[xcat-user] Issue when running nodeset - kcmdline & initrd not set using xcat 2.13 and CentOS7

Discussion:

J. Smith

2017-07-20 21:47:36 UTC

Hello,

I have installed a new version of xcat v2.13 on CentOS7 and have migrated
my xcat tables from another xcat server that was running CentOS6 with xcat
2.9

The migrated data looks fine but when adding new nodes, I see some
incomplete information after I run nodeset. For instance on node 113 there
is no information set on kcmdline & initrd. Information copied over from
xcatdump for node 102 looks fine.
Does anyone has any suggestions?

New Environment Information:

2 Managements Nodes set for HA using GPFS to share the xCAT data and I use
a VIP Interface to bring up xcat services.

Virtual IP Alias Address: xcatmn 192.168.248.60
Primary Management Node: ms1 192.168.248.61
Secondary Management Node: ms2 192.168.248.62

[[hpcslurm01]***@ms1 x86_64]# lsxcatd -v
Version 2.13.3 (git commit 7f9e0b57554c3a1975b83308935b7d183c632a9d, built
Thu Apr 13 01:56:07 EDT 2017)

CentOS 7
Linux ms1 3.10.0-229.el7.x86_64

[[hpcslurm01]***@ms1 x86_64]# lsdef -t site -l
Object name: clustersite
SNsyncfiledir=/var/xcat/syncfiles
auditnosyslog=0
auditskipcmds=ALL
blademaxp=64
cleanupxcatpost=no
consoleondemand=no
databaseloc=/var/lib
db2installloc=/mntdb2
dhcpinterfaces=em3:0
dhcplease=43200
dnshandler=ddns
domain=panther.net
enableASMI=no
forwarders=131.94.205.10,131.94.7.220
fsptimeout=0
installdir=/install
ipmimaxp=64
ipmiretries=3
ipmitimeout=2
master=192.168.248.60
maxssh=8
nameservers=192.168.248.61,192.168.248.62
nodesyncfiledir=/var/xcat/node/syncfiles
ntpservers=ms1,ms2
powerinterval=0
ppcmaxp=64
ppcretry=3
ppctimeout=0
sharedtftp=1
sshbetweennodes=ALLGROUPS
syspowerinterval=0
tftpdir=/tftpboot
timezone=America/New_York
useNmapfromMN=no
vsftp=n
xcatconfdir=/etc/xcat
xcatdport=3001
xcatiport=3002
xcatsslversion=TLSv1

Migrated data for node 102 looks fine:
[[hpcslurm01]***@ms1 x86_64]# lsdef n102
Object name: n102
arch=x86_64
bmc=r102
currstate=netboot centos6.5-x86_64-panther-pec6220
groups=panther-pem420,dell
hostnames=n102

initrd=xcat/osimage/centos6.5-x86_64-netboot-panther-pec6220/initrd-stateless.gz
installnic=em1
ip=192.168.248.142
kcmdline=imgurl=
http://xcatmn:80//install/netboot/centos6.5/x86_64/panther-pec6220/rootimg.gz
XCAT=xcatmn:3001 NODE=n102 FC=0 ifname=em1:F8:CA:B8:A9:0E:04 netdev=em1
console=tty0 console=ttyS0,115200
kernel=xcat/osimage/centos6.5-x86_64-netboot-panther-pec6220/kernel
mac=F8:CA:B8:A9:0E:04
mgt=ipmi
netboot=pxe
os=centos6.5

postscripts=syslog,remoteshell,otherpkgs,syncfiles,panther-bondtrunknics,panther-ldap,panther-nouserlogin,panther-engineerlicense,panther-resolv,panther-yumrepo-centos65,panther-rpms,panther-mlnx-ofed,panther-upgradegpfs-diskless-4.2.1-2,panther-setupgpfs,panther-lsf
power=impi
primarynic=em1
profile=panther-pec6220
provmethod=centos6.5-x86_64-netboot-panther-pec6220
serialport=0
serialspeed=115200
status=booted
statustime=02-08-2017 16:57:05
updatestatus=synced
updatestatustime=03-30-2017 17:15:00
xcatmaster=xcatmn

New added node 113 is not setup properly, there is no information set on
kcmdline & initrd
[[hpcslurm01]***@ms1 x86_64]# lsdef n113
Object name: n113
arch=x86_64
bmc=r113
currstate=netboot centos6.5-x86_64-panther-pec6220
groups=panther-pem420,dell
hostnames=n113
installnic=em1
ip=192.168.248.153
mac=48:4D:7E:81:F2:93
mgt=ipmi
netboot=pxe
os=centos6.5

postscripts=syslog,remoteshell,otherpkgs,syncfiles,panther-bondtrunknics,panther-ldap,panther-nouserlogin,panther-engineerlicense,panther-resolv,panther-yumrepo-centos65,panther-rpms,panther-mlnx-ofed,panther-upgradegpfs-diskless-4.2.1-2,panther-setupgpfs,panther-lsf
power=impi
primarynic=em1
profile=panther-pec6220
provmethod=centos6.5-x86_64-netboot-panther-pec6220
serialport=0
serialspeed=115200
xcatmaster=xcatmn

Thanks!

Casandra H Qiu

2017-07-20 22:13:15 UTC

Permalink

Hi:

For better performance, nodeset will not add kcmdline and initrd to node
definition any more.
But you can find those in the /tftpboot/petitboot/nodename after ran
nodeset command.

Thanks,
Casandra

...................................................................
Casandra Hong Qiu
Phone: (845) 433-9291, t/l 293-9291
Office: Building 8, 3-B-04
***@us.ibm.com

From: "J. Smith" <***@gmail.com>
To: xCAT Users Mailing list <xcat-***@lists.sourceforge.net>
Date: 07/20/2017 05:48 PM
Subject: [xcat-user] Issue when running nodeset - kcmdline & initrd not
set using xcat 2.13 and CentOS7

Hello,

I have installed a new version of xcat v2.13 on CentOS7 and have migrated
my xcat tables from another xcat server that was running CentOS6 with xcat
2.9

The migrated data looks fine but when adding new nodes, I see some
incomplete information after I run nodeset. For instance on node 113 there
is no information set on kcmdline & initrd. Information copied over from
xcatdump for node 102 looks fine.
Does anyone has any suggestions?

New Environment Information:

2 Managements Nodes set for HA using GPFS to share the xCAT data and I use
a VIP Interface to bring up xcat services.

Virtual IP Alias Address: xcatmn 192.168.248.60
Primary Management Node: ms1 192.168.248.61
Secondary Management Node: ms2 192.168.248.62

[[hpcslurm01]***@ms1 x86_64]# lsxcatd -v
Version 2.13.3 (git commit 7f9e0b57554c3a1975b83308935b7d183c632a9d, built
Thu Apr 13 01:56:07 EDT 2017)

CentOS 7
Linux ms1 3.10.0-229.el7.x86_64

[[hpcslurm01]***@ms1 x86_64]# lsdef -t site -l
Object name: clustersite
    SNsyncfiledir=/var/xcat/syncfiles
    auditnosyslog=0
    auditskipcmds=ALL
    blademaxp=64
    cleanupxcatpost=no
    consoleondemand=no
    databaseloc=/var/lib
    db2installloc=/mntdb2
    dhcpinterfaces=em3:0
    dhcplease=43200
    dnshandler=ddns
    domain=panther.net
    enableASMI=no
    forwarders=131.94.205.10,131.94.7.220
    fsptimeout=0
    installdir=/install
    ipmimaxp=64
    ipmiretries=3
    ipmitimeout=2
    master=192.168.248.60
    maxssh=8
    nameservers=192.168.248.61,192.168.248.62
    nodesyncfiledir=/var/xcat/node/syncfiles
    ntpservers=ms1,ms2
    powerinterval=0
    ppcmaxp=64
    ppcretry=3
    ppctimeout=0
    sharedtftp=1
    sshbetweennodes=ALLGROUPS
    syspowerinterval=0
    tftpdir=/tftpboot
    timezone=America/New_York
    useNmapfromMN=no
    vsftp=n
    xcatconfdir=/etc/xcat
    xcatdport=3001
    xcatiport=3002
    xcatsslversion=TLSv1

Migrated data for node 102 looks fine:
[[hpcslurm01]***@ms1 x86_64]# lsdef n102
Object name: n102
    arch=x86_64
    bmc=r102
    currstate=netboot centos6.5-x86_64-panther-pec6220
    groups=panther-pem420,dell
    hostnames=n102

initrd=xcat/osimage/centos6.5-x86_64-netboot-panther-pec6220/initrd-stateless.gz

    installnic=em1
    ip=192.168.248.142
    kcmdline=imgurl=
http://xcatmn:80//install/netboot/centos6.5/x86_64/panther-pec6220/rootimg.gz
XCAT=xcatmn:3001 NODE=n102 FC=0 ifname=em1:F8:CA:B8:A9:0E:04 netdev=em1
console=tty0 console=ttyS0,115200
    kernel=xcat/osimage/centos6.5-x86_64-netboot-panther-pec6220/kernel
    mac=F8:CA:B8:A9:0E:04
    mgt=ipmi
    netboot=pxe
    os=centos6.5

postscripts=syslog,remoteshell,otherpkgs,syncfiles,panther-bondtrunknics,panther-ldap,panther-nouserlogin,panther-engineerlicense,panther-resolv,panther-yumrepo-centos65,panther-rpms,panther-mlnx-ofed,panther-upgradegpfs-diskless-4.2.1-2,panther-setupgpfs,panther-lsf

    power=impi
    primarynic=em1
    profile=panther-pec6220
    provmethod=centos6.5-x86_64-netboot-panther-pec6220
    serialport=0
    serialspeed=115200
    status=booted
    statustime=02-08-2017 16:57:05
    updatestatus=synced
    updatestatustime=03-30-2017 17:15:00
    xcatmaster=xcatmn

New added node 113 is not setup properly, there is no information set on
kcmdline & initrd
[[hpcslurm01]***@ms1 x86_64]# lsdef n113
Object name: n113
    arch=x86_64
    bmc=r113
    currstate=netboot centos6.5-x86_64-panther-pec6220
    groups=panther-pem420,dell
    hostnames=n113
    installnic=em1
    ip=192.168.248.153
    mac=48:4D:7E:81:F2:93
    mgt=ipmi
    netboot=pxe
    os=centos6.5

postscripts=syslog,remoteshell,otherpkgs,syncfiles,panther-bondtrunknics,panther-ldap,panther-nouserlogin,panther-engineerlicense,panther-resolv,panther-yumrepo-centos65,panther-rpms,panther-mlnx-ofed,panther-upgradegpfs-diskless-4.2.1-2,panther-setupgpfs,panther-lsf

    power=impi
    primarynic=em1
    profile=panther-pec6220
    provmethod=centos6.5-x86_64-netboot-panther-pec6220
    serialport=0
    serialspeed=115200
    xcatmaster=xcatmn

Thanks!

J. Smith

2017-07-21 19:17:12 UTC

Permalink

Hi,
Are you saying that kcmdline and initrd does not need to be defined anymore
for a diskless installation? So how does the new xCAT knows where to get
initrd and the kcmdline for pxe boot?
I checked this path /tftpboot/petitboot/ but I don't have it on my
environment.

Thanks.

On Thu, Jul 20, 2017 at 6:13 PM, Casandra H Qiu <***@us.ibm.com> wrote:

> Hi:
>
> For better performance, nodeset will not add kcmdline and initrd to node
> definition any more.
> But you can find those in the /tftpboot/petitboot/nodename after ran
> nodeset command.
>
>
> Thanks,
> Casandra
>
> ...................................................................
> Casandra Hong Qiu
> Phone: (845) 433-9291, t/l 293-9291
> Office: Building 8, 3-B-04
> ***@us.ibm.com
>
>
>
> [image: Inactive hide details for "J. Smith" ---07/20/2017 05:48:55
> PM---Hello, I have installed a new version of xcat v2.13 on CentOS7]"J.
> Smith" ---07/20/2017 05:48:55 PM---Hello, I have installed a new version of
> xcat v2.13 on CentOS7 and have migrated
>
> From: "J. Smith" <***@gmail.com>
> To: xCAT Users Mailing list <xcat-***@lists.sourceforge.net>
> Date: 07/20/2017 05:48 PM
> Subject: [xcat-user] Issue when running nodeset - kcmdline & initrd not
> set using xcat 2.13 and CentOS7
> ------------------------------
>
>
>
> Hello,
>
> I have installed a new version of xcat v2.13 on CentOS7 and have migrated
> my xcat tables from another xcat server that was running CentOS6 with xcat
> 2.9
>
> The migrated data looks fine but when adding new nodes, I see some
> incomplete information after I run nodeset. For instance on node 113 there
> is no information set on kcmdline & initrd. Information copied over from
> xcatdump for node 102 looks fine.
> Does anyone has any suggestions?
>
> New Environment Information:
>
> 2 Managements Nodes set for HA using GPFS to share the xCAT data and I use
> a VIP Interface to bring up xcat services.
>
> Virtual IP Alias Address: xcatmn 192.168.248.60
> Primary Management Node: ms1 192.168.248.61
> Secondary Management Node: ms2 192.168.248.62
>
> [[hpcslurm01]***@ms1 x86_64]# lsxcatd -v
> Version 2.13.3 (git commit 7f9e0b57554c3a1975b83308935b7d183c632a9d,
> built Thu Apr 13 01:56:07 EDT 2017)
>
> CentOS 7
> Linux ms1 3.10.0-229.el7.x86_64
>
> [[hpcslurm01]***@ms1 x86_64]# lsdef -t site -l
> Object name: clustersite
> SNsyncfiledir=/var/xcat/syncfiles
> auditnosyslog=0
> auditskipcmds=ALL
> blademaxp=64
> cleanupxcatpost=no
> consoleondemand=no
> databaseloc=/var/lib
> db2installloc=/mntdb2
> dhcpinterfaces=em3:0
> dhcplease=43200
> dnshandler=ddns
> domain=*panther.net* <http://panther.net/>
> enableASMI=no
> forwarders=131.94.205.10,131.94.7.220
> fsptimeout=0
> installdir=/install
> ipmimaxp=64
> ipmiretries=3
> ipmitimeout=2
> master=192.168.248.60
> maxssh=8
> nameservers=192.168.248.61,192.168.248.62
> nodesyncfiledir=/var/xcat/node/syncfiles
> ntpservers=ms1,ms2
> powerinterval=0
> ppcmaxp=64
> ppcretry=3
> ppctimeout=0
> sharedtftp=1
> sshbetweennodes=ALLGROUPS
> syspowerinterval=0
> tftpdir=/tftpboot
> timezone=America/New_York
> useNmapfromMN=no
> vsftp=n
> xcatconfdir=/etc/xcat
> xcatdport=3001
> xcatiport=3002
> xcatsslversion=TLSv1
>
> Migrated data for node 102 looks fine:
> [[hpcslurm01]***@ms1 x86_64]# lsdef n102
> Object name: n102
> arch=x86_64
> bmc=r102
> currstate=netboot centos6.5-x86_64-panther-pec6220
> groups=panther-pem420,dell
> hostnames=n102
> initrd=xcat/osimage/centos6.5-x86_64-netboot-panther-
> pec6220/initrd-stateless.gz
> installnic=em1
> ip=192.168.248.142
> kcmdline=imgurl=
> *http://xcatmn:80//install/netboot/centos6.5/x86_64/panther-pec6220/rootimg.gz*
> <http://xcatmn//install/netboot/centos6.5/x86_64/panther-pec6220/rootimg.gz>
> XCAT=xcatmn:3001 NODE=n102 FC=0 ifname=em1:F8:CA:B8:A9:0E:04 netdev=em1
> console=tty0 console=ttyS0,115200
> kernel=xcat/osimage/centos6.5-x86_64-netboot-panther-pec6220/kernel
> mac=F8:CA:B8:A9:0E:04
> mgt=ipmi
> netboot=pxe
> os=centos6.5
> postscripts=syslog,remoteshell,otherpkgs,syncfiles,panther-
> bondtrunknics,panther-ldap,panther-nouserlogin,panther-
> engineerlicense,panther-resolv,panther-yumrepo-
> centos65,panther-rpms,panther-mlnx-ofed,panther-upgradegpfs-
> diskless-4.2.1-2,panther-setupgpfs,panther-lsf
> power=impi
> primarynic=em1
> profile=panther-pec6220
> provmethod=centos6.5-x86_64-netboot-panther-pec6220
> serialport=0
> serialspeed=115200
> status=booted
> statustime=02-08-2017 16:57:05
> updatestatus=synced
> updatestatustime=03-30-2017 17:15:00
> xcatmaster=xcatmn
>
>
> New added node 113 is not setup properly, there is no information set on
> kcmdline & initrd
> [[hpcslurm01]***@ms1 x86_64]# lsdef n113
> Object name: n113
> arch=x86_64
> bmc=r113
> currstate=netboot centos6.5-x86_64-panther-pec6220
> groups=panther-pem420,dell
> hostnames=n113
> installnic=em1
> ip=192.168.248.153
> mac=48:4D:7E:81:F2:93
> mgt=ipmi
> netboot=pxe
> os=centos6.5
> postscripts=syslog,remoteshell,otherpkgs,syncfiles,panther-
> bondtrunknics,panther-ldap,panther-nouserlogin,panther-
> engineerlicense,panther-resolv,panther-yumrepo-
> centos65,panther-rpms,panther-mlnx-ofed,panther-upgradegpfs-
> diskless-4.2.1-2,panther-setupgpfs,panther-lsf
> power=impi
> primarynic=em1
> profile=panther-pec6220
> provmethod=centos6.5-x86_64-netboot-panther-pec6220
> serialport=0
> serialspeed=115200
> xcatmaster=xcatmn
>
>
> Thanks!
>
>
> ------------------------------------------------------------
> ------------------
> Check out the vibrant tech community on one of the world's most
> engaging tech sites, Slashdot.org! http://sdm.link/slashdot______
> _________________________________________
> xCAT-user mailing list
> xCAT-***@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/xcat-user
>
>
>
> ------------------------------------------------------------
> ------------------
> Check out the vibrant tech community on one of the world's most
> engaging tech sites, Slashdot.org! http://sdm.link/slashdot
> _______________________________________________
> xCAT-user mailing list
> xCAT-***@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/xcat-user
>
>

Long LA Cheng

2017-07-24 01:06:53 UTC

Permalink

------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot

J. Smith

2017-07-24 15:09:43 UTC

Permalink

Thank you Long for your reply,

I did check the information for my node, notice that in the append the
ifname entry was missing.

DEFAULT xCAT
LABEL xCAT
KERNEL xcat/osimage/centos6.5-x86_64-netboot-panther-pec6220/kernel
APPEND
initrd=xcat/osimage/centos6.5-x86_64-netboot-panther-pec6220/initrd-stateless.gz
imgurl=
http://xcatmn:80//install/netboot/centos6.5/x86_64/panther-pec6220/rootimg.gz
XCAT=xcatmn:300
1 NODE=n113 FC=0 netdev=em1 console=tty0 console=ttyS0,115200
IPAPPEND 2

I try adding it (ifname=em1:48:4D:7E:81:F2:93) but I still have the same
issue.
The pxe boot seems to work until it detects the network interface but then
nothing happens. Does not seem that the post installation and postscripts
start running.

Any suggestions?

Thanks!

On Sun, Jul 23, 2017 at 9:06 PM, Long LA Cheng <***@cn.ibm.com> wrote:

> Hi,
>
> As pxe is used as the netboot loader, you can check the
> 'kernel/initrd/kcmdline' configuration in '/tftpboot/pxelinux.cfg/<node>'.
>
> Thanks.
>
> Best Regards
>
> Long Cheng(çšéŸ)
> IBM Systems &Technology Group, Development
> SOFTWARE ENGINEER
> Tel:86-10-82453046
> Email:***@cn.ibm.com
> Address: 3F, Building 28, Zhong Guan Cun Software Park, No.8, Dong Bei
> Wang West Road, Hai Dian District, Beijing 100193, PRC
> å°åïŒåœéåäžæºåšäžåœ(æèµ)æéå¬åž, äžåœç³»ç»ç§æå®éªå®€, åäº¬åžæµ·æ·åºäžåæºè¥¿è·¯8å·äžå³æèœ¯ä»¶å28å·æ¥Œ3å±ïŒé®çŒ:100193
>
>
>
> ----- Original message -----
> From: "J. Smith" <***@gmail.com>
> To: xCAT Users Mailing list <xcat-***@lists.sourceforge.net>
> Cc:
> Subject: Re: [xcat-user] Issue when running nodeset - kcmdline & initrd
> not set using xcat 2.13 and CentOS7
> Date: Sat, Jul 22, 2017 3:18 AM
>
> Hi,
> Are you saying that kcmdline and initrd does not need to be defined
> anymore for a diskless installation? So how does the new xCAT knows where
> to get initrd and the kcmdline for pxe boot?
> I checked this path /tftpboot/petitboot/ but I don't have it on my
> environment.
>
> Thanks.
>
> On Thu, Jul 20, 2017 at 6:13 PM, Casandra H Qiu <***@us.ibm.com>
> wrote:
>
> Hi:
>
> For better performance, nodeset will not add kcmdline and initrd to node
> definition any more.
> But you can find those in the /tftpboot/petitboot/nodename after ran
> nodeset command.
>
>
> Thanks,
> Casandra
>
> ...................................................................
> Casandra Hong Qiu
> Phone: (845) 433-9291, t/l 293-9291
> Office: Building 8, 3-B-04
> ***@us.ibm.com
>
>
>
> [image: Inactive hide details for "J. Smith" ---07/20/2017 05:48:55
> PM---Hello, I have installed a new version of xcat v2.13 on CentOS7]"J.
> Smith" ---07/20/2017 05:48:55 PM---Hello, I have installed a new version of
> xcat v2.13 on CentOS7 and have migrated
>
> From: "J. Smith" <***@gmail.com>
> To: xCAT Users Mailing list <xcat-***@lists.sourceforge.net>
> Date: 07/20/2017 05:48 PM
> Subject: [xcat-user] Issue when running nodeset - kcmdline & initrd not
> set using xcat 2.13 and CentOS7
> ------------------------------
>
>
>
> Hello,
>
> I have installed a new version of xcat v2.13 on CentOS7 and have migrated
> my xcat tables from another xcat server that was running CentOS6 with xcat
> 2.9
>
> The migrated data looks fine but when adding new nodes, I see some
> incomplete information after I run nodeset. For instance on node 113 there
> is no information set on kcmdline & initrd. Information copied over from
> xcatdump for node 102 looks fine.
> Does anyone has any suggestions?
>
> New Environment Information:
>
> 2 Managements Nodes set for HA using GPFS to share the xCAT data and I use
> a VIP Interface to bring up xcat services.
>
> Virtual IP Alias Address: xcatmn 192.168.248.60
> Primary Management Node: ms1 192.168.248.61
> Secondary Management Node: ms2 192.168.248.62
>
> [[hpcslurm01]***@ms1 x86_64]# lsxcatd -v
> Version 2.13.3 (git commit 7f9e0b57554c3a1975b83308935b7d183c632a9d,
> built Thu Apr 13 01:56:07 EDT 2017)
>
> CentOS 7
> Linux ms1 3.10.0-229.el7.x86_64
>
> [[hpcslurm01]***@ms1 x86_64]# lsdef -t site -l
> Object name: clustersite
> SNsyncfiledir=/var/xcat/syncfiles
> auditnosyslog=0
> auditskipcmds=ALL
> blademaxp=64
> cleanupxcatpost=no
> consoleondemand=no
> databaseloc=/var/lib
> db2installloc=/mntdb2
> dhcpinterfaces=em3:0
> dhcplease=43200
> dnshandler=ddns
> domain=*panther.net* <http://panther.net/>
> enableASMI=no
> forwarders=131.94.205.10,131.94.7.220
> fsptimeout=0
> installdir=/install
> ipmimaxp=64
> ipmiretries=3
> ipmitimeout=2
> master=192.168.248.60
> maxssh=8
> nameservers=192.168.248.61,192.168.248.62
> nodesyncfiledir=/var/xcat/node/syncfiles
> ntpservers=ms1,ms2
> powerinterval=0
> ppcmaxp=64
> ppcretry=3
> ppctimeout=0
> sharedtftp=1
> sshbetweennodes=ALLGROUPS
> syspowerinterval=0
> tftpdir=/tftpboot
> timezone=America/New_York
> useNmapfromMN=no
> vsftp=n
> xcatconfdir=/etc/xcat
> xcatdport=3001
> xcatiport=3002
> xcatsslversion=TLSv1
>
> Migrated data for node 102 looks fine:
> [[hpcslurm01]***@ms1 x86_64]# lsdef n102
> Object name: n102
> arch=x86_64
> bmc=r102
> currstate=netboot centos6.5-x86_64-panther-pec6220
> groups=panther-pem420,dell
> hostnames=n102
> initrd=xcat/osimage/centos6.5-x86_64-netboot-panther-pec6220
> /initrd-stateless.gz
> installnic=em1
> ip=192.168.248.142
> kcmdline=imgurl=*http://xcatmn
> <http://xcatmn>:80//install/netboot/centos6.5/x86_64/panther-pec6220/rootimg.gz*
> XCAT=xcatmn:3001 NODE=n102 FC=0 ifname=em1:F8:CA:B8:A9:0E:04 netdev=em1
> console=tty0 console=ttyS0,115200
> kernel=xcat/osimage/centos6.5-x86_64-netboot-panther-pec6220/kernel
> mac=F8:CA:B8:A9:0E:04
> mgt=ipmi
> netboot=pxe
> os=centos6.5
> postscripts=syslog,remoteshell,otherpkgs,syncfiles,panther-b
> ondtrunknics,panther-ldap,panther-nouserlogin,panther-engine
> erlicense,panther-resolv,panther-yumrepo-centos65,
> panther-rpms,panther-mlnx-ofed,panther-upgradegpfs-diskl
> ess-4.2.1-2,panther-setupgpfs,panther-lsf
> power=impi
> primarynic=em1
> profile=panther-pec6220
> provmethod=centos6.5-x86_64-netboot-panther-pec6220
> serialport=0
> serialspeed=115200
> status=booted
> statustime=02-08-2017 16:57:05
> updatestatus=synced
> updatestatustime=03-30-2017 17:15:00
> xcatmaster=xcatmn
>
>
> New added node 113 is not setup properly, there is no information set on
> kcmdline & initrd
> [[hpcslurm01]***@ms1 x86_64]# lsdef n113
> Object name: n113
> arch=x86_64
> bmc=r113
> currstate=netboot centos6.5-x86_64-panther-pec6220
> groups=panther-pem420,dell
> hostnames=n113
> installnic=em1
> ip=192.168.248.153
> mac=48:4D:7E:81:F2:93
> mgt=ipmi
> netboot=pxe
> os=centos6.5
> postscripts=syslog,remoteshell,otherpkgs,syncfiles,panther-b
> ondtrunknics,panther-ldap,panther-nouserlogin,panther-engine
> erlicense,panther-resolv,panther-yumrepo-centos65,
> panther-rpms,panther-mlnx-ofed,panther-upgradegpfs-diskl
> ess-4.2.1-2,panther-setupgpfs,panther-lsf
> power=impi
> primarynic=em1
> profile=panther-pec6220
> provmethod=centos6.5-x86_64-netboot-panther-pec6220
> serialport=0
> serialspeed=115200
> xcatmaster=xcatmn
>
>
> Thanks!
>
>
> ------------------------------------------------------------
> ------------------
> Check out the vibrant tech community on one of the world's most
> engaging tech sites, Slashdot.org! http://sdm.link/slashdot______
> _________________________________________
> xCAT-user mailing list
> xCAT-***@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/xcat-user
>
>
>
>
>
> ------------------------------------------------------------
> ------------------
> Check out the vibrant tech community on one of the world's most
> engaging tech sites, Slashdot.org! http://sdm.link/slashdot
> _______________________________________________
> xCAT-user mailing list
> xCAT-***@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/xcat-user
>
>
> ------------------------------------------------------------
> ------------------
> Check out the vibrant tech community on one of the world's most
> engaging tech sites, Slashdot.org! http://sdm.link/slashdot
> _______________________________________________
> xCAT-user mailing list
> xCAT-***@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/xcat-user
>
>
>
>
> ------------------------------------------------------------
> ------------------
> Check out the vibrant tech community on one of the world's most
> engaging tech sites, Slashdot.org! http://sdm.link/slashdot
> _______________________________________________
> xCAT-user mailing list
> xCAT-***@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/xcat-user
>
>

J. Smith

2017-07-24 20:53:26 UTC

Permalink

In addition to my previous email, I have also noticed the following, not
sure if it is a bug:

1) If I update the bootparams.addkcmdline entry for the specific node it
does not seem to update the content of the node file under pxelinux.cfg. Is
that normal?
Changes seem to take effect only when I modify directly on the node file
under pxelinux.cfg

2) I see some permissions Error on /var/log/html/error_log
[Mon Jul 24 16:42:39.622769 2017] [core:error] [pid 187765] (13)Permission
denied: [client 192.168.248.153:56111] AH00035: access to
/install/netboot/centos6.5/x86_64/panther-pec6220/rootimg.gz denied
(filesystem path '/install/netboot/centos6.5') because search permissions
are missing on a component of the path

I compared with my old environment and it seems to be the same. Any
suggestions?

Thanks!

On Mon, Jul 24, 2017 at 11:09 AM, J. Smith <***@gmail.com> wrote:

> Thank you Long for your reply,
>
> I did check the information for my node, notice that in the append the
> ifname entry was missing.
>
> DEFAULT xCAT
> LABEL xCAT
> KERNEL xcat/osimage/centos6.5-x86_64-netboot-panther-pec6220/kernel
> APPEND initrd=xcat/osimage/centos6.5-x86_64-netboot-panther-pec6220/initrd-stateless.gz
> imgurl=http://xcatmn:80//install/netboot/centos6.5/x86_
> 64/panther-pec6220/rootimg.gz XCAT=xcatmn:300
> 1 NODE=n113 FC=0 netdev=em1 console=tty0 console=ttyS0,115200
> IPAPPEND 2
>
>
> I try adding it (ifname=em1:48:4D:7E:81:F2:93) but I still have the same
> issue.
> The pxe boot seems to work until it detects the network interface but then
> nothing happens. Does not seem that the post installation and postscripts
> start running.
>
> Any suggestions?
>
> Thanks!
>
> On Sun, Jul 23, 2017 at 9:06 PM, Long LA Cheng <***@cn.ibm.com>
> wrote:
>
>> Hi,
>>
>> As pxe is used as the netboot loader, you can check the
>> 'kernel/initrd/kcmdline' configuration in '/tftpboot/pxelinux.cfg/<node>
>> '.
>>
>> Thanks.
>>
>> Best Regards
>>
>> Long Cheng(çšéŸ)
>> IBM Systems &Technology Group, Development
>> SOFTWARE ENGINEER
>> Tel:86-10-82453046
>> Email:***@cn.ibm.com
>> Address: 3F, Building 28, Zhong Guan Cun Software Park, No.8, Dong Bei
>> Wang West Road, Hai Dian District, Beijing 100193, PRC
>> å°åïŒåœéåäžæºåšäžåœ(æèµ)æéå¬åž, äžåœç³»ç»ç§æå®éªå®€, åäº¬åžæµ·æ·åºäžåæºè¥¿è·¯8å·äžå³æèœ¯ä»¶å28å·æ¥Œ3å±ïŒé®çŒ:100193
>>
>>
>>
>> ----- Original message -----
>> From: "J. Smith" <***@gmail.com>
>> To: xCAT Users Mailing list <xcat-***@lists.sourceforge.net>
>> Cc:
>> Subject: Re: [xcat-user] Issue when running nodeset - kcmdline & initrd
>> not set using xcat 2.13 and CentOS7
>> Date: Sat, Jul 22, 2017 3:18 AM
>>
>> Hi,
>> Are you saying that kcmdline and initrd does not need to be defined
>> anymore for a diskless installation? So how does the new xCAT knows where
>> to get initrd and the kcmdline for pxe boot?
>> I checked this path /tftpboot/petitboot/ but I don't have it on my
>> environment.
>>
>> Thanks.
>>
>> On Thu, Jul 20, 2017 at 6:13 PM, Casandra H Qiu <***@us.ibm.com>
>> wrote:
>>
>> Hi:
>>
>> For better performance, nodeset will not add kcmdline and initrd to node
>> definition any more.
>> But you can find those in the /tftpboot/petitboot/nodename after ran
>> nodeset command.
>>
>>
>> Thanks,
>> Casandra
>>
>> ...................................................................
>> Casandra Hong Qiu
>> Phone: (845) 433-9291, t/l 293-9291
>> Office: Building 8, 3-B-04
>> ***@us.ibm.com
>>
>>
>>
>> [image: Inactive hide details for "J. Smith" ---07/20/2017 05:48:55
>> PM---Hello, I have installed a new version of xcat v2.13 on CentOS7]"J.
>> Smith" ---07/20/2017 05:48:55 PM---Hello, I have installed a new version of
>> xcat v2.13 on CentOS7 and have migrated
>>
>> From: "J. Smith" <***@gmail.com>
>> To: xCAT Users Mailing list <xcat-***@lists.sourceforge.net>
>> Date: 07/20/2017 05:48 PM
>> Subject: [xcat-user] Issue when running nodeset - kcmdline & initrd not
>> set using xcat 2.13 and CentOS7
>> ------------------------------
>>
>>
>>
>> Hello,
>>
>> I have installed a new version of xcat v2.13 on CentOS7 and have migrated
>> my xcat tables from another xcat server that was running CentOS6 with xcat
>> 2.9
>>
>> The migrated data looks fine but when adding new nodes, I see some
>> incomplete information after I run nodeset. For instance on node 113 there
>> is no information set on kcmdline & initrd. Information copied over from
>> xcatdump for node 102 looks fine.
>> Does anyone has any suggestions?
>>
>> New Environment Information:
>>
>> 2 Managements Nodes set for HA using GPFS to share the xCAT data and I
>> use a VIP Interface to bring up xcat services.
>>
>> Virtual IP Alias Address: xcatmn 192.168.248.60
>> Primary Management Node: ms1 192.168.248.61
>> Secondary Management Node: ms2 192.168.248.62
>>
>> [[hpcslurm01]***@ms1 x86_64]# lsxcatd -v
>> Version 2.13.3 (git commit 7f9e0b57554c3a1975b83308935b7d183c632a9d,
>> built Thu Apr 13 01:56:07 EDT 2017)
>>
>> CentOS 7
>> Linux ms1 3.10.0-229.el7.x86_64
>>
>> [[hpcslurm01]***@ms1 x86_64]# lsdef -t site -l
>> Object name: clustersite
>> SNsyncfiledir=/var/xcat/syncfiles
>> auditnosyslog=0
>> auditskipcmds=ALL
>> blademaxp=64
>> cleanupxcatpost=no
>> consoleondemand=no
>> databaseloc=/var/lib
>> db2installloc=/mntdb2
>> dhcpinterfaces=em3:0
>> dhcplease=43200
>> dnshandler=ddns
>> domain=*panther.net* <http://panther.net/>
>> enableASMI=no
>> forwarders=131.94.205.10,131.94.7.220
>> fsptimeout=0
>> installdir=/install
>> ipmimaxp=64
>> ipmiretries=3
>> ipmitimeout=2
>> master=192.168.248.60
>> maxssh=8
>> nameservers=192.168.248.61,192.168.248.62
>> nodesyncfiledir=/var/xcat/node/syncfiles
>> ntpservers=ms1,ms2
>> powerinterval=0
>> ppcmaxp=64
>> ppcretry=3
>> ppctimeout=0
>> sharedtftp=1
>> sshbetweennodes=ALLGROUPS
>> syspowerinterval=0
>> tftpdir=/tftpboot
>> timezone=America/New_York
>> useNmapfromMN=no
>> vsftp=n
>> xcatconfdir=/etc/xcat
>> xcatdport=3001
>> xcatiport=3002
>> xcatsslversion=TLSv1
>>
>> Migrated data for node 102 looks fine:
>> [[hpcslurm01]***@ms1 x86_64]# lsdef n102
>> Object name: n102
>> arch=x86_64
>> bmc=r102
>> currstate=netboot centos6.5-x86_64-panther-pec6220
>> groups=panther-pem420,dell
>> hostnames=n102
>> initrd=xcat/osimage/centos6.5-x86_64-netboot-panther-pec6220
>> /initrd-stateless.gz
>> installnic=em1
>> ip=192.168.248.142
>> kcmdline=imgurl=*http://xcatmn
>> <http://xcatmn>:80//install/netboot/centos6.5/x86_64/panther-pec6220/rootimg.gz*
>> XCAT=xcatmn:3001 NODE=n102 FC=0 ifname=em1:F8:CA:B8:A9:0E:04 netdev=em1
>> console=tty0 console=ttyS0,115200
>> kernel=xcat/osimage/centos6.5-x86_64-netboot-panther-pec6220/kernel
>> mac=F8:CA:B8:A9:0E:04
>> mgt=ipmi
>> netboot=pxe
>> os=centos6.5
>> postscripts=syslog,remoteshell,otherpkgs,syncfiles,panther-b
>> ondtrunknics,panther-ldap,panther-nouserlogin,panther-engine
>> erlicense,panther-resolv,panther-yumrepo-centos65,panther-
>> rpms,panther-mlnx-ofed,panther-upgradegpfs-diskless-
>> 4.2.1-2,panther-setupgpfs,panther-lsf
>> power=impi
>> primarynic=em1
>> profile=panther-pec6220
>> provmethod=centos6.5-x86_64-netboot-panther-pec6220
>> serialport=0
>> serialspeed=115200
>> status=booted
>> statustime=02-08-2017 16:57:05
>> updatestatus=synced
>> updatestatustime=03-30-2017 17:15:00
>> xcatmaster=xcatmn
>>
>>
>> New added node 113 is not setup properly, there is no information set on
>> kcmdline & initrd
>> [[hpcslurm01]***@ms1 x86_64]# lsdef n113
>> Object name: n113
>> arch=x86_64
>> bmc=r113
>> currstate=netboot centos6.5-x86_64-panther-pec6220
>> groups=panther-pem420,dell
>> hostnames=n113
>> installnic=em1
>> ip=192.168.248.153
>> mac=48:4D:7E:81:F2:93
>> mgt=ipmi
>> netboot=pxe
>> os=centos6.5
>> postscripts=syslog,remoteshell,otherpkgs,syncfiles,panther-b
>> ondtrunknics,panther-ldap,panther-nouserlogin,panther-engine
>> erlicense,panther-resolv,panther-yumrepo-centos65,panther-
>> rpms,panther-mlnx-ofed,panther-upgradegpfs-diskless-
>> 4.2.1-2,panther-setupgpfs,panther-lsf
>> power=impi
>> primarynic=em1
>> profile=panther-pec6220
>> provmethod=centos6.5-x86_64-netboot-panther-pec6220
>> serialport=0
>> serialspeed=115200
>> xcatmaster=xcatmn
>>
>>
>> Thanks!
>>
>>
>> ------------------------------------------------------------
>> ------------------
>> Check out the vibrant tech community on one of the world's most
>> engaging tech sites, Slashdot.org! http://sdm.link/slashdot______
>> _________________________________________
>> xCAT-user mailing list
>> xCAT-***@lists.sourceforge.net
>> https://lists.sourceforge.net/lists/listinfo/xcat-user
>>
>>
>>
>>
>>
>> ------------------------------------------------------------
>> ------------------
>> Check out the vibrant tech community on one of the world's most
>> engaging tech sites, Slashdot.org! http://sdm.link/slashdot
>> _______________________________________________
>> xCAT-user mailing list
>> xCAT-***@lists.sourceforge.net
>> https://lists.sourceforge.net/lists/listinfo/xcat-user
>>
>>
>> ------------------------------------------------------------
>> ------------------
>> Check out the vibrant tech community on one of the world's most
>> engaging tech sites, Slashdot.org! http://sdm.link/slashdot
>> _______________________________________________
>> xCAT-user mailing list
>> xCAT-***@lists.sourceforge.net
>> https://lists.sourceforge.net/lists/listinfo/xcat-user
>>
>>
>>
>>
>> ------------------------------------------------------------
>> ------------------
>> Check out the vibrant tech community on one of the world's most
>> engaging tech sites, Slashdot.org! http://sdm.link/slashdot
>> _______________________________________________
>> xCAT-user mailing list
>> xCAT-***@lists.sourceforge.net
>> https://lists.sourceforge.net/lists/listinfo/xcat-user
>>
>>
>

Er Tao Zhao

2017-07-25 01:54:57 UTC

Permalink

Long LA Cheng

2017-07-25 02:01:23 UTC

Permalink

J. Smith

2017-07-25 03:40:01 UTC

Permalink

Hi Zhao & Long,

Thank you for the suggestions!

1) I fixed the issue with the permission error, there was one sub-directory
that was missing the right permission under /install/netboot so that is
okay now.

2) I made a mistake on my previous message when I updated
"bootparams.addkcmdline", lsdef info was updated properly and it was the
same for the node file after running nodeset it was also updated properly
under pxelinux.cfg.

However, that does not work if I update "bootparams.kcmdline=", lsdef shows
the proper information, but after running nodeset, the node file under
pxelinux.cfg does not get updated. If I update manually the node file, and
do a pxeboot the installation works but as soon as I run nodeset, the file
doesn't include all my changes.

The node file with my manual changes looks like that:
DEFAULT xCAT
LABEL xCAT
KERNEL xcat/osimage/centos6.5-x86_64-netboot-panther-pec6220/kernel
APPEND
initrd=xcat/osimage/centos6.5-x86_64-netboot-panther-pec6220/initrd-stateless.gz
imgurl=
http://xcatmn:80//install/netboot/centos6.5/x86_64/panther-pec6220/rootimg.gz
XCAT=xcatmn:300
1 NODE=n113 FC=0 ifname=em1:48:4D:7E:81:F2:93 netdev=em1 console=tty0
console=ttyS0,115200
IPAPPEND 2

When I run,

chtab node=n113 bootparams.kcmdline="imgurl=
http://xcatmn:80//install/netboot/centos6.5/x86_64/panther-pec6220/rootimg.gz
XCAT=xcatmn:3001 NODE=n124 FC=0 ifname=em1:48:4D:7E:81:F2:93 netdev=em1
console=tty0 console=ttyS0,115200"

The part that doesn't get updated for some reason after running nodeset is
"ifname=em1:48:4D:7E:81:F2:93". This is removed.
This is the right mac and interface name to be used.

If I run nodeset this is the output, as you can see "ifname=" is removed:
DEFAULT xCAT
LABEL xCAT
KERNEL xcat/osimage/centos6.5-x86_64-netboot-panther-pec6220/kernel
APPEND
initrd=xcat/osimage/centos6.5-x86_64-netboot-panther-pec6220/initrd-stateless.gz
imgurl=
http://xcatmn:80//install/netboot/centos6.5/x86_64/panther-pec6220/rootimg.gz
XCAT=xcatmn:300
1 NODE=n113 FC=0 netdev=em1 console=tty0 console=ttyS0,115200
IPAPPEND 2

Any ideas?

3) General question: If a management node runs on CentOS7 with xCAT 2.13,
can we still run "genimage" to create/update a CentOS6 osimage or this
needs to be done on a management node running CentOS6?

On Mon, Jul 24, 2017 at 10:01 PM, Long LA Cheng <***@cn.ibm.com> wrote:

> Hi,
>
> For the pxe boot question, the network interface of the deploying node
> broadcasts the dhcp request and the dhcp server on xcat management node
> will reply to this if the host configuration(mac) can match the request. So
> this is handled by dhcp server, not the kcmdline in the pxe configuration
> file.
>
> For the issue 1, could you double check with the following steps:
> (1) `lsdef <node>, is there any entry like 'addkcmdline=<your input>'
> (2) runs nodeset against the node.
> (3) check the pxe configuration for the node.
>
> For the issue 2, could you check the permission of the directory/file
> under /install directory at first, '755' permission is required, then
> restart apache service. You can try to download some file under the
> directory with 'wget' to check.
>
> Thanks
> Best Regards
>
> Long Cheng(çšéŸ)
> IBM Systems &Technology Group, Development
> SOFTWARE ENGINEER
> Tel:86-10-82453046
> Email:***@cn.ibm.com
> Address: 3F, Building 28, Zhong Guan Cun Software Park, No.8, Dong Bei
> Wang West Road, Hai Dian District, Beijing 100193, PRC
> å°åïŒåœéåäžæºåšäžåœ(æèµ)æéå¬åž, äžåœç³»ç»ç§æå®éªå®€, åäº¬åžæµ·æ·åºäžåæºè¥¿è·¯8å·äžå³æèœ¯ä»¶å28å·æ¥Œ3å±ïŒé®çŒ:100193
>
>
>
> ----- Original message -----
> From: "J. Smith" <***@gmail.com>
> To: xCAT Users Mailing list <xcat-***@lists.sourceforge.net>
> Cc:
> Subject: Re: [xcat-user] Issue when running nodeset - kcmdline & initrd
> not set using xcat 2.13 and CentOS7
> Date: Tue, Jul 25, 2017 4:54 AM
>
> In addition to my previous email, I have also noticed the following, not
> sure if it is a bug:
>
> 1) If I update the bootparams.addkcmdline entry for the specific node it
> does not seem to update the content of the node file under pxelinux.cfg. Is
> that normal?
> Changes seem to take effect only when I modify directly on the node file
> under pxelinux.cfg
>
> 2) I see some permissions Error on /var/log/html/error_log
> [Mon Jul 24 16:42:39.622769 2017] [core:error] [pid 187765] (13)Permission
> denied: [client 192.168.248.153:56111] AH00035: access to
> /install/netboot/centos6.5/x86_64/panther-pec6220/rootimg.gz denied
> (filesystem path '/install/netboot/centos6.5') because search permissions
> are missing on a component of the path
>
> I compared with my old environment and it seems to be the same. Any
> suggestions?
>
> Thanks!
>
>
> On Mon, Jul 24, 2017 at 11:09 AM, J. Smith <***@gmail.com> wrote:
>
> Thank you Long for your reply,
>
> I did check the information for my node, notice that in the append the
> ifname entry was missing.
>
> DEFAULT xCAT
> LABEL xCAT
> KERNEL xcat/osimage/centos6.5-x86_64-netboot-panther-pec6220/kernel
> APPEND initrd=xcat/osimage/centos6.5-x86_64-netboot-panther-pec6220/initrd-stateless.gz
> imgurl=http://xcatmn:80//install/netboot/centos6.5/x86_64/panther-pec6220/rootimg.gz
> XCAT=xcatmn:300
> 1 NODE=n113 FC=0 netdev=em1 console=tty0 console=ttyS0,115200
> IPAPPEND 2
>
>
> I try adding it (ifname=em1:48:4D:7E:81:F2:93) but I still have the same
> issue.
> The pxe boot seems to work until it detects the network interface but then
> nothing happens. Does not seem that the post installation and postscripts
> start running.
>
> Any suggestions?
>
> Thanks!
>
> On Sun, Jul 23, 2017 at 9:06 PM, Long LA Cheng <***@cn.ibm.com>
> wrote:
>
> Hi,
>
> As pxe is used as the netboot loader, you can check the
> 'kernel/initrd/kcmdline' configuration in '/tftpboot/pxelinux.cfg/<node>'.
>
> Thanks.
>
> Best Regards
>
> Long Cheng(çšéŸ)
> IBM Systems &Technology Group, Development
> SOFTWARE ENGINEER
> Tel:86-10-82453046
> Email:***@cn.ibm.com
> Address: 3F, Building 28, Zhong Guan Cun Software Park, No.8, Dong Bei
> Wang West Road, Hai Dian District, Beijing 100193, PRC
> å°åïŒåœéåäžæºåšäžåœ(æèµ)æéå¬åž, äžåœç³»ç»ç§æå®éªå®€, åäº¬åžæµ·æ·åºäžåæºè¥¿è·¯8å·äžå³æèœ¯ä»¶å28å·æ¥Œ3å±ïŒé®çŒ:100193
>
>
>
> ----- Original message -----
> From: "J. Smith" <***@gmail.com>
> To: xCAT Users Mailing list <xcat-***@lists.sourceforge.net>
> Cc:
> Subject: Re: [xcat-user] Issue when running nodeset - kcmdline & initrd
> not set using xcat 2.13 and CentOS7
> Date: Sat, Jul 22, 2017 3:18 AM
>
> Hi,
> Are you saying that kcmdline and initrd does not need to be defined
> anymore for a diskless installation? So how does the new xCAT knows where
> to get initrd and the kcmdline for pxe boot?
> I checked this path /tftpboot/petitboot/ but I don't have it on my
> environment.
>
> Thanks.
>
> On Thu, Jul 20, 2017 at 6:13 PM, Casandra H Qiu <***@us.ibm.com>
> wrote:
>
> Hi:
>
> For better performance, nodeset will not add kcmdline and initrd to node
> definition any more.
> But you can find those in the /tftpboot/petitboot/nodename after ran
> nodeset command.
>
>
> Thanks,
> Casandra
>
> ...................................................................
> Casandra Hong Qiu
> Phone: (845) 433-9291, t/l 293-9291
> Office: Building 8, 3-B-04
> ***@us.ibm.com
>
>
>
> [image: Inactive hide details for "J. Smith" ---07/20/2017 05:48:55
> PM---Hello, I have installed a new version of xcat v2.13 on CentOS7]"J.
> Smith" ---07/20/2017 05:48:55 PM---Hello, I have installed a new version of
> xcat v2.13 on CentOS7 and have migrated
>
> From: "J. Smith" <***@gmail.com>
> To: xCAT Users Mailing list <xcat-***@lists.sourceforge.net>
> Date: 07/20/2017 05:48 PM
> Subject: [xcat-user] Issue when running nodeset - kcmdline & initrd not
> set using xcat 2.13 and CentOS7
> ------------------------------
>
>
>
> Hello,
>
> I have installed a new version of xcat v2.13 on CentOS7 and have migrated
> my xcat tables from another xcat server that was running CentOS6 with xcat
> 2.9
>
> The migrated data looks fine but when adding new nodes, I see some
> incomplete information after I run nodeset. For instance on node 113 there
> is no information set on kcmdline & initrd. Information copied over from
> xcatdump for node 102 looks fine.
> Does anyone has any suggestions?
>
> New Environment Information:
>
> 2 Managements Nodes set for HA using GPFS to share the xCAT data and I use
> a VIP Interface to bring up xcat services.
>
> Virtual IP Alias Address: xcatmn 192.168.248.60
> Primary Management Node: ms1 192.168.248.61
> Secondary Management Node: ms2 192.168.248.62
>
> [[hpcslurm01]***@ms1 x86_64]# lsxcatd -v
> Version 2.13.3 (git commit 7f9e0b57554c3a1975b83308935b7d183c632a9d,
> built Thu Apr 13 01:56:07 EDT 2017)
>
> CentOS 7
> Linux ms1 3.10.0-229.el7.x86_64
>
> [[hpcslurm01]***@ms1 x86_64]# lsdef -t site -l
> Object name: clustersite
> SNsyncfiledir=/var/xcat/syncfiles
> auditnosyslog=0
> auditskipcmds=ALL
> blademaxp=64
> cleanupxcatpost=no
> consoleondemand=no
> databaseloc=/var/lib
> db2installloc=/mntdb2
> dhcpinterfaces=em3:0
> dhcplease=43200
> dnshandler=ddns
> domain=*panther.net* <http://panther.net/>
> enableASMI=no
> forwarders=131.94.205.10,131.94.7.220
> fsptimeout=0
> installdir=/install
> ipmimaxp=64
> ipmiretries=3
> ipmitimeout=2
> master=192.168.248.60
> maxssh=8
> nameservers=192.168.248.61,192.168.248.62
> nodesyncfiledir=/var/xcat/node/syncfiles
> ntpservers=ms1,ms2
> powerinterval=0
> ppcmaxp=64
> ppcretry=3
> ppctimeout=0
> sharedtftp=1
> sshbetweennodes=ALLGROUPS
> syspowerinterval=0
> tftpdir=/tftpboot
> timezone=America/New_York
> useNmapfromMN=no
> vsftp=n
> xcatconfdir=/etc/xcat
> xcatdport=3001
> xcatiport=3002
> xcatsslversion=TLSv1
>
> Migrated data for node 102 looks fine:
> [[hpcslurm01]***@ms1 x86_64]# lsdef n102
> Object name: n102
> arch=x86_64
> bmc=r102
> currstate=netboot centos6.5-x86_64-panther-pec6220
> groups=panther-pem420,dell
> hostnames=n102
> initrd=xcat/osimage/centos6.5-x86_64-netboot-panther-pec6220
> /initrd-stateless.gz
> installnic=em1
> ip=192.168.248.142
> kcmdline=imgurl=*http://xcatmn
> <http://xcatmn>:80//install/netboot/centos6.5/x86_64/panther-pec6220/rootimg.gz*
> XCAT=xcatmn:3001 NODE=n102 FC=0 ifname=em1:F8:CA:B8:A9:0E:04 netdev=em1
> console=tty0 console=ttyS0,115200
> kernel=xcat/osimage/centos6.5-x86_64-netboot-panther-pec6220/kernel
> mac=F8:CA:B8:A9:0E:04
> mgt=ipmi
> netboot=pxe
> os=centos6.5
> postscripts=syslog,remoteshell,otherpkgs,syncfiles,panther-b
> ondtrunknics,panther-ldap,panther-nouserlogin,panther-engine
> erlicense,panther-resolv,panther-yumrepo-centos65,panther-rp
> ms,panther-mlnx-ofed,panther-upgradegpfs-diskless-4.2.1-2,
> panther-setupgpfs,panther-lsf
> power=impi
> primarynic=em1
> profile=panther-pec6220
> provmethod=centos6.5-x86_64-netboot-panther-pec6220
> serialport=0
> serialspeed=115200
> status=booted
> statustime=02-08-2017 16:57:05
> updatestatus=synced
> updatestatustime=03-30-2017 17:15:00
> xcatmaster=xcatmn
>
>
> New added node 113 is not setup properly, there is no information set on
> kcmdline & initrd
> [[hpcslurm01]***@ms1 x86_64]# lsdef n113
> Object name: n113
> arch=x86_64
> bmc=r113
> currstate=netboot centos6.5-x86_64-panther-pec6220
> groups=panther-pem420,dell
> hostnames=n113
> installnic=em1
> ip=192.168.248.153
> mac=48:4D:7E:81:F2:93
> mgt=ipmi
> netboot=pxe
> os=centos6.5
> postscripts=syslog,remoteshell,otherpkgs,syncfiles,panther-b
> ondtrunknics,panther-ldap,panther-nouserlogin,panther-engine
> erlicense,panther-resolv,panther-yumrepo-centos65,panther-rp
> ms,panther-mlnx-ofed,panther-upgradegpfs-diskless-4.2.1-2,
> panther-setupgpfs,panther-lsf
> power=impi
> primarynic=em1
> profile=panther-pec6220
> provmethod=centos6.5-x86_64-netboot-panther-pec6220
> serialport=0
> serialspeed=115200
> xcatmaster=xcatmn
>
>
> Thanks!
>
>
> ------------------------------------------------------------
> ------------------
> Check out the vibrant tech community on one of the world's most
> engaging tech sites, Slashdot.org! http://sdm.link/slashdot______
> _________________________________________
> xCAT-user mailing list
> xCAT-***@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/xcat-user
>
>
>
>
>
> ------------------------------------------------------------
> ------------------
> Check out the vibrant tech community on one of the world's most
> engaging tech sites, Slashdot.org! http://sdm.link/slashdot
> _______________________________________________
> xCAT-user mailing list
> xCAT-***@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/xcat-user
>
>
> ------------------------------------------------------------
> ------------------
> Check out the vibrant tech community on one of the world's most
> engaging tech sites, Slashdot.org! http://sdm.link/slashdot
> _______________________________________________
> xCAT-user mailing list
> xCAT-***@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/xcat-user
>
>
>
>
> ------------------------------------------------------------
> ------------------
> Check out the vibrant tech community on one of the world's most
> engaging tech sites, Slashdot.org! http://sdm.link/slashdot
> _______________________________________________
> xCAT-user mailing list
> xCAT-***@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/xcat-user
>
>
> ------------------------------------------------------------
> ------------------
> Check out the vibrant tech community on one of the world's most
> engaging tech sites, Slashdot.org! http://sdm.link/slashdot
> _______________________________________________
> xCAT-user mailing list
> xCAT-***@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/xcat-user
>
>
>
>
> ------------------------------------------------------------
> ------------------
> Check out the vibrant tech community on one of the world's most
> engaging tech sites, Slashdot.org! http://sdm.link/slashdot
> _______________________________________________
> xCAT-user mailing list
> xCAT-***@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/xcat-user
>
>

Long LA Cheng

2017-07-25 05:34:30 UTC

Permalink