020 Network Install. Linux on POWER Red Hat Edition

Transcription

1 020 Network Install Linux on POWER Red Hat Edition 1

2 RHEL 6.5 Network Install Your first (odd) RHEL installed LPAR will become a network install server Bring over sk_rh65 script Run sk_rh65 s for install server setup on odd LPAR Checks for and makes directories Checks mounts Checks NFS exports Places network boot image Installs RPMS Brings over kickstart template Brings over /etc/dhcp/dhcpd.conf file chkconfig sets run levels for a number of services sed /etc/selinux/config to disable SELINUX Prompts for reboot of odd LPAR y Reboot odd LPAR 2

3 RHEL 6.5 Network Install Run sk_rh65 with other command line flags on odd LPAR, to enable client install Creates client stanza in /var/lib/tftpboot/etc/yaboot.conf Runs ssh lpar_netboot onto HMC to retrieve client MAC address Links client MAC address to /var/lib/tftpboot/etc/yaboot.conf Parses kickstart template to create unique file /export/kickstart/ks_snn.cfg for your client Inserts client stanza in /etc/dhcp/dhcpd.conf, restarts dhcpd Activate the even LPAR, network install client, to Open Firmware Open Firmware 0 > boot syntax Several tftp transfers automatically RHEL install starts automatically RHEL install packages complete RHEL post installation Post install checks Convenient HMC commands 3

4 RHEL 6.5 Network Install Same desktop tools required - terminal, then ssh for login into Hardware Management Console (HMC) and Linux LPARs (VMs) - VNC viewer for graphical network install if desired Your LPARs are created for you, see your student worksheet odd LPAR (s21, s67, etc) is media installed, will be install server even LPAR (s22, s68, etc) for network install client 4

5 Bring over sk_rh65 script On the odd LPAR # mount :/export/config_files /mnt # cp /mnt/sk_rh65 sk_rh65 # umount /mnt #./sk_rh65 (see usage message) #./sk_rh65 s Setup complete. Reboot required. Reboot now? (y/n) y 5

6 Enable the client install from odd LPAR After reboot, on your ODD LPAR #./sk_rh65 H <hmc ip> u <hmc user> \ m <managed server> \ c <client hostname> \ p <partition name> \ f <profile name> Managed_server from worksheet, 73nP Profile name snn, same as your EVEN partition name EVEN partition name snn EVEN client_hostname snn If dhcpd restart fails see instructor You will be prompted for student password on hmc twice The next 21 slides represent the manual config that the script has replaced. They are included for reference. The button below will skip forward to ssh into the HMC, for booting the client LPAR and opening its console Skip forward to ssh into HMC 6

7 Network boot image ssh to your odd install server LPAR (you just media installed it) We will prepare a somewhat indirect network boot with yaboot Name yaboot in such a way, that we know what it is 6 months from now # mkdir p /var/lib/tftpboot/etc # mkdir p /var/lib/tftpboot/ppc/ppc64 # cp /export/rhel65dvd/ppc/chrp/yaboot /var/lib/tftpboot/yaboot_rhel65 # cp /export/rhel65dvd/ppc/ppc64/yaboot.conf /var/lib/tftpboot/etc # cp /export/rhel65dvd/ppc/ppc64/initrd.img /var/lib/tftpboot/ppc/ppc64 # cp /export/rhel65dvd/ppc/ppc64/vmlinuz /var/lib/tftpboot/ppc/ppc64 sh_rh65 script skips this slide 7

8 Network boot image Check your work # ls -la /var/lib/tftpboot total 276 drwxr-xr-x. 4 root root 4096 Apr 29 11:39. drwxr-xr-x. 43 root root 4096 Apr 29 11:38.. drwxr-xr-x. 2 root root 4096 Apr 29 11:40 etc drwxr-xr-x. 3 root root 4096 Apr 29 11:38 ppc -r--r--r--. 1 root root Apr 29 11:39 yaboot_rhel65 # ls -la /var/lib/tftpboot/etc total 12 drwxr-xr-x. 2 root root 4096 Apr 29 11:40. drwxr-xr-x. 4 root root 4096 Apr 29 11:39.. -r--r--r--. 1 root root 221 Apr 29 11:40 yaboot.conf # ls -la /var/lib/tftpboot/ppc/ppc64 total drwxr-xr-x. 2 root root 4096 Apr 29 11:41. drwxr-xr-x. 3 root root 4096 Apr 29 11:38.. -r--r--r--. 1 root root Apr 29 11:41 initrd.img -r-xr-xr-x. 1 root root Apr 29 11:41 vmlinuz sh_rh65 script skips this slide 8

9 Edit client stanza into /var/lib/tftpboot/etc/yaboot.conf # vi /var/lib/tftpboot/etc/yaboot.conf init-message = "\nwelcome to the 64-bit Red Hat Enterprise Linux 6.5 installer!\nhit <TAB> for boot options.\n\n" timeout=6000 default=linux Note the stanza for the default label image=/ppc/ppc64/vmlinuz label=linux initrd=/ppc/ppc64/initrd.img read-only Create one stanza for your client even LPAR, with a specific label for your client, and a specific append for your client image=/ppc/ppc64/vmlinuz label=snn initrd=/ppc/ppc64/initrd.img append="ks=nfs:<oddlparip>:/export/kickstart/ks_snn.cfg ksdevice=eth0 ip=<evenlparip> netmask= gateway= noipv6" read-only sh_rh65 script skips this slide snn is your EVEN LPAR All one line. No newline, no enter I was not excited about editing this file for EVERY client. But adding a unique stanza for each client is not too complicated, saves a lot of error prone typing at Open Firmware, and supports the idea of multiple install clients. I am scripting up a mass config 9

10 Client MAC and IP Address At HMC login, use lpar_netboot command to collect MAC address from your client (even) LPAR. LPAR name and profile name are identical. lpar_netboot -M -n -t ent snn snn 73nP # Connecting to snn # Connected # Checking for power off. # Power off complete. # Power on snn to Open Firmware. # Power on complete. # Getting adapter location codes. # Type Location Code MAC Address Full Path Name Ping Result Device Type ent U8233.E8B P-V26-C2-T1 e683616c7502 /vdevice/l-lan@ n/a virtual If you get a cannot connect error, you have console open to even LPAR in another window. Close that console and retry LPAR name, profile name (same as LPAR name), server name Back on your install server (odd) LPAR, link yaboot.conf to a MAC address filename # cd /var/lib/tftpboot/etc # ln s yaboot.conf 01-e c sh_rh65 script skips this slide # ls 01-e d yaboot.conf We will also use MAC address when editing dhcpd.conf file important 01- prefix here Write the MAC address on your student worksheet. 10

11 Kickstart info We use a ks.cfg file to automate behavior of a RHEL install The media install of your odd LPAR left a representative kickstart file /root/anaconda-ks.cfg I used this as a basis for <instructor server>:/export/config_files/ks_template.cfg Copy it to your odd LPAR, and also copy it to name that matches your client hostname On the odd LPAR # mkdir p /export/kickstart # echo /export/kickstart *(ro,no_root_squash) >>/etc/exports # mount <instructorserver>:/export/config_files /mnt # cp /mnt/ks_template.cfg /export/kickstart # umount /mnt # cd /export/kickstart # cp ks_template.cfg ks_snn.cfg snn, your even LPAR hostname Into the template, many parameters were added from Red Hat Chapter 31.4 Kickstart options US/Red_Hat_Enterprise_Linux/5/html/Installation_Guide/s1-kickstart2-options.html sh_rh65 script skips this slide 11

12 Kickstart info snn, your even LPAR hostname Make edits to your /export/kickstart/ks_snn.cfg file Arrowheads are NOT part of an ip address # Kickstart file automatically generated by anaconda. #version=devel install #cdrom nfs --server=<install server ip> --dir=/export/rhel64dvd lang en_us.utf-8 keyboard us logging --host=<install server ip> --level=debug network --onboot yes --device eth0 --bootproto static --ip <yourclientip> --netmask gateway nameserver noipv6 hostname <yourclienthostname> rootpw --iscrypted $6$tkUSTyREWqY6wLxg$zH92ZhUgG/h71zU2hChHXEDICngTNJPobh2Fo.7G GQZ/TDuOjft8XBy3A9Wp2frgzktWZNdWwZlOmjJinGU.D0 #firewall service=ssh firewall disabled #authconfig enableshadow passalgo=sha512 authconfig enablemd5 --enableshadow sh_rh65 script skips this slide Don t close the file after these edits, there are more 12

13 Kickstart info snn, your even LPAR hostname Make edits to your /export/kickstart/ks_snn.cfg file 13 #selinux enforcing sh_rh65 script skips this slide selinux disabled timezone --utc America/Chicago bootloader --location=partition --driveorder=mpatha -- append="crashkernel=auto console=hvc0 rhgb quiet # The following is the partition information you requested Caution with initlabel if # Note that any partitions you deleted are not expressed you have data on # here so unless you clear all partitions first, this some is LUNs # not guaranteed to work zerombr clearpart --all -initlabel --drives=mpatha,mpathb part prepboot --fstype=prepboot --size=4 -ondisk=mpatha part /boot --fstype=ext4 --size=500 -ondisk=mpatha part pv grow --size=1 -ondisk=mpatha volgroup vg_snn --pesize=4096 pv partitions logvol / --fstype=ext4 --name=lv_root --vgname=vg_snn --grow -- size= maxsize=51200 logvol swap --name=lv_swap --vgname=vg_snn --grow --size= maxsize=1984 Logical volumes created in vg 3 partitions created on mpatha vg created on 1 of the

14 Kickstart info Make edits to your /export/kickstart/ks_snn.cfg file # define additional repositories repo --name=ibm_power_tools --baseurl= POWER/Linux/yum/IBM/RHEL/6/ppc64 repo --name=ibm_power_sdk_tools -- baseurl= repo --name=advance_toolchain --baseurl=ftp://ftp.unicamp.br/pub/linuxpatch/tool chain/at/redhat/rhel6 services --disabled NetworkManager,bluetooth,ip6tables,iptables --enabled httpd,nfs #vnc --password=abcd1234 sh_rh65 script skips this slide 14

15 Kickstart info Make edits to your /export/kickstart/ks_snn.cfg @basic-desktop krb5-workstation libxmu perl-dbd-sqlite sh_rh65 script skips this slide 15

16 Kickstart info Make edits to your /export/kickstart/ks_snn.cfg file %post #!/bin/sh mount <instructor server ip>:/export/config_files /mnt cd /mnt rpm -ivh ibm-power-repo* cd umount /mnt mkdir -p /export/rhel64dvd mount <install server ip>:/export/rhel65dvd /export/rhel65dvd echo "[RHEL65DVD]" >/etc/yum.repos.d/rhel65dvd.repo echo "name=the_rhel65dvd" >>/etc/yum.repos.d/rhel65dvd.repo echo "baseurl=file:///export/rhel65dvd" >>/etc/yum.repos.d/rhel65dvd.repo echo "enabled=1" >>/etc/yum.repos.d/rhel65dvd.repo echo "gpgcheck=0" >>/etc/yum.repos.d/rhel65dvd.repo yum -y install ibm-power-managed-rhel6 yum -y install nmon %end sh_rh65 script skips this slide 16

17 On the Install server, some DHCP doc Some detailed information to read carefully later /usr/share/doc/dhcp-common-4.1.1/readme /usr/share/doc/dhcp-common-4.1.1/relnotes Initially, no manpage for dhcpd, no dhcpd.conf file # man dhcpd No manual entry for dhcpd # ls /etc/dhcp dhclient.d dhclient-eth0.confh sh_rh65 script skips this slide 17

18 Install dhcp, and tftp server from iso media Install rpms on your install server (odd) LPAR # rpm ivh /export/rhel65dvd/packages/dhcp-4.1.1* # rpm ivh /export/rhel65dvd/packages/dhcp-common* # rpm ivh /export/rhel65dvd/packages/tftp-0* # rpm ivh /export/rhel65dvd/packages/xinetd* # rpm ivh /export/rhel65dvd/packages/tftp-server* Now check # ls /etc/dhcp dhclient.d dhclient-eth0.conf dhcpd6.conf dhcpd.conf # man dhcpd See the sample file # view /usr/share/doc/dhcp-4.1.1/dhcpd.conf.sample common likely already installed You could just yum install these sh_rh65 script skips this slide 18

19 Bring over dhcpd.conf file from instructor server # mount :/export/config_files /mnt # cp /mnt/dhcpd.conf /etc/dhcp/dhcpd.conf # umount /mnt sh_rh65 script skips this slide 19

20 Edit up dhcpd.conf file vi /etc/dhcp/dhcpd.conf # # DHCP Server Configuration file. # see /usr/share/doc/dhcp*/dhcpd.conf.sample # see 'man 5 dhcpd.conf # default-lease-time 600; max-lease-time 7200; # # see /etc/rsyslog.conf for local7 log direct log-facility local7; # # A subnet we are not using subnet netmask { } We ll look at rsyslog entry for local7 later This first page is identical for every student # Your workshop network - do NOT use dynamic-bootp - do NOT use a range # Any range seems to DHCPOFFER dynamic addresses to requests; not what we want # We are assigning specific IP to specific client MAC subnet netmask { option routers ; } sh_rh65 script skips this slide 20

21 Edit up dhcpd.conf file vi /etc/dhcp/dhcpd.conf host snn{ hardware ethernet nn:nn:nn:nn:nn:nn; fixed-address your.inst.client.ip; filename "yaboot_rhel65"; server-name your.inst.server.ip"; } Hostname of YOUR even LPAR install client MAC address of YOUR install client here IP address of YOUR install client here, no quotes Just the bootfile name, NO path. dhcpd starts up with a default path sh_rh65 script skips this slide IP address of YOUR install server 21

22 Start dhcpd # service dhcpd start Starting dhcpd: [FAILED] OK, what problems do I have with syntax in dhpcd.conf? Try it on the command line # dhcpd -cf /etc/dhcp/dhcpd.conf Internet Systems Consortium DHCP Server P1 Copyright Internet Systems Consortium. All rights reserved. For info, please visit WARNING: Host declarations are global. They are not limited to the scope you declared them in. /etc/dhcp/dhcpd.conf line 23: expecting numeric value. hardware ethernet E6:83:6D:0A:29:nn; sh_rh65 script skips this slide ^ /etc/dhcp/dhcpd.conf line 26: semicolon expected. server-name ^ /etc/dhcp/dhcpd.conf line 26: expecting a parameter or declaration server-name " "; ^ /etc/dhcp/dhcpd.conf line 28: unexpected end of file } ^ Configuration file errors encountered -- exiting 22

23 Start dhcpd Make edits, try again # dhcpd -cf /etc/dhcp/dhcpd.conf Internet Systems Consortium DHCP Server P1 Copyright Internet Systems Consortium. All rights reserved. For info, please visit WARNING: Host declarations are global. They are not limited to the scope you declared them in. Not searching LDAP since ldap-server, ldap-port and ldap-base-dn were not specified in the config file Wrote 0 deleted host decls to leases file. Wrote 0 new dynamic host decls to leases file. Wrote 0 leases to leases file. Listening on LPF/eth0/e6:83:60:11:22:02/ /20 Sending on Sending on LPF/eth0/e6:83:60:11:22:02/ /20 Socket/fallback/fallback-net Just fyi Host does not have to be defined within a Subnet # service --status-all grep dhcp dhcpd (pid 6001) is running... dhcpd is stopped sh_rh65 script skips this slide It is running. Not sure what stopped means 23

24 dhcpd logging About that log-facility local7; entry # grep local7 /etc/rsyslog.conf local7.* /var/log/boot.log # tail -f /var/log/boot.log Oct 24 16:18:47 m1-stu01 dhcpd: DHCPDISCOVER from 00:21:d7:31:ae:40 via eth0: network /20: no free leases Oct 24 16:20:01 m1-stu01 dhcpd: DHCPDISCOVER from 00:21:d7:31:ae:40 via eth0: network /20: no free leases Oct 24 16:20:04 m1-stu01 dhcpd: DHCPDISCOVER from 00:21:d7:31:ae:40 via eth0: network /20: no free leases sh_rh65 script skips this slide That s right, do NOT give out dynamic addresses to DHCPDISCOVER requests. If you are still watching this later, you will see BOOTREQUEST from your install client, and BOOTREPLY from your install server 24

25 Set services on for restart chkconfig command, run levels 3, 4, and 5 # chkconfig -level 345 dhcpd on # chkconfig -level 345 xinetd on # chkconfig -level 345 nfs on # chkconfig -level 345 tftp on sh_rh65 script skips this slide Inserts disable = no into /etc/xinetd.d/tftp Start xinetd # service xinetd start Make NFS export # service nfs start # exportfs /export/rhel65dvd <world> /export/kickstart <world> Recall in module 010, we put /export/rhel65dvd in /etc/exports, and /export/kickstart in this module 25

26 Reduce security config on Install Server Verify that iptables, ip6tables not running # service --status-all grep tables ip6tables: Firewall is not running. iptables: Firewall is not running. Check status of selinux # sestatus SELinux status: enabled SELinuxfs mount: /selinux Current mode: enforcing Mode from config file: enforcing Policy version: 24 Policy from config file: targeted If these service status checks return nothing, it is likely firewall is running. Run setup and turn it off sh_rh65 script skips this slide 26

27 Reduce security config on Install Server Set SELINUX=disabled # vi /etc/selinux/config # This file controls the state of SELinux on the system. # SELINUX= can take one of these three values: # enforcing - SELinux security policy is enforced. # permissive - SELinux prints warnings instead of enforcing. # disabled - No SELinux policy is loaded. SELINUX=disabled # SELINUXTYPE= can take one of these two values: # targeted - Targeted processes are protected, # mls - Multi Level Security protection. SELINUXTYPE=targeted Set SELINUX=disabled Do NOT change SELINUXTYPE sh_rh65 script skips this slide # shutdown r now Wait until server is back up, before proceeding on next slide We have concluded the install server needs a reboot after SELINUX change 27

28 ssh into HMC # ssh student@ nn Login student, password from student worksheet 28

29 Activate even LPAR, open its console At the HMC. chsysstate m 73nP r lpar o shutdown --immed n snn chsysstate m 73nP -r lpar o on n snn f snn b of lpar name profile name Your EVEN LPAR Boot mode open firmware At the HMC mkvterm m 73nP p snn Open in progress Memory Open Completed. Keyboard Network SCSI Speaker ok 0 > 29

30 Open firmware 0 > prompt At the 0 > prompt 0 > boot network:oddlparip,,,, snn Even LPAR name matches the label for this specific client in /var/lib/tftpboot/etc/yaboot.conf Boot-spacenetwork-colon Four commas, space, even LPAR name You should not have to do this, but you could put more on the 0 > prompt. As it happens, you already included it in the append in /var/lib/tftpboot/etc/yaboot.conf 0 > boot network:oddlparip,,evenlparip,gatewayip snn 30

31 First tftp transfer This comes from /etc/dhcp/dhpcd.conf 31

32 tftp error 0 > boot network: odd,,,, snn Response to the First BOOTP request was not received BOOTP Parameters: chosen-network-type = ethernet,auto,none,auto server IP = client IP = gateway IP = device = /vdevice/l-lan@ MAC address = 5e 15 eb d loc-code = U8233.E8B P-V33-C2-T1 BOOTP request retry attempt: 1 BOOTP request retry attempt: 2 BOOTP request retry attempt: 3 If you DON T get Filename yaboot_rhel65 Check that client IP and MAC here against what you put in /etc/dhcp/dhcpd.conf 32

33 Second tftp transfer This the filename linked to /var/lib/tftpboot/etc/yaboot.conf recall your 01- prefix Type in your label snn and Enter or just hit Enter 33

34 Third tftp transfer vmlinuz 34

35 Fourth tftp transfer Initrd.img 35

36 Lots of initialization 36

37 Configuring eth0 37

38 Disk Re-initialize all If you get this Error, tab to Re-initialize all and hit space 38

39 Writing the disk configuration 39

40 RHEL Install 40

41 RHEL install 41

42 RHEL install 42

43 RHEL install 43

44 RHEL install, packages completed 44

45 RHEL install, post-installation 45

46 RHEL install complete Hit space to reboot 46

47 Installed LPAR rebooting Hit 1 for SMS when the word Keyboard appears 47

48 SMS, configure boot device order At SMS Main Menu on reboot, 5 Select Boot Options 48

49 SMS Boot Device Order 2. Configure Boot Device Order 49

50 SMS Boot Device Order 1. Select 1 st Boot Device, 5. Hard Drive 50

51 SMS Boot Device Order 1. SCSI 51

52 SMS Boot Device Order 1. The first Media Adapter 52

53 SMS Boot Device Order Type the number of your installed SCSI Harddisk and enter 53

54 Configure 1 st Boot Device 2, Set Boot Sequence: Configure as 1 st Boot Device 54

55 exit System Management Services x to exit System Management Services 55

56 exit System Management Services 1 and enter, watch for boot, and RHEL setup to run 56

57 boot: (no typing here) 57

58 boot: 58

59 RHEL login: The root pw was encrypted in the kickstart file, same as we used in odd LPAR install 59

60 Did we get what we expected? m1-sysnn login: root Password: ~]# rpm -qa grep managed ibm-power-managed-rhel ppc64 ~]# rpm -qa grep nmon nmon-14i-1.el6.ppc64 ~]# sestatus SELinux status: disabled Login with the expected, encrypted password from kickstart Ibm-power-managed and nmon installed SE Linux disabled 60

61 Some convenient HMC commands lpar_netboot -M -n -t ent m1-snn snn 73nP chsysstate -m <managed server> -r lpar -o shutdown --immed -n <lparname> chsysstate m <managed server> -r lpar o on n <lparname> f <profilename> b of vtmenu rmvterm -m <managed server> -p <lparname> 61

62 Unexpected echo of commands or password at console If you find strange echo of password or commands on the console of your new Red Hat instance, you should remove the console specifier on the bootloader statement in your kickstart files # grep bootloader your-ks.cfg bootloader --location=partition --driveorder=mpatha --append="crashkernel=auto console=hvc0 rhgb quiet" Remove console=hvc0 from your kickstart files 62