IBM z Systems Development and Test Environment Tools User's Guide IBM
ii IBM z Systems Development and Test Environment Tools User's Guide
Contents Chapter 1. Overview......... 1 Introduction.............. 1 Creating application images......... 1 Option 1: Creating an application image from an existing IBM z System.......... 1 Option 2: Creating an application image from an existing zd&t............. 2 Provisioning application images to zd&t instances in an automated way............ 2 License Servers requirements......... 3 zd&t Tools requirements.......... 4 Software requirements........... 4 Chapter 3. Installing zd&t Tools.... 5 Installing the zd&t Tools Web User Interface... 5 Working with Interactive Mode....... 5 Working with Silent Mode......... 9 Installing zd&t Tools z/os files....... 13 Chapter 2. Getting started....... 3 Hardware requirements........... 3 iii
iv IBM z Systems Development and Test Environment Tools User's Guide
Chapter 1. Overview Introduction Creating application images IBM z Systems Development and Test Environment Tools (zd&t) is a simple utility which enables you to create and monitor instances of z System installs, or import existing packages and deploy them to test systems. This allows you to develop and test outside the regular production systems. IBM z Systems Development and Test Environment Tools includes the following features: v Creating application images from various sources. v Provisioning application images for developers and testers in a self-service automated way. v Monitoring the status and availability of all created assets and target systems. An application image is a collection of application components that originate from the same IBM z Systems and packaged together as a single deliverable for a target system. IBM z Systems Development and Test Environment allows you to create application images from various sources: v Existing IBM z System. v Existing IBM z Systems Development and Test Environment instance. v Application Developers Controlled Distributions (ADCD). The z/os Software distribution is bundled with the product. (This is not a part of Beta). Option 1: Creating an application image from an existing IBM z System To create an application image from an existing IBM z System, follow these steps: 1. Create application components from an existing IBM z System. 2. Create an application image by selecting the created components that are needed for an application image. Creating application components An application component is a collection of volumes from an IBM z System that is intended to be reusable in a mix and match fashion with other components from the same IBM z System. You can extract volumes from your z Systems into logical components, and pair each component with other volume-based ones. Application components consist of : v A set of sequential files that represent your system volumes. v Data set dumps or volume sequential files that represent a subsystem (not a part of beta). v Data set dumps that represents an application or application data (not a part of beta). 1
Note: This process would need to be done by a system programmer, or someone that is very familiar with the IBM z System where the data is being extracted. Creating an application image An application image consists of a set of application components from the same IBM z System. After creating the application components, you need to combine the created application components into a single application image. An application image must contain only one application component that contains your system residence volumes as well as any number of other components that could represent your application, application data, or any number of sub systems like CICS or IMS. Note: This process would also need to be done by a system programmer, or someone that is very familiar with how the application components were constructed and their dependencies. Option 2: Creating an application image from an existing zd&t IBM z Systems Development and Test Environment also allows you to import an application image from an existing zd&t. In this case, when you supply the hostname and Linux credentials of the zd&t system along with the location of the devmap file, the tool will import this information and make it available for deployment to other target Linux systems. Provisioning application images to zd&t instances in an automated way After creating application images, IBM z Systems Development and Test Environment Tools will automate the ability for your application programmers or testers to have an entire zd&t environment constructed for their application when needed. The only requirement for the deployment is that a clean Linux OS is installed. Using the Deploy options in the Tools will enable you to automatically: 1. Silently install the emulator to the target Linux system. 2. Configure the host Linux machine iptables, license server and so on. 3. Install the application image content. 4. Generate a devmap file for application images extracted from a IBM z System. 5. Modify the z/os parameters for application images extracted from a IBM z System so that it is able to IPL in zd&t. 6. Start the emulator. Then, your target systems could be your own on premise physical machines with your own personal cloud, or ones from our IBM managed cloud. Note: This process can be done by any application programmer or tester on-demand whenever they need a new environment. 2 IBM z Systems Development and Test Environment Tools User's Guide
Chapter 2. Getting started Hardware requirements IBM z Systems Development and Test Environment requires the following: Disk space Memory Processor License Servers requirements v 50 GB of disk space is required. v 150 GB of disk space is required for the packaged z/os V2.2 distribution. v More space may be required if using extracted IBM z System volumes. v 2 GB of RAM per emulated CP plus 1 GB for Linux, for a minimum of 3 GB of RAM, is required. v At a minimum, a Generation 3 Intel i7 2.6GHz quad-core, or equivalent, processor is required. To install a software based License Manager, it must be on a 64-bit x86 Intel system that does not have IBM z Systems Development and Test Environment installed on it. The additional required resources are as follows: Disk space Memory Processor v Minimum 1 GB of disk space is required for Linux. v Minimum 1 GB of RAM is required. v Minimal To install a USB hardware device based License Server, it must be on a 64-bit x86 Intel system that does not have a software based License Manager installed on it. The additional required resources are as follows: Disk space Memory Processor v 12 GB of disk space is required for Linux and workspace. v 2 GB of RAM is required. v 2.0 GHz or higher Intel Core 2 Duo, Generation 1 Intel i3, or equivalent processor required. Additional requirements, if using a USB Hardware Device licensing (required for Personal Edition): v The hardware must include one or more USB ports. v The License Key Server must not be hosted on zbx hardware. 3
zd&t Tools requirements v The product's USB Hardware Device must be attached to an available USB port. v The hardware must be configured to give the License Key Server exclusive use of the USB port where the product's USB Hardware Device is attached. A 64-bit x86 Intel system is needed to install and run the IBM z Systems Development and Test Environment Tools. The additional required resources are as follows: Disk space Memory Processor v 2GB of disk space is required. v 1GB of RAM for Linux v Minimal. Note: Software requirements 1. An FTP server for hosting the tools artifacts (z system volumes, datasets, tooling metadata): Disk space: Needs sufficient space to hold numerous and potentially very large files for extracted IBM z System volumes, as well as 150GB of disk space for ADCD z/os V2.2 distribution. 2. A 64-bit x86 Intel (or compatible) system for each instance of IBM z Systems Development and Test Environment: Refer to general hardware requirements above. 3. A Red Hat software repository for Yum must be available and accessible by the target Linux systems. 4. A SSH server must be running on the target Linux systems and accessible by the system running the tools. 5. The following commands must reside on the target Linux systems: wget, ftp, sftp, ssh, and yum. Restriction: If there are application images in progress (i.e. volume extraction is on-going), and the WebSphere Liberty server hosting the tools is shut down, the permissions for accessing the IBM z System are lost, which causes a failure with the remaining volumes that need extraction. You will need to re-run the application image creation process to re-extract and build these application images. v Red Hat Linux OS v X86-64 machine (64 bits version) v Root Permissions 4 IBM z Systems Development and Test Environment Tools User's Guide
Chapter 3. Installing zd&t Tools There are two required parts to installing the IBM z Systems Development and Test Environment Tools: v IBM z Systems Development and Test Environment (zd&t) Tools Web User Interface RPM Install, to install the Web application part of the Tools and get the files for the Host install. v IBM z Systems Development and Test Environment (zd&t) Tools Host Install, to install the backend parts. Download the Tools installation file (zdt_install.x86_64) from the zd&t Open Beta download site at https://www-01.ibm.com/marketing/iwm/iwm/web/ prelogin.do?source=swerpsysz-dev-3. Installing the zd&t Tools Web User Interface zdt_install is a bash script that allows you to install, refresh or remove the following zd&t products: v IBM z Systems Development and Test Environment Personal Edition v IBM z Systems Development and Test Environment License Manager v IBM z Systems Development and Test Environment Tools This Beta is targeting the new support provided by the Tools install and can be activated by installing the License Manager and requesting a Software License as documented in the Tools Beta community blog entry for this Beta. For more information, see IBM z Systems Development and Test Environment (zd&t) open beta community. If you have previously purchased the product, you can use your existing Software Licensing or activate the product with your USB hardware device and a remote license server. The Personal Edition install is not used by the Tools and is not required for this Beta. After copying the installation file, zdt_install.x86_64 to the target machine, you can run this bash script to install, refresh or remove the zd&t Tools and License Manager. You have the option of running the install script in either: v Interactive mode v Silent mode Working with Interactive Mode The Interactive mode allows you to interact with a command line menu and select the zd&t products that you want to install, refresh or remove. To Start the zdt_install.x86_64, enter the following command: $./zdt_install.x86_64 Then the following menu is displayed: 5
The following products can be installed/updated/uninstalled. Please select one: 1) IBM z Systems Development and Test Environment Personal Edition 2) IBM z Systems Development and Test Environment License Manager 3) IBM z Systems Development and Test Environment Tools ==> Type the corresponding number (1,2,3) of the product you want to install, refresh or remove. After selecting the option, the following menu with the options of that product is displayed: What do you want to do with IBM z Systems Development and Test Environment Tools? 1) Install 2) Update 3) Uninstall ==> Type the corresponding number (1,2,3) to decide whether you want to install, refresh or remove the product. After selecting the option, the installer will start executing the selected option. Installing zd&t Tools with Interactive Mode The following case shows how to install IBM z Systems Development and Test Environment Tools using the interactive mode option: [root@csx00529 zdt_tools_beta]#./zdt_install.x86_64 The following products can be installed/updated/uninstalled. Please select one: 1) IBM z Systems Development and Test Environment Personal Edition 2) IBM z Systems Development and Test Environment License Manager 3) IBM z Systems Development and Test Environment Tools ==>3 What do you want to do with IBM z Systems Development and Test Environment Tools? 1) Install 2) Update 3) Uninstall ==>1 Installing ibm-java-x86_64-sdk +++++ 1:ibm-java-x86_64-sdk-8.0-4.6 ################################# [100%] Installing liberty +++++ 1:liberty-1-17.0.0.1 ################################# [100%] Installing Apache derby +++++ 1:derby-1-10.13.1.1 ################################# [100%] Installing war File +++++ 1:war-1-1.0.0.0 ################################# [100%] Copying zdt and License Manager rpms to installer folder. Server zdtserver created. Creating zdttools database. ij version 10.13 ij> CONNECT jdbc:derby:/opt/ibm/zdt/liberty/usr/servers/zdtserver/derby/zdttools;create=true ; ij> Populating zdttools database. 6 IBM z Systems Development and Test Environment Tools User's Guide
After installing IBM z Systems Development and Test Environment Tools, start the server as follows: [root@csx00529 zdt_tools_beta]# cd /opt/ibm/zdt/bin [root@csx00529 bin]# ls -l total 8 -rwxr-xr-x 1 root root 1240 Jul 10 17:24 startserver -rwxr-xr-x 1 root root 1076 Jul 10 17:24 stopserver [root@csx00529 bin]#./startserver Starting server zdtserver. Server zdtserver started with process ID 13307. The IBM z System Developer and Test Environment Tools can be accessed using the following URL in a browser: https://csx00529.canlab.ibm.com:9443/zdtmc/index.html#/login [root@csx00529 bin]# Then, specify the URL https://csx00529.canlab.ibm.com:9443/zdtmc/ index.html#/login in a browser, and the following page is displayed: For this beta version, just click Sign in to access the Tools functions. Then the main options are displayed, and you can specify configuration options, create components, manage z/os images, monitor assets and deploy instances as follows: Chapter 3. Installing zd&t Tools 7
Updating installed zd&t Tools with Interactive Mode The following case shows how to update a previously installed IBM z Systems Development and Test Tools using the interactive mode option. [root@csx00529 bin]# cd /zdt_tools_beta/ [root@csx00529 zdt_tools_beta]#./zdt_install.x86_64 The following products can be installed/updated/uninstalled. Please select one: 1) IBM z Systems Development and Test Environment Personal Edition 2) IBM z Systems Development and Test Environment License Manager 3) IBM z Systems Development and Test Environment Tools ==>3 What do you want to do with IBM z Systems Development and Test Environment Tools? 1) Install 2) Update 3) Uninstall ==>2 Stopping server zdtserver. Server zdtserver stopped. Removing ibm Java Removing Liberty Removing Apache Derby Removing War File Installing ibm-java-x86_64-sdk +++++ 1:ibm-java-x86_64-sdk-8.0-4.6 ################################# [100%] Installing liberty +++++ 1:liberty-1-17.0.0.1 ################################# [100%] Installing Apache derby +++++ 1:derby-1-10.13.1.1 ################################# [100%] Installing war File +++++ 1:war-1-1.0.0.0 ################################# [100%] Copying zdt and License Manager rpms to installer folder. Server zdtserver created. Creating zdttools database. ij version 10.13 ij> CONNECT jdbc:derby:/opt/ibm/zdt/liberty/usr/servers/zdtserver/derby/zdttools;create=true ; ij> Populating zdttools database. After updating IBM z Systems Development and Test Environment Tools, start the server as follows: [root@csx00529 zdt_tools_beta]# cd /opt/ibm/zdt/bin [root@csx00529 bin]#./startserver Starting server zdtserver. Server zdtserver started with process ID 14303. 8 IBM z Systems Development and Test Environment Tools User's Guide
The IBM z System Developer and Test Environment Tools can be accessed using the following URL in a browser: https://csx00529.canlab.ibm.com:9443/zdtmc/index.html#/login[root@csx00529 bin]# Then you can specify the URL https://csx00529.canlab.ibm.com:9443/zdtmc/ index.html#/login in a browser. Uninstalling installed zd&t Tools with Interactive Mode The following case shows how to uninstall the previously installed IBM z Systems Development and Test Environment Tools using the interactive mode option. [root@csx00529 bin]# cd /zdt_tools_beta/ [root@csx00529 zdt_tools_beta]#./zdt_install.x86_64 The following products can be installed/updated/uninstalled. Please select one: 1) IBM z Systems Development and Test Environment Personal Edition 2) IBM z Systems Development and Test Environment License Manager 3) IBM z Systems Development and Test Environment Tools ==>3 What do you want to do with IBM z Systems Development and Test Environment Tools? 1) Install 2) Update 3) Uninstall ==>3 Stopping server zdtserver. Server zdtserver stopped. Removing ibm Java Removing Liberty Removing Apache Derby Removing War File [root@csx00529 zdt_tools_beta]# Working with Silent Mode The silent mode allows you to install, refresh or remove zd&t products without using the command line menu. The silent mode works in the following way: Program usage:./zdt_install.x86_64 <option><product> Where '<option>' can be one of the following: --install which will install the selected option. --refresh which will refresh the selected option. --remove which will remove the selected option. where '<product>' can be one of the following: Chapter 3. Installing zd&t Tools 9
--zdtpedition which will install, refresh or remove IBM z Systems Development and Test Environment Personal Edition. --zdtlicense which will install, refresh or remove IBM z Systems Development and Test Environment License Manager. --zdttools which will install, refresh or remove IBM z Systems Development and Test Environment Tools. For example, to install IBM z Systems Development and Test Environment Personal Edition with Silent Mode, enter the command:./zdt_install.x86_64 --install zdtpedition After typing the command, the installer will start executing the selected option for product. Installing zd&t Tools with Silent Mode The following case shows how to install IBM z Systems Development and Test Tools using the silent mode option. After typing the command, the installer will start executing the selected option for product as follows: [root@csx00529 zdt_tools_beta]#./zdt_install.x86_64 --install --zdttools Installing ibm-java-x86_64-sdk +++++ 1:ibm-java-x86_64-sdk-8.0-4.6 ################################# [100%] Installing liberty +++++ 1:liberty-1-17.0.0.1 ################################# [100%] Installing Apache derby +++++ 1:derby-1-10.13.1.1 ################################# [100%] Installing war File +++++ 1:war-1-1.0.0.0 ################################# [100%] Copying zdt and License Manager rpms to installer folder. Server zdtserver created. Creating zdttools database. ij version 10.13 ij> CONNECT jdbc:derby:/opt/ibm/zdt/liberty/usr/servers/zdtserver/derby/zdttools;create=true ; ij> Populating zdttools database. After installing IBM z Systems Development and Test Environment Tools, start the server as follows: [root@csx00529 zdt_tools_beta]# cd /opt/ibm/zdt/bin [root@csx00529 bin]#./startserver Starting server zdtserver. Server zdtserver started with process ID 15091. 10 IBM z Systems Development and Test Environment Tools User's Guide
The IBM z System Developer and Test Environment Tools can be accessed using the following URL in a browser: https://csx00529.canlab.ibm.com:9443/zdtmc/index.html#/login [root@csx00529 bin]# Then, specify the URL https://csx00529.canlab.ibm.com:9443/zdtmc/ index.html#/login in a browser, and the following page is displayed: For this beta version, just click Sign in to access the Tools functions. Then the main options are displayed, and you can specify configuration options, create components, manage z/os images, monitor assets and deploy instances as follows: Updating installed zd&t Tools with Silent Mode The following case shows how to update the previous installed IBM z Systems Development and Test Tools using the silent mode option. After typing the command, the installer will start executing the selected option for product as follows: Chapter 3. Installing zd&t Tools 11
[root@csx00529 zdt_tools_beta]#./zdt_install.x86_64 --update --zdttools Stopping server zdtserver. Server zdtserver stopped. Removing ibm Java Removing Liberty Removing Apache Derby Removing War File Installing ibm-java-x86_64-sdk +++++ 1:ibm-java-x86_64-sdk-8.0-4.6 ################################# [100%] Installing liberty +++++ 1:liberty-1-17.0.0.1 ################################# [100%] Installing Apache derby +++++ 1:derby-1-10.13.1.1 ################################# [100%] Installing war File +++++ 1:war-1-1.0.0.0 ################################# [100%] Copying zdt and License Manager rpms to installer folder. Server zdtserver created. Creating zdttools database. ij version 10.13 ij> CONNECT jdbc:derby:/opt/ibm/zdt/liberty/usr/servers/zdtserver/derby/zdttools;create=true ; ij> Populating zdttools database. [root@csx00529 zdt_tools_beta]# After updating IBM z Systems Development and Test Environment, the server is started as follows: [root@csx00529 zdt_tools_beta]# cd /opt/ibm/zdt/bin [root@csx00529 bin]#./startserver Starting server zdtserver. Server zdtserver started with process ID 15809. The IBM z System Developer and Test Environment Tools can be accessed using the following URL in a browser: https://csx00529.canlab.ibm.com:9443/zdtmc/index.html#/login [root@csx00529 bin]# Then, specify the URL https://csx00529.canlab.ibm.com:9443/zdtmc/ index.html#/login in a browser. Uninstalling installed zd&t Tools with Silent Mode The following case is to uninstall the previous installation of IBM z Systems Development and Test Tools using the silent mode option. 12 IBM z Systems Development and Test Environment Tools User's Guide
After typing the command, the installer will start executing the selected option for product as follows: [root@csx00529 bin]# cd /zdt_tools_beta/ [root@csx00529 zdt_tools_beta]#./zdt_install.x86_64 --uninstall --zdttools Stopping server zdtserver. Server zdtserver stopped. Removing ibm Java Removing Liberty Removing Apache Derby Removing War File [root@csx00529 zdt_tools_beta]# Installing zd&t Tools z/os files This section describes the installation of the mainframe portion of zd&t tools on the system from which data will be extracted for setting up zd&t instances. To install the IBM z Systems Development and Test Environment Tools host files, follow these steps: 1. Once zdt_install.x86_64 bash script is run on a Linux machine to install the Web UI, the directory /opt/ibm/zdt/zsystem contains a zip file with the mainframe component: zdtbeta_20170705.zip. 2. Unzip the file and get 2 binary files that contain the code. Verify the size of these 2 files against the following list: a. FEU.SFEUAUTH.BIN: 334,560 bytes b. FEU.SFEUSAMP.BIN: 8,320 bytes 3. Customize the following sample job, and submit it in the source z/os to pre-allocate target data sets: //ALLOC JOB jobcard //ALLOC EXEC PGM=IEFBR14 //SFEUAUTH DD DSN=&SYSUID..FEU.SFEUAUTH.BIN, // DISP=(NEW,CATLG),DSORG=PS,RECFM=FB,LRECL=80, //* VOL=SER=vvvvvv, // BLKSIZE=0,UNIT=SYSALLDA,SPACE=(TRK,(10,5)) //SFEUSAMP DD DSN=&SYSUID..FEU.SFEUSAMP.BIN, // DISP=(NEW,CATLG),DSORG=PS,RECFM=FB,LRECL=80, //* VOL=SER=vvvvvv, // BLKSIZE=0,UNIT=SYSALLDA,SPACE=(TRK,(1,5)) //* 4. Use FTP to upload the 2 unzipped files in Binary mode to the pre-allocated data sets in the source z/os. 5. Receive the uploaded files by running the following TSO command: TSO RECEIVE INDA('userid.FEU.SFEUAUTH.BIN') a. Reply the following on the request for restore parameters to create dsprefix.feu.sfeuauth. DA( dsprefix.feu.sfeuauth ) b. Repeat the process for data set userid.feu.sfeusamp.bin. Chapter 3. Installing zd&t Tools 13
6. Grant APF authorization to the load library that holds the load module. For example: a. For an immediate but temporary solution, issue this command in the z/os console v If the data set is SMS managed: SETPROG APF,ADD,DSN=dsprefix.FEU.SFEUAUTH,SMS v If the data set is not SMS managed: SETPROG APF,ADD,DSN=dsprefix.FEU.SFEUAUTH,VOL=volser b. For a permanent solution, the APF authorization must be added via an APF statement to the active PROGxx PARMLIB member. 7. If you are going to use zenterprise Data Compression (zedc) to do hardware data compression, have the system programmer to grant READ access to the SAF profile in class FPZ.ACCELERATOR.COMPRESSION to the user ID that runs the tool. 8. The user who will run data extraction will need READ access to the SAF profile in class DASDVOL for every volume to be extracted. 9. If you intend to use the stand-along extraction utility, modify the sample JCL at dsprefix.feu.sfeusamp(feuvimg) as documented in the JCL. 10. In Unix System Services command shell, running with UID(0), enter the following commands: mkdir -p -m 755 /usr/lpp/ibm/zdt ln -e FEUCLI /usr/lpp/ibm/zdt/feucli.el touch /usr/lpp/ibm/zdt/feuc chmod 755 /usr/lpp/ibm/zdt/feuc 11. Edit /usr/lpp/ibm/zdt/feuc to contain the following text. Note that the setting for STEPLIB must match the dataset name for the executable library that you set up in steps 5 and 6. STEPLIB= dsprefix.feu.sfeuauth /usr/lpp/ibm/zdt/feucli.el $@ 14 IBM z Systems Development and Test Environment Tools User's Guide