IBM Software Group The Challenge of Managing WebSphere Farm Configuration Rational Automation Framework for WebSphere Terence Chow Technical Specialist IBM Rational Hong Kong 2007 IBM Corporation
Example: Set Up A Simple WAS Cluster 2
What s Happening Behind the Scenes Total Steps = 150+ Perform pre-installation tasks Create, configure, and verify deployment manager profile Create, configure, and verify application server profile Create, configure, and verify custom profile Federate nodes (both app server and custom profiles), configure, and verify IBM HTTP server the distributed remote plug-in Create and configure the horizontal cluster (High Availability) Enable and configure HA persistent service HTTP session persistence Memory-to-memory Database Create and configure SIBus and messaging engine (05 steps) (20 steps) (12 steps) (10 steps) (14 steps) (14 steps) (20 steps) (17 steps) (09 steps) (41 steps) (20 steps) (21 steps) (5 steps) 3
Now consider something more complex. 4
Common Pains in WebSphere Environments Lack of consistency and/or repeatability Staff taxed by environment synchronization efforts; Configuration changes hard to manage Challenge to connect disparate groups under single, enforceable process No ability to manage WebSphere environments beyond the cell level Most WebSphere admin performed today using home-grown solutions. Cost-center and a burden to the business. No change history or audit trail for WebSphere configuration Costly automation of configuration changes and deployments Requires custom coding Time consuming to deploy without a framework Lack of a disaster recovery 5
Expand Value with Software Production Orchestration Rational Automation Framework Creative Behavior Front-Office Workflow Automation Build Development Back-Office Production Automation Test DevOps Software Delivery Automation Consumers Users Operations Procedural Rigor Design Requirements Coding Build Package Stage Test Package Handoff Production/GA 6
Background: The Build Forge Automation System Clients Centralized automation server oriented to software development activities Distributed automation system supporting huge variety of platforms Windows, Linux, Unix, Mac, z/os, i5/os, zlinux, Tandem, etc. Automation Server Enterprise Proven automation platform Automation Targets Database Application Server Agent Rational Asset Analyzer worker worker Agent ClearCase / Synergy worker Agent Agent Agent Agent Agent server Server Server server worker worker worker worker Rational Asset Manager (RAM) Rational Software Analyzer Rational AppScan Mainframe 7
RAFW Topology Framework Server Target Systems WebSphere Base/ND Cell Rational Build Forge Management Console Engine, Services Layer, UI SSH Windows SMB/CFIS/DCE/RPC Rational Build Forge Agent Rational Automation Framework for WebSphere SSH Windows SMB/CFIS/DCE/RPC WebSphere Portal Cell
Example Build Forge Automated Process Build Forge Effect of Class Sharing on Memory Footprint in WAS V6.1 WAS 6.02 WAS 6.1 GO Megabytes 800 700 600 500 400 300 245 233 363 328 481 422 600 516 719 609 Aggregated Reports across entire Process 200 126 140 100 0 1 2 3 4 5 6 Number of Running App Servers System configuration Linux: IBM X-Series 335, 2x 3.2 GHz Intel Xeon, 8.00 GB RAM, Suse Enterprise Linux 9 SP3 1. 2. 3. 4. 5. 6. 7. 8. Extract Source Code Extract Asset Metadata Static Analysis of Source Build Source Code Package Build Results Update Defect Tracking Build Results Execute Tests SCM Rational Clear Quest RAM Rational ClearCase, Team Concert, Telelogic Synergy Rational Asset Manager Rational Software Analyzer, AppScan, Asset Analyzer Rational ClearQuest, Team Concert, Telelogic Change Rational WebSphere Framework Rational Quality Manager 9
What Is the Rational Automation Framework for WebSphere? Customizable Framework for the WebSphere Family of products that delivers WebSphere product installation & patching automation Configuration change management Application deployment automation The framework s strengths are Accuracy Reliability Consistency Data Driven - RAFW maintains normalized configuration data Apply the right data to the right WebSphere environment Apply data in repeatable manner to WebSphere environments 10
Does It Work?... Customer stories: Financial Service Company: At present, there are some automated processes in place, but with limited consistency. Knowledge and processes are not standardized across the teams and applications. Much of engineers time is spent executing the steps required to update and deploy these applications. With repeatable automated build and deploys using Build Forge, this could be eliminated. In discussions with the team, 50-75% of the total time of engineering is spent on managing and maintaining Websphere alone. Build Forge can be used to improve the overall efficiency and productivity of the engineers as well as the team leads and management. Source: Rational Build Forge Software Value Assessment for a Financial Company (2007) 11
RAFW Successes ❿ Visa End to end automation from software build, release, test and deploy significantly improved productivity with same staff ❿ ING - Reduced Portal environment deployment from 4-5 weeks to 1 week ❿ Circuit City Reduced WebSphere Application Server environment deployment from 2-3 weeks to 3-4 days ❿ Fifth 3 rd Bank Automated WebSphere administration from 12 headcount by 30% 12
Why you need RAFW Reduce Maintenance Time Minimize deployment/environment build time Build Environments in hours not days code in minutes not hours Gaining Control of your Environment Eliminate Spaghetti Infrastructure problem Enforce Standards Across the Enterprise Reduce Human Errors Repeatability & Consistency Rebuild environments consistently Reliable and Repeatable Disaster Recovery Introduce consistency across SDLC Reduce Costs Free staff up for strategic initiatives Reduce labor costs If Time = Money, Less time = More Money 13
RAFW: Automation of WebSphere & Portal Admin Why Does it Get me? Enterprise-level solution with Multiple O/S support Multi-cell WebSphere Auotmation Over *300* pre-built, field tested actions for WAS and Portal Plus 100+ Portal specific actions Build Forge Framework for Websphere Server Architectural Overview Development Q&A Common use scenarios Multi-cell WebSphere tool Environment build out Configuration capture Application deployment Change management for WebSphere configuration Configuration comparison Source Control Staging Production 14
Centralizing the Management of WebSphere Enterprise solution Multi-cell WebSphere management Multiple OS support Secure communication (using ssh) Framework Server 15
Configuration Scope 16
How RAFW functions Binding of scoped configuration data, environment, and action execution Common collection of reusable actions Reflects scope in WebSphere Ability to chain actions together Context switching between cells Data Driven 17
Example Use Case: Monitor Live WebSphere Configuration Every night Build Forge executes a scheduled comparison of the live cell configuration against the Master. Any difference causes an email notification to be generated and sent to WebSphere administrator for that cell. WebSphere Application Server (and derivatives) ND Cell Rational Build Forge Master (approved) configuration stored under change control Email or RSS feed notification of results of configuration comparison Cell Source Control System 18
Example Use Case: Automating Cloud Development IBM Rational Build Forge with Rational Automation Framework for WebSphere Cut the Cost of Software Development Rational brings industrial production techniques to your cloud development lifecycle that reduce timeto-market and deliver higher quality, consistent results Automate for Agility Automate your existing tools and processes, gain rapid ROI, and then fine-tune your cloud development for increased efficiency and savings Improve Control in WebSphere Environments Over 400 field-proven automated tasks for configuration and application deployment to Application Server and Portal Server targets Head for the Clouds for Greater Resource Utilization Rational Automation Framework for WebSphere integration with WebSphere Cloudburst delivers on-demand, easily customized middleware appliances for all purposes 19
Rational Automation Framework for WebSphere CloudBurst WebSphere CloudBurst 1. Dispense WebSphere Pattern WebSphere Application Server (and derivatives) ment Manager Custom Node IBM HTTP Server Custom Node Start: RAFW Invokes CloudBurst RAFW 2. CloudBurst script callback to RAFW 3. RAFW package and deploy application Cloud Note: This scenario can be extended to include additional Rational components including Rational Asset Manager, Rational AppScan, and Rational Software Architect 20
Example Use Case for Portal in the Developer Cloud The Developer Cloud includes an image for Portal Server that is to be used ondemand for testing the Portal application RAFW bridges the gap between development IDE and Portal Server running in the Developer Cloud WebSphere Portal Server IMAGE WebSphere Portal Server 2. An RAFW automated process is launched that ensures that the target Portal Server image is started within the Developer Cloud. Theme Portlet Portlet WSRP Portlet 1. Portlet developer makes modifications to a portion of the Portal Application and checks changes in to the project SCM Rational Build Forge & Rational Automation Framework for WebSphere Development Tools Application Developer SCM 3. The RAFW automated process builds the portal application changes into a solution release package 4. The RAFW automated process deploys the solution release package on to the Portal Server running in the Developer Cloud RQM Rational AppScan 5. Testing and validation is performed against Portal application to detect quiality problems and potential security vulnerabilities 21
What that looks like in RAFW Build Out New WebSphere Clustered Environment 1. Generate new Environment using Framework Wizard 2. Click on New Project to launch build of new Environment 3. Automatically Notify interested parties upon completion 4. Add steps in project for Configuration elements (JDBC, JMS, JAAS etc) 5. Schedule unattended jobs 6. Rebuild environment as Needed! Complete WebSphere Cell Build out!
Screen capture of RAFW Environment Wizard
Screen capture of Framework Libraries Common configuration and deployment patterns defined as RAFW building block reusable Libraries
Middleware Supported RAFW Release 7.1.1 (May 15, 2009) Supported Middleware Versions, Platforms, and Action Types AIX HP-UX Linux Solaris Windows zlinux z/os IBM HTTP Server Version 6.0, 6.1, 7.0 * * WebSphere Application Server Version 6.0, 6.1, 7.0 * * WebSphere Application Server ND Version 6.0, 6.1, 7.0 * WebSphere Portal Version 6.0, 6.1 * * z/os Support Planned for 4Q09
❿ Detailed domain models ❿Calculates required deployment tasks ❿Maps deployment tasks to automated jobs in Build Forge ❿Stores models and deployment plan in RAM ❿Publishes deployment plan directly to Build Forge IBM Software Group Rational software Rational Software Architect ment Modeling
Learn more at: IBM Rational software IBM Rational Software Delivery Platform Process and portfolio management Change and release management Quality management Architecture management Rational trial downloads developerworks Rational IBM Rational TV IBM Rational Business Partners Copyright IBM Corporation 2007. All rights reserved. The information contained in these materials is provided for informational purposes only, and is provided AS IS without warranty of any kind, express or implied. IBM shall not be responsible for any damages arising out of the use of, or otherwise related to, these materials. Nothing contained in these materials is intended to, nor shall have the effect of, creating any warranties or representations from IBM or its suppliers or licensors, or altering the terms and conditions of the applicable license agreement governing the use of IBM software. References in these materials to IBM products, programs, or services do not imply that they will be available in all countries in which IBM operates. Product release dates and/or capabilities referenced in these materials may change at any time at IBM s sole discretion based on market opportunities or other factors, and are not intended to be a commitment to future product or feature availability in any way. IBM, the IBM logo, the on-demand business logo, Rational, the Rational logo, and other IBM products and services are trademarks of the International Business Machines Corporation, in the United States, other countries or both. Other company, product, or service names may be trademarks or service marks of others. 27
Rational Automation Framework for WebSphere Platform Support Middleware Versions Supported WebSphere Application Server 6.0, 6.1, 7.0 WebSphere Network ment Server 6.0, 6.1, 7.0 WebSphere Portal Server version 6.0, 6.1 Middleware Supported on Following Operating Systems Linux AIX Solaris Windows HP-UX 28