Continuous Integration im Umfeld der Oracle SOA Suite 11g

Transcription

1 Continuous Integration im Umfeld der Oracle SOA Suite 11g DOAG Konferenz 2011 Markus Heinisch Markus Zehnder Trivadis GmbH Nov. 2011, Nürnberg BASEL BERN LAUSANNE ZÜRICH DÜSSELDORF FRANKFURT A.M. FREIBURG I.BR. HAMBURG MÜNCHEN STUTTGART WIEN 1

2 Trivadis Facts & Figures 11 Trivadis Niederlassungen mit über 550 Mitarbeitern Hamburg Finanziell unabhängig und nachhaltig profitabel Kennzahlen 2010 Düsseldorf ~180 MA Umsatz CHF 101 / EUR 73 Mio. Frankfurt Dienstleistungen für über 700 Kunden in mehr als Projekten Über 170 Service Level Agreements Stuttgart Freiburg München Wien Mehr als 5'000 Trainingsteilnehmer Basel Zürich Bern Lausanne~350 MA ~20 MA Forschungs- und Entwicklungsbudget: CHF 5.0 / EUR 3.6 Mio. 2 Trivadis das Unternehmen

3 Das Besondere Kundenindividuelle Lösungskompetenz und Herstellerunabhängigkeit Technologiekompetenz Lösungs- und Integrations-Know-how Begleitung über den gesamten IT-Projekt- Lifecycle bietet fundierte Methodenkenntnisse und eigenentwickelte Vorgehensweisen garantiert wiederholbare Qualität und Realisierungssicherheit hat über 17 Jahre Expertise in Oracle und Microsoft verfügt über ein eigenes Technology Center und setzt auf technologische Exzellenz hat eine breite, branchenübergreifende Kundenbasis und jährlich über 1800 Projekte verbindet technologisches Spezialistenwissen mit dem Verständnis für die Business-Spezifika des Kunden begleitet den gesamten IT-Projekt-Lifecycle mit einem modularen Dienstleistungsportfolio bietet für jeden Reifegrad die passende Dienstleistungs- und Lösungskombination 3 Trivadis das Unternehmen

4 AGENDA 1. Why CI? 2. CI Environment 3. CI for SOA 4. Conclusion and what s next 4

5 Integration is hard! Development on your own is nice and easy while integration is hard You already knew that! :-) Effort increase exponentially with Number of bugs Number of components Time since last integration Ideally, we would like to avoid it! effort time 5

6 What is Continuous Integration (CI)? (I) Continuous Integration is a software development practice Members of a team integrate their work frequently Each person integrates at least daily Leading to multiple integrations per day Each integration is verified by an automated build (including test) to Detect integration errors as quickly as possible Many teams find that this approach leads to Significantly reduced integration problems Allows a team to develop cohesive software more rapidly 6

7 What is Continuous Integration (CI)? (II) Replace big (and long) integration phases with small and frequent ones Ideally, instantaneous Think of continuous compilation in Eclipse Minimize integration effort Keep the development process running... CI was introduced with XP Term introduced by Martin Fowler /articles/continuousintegration.html 7

8 Developer s Workflow Developer Notebooks Feedback Mechanism 1. Checkout/Update from SCM 2. Do your coding Update/create unit tests 3. Run automated build on my machine Repeat 2-3 until tests pass! Commit changes SCM Poll CI Server Deploy Runtime Environment 4. Merge with latest changes from SCM Fix and rebuild until tests pass! Build Script 5. Commit to SCM 6. Run a build on a clean machine Immediately fix bugs and integration issues! 8

9 Benefits Continuous, significant and rapid feedback on development progress Finding bugs is easier Early detection of conflicts Self-testing builds Diff debugging Less cumulative bugs Reduced risks Easier predictions Avoid blind spots in the project When you do not know how long it will take to fix all open bugs Developers concentrate on coding Encourage more frequent deployments Leads to Continuous Delivery 9

10 AGENDA 1. Why CI? 2. CI Environment 3. CI for SOA 4. Conclusion and what s next 10

11 Trivadis Trusted Cloud Trivadis Trusted Cloud is a separated platform for development, testing or customer hosting purposes Every single VM or bundled Project VMs will be separated by private VLANs VMware, vsphere Life Cycle Manager 7 Blades, 2 CPUs (4 Cores) and 144 GB Memory on board per Blade SAN Storage TB 145 active VMs Continuous Integration is part of the Trivadis Trusted Cloud IT Services provides VM templates for CI for Java and CI for SOA Soon available: CI for DB-Dev 11

12 Trivadis Trusted Cloud Lifecycle Manager VM Templates CI Java Project X CI Hudson Project X Project Y Project Z Project Trivadis Trusted Cloud CI SOA Windows VMs Nexus Sonar Runtime Environmment SUSE VMs DB RedHat VMs Subversion Nexus TFS JIRA Trivadis Network 12

13 Trivadis Trusted Cloud The Cloud is divided in two types of objects 1. The shared services Available for all projects and supported by IT Trivadis Subversion, full-featured version control system Jira, Issue tracking and project tracking for software development teams Nexus, Maven Repository for libraries Microsoft Team Foundation Server, (pretty useless for Java development ) 2. The vertical components Operating System Template VMs Responsibility IT Services 13

14 Trivadis Trusted Cloud 2. The vertical components CI Template VMs - Master installations for the Continuous Integration environment - All necessary components for the CI are installed, partially configured and ready to run - All the projects which need an CI environment receive a copy of this VM - Responsibility Trivadis CI-Support Team Project VM - Specific for a project - Every Java project needs and uses its own components - Responsibility Project Team Project CI VM - Copy from the Master CI VM - Administrator of the CI environment for the java project still has to configure the various components specifically for his project - Responsibility Project Team 14

15 AGENDA 1. Why CI? 2. CI Environment 3. CI for SOA Goals Components WebLogic Automation OSB Build & Deployment SOA Suite Composites Build & Deployment 4. Conclusion and what s next 15

16 CI for SOA Goals what do we want to achieve? Automate everything Environment WLS Domain creation and configuration Schema repository creation Startup and shutdown of admin- / managed servers OSB & SOA artifacts build & deployment soapui integration testing Maven lifecycle and Hudson build server integration Separate build and deployment Build task: Perform build and unit tests then store artifact in Maven repository Deploy task: Retrieve artifact from Maven repository and deploy to specified environment Foundation for continuous delivery 16

17 Component-Architecture of the CI for SOA Developer Notebook Browser IDE (Eclipse, JDev) OSB Suite SOA Suite Tomcat CI for SOA VM Nexus WebLogic Application Server OSB Suite SOA Suite Sonar Hudson Tools: JDK, MVN, Ant, NodeManager, RCU, OSB OEPE, soapui Oracle XE Project VM Artifact Runtime Environment Integration WLS OSB/SOA Integration DB Dev Tools (Maven, SVN client) Subversion Jira Trivadis Trusted Cloud 17

18 Components of the VM CI for SOA Nexus Repository, V 1.9 Archive for Maven artifacts, libraries and licensed software Hudson, V 2.1 CI Server, builds, tests and deploys software Oracle Software OSB 11g including Oracle Enterprise Pack for Eclipse (OEPE) SOA Suite 11g Oracle Repository Creation Utility (RCU) Oracle XE Universal for meta data repositories Basic Components Java 1.6, JRockit, Maven 2.2.1, Ant 1.8.2, Tomcat 6, soapui 4 18

19 WebLogic Automation (1/2) WebLogic Scripting Tools (WLST) Command-line scripting environment Based on Jython, a Java implementation of Python Supports standard Jython features Ability to use or extend existing Java classes Enhanced with WebLogic specific scripting commands 19 Continuous Integration with Oracle Service Bus and SOA Suite

20 WebLogic Automation (2/2) Domain Templates Defines the full set of resources within a domain Visual Domain Template Builder utility Usable with WLST and Configuration Wizard Great for cloning & duplicating existing domains RCU Command line mode is not really made for automation! Linux solution: Expect scripting language Windows: Pipes & timeout hack Yet still considered the better option than manually backup & restore DB schema 20 Continuous Integration with Oracle Service Bus and SOA Suite

21 OSB Projects Automatic Build & Deployment Development Continuous Integration Develop Check-in Build Package Deploy Test 21 Continuous Integration with Oracle Service Bus and SOA Suite

22 OSB - Automatic Build & Deployment Generate Configuration.jar Not a simple jar, war or ear build Run Eclipse OEPE in cmd-line mode, in WLS-OSB environment!!! Export & Edit Customization.xml Export initial Customization.xml from OSB Customize service-endpoints etc. for tests and different environments Import Configuration.jar & Customization.xml Use WLST import script within ant-task Apply environment specific customization file Parameterized deployment Which artifact version? To which environment? 22 Continuous Integration with Oracle Service Bus and SOA Suite

23 SOA Suite - Automatic SCA Build & Deployment Development Continuous Integration Develop Check-in Build Package Deploy Test 23 Continuous Integration with Oracle Service Bus and SOA Suite

24 SOA Suite - The SCA Build Process SCA builds are performed using a set of ANT build files and tasks Also used by JDeveloper Or from the command line without JDeveloper! Easy to integrate in Maven lifecycle Files are located under: Middleware_Home\SOA_Suite_Home\bin ant-scacompile.xml ant-scapackage.xml ant-scadeploy.xml ant-scatest.xml Compiles a composite project Packages a composite project (into a SAR) Deploys a composite project (a SAR) Tests a composite 24 Continuous Integration with Oracle Service Bus and SOA Suite

25 Testing with soapui JUnit compatible test results Headless command line test runner Easy to integrate with Ant task Too many issues with soapui Maven plugin repository! Pro version recommended Data Sources and SQL Builder Very useful for load tests Convenient form editor 25 Continuous Integration with Oracle Service Bus and SOA Suite

26 Hudson Integration 26 Continuous Integration with Oracle Service Bus and SOA Suite

27 AGENDA 1. Why CI? 2. CI Environment 3. CI for SOA 4. Conclusion and what s next 27

28 Conclusion In use by a large internal reference project Project team couldn t live without it anymore Not as «plug and play» as CI for Java, but: A huge initial time saving for new projects Standard set of scripts for many scenarios Not re-inventing the wheel in every project Improved support and troubleshooting Continuously enhanced By-products: Developer VM (Ubuntu based, cloneable to bare metal HW) Enhanced Trivadis Toolbox TVD-BasEnv with WebLogic support 28 Continuous Integration with Oracle Service Bus and SOA Suite

29 What s next? Planned enhancements Hudson Build Slaves Fully script based configuration of JCA adapters Handling Meta Data Services (MDS) Human Task deployment The future inspired by Oracle s Fusion build system Dependency and impact analysis Dynamically setting service endpoints Extract metrics 29 Continuous Integration with Oracle Service Bus and SOA Suite

30 References Continuous Integration with Hudson, Carlo Bonamico Continuous Integration: Improving Software Quality and Reducing Risk, Paul M. Duvall, Steve Matyas, Andrew Glover Hudson Nexus soapui RedStack blog 30

31 DEN TRIVADIS- STAND FINDEN SIE AUF EBENE 3, STAND NR. 304 Trivadis GmbH Markus Heinisch Lehrer-Wirth-Str München Tel Fax info@trivadis.com Trivadis AG Markus Zehnder Papiermühlestrasse 73 CH-3014 Bern Tel Fax BASEL BERN LAUSANNE ZÜRICH DÜSSELDORF FRANKFURT A.M. FREIBURG I.BR. HAMBURG MÜNCHEN STUTTGART WIEN 31

32 ANHANG 32

33 WebLogic Components Domain Basic administration unit Admin Server Central control entity Managed Server Application components Node Manager Server control (start/stop) WLST Host 1 NodeManager Web administration consoles Domain Machine 1 AdminServer ManagedServer1 Administration Consoles Host 2 Machine 2 NodeManager ManagedServer2 ManagedServer3 33 Continuous Integration with Oracle Service Bus and SOA Suite

34 TVDBasEnv Integration Starting with version 10.05b, TVDBasEnv supports Weblogic Down/dummy : OWLS_DOMAIN(wlserver_10.3) agent(agent11g) nms rdbms1120 (No)mount/up : DB112(11.2.0) Listener : LISTENER(11.2.0) WLS Admin : Up (OwlsAdmin) (wls1) WLS Node : Up (1) You can use TVDBasEnv to start/stop NodeManager Admin Server Managed Server(s) User wlst without password 34