Impact Analysis for Cross Domain Enterprise Applications

Size: px

Start display at page:

Download "Impact Analysis for Cross Domain Enterprise Applications"

Sheena Griffin
6 years ago
Views:

1 Manage the application chaos: Impact Analysis for Cross Domain Enterprise Applications Iftach Ragoler, Sara Porat, Avi Yaeli, Sharif Mograbi, Shlomit Shachor-Ifergan, Alex Akilov, Guy Rosman, Shiri Dori WebSphere Studio As Analyzer (WSAA) IBM Labs in Haifa

2 A Toy Application! Web Archive (War) JSP Jar CICS Region IMS Transaction gif Enterprise Archive (Ear) Concatenation Program IMS subsystem Utility Jar 2 WebSphere Studio As Analyzer (WSAA)

3 A Real Application! Web Archive (War) Jar Web Archive (War) Jar Web Archive (War) Jar IMS Web Archive (War) Jar Transaction Web Archive (War) JSP Jar IMS JSPWeb Archive (War) Jar CICS Region Transaction IMS JSPWeb Archive (War) Jar CICS Region Transaction JSP Web Archive (War) Jar CICS Region IMS JSP Web Archive (War) Jar JSP Jar CICS Region gif CICS Region Transaction IMS JSP CICS IMS Region Transact gif JSP subsystem gif IMS JSP gif subsystem IMS gif JSP Concatenation Concatenation subsystem Concatenation IMS Program ProgramConcatenation subsystem ProgramConcatenation Program Program Concatenation Concatenation Concatenation Concatenation 3 WebSphere Studio As Analyzer (WSAA) Enterprise Archive gif (Ear) JSP Enterprise Archive gif (Ear) Enterprise Archive gif (Ear) JSP Enterprise Archive gif (Ear) JSP Enterprise Archive (Ear) Enterprise Archive gif Utility (Ear) JSP Jar gif Utility Jar gif Utility gif Jar Utility Jar

4 Application Mining What happens when changing a column in this DB? Which other ass are impacted because of a change to this? What is the impact of changing this?! Web Archive (War) Jar Web Archive (War) Jar Web Archive (War) Jar IMS Web Archive (War) Jar Transaction Web Archive (War) JSP Jar IMS JSPWeb Archive (War) Jar CICS Region Transaction IMS JSPWeb Archive (War) Jar CICS Region Transaction JSP Web Archive (War) Jar CICS Region IMS JSP Web Archive (War) Jar JSP Jar CICS Region gif CICS Region Transaction IMS JSP CICS IMS Region Transact gif JSP subsystem gif IMS JSP gif subsystem IMS gif JSP Concatenation Concatenation subsystem Concatenation IMS Program ProgramConcatenation subsystem ProgramConcatenation Program Program Concatenation Concatenation Concatenation Concatenation 4 WebSphere Studio As Analyzer (WSAA) Enterprise Archive gif (Ear) JSP Enterprise Archive gif (Ear) Enterprise Archive gif (Ear) JSP Enterprise Archive gif (Ear) JSP Enterprise Archive (Ear) Enterprise Archive gif Utility (Ear) JSP Jar gif Utility Jar gif Utility gif Jar Utility Jar

5 Application Mining Which tests should I run because of a change in this Jar? Is there a component that parses XML files? Where is it? How many applications access this DB table?! Web Archive (War) Jar Web Archive (War) Jar Web Archive (War) Jar IMS Web Archive (War) Jar Transaction Web Archive (War) JSP Jar IMS JSPWeb Archive (War) Jar CICS Region Transaction IMS JSPWeb Archive (War) Jar CICS Region Transaction JSP Web Archive (War) Jar CICS Region IMS JSP Web Archive (War) Jar JSP Jar CICS Region gif CICS Region Transaction IMS JSP CICS IMS Region Transact gif JSP subsystem gif IMS JSP gif subsystem IMS gif JSP Concatenation Concatenation subsystem Concatenation IMS Program ProgramConcatenation subsystem ProgramConcatenation Program Program Concatenation Concatenation Concatenation Concatenation 5 WebSphere Studio As Analyzer (WSAA) Enterprise Archive gif (Ear) JSP Enterprise Archive gif (Ear) Enterprise Archive gif (Ear) JSP Enterprise Archive gif (Ear) JSP Enterprise Archive (Ear) Enterprise Archive gif Utility (Ear) JSP Jar gif Utility Jar gif Utility gif Jar Utility Jar

6 Application Mining What is the Business Rule of this Application? What is the estimated cost of changing this IMS Transaction?! Web Archive (War) Jar Web Archive (War) Jar Web Archive (War) Jar IMS Web Archive (War) Jar Transaction Web Archive (War) JSP Jar IMS JSPWeb Archive (War) Jar CICS Region Transaction IMS JSPWeb Archive (War) Jar CICS Region Transaction JSP Web Archive (War) Jar CICS Region IMS JSP Web Archive (War) Jar JSP Jar CICS Region gif CICS Region Transaction IMS JSP CICS IMS Region Transact gif JSP subsystem gif IMS JSP gif subsystem IMS gif JSP Concatenation Concatenation subsystem Concatenation IMS Program ProgramConcatenation subsystem ProgramConcatenation Program Program Concatenation Concatenation Concatenation Concatenation 6 WebSphere Studio As Analyzer (WSAA) Enterprise Archive gif (Ear) JSP Enterprise Archive gif (Ear) Enterprise Archive gif (Ear) JSP Enterprise Archive gif (Ear) JSP Enterprise Archive (Ear) Enterprise Archive gif Utility (Ear) JSP Jar gif Utility Jar gif Utility gif Jar Utility Jar

7 Application Mining Does this jar How have many use ass do I have in my any bad practices? Does application? What is their distribution? it follow a J2EE pattern? How do I migrate this War to be JSF based?! Web Archive (War) Jar Web Archive (War) Jar Web Archive (War) Jar IMS Web Archive (War) Jar Transaction Web Archive (War) JSP Jar IMS JSPWeb Archive (War) Jar CICS Region Transaction IMS JSPWeb Archive (War) Jar CICS Region Transaction JSP Web Archive (War) Jar CICS Region IMS JSP Web Archive (War) Jar JSP Jar CICS Region gif CICS Region Transaction IMS JSP CICS IMS Region Transact gif JSP subsystem gif IMS JSP gif subsystem IMS gif JSP Concatenation Concatenation subsystem Concatenation IMS Program ProgramConcatenation subsystem ProgramConcatenation Program Program Concatenation Concatenation Concatenation Concatenation 7 WebSphere Studio As Analyzer (WSAA) Enterprise Archive gif (Ear) JSP Enterprise Archive gif (Ear) Enterprise Archive gif (Ear) JSP Enterprise Archive gif (Ear) JSP Enterprise Archive (Ear) Enterprise Archive gif Utility (Ear) JSP Jar gif Utility Jar gif Utility gif Jar Utility Jar

8 Anatomy of a Real Enterprise Application (WSAA customer) 404,237 source files 185,884 Cobol files 203,557 JCL files 124,430,225 lines of code 24,657,412 comments lines 99,755,617 non comment lines 17,196 blank lines A small CICS region (out of a dozen) has 219 groups 1,100 transactions 105 data stores 8 WebSphere Studio As Analyzer (WSAA)

9 Motivation Many development teams Distributed across the organization possibly multisite Not aware of other teams responsibilities Not managed on the same Source Configuration Management (SCM) Possessing different skills Many programming languages Integration problems Old applications Their developers might have left/retired A change request may raise the questions: What should be changed? What is impacted? Who owns the impacted components? Most of the IT dollars goes for maintaining legacy code Applications need to evolve Application Mining Tools 9 WebSphere Studio As Analyzer (WSAA)

10 WebSphere Studio As Analyzer (WSAA) Solution for the management of application software ass Inventory Capture applications inventory Display application ass and their relationships in a graphical manner Application mining and impact analysis Visually mine the structure and dependencies of application artifacts to assess the impact of changes Enables to make changes to code with more confidence, greater speed, and less risk Search and Reuse Query the repository to locate (reusable) ass 10 WebSphere Studio As Analyzer (WSAA)

11 ) "* ( "" ' " & % " $ # IBM Labs in Haifa WebSphere Studio As Analyzer (WSAA) Enterprise Repositories ClearCase PVCS CMVC CVS Crawlers # Analyzers!" # $" %&'( '" 2' 3( )%* * " "' " #"* " # %%""""' %* " WEB Browser File Systems WAS 4 AE WAS 5 ND!"* +,- +./ +'" "( +2%'* 9 %%( 5# #" 8 % Repository Analysis " " " WSED IDE Eclipse IDE WebSphere Portal Server WAS 5 z/os BEA WebLogic +" 0 XML SVG Portlet WSxD Discovery Analysis Central Repository Client Formatting Services Services Client Integration off-line run-time Legend available features in plan underway 11 WebSphere Studio As Analyzer (WSAA)

12 WSAA Quick Fact Sheet Powered by DB2 and WebSphere Scans code from a variety of configuration management and runtime systems ClearCase, PVCS, CMVC, CVS, WebSphere Application Server, Analyzes various languages and artifacts Java, J2EE (Servlet, JSP, EJB, Tag Library), C/C++, XML, Detect and understands complex semantic relationships and dependencies Java to CICS, Java to MQ, Extensible framework design Use the SDK to extend its functionality 12 WebSphere Studio As Analyzer (WSAA)

13 13 WebSphere Studio As Analyzer (WSAA)

14 Ass Metadata Java War Jsp C/CPP Servlet Cell 14 WebSphere Studio As Analyzer (WSAA)

15 Details Pages Each as type has its own details page Displays the as metadata 15 WebSphere Studio As Analyzer (WSAA)

16 Exploring the Topology Topology exploration helps to understand what exists where 16 WebSphere Studio As Analyzer (WSAA)

17 Compute As Relationship Intra-Language Computes dependencies between software ass within the same programming language Java es Java Methods 17 WebSphere Studio As Analyzer (WSAA)

18 Compute As Relationship Intra-Language Computes dependencies between ass within the same language Hyperlinks References and implementing classes 18 WebSphere Studio As Analyzer (WSAA)

19 Compute As Relationship - Inter-Language Computes dependencies between ass in different languages HtmlServlet Implementing class War 19 WebSphere Studio As Analyzer (WSAA)

20 Compute As Relationship Inter-Language Computes dependencies between ass in different languages /Jms connection Factory Jsp Tag Library 20 WebSphere Studio As Analyzer (WSAA)

21 Compute As Relationship - Higher level of abstraction Adds aggregation of relationships for higher level views E.g. class to class reference may inspire Jar to Jar and package to package relationship 21 WebSphere Studio As Analyzer (WSAA)

22 22 WebSphere Studio As Analyzer (WSAA)

23 Closing the Gap between Distributed and zos The ass are organized in a hierarchical view The relationships of each as to other ass are maintained But we still need to connect between the Distributed and the zos ass --6" " + : Statement Statement Data Field Data Field %% %% -"; Program or Copy Program or Copy Source Source Data Record Data Record - - +%% Program Program File, File, Database Database 12 )! 12 )! " Job Step Job Step Transaction Transaction Problem: How do we compute the connector links? WSAA Distributed + zos 23 WebSphere Studio As Analyzer (WSAA)

24 Connector Representation 24 WebSphere Studio As Analyzer (WSAA)

25 Connector Composition A connector is usually comprised of a few standard API calls that Defines the actual middleware or backend system Activates/writes/reads to/from this middleware or backend system Context ctx = new InitialContext(); Data Base access DataSource datasource = (DataSource)ctx.lookup("java:comp/env/jdbc/BankDB"); Connection connection = datasource.getconnection(); Statement statement = connection.createstatement(); ResultSet resultset = statement.executequery("select NAME from CUSTOMERS"); while(resultset.next()) resultset.getstring("name"); 25 WebSphere Studio As Analyzer (WSAA)

26 Connector Composition A connector is usually comprise of a few standard API calls that Defines the actual middleware or backend system Activates/writes/reads to/from this middleware or backend system Context ctx = new InitialContext(); Jms access QueueConnectionFactory qqcf = (QueueConnectionFactory)ctx.lookup("java:comp/env/jms/PriceChangeQCF"); Queue queue = (javax.jms.queue)ctx.lookup("java:comp/env/jms/triggerq"); QueueConnection txconn = qqcf.createqueueconnection(); QueueSession sess = txconn.createqueuesession(true, 0); QueueSender sender = sess.createsender(queue); TextMessage tm = sess.createtextmessage("50"); sender.send(tm); 26 WebSphere Studio As Analyzer (WSAA)

27 Connector Composition A connector is usually comprise of a few standard API calls that Defines the actual middleware or backend system Activates/writes/reads to/from this middleware or backend system CICS Connector InteractionSpec ceinteractionspec = new com.ibm.connector.cics.eciinteractionspec(); ceinteractionspec.transactionname("os2c"); ceinteractionspec.programname("tc591700"); 27 WebSphere Studio As Analyzer (WSAA)

28 Connector Detection Consists of two phases: Pattern Detection Find occurrences of a pattern in code Inference Engine Infer from those occurrences the relationship between the source component and the backend system or middleware 28 WebSphere Studio As Analyzer (WSAA)

29 What is a Pattern? A pattern is a sequence of instructions and the relationship between them We need to know certain data that flows in the program in order to use it in the connector resolution E.g., database JNDI name For example, the following two instructions result in a Data Base access Context ctx = new InitialContext(); DataSource datasource = (DataSource)ctx.lookup("java:comp/env/jdbc/BankDB"); Matched Important Data 29 WebSphere Studio As Analyzer (WSAA)

30 Pattern Detector Language We developed an abstract XML based language and a tool for detecting the occurrence of patterns in code E.g., The same example in our language: Matched Resolved 30 WebSphere Studio As Analyzer (WSAA)

31 Inference Engine Just discovering pattern occurrences is not enough We want to know to which component this occurrence belongs We want to know the actual backend system or middleware The Inference engine has the domain knowledge for inferring the components E.g., J2EE based Inference Engine 31 WebSphere Studio As Analyzer (WSAA)

32 Connector Detection Challenges Currently uses static analysis In the future should combine with dynamic analysis Need interprocedural analysis for OO languages Data flow analysis that is cross language Load data from external resources E.g., property file 32 WebSphere Studio As Analyzer (WSAA)

33 Related Tools Distributed Impact Analysis and Program Understanding CAST Mining MKS Discover Headway Software - ReView zos Impact Analysis and Program Understanding SEEC Mosaic Studio Relativity RescueWare Component Stores LogicLibrary FlashLine Impact Analysis in the IDE Eclipse Many More. 33 WebSphere Studio As Analyzer (WSAA)

34 34 WebSphere Studio As Analyzer (WSAA)

IBM WebSphere Studio Asset Analyzer, Version 5.1

IBM WebSphere Studio Asset Analyzer, Version 5.1 Helping you quickly understand, enhance and maintain enterprise applications IBM, Version 5.1 Highlights n Provides interactive textual n Helps shorten the learning curve and graphic reports that help