Quick tour of the Test and Performance Tools Platform (TPTP) Valentina Popescu IBM Tivoli TPTP AG Lead

Transcription

1 Quick tour of the Test and Performance Tools Platform (TPTP) Valentina Popescu IBM Tivoli TPTP AG Lead 2006 by IBM; made available under the EPL v1.0 October 11, 2006

2 Agenda TPTP Overview TPTP Architecture Models for adopting TPTP TPTP Roadmap TPTP Testing tools TPTP Profiling tools TPTP Monitoring tools Demo What s New in TPTP 4.2 What is coming in TPTP 4.3 Useful Resources by IBM; made available under the EPL v1.0 October 11, 2006

3 TPTP Overview Test and Performance Tools Platform (TPTP) was created as an Eclipse toplevel project in August of 2004 TPTP is a continuation of Hyades project (created in December 2002) with expanded scope Mission is to build a generic, extensible, standards-based tool platform for test and performance tracing tools Project Structure Comprised of four projects Platform, Test, Trace, Monitoring Developed by a number of strategic contributors Intel, IBM, Scapa Technologies, Compuware, Computer Associates, OC Systems, SAP, FOKUS For more information visit by IBM; made available under the EPL v1.0 October 11, 2006

4 Eclipse Architecture by IBM; made available under the EPL v1.0 October 11, 2006

5 TPTP Architecture by IBM; made available under the EPL v1.0 October 11, 2006

6 Reasons for adopting TPTP Focus your investments on value-add portion Let TPTP provide the generic functionality, which is traditionally 80% of the cost of creating a new tool Interoperability of tools Empower users to gather the best-in-class tools from different vendors into a common workbench Empower users to add their own tools for specific needs Eclipse Public License is friendly to commercial use by IBM; made available under the EPL v1.0 October 11, 2006

7 Models for adopting TPTP TPTP Architecture Summary User Interface TPTP perspective in the Eclipse Platform and common UI components to ensure consistent usage models, and sample tools Execution Environment Control interfaces for system under test (starting, stopping, attaching to processes) and linkage to communication subsystem and web services bindings Data Models Test, Profile, Statistical and Log data models Communications & Data Collection Cross process communications, control, and data collection by IBM; made available under the EPL v1.0 October 11, 2006

8 Data Collection and Communication Framework Note: Workbench machine and target machine can be the same machine by IBM; made available under the EPL v1.0 October 11, 2006

9 Data Meta-Models Based on EMF EMF persistence is XML/XMI Two sets of meta-models Test meta-model Execution & Trace Model Trace Model Statistical Model Logging Model Eclipse Modeling Framework (EMF) TPTP Meta-Models Models Test UML 2 Testing Profile Execution History Execution & Trace Logging Trace Statistical by IBM; made available under the EPL v1.0 October 11, 2006 * Other names and brands may be claimed as the property of others

10 User Interface Perspectives: Profiling & Logging, GLA and Test Viewers: UML2 sequence diagram, table, navigator, call graph, interactions, code coverage, log, statistical, symptom, and performance Editors: Probe, test data pool, test meta-date, execution history, GLA configuration Reporting and Charting: SVG charts and text/html reports by IBM; made available under the EPL v1.0 October 11, 2006

11 TPTP Project Structure Platform Static analysis tool Static and Dynamic instrumentation with Probekit Testing tools JUNIT Testing URL Stress Testing Manual Testing Profiling tools Method Interaction and Coverage CPU Utilization Memory Profiling Probe Kit & BCI Monitoring tools Log analyzer and symptom database Generic Log Adapter by IBM; made available under the EPL v1.0 October 11, 2006

12 Profiling tool - Interactions View The Interactions Views present execution flow of an application according to the notation defined by UML2 Trace Interactions. Host Interactions Process Interactions Thread Interactions Agent Interactions Class Interactions Object Interactions by IBM; made available under the EPL v1.0 October 11, 2006

13 Profiling tool - Execution Flow View A clear global view on the overall application execution Analyze the application execution at the thread level. Threads are represented by vertical lines Execution stack goes from left to right Execution time goes from top to bottom Interactive: Zoom In/Out or Select Zoom Table format display available below the graphical presentation by IBM; made available under the EPL v1.0 October 11, 2006

14 TPTP Monitoring Tools Log Monitoring Apache, JBoss, Jonas Generic Log Adapter Common Base Event Standard Problem Determination Symptom Database by IBM; made available under the EPL v1.0 October 11, 2006

15 Monitoring tool Log and Log Interaction views by IBM; made available under the EPL v1.0 October 11, 2006

16 Generic Log Adapter by IBM; made available under the EPL v1.0 October 11, 2006

17 Demo Create a simple plug in and: Run TPTP static analysis against the code Profile the plug in using TPTP Profiler Create a TPTP automated test and run, create reports Profile a web application suing TPTP by IBM; made available under the EPL v1.0 October 11, 2006

18 What is new in TPTP 4.2 Improved Test Log viewer Improved static analysis engine and rules. Improved data collection performance by using aggregated data agents. Improved UI experience for log analysis and correlation. New target system support for 64-bit Windows OS on Itanium Processor Family and Intel EM64T. Dynamic BCI using Dynamic Probekit by IBM; made available under the EPL v1.0 October 11, 2006

19 Technology preview functions in TPTP 4.2 JVMTI profiling support Line level coverage analysis C/C++ Code Review Provider Build to Manage Toolkit Resource monitoring via WSDM and JMX Application response measurement through ARM instrumentation by IBM; made available under the EPL v1.0 October 11, 2006

20 Technical Preview - Build-To-Manage toolkits Benefits for Developers: Less time spent on instrumentation Better diagnostic data from production Don t have to become an expert on management standards Benefits for Operators: Faster problem isolation Better transaction tracing More reliable application deployment Standards supported: JMX - ARM CBE SI WSDM by IBM; made available under the EPL v1.0 October 11, 2006

21 What is coming in TPTP 4.3 Improved JUnit integration between TPTP and JDT Provide a generic Java API recorder to record Java API invocations for creating a test AGR improvements Provide the concept of an object mine inside each test suite RCP Log Analyzer for log analysis and correlation RCP Symptom Database editor Improved profiling UI : better profiling views for analyzing application execution For full list of TPTP 4.3 features see Target release date Nov 11, by IBM; made available under the EPL v1.0 October 11, 2006

22 TPTP Roadmap Approved Done CPL Pending Test & Performance Tools Platform CPL 3.3 CPL 4.0 CPL CPL / EPL CPL / EPL EPL EPL EPL 4.3 TODAY EPL Q3 Q4 Q1 Q2 Q3 Q4 Q1 Q2 Eclipse* Platform A CPL CPL CPL / EPL EPL TPTP 3.x and 4.x releases are based on Eclipse* Platform 3.0.x and 3.1.x respectively 2006 releases pending cross-eclipse alignment CPL / EPL notations refer to the license(s) under which the release will be made EPL by IBM; made available under the EPL v1.0 October 11, 2006 * Other names and brands may be claimed as the property of others

23 Useful Resources TPTP Project Home: Tutorials, Demos, Whitepapers, and much more TPTP Newsgroup: news://news.eclipse.org/eclipse.tptp TPTP Mailing Lists: EclipseCon Home: March 20-23, 2006 in Santa Clara, CA by IBM; made available under the EPL v1.0 October 11, 2006

24 Q & A by IBM; made available under the EPL v1.0 October 11, 2006