Test.Forge.mil Overview
Improving Software Development Reduce Cost Faster Delivery More Testing Agile Development Cloud Virtualization????
Current Process Program Office Development Contractor(s) Test Contractor(s) IV&V Agency(s) Ops Team
Desktops & servers Provide access to the all resources necessary Operating Systems & updates Applications & code...to all parties involved Test.Forge.mil Goals Test cases Program Office Developer Tester Community Member so they can support &perform rapid, repeatable, agile, ondemand testing of software systems Functional Performance Regression DT OT while leveraging automation and virtualization to expand resources. Virtual services Virtual machines Virtual users
What it is Test.Forge.mil PKI Authentication Forge.mil SSO Database Community.Forge.mil Integration Remote Access Solutions UI & Other Requirements CONS3RT PaaS BaaS TaaS Hosting Application Lifecycle Management Source Code Build Data Center Cloud Machine Virtualization O/S & Application Provisioning Virtual Services Test Tools Messaging Backbone * some 2011 products All Rights for Reserved illustrative purpose; not all listed are implemented at this time
How it Works Local Cloud Private Cloud Public Cloud Web Collaboration Scenario Virtualization Tools Test as a Service Provisioning Platform as a Service Build as a Service Scenario #7 VMs Servers O/S Apps Configs Test Assets Scenarios/Appli ances Source Code Virtual Services Devices Asset Library
Sample Project Sample Project: Objective Build a web dashboard for senior leadership that displays DoD activities alongside current events and weather for situational awareness purposes. Location: Kabul, Afghanistan Troops Map 84,375 21,222 34 111 18,153 DCAPES News Weather Use of program/organization names are for illustration purposes and do not represent any official involvement with Test.Forge
Test.Forge Dashboard Project Program Office Developer Tester Community Member The Master Dashboard PMO can define the standard configurations for the systems to be used in development & test. The DCGS A PMO can publish a standard DCGS system to be used in development & test. The TBMCS PMO can publish a virtual service model with standard inputs/outputs for development & test. JITC can provide standard interoperability tests tat are run using existing test tools. The developer can build & save virtual service models of some of the industry news feeds to expedite efforts. The developer can run continuous integration testing with every daily build. The testers can begin creating & validating test cases in parallel with development. The developers & testers can quickly evaluate a what if scenario by replacing one part of the system (e.g. IBM vs. JBOSS). Forge.mil Infrastructure (NTP, DNS, DCHP) Master Dashboard Project DCGS A Project TBMCS Project Virtual Service Engine(s) Dashboard v0.2 DCGS v10.1 Test as a Service (LISA, Selenium, W3AF, etc.) Dashboard v0.3 CONS3RT Maestro External Cloud FAP VSManager TestManager GUI Messaging Test.Forge Services O/S Apps Configs Test Assets Test.Forge Asset Library Scenarios/Appli ances Virtual Services Test.Forge Cloud External Cloud Use of program/organization names are for illustration purposes and do not represent any official involvement with Test.Forge
Demo
Test.Forge.mil enables the ability to build virtual machines install multiple software applications onto these virtual machines pull, build & deploy source code onto these virtual machines mange virtual service models What it does combine virtual machines & virtual service models into complex systems of systems scenarios deploy (turn on) these scenarios select the destination cloud for the deployment run automated tests against a deployment save and reuse all the components, scenarios and deployments execute these tasks on demand with any combination on Windows and Linux components
How to use it Test.Forge.mil can be used for Platform as a Service build workstations for developers to write code build workstations for testers to write test perform manual tests what if analysis Test as a Service execute regression testing on new builds perform smoke tests performance testing what if analysis Continuous Delivery continuous integration (big & little) compliance testing Build as a Service Collaboration share knowledge, techniques & technology across communities connect non developers & non testers
Benefits Goals & Benefits: On demand environments to support all levels of testing Shorten timelines, reduce cost for testing Push quality down to source of problems Test early, test often (every week, every day, every hour) Pull in all parties involved in development (not just developers) Act as a Test Range for IT Systems Incorporate best of breed COTS/GOTS test tools Transform cloud from buzz word to useful tool Reduce risk Work with common tool sets for testing, automation
Contact Information ESI3 Lab 15 Eglin Street Building 1607, Shelter 10 Hanscom AFB, MA 01731 (781) 377 7184 DSN 478 7184 https://www.esi3l.ceif.hpc.mil Peter Walsh Program Manager, NPLACE WVHTC Foundation, Inc. walsh@nplace.net peter.walsh.ctr@hanscom.af.mil Phone: (781) 377 7211 DSN: 478 7211 Cell: (617) 816 6001 John Casebolt President, CTO Jackpine Technologies john.casebolt@jackpinetech.com Phone: (978) 263 6025 Cell: (978) 394 2195
Backups
Test.Forge Feature Roadmap* Scenarios, Assets & Clouds Testing Other build & deploy virtual machines automated test workflow integration in Forge.mil build & deploy virtual services deploy into other cloud(s) execute itko LISA tests execute soapui tests single sign on users & groups CAC authentication Pilot Phase connect your cloud execute Selenium tests asset visibility rules deploy on hardware execute W3AF scans NIPR accreditation config & deploy devices nested scenarios automated O/S updates dynamic resource management execute Retina scans execute Fortify code scans execute HP LoadRunners tests consolidated results reporting project level resources billing model metrics license management Future Phases *Feature set subject to change during the development process
How We are Building it Developer New Code local (IDE) build svn commit Jenkins & Maven Good build? Integration Deploy in INT Debug & test Pass tests? Delete artifact Continuous Integration Deploy in CI Smoke/Regr ession Pass tests? New stuff? Tag Jenkins & Maven QA Deploy in QA Smoke/Regr ession New tests Pass tests? New stuff? Tag Jenkins & Maven Production Deploy in Prod