CADE USER MANUAL. Data & Analytics

Transcription

1 CADE USER MANUAL Data & Analytics MARCH 22, 2017

2 Table of Contents 1. Introduction to CADE Data and Analytics Search Dashboard Library Contacting Us - The CADE Help Desk Glossary of Terms and Acronyms References

3 Introduction to CADE What is CADE? The Cost Assessment Data Enterprise (CADE) is an initiative of the Office of the Secretary of Defense Cost Assessment and Program Evaluation (OSD CAPE) with the goal to increase analyst productivity and effectiveness by collecting, organizing and displaying data in an integrated web-based application. Each day, CAPE analysts conduct independent cost estimates and cost analyses, prescribe policies and procedures for the conduct of cost estimation and cost analyses in DoD (Department of Defense), review all cost estimates and cost analyses conducted in connection with Major Defense Acquisition Programs (MDAPs) and Major Automated Information System (MAIS) programs, conduct cost analyses of defense acquisition programs to be carried out using multiyear contract authority, prescribes policies and procedures for the reporting and collection of actual cost data and other information for MDAPs and MAIS programs, and issue guidance relating to the full consideration of life-cycle management and sustainability costs in MDAPs and MAIS programs. CADE provides all analysts with a command and control website housing authoritative source data which are easily searchable and retrievable. CADE will increase analyst productivity and effectiveness while improving data quality, reporting compliance and source data transparency. To learn more visit About this Document The Data and Analytics application of CADE provides analyst the capability to query, download, and visualize Cost and Software Data Reports (CSDRs), Earned Value Management (EVM) and Select Acquisition Report (SAR) data. Additionally, analysts have access to various search and save tools like the Favorite Function and CADE Library to better help them navigate the database and find the cost and program data most relevant to them. Various program views can also be employed to review from different perspectives. The purpose of this manual is to provide all CADE users and students with a detailed description of each of the main functional and sub areas of the site, as well as serve as a step-by-step guide on how to fully utilize the technical functionalities and interpret related content. Registration and Getting Started Registering for CADE is a simple step-by-step process for which you will need to create a username, secure password, and provide a government or company address. If you are a new user and need to register, click Request CADE Account in the top right corner of the CADE homepage. For more information, ask your team training representative for a copy of the CADE Registration User Guide.All returning CADE users and students may click CADE Portal Login and Student FAÇADE Login in the top right corner of the CADE homepage for access. 2

4 Data and Analytics From the CADE Portal Home Page, you can access the Data &Analytics application by clicking on the named link located under the Applications-Analyst menu on the left-hand side of the screen as shown in Figure 1. Figure 1: CADE Portal Home Page 3

5 The Homepage The first screen or Homepage that an analyst will view in the Data & Analytics application is dependent upon analyst-defined preferences. Analysts entering the application for the first time or analysts who choose not to select favorite program(s) will be redirected to the Select Favorite Programs function shown in Figure 2. Here they will be prompted to search for their program of interest. Figure 2: Select Favorite Programs Function As shown in Figure 3, returning analysts who have identified a single favorite program will be redirected to the Dashboard of their favorite program. Figure 3: Program Dashboard View 4

6 As shown in Figure 4, analysts who have two or more programs marked as favorites will be redirected to a program list, where they can then select from among their favorite programs or navigate to the Search page to find a program that is not on their list. Figure 4: Programs List More information on designating programs as a favorite will appear in the Dashboard section. 5

7 The Navigation Bar The Data & Analytics application has been organized into ten major sections and functionalities. As seen in Figure 5, they include - CADE Portal: Return to the initial login screen. - Search: Search for programs, query, run and export data reports. - My CADE: Upload, view, and export all data o Dashboard: Access high level and detailed program data and information. o Retrieve Files: Retrieve exported reports. o Tools: Obtain downloadable excel tools useful with Cost Earned Value and contracts data. o Library: Search and review contract information. o Reports: Standard reports about site metrics and cost report submissions are available to site administrators. - Contact Us: Contact your local Help-Desk. Figure 5: Navigation Bar with dropdown options To navigate between the sections and functionalities, utilize the black navigation bar which will always appear across the top of the screen. To view a particular section or functionality, click on the title or hover your cursor over the title to view a dropdown list of selected subsections under each title. An example of the dropdown list is shown in Figure 5. A secondary navigation bar also appears and is shown in Figure 4 directly below the black navigation bar. From this blue field located on the program dashboard, the analyst can access more information on Acquisition, Cost, Earned Value Management (EVM), and Technical data. 6

8 Widget The widgets can be viewed on the right hand side of the program Dashboard. The widgets can be hidden by using the Collapse Widgets right blue arrow. Once the widgets are hidden, the user must select the left blue arrow to display the information. - Program-Specific Summary Information: Provides a quick summary of the program funding detail from the Defense Acquisition Management Information Retrieval (Repository) (DAMIR) for the program being displayed in the Dashboard. o A link has been provided so the user can quickly navigate to view funding details. - SAR Schedule Events: Provides a quick summary of Selected Acquisition Reports (SAR) program events from DAMIR for the program being displayed in the Dashboard. o A link is provided so the user can quickly navigate to View and Plot Events - Key Events: Provides a summary of key events in the program s history. Events are maintained by the CADE user community. o Select View and Plot Key Events to select and add key events to EVM Views or Create New Key Events. - Library: Provides a summary of the recent activity in the CADE Library. The latest files that have been uploaded are highlighted in the widget. The user can also select the View Library link to navigate to the library. - Community Knowledge- All users can select the link to share and view information related to a specific program. - CCRL Search: Provides quick links to navigate to the CCRL website or to search CCRL documents. o CCRL Website o Click Search CCRL Documents to search and comment on CCRL documents and their properties. You may also search for information by entering keywords into the search bar and click Add Another Filter to bring up more search bars to refine your search. A link to the NCAA Navy Library site is also available. o You may also Order by Popularity by clicking in the box on the bottom right hand. Information will be stored according to how frequently it is searched. - External Links: Provides links to external sources that may be of interests to CADE users. 7

9 Search Select Favorite Programs Function The Select Favorite Programs function allows analysts to query, filter, favorite, and select programs based upon certain criteria. It contains a combination of dropdown and text fields. To utilize this function, slide your cursor over search on the black navigation bar and click on Search Programs when the dropdown appears. Group By: In this section, the user can arrange the outputs by Service, DAES Group, Acquisition Category (ACAT), or Commodity Group. In the example given in Figure 6, the results will be grouped by Service. Filter By: This optional filter function allows analysts to query the list of programs available to a subset of programs based on the input entered. Program Name: Enter the program name to narrow your search. Services: Select from a list of military branches and agencies. DAES Group: A group of programs that will undergo the Defense Acquisition Executive Summary Review on a quarterly basis. ACAT: If known, select the appropriate Acquisition Category. Commodity Group: A group of weapon systems belonging to the same military standard category. Contractor: Enter the name of the prime or subcontractor. 8 Reporting Statuses: Figure 6: Search Program Screen 1. Select Active Only if you are searching for an acquisition program that is actively providing reports (i.e. is responsible for future submissions). 2. Select All if you want to search across defense programs, including legacy. Latest EVM-CR (Earned Value Management Central Repository) DAES (Defense Acquisition Executive Summary) Assessment: Users can filter the search results based on the latest DAES

10 assessment. The options for assessment ratings are Good, OK, Partial, Non-compliant, No Data, and Not Reporting. This provides users with a quick look at which programs have a specific rating. The results will appear to the right of the Group By and Filter By options seen in Figure 7 and will be categorized by the selected group (Service, DAES Group, ACAT, Commodity Group). Click the upward pointing arrow on the left hand side of the grey tabs to expand or hide the results. Figure 7: Search Program Results 9

11 Select Favorite Programs: A favorite program is one that has been marked by the user for easy access. To mark the program as a favorite or remove the program from the favorites list, click in the grey field to the left of the program bar; the screen will reload as seen in Figure 8. All favorited programs will appear in a list as shown in Figure 4. Figure 8: Save Favorite Programs 10

12 Search Cross- Program Function To access the Cross-Program Data function, move your cursor over Search on the black navigation bar and click on Search Cross- Program. Here, analysts query, filter, and compile all Extensible Markup Language (XML) converted Contractor Cost Data Reports (CCDR) and export the data into an analysis ready flat file. Please note that all files dated from the year 2000 through the present are XML converted files. All files dating back to the 1960 s are available in MS Excel or jpeg format. To create a new query, click Edit/Run in the Query menu on the left side of the toolbar. Query Functions (Edit/Run) A. Click Add Filter and select the category (Commodity, Program, Service, etc.) by which the search results should be filtered and click Run. To generate all reports with a given keyword such as Radar or Airframe, select the WBS Element Name filter and a search field will appear. Enter the keyword and press OK. 11 Figure 10: Edit/Run Query Screen

13 B. On the following filter screen, select one or more of the available field options to specify your search and click Ok. Figure 11: Edit/Query Filter Screen C. On the final screen, the filters and selection results will appear. To update the filter selection, click the link in the filter section. Figure 12: Selection Results D. Click Run to generate a list of CCDRs and related metadata by program. E. Results can be sorted in any particular order by clicking on the column title; to nest sort columns, click the titles in the order desired. 12

14 F. Utilize the Include All, Exclude All, or green arrows on the left-hand side of the screen to determine which files will be included or removed from the export; the number of Included Reports will update in the top right corner of the screen. Report Details Figure 13: Query Results To view more program details, click on the underlined name in the Report Name column seen in Figure 13. Within the report details view you can review basic program, contract, and submission information. All forms associated with the program in view will appear in tabs as seen in Figure 14. Figure 14: Report Details 13

15 Export Data and Retrieve Files Click the export icon located on the toolbar located above the report name on the Report Details screen. As seen in Figure 15, an option bar will appear for all files exported with under the Report Details functionality. From there, flat files may be opened or saved to your local drive. Figure 15: Export Flat File from Report Details To export select specific reports and determine the data outputs and format for each, click on the export button in the Results section of the toolbar in the top left section of the screen, the pop-up window seen in Figure 16 will appear. Note: Export to.csv (comma separated values) when retrieving detailed export tables for several dozen files or when individual files are needed. Exports will always be provided in a default MS otherwise. Files that are too large for excel will also export as.csv files. Export Query Results explained: A. Quick Export Tables a. Metadata: Will return a table by CCDR with associated metadata including program name, contract number, prime/sub-contractor name, location, etc. and other information about the data Figure 16: Export Query Table reports b. Summary Elements: Will return a data table with below the line data elements including subtotal cost, general and administrative (G&A) costs, management reserve profit, and total price. 14

16 c. Element 1.0 Only: For each CCDR this export will provide the cost, hours and quantities for Element 1.0 only, further segregated by functional resource categories such as engineering labor and raw materials. B. Detailed Data Tables a. Functional Cost and Hours: Will return the full range of cost, hours and quantity data within the CCDR for all elements within the WBS hierarchy b. Progress Curve: For programs in sequential production this data table will provide unit recurring cost and hours. C. Native Documents a. This export option will provide a ZIP file that contains a raw underlying submission for the Contract Cost Data Reports (CCDRs) such as legacy Excel or XML files. b. The identifying link between native documents (excel or xml files from which the original data is retrieved) and the export tables will be the CCDR report ID (seen in Figure 17) which serves as a unique identifier. When the user has successfully exported a report(s) via the Cross-Program Query function, the document(s) will automatically be send to the queue accessible under My CADE > Retrieve Files. Click the blue arrow icon under Actions as seen in Figure 17 to download the document or click on the trash can icon to delete and remove the file from the queue. Figure 17: Retrieve Files Screen Explanation: Cross Program Query Exports in excel format will contain comprehensive program information related to the selections in the export query. Be sure to control for items such as the CCDR Report ID, WBS Reporting Level, Units of Measurement, and other factors that may cause data to be double-counted, skewed, or otherwise inaccurately represented. A sample export can be seen in Figure Figure 18: Exported Query

17 Dashboard Program specific information can be accessed at any point by selecting the Dashboard on the black navigation bar. From this point, you have easy access to specific program contract and data availability information, as well as, related Acquisition, Cost, Earned Value Management (EVM), and Technical data. Only one program may be viewed at a given time. Generally, the Dashboard view displays the information for your favorite program. If you have more than one program in your favorite list, the view will default to the first program listed alphabetically. Directly below the black navigation bar is a resource section, or blue program menu, through which specific program-related Acquisition, Cost, EVM, and Technical data can be accessed. The user can also review and edit favorite program selections from options available in the blue menu. The following sections detail the information, data, and functions that can be accessed through this menu. Program Search and My Favorite Programs Functions Figure 19: Program Dashboard View The Program search bar to the left of the screen will display the name of the Program that is currently being viewed. This search function will also allow the user to search for a different program by typing in a program name in the white search bar and selecting enter. The displayed program can be added or removed from the My Favorite Programs list by selecting or deselecting the yellow star to the right of the program name. Click on the My Favorite Programs link to access a complete list of favorited programs as shown in Figure 4. 16

18 Program Summary Table and Graphs The first table displays high-level program-specific information in a summary format. The user can quickly understand the Program Name and associated Program Number (PNO) as it is listed in CADE and DAMIR databases. The table also provides the lead service, DoD Program Group, Acquisition Category (ACAT), date of the latest SAR, the Acquisition Cost, and the Quantity. The two graphs displayed in the middle of the dashboard view provide a high-level look at Acquisition cost and quantity data using SAR data. Further details on these charts will appear in the Acquisition Views section (add link to section w/section #). Program Contracts and Data Availability Table This dashboard function lists the CSDR and EVM data that is available by contract for the program. Click the blue addition sign to view contract-specific EVM and CSDR sub-tables that summarize the data by task. EVM Data (By Task) sub-table provides a quick view of the reports available in CADE; click the binoculars icon to browse EVM data. To the right of this function, click the magnifying glass to access various EVM graphs, or the double down blue arrows to export and download the data. Similarly, the CSDR Data (By Task) sub-table can be expanded using the blue addition sign to view the CSDR submissions, their dates, and the types of reports available. The binoculars allow the user to navigate to the Browse/Export data page and the double down blue arrows allow the user to select and download the available CSDR data. Figure 20: Expanded View of the Program Contracts and Data Availability Table To view future submission and report dates, the user can expand the CSDR view to the submission level. 17

19 Acquisition In the Acquisition section of the blue program menu, you will find data and information from the Defense Acquisition Management Information Repository (DAMIR). You can navigate to the pages with acquisition data by hovering over Acquisition in the blue menu and selecting from the drop-down list or by selecting Acquisition and using the links as shown below in Figure 21. Figure 21: Acquisition Home Page A. Views There are four distinct Acquisition views available to the user as seen in Figure 22. Each provides access to various budget, quantity, and schedule data over periods of time. The analyst can select the icon for each graphic to access the data, view and/or edit the chart, and download the data. Figure 22: Acquisition Views a. Acquisition Cost and Quantity Estimate across SAR Submissions This graph, which can be seen in the Dashboard (Figure 19), displays the total cost and quantity estimates for each annual SAR submission. Analysts can tailor the view by clicking the appropriate fields under the View Controls section to the left of the screen. 18

20 This view also shows the total program funding for acquisition appropriations over time. Each bar, along the left-axis, represents the total acquisition cost in then-year dollars for a particular SAR submission. It is broken out by Research, Development, Test and Evaluation (RDT&E), Procurement, Military Construction (MILCON), and Operations and Maintenance (O&M). The line along the right-axis shows the total procurement quantity. In Figure 23, we see that the total acquisition cost and quantity has grown from ~$13B and 1,000 units in the Dec-04 submission to ~$28B and 1,100 units in the Dec 2015 submission. Changes may be applied or reset and will be displayed in the visual graph if applicable. The Export Data to Excel function is available below the Maximum and Minimum Options fields. To the right of the controls is a Zoom In function that can be used to enlarge the visual data. The legend appears in the top right corner of the graph. Figure 23: Acquisition Cost and Quantity Estimate 19

21 b. Time-Phased Acquisition Costs and Quantity This view displays the time phasing of cost by appropriation and procurement quantities from the most recent SAR submission; this graph can also be viewed on the Dashboard as seen in Figure 19. For the most recent SAR submission, this view displays the time phasing of the acquisition budget authorized by congress. On the left-axis, the annual program funding in then-year dollars is broken out by RDT&E, Procurement, MILCON, and O&M. The dotted line on the right-axis shows the annual procurement quantity ordered, or in the case of a future period, the forecasted order. In Figure 23 you can view a program for which funding began in fiscal year 2003 and procurement is expected to end in fiscal year Changes may be applied or reset and will be displayed in the visual graph if applicable. Set filters by clicking the appropriate fields under the View Controls section on the left-hand side of the screen. To the right of the controls is a Zoom In function that can be used to enlarge the visual data; the legend will appear on the graph. The Export Data to Excel function is available below the Maximum and Minimum Options fields. Figure 24: Time-Phased Acquisition Cost and Quantity 20

22 c. Average Procurement Unit Cost (APUC) This view displays the APUC across various SAR submissions in a single view. Though the APUC reported in the SAR is in constant base year dollars, this chart only provides a then-year dollar seen with the bars on the left-axis. Constant-dollar data for the APUC are available by utilizing the export option. Note that the base year of the APUC may change over time according to baseline updates. For a consistent constant-dollar view, the analysts can normalize the then year costs available in the export using an inflation index, properly weighted by the budget appropriation. The dotted line along the right axis represents the total estimated procurement quantity. Figure 25: Average Procurement Unit Cost d. SAR Events Over Time/ Schedule Events The SAR Schedule Events provides a graph and chart of the Current Estimate, Acquisition Program Baseline Objective, APB Threshold, and SAR Baseline of various SAR events (milestone decisions, design reviews, etc.) for each SAR submission. This view allows the user to observe chronological changes in the schedule of a selected program. Analysts have the ability to export event flat files and chart data by clicking the respective links in the top left corner of the page; you will be prompted to open or save the generated document. Submission Effective Dates may also be chosen to be displayed on the graph. The vertical axis displays the SAR completion date as the horizontal axis will display SAR submissions dates; schedule slips to program events are displayed by an increasing line. A table of all program events listed the selected SAR submission is situated below the chart and program events selection field. Select the SAR submission tabs to view program events for a different estimate. Changing the table does not affect the view above. 21

23 Export Events Flat File: This function, located to the top left of the screen combines all SAR schedule events across various SAR submissions for that program into one flat file. Exports are available for the data currently plotted in the view and for all program event data for each of the program s SAR submissions. Figure 26: SAR Estimates Over Time B. Program Information: Provide review key program information, a list of sub programs, and the Mission and Executive Summary from the Selected Acquisition Reports (SARs). a. SAR Annual Funding: Provides summary budget figures in tabular format. Key information listed includes then year costs, base year costs, and procurement quantities by fiscal year and budget appropriation. The export options provided include the Single SAR Export which provides all cost and quantity data for a selected SAR submission, and the SAR Flat File Export, which provides one export including the cost and quantity data from all SAR submissions for that program. The files may be opened or saved to your local drive. b. MAR Annual Funding: This section is the same as the SAR Annual Funding, but pertains to Major Automated Information Systems (MAIS) instead of Major Defense Acquisition Programs (MDAP). The data fields for this section of the MAR are the same as the SAR. The MAR export does not yet include a MAR Flat File Export, though it does provide a flat file for a single MAR submission in the Single MAR Export. c. Contract Budgets: Provides information on major contracts as reported in the Defense Acquisition Executive Summary (DAES) grouped by budget appropriation. These data further breaks-out into completed contracts, large active contracts, small active contracts, future contracts, and non-contract (program office) costs. 22

24 Cost In the Cost section, the user will be able to view and export contractor cost data reports, submit and view information related to Contractor Cost Data Reports (CCDRs) and download VAMOSC Visual Analytics Tools, and user guides. Navigate to the cost data by hovering over Cost in the blue menu and selecting from the drop-down list or by selecting Cost and using the links as shown below in Figure 26. Figure 26: Cost Home Page a. Views No Current Views This section is a placeholder for future or under development standard cost views. Examples include Galaxy Charts of contract costs by Work Breakdown Structure (WBS) for CSDRs or cost improvement by unit for Progress Curve Report (PCR) (DD Form1921) data. b. Browse/Export Data Browse function to view Cost and Software Data Reports submission. Here the analyst can drilldown a specific contract, contract tasks, and submissions and export in either a flat file or traditional CCDR format. c. Cost Estimates In addition to the authoritative cost data that can be browsed and exported via CADE. CADE also houses authoritative estimates that support key milestone decisions. Independent Cost Estimates (ICEs) are conducted by the OSD CAPE for ACAT ID and IAM programs, with accompanying Service Cost Positions (SCPs). The Service Cost Centers conduct ICEs for ACAT IC and IAC programs. This page provides links to allow the user to view the program-specific cost estimates currently stored in the CADE Library and also provides links to support the upload of such documents into the library in accordance with the DoD Cost Analysis Improvement Memo published January 9, i. Submit ICE: When submitting an Independent Cost Estimate include, at minimum, a Spruill Chart, summary briefing, associated milestone and as-of-date. General submission instructions are located in the Library section under Upload New. ii. Submit SCP: When submitting a Service Cost Position include, at minimum, a Spruill Chart, summary briefing, associated milestone and as-of-date. General submission instructions are located in the Library section under Upload New. iii. View ICEs: This link pre-filters the CADE Library so that the user can view the available Independent Cost Estimates associated with the program. Please note that the library will have been previously filtered based on the program in the dashboard view. 23

25 iv. View SCPs: This link pre-filters the CADE library so that you can view the Service Cost Positions associated with a program. Please note that the library will have been previously filtered based on the program in the dashboard view. d. Operations and Sustainment (O&S): The table shown on this page allows users to download O&S Visual Analysis Tools (VATs) and their respective User Guides. These tools allow the user to view and create analysis of O&S costs for various commodity groups. - The chart displayed lists four different Navy tools (Aircraft, MSC, Ships, and Ship Systems), two Air Force tools (one AFTOC and one Test) and three Army tools (Aircraft, Combat Vehicles, and Wheeled Combat Vehicles), their data types, and the date of the most recent update. - In the columns titled Download Tool and Download User Guide on the right hand side of the screen, click one of the green dots to download the O&S Visual Analysis Tool or User Guide for the respective tool. - By clicking Show Description at the bottom of the screen, a dropdown will appear with information regarding AFTOC, OSMIS, and VAMOSC. Earned Value Management (EVM) In this section of the blue program menu bar analysts can access program-specific earned value management data using the report view browse function, build charts using one of 13 EVM views, run validity checks, and export the data using a variety of filters. Figure 27: EVM Home Page 24

26 Validity Checks This page allows the user to customize validity checks on the EVM data. The user can specify the percent thresholds for Actual Cost of Work Performed (ACWP) vs Budgeted Cost of Work Performed (BCWP), and the percent threshold for comparison checks (e.g. BCWP is more than X% greater than Budget at Complete (BAC), Budgeted Cost of Work Scheduled (BCWS) is more than X% of Budget at Complete (BAC), etc.) on performance parameters, sanity checks, and zero count checks. The user can select the specific Contract Task from the drop down arrow and choose the selected time period for which to run the validity check. A. Default. The tool provide a default check of 25% threshold on ACWP vs BCWP (i.e. ACWP is 25% above or below the planned value), a 5% threshold on comparison checks (e.g. BCWP is more than 5% greater than BAC), provides performance checks based on provided thresholds, sanity checks (e.g. there is a BCWP with no BCWS, etc.). A. Validity type and options. B. Export Data Figure 28: Validity Check B. Apply Changes- The user can update the percent thresholds and turn performance, sanity, and zero count checks on and off. C. EVM validity check summary- The results of the check will appear in the EVM validity summary table. D. Click Export below Data - The table will display the detailed results of the validity check and give the element ID, the WBS level, the element name and the validity check details. The user can click on the binoculars to view a summary of all of the EVM performance parameters. The user can also select Export below Data to view the information in MS Excel. 25

27 Browse Data From this page, analysts can view the Integrated Program Management Reports (IPMR) formats 1-4 Metadata, by WBS Elements, Summary elements, by OBS elements, Baselines, and Staffing. Figure 29: Browse Views Click the arrow to the far right to access a dropdown list of the related contract tasks. All EVM tasks for the program will appear. Figure 30: Contract Task Bar To view details in chart form, click the respective chart links seen in Figure 29. The IPMR browse function can also be accessed from the Program and Contracts data availability page. The browse data function allows users to view the data reported in the IPMR formats. Users have the option to view the IPMRs metadata information using the Browse Header option, EVM metrics by WBS using the Browse WBS Elements option, EVM metrics for summary elements using Browse Summary Elements option, EVM metrics by OBS element using Browse OBS Elements option, Baseline data using the Browse Baseline option, and staffing data using the Browse Staffing option. 26

28 Export Data Click here to export EVM data in Microsoft Excel format. Click here to extend the views and select the tabs and variables to be included in the export as well as the format. Figure 31: Export EVM Data A. All Periods Data Dump- Include or exclude CPR Header, WBS Elements and Summary Elements, OBS Elements and Summary Elements, Baseline Elements, and Budgeted and Estimated Staffing. Set effective period dates and choose OBS and WBS levels. In this format WBS elements will be listed as rows and time periods as columns. B. Alternative Format 1 Data Dump- Include or exclude a Header and Summary. Set effective period dates and choose WBS levels. In this format, time periods will be displayed in a single values column. C. Formatted CPR Report- Include or exclude formatting for OBS, WBS, Baseline, and Staffing. This format provides data in the legacy human readable PDF version of the CPR. D. Validity Check Report- Select the appropriate time period and update the percent thresholds on checks for ACWP versus BCWP and comparisons. E. Export by EVM Metric- Include or exclude the Estimate and Budget at Completion (EAC and BAC) and cumulative amounts for ACWP, BCWP, and BCWS. Adjust the effective period dates and WBS levels. F. Raw Files- Include or exclude the formatted Human Readable CPR, CFSR File, and Native Format Schedule. 27

29 Views By selecting the views option under the EVM section, analysts can build various graphs using the IPMR 1-4 formats. Each graph contains a header bar that lists the contract number, contract phase and task, and the performing contractor. Other functions, like data exportation and graph manipulation features are available in each view but will alter Figure 32: EVM Views Header form. Other features are completely unique to the current view. 1. Performance over Time- This view, as shown in Figure 33, will provide a EVM metrics of the contract task over a specified time period. - Adjust the primary and secondary y-axes in the fields or add and remove multiple EV variables to the graph and set the corresponding scale and metric for each. Below the graphs are fields in which the date range can be set for the x-axis and decimal points for the y-axis. Adjust the Primary and Secondary Y- axes and its functions. Set date range, decimals, filter data, and format the tables and files Figure 33: Performance over Time View 28

30 2. Element Performance Comparison- This view, as shown in Figure 34, allows the analyst to compare across WBS elements in one, or at most two, time periods rather than just one element over time. - The analyst to select the number of and level at which elements will be compared. The Primary axis (left-hand side) allows the analyst to view an EVM metric across the WBS elements. This will be represented as bars. The value for the selected metric will be displayed for two time periods which the analyst can select ( Date 1 in pink and Date 2 in blue). - The secondary axis (right-hand side) allows the analyst to compare a different metric represented as a diamond scatter plot. This allows the analyst to, for example, find the largest elements in terms of budget using the primary axis metric (bars) and compare all their cost performance index values using the secondary axis metric (scatter). Utilize these functions to zoom in, export data, or copy the chart Update the primary and secondary axes and report Adjust the dates and table formatting Figure 34: Element Performance Comparison View 29

31 3. Gold Card-As shown in Figure 35, - This view provides standard EVM Gold Card metrics over time. Add overlaying summary and performance metrics and update minimum and maximum values summary and performance values. - Under View Controls, select the series of variables to be displayed in the graph and select the chart style. - Add overlaying summary and performance metrics and update minimum and maximum values summary and performance values Select the appropriate series, minimum/maximum options and viewing options Figure 35: Gold Chart View 30

32 4. Galaxy Chart- This chart will provide a snapshot of how dollar figures are broken out among categories. The size and location of each circle is relative and proportional to that variables impact on the overall budget. - Adjust the parameters for the main and dashed circles including metrics and choose the series that need to be represented. - In the gray box labeled Total, review a detailed list of the segments and sub-segments comprising the galaxy chart. - Select the total number of levels in the box below Total or change the reporting period at the top of the screen. Adjust the reporting period, number of total levels, and view a breakdown of each individual bubble Adjust the metrics for the main and dashed circles Figure 36: Galaxy Chart View 31

33 5. To Complete Performance Index (TCPI) The purpose of this view, shown in Figure 37, is to show the cost performance index (CPI) versus the To-Complete Performance Index (TCPI). The CPI signals current cumulative cost performance, where 1.00 is performance to plan and values lower than 1.00 indicate cost overruns. The TCPI indicates what future cost performance is required in order for the contractor to hit their Estimate at Complete (EAC). - Under View Controls, adjust the start and end date for the reporting period or edit controls such as the WBS element, graph conventions (labels, spread lines), or adjust the minimum and maximum values for cost efficiency and percent growth. - As a general rule, when the TCPI value exceeds that of the CPI by of 0.10 or more, the contractor is unlikely to come in at their estimated costs and may require a re-plan. Adjust the WBS elements, conventions, and Min/Max options Figure 37: TCPI View 32

34 6. EAC Growth Rate (Estimate at Complete) This view allows the analyst, for a selected WBS element, to plot the contractor s Budget at Complete (BAC) relative to the Estimate at Complete (EAC). It also allows the analyst to validate the contractor EAC by creating various Independent EACs. This can be done using a user-defined weighted average of cost and schedule performance indexes (CPI and SPI) based on either the cumulative values or a 3 or 6 months moving average of the performance index values. Further, the analyst can forecast the future BAC, EAC, or IEAC using a linear or log-linear regression based on observed values set by the analyst. The forecasted metrics will go out to the contractor estimated completion date, which can be overridden by the analyst if an independent schedule is provided. Finally, the analyst may plot and forecast metrics as either dollar or % growth (y-axis) and by month or percent (%) complete (x-axis). Note: the view defaults to Cost of Money which does not have the EVM performance metrics. - Set thresholds for the graph. They include an as-of-date as well as high and low growth percentages. Under the Select Independent EAC function you set parameters for the performance index measured and the CPI and SPI weights. - Select the reporting level and element and adjust the override planned end date. Set thresholds, select independent EAC s and elements, set forecasts, and override planned end dates Figure 38: Independent EAC Growth for Cost of Money View 33

35 7. Management Reserve- This chart provides an accounting perspective on managerial funds, more specifically, the baseline, remaining funds against work remaining, and the overall funding. Management Reserve is budget held to cover cost growth that may occur due to the materialization of risk. Burning down management reserve early in the contract can signal performance risk. Select the series to be displayed in the chart and set your minimum, maximum, and percent values. Select series and the Min/Max options Figure 39: Management Reserve View 34

36 8. Budget Shifting - This view shows the analyst which WBS elements have had the greatest volatility in the BAC and/or EAC. The performance issue it is intended to pick up on is when contractors move budget out of back-end elements, such as integration and test, to cover cost overruns in front-end elements, such as requirements and design. Note that the dark solid bars represent changes in BAC between two selected dates, colored by cumulative CPI on the latter date. The transparent bars that overlay the dark solid bars represent the change in EAC for that exact same Element and time-frame. - To the left of this chart, set the date range, reporting level, number of elements, metrics, and views specific to this chart. - Update the thresholds for the CPI Bin. Updates may be labeled as GOOD, FAIR, or POOR. Set date ranges, adjust the number and reporting level of elements, metrics, select views, and thresholds Figure 40: Budget Shifting View 35

37 9. Planning Performance- This view is intended to show planning performance over a six month windows. It is available for Baseline dollar plans (Format 3) and Staffing plans (Format 4). Both options will show, for the last several reporting periods, what the actual value was for that period, as well as the forecasted values for the next six months. This view allows the analyst to see whether the contractor has expended the amount of dollars it forecasted it would (Baseline option) or whether the contractor has expended the amount of staffing units it forecasted (Staffing option). - Under View Controls, select your report type, series, preferred viewing options, and minimum and maximum value options. Set the report type, preferred viewing options, min/max options and series selections Figure 41: Planning Performance View 36

38 10. WBS Contribution- This chart allows the user to drill down the WBS and view the contribution of children elements to either the Parent EAC or the Total EAC. It can provide the analyst into which elements are cost drivers, and which elements have been changing over time. - Select an element to highlight allows the analyst to select which WBS element to display in the chart - Chose the parameters for the conventions, the date, percent EAC, series type, and the minimum and maximum options. Select elements, conventions, percent EAC s and series types Figure 42: WBS Contribution View Select the date and Min/Max options 11. Budgeted Work- This chart displays comparative data relating to work planned versus work performed. - Adjust the views for this specific chart and set minimum and maximum values. Figure 43: Budgeted Work View 37

39 12. Staffing Deviation- The intent of this chart is to display staffing changes over time. The analyst has the ability to select the baseline and compare it with the actual staffing levels, planned staffing levels, and 6 month projections. - Select the desired series and set minimum and maximum values and cumulative values. Figure 44: Staffing Deviation View 13. Burn Rate- This chart will display the monthly burn rate for ACWP for a given project. - Select a WBS element; choose conventions to include a linear regression, or polynomial regression. Set minimum and maximum options. - The analyst may also use this chart to plot a linear or a polynomial regression to get summary statistics for burn rate analyses. Figure 45: Burn Rate View 38

40 Technical Program-specific technical data and information can be accessed through the program blue menu bar. Users can select Technical from the blue program menu, or hover over Technical and select from the drop down menu. Technical data are crucial to provide explanatory cost driver variables for cost estimating relationship (CER) development. CADE is partnered with the Deputy Assistant Secretary of Defense for Systems Engineering (DASD (SE)) and the service cost centers to systematize the collection of Technical data across Commodities. Views The views page is a placeholder for future visualizations of technical data or paired cost and technical data. a. CARD Cost Analysis Requirements Description: In this section, the user you can submit, browse, and search for Cost Analysis Requirements Descriptions for a program currently in the CADE Library. - Contact CAPE Leadership: The name of the CARD process lead will appear with a hyperlink. Click here to send this individual an via outlook. - Interim CARD Policy: More information on CARD policies can be found on the CADE public website. - Submit CARD: From the CARD page, the user is provided a link to upload a CARD with all appendices, attachments and memorandum in the CADE Library. General submission instructions are located in the Library section under Upload New. - Views CARDs: From the CARD page, the user can click on the link to view all CARDs associated with the program. The link redirects the user to the CADE Library which displays pre-filtered results based on the program and a search for CARD. b. SRDR- Software Resource Data Reports: Access the software resource data reports and related data - CSDR Drill-Down: This CSDR Drill-Down refers to the same functionality that can be found under Cost -> Browse/Export Data. The SRDR page will redirect the user to the Browse/Export function pre-filtered on the first contract associated with the program. - Tools: Please visit the Tools section later in this document for more information. - SRDR Unified Review Function (SURF): This function supports the DCARC review of SRDRs. - SRDR Analyst View: One of the ways in which an analyst can review the SRDR data available in CADE. o Browse Raw Reports: Allows the user to view the SRDR data Select options from the following dropdown sections: Program, Authorizing Vehicle (Contract), Element, and Report. Select the Software Resources Data Report. Review page one of the Software Resources Data Report for information on the report context, project description, and site. Review page two of the Software Resources Data Report for information on project resources and expected scheduling. 39

41 Figure 46: SRDR Analyst View Data Analysis Query: Allows the analyst to query the database by Service, Program, Authorizing Vehicle or Element. Productivity Chart: The productivity chart provides a visual representation of the Total Labor Hours versus the Equivalent Source Lines of Code (ESLOC) for the selected data. To create a Productivity Chart the user must follow these steps: 1. Filter the data based on Service, Program, Authorizing Vehicle or Element 2. Select the data points to include in the analysis 3. View the Results. The results can be exported into MS. Excel and the user has the ability to group the results by CMM level, Primary Application, and Primary Language. Also, the user can set the min/max of the chart based on Total Hours or ESLOC. Grouped Productivity Chart: The Grouped Productivity chart provides a visual representation of the Hours/ESLOC (productivity factor) versus the CMM Levels, the Primary Application, or the Primary Language. Prod Compare: The chart allows the analyst to look at how the productivity changes over time based on the data that is selected. The chart compares initial productivity to final hours/initial size. The analyst can look at how different elements compare within programs or how different programs compare to each other. Growth Chart: The growth chart allows the analyst to view the % change in both ESLOC and Hours by WBS element. 40 c. TDR: The Technical Data Report (TDR), also known as the DD Form 1921-T, is used to capture estimated and actual parameter values from a given contractor during key milestones moments which include Preliminary Design Review (PDR) and Critical Design Review (CDR). This section is under development but will expound upon the information provided in the Contractor Cost Data Reports (CCDRs) and Software Resource Data Resources. Current policies and guidelines can be found on the CADE public website. d. The final chart to review information on AFTOC, OSMIS, and VAMOS

42 Library The CADE library is a document repository primarily used to store hanging files that are searchable by document title, as-of date, container type, commodity type, organization name, life-cycle phase and program name and does not currently search the Cost and Software Data Reports (CSDR) or Earned Value Management (EVM) data stored in DACIMS, the EVM-Central Repository (EVM-CR), or CADE. The CADE library has three main functions: Upload New, Simple Search, and Advanced Search. The default view for the CADE library is the Simple Search. Upload New In Upload New the user can create a new entity within the CADE library called a container. A Container is a group of closely related easily accessible files with a common set of metadata. While Containers correspond to a single program, it can be tagged with up to seven programs. A. Required Data a. Container Title- This should include the program name and a brief description of the container. b. As-Of Date- Use the calendar icon to select the appropriate date. This date reflects the asof date of the data and not the upload date. c. Container Type- Select the appropriate type from the drop-down. If the needed Container Type is not listed, select Other and notify a CADE Content Manager of a new container type that should be added to the list. If your document does not fit into one of the preexisting containers, contact your library content manager. d. Organization- Select the organization that created the file(s) from the drop-down list. e. Container Files- Attach relevant files and references B. Optional Data a. Point of Contact The point of contact for the container. In some cases, this is the analyst that uploaded the data. This could also be the author of the file(s). b. Commodity: If known, select the commodity associated with the file(s). c. Publish Date This is the date that the data can be published into CADE. This is used by the CADE librarian when access to data or information is restricted by date. d. Life Cycle Phase: If known, select the Life Cycle Phase that corresponds to the associated file(s). e. Program Description 41