Avionics Cyber T&E Examples Testing Cyber Security Resilience to support Operations in the 3rd Offset Environment

Transcription

1 Avionics Cyber T&E Examples Testing Cyber Security Resilience to support Operations in the 3rd Offset Environment 26 January 2017 Presented by: Mr. Chad Miller

2 NAVAIR Cyber T&E What: Replicate Cyber Battlespace Environment Why: To support Department of Defense (DoD) s acquisition strategy for Cyber Research & Development, Test & Evaluation, and Training for existing and future weapons platforms How: Enhance, augment, and leverage current infrastructure, processes, tools, and Subject Matter Experts (SMEs) to develop full spectrum cyber adversarial emulation 2 2

3 Cyber Challenges Proliferation of software systems into weapons systems creates new vulnerabilities Integrated SoS drives increased use of networking Dynamic and complex Battle-space environment Interoperability and integration Advanced Persistent threat Commercial Software Widely Exploited Obsolescencecc Common Weaknesses Zero Day Exploits Multiple Versions and configurations Legacy Systems Keep interoperable with newer fielded systems Sustainment Non-proprietary and open architecture Increased Cyber vulnerabilities and exposure based on open concept Attack Surface: A system s exposure to reachable and exploitable cyber vulnerabilities Source: SANS Attack Surface Problem: 3

4 External Platform Attack Surface 4

5 Internal Platform Attack Surface Supply Chain Counterfeit Electronics Reverse Engineering 5

6 Cyber Testing Purpose of Cyber Testing Identify Potential Risks Identify Mission Impacts Support of the Risk Management Framework Support of the Cybersecurity T&E Guidebook (Steps 3 6) Vulnerability Eradication Process Tests Should Focus on Assessing Attack Paths, i.e. How the adversary would get into the SUT Radar, TDL, Maintenance, Supply Chain Attack Targets, i.e. What the adversary would be targeting when conducting their attack LRUs, SCADA Systems, Mission Computer, Navigation Systems, Real Time Operating Systems (RTOS) 6

7 Specific Cyber Tests Performance Baseline Vulnerability Scans Code Alteration Exfiltration Geo-fencing Awareness Restoration Penetration Test Counter Navigation Resiliency System Under Test 7

8 Continuum of Testing Engineering Box System Level CDR T&E Aircraft SoS Level Cyber Risk Assessment Cyber Table Top Cyber T&E Cooperative Program Development Information Assurance Adversarial OT Test Plan Test Tools & Infrastructure Test Execution Test Report Adversarial Core Competencies: Intellectual & Practical Access to Specific Information Adversary TTPs Adversary capabilities Unique U.S. capabilities Independent approach Coordination with Red Teams 8

9 Infrastructure Development Strategy Component Box- Level System / Platform System Test Integration Laboratory Cyber LVC Environment System Integration Platform Level Distributed DT&E Regional Naval Cyber Events Mission System Environment Joint Cyber Events Operational Test Support SIL Cyber Life-cycle support Cyber Logistics / Supply Chain System Component ESSIPE NCR Cybersecurity RMF Cyber Table Top CYBERSAFE Cyber Platform Risk Assessment RSDP CRA V&V PEMA Pen Testing / Cooperative Vulnerability Assessment Navy WAN T&E Local Cyber Test Environment with Node Capability Cyber Contested Test Environment Multiple Platform Capability M&S and LVC for Risk Reduction and SoS Integrated NAVAIR/Navy DT&E National Cyber Range / Regional Service Delivery Point Red Team - Adversarial Assessment Cyber Sustainment / Survivability 9

10 Cyber Infrastructure for Non-Standard Computing Devices and Avionics Enhanced Simulation Systems Interface Prototyping Environment (ESSIPE) A self contained, reconfigurable prototyping environment capable of supporting multiple aircraft types, avionics equipment, and simulation hardware providing simulation engineers the opportunity to safely test prototype designs prior to implementation on dedicated simulation/training assets. Faraday Cages Signal Level Instrumentation 10

11 Cyber Test Tools Enterprise IT CORE Impact, Metasploit, Kali Linux, Burp Suite, Cobalt Strike, Peach Fuzzer, etc Special proprietary tools (i.e. TSMO NETT) Custom malware attack vector and target specific Platform Systems Performed an in-depth analysis of aircraft systems vulnerabilities and then developed specific tools and test techniques to exploit discovered vulnerabilities Created computer controlled software define radio devices which functioned with aviation systems Developed to generate malicious inputs to attack highly specialized systems in aviation Ranges & Distributed Resources NCR, JIOR, JMN, RSDPs 11

12 Cyber Testing Examples Cyber Risk Assessment (CRA) & Cyber Table Top (CTT) Validation & Verification (V&V) MH-60, Fire Scout, Triton, P-8A, MQ-25A, etc Portable Electronic Maintenance Aid (PEMA), Common Munitions Bit/Reprogrammer Equipment (CMBRE), etc IFF, Link-16, etc... Integration of HWIL SILs for Cyber DT&E Cyber Chamber DT - EA-18G USS Secure Distributed, LVC Cyber Test & Training A wide variety of testing across the NAVAIR portfolio Includes weapon / PIT systems and logistics elements 12

13 National Cyber Range Supporting T&E Embrace a rapidly configurable architecture that supports multiple test events independent from one another Support simultaneous unclassified and classified programs Make available unified, accredited, and validated Cyber test tools Provide automated Cyber-range creation and configuration processes and procedures Support, develop, and/or integrate credible IT and PIT Cyber environments Enable distributed connectivity to the JIOR and/or JMN Allow access to Navy Installed System Test Facilities and Avionics labs Supply connectivity and interoperability to NAVAIR HWIL and SIL facilities 13

14 NAVAIR/NCR Force Multipliers Ability to integrate and connect platform and weapon system HWIL facilities, SILs, and traditional T&E facilities to a Cyber range Create a unique Cyber contested warfare environment Leverage, enhance, and augment existing Cyber RDT&E Create the ability to perform Cyber testing with the entire effects chain in a full threat environment Validate against both accredited emulations and hardware Provide, coordinate, and leverage platform and weapon system SMEs Create virtualizations of weapon system hardware Expand the Cyber T&E of non-traditional Cyber threat vectors and attack surfaces Provide the ability to take Cyber DT/OT and communicate results to research and engineering as early as possible to be improve products delivered to the warfighter 14

15 Cyber Lessons Learned Collaboration between engineers and Cyber Subject Matter Experts (SMEs) enhances solution development, design, and resiliency Utilizie existing T&E infrastructure, expertise, processes, procedures, and tools catapults Cyber testing Understanding of the adversary s capabilities overlaid with known vulnerabilities (proper use of Red Teams) is critical to developing test strategy Integrating other SYSCOMS and partners to address system of system (SoS) and interface boundary protections is critical to understanding overall vulnerabilities Live, Virtual, and Constructive (LVC) environments and ranges supporting Cyber test utilizing fleet representative models provides a validated baseline to start from 15

16 NAVAIR Cyber Battlespace Large Anechoic Chamber Manned Flight Simulator Shielded Hangar Electronic Combat Stimulation Facility (ECSTIM) ESTEL Warfare Simulation P8SIL Distributed Test Communication, Navigation, IFF Lab High Performance Computing Threat Air Defense Lab 16