Supporting Rapid Acquisition with Speed and Agility

1 34th Annual ITEA Symposium: T&E in a Time of Risk and Change Supporting Rapid Acquisition with Speed and Agility Mr. Derrick Hinton Acting Director Test Resource Management Center 5 October 2017

2 Topics of Discussion TRMC Overview Rapid Acquisition (RA) Defined Alternative Pathways for Acquisition Sample RA Use Case Characteristics of the RA Process Required Characteristics of T&E Infrastructure to Support RA Identifying and Overcoming Challenges Ultimate Vision Points of Contact

TRMC Overview 3

TRMC Organization As of 1 Oct 2017 Under Secretary of Defense for Acquisition, Technology & Logistics The Honorable Ellen M. Lord Chief Financial Officer Chief Operating Officer Director, TRMC Mr. G. Derrick Hinton (Acting) Deputy EA for Cyber Test Ranges PM, NCR Complex Expansion Principal Deputy, TRMC Ms. Sheila Wright (Acting) Deputy PM, NCR Complex Expansion Deputy Director, T&E Range Oversight Deputy Director, Major Initiatives and Technical Analyses PM, T&E/S&T // PM, JMETC Agency Range Oversight Air Force Range Oversight PM, CTEIP Director, TENA SDA Director, NCR Complex Army Range Oversight Navy Range Oversight Deputy PM, CTEIP PM, REP Deputy PM, T&E/S&T Deputy PM, JMETC Deputy Director, NCR Complex 4

TRMC Missions (1 of 2) DoD (Charter) Directive 5105.71 MRTFB OVERSIGHT / T&E INFRASTRUCTURE Plan for and assess the adequacy of the MRTFB to provide adequate testing in support of the development, acquisition, fielding, and sustainment of defense systems Support the Department s objective of ensuring compliance with DoDD 7000.14-R Review proposed significant changes to T&E facilities and resources of the MRTFB before they are implemented by the DoD Components Issue guidance to the DoD Components, through the USD(AT&L), with respect to MRTFB planning Maintain an awareness of other T&E facilities and resources, within and outside the DoD, and their impacts on DoD requirements Serve as Executive Agent for Cyber Test Ranges STRATEGIC PLAN Complete a strategic plan for T&E not less often than once every 2 fiscal years Statutory Regulatory 5

TRMC Missions (2 of 2) DoD (Charter) Directive 5105.71 BUDGET CERTIFICATION Submit report to the SECDEF containing the comments of the Director concerning all such proposed budgets, together with the Director s certification as to whether such proposed budgets are adequate PROGRAMS Administer the CTEIP (Central Test and Evaluation Investment Program) and T&E/S&T Program CAPABILITIES Manage and operate the JMETC (Joint Mission Environment Test Capability) Multiple Independent Levels of Security (MILS) Network and the Regional Service Delivery Points (RSDP) cloud computing environments Manage and operate the NCR (National Cyber Range) (IAW RMD 407A1, Issue #1, Title: Cyber, Jan 12, 2015) to provide test capability and capacity for the T&E Community Statutory Regulatory 6

Rapid Acquisition (RA) Defined 7

Rapid Acquisition (RA) Defined 8 CJCSI 3170.01I, 23 January 2015, Glossary page GL-7: Rapid Acquisition A streamlined and tightly integrated iterative approach, acting upon validated urgent or emergent capability requirements, to: conduct analysis and evaluate alternatives contract using all available statutory and regulatory authorities and waivers and deviations of such, appropriate to the situation; identify and minimize technical development,..; and rapidly produce and deliver required capabilities.

Alternative Pathways for Acquisition 9

10 A New Acquisition Pathway Today, the DoD predominately uses two acquisition pathways that are well understood and used regularly: Major Defense Acquisition Programs (DoDI 5000.02) Urgent/Emerging Operational Needs (DoDD 5000.71) DoD s response to Congress on NDAA FY 2017 section 901, requiring the re-org of AT&L, states: in today's near-peer competitive environment, DoD needs alternative pathways to acquire capabilities FY 2016 NDAA provided such an additional pathway: Middle Tier Acquisition

Current DoD Policy on Rapid Acquisition 11 DoDD 5000.71, August 24, 2012, Rapid Fulfillment of Combatant Commander Urgent Operational Needs DoD s highest priority is to provide warfighters involved in conflict or preparing for imminent contingency operations with the capabilities urgently needed to overcome unforeseen threats, achieve mission success, and reduce risk of casualties. DoDI 5000.02 February 02, 2017 Operation of the Defense Acquisition System Rapid Fielding of Capabilities Enclosure 13, URGENT CAPABILITY ACQUISITION CJCSI 3170.01I January 23, 2015 Joint Capabilities Integration and Development System Complies with PUBLIC LAW 107 314 DEC. 2, 2002 BOB STUMP NATIONAL DEFENSE AUTHORIZATION ACT FOR FISCAL YEAR 2003 SEC. 806. RAPID ACQUISITION AND DEPLOYMENT PROCEDURES.

Sample RA Use Case 12

13

Characteristics of the RA Process 14

Characteristics of the RA Process Global Hawk Examples: Joint Improvised Explosive Device Defeat Office Mine Resistant Ambush Protected (MRAP) Vehicles Predator Hellfire Missiles Accepts greater risk than deliberate process Includes rapid development, rapid prototyping, and/or rapid procurement and rapid fielding Synchronizes abbreviated requirements, resourcing and tailored processes and eliminates approval layers Deviates from and/or waives authorities RA delivery includes a CONOP refinement effort after equipment delivery RA organization assists with operationalizing solutions Includes an operational assessment Iterative process; leads to spiral development Solution includes a training element Initial sustainment generally includes Field Service Representatives Adapted from Chris O Donnell (D,JRAC) Rapid Acquisition brief to Product Support Manager Workshop on 8 June 2017 15

Required Characteristics of T&E Infrastructure to Support RA 16

Global Hawk Required Characteristics of T&E Infrastructure to Support RA Examples: Joint Improvised Explosive Device Defeat Office Mine Resistant Ambush Protected (MRAP) Vehicles Predator Hellfire Missiles T&E must rapidly present environments, targets, threats using: Modeling and Simulation o Red, Blue, and Gray digital intel packages to rapidly integrate and update profiles into simulations o Rapid virtualization of system under test o Common protocols across all M&S and T&E activities Hardware in the Loop & Installed System Test Facilities o Maximize digital/modular interfaces for rapid reconfiguration Open Air Ranges o Core of peer competitors order of battle laydown established o Digital/reconfigurable emulators o Contract authority Real time Data Collection and Presentation o Big data mining o High-speed analysis tools for rapid transition of data to reports 17

Rapid Acquisition Test Infrastructure Enablers 18 When speed of delivery is a driving priority, program leadership needs to assess the ability of a candidate range not only to provide technical services, but also to deliver those services and critical administrative enabling functions at a speed acceptable to the fielding requirement.

To Support RA Programs, an MRTFB Must 19 Have agile internal processes and procedures Have modeling and simulation support services Be configurable to support RA (ISTFs) Be able to develop and produce tailored T&E products Be able to develop tactics, techniques and procedures concurrent with T&E Be able to begin immediate construction of infrastructure Be able to clear non-traditional air vehicles in time to support RA

and Must Also Have the Following Already in Place 20 A variety of funding constructs for RA Appropriate contract vehicles to support immediate activity Environmental Impact Clearances for intended T&E Special Use airspace Spectrum allocations (in place or immediately resolvable) Rapidly configurable Govt and contractor workforce TS/TS-SCI billets and workspaces for Govt, contractors, and foreign partners

T&E Infrastructure Support Missile engagement effectiveness requires successful execution of all segments of the offensive kill chain Emulate necessary environment Accept higher risk Demonstrate performance Iterate M&S - DIADS - ITASE - JSE - Etc Next Generation Jammer (NGJ) HWIL / ISTF Rapidly configurable environment Programmable threats EA-18G F-35 Dynamic Targets (5) OAR Teaming Arrangements Transportable Instrumentation Programmable & Mobile Threats MILCON Waiver 21

Identifying and Overcoming Challenges 22

23 Common Range Instrumentation Challenges & Solutions Challenges Solutions Increasing RF spectrum demand Increasing demand for data accuracy and precision Increasing data quantity driving network and storage capacity SUTs driving need for miniaturization and modularity Common hardware and standards for telemetry and TSPI CTEIP Projects o o o Common Range Integrated Instrumentation System (CRIIS) Integrated Network Enhanced Telemetry (inet) Advanced Range Tracking and Imaging System (ARTIS) Supporting T&E/S&T Efforts o Spectrum Efficient Technology Efforts ULTIMATE GOAL: Wireless Inter-Range Network Environment That Seamlessly Supports Any & All Range Operations 24/7/365 In the Most Spectrum-Efficient Manner Possible

24 Autonomy Challenges & Solutions Challenges Solutions Range control and safety Establishing user trust Non-intrusive instrumentation Testing see-and-avoid technologies Repeatable testing of cognitive autonomous system interactions DMS/ISTF/OAR correlation Replicating swarming autonomy scenarios CTEIP Projects o Swarm Autonomy and Scoring (SWARM) Supporting T&E/S&T Efforts o o o o Autonomy T&E Infrastructure Gap Assessment and Investment Plan (IGAP) Stress Testing of Autonomy Architectures (STAA) Robustness Inside-Out Testing (RIOT) Safe Testing of Autonomy in Complex, Interactive Environments (TACE)

25 Cyber Security Challenges & Solutions Challenges Solutions Keeping pace with rapidly changing cyber threats Ability to present representative operational environments Visualization of cyber battlefield and effects Controlling propagation of threat (isolated from operational systems) Sanitization of the test environment Maximize utility of distributed cyber test environments National Cyber Range (NCR) o o o o Multiple Independent Levels of Security (MILS) architecture; rapid emulation; automation; sanitization capabilities Cyber Table Tops Regional Service Delivery Points (RSDPs) NCR Complex Buildout CTEIP Projects o CTEIP Cyber Test Analysis and Simulation Environment (CyberTASE) Supporting T&E/S&T Efforts o o Advanced Cyber Threat Representation (ACTR) Framework for Automated and Verified Sanitization (FAVS)

Ultimate Vision 26

VISION: Live-Virtual-Constructive (LVC) Test Environment CROSS DOMAIN OPERATIONS Programs of Record (e.g., F-35) Tactical Network Emulation Virtual & Constructive Red & Blue System Simulations Mission Based Scenarios System Integration Test Support Network Distributed Data Collection Cloud Services Common Tools Standard Processes and Repositories TENA Solutions TENA Middleware Virtualization V V & A PRE-EVENT Planning Protocol Translators JMETC Networks System Adaptors JTEN Massively Parallel Processing Configuration Management Gateways Security Range Protocols JIOR EVENT Monitoring, Management, Control Big Data Storage High Level Architecture Cross Domain Solutions Information Assurance Distributed Interactive Simulation Big Data Analytics POST-EVENT Data Reduction, Analysis, Visualization MOP Framework

VISION: LVC Test Environment A Closer Look

TRMC Points of Contact 29

TRMC Points of Contact Mr. Derrick Hinton Acting Director, TRMC Acting Executive Agent (EA) for Cyber Test Ranges george.d.hinton2.civ@mail.mil 571-372-2761 Mr. Chip Ferguson Deputy EA, Cyber Test Ranges bernard.b.ferguson.civ@mail.mil 571-372-2697 Mr. AJ Pathmanathan Director, National Cyber Range (NCR) Complex arjuna.pathmanathan.civ@mail.mil 571-372-2702 Dr. Robert Tamburello Deputy Director, NCR Complex PM, NCR Complex Expansion robert.n.tamburello.civ@mail.mil 571-372-2753 Mr. G. Derrick Hinton (Acting) Director, TRMC EA, Cyber Test Ranges george.d.hinton2.civ@mail.mil 571-372-2761 Ms. Sheila Wright (Acting) Principal Deputy, TRMC sheila.r.wright.civ@mail.mil 571-372-2735 http://www.acq.osd.mil/dte-trmc Mr. George Rumford Deputy Director, Major Initiatives & Technical Analyses PM, Test & Evaluation / Science & Technology (T&E/S&T) PM, Joint Mission Environment Test Capability (JMETC) george.j.rumford.civ@mail.mil 571-372-2711 Ms. Denise De La Cruz Deputy Director, T&E Range Oversight denise.b.delacruz.civ@mail.mil 571-372-2733 Mr. Christopher Paust PM, Central Test & Evaluation Investment Program (CTEIP) christopher.w.paust.civ@mail.mil 571-372-2732 As of 1 Oct 2017 30

Backup 31

Concept for Alternative Paths Report to Congress...Response to Section 901 August 2017 Alternative Pathway is not uncommon to smaller acquisitions While DoDI 5000.02 and DoDD 5000.71 processes remain in place USD(R&E) will set policy for implementing the alternative pathways to speed the delivery of capability to the warfighter Additional DoD Initiatives: Project MAVIN -- Agile -- Autonomy Report to Congress,.. Response to Section 901 Alternate Pathways Initiated by operators defining a need or researchers identifying an opportunity Resources applied to procure limited numbers for: Testing, prototyping, user evaluations, operational assessments Deliberate decision point: Further invest to scale up, Divest, Continue modifying, or Harvest technology and move on Figure 6: Alternate Pathways each echelon of the Department must be structured to rapidly adapt and field capabilities that leverage the advances that are occurring at an ever increasing pace in the commercial and defense technology sectors (Report to Congress,.. Response to Section 901 August 2017) 32

Test Domain Contribution Test Domains Ground Test Resources Flight Test Resources Modeling & Simulation Low cost, high volume, high statistical significance Validation of engagement models Digital representation of threat offensive capabilities Replication of operational context HW in the Loop & Installed Sys Test Facility Intermediate step in systems engineering development Complexity of replicating phenomenology; RF and IR environment Representative HW and SW Replication of operational context RA programs may exploit test domains to a greater or lesser extent balancing risk to meet schedule Open Air Open Air Captive Carry Live Launch Moderate cost, moderate High cost, low volume of volume, moderate statistical test data, low statistical significance significance Focused on evaluating Complexity and cost of missile seeker commands, replicating complex prior to live fire test scenario and Complexity and cost of environments replicating complex Supports M&S validation scenario and environments Limited by flight safety, Supports M&S validation target operating limits Limited by flight safety, captive carry operating limits 33

30 th Space Wing Vandenberg AFB, CA NAWC-WD Point Mugu, CA Major Range and Test Facility Base (MRTFB): The Critical Core 23 Sites: Army-8; Navy-6; Air Force-7; Defense Agency-2 Updated 22 Jul 2015 Legend: Created by Congress Army, Navy, AF, Defense Agency 25,000+ Personnel ~$4B in Funding Annually Cold Regions Test Center Fort Greely, AK NAWC-WD China Lake, CA U.S. Army Kwajalein Atoll Reagan Test Site PMRF Kauai, HI NUWC Keyport (Nanoose & Dabob ranges) Keyport, WA 412th Test Wing Edwards AFB, CA Nevada Test and Training Range Nellis AFB, NV DISA,JITC Fort Huachuca, AZ Tropic Regions Test Center, various locations Utah Test and Training Range Hill AFB, UT West Desert Test Center Dugway Proving Ground, UT Yuma Test Center Yuma Proving Ground, AZ Electronic Proving Ground Fort Huachuca, AZ 96 th Test Wing (Includes 96 th Test Group), Eglin AFB, FL White Sands Test Center, White Sands Missile Range, MN DISA Ft. Meade, MD Army 5.5M Acres Land Navy 1M Acres Land, 165K sq mi Sea, 103K sq mi Air Air Force Western Ranges ALONE 5M Acres Land Aberdeen Test Center, Aberdeen Proving Ground, MD NAWC-AD Patuxent River NAS, MD Arnold Engineering Development Complex, Arnold AFB, TN 45 th Space Wing, Patrick AFB, FL Atlantic Undersea Test and Evaluation Center, Andros Island, Bahamas 34

Test & Evaluation / Science & Technology (T&E/S&T) Program Mission: Develop Technologies Required to Test Future Warfighting Capabilities Established in FY02 Joint DDR&E / DOT&E Initiative Transitioned to TRMC in FY05 RDT&E Budget Activity 3 funds Purpose High Risk / High Payoff R&D for Testing Foster technology transition to major DoD test ranges Risk reduction for test capabilities developments Annual Broad Agency Announcements (BAAs) Academia Industry Government Laboratories Tri-Service working groups Validate requirements Evaluate proposals Facilitate technology transition 58 Active Projects Central Oversight Distributed Execution High Speed Systems 15 Active Projects Eight Test Technology Areas Unmanned & Autonomous Systems 4 Active Projects Spectrum Efficiencies 8 Active Projects Advanced Instrumentation 9 Active Projects Directed Energy 4 Active Projects Cyberspace 3 Active Projects Electronic Warfare 10 Active Projects C4I & Software Intensive Systems 5 Active Projects Shaping Technology into Tomorrow s T&E Capabilities 35

Central Test & Evaluation Investment Program (CTEIP) Mission: Develop or Improve Major Test Capabilities that have multi-service Utility Established in FY91 by Congress with 6.4 RDT&E funds Long-Term multi-service Investments Near-Term Investments JIM-Core 3-5 year requirement horizon EMD of major multi-service test capabilities Development, not procurement Services & Agencies budget for O&M $110-140M/year, $600- $700M over 5 years Joint Improvement & Modernization (JIM) JIM-EW Special DoD area of emphasis EMD of electronic warfare (EW) test capabilities Assess aircraft performance against complex new threats. Service budget for O&M Total cost ~$465 over ~7 years JIM-Hypersonics Special DoD area of emphasis EMD of hypersonic ground test capabilities Focus on hypersonic cruise & boost glide missiles Service budget for O&M Total cost ~$350 over ~5 years Resource Enhancement Project (REP) 1-2 year horizon EMD of instrumentation to address near term OT shortfalls Coordinated with DOT&E $18-20M/year Threat Systems Project (TSP) 1-2 year horizon Address shortfalls in threat systems representation Coordinated with DOT&E $3-5M/year Biennial multi-service T&E Reliance Nomination Process Multiple DoD EW studies DoD Approved Roadmap Annual review of OT shortfalls Annual review of threat needs Requirements Drivers 31 JIM, 6 EW, 17 Hypersonics, 19 REP, 13 TSP = 86 Projects 36

JMETC SECRET Network (JSN) Functional JSN Locations: 46 (access to 77 labs/facilities) Planned JSN Locations: 4 Connection Points to Other Networks: 5 Edwards (2): Ridley 412 th EWG IFAST China Lake (4): F/A-18, IBAR, TSPIL, AV-8B Land Range, WSCI Point Mugu (4): ITEC, EW CyCon, AEA, Sea Range MAGTF EW Camp Pendleton: MCTSSA Corona: NSWC Port Hueneme: NSWC Point Loma : (2) SSC-PAC 59140 SSC-PAC CTB LMMT FTEC (Keyport Det.) W. Interconnect Rtr. Rancho Bernardo NGC Triton MHPCC Hawaii Pearl Harbor FIST2FAC (Keyport Det.) Army Air Force Navy Marines Joint Keyport NUWC Industry Dugway Proving Ground Raytheon Tucson Ft Huachuca (4): JITC, JTDL, CMIS, JTRS Leverages the SECRET Defense Research and Engineering Network (SDREN) for connectivity Operates at SECRET classification, available 24/7 Continuous monitoring, troubleshooting, and optimization of the end-to-end network infrastructure Capable of supporting numerous simultaneous test events WSMR IRCC Tinker AFB AWACS Ft. Sill, SMART Lab Greenville Rivet Joint Ft Hood (2): CTSF, TTEC As of 21 Aug 2017 WPAFB: SIMAF Crane (2): NSWC RDT&E, NTN Lab Redstone (12): SMDC RTC: DTCC, DISTL, AvSTIL AMRDEC SSDD AMRDEC SED: Patriot, THAAD, FAAD, GSIL, JLENS, MUSE, C-RAM Eglin AFB (4): AOC, DTF, GWEF, KHILS GTRI LMCO Global Vision Network Pittsfield GD LCS Hanscom AFB CEIF Rome NY AFRL Newport NUWC Melbourne NGC JSTARS Moorestown (2): CSEDS, CPTS Aberdeen: ATC-STE, ARL Arlington IDT Dahlgren: (3) IWSL, DOC, ICSTF Rapid-SIL/C2 Pax River: (11) E2C, E2D, MCL, ATR ACETEF, SAIL, MFS, P-8, E-2C SIL, UASIL, EP-3 Triton Lab JMETC SYSCON East Interconnect Rtr. JS J6 DDC4 C4AD Langley TDLITC Dam Neck CDSA Wallops Island SCSC Newport News NGC VASCIC Manassas LM ASW McLean MITRE NSEL Metro Park JMETC / TENA SDA Lab DISTRIBUTION A. Approved for public release: distribution unlimited. 37

National Cyber Range (NCR) Complex Computing Assets/Facility Encapsulation Architecture & Operational Procedures Integrated SW Testing Toolsuite Provides the ability to rapidly design, deploy and sanitize large scale, high fidelity test and training environments Extremely malicious threats can be unleashed on operationally, representative systems and networks to assess the impact on the network, networked weapon systems, the associated mission Significant technological advancements incorporated into integrated tool suite Highlighted by the significant level of automation Ability to support up to four concurrent events, executed in completely isolated testbeds, at different levels of classification Automated sanitization capability Expunges all malicious code from every component used within the event and returns it to a pristine state ready for reuse Sanitizes not only storage but also servers (including non-volatile RAM) and network equipment Time saving In many cases, what previously took weeks or months has been reduced to hours or days Allowing users the ability to rapidly plan, execute, and analyze their test or training initiatives NCR also provides SME Available, at the discretion of the user, to support the planning, execution and analysis of test and training events NCR is able to collaborate with other cyber ranges using secure networks When test events require special capabilities or additional scale 38