34 th Annual International Test and Evaluation Symposium T&E in a Time of Risk and Change Test and Evaluation in Acquisition of Capabilities John Auborn, NAVAIR Paola Pringle, NAVAIR This Presentation Approved as Distribution Statement A - approved for public release; distribution is unlimited, as under NAVAIR Public Release Authorization 2016-775
BLUF So I ve checked all the boxes and tested that my system/platform/weapon/sensor is completely compliant with all requirements and specifications But can it work in a mission? To answer this question, we need to think beyond our SINGLE system or SUBSYSTEM 2 2
Evolution of Systems Capability: The ability to complete a task or execute a course of action under specified conditions and level of performance. Capabilities are functions of people operating Platforms, Weapons, Networks, and Sensors with the speed and accuracy needed to seize and retain the initiative over our adversaries. Distributed Common Ground Station-Air Force (DCGS_AF) Information Management Architecture http://www.acq.osd.mil/se/docs/se-guide-for-.pdf - SE of Guidebook 3 3
The Evolution of T&E Capabilities HARDWARE Installed System Assessment Today s Demands Family-of-Systems Systems-of-Systems Environment Immersion Battlespace Representation + SIMULATE Software-Based Emulations + + STIMULATE Red/Blue Hardware Integration COLLABORATE Distributed Labs/Sites Integration Hub and Spoke Early Identification and Resolution of Deficiencies Joint Complex Integrated - Collaborative Systems Distribution Statement A - approved for public release; distribution is unlimited, as under NAVAIR Public 4 4 Release Authorization 2016-775
Warfighter Needs Capability to Protect high value asset in a high threat environment Example of Operational View of : Naval Integrated Fire Control Counter Air http://www.acq.osd.mil/se/docs/se-guide-for-.pdf - SE of Guidebook...THE MODERN BATTLESPACE IS CHANGING, AND AT SUCH A PACE THAT WE HAVE CONCLUDED: THE STATUS QUO WILL NOT ENABLE VICTORY IN THE NEXT WAR. DON 30 Year R&D Plan 5
Modeling and Simulation in Acquisition SIMULATION AND STIMULATION FACILITIES RANGE TESTING DIGITAL MODELING HARDWARE IN THE LOOP INTEGRATION LABORATORY FLIGHT TEST INSTALLED SYSTEMS TEST FACILITY TRL 1 2 3 4 5 5 6 7 8 9 https://www.army.mil/article/191704/rtc_offers_new_tool_in_st ockpile_reliability_testing Distribution Statement A - approved for public release; distribution is unlimited, as under NAVAIR Public Release Authorization 2016-775 6 6
Outpacing the Threat Digital Thread Enables Rapid Delivery of Integrated Capabilities Enabling Capabilities-Based T&E System models form Constructive basis for LVC M&S environment Constructive Virtual Live Integrated Warfare Analysis establishes CONEMPS, Effects-Chains, req d attributes SYSTEM MODEL DIGITAL MODELING FLIGHT TEST MODEL CONEMPS and Effects Chains are modeled at the System of Systems () level Systems are developed in a Model-Based environment (SE Transformation) INSTALLED SYSTEMS TEST FACILITY LVC-based training required for Fleet integrated ops 7 7
Outpacing the Threat Digital Thread Enables Rapid Delivery of Integrated Capabilities Enabling Capabilities-Based T&E System models form Constructive basis for LVC M&S environment Constructive Virtual Live Integrated Warfare Analysis establishes CONEMPS, Effects-Chains, req d attributes SYSTEM MODEL DIGITAL MODELING FLIGHT TEST MODEL CONEMPS and Effects Chains are modeled at the System of Systems () level Systems are developed in a Model-Based environment (SE Transformation) INSTALLED SYSTEMS TEST FACILITY LVC-based training required for Fleet integrated ops 8 8
Test and Evaluation Throughout SE Process Initiate Conduct Analysis Continue Analysis Continue Analysis Develop Arch Evolve Arch Evolve Arch Plan Update Plan Update Implement Update Implement Update http://www.acq.osd.mil/se/docs/implementerviewse--final.pdf 9 9
Test and Evaluation Throughout SE Process New Construct: SYSCOMs take responsibility for providing the effective interaction of the decision support systems Execution: System of Systems () Systems Engineering (SE) framework addresses complexity and scope of planning process and SE of s Results: Continuous and rapid improvements to Fleet warfighting capabilities http://www.acq.osd.mil/se/docs/implementerviewse--final.pdf 10 1
Capabilities Based Test and Evaluation Focuses on continuous evaluation and improvement of a System/ in a Mission Context Supports Capabilities Based Analysis (CBA) Is iterative/recursive evaluation Provides increasing level of complexity realism a corresponding level of confidence BASED ON MISSION VALUE ASSESSMENT, CBTE PROVIDES PROGRAMS A VALIDATED BASIS TO PRECLUDE CHASING LAST 20% OF SPEC AT 80% OF THE COST NAVAIR Public Release SPR 2016-256; Distribution Statement A - Approved for public release; 11 distribution is unlimited. 11
CBTE Framework Verification and Validation of capabilities documented in digital architectures Traceability from Mission-based Analysis Issues to Test Designs ENGINEERING SIMULATION AND STIMULATION FACILITIES RANGE TESTING Re-balance as required DIGITAL MODELING HARDWARE IN THE LOOP INTEGRATION LABORATORY FLIGHT TEST INSTALLED SYSTEMS TEST FACILITY TRL 1 2 TRL 3 4 5 5 6 7 8 9 https://www.army.mil/article/191704/rtc_offers_new_tool_in_st ockpile_reliability_testing Distribution Statement A - approved for public release; distribution is unlimited, as under NAVAIR Public Release Authorization 2016-775 12 12
CBTE Progress Applying upfront and early M&S to quantify performance and optimize/reduce overall flight test Extensive LVC distributed test approach Maritime Patrol Reconnaissance Aircraft P-8A Naval Integrated Fire Control-Counter Air (NIFC-CA) From the Air (FTA) Harpoon Block II+ LRASM Kill Chain Test Bed F-35 using the Joint Simulation Environment in support of IOT&E Evolving for Triton s ISR Mission Requirements Developing Options for Fire Scout LCS Developing strategy for Next Generation Jammer NAVAIR >>> MOVING FORWARD TO BEAT THE THREAT 13
Hmmm, testing world domination Check! Thoughts 14
Hmmm, testing world domination Check! Thoughts Ms. Paola Pringle Integrated Warfare Test and Evaluation Division, 5.1L Cyberspace T&E Branch 51L300E P-8A Increment 3 Interoperability LTE (805) 816-3038 paola.pringle@navy.mil Mr. John Auborn Integrated Battlespace Simulation and Test, 5.4H Surface & Strike Mission Environments LVC Architect (760) 939-2274 john.auborn@navy.mil 15