Test and Evaluation in Acquisition of Capabilities

Transcription

1 34 th Annual International Test and Evaluation Symposium T&E in a Time of Risk and Change Test and Evaluation in Acquisition of Capabilities John Auborn, NAVAIR Paola Pringle, NAVAIR This Presentation Approved as Distribution Statement A - approved for public release; distribution is unlimited, as under NAVAIR Public Release Authorization

2 BLUF So I ve checked all the boxes and tested that my system/platform/weapon/sensor is completely compliant with all requirements and specifications But can it work in a mission? To answer this question, we need to think beyond our SINGLE system or SUBSYSTEM 2 2

3 Evolution of Systems Capability: The ability to complete a task or execute a course of action under specified conditions and level of performance. Capabilities are functions of people operating Platforms, Weapons, Networks, and Sensors with the speed and accuracy needed to seize and retain the initiative over our adversaries. Distributed Common Ground Station-Air Force (DCGS_AF) Information Management Architecture - SE of Guidebook 3 3

4 The Evolution of T&E Capabilities HARDWARE Installed System Assessment Today s Demands Family-of-Systems Systems-of-Systems Environment Immersion Battlespace Representation + SIMULATE Software-Based Emulations + + STIMULATE Red/Blue Hardware Integration COLLABORATE Distributed Labs/Sites Integration Hub and Spoke Early Identification and Resolution of Deficiencies Joint Complex Integrated - Collaborative Systems Distribution Statement A - approved for public release; distribution is unlimited, as under NAVAIR Public 4 4 Release Authorization

5 Warfighter Needs Capability to Protect high value asset in a high threat environment Example of Operational View of : Naval Integrated Fire Control Counter Air - SE of Guidebook...THE MODERN BATTLESPACE IS CHANGING, AND AT SUCH A PACE THAT WE HAVE CONCLUDED: THE STATUS QUO WILL NOT ENABLE VICTORY IN THE NEXT WAR. DON 30 Year R&D Plan 5

6 Modeling and Simulation in Acquisition SIMULATION AND STIMULATION FACILITIES RANGE TESTING DIGITAL MODELING HARDWARE IN THE LOOP INTEGRATION LABORATORY FLIGHT TEST INSTALLED SYSTEMS TEST FACILITY TRL ockpile_reliability_testing Distribution Statement A - approved for public release; distribution is unlimited, as under NAVAIR Public Release Authorization

7 Outpacing the Threat Digital Thread Enables Rapid Delivery of Integrated Capabilities Enabling Capabilities-Based T&E System models form Constructive basis for LVC M&S environment Constructive Virtual Live Integrated Warfare Analysis establishes CONEMPS, Effects-Chains, req d attributes SYSTEM MODEL DIGITAL MODELING FLIGHT TEST MODEL CONEMPS and Effects Chains are modeled at the System of Systems () level Systems are developed in a Model-Based environment (SE Transformation) INSTALLED SYSTEMS TEST FACILITY LVC-based training required for Fleet integrated ops 7 7

8 Outpacing the Threat Digital Thread Enables Rapid Delivery of Integrated Capabilities Enabling Capabilities-Based T&E System models form Constructive basis for LVC M&S environment Constructive Virtual Live Integrated Warfare Analysis establishes CONEMPS, Effects-Chains, req d attributes SYSTEM MODEL DIGITAL MODELING FLIGHT TEST MODEL CONEMPS and Effects Chains are modeled at the System of Systems () level Systems are developed in a Model-Based environment (SE Transformation) INSTALLED SYSTEMS TEST FACILITY LVC-based training required for Fleet integrated ops 8 8

9 Test and Evaluation Throughout SE Process Initiate Conduct Analysis Continue Analysis Continue Analysis Develop Arch Evolve Arch Evolve Arch Plan Update Plan Update Implement Update Implement Update 9 9

10 Test and Evaluation Throughout SE Process New Construct: SYSCOMs take responsibility for providing the effective interaction of the decision support systems Execution: System of Systems () Systems Engineering (SE) framework addresses complexity and scope of planning process and SE of s Results: Continuous and rapid improvements to Fleet warfighting capabilities

11 Capabilities Based Test and Evaluation Focuses on continuous evaluation and improvement of a System/ in a Mission Context Supports Capabilities Based Analysis (CBA) Is iterative/recursive evaluation Provides increasing level of complexity realism a corresponding level of confidence BASED ON MISSION VALUE ASSESSMENT, CBTE PROVIDES PROGRAMS A VALIDATED BASIS TO PRECLUDE CHASING LAST 20% OF SPEC AT 80% OF THE COST NAVAIR Public Release SPR ; Distribution Statement A - Approved for public release; 11 distribution is unlimited. 11

12 CBTE Framework Verification and Validation of capabilities documented in digital architectures Traceability from Mission-based Analysis Issues to Test Designs ENGINEERING SIMULATION AND STIMULATION FACILITIES RANGE TESTING Re-balance as required DIGITAL MODELING HARDWARE IN THE LOOP INTEGRATION LABORATORY FLIGHT TEST INSTALLED SYSTEMS TEST FACILITY TRL 1 2 TRL ockpile_reliability_testing Distribution Statement A - approved for public release; distribution is unlimited, as under NAVAIR Public Release Authorization

13 CBTE Progress Applying upfront and early M&S to quantify performance and optimize/reduce overall flight test Extensive LVC distributed test approach Maritime Patrol Reconnaissance Aircraft P-8A Naval Integrated Fire Control-Counter Air (NIFC-CA) From the Air (FTA) Harpoon Block II+ LRASM Kill Chain Test Bed F-35 using the Joint Simulation Environment in support of IOT&E Evolving for Triton s ISR Mission Requirements Developing Options for Fire Scout LCS Developing strategy for Next Generation Jammer NAVAIR >>> MOVING FORWARD TO BEAT THE THREAT 13

14 Hmmm, testing world domination Check! Thoughts 14

15 Hmmm, testing world domination Check! Thoughts Ms. Paola Pringle Integrated Warfare Test and Evaluation Division, 5.1L Cyberspace T&E Branch 51L300E P-8A Increment 3 Interoperability LTE (805) paola.pringle@navy.mil Mr. John Auborn Integrated Battlespace Simulation and Test, 5.4H Surface & Strike Mission Environments LVC Architect (760) john.auborn@navy.mil 15