International Test and Evaluation Association T&E: Keeping Pace with a Fast-Changing World Mr. Chris Paust CTEIP, Deputy Program Manager Test Resource Management Center 26 April 2012
A Changing World Over the last decade, the nature of Warfare has changed drastically Asymmetric warfare/non-conventional systems Unmanned and Autonomous Systems Networked Systems of Systems Cyber warfare escalation Test and Evaluation has been struggling to keep up Test Resource Management Center Created to ensure DoD T&E doesn t fall behind 2
DoD Test: A $10B Enterprise Typically 1-2% of total system acquisition cost 12,000,000 10,000,000 8,000,000 6,000,000 4,000,000 RDT&E (Non-MRTFB) DT&E OT&E Operations Capability Investments 2,000,000 0 Source: FY12 BES R-3 and September 2010 MRTFB
Test Resource Management Center Oversight of the Enterprise 4 Major Roles: DoD Field Activity Direct Report to USD(AT&L) SES Director Oversight of MRTFB Biennial 10-Year Strategic Planning Administer T&E Investment Programs CTEIP T&E/S&T JMETC Annual T&E Budget Certification Military Departments & Defense Agencies 5
Steward of the DoD Test Infrastructure Major Range and Test Facility Base (MRTFB) Cold Regions Test Center Keyport NAWC-WD China Lake 30 th Space Wing 30,000 personnel Military, Gov, Contractor Nevada Test and Training Range Utah Test and Training Range West Desert Test Center 18,000 sq. mi. of land 180,000 sq. mi. of air space ( > ½ of all DoD land) DISA,NCR Aberdeen Test Center NAWC-WD Point Mugu Air Force Flight Test Center Yuma Test Center Electronic Proving Ground High Energy Laser Systems Test Facility Arnold Engineering Development Center NAWC-AD Patuxent River Tropic Regions Test Center, HI & Puerto Rico PMRF Legend: 24 sites Army (9), Navy (6), AF (7), Defense Agency (2) DISA,JITC U.S Army Kwajalein Atoll Reagan Test Site White Sands Test Center Replacement Value = $25B 46 th Test Wing (Includes 46 th Test Group) 45 th Space Wing Atlantic Undersea Test and Evaluation Center 6
Department of Defense Test Investment Strategy Quadrennial Defense Review Strategic Planning Guidance Annual T&E Budget Certification* DoD T&E Strategic Plan* Service T&E Needs and Solutions Process TRMC Joint Investment Programs Transition Risk mitigation needs Technology shortfalls Requirements Risk mitigation solutions Capabilities Advanced development (6.3 Funding) (6.4 Funding) (6.5 Funding) Service Modernization and Improvement Programs Acquisition Programs and Advanced Concept Technology Demonstrations T&E Multi- Service/Agency Capabilities DoD Corporate Distributed Test Capability 7 7
T&E/Science &Technology Program Mission: Develop Technologies Required to Test Future Warfighting Capabilities Established in FY02 Joint DDR&E / DOT&E Initiative Transitioned to TRMC in FY05 6.3 RDT&E Funds Purpose High Risk / High Payoff R&D for Testing 80 Active Projects Foster technology transition to major DoD test ranges Risk reduction for test capabilities developments Annual Broad Agency Announcements (BAAs) Academia Industry Government Laboratories Tri-Service working groups Validate requirements Evaluate proposals Facilitate technology transition Central Oversight Distributed Execution High Speed Systems 13 Active Projects Eight Test Technology Areas Unmanned & Autonomous Systems 3 Active Projects Spectrum Efficiency 14 Active Projects Advanced Instrumentation 8 Active Projects Directed Energy 17 Active Projects Cyberspace 2 Active Projects Electronic Warfare 16 Active Projects Net-Centric Systems 7 Active Projects Shaping Technology into Tomorrow s T&E Capabilities
Central T&E Investment Program Mission: Develop or Improve Major Test Capabilities that have Multi-Service Utility Initiated DEPSECDEF 9 November 1988 Established in FY91 by Congress 6.4 RDT&E funds Purpose Have multi-service utility Be developmental Be non-procurement 47 Active Projects T&E Master Plans (TEMP) References Submarine Launched Countermeasure Emulator CBASS torpedo effectiveness testing against enemy countermeasure threats MILSATCOM Atmospheric Scintillation Simulator AEHF survivability and effectiveness testing in realistic atmospheric environments Ground Mounted Seeker Simulation Advanced open-air SAM simulator to support IDECM Block IV effectiveness testing Threat Systems Project (TSP) 1-2 year requirement horizon EMD of target capabilities Address shortfalls in threat systems representation Coordinated with DOT&E Joint Improvement & Modernization (JIM) 3-5 year requirement horizon EMD of Major Test Capabilities Must address joint requirements Services & Agencies budget for O&M over Life-Cycle of delivered capabilities 3 Project Portfolios Resource Enhancement Project (REP) 1-2 year requirement horizon EMD of instrumentation needed to address an emergent requirements Must address OT shortfalls Coordinated with DOT&E 9
Joint Mission Environment Test Capability Program Site in Alaska Ft. Greely: CRTC Edwards (2): Ridley 412 th EWG IFAST China Lake (3): F/A-18, IBAR, TSPIL Point Mugu (2): ITEC, EA-6B Camp Pendleton: MCTSSA Corona: NSWC Palmdale, NGC BAMS Point Loma : SSC-PAC 59140 SSC-PAC HAIPE West Agg Rtr. Rancho Bernardo, NGC BAMS Sites in Hawaii PMRF: Bldg 105 MHPCC Ft Huachuca: (4) JITC, JTDL, CMIS, JTRS 80 Encrypted 60 for Secret System High 40 DISA-registered IP address space 20 0 Active FY06 monitoring FY07 FY08of network FY09 FY10 performance FY11 Ft Hood (2): CTSF, TTEC JMETC Site Expansion Dedicated, trusted connectivity on SDREN (part of the GIG) Sites As of 05 Apr 2012 Capable of supporting multiple simultaneous test events Functional Sites: 67 New Sites Planned: 10 Connection Points to Other Networks: 7 WPAFB: SIMAF Crane: NWSC RDT&E Redstone (10): SMDC RTC: DTCC, GMAN SED: Patriot, THAAD, FAAD, GSIL, JLENS, MUSE, SIV (2) SED-PSEM, AMRDEC GTRI Hurlburt Field: C2DAC Eglin AFB (5): AOC, DTF, GWEF, KHILS, JDAT Charleston (2): IPC, MEF-MEU Bethpage: NGC BAMS Bethpage: NGC BCN Moorestown: CSEDS Aberdeen: ACCN Pax River: (8)ESTEL E2C/D, MCL, ACETEF, SAIL, ATR, E-2C SIL, UASIL, MFS JMETC SYSCON East Agg Rtr. Dahlgren (2): CEDL,IWSL JS J8 DDC4: C4AD Langley (2): C-GIIF, TDLITC Norfolk: COMOPTEVFOR Dam Neck: CDSA Wallops Island: (2) SCSC, SSDS Newport News: NGC VASCIC McLean: MITRE NCEL LMCO Global Vision Network, Arlington, VA Army Air Force Navy Marines Joint Industry Academia
Technology Push vs. Acquisition Pull The T&E community is in constant battle Technology is moving at lightning speed. Formal Acquisition does not. Innovations and asymmetrical threats drive us to be reactive to urgent needs. Warfighters need us to be proactive 11
Investors in Tomorrow s Technology 30 2011 Research Investments ($B) 25 20 15 10 5 Rest of Top 10 Google $3B IBM $6B Microsoft $9B Rest of Top 10 Motorola $3B Cisco $5B Intel $6B 0 Total DoD S&T Industry-IT R&D Industry-Electronics R&D 12
Trends in Software Complexity 13
Trends in Devices & Adoption 14
Trends in Devices & Adoption 15
Trends in Power, Size & Cost Your cell phone in 2012 is 1,000 x more powerful 100,000 x smaller 1,000,000 x cheaper than 1 MIT computer in 1965 16
Why is this relevant to us? 17
A Very Complex Test Environment Bidirectional Secure Range Network Bidirectional Secure Range Network SPECTRUM, LAND, SEA AND AIR RESOURCES OTHER RANGES Unmanned System Networks Mobile Adaptive Mesh Networks CEC TAC NET C2 CONTROL NET Joint Task Force C4I Providers Range Control Facility
Ensuring Technology Transition These technologies are being integrated into weapon systems Ours and theirs! These same technologies need to be matured and integrated into our test capabilities Critical to ensure S&T technologies have solid transition partners CTEIP and Service T&E Investments 19
T&E Investments for the Future Spectrum Efficiencies Advanced aeronautical telemetry at Open Air Test Ranges Cyberspace & Network Centric Systems Technologies and capabilities to emulate, visualize, and assess our abilities to defend cyberspace Testing in Urban Environments A robust, realistic environment to test electromagnetic effects, mission effectiveness, and interoperability of systems under test Safe Test of Large Footprint Weapons Reconfigurable, modular, low power design suitable for high dynamic environments Accurate TSPI (Time Space Positioning Information) Precision tracking capability for high-dynamic aircraft Infrared Countermeasure Testing Capability to present IRCM system-under-test with a realistic representation of an incoming missile 20
S&T Investments for the Future T&E/S&T Technology Areas Directed Energy Test Net Centric Systems Test Non-Intrusive Instrumentation Spectral Efficient Technology Cyber Space Test Technologies Electronic Warfare Test Unmanned Autonomous Systems Test Advanced Instrumentation Systems Test Key Investments & Successes Broadband Telemetry Antenna (L/S/C Bands) Linear Power Amplifier (50% efficiency increase) Adaptive Orthogonal Frequency Division Multiplexing (AOFDM) Low Cost OFDM Telemetry Transceiver Network management tools Spectrum hopping radio to access unused portions of spectrum 21
Spectrum Efficient Testing Bit Rate (Kbps) 100,000 10,000 1,000 100 Historic F-18 F-14 B-52 F-16 Test Capability Driver Spectrum and Data Rates Trends SM I B-1 A-10 SRAM II F-15E B-2 YF-22 YF-23 F-22 1v2 AIM-9X OBRA 93 Future Threats BBA 97 DAB, PCS, 10 200 1970 1975 1980 1985 1990 1995 2000 2005 2010 Challenge Develop a Range Telemetry capability that: Provides more efficient/effective ways to use available spectrum. Reduces test and re-test time by fixing data drop-outs. Enables selective data acquisition during tests. F-22 F-18 E/F NASA CEV F-35 2v4 ESSM SM 6 JDAM E-2D VH-71 300 275 250 225 Spectrum (MHz) Program Example Integrated Network Enhanced Telemetry (inet) Block 1 Project Enhances current 1-way Serial Streaming Telemetry (SST) systems with a 2-way network capability. Leverages Service and TRMC initiatives to develop C-band telemetry Leverages T&E/S&T projects addressing: 1) dynamic frequency assignments, 2) multi-path mitigation, and 3) forward error correction. Goal Test inet Block 1 capability at Edwards Air Force Base and Patuxent River Naval Air Station by FY13. Program Status Completed Preliminary Design Review. Completed prototype hardware performance testing at the Southwest Research Institute (SwRI) System Integration Laboratory.
Net-Centric Warfare Testing Net Enabled Weapons Testing Drivers Joint service test & training exercises are increasing in frequency and complexity Testing of Net Enabled Weapons Interoperability testing of systems of systems. Distributed Live, Virtual and Constructive Testing Challenge Resolve battle space interoperability problems before networked systems are brought to war Program Example Interoperability Test and Evaluation Capability (InterTEC) Construct, control, instrument, capture joint C4ISR data Stimulate and analyze an operationally relevant distributed test environment Perform post-event analysis Support interoperability certification Development Status-Successes Spiral 2 Development Complete JITC accredited for Joint Interoperability Certification test use Spiral 3 (Release 1) System Acceptance Testing Completed in November 2010 CND Scenario that linked IO Range and JMETC networks for the first time JITC interim accreditation for NR-KPP Certification test use Full (Spiral 3) Operational Capability in 2013
Urban Environment Testing Drivers Program Example Joint Urban Test Capability (JUTC) Project FY2010 New Start Addresses Critical Capability Gap in DoD Strategic Plan for T&E Resources Leverage results of Urban Environment Test Capability Study Leverage S&T investments in advanced instrumentation Challenge Develop test capabilities that measure both the effects of Urban Environment (UE) on systems under test (SUT) and SUT interactions in UE Technical performance Operational effectiveness Suitability and survivability Goal Develop robust, realistic, technically relevant, urban test environment: Accurate physical, electromagnetic and population effects Test-Quality Instrumentation and Data Collection Development Status Completed Test Capability Requirements Document (TCRD) Expected to enter EMD in FY12
Safe Testing of Large Footprint Weapons Drivers Program Example Subminiature Flight Safety System (SFSS) Leverages completed CTEIP projects: Joint Advanced Missile Instrumentation (JAMI) provides GPS-based TSPI and real time post flight data processing. Enhanced Flight Termination System (EFTS) provides new digital and encrypted flight termination link. Challenge Longer range (large footprint) of new missiles necessitates the use of flight termination systems for flight safety. Limited unused space inside modern missiles requires flight termination systems to be subminiature in size (11 to 16 inch 3 ). Goals More realistic operational test of long range weapons- eliminate range safety constraints. Reconfigurable, modular, low power design suitable for high dynamic environments. Development Status-Successes Completed PDR IOC expected in FY14
Accurate Time Space Position Information (TSPI) Drivers Program Example Common Range Integrated Instrumentation System (CRIIS) - First real-time, high-precision (sub-meter) TSPI range system. Challenge Goal Replace ARDS starting in 2014: Fielded for 25 years on 10 MRTFB ranges, training venues, foreign military end-users Variants: P5 Combat Training System, others GPS ARDS CRIIS Development Status- Successes Successful prototype flight demonstrations Completed PDR, on-track to CDR Provide precise Ground Truth TSPI for high accuracy future Systems Under Test (SUT)
Infra-Red Countermeasure (IRCM) Test Capability Portfolio Drivers Advanced IR Missiles Advanced IRCM Systems Not feasible to fire missiles at manned aircraft to test IRCM system effectiveness Challenge Present IRCM system-under-test with a realistic representation of an incoming missile Ground Based (JMITS) Missile Simulators Airborne (TAPS) Program Examples Ground Based Missile Simulators JMITS - Joint Mobile IRCM Test System MSALTS- Multi-Spectral Sea and Land Target Simulator Airborne Threat Missile Simulator TAPS - Towed Airborne Plume Simulator Installed System Environments JDIGS - Joint Distributed IRCM Ground Test System Missile Signal Processors in the Loop Development Status -Successes TAPS Flight Testing Completed IOC in 2010, accredited for use in LAIRCM NexGen Operational Testing Completed MSALTS CDR IOC in 2013 Completed JDIGS Risk Reduction Demonstrations Verified acceptable end-to-end (distributed test) data throughput and latency IOC in 2013 IRCM Test Resource Requirements Study Update Addressing urgent HFI testing needs
Closing Thoughts Technology is moving at a blinding pace. Most of it will come from industry and will be rapidly acquired, adapted, and fielded to meet operational needs. It will certainly push our test resources beyond their current limits To ensure the Department s T&E infrastructure keeps pace We must grow existing capabilities We must invest in new technologies And ensure we have well-defined/supported transition partners We can t do it alone! We must partner with Academia, Industry, and other stakeholders to meet these challenges 28