Oversight of DoD Test and Evaluation (T&E) Resources

Oversight of DoD Test and Evaluation (T&E) Resources

Topics Test Resource Management Center (TRMC) Major Range and Test Facility Base (MRTFB) Test Range Issues/Concerns Summary 2

Test Resource Management Center (TRMC) TRMC Organization TRMC Background TRMC Responsibilities Range Oversight Major Range and Test Facility Base (MRTFB) Strategic Plan Budget Certification Investment Programs» Technology Development: Test and Evaluation (T&E)/Science and Technology (S&T)» Test Capability Development: Central Test and Evaluation Investment Program (CTEIP)» Interoperability: Joint Mission Environment Test Capability (JMETC) Major Range and Test Facility Base (MRTFB) Test Range Issues/Concerns Summary Test Resource Management Center 3

TRMC Organization Office of the Secretary of Defense Section 231 of the 2003 National Defense Authorization Act (NDAA) established TRMC as a DoD Field Activity 4

TRMC Organization TRMC Organizational Structure 5

TRMC Background Need for Test Range Oversight Concern about managing the test infrastructure 1999 and 2000 studies Recognition that the right range infrastructure resources enable and support adequate T&E of weapon systems Need to assess duplicative test capabilities as essential or unnecessary costs These identified concerns and needs resulted in the 2002 legislation: Bob Stump NDAA for FY03 (PL107-314) Sec 231: Establish a Department of Defense (DoD) TRMC as a Field Activity under USD(AT&L) that will: Complete and maintain a Strategic Plan for T&E Resources Review and provide oversight of proposed DoD T&E budgets Certify Service and Defense Agency T&E proposed budgets Administer: CTEIP T&E/S&T Codified in Title 10 U.S. Code 196 6

The TRMC shall: TRMC Responsibilities Range Oversight: MRTFB Plan for and assess the adequacy of the MRTFB to provide adequate testing in support of development, acquisition, fielding, and sustainment of defense systems, per Title 10 U.S. Code 196. Maintain awareness of other T&E facilities and resources, within and outside the Department, and their impacts on DoD requirements. (DoDD 5105.71 DTRMC) The MRTFB is the designated core set of T&E capabilities and resources that is managed, operated, and sustained by the DoD Components to support DoD RDT&E and the DoD acquisition process. (DoDD 3200.11 MRTFB) TRMC responsibilities include: Implementing policy for the MRTFB, including composition, sizing, and usage; Reviewing and providing oversight of proposed DoD budgets and expenditures for the MRTFB; and Monitoring and evaluating the T&E facilities and resources, through periodic reviews and data collection activities, to ensure its adequacy to meet requirements and to prevent unnecessary duplication of capabilities. 7

TRMC Responsibilities Range Oversight: Strategic Plan At least once every 2 fiscal years (FYs), TRMC shall complete a strategic plan with respect to DoD T&E facilities and resources to include: An assessment of the current state of available T&E facilities and resources; A comprehensive review of DoD T&E requirements and the adequacy of the T&E facilities and resources to meet those requirements over a horizon of 10 FYs; and Discussion and rationale for proposed new T&E capability improvements. (DoDD 5105.71 DTRMC) 2012 Strategic Plan for DoD T&E Resources: Addresses FY14 FY23 Supports certification of T&E budgets Uses the Reliance Report Supporting FY14 24 Investments The Reliance Process supports the Service T&E Board of Directors (T&E BOD) cooperative engagement for informal management of T&E capabilities across DoD. Eleven working groups address T&E capability areas across the DoD T&E community to identify gaps and issues. The Director (TRMC) monitors and advises the process as well as the T&E BOD. 8

TRMC Responsibilities Range Oversight: Budget Certification Section 196(e), 10 U.S.C.: By January 31 of the year preceding the FY for which such budgets are proposed, the Director (TRMC) shall submit to the Secretary of Defense: Comments of the Director with respect to the T&E budgets of the Military Departments and Defense Agencies, together with certification of the Director as to whether such proposed budgets are adequate. Additional certification as to whether such proposed budgets provide balanced support for the Strategic Plan. By March 31, the Secretary of Defense shall submit to Congress a report on those proposed budgets which the Director has not certified to be adequate. DoDD 5105.71 DTRMC 9

TRMC Responsibilities Investment Programs: Overview Section 196 (c)(a)(e), 10 U. S. C.: Test and Evaluation/Science and Technology (T&E/S&T) Technology Development Central Test and Evaluation Investment Program (CTEIP) Test Capability Development In FY06, TRMC assumed management responsibility for implementing the infrastructure capabilities identified in the 2004 Testing in a Joint Environment Roadmap (DoDD 5105.71 DTRMC) Joint Mission Environment Test Capability (JMETC) Interoperability Activities to reduce shortfalls in T&E capabilities 10

TRMC Responsibilities Investment Programs: T&E/S&T Program Goal: To exploit new technologies and expedite their transition from the laboratory to the T&E community Program Philosophy Work closely with test capability developers (e.g., CTEIP projects, Service Range I&M projects) to mature and reduce risk in new test technologies Leverage heavily from ongoing efforts in industry, academia, and the DoD S&T community (DARPA, ONR, ARL, AFRL, etc.) Current T&E/S&T Test Technology Areas Cyberspace Test Directed Energy Test Electronic Warfare Test High Speed Systems Test T&E/S&T Program Technology Development Net-Centric Systems Test Unmanned & Autonomous Systems Test Advanced Instrumentation Systems Technology Spectrum Efficient Technology 11

Established in FY02 Joint DDR&E/DOT&E Initiative Transitioned to TRMC in FY05 RDT&E Budget Activity 3 funds Purpose High Risk/High Payoff R&D for Testing TRMC Responsibilities Investment Programs: T&E/S&T Mission: Develop Technologies Required to Test Future Warfighting Capabilities Foster technology transition to major DoD test ranges Risk reduction for test capabilities developments High Speed Systems 13 Active Projects Unmanned & Autonomous Systems 3 Active Projects FY 2012 80 Active Projects Current Test Technology Areas Annual Broad Agency Announcements (BAAs) Academia Industry Government Laboratories Tri-Service working groups Validate requirements Evaluate proposals Facilitate technology transition Central Oversight Distributed Execution Spectrum Efficiency 14 Active Projects Advanced Instrumentation 8 Active Projects Directed Energy 17 Active Projects Cyberspace 2 Active Projects Electronic Warfare 16 Active Projects Net-Centric Systems 7 Active Projects Shaping Technology into Tomorrow s T&E Capabilities 12

TRMC Responsibilities Investment Programs: T&E/S&T Net-Centric Systems Test Creating a composable, distributed Live-Virtual-Constructive test environment T&E of Service Oriented Architectures Information Assurance (IA) test instrumentation Test Environment Control and Situational Awareness EXAMPLES High Speed Systems Test Variable Mach test capabilities Clean air heaters Heat flux sensors Combustion gas analysis Advanced computational fluid dynamics Measurement of high pressure, temperature, and shear stress Technologies to determine effects of vitiates Directed Energy Test Measuring the effects of Directed Energy on the target Survivable on-board instrumentation Instrumentation on targets that is non-intrusive to performance and threat signature Instrumentation to determine performance margins Evidence of the degree of hard kill and soft kill Emulating far-field effects in near-field conditions Spectrum Efficient Technology Data Link Technologies: Improved spectrum efficiency of test capabilities Telemetry Networking Technologies: Advanced telemetry systems with optimized networked/2-wtextboxay data links capabilities Spectrum Management: Improved usage of RF spectrum for effective management of the complex telemetry environment at an open-air range 13

TRMC Responsibilities Investment Programs: CTEIP CTEIP Test Capability Development Develops high priority test capabilities that resolve Joint/multi-Service requirements shortfalls Promotes common test infrastructure and standard test methodologies Minimizes duplicative engineering development and life cycle support costs Partnership with Services and Agencies Service T&E Executives prioritize needs OSD centrally manages funding Service field activities lead development 14

TRMC Responsibilities Investment Programs: CTEIP Mission: Develop or Improve Major Test Capabilities that have Multi-Service Utility Initiated DEPSECDEF: 9 November 1988 Established in FY91 by Congress RDT&E Budget Activity 4 funds Purpose Have multi-service utility Be developmental Be non-procurement FY2012 43 Active Projects T&E Master Plan (TEMP) References MILSATCOM Atmospheric Scintillation Simulator AEHF survivability and effectiveness testing in realistic atmospheric environments Ground Mounted Seeker Simulation Advanced open-air SAM simulator to support IDECM Block IV effectiveness testing Prec Tgt Sig - Performance Mover (PTS-RPM) Radar reflective/mobile targets for Gray Eagle UAS testing Threat Systems Project (TSP) 1 2 year requirement horizon EMD of target capabilities Address shortfalls in threat systems representation Coordinated with DOT&E $3-5M/year Joint Improvement & Modernization (JIM) 3 5 year requirement horizon EMD of Major Test Capabilities Must address joint requirements Services & Agencies budget for O&M over Life-Cycle of delivered capabilities $110-120M/year Resource Enhancement Project (REP) 1 2 year requirement horizon EMD of instrumentation needed to address an emergent requirement Must address OT shortfalls Coordinated with DOT&E $18-20M/year 11 TSP, 19 JIM, 13 REP = 43 Projects 15

TRMC Responsibilities Investment Programs: CTEIP Next Generation Range Instrumentation System Net-Centric Warfare Testing Maximizes Interoperability at Major Service Open Air Ranges Increased TSPI Accuracy for advanced aerial Systems Under Test Enhanced Datalink for faster, more efficient, reliable testing Updated security for missions up to Top Secret EXAMPLES (JIM) Resolve battle space interoperability problems before networked systems are brought to war Stimulate and analyze an operationally relevant distributed test environment Construct, control, instrument, and capture joint C4ISR data Support interoperability certification Electronic Warfare Testing Provide high fidelity ground testing of new multi-axis jammer Provide high fidelity EW simulation (in a ground test facility) closer to flight test reality than current ISTF including: The capability to test increased detection and processing capabilities of U.S. EW systems Better models to address platform motion, direction finding, modulation, environment, and threats Growth potential in testing UAV Sense & Avoid Spectrum Efficient Technology Develop a range telemetry capability that: Provides more efficient/effective ways to use available spectrum Reduces test and re-test time by fixing data drop-outs Enables selective data acquisition during tests 16

Multi-Spectral Sea and Land Target Simulator TRMC Responsibilities Investment Programs: CTEIP Mobile (shoot on the move) open air IR/UV missile plume simulator Activates multi-spectral sources while in motion to provide for testing new IRCM systems on rotary wing and slow-moving aircraft Easily relocated to on- or off-range test locations Increased output radiation over legacy systems Supports JATAS IOT&E FY13 Precision Target Signatures-Reflective Performance Mover Improves legacy low cost, expended chloroplast targets by enhancing RCS realism and providing limited mobility Uses John Deere Gator COTS mover on frame design Leverages Army s 21 st Century Target Control System Supports Gray Eagle UAS FOT&E2, 3/4Q FY13 EXAMPLES (REP/TSP) Ground Mounted Seeker Simulator Provides an open air missile simulation for the I-32 and I-34 threat radars' associated threat missiles Collocated and compatible with the existing Missile-on-a-Mountain (MOM) threat missile simulations Built on proven RF compensation technology Supports Integrated Defensive Electronic Countermeasures (IDECM) OTIIIB (FOT&E) in 2/3Q FY13 Wideband Configurable Control Jammer (WCCJ) II Converts the WCCJ prototype into a versatile range ready jamming asset to enable safe and effective frequency-notched jamming operations on T&E ranges Provides notched threat waveforms allowing realistic threat jamming signals without affecting non-tested communications environment. Supports multiple Army Network Integration Exercises and many communication systems under test 17

TRMC Responsibilities Investment Programs: JMETC JMETC Interoperability Provide a persistent and robust infrastructure to integrate Live, Virtual, and Constructive systems for T&E in a Joint Systems-of-Systems (SoS) environment Persistent connectivity, integration software, tools, reuse repository, technical expertise Supports distributed testing across the Acquisition Life Cycle Address SoS interoperability issues early Generate adequate numbers of systems under test Create adequate supporting cast of systems Link the right threat types, fidelity, and density for live testing JMETC Users Group FY2012 70+ Distributed Event Activities Focus on tech requirements and solutions relevant to current and future distributed testing needs Identify infrastructure requirements, use cases, and opportunities to collaborate Identify, investigate, and resolve issues Discuss available solutions, tools, and techniques; share lessons learned For the Schedule and Location of next quarterly meeting: WWW.JMETC.ORG 18

TRMC Responsibilities Investment Programs: JMETC 19

TRMC Responsibilities Investment Programs: JMETC Air-to-Ground Integrated Layer Exploration (AGILE) EXAMPLES Battlefield Airborne Communications Node (BACN) Sponsored by the Simulation and Analysis Facility (SIMAF), USAF Air Systems Command Bi-annual LVC venue for programs to test integration and data exchange requirements for Joint Fires in realistic environment JMETC provides distributed infrastructure and technical support for all AGILE events Joint Urgent Operational Need (JUON) Integration of BACN payload onto multiple platforms JMETC supported Distributed testing included Live-fly DT and Operational Utility Evaluation; saved $1.2M Urgent capability fielded early Joint Interoperability Test Command (JITC) Interoperability Certification JITC conducts interoperability assessments, standards conformance, and certification testing for weapons and C2 systems in an operationally realistic Joint environment Typically 5 Joint Interoperability Tests (JIT) per year JMETC supports with infrastructure, technical support, and approved test tools Cyberspace T&E Infrastructure Development JMETC and Joint Information Operations Range (JIOR) will leverage each other s capabilities Common managed infrastructure, framework and tools Develop and promote standards Plans and conducts Cyberspace T&E pilot events for C2 and weapon systems, FY 11 13

Deputy Assistant Secretary of Defense for Developmental Test & Evaluation Director, Test Resource Management Center Web Site www.acq.osd.mil/dte-trmc/ 21

Major Range and Test Facility Base Test Resource Management Center (TRMC) Major Range and Test Facility Base (MRTFB) Definition and Guidance Composition Charge Policy Scheduling Policy Test vs. Training Ranges Test Range Issues/Concerns Summary 22

MRTFB Definition and Guidance The MRTFB is the designated core set of T&E capabilities and resources that is managed, operated, and sustained by the DoD Components to support DoD RDT&E and the DoD acquisition process. Policy as contained in DoDD 3200.11 and DoDI 3200.18 states that the MRTFB shall: Be sized, operated, and maintained as a national asset that exists primarily to provide T&E information to DoD-sponsored T&E users Provide a broad base of T&E capabilities sufficient to support the full spectrum of DoD T&E requirements, but shall not be unnecessarily duplicated Be managed and operated under uniform guidelines across the DoD Components IAW DODI 5000.02*: Test planning and conduct shall take full advantage of existing investment in DoD ranges, facilities, and other resources. *(Enclosure 6, para. 2.c.(3)) 23

MRTFB Composition 24

MRTFB Charge Policy Reimbursement 1 DoD Component Users Non-DoD Component Users 2 Other Direct Civilian Labor Actual Actual Actual Indirect Civilian Labor N/A Commander s discretion Actual Military Direct and N/A Actual 4 Actual Indirect Labor MRTFBs receive institutional funding (for overhead and indirect costs) from their parent Service/Defense Agency Institutional funding includes MRTFB sustainment, maintenance, operations, & infrastructure investments 1. Source: Financial Management Regulation 7000.14-R, Volume 11A, Chapter 12, "Major Range and Test Facilities" 2. Includes federal, state or local government agencies; allied foreign governments; defense contractors (not under contract with DoD); private organizations; and U.S. commercial enterprise customers 3. Allied foreign governments or commercial businesses 4. Volume 11A, Chapter 1 paragraph 0102 B 2 Policy and Procedures: Military labor shall be charged to non-dod organizations on the basis of the actual hours worked or assigned (detailed). Assignments (details) shall be charged using the annual military composite standard pay rates determined by the Military Departments. 25

MRTFB Scheduling Policy Scheduling of the MRTFB shall be based upon a priority system that gives equitable consideration to all DoD Components and accommodates DoD acquisition program priorities. Support to other MRTFB users shall be accommodated as schedule & resources permit. IAW DoDD 3200.11, Paragraph 4.5, allied foreign governments and contractors may use DoD T&E facilities on a space-available basis (contact the range to determine criteria that must be met) DoDD 4140.1-R designates priority of resources based on urgency and how essential to overall DoD mission MRTFB facilities should use Appendix 4, Essentiality Matrix, to determine priorities Air Force assigns precedence ratings per AFI 16-301 Range Commanders resolve conflicts (DoDD 3200.18, Enclosure 3) 26

MRTFB Test vs. Training Ranges Much less expensive to schedule test events at training ranges (in conjunction with training events) May not have level or fidelity of instrumentation found at a test range Generally cannot assist in developing test plans or providing analysis for test reporting, as is generally done at a test range Can provide more operationally relevant scenarios during exercises Can affordably increase density of activity to challenge system capabilities The main priority is training (e.g., units preparing for deployment) Test events & objectives may not get accomplished (must always manage risk) Conversely, operational activities routinely utilize MRTFB facilities with great success*: Provide full range of training capabilities Fidelity of feedback and threat representations Proximity often saves on transit costs Operational Users subject to MRTFB Range Commander s charging policy * TRMC MRTFB Training Study, 30 Mar 2011, FOUO 27

Test Range Issues/Concerns Test Resource Management Center (TRMC) Major Range and Test Facility Base (MRTFB) Test Range Issues/Concerns Encroachment New Weapons System Technologies T&E Infrastructure Service/Range Differences Test Range Capabilities and Services Range Safety Environmental Protection Test Site Management and Control Summary 28

Test Range Issues/Concerns Encroachment: Overview Encroachment refers to the incompatible uses of land, air, water, and other resources. It is the cumulative impact of urban development that hampers the military's ability to carry out its testing and training mission. Areas of Encroachment include: Threatened and Endangered Species/Critical Habitat Noise Restrictions Munitions Restrictions: Adjacent Land Use Frequency Spectrum Cultural Resources Maritime Sustainability Water Quality/Supply Airspace Wetlands Air Quality DoD Sustainable Ranges Initiative (DoDD 3200.15) Ensures the long-term viability and continuity of military training and testing ranges provides good stewardship for the land Works within government and partners with groups beyond installation boundaries 29

Test Range Issues/Concerns Encroachment: Frequency Spectrum Nation s Objective: Balance economic prosperity with national security Demand for access to 0.3 3 GHz band exceeds capacity of band Exponential increase in the use of wireless communications (e.g., smartphones) Repurposing/Sale of RF spectrum to commercial users Increasing impacts of adjacent-channel interference and in-band sharing DoD Spectrum Drivers Complex weapon sensors and networked systems transmit large amounts of data Data rates are growing exponentially Most instrumentation data (TSPI and telemetry) operate in 0.3 3 GHz band Three prong strategy to ensure adequate spectrum for T&E 1. Defend: Work with spectrum authorities to mitigate/avoid encroachment 2. Develop: Spectrum-efficient technologies for near term bandwidth requirements 3. Devise: Creative technical solutions to offset potential loss of spectrum Integrated Network Enhancement Telemetry (inet) breaks paradigm of all data all the time Alternate Spectrum: Technologies to utilize C-Band spectrum Sharing: Spectrum sensing and location technologies may allow sharing of bands Extremely high frequencies: Bands above 30 GHz have potential to expand bandwidth, but require substantial investment in R&D. DoD, with support of the Services, is involved in spectrum legislation at every level and is investing in technologies to ensure spectrum requirements are met. 30

Test Range Issues/Concerns New Weapons Systems Technologies Cyber T&E Limited capacity to test cyber threat impact on Programs/Missions Lack of DoD enterprise-level T&E infrastructure Shortfalls in almost all investment areas continue Autonomous/Intelligent Systems Adequate range instrumentation to effectively and safely control, monitor, and track UAAS through the airspace Develop effective procedures, techniques, and methodologies to test and evaluate autonomous systems technologies Conventional Prompt Global Strike Hypersonic velocities and intercontinental range capability drive the need for testing over the Broad Ocean Area and requires support from multiple ranges/agencies for a single mission Mobile, transportable, and space-based instrumentation is required to acquire sufficient data to assess performance Directed Energy (i.e., High Energy Lasers, High Power Microwaves) Significant safety issues (e.g., personnel, aircraft, satellites, electronic equipment, HAZMAT) 31

Test Range Issues/Concerns T&E Infrastructure Budget cuts continue to impact T&E infrastructure Instances of 1950s and 1960s-era instrumentation/facilities becoming unsupportable and unmaintainable Pressure on ranges and Services/Agencies to cut costs and reduce services or capabilities seen as redundant but, must look beyond individual Service parochialisms to broader T&E customer base Larger weapon system footprints Most land ranges lack sufficient space to safely test large footprint weapons NOTE: IAW DoDD 3200.11 and DoDI 3200.18, Services must coordinate any proposed changes to T&E capabilities/infrastructure (to include workforce, property, and facilities) with TRMC before making any changes. 32

Test Range Issues/Concerns Service/Range Differences Differences between various Services and ranges (This is a significant issue for Strategic Warfare, which uses multiple ranges from various Services concurrently) Range scheduling Range charges Must follow DoDD 7000.14-R, Financial Management Regulation (FMR) Range operations Range safety procedures Data standards 33

Test Range Issues/Concerns Test Range Capabilities and Services Test range capabilities and services include: Instrumentation and data collection equipment T&E infrastructure, facilities, and support equipment Environmental protection Range safety Targets and threat representations Meteorological/oceanographic support Support personnel Range scheduling and control Contact each range concerning operating procedures, range use agreements, available services and restrictions, scheduling information, etc. Anticipate Web-Based Directory of MRTFB capabilities available summer of 2013 34

Test Range Issues/Concerns Range Safety The Range Safety office typically has the following responsibilities: Develop/implement required safety programs, practices, procedures, criteria, and requirements. Provide trained experts for safety oversight and guidance. Manage the safety/mishap reporting program. Investigate, report, and identify corrective actions for safety deficiencies, high accident potentials, and mishaps. Obtain and use safety releases from program offices before exposing people, equipment, or the environment to hazards during T&E. 35

Test Range Issues/Concerns Environmental Protection DoD installations must comply with all applicable Federal, State, and local environmental laws and standards Base Environmental Office can assist/advise National Environmental Policy Act of 1969 (NEPA) Federal agencies must comply with NEPA before making final decisions about actions that could have environmental effects. The NEPA process considers environmental impact versus impact to national security and other important impacts. 36

Summary Test Resource Management Center (TRMC) Major Range and Test Facility Base (MRTFB) Test Range Issues/Concerns Summary 37

Test Range Issues/Concerns Test Site Management and Control The Range Commander typically designates the following (or their equivalent): Range Control Officer: Controls range operations and safety Range Operations Officer: Supervises support functions such as planning, maintenance, and range investments A Range Safety Officer, Flight Safety Officer, Laser Safety Officer, Directed Energy Weapon Safety Officer, Range Training Officer, Vehicle Control Officer, HAZMAT/Environmental Coordinator, Installation Civil Engineer, etc. may also be appointed. 38

Summary Test Resource Management Center (TRMC) Major Range and Test Facility Base (MRTFB) Test Range Issues / Concerns NOTE: For additional information, see the TRMC website http://www.acq.osd.mil/dte-trmc/ then select from the TRMC dropdown A or the Major Range and Test Facility Base icon B 39