Non-Technical Obstacles to Effective M&S Connectivity in Support of T&E

Transcription

1 Non-Technical Obstacles to Effective M&S Connectivity in Support of T&E Panel Chair: Mr. John Illgen Northrop Grumman Simulation Technologies

2 Introduction Greetings Introduction of Panel Members John Illgen, Northrop Grumman Dr. Paul Deitz, ARL Mr. Rick Cozby, DTC Mr. Jack Sheehan, FCSCTO Mr. Augie Ponturiero, Northrop Grumman

3 A Changing Landscape Capabilities-Based Acquisition Warfighter-focused New thought processes on WHY, WHAT, and HOW to develop new Systems/Families of Systems/Systems of Systems New Systems/Families of Systems Born Joint Services working together at all levels to bring capabilities to the Warfighters Funding Constraints New Developments vs Current Operations Support Using more Virtual and Constructive entities for testing M&S more significant in Test and Evaluation

4 The Effect Increased cooperation between Services and DoD Agencies at all levels Multi-Service and Joint Testing OSD-driven Testing in a Joint Environment Roadmap What is the impact to Service Acquisition efforts? PM, T&E, Warfighters must work together across Service boundaries to field new systems T&E communities need to understand one another first! T&E Communities forging closer working relationships Different priorities Cultural and Language differences

5 Today s Discussion Look at the Non-Technical issues affecting T&E T&E Communities forging closer working relationships Different priorities Cultural and Language differences Multi-Service and Joint Testing OSD-driven Testing in a Joint Environment Roadmap What is the impact to Service Acquisition efforts? PMs, T&E, Warfighters must work together across Service boundaries to field new systems First Step: T&E Communities must work together and speak the same language

6 Non-Technical Factors Affecting T&E Interoperability Mr. Augustine J. Ponturiero Northrop Grumman Simulation Technologies

7 The Problem: How to clarify Lifecycle issues in a T&E context? COOPERATIVE ENGAGEMENT CV BATTLE GROUP RETURNING CV STRIKE AIRCRAFT E2-C SURVEILLANCE USN COMBAT AIR PATROL JOINT US/ALLIED BATTLE GROUP F E S E L F N S E 11 Fundamental Elements: Seven Levels, Four Operators 6. Context, Environment (Military, Civil, Physical, etc.) 7. OWNFOR Why = Purpose, Mission 7. OPFOR Why = Purpose, Mission 5. Index: Location 7. Mission & Time 7. Mission 4. Tasks, Operations 4. Tasks, Operations O 4,1 O 4,1 O 3,4 O 3,4 3. Functions, 1. Interactions, 3. Functions, BLUFOR OPFOR Performance Effects Performance O 1,2 O 1,2 O2,3 2. Components, 2. Components, O 2,3 Forces Forces AWACS COMMERCIAL AIR LANES AMPHIBIOUS GROUP ENEMY SUB ASCM ATTACK T H E A T ER D E F E N S E Planning Employment CV-LAUNCHED STRIKE HAWK JTIDS ENEMY GROUND LAUNCHED MISSILES ENEMY HELO 17 MERCHANT SHIPS ENEMY JAMMING ENEMY AIR ATTACK PATRIOT TBM ATTACKS Elements N N FoS, SoS Mission Tactical Use Case Example for IP03: Conduct Network Fires UA CIC PROGRAMS UA MCG2 UA MCG1 Analysis Of Alternatives 1,2, 4 3, 5 3, 5 1, 2, 4 UA MSC Fiscal Realities 1, 4 2, 4 1, 5 2, 4 NCIE Tasks UE/JTF CIC 1 UA FEC UA ISRC Technical / Stimulation / Control Test Functional NCIE Measurements Capability Test of Network Technical / Stimulation / Control Test Functional Capability Measurements Test of Nodal Elements N N Test Technical / Capability Functional NCIE Test of Interoperability User N N CJCSI 3170 (JCIDS User ± ) IP/S1 Test IP/S2 Strategy & Operational Joint Operations NSS Capability IP/S3 Guidance Overarching Concepts Test Concepts NCIE IP/S4 User JSBE PRIORITIES FCS UAMBL Joint Operating Concepts Science & Technology IP-1: BATTLE COMMAND BIC CO Legend: 1 OPORD/FRAGOS 2 RECOMMENDED AG 3 APPROVED AG 4 STAFF ESTIMATE 5 CDR S GUIDANCE JCIDS Recommendation Capability Needs DOTMLPF Changes Planning, Programming, and Budgeting System Integrated Architecture OPLANs Defense and Planning CONPLANs Scenarios Overlay what we have with what we need to do Task COCOM IPLs Assessment Analysis GAP Analysis and Risk Assessment Analysis Functional Area Analysis (FAA) Functional Solutions Analysis (FSA) Reconciliation and Recommendation Decision and Action Chairman of the Joint Chiefs of Staff Instruction , DEP 3, 5 NETWORKS M&S Capability Assessments TECOE Elements MOPs/MOEs Evaluation Strategy Element Level (ORD, Spec) TT OT Data Joint M&S Functional Concepts Virtual Components/ SOSIL/SIL Sub-systems/ Validation Systems Test Execution Strategy Acquisition Experimentation ± Joint Capabilities Integration and Development System 4 TRADOC Element Level Cap/Lim E, s, s, + Unks Evaluation Matrix and Decomposition of COI C MOE DATA SOURCES Evaluator Equations UA JROC 1 XXXX 1.1 s s s s s p p p 1.2 s s s s s p p P 1.3 s s s s s p p s s S 1.4 s s s s s p p s s s 1.5 s s s s s p p p 1.6 s s s s s p p P 2 XXXX 2.1 s s s s s p p s s S 2.2 s s s s s p p s s s 2.3 s s s s s p p p 2.4 s s s s s p p p 3 XXXX 3.1 Interim s srange s OF MILITARY s s p p OPERATIONS P (JROCM ) 3.2 s s s s s p p s s S Involving Use/ Not Involving Use/ 3.3 WAR s s s s MOOTW s p p s s s Threat of Force MOOTW Threat of Force 3.4 s s s s s p p p NUCLEAR 3.5 WARFARE s s s s s p p P CONVENTIONAL 3.6 s s swarfare s s p p s s S 3.7 s s s s s p p s s s FORCIBLE ENTRY; STRIKES; RAIDS 3.8 s s s s s p p p 4 XXXX 4.1 s s s UNCONVENTIONAL s s s p WARFARE p p p 4.2 s s s s s s INFORMATION p poperations p p 4.3 s NONCOMBATANT s s s s EVACUATION s p OPERATIONS; p p precovery OPERATIONS 4.4 s s s s s LINE sof COMMUNICATIONS p p p PROTECTION p COMBATTING TERRORISM HOMELAND SECURITY HOMELAND DEFENSE: NATIONAL LAND DEFENSE; NATIONAL MARITIME DEFENSE; NATIONAL AIR AND SPACE DEFENSE; CRITICAL INFRASTRUCTURE PROTECTION CIVIL SUPPORT: CONSEQUENCE MANAGEMENT; MILITARY SUPPORT TO CIVIL AUTHORITY; MILITARY ASSISTANCE FOR CIVIL DISTURBANCES; DOD SUPPORT TO COUNTER DRUG OPS FOREIGN CONSEQUENCE MANAGEMENT; FOREIGN HUMANITARIAN ASSISTANCE COUNTERPROLIFERATION SANCTION ENFORCEMENT SUPPORT TO COUNTERINSURGENCY; SUPPORT TO INSURGENCY FREEDOM OF NAVIGATION OPERATIONS PEACE ENFORCEMENT SHOW OF FORCE PEACEKEEPING OPERATIONS SECURITY COOPERATION ACTIVITIES NATION ASSISTANCE: SECURITY ASSISTANCE; FOREIGN INTERNAL DEFENSE; Operational HUMAN & CIV ASSIST ARMS CONTROL; MILITARY CONTACTS MULTI-NATIONAL EX, TR, ED NORMAL AND ROUTINE MILITARY ACTIVITIES Sensitivity Analyses Sensitivity By Analyses Thread By Thread Mission, S, S, + Unks Unit Of Action Cap/Lim S, S, +Unks Use Cases FCS MISSION MOPs/MOEs FoS/SoS Level Mission Threads (ORD, Spec, (O&O) Decomposition KPP, COIC) Red Blue FCS FoS/SoS Cap/Lim E, s, s, + Unks Core Compl Joint/Compl Systems Systems M&S M&S SoS, S, S, + Unks Family System of Of Systems Systems Cap/Lim S, S, +Unks Updated as Systems Mature Cap/Lim By Mission + Unks Capabilities Capabilities & Limitations Limitations By By Mission Mission + + Unks Unks Validation Platform Testing Distributed Testing Operational Testing Functional Needs Analysis (FNA) RDECOM JTEM SoS Eng Strategy GIG S H IP D E A R E A D E F E N S E Functional Areas The Missions & Means Framework SME Engineering Process 3CE OV s Tactical Realities SV s M&S Instrumentation Warfighter Testing Requirements Physical Infrastructure DoD Future Upgrades 8 MMF Joint Interoperability PPBS ATEC Object Models Legacy Systems Development Plans C3T AFICE Asymmetric Threats

8 Challenges Systems of Systems (SOS)/Families of Systems (FOS) Network Enabled Systems Network Centric Enterprise Services Global Information Grid Joint Command and Control (JC2) Multi-National Information Sharing Missions and Scenarios Paradigm Shift Transform from forces-based, materiel-centric Cold War to capabilities-based, mission centric asymmetric-warfare posture Joint Focus What is the force multiplier? How do we define it?

9 Non-Technical Factors T&E Community Issues Ad Hoc Processes Rely on individuals, not processes, to successfully complete events Common Tools Few Not used effectively Gap in tools available for collaboration and communication Not familiar with other Services No effective Network Engineering Process Insufficient process maturity to be repeatable Must make a Cultural Change within the T&E Community

10 A Cultural Change Joint vice Service focused testing Shared Models and Simulations Users won t use the model correctly and it will reflect badly on me/us Improved understanding of Joint Test environment including Network and Security strengths and limitations Navy = Air Force = Army = Marines Improved community-wide methods and processes JTEM is taking the first steps Sustainable, Repeatable, Consistent, Understandable results Operations and Acquisitions context

11 The Benefit: Better Info to Decision-Makers, Faster Operational and Acquisition Leadership Better analysis of alternatives for acquisition decisions Clearer understanding of test results across T&E and Operations Spectrum Shared data and information faster analysis and recommendations Virtual Environment for testing Capability-based assessment of system Examination of proposed systems from a Doctrine/Operations/Training perspective early in development. Common language, data, and processes between Acquisition, T&E, and Ops Communities Common understanding between Acquisition, Ops, and T&E Communities

12 Capabilities-Based Development The Missions and Means Framework The LINK between the Military Decision Making Process and the domain of DOTMLPF solutions A WARFIGHTER-FOCUSED STRUCTURE for rigorous, complete, and detailed analysis in crucial evaluation programs An ORGANIZING PRINCIPLE for requirements, test planning, and evaluation Guidance OPLANs and CONPLANs Assessment and Analysis Reconciliation and Recommendation NSS Joint Operating Concepts strategic national strategic theater operational tactical Strategy & Overarching Concepts Defense Planning Scenarios Task Analysis T 1 T 1 T 1 T 1 T 1 T m Joint Operations Concepts Integrated Architecture Overlay what we have with what we need to do COCOM IPLs GAP Analysis Risk Assessment JCIDS Is this a mission Recommendation capability package that meets Capability Needs the mission DOTMLPF capability Changes requirement? Capability Assessments C n C n C n C n CJCSI D, 12 Mar 04, p. A-3 Joint Functional Concepts JCIDS Analysis (FAA, FNA, FSA) platform/ system of systems subsystem component Decision and Action Science & Technology Planning, Programming, and Budgeting System Acquisition Experimentation

13 Application of the Missions and Means Framework to Distributed Testing: Some Results From A Test Mr. Richard S. Cozby Chief, Technology Management Division HQ, U.S. Army Developmental Test Command

14 Distributed Test Event-5/Multi-Service Distributed Event Event: August 2005 Mission Context: A Company Mounted Operation Supported by Platoon Dismounted Forces in an Urban Environment

15 Event Joint Mission Context Reachback Reachback AWACS Navy E-2C JSTARS AEA Assets Predator F-15 AC-130 F-16 FAC-A Army UAVs CAOC AEGIS Cruiser JTAC ASOC UA Theater Theater STRYKER F-18 SA-8 SA-6 TARGET

16 Participants AIR FORCE DMOC - Kirtland AFB, NM SIMAF Wright Pat AFB, OH 46thTW Eglin AFB, FL Hurlburt Field, FL CAOC-X Langley AFB, VA AFAMS-CVC Pentagon SWC Schriever AFB, CO a DREN DREN Full Full Mesh Mesh NSWC - Navy DMOC - AF NAVY ARMY NSWC Dahlgren, VA a JITC Joint WSMR - Army ATC / DTC - APG, MD EPG - Ft Lewis, WA EPG - Ft Huachuca, AZ NAWCAD Patuxent River, MD SPAWAR San Diego, CA NAWCWD China Lake, CA RTTC/AMRDEC - Huntsville, AL WSTC / IRCC- WSMR, NM JPSD JPO / NVESD Ft Belvoir, VA

17 Event Analysis Framework Missions and Means Framework 11 Fundamental Elements: Seven Levels, Four Operators MSDE Analysis Framework 7. OWNFOR Why = Purpose, Mission 6. Context, Environment (Military, Civil, Physical, etc.) 7. OPFOR Why = Purpose, Mission UJTL abc def ghi 7. Mission 5. Index: Location & Time 7. Mission 4. Tasks, Operations 4. Tasks, Operations O 4,1 O 4,1 O 3,4 O 3,4 abc def ghi abc def ghi abc def ghi abc def ghi OOB abc def ghi 3. Functions, Capabilities BLUFOR 1. Interactions, Effects OPFOR 3. Functions, Capabilities abc def ghi O 2,3 2. Components, Forces O 1,2 O 1,2 2. Components, Forces O 2,3 abc def ghi Planning abc def ghi Employment Use Joint Tactical Tasks to define the operation Decompose the tasks to understand component-level influences Instrument the components to measure their activities Synthesize the tasks as a manifestation of component interactions

18 Event Analysis Methodology ANALYSIS PRODUCTS Baseline analysis methodology for assessment of Joint Tasks Baseline set of Joint Task Measures associated with each Service Level Task (NTA, ART, AFT, MCTL) Quantitative Data Examples ART M3 - Time to make initial assessment of attacks after TOT NTA M2 Minutes after target ID to complete attack AFT M1 Time from the desired timing for lethal force to cause desired effects System level measures for respective service test objectives MULTI-SERVICE JOINT TASK COMMON ANALYSIS METHODOLOGY

19 Results and Areas for Improvement Demonstrated ability to execute a distributed L/V/C event with existing capabilities. Conducted system testing in the context of a Joint mission. Gained experience with multi-service performance report generation using multiple tools. Gained experience in reporting complex Joint thread exercises with diverse data formats. Areas Requiring Improvement Assessment 1 Ability to determine system contributions to the accomplishment of a Joint task. 2 Ability to evaluate individual test item performance in L/V/C events Ability to test multiple items in a Joint environment simultaneously and accomplish all test objectives. Ability to sufficiently gather, process, and analyze data (one set) from distributed L/V/C events. Determine capabilities and limitations associated with legacy systems in Joint L/V/C events. Integrate across a variety of environment models and coordinate systems. 7 Assess and integrate multiple threat representations in a distributed L/V/C environment

20 Getting Organized to Perform Evaluation Dr. Paul H. Deitz Director (A) Human Research & Engineering Directorate, U.S. Army Research Laboratory 3/14/

21 Mode 1: Deliberate Planning Military Operations and Warfighting Require Capability Provide Capability DOTMLPF* Solutions Define Enable Mode 2: Crisis Response Vugraph Happy Talk! Analysis, Demonstration Research, Experimentation Logistics, Sustainment Tactics, Fielding Life Cycle Acquisition, Test & Evaluation Readiness, Training * DOTMLPF: Doctrine, Organization, Training, Materiel, Leader Development, Personnel, Facilities 21

22 Mode 1: Deliberate Planning Military Operations and Warfighting Require Capability Provide Capability DOTMLPF* Solutions Define Enable Mode 2: Crisis Response Vugraph Unhappy Talk! Analysis, Demonstration Research, Experimentation Logistics, Sustainment Tactics, Fielding Life Cycle Acquisition, Test & Evaluation Readiness, Training * DOTMLPF: Doctrine, Organization, Training, Materiel, Leader Development, Personnel, Facilities 22

23 The Russians Are Coming, The Russians Are Coming "Just got to get organized. We've got to get organized. Jonathan Winters (Officer Norman Jones) to Ben Blue Metro-Goldwyn-Mayer, Inc., 1966

24 Where E Resides Decision Making Knowledge Formation Where T Resides Information Observe, Exercise, Measure, Test Sift, Filter, Analyze, Evaluate Requirements Requirements Information Where M&S Reside Calculate, Model, Represent, Simulate Abstraction Repeated VV&A Process Abstraction Single, Unified Abstraction

25 The Example: Ballistic Live Fire Example Mission Utility Functional Capabilities Post-Event Components Interaction Conditions Level 4 Level 3 Level 2 Level 1 Operational Testing* O 3,4 Operator Developmental Testing* O 2,3 Operator Developmental Testing* O 1,2 Operator * And/Or Modeling & Simulation

26 Direct Fire Validation Perf Number of System Evaluation Metrics Shot Threat or Components Personnel Discrete Distribution Non-Perf Killed Casualties M-LoF F-LoF K-Kill 1 Threat A Non-Perforation Correctly Predicted 2 Threat A Non-Perforation Correctly Predicted 3 Threat A 4 Threat A 4* Threat A Non-Perforation Correctly Predicted 5 Threat A 5* Threat A 6 Threat B Non-Perforation Correctly Predicted 7 Threat B Non-Perforation Correctly Predicted 8 Threat B 9 Threat B 10 Threat C 10* Threat C 11 Threat D 12 Threat C 13 Threat C 14 Threat E 15 Threat F 16 Threat F Perforations 50% 5% & < 50% > 0% & < 5 % = 0% Component Criteria 80% 50% & < 80% < 50% Personnel Criteria 1/2 Crew member > 1/2 & 1 crew member > 1 Crew member From William E. Baker, Richard Saucier, Theodore M. Muehl, and Ricky L. Grote, Discrete Distribution 50% 5% & < 50% > 0% & < 5 % = 0%

27 The MMF: Old & New 4. O 4,1 Tasks, Operations O 3,4 Circa Context: Environment (Military, Civil, Physical, etc.) 7. BlueFor Purpose: Why = Mission 3. Functions, Capabilities 7. Mission 4. Tasks, Operations O 4,1 5. Index: Location & Time O 2,3 O 3,4 2. Components, Forces 3. Functions, Capabilities O 2,3 BLUFOR O 1,2 1. Interactions, Effects O 1,2 2. Components, Forces 1. Interactions, Effects

28 Missions and Means Framework 11 Fundamental Elements: Seven Levels, Four Operators 7. OWNFOR Why = Purpose, Mission 7. OPFOR Why = Purpose, Mission 7. Why, Wherefore, to What End

29 Missions and Means Framework 11 Fundamental Elements: Seven Levels, Four Operators 6. Context, Environment (Military, Civil, Physical, etc.) 7. OWNFOR Why = Purpose, Mission 7. OPFOR Why = Purpose, Mission 6. Under What Circumstances

30 Missions and Means Framework 11 Fundamental Elements: Seven Levels, Four Operators 6. Context, Environment (Military, Civil, Physical, etc.) 7. OWNFOR Why = Purpose, Mission 7. OPFOR Why = Purpose, Mission 5. Index: Location & Time 5. When and Where

31 Missions and Means Framework 11 Fundamental Elements: Seven Levels, Four Operators 6. Context, Environment (Military, Civil, Physical, etc.) 7. OWNFOR Why = Purpose, Mission 7. OPFOR Why = Purpose, Mission 7. Mission 4. Tasks, Operations 5. Index: Location & Time 7. Mission 4. Tasks, Operations OWNFOR OPFOR 4. Activity-centric, named with a Verb, Do What The Playbook

32 Missions and Means Framework 6. Context, Environment (Military, Civil, Physical, etc.) 7. OWNFOR Why = Purpose, Mission 7. OPFOR Why = Purpose, Mission 5. Index: Location 7. Mission & Time 7. Mission 4. Tasks, Operations 4. Tasks, Operations O 4,1 O 4,1 O 3,4 O 3,4 3. Functions, Capabilities BLUFOR 1. Interactions, Effects OPFOR 3. Functions, Capabilities O 2,3 2. Components, Forces O 1,2 O 1,2 2. Components, Forces O 2,3 Planning Employment Architecture defines how Parts are assembled into Packages Capabilities are relationships between Parts and Packages

33 MMF and FCS Mr. Jack Sheehan Chief Engineer, Combined Test Organization PM UA

34 AS OF 21Jun05 FCS Review to DAB Systems of System Engineering April 03 ORD, Jan 05 Update Interpret User Needs, Develop & Refine SoS Performance Spec & Functional Specs INPUTS ORD, O&O, ASR, SEP, CDD System of System Specification Trades Develop System Functional Specs into PID s / PCD s and CI Functional (design to) Specs SoS SRR 2004 (1Q) DCR 2004 (3Q) Prime Item & CI Development Specs Trades SoS SFR 2005 (4Q) Planning SoS PDR 2008 (4Q) Verification Test Analysis and Simulation MS C 2012 (4Q) Final Industrial Capability Assessment Complete Production Readiness Reviews (PRR) System Integration Verification Integration and Verification System of System Verification Army Operational Validation IOC 2015 (1Q) Combined DT&E / OT&E / LFT&E Demonstrate SoS Compliance to Specs System Level DT&E / LFT&E Verify System Performance Compliance to Specs EMRL Sustainment EMRL FRP EMRL MS C EMRL SoS PDR Preliminary Design Subsystem Integration Verification Integrated DT&E / LFT&E Verify Performance Compliance to Specs Evolve CI Functional Specs into Product (build to) Documentation CI / CSCIs Component Verification Individual CI / CSCI Verification Concurrent Engineering Approach consists of a series of four Engineering Iterations (EI s), four Capability Maturity reviews and four Engineering Maturity Reviews *Dates In FY SoS CDR 2010(4Q) EMRL SoS CDR Fabricate, Assemble, Code to build to Documentation Build TRR s Proceed Testing Legend: Current Status of Completion

35 Chains versus Networks Chain Too Too brittle, brittle, simple simple pattern, simple simple control, control, scaled scaled business end end most most poorly poorly connected, hard hard to to reconfigure or or change change flow flow Network Very Very robust, robust, complex pattern, complex control, control, scale scale free free business end end best best connected, natural natural to to reconfigure or or change change flow flow

36 The FCS BCT Integrates With Army Enterprise System Into the GIG Integrated Warfighting Platforms: Lethality / Survivability enhanced by underlying network layers Sensing Systems: motion, visual, audible, etc. ISR: Eyes and Ears of the Commander BC Applications: assimilate info BC: C2 logic and reasoning based on information System Services: Common Net- Centric Infrastructure SOSCOE: Tactical Net-Centric Middleware Standards: Common Net-Centric technical standards. Includes DoD guidance, policy, and direction Transport Systems: networked communications Networked Communications: comms backbone and omms subnets from GIG to/from ground sensors

37 a-mind TM - Automated Mission Relevant Situational Awareness What is done? Operational Architecture/Operational Use Case Definition How it s done. Operational Use Cases Dependencies on Services Service Layer Virtual Translator Infostructure Used to Provide Services What is used? Web Apps Operational Architecture Operational Architecture Internet Data Services Functional Capabilities & Services Information Infostructure DNS Functional Capabilities & Services Information Infostructure a-mind Technology automates dependency understanding enabling analysis of Mission Impact of Infostructure Disruptions Proven ability to integrate COTS products Unique integration and analysis framework patent filings Mission Impact Management (MIM) Solution a Product of Northrop Grumman- Patent Pending

38 Dependencies Map and view relationships within tiers... MIM: Northrop Grumman

39 Dependencies... and between tiers MIM: Northrop Grumman

40 New M&S Requirements Module Functional Performance The Cube Unique Configuration Items Network Systems Communications Interoperability Networked Lethality Training Survivability Maneuver / Maneuver Support MANPRINT Sustainment Transportability/Deployability System Management RAM-T Constraints & Environments Safety (ESOH) Producibility Affordability Growth SoSCOE Common C4ISR Components Modeling and Simulation Common Critical CI/CSCIs Complementary Systems Soldier Systems Training and Logistics Systems MGV UAV UGV NLOS LS IMS Complementary Sys Training Systems Logistics Systems Requirements Modules Established Around the Front-Face of the Cube M&S Module is intended to enhance the integration and utilization of M&S across all aspects of the program. M&S Team is responsible for the application of M&S from Cradle-to-Grave and Top-to-Bottom New M&S Requirements Module Systems / Platforms Multi-disciplined Teams including LSI, LSI, PM PM UA UA & TRADOC

41 Simple Tree UGV Example

42 Panel Summary Mr. John Illgen Northrop Grumman Simulation Technologies

43 Conclusions T&E and M&S have evolved and are managed asynchronously Adequate evaluation for today s complex SoSs in a Joint context requires extensive complimentary Test/M&S detailed planning and execution Lack of common processes inhibits M&S sharing in the T&E community No standard Standard to assess M&S ability What is a High Fidelity Model? No common processes for using/sharing M&S Common understanding through common languages, methods, and processes are crucial to achieving full T&E community integration

44 Path Ahead Crawl before Walking Develop a common understanding of what Warfighter focused T&E means to each Service and DoD Agency Develop common language and practices for M&S use in T&E Understand Service/Agency strengths and weaknesses in M&S in a T&E context Community-wide Methods and Processes (M&P) Standard M&P for T&E across all Services and DoD Agencies Links M&S use within DoD T&E communities Good news: JTEM is making progress in this area

45 Path Ahead Incorporate MMF as a community-wide T&E Process Global organizing schema covering both the mission definition and mission execution Common understanding of T&E in Warfighter context Without a global organizing schema covering both the mission definition and mission execution sides of the problem, the many pieces cannot be properly defined, instantiated, linked and executed

46 The Problem: How to clarify Lifecycle issues in a T&E context? COOPERATIVE ENGAGEMENT CV BATTLE GROUP RETURNING CV STRIKE AIRCRAFT E2-C SURVEILLANCE USN COMBAT AIR PATROL JOINT US/ALLIED F E S E L F N S E 11 Fundamental Elements: Seven Levels, Four Operators 6. Context, Environment (Military, Civil, Physical, etc.) 7. OWNFOR Why = Purpose, Mission 7. OPFOR Why = Purpose, Mission 5. Index: Location 7. Mission & Time 7. Mission 4. Tasks, Operations 4. Tasks, Operations O 4,1 O 4,1 O 3,4 O 3,4 3. Functions, 1. Interactions, 3. Functions, BLUFOR OPFOR Performance Effects Performance O 1,2 O 1,2 O2,3 2. Components, 2. Components, O 2,3 Forces Forces E AWACS COMMERCIAL AIR LANES AMPHIBIOUS GROUP ENEMY SUB ASCM ATTACK T H E A T ER D E F E N S E Planning Employment CV-LAUNCHED STRIKE HAWK JTIDS ENEMY GROUND LAUNCHED MISSILES ENEMY HELO 17 MERCHANT SHIPS ENEMY JAMMING ENEMY AIR ATTACK PATRIOT TBM ATTACKS Elements N N FoS, SoS Mission Tactical Use Case Example for IP03: Conduct Network Fires UA CIC PROGRAMS UA MCG2 UA MCG1 Analysis Of Alternatives 1,2, 4 3, 5 3, 5 1, 2, 4 UA MSC Fiscal Realities FCS NCIE 1, 4 2, 4 Evaluation Matrix and Decomposition of COI C MOE DATA SOURCES Evaluator Equations UA ISRC 1 XXXX 1.1 s s s s s p p p 1.2 s s s s s p p P 1.3 s s s s s p p s s S 1.4 s s s s s p p s s s s s s s s p p p 1.6 s s s s s p p P 2 XXXX 2.1 s s s s s p p s s S MMF 2.2 s s s s s p p s s s 2.3 s s s s s p p p 2.4 s s s s s p p p 3 XXXX 3.1 s s s s s p p P IP-1: BATTLE Interim RANGE OF MILITARY OPERATIONS (JROCM ) 3.2 s s s s s p p s s S COMMAND UA Involving Use/ Not Involving Use/ 3.3 WAR s s s s MOOTW s p p s s s Threat of Force MOOTW Threat of Force 3.4 s s s s s p p p NUCLEAR 3.5 WARFARE s s s s s p p P NCIE CONVENTIONAL 3.6 s s swarfare s s p p s s S 3.7 s s s s s p p s s s FORCIBLE ENTRY; STRIKES; RAIDS 3.8 s s s s s p p p 4 XXXX 4.1 s s s UNCONVENTIONAL s s s p WARFARE p p p 4.2 s s s s s s INFORMATION p poperations p p SME Engineering 4.3 s NONCOMBATANT s s s s EVACUATION s p OPERATIONS; p p precovery OPERATIONS 4.4 s s s s s LINE sof COMMUNICATIONS p p p PROTECTION p BIC CO COMBATTING TERRORISM HOMELAND SECURITY 1, DEP 3, 5 HOMELAND DEFENSE: NATIONAL LAND DEFENSE; NATIONAL MARITIME DEFENSE; 2, 4 NATIONAL AIR AND SPACE DEFENSE; CRITICAL INFRASTRUCTURE PROTECTION Process CIVIL SUPPORT: CONSEQUENCE MANAGEMENT; MILITARY SUPPORT TO CIVIL AUTHORITY; MILITARY ASSISTANCE FOR CIVIL DISTURBANCES; DOD SUPPORT TO COUNTER DRUG OPS Legend: FOREIGN CONSEQUENCE MANAGEMENT; FOREIGN HUMANITARIAN ASSISTANCE UA FEC 1 OPORD/FRAGOS COUNTERPROLIFERATION SANCTION ENFORCEMENT 2 RECOMMENDED AG SV s SUPPORT TO COUNTERINSURGENCY; SUPPORT TO INSURGENCY 3 APPROVED AG FREEDOM OF NAVIGATION OPERATIONS PEACE ENFORCEMENT 4 STAFF ESTIMATE MMF 5 CDR S GUIDANCE SOLVES SHOW OF FORCE PEACEKEEPING OPERATIONS SECURITY COOPERATION ACTIVITIES NATION ASSISTANCE: SECURITY ASSISTANCE; FOREIGN INTERNAL DEFENSE; Operational HUMAN & CIV ASSIST ARMS CONTROL; MILITARY CONTACTS MULTI-NATIONAL EX, TR, ED NORMAL AND ROUTINE MILITARY ACTIVITIES 8 Use M&S Technical / Test Cases Functional 3CE Capability Test of Warfighter Network Testing Requirements Stimulation / Control Measurements Technical / Instrumentation Test Functional Physical Infrastructure Capability Test of GIG THE Nodal Elements DoD N N Test Technical / TECOE PROBLEM Development Capability Functional NCIE Test of Elements FCS MISSION Plans Interoperability MOPs/MOEs MOPs/MOEs Evaluation Strategy Element Level FoS/SoS Level Mission Threads User N N CJCSI 3170 (JCIDS User ± Decomposition (ORD, Spec) (ORD, Spec, (O&O) KPP, COIC) Red ) IP/S1 JTEM PPBS Blue Test IP/S2 TT Strategy & Operational Element Level Capabilities Capabilities Joint Operations OT FCS FoS/SoS Cap/Lim By Guidance NSS Overarching Capability IP/S3 Cap/Lim Cap/Lim Mission Concepts Test Data & E, s, s, + Unks + Concepts E, s, s, + Unks Limitations NCIE IP/S4 Unks Limitations User By By Core Compl Sensitivity Future Upgrades Joint/Compl Stimulation / Control Measurements JSBE PRIORITIES 1, 5 UAMBL Tasks Joint Operating Concepts Science & Technology UE/JTF CIC JCIDS Recommendation Capability Needs DOTMLPF Changes Planning, Programming, and Budgeting System Integrated Architecture OPLANs Defense and Planning CONPLANs Scenarios Overlay what we have with what we need to do Task COCOM IPLs Assessment Analysis GAP Analysis and Risk Assessment Analysis Functional Area Analysis (FAA) Functional Solutions Analysis (FSA) Reconciliation and Recommendation Decision and Action Chairman of the Joint Chiefs of Staff Instruction 3170 NETWORKS M&S Capability Assessments Joint M&S Functional Concepts Virtual Components/ SOSIL/SIL Sub-systems/ Validation Systems Test Execution Strategy Validation Platform Testing Distributed Testing Operational Testing Functional Needs Analysis (FNA) Acquisition Experimentation ± Joint Capabilities Integration and Development System 4 TRADOC RDECOM JROC Systems Systems M&S M&S SoS, S, S, + Unks Family System of Of Systems Systems Cap/Lim S, S, +Unks Updated as Systems Mature Analyses Sensitivity By Analyses Thread By Thread Mission, S, S, + Unks Unit Of Action Cap/Lim S, S, +Unks SoS Eng Strategy Mission Mission + + Unks Unks S H IP D E BATTLE GROUP A R E A D E F E N S Functional Areas The Missions & Means Framework OV s Tactical Realities Joint Interoperability ATEC Object Models Legacy Systems C3T AFICE Asymmetric Threats

47 Points of Contact John Illgen, Northrop Grumman SIM TECH Phone: (805) X201/206 Dr. Paul H. Deitz, Director(A), U.S. Army Research Laboratory Human Research & Engineering Directorate Office: (410) Cell: (443) Mr. Rick Cozby, Chief, Technology Management Division HQ, U.S. Army Developmental Test Command Phone: (410) DSN: Mr. Jack H. Sheehan, Chief Engineer Combined Test Organization, PM Unit of Action Office: (703) Cell: (443) Augustine Ponturiero, Northrop Grumman SIM TECH Phone: (240)

48 Questions?

49 Backup Slides

50 Missions and Means Framework 11 Fundamental Elements: Seven Levels, Four Operators 6. Context, Environment (Military, Civil, Physical, etc.) 7. OWNFOR Why = Purpose, Mission 7. OPFOR Why = Purpose, Mission 7. Mission 4. Tasks, Operations 5. Index: Location & Time 7. Mission 4. Tasks, Operations BLUFOR OPFOR 2. Components, Forces 2. Components, Forces 2. Entity-centric, named with a Noun By Whom The Players

51 Missions and Means Framework 11 Fundamental Elements: Seven Levels, Four Operators 6. Context, Environment (Military, Civil, Physical, etc.) 7. OWNFOR Why = Purpose, Mission 7. OPFOR Why = Purpose, Mission 7. Mission 4. Tasks, Operations 5. Index: Location & Time 7. Mission 4. Tasks, Operations 3. Functions, Capabilities OWNFOR 1. Interactions, Effects OPFOR 3. Functions, Capabilities 2. Components, Forces 2. Components, Forces 1. The (shared) Slings-and-Arrows of Outrageous Fortune -- Science 3. Condition-dependent How Well -- Engineering

52 Missions and Means Framework 11 Fundamental Elements: Seven Levels, Four Operators 6. Context, Environment (Military, Civil, Physical, etc.) 7. OWNFOR Why = Purpose, Mission 7. OPFOR Why = Purpose, Mission 5. Index: Location 7. Mission & Time 7. Mission 4. Tasks, Operations 4. Tasks, Operations O 4,1 O 4,1 O 3,4 O 3,4 3. Functions, Capabilities OWNFOR 1. Interactions, Effects OPFOR 3. Functions, Capabilities O 2,3 2. Components, Forces O 1,2 O 1,2 2. Components, Forces O 2,3 Planning Employment Bottom-up, Causal, Time-forward execution and adjudication of outcomes

53 Missions and Means Framework 11 Fundamental Elements: Seven Levels, Four Operators 6. Context, Environment (Military, Civil, Physical, etc.) 7. OWNFOR Why = Purpose, Mission 7. OPFOR Why = Purpose, Mission 5. Index: Location 7. Mission & Time 7. Mission 4. Tasks, Operations 4. Tasks, Operations O 4,1 O 4,1 O 3,4 O 3,4 3. Functions, Capabilities BLUFOR 1. Interactions, Effects OPFOR 3. Functions, Capabilities O 2,3 2. Components, Forces O 1,2 O 1,2 2. Components, Forces O 2,3 Planning Employment Top-Down, Concurrent Synthesis and Decision Making

54 Missions and Means Framework 6. Context, Environment (Military, Civil, Physical, etc.) 7. OWNFOR Why = Purpose, Mission 7. OPFOR Why = Purpose, Mission 5. Index: Location 7. Mission & Time 7. Mission 4. Tasks, Operations 4. Tasks, Operations O 4,1 O 4,1 O 3,4 O 3,4 3. Functions, Capabilities BLUFOR 1. Interactions, Effects OPFOR 3. Functions, Capabilities O 2,3 2. Components, Forces O 1,2 O 1,2 2. Components, Forces O 2,3 Planning Employment Architecture defines how Parts are assembled into Packages Capabilities are relationships between Parts and Packages