1 Enabling Systems Engineering with an Integrated Approach to Knowledge Discovery and Architecture Framework Michael R. Collins Advantage Development, Inc. October, 2008
2 Architecting and Engineering Different Sides of the Same Coin Engineering employs analysis of function to iteratively decompose and separate a primarily functional representation of a whole into representations of economically producible components that can be assembled to construct the functional whole. Big implication here! Engineering requires an initial point - a representation of the whole to be successful! Engineering does not work without an initial point!! We refer to this initial point as: Engineerible Requirements The set of engineering requirements necessary and sufficient to initiate the successful engineering and production of a system Brad Mercer, MITRE, Chief Architect Maritime IT and Engineering
Architecting and Engineering Different Sides of the Same Coin Architecting employs synthesis of form to iteratively compose separate elements to form a coherent whole, or a representation of a coherent whole, that can serve as an initial point for system development. Architecting synthesizes this initial point from the collective vision, goals, constraints, and other needs of the stakeholders in the to-bedeveloped system converting conflicting stakeholder demands into a conceptualized whole that maximizes the satisfaction of each stakeholder. From the point of view of architecting, we refer to this engineering initial point as an: Architecture Specification An architecture description to which all system implementations must adhere; and a set of principles, practices, and constraints guiding implementation, operation, and evolution of the developed system Phone 216-570-8775 Brad Mercer, MITRE, Chief Architect Maritime IT and Engineering 3
Architecting and Engineering Different Sides of the Same Coin collective vision, goals, constraints, and other needs of the stakeholders Architecting Synthesis of Form iteratively compose separate elements to form a coherent whole architecture specification engineerible requirements Phone 216-570-8775 Analysis of Function Engineering representations of economically producible components that can be assembled to construct the functional whole iteratively decompose and separate a primarily functional representation of a whole Brad Mercer, MITRE, Chief Architect Maritime IT and Engineering 4
Direct Action - Raids, Ambushes, Assaults - Terminal Guidance SOF tactical operations directed against enemy missile threats Special Reconnaissance - Target // Threat Assessment - Armed Reconnaissance -Post Strike Reconnaissance SOF tactical operations to gather information and eliminate targets of opportunity (JSOAC) Theater ISR Theater Intel National ISR USCENTCOM C2 / Intel JSOTF NIMA / NRO IMINT All Source Intel Defense Intel / MASINT SIGINT Foreign Intel/Info Non-DoD Info Non-DoD CIA DIA NSA Allies & Coalition Deployed JSOTF/ FOB DoD Client Services Environment USCENTCOM DoD Client Services Environment Allies and Coalition Org Space JSOAC / JAOC DoD Client Services Environment SI - NCES to JSOAC Client Services Environment SI - JSOAC Client Services Environment to NCES Global Grid Non-DOD Agencies Org Space UAV SI - NCES to CENTCOM Client Services Environment SI - CENTCOM Client Services Environment to NCES SI - JSOTF Client Service s E nvironment to NCES SI - NCES to JSOTF Client Services Environment SI A/C Client Services Environment to NCES SI - NCES to A/C Client Services Environment A/C Client Services Environment SI - NCES to UAV SI - UAV to NCES SI - Non-DOD Client Services Environment to NCES SI - NCES to Non-DoD Client Services Environment Non-DoD Client Services Environment SI - DIA Client Services Environment to NCES SI - NCES to DIA Client Services Environment IC Client Services Environment DIA Processing Services Network Security Services DISCOVER, ARCHITECT, VISUALIZE, MANAGE NCES System Common Catalog Services Full-Service Directory Services Global Hawk NSA Enterprise Data Storage Services Application Services IC Client Services Environment SI - NCES to Predator SI - Predator to NCES Netw ork Management Services Us er Assistant Services Predator SI - NCES to JSF Joint Strike Fighter SI - JSF to NCES SI - NCES to ISR Satellite SI - ISR Satellite to NCES SI - Land Warrior to NCES SI - NCES to Land Warrior UCAV SI - NCES to UCAV SI - UCAV to NCES SI - NIMA / NRO IC Client Service s Environment SI - NCES to NIMA / NRO IC Client S ervices Environment SI - CIA Client Services Environment to NCES SI - NCES to CIA Client Services Environment IC Client Services Environment CIA IC Client Services Environment NIMA / NRO Land Warrior System Services SOF Operational Systems ISR Satellite 12 USCE NTCOM Deployed JSOTF/ FOB Allies and Coalition Org Space JSOAC / JAOC Non-DOD Agencies Org Space UAV (Wireless/WNW) (Wireless/WNW) (Terrestrial) (Terrestrial) (Terrestrial) (Wireless/WNW) (Terre strial) DIA Global Hawk (Wireless/Wideband Network Waveform) Global Grid (Terrestrial) NSA Predator (Wireless/WNW) (Terrestrial) CIA (Wireless/WNW) (Terrestrial) Joint Strike Fighter (Wireless/WNW) (Wireless/WNW) Internet Prot ocol Netw ork (Wireless/WNW) NIMA / NRO A1 (1) Achieve Dominance UCAV SOF Operational Systems A11 (11) Provide Knowledge Management Services A12 (12) Assure A13 (13) Use IS R Satellite Land Warrior Syste m Services 13 A2 (2) Provide National Level Intelligence and A3 (3) Provide Command, Control, and Intelligence A411 (4110) Conduct Target and Threat Assessment (JP 3-05) A4111 (4111) Process Target and Threat A4112 (4112) Determine Additional Support Requirements for Target & Threat Assessment A4113 (4113) Identify and Assess Target and Threat A0 (0) Conduct Warfighting in S outhwest A sia A41 (4100) Conduct Special Reconnaissance Mission (JP 3-05) A412 (4120) Conduct Armed Reconnaissance (JP 3-05) A4121 (4121) Process Armed Reconnaissance Mission A4122 (4122) Determine Additional Support Requirem ents for Armed Reconnaissance A4123 (4123) Conduct Reconnaissance, Detect and Attack Targets of Opportunity A4 (4) Conduct SOF Operations in SW A A413 (4130) Conduct Post Strike Reconnaissance (JP 3-05) A4131 (4131) Process Post Strike Reconnaissance Mission A4132 (4132) Determine Additional Support Requirem ents for Post Strike Reconnaissance A4133 (4133) Measure Results of Strike A421 (4210) Conduct Raids, Am bushes, or Direct Assaults (JP 3-05) A4211 (4211) P rocess Direct Action Mission A4212 (4212) Determine Additional Support Requirements for Attacking Target A4213 (4213) Attack Target A5 (5) Conduct Air Operations A42 (4200) Conduct Direct Action Mission (JP 3-05) A422 (4220) Conduct Terminal Guidance Operations (JP 3-05) A4221 (4221) P rocess Term inal Guidance Mission A4222 (4222) Determine Support Requirements for Terminal Guidance Operations A4223 (4223) Direct Munitions at Designated Targets Warfighting in Southwest Asia Tactical Use Case OV-4 Command Relationships Chart Theater Component Commands Army Commander Navy Commander Air Force Commander Marine Commander Special Operations Forces Commander Joint Force Special Operations Component Commander ARSOTF / NSWTG / AFSOF SOF Team Joint Force Land Component Commander Combat Units Joint Force Air Component Commander Combat Units Combatant Commander Commander Joint Task Force Joint Force Maritime Component Commander Combat Units Operational Control Administrative/Logistical Support Area of Focus Non-DoD Agencies Intelligence and " "(2) Provide National Level Allied and Coalition Forces "(2) Provide National Level Intelligence and " DIA "(2) Provide National Level Intelligence and " Non-DoD Agencies - NCID NCID - Non-DoD Agencies USCENTCOM "(3) Provide Command, Control, and Intelligence " NSA "(2) Provide National Level Intelligence and " Network Centric Dom ain "(1) Achieve Dominance" JSOTF/FOB "(3) Provide Command, Control, and Intelligence " CIA "(2) Provide National Level Intelligence and " SOF Unit - NCID NCID - SOF Unit Air Operations "(5) Conduct Air Operations SOF Unit "(4) Conduct SOF Operations in SWA" "(4100) Conduct Special Reconnaissance Mission (JP 3-05)" "(4111) Process Target and Threat " "(4112) Determine Additional Support Requirements for Target & Threat Assessment" "(4113) Identify and Assess Target and Threat" "(4120) Conduct Armed Reconnaissance (JP 3-05)" "(4121) Process Armed Reconnaissance Mission " "(4122) Determine Additional Support Requirements for Armed Reconnaissance" "(4123) Conduct Reconnaissance, Detect and Attack Targets of Opportunity" "(4130) Conduct Post Strike Reconnaissance (JP 3-05)" "(4131) Process Post Strike Reconnaissance Mission " "(4132) Determine Additional Support Requirements for Post Strike Reconnaissance" "(4133) Measure Results of Strike" "(4200) Conduct Direct Action Mission (JP 3-05)" "(4211) Process Direct Action Mission " "(4212) Determine Additional Support Requirements for Attacking Target" "(4213) Attack Target" "(4220) Conduct Terminal Guidance Operations (JP 3-05)" "(4221) Process Terminal Guidance Mission " "(4222) Determine Support Requirements for Terminal Guidance Operations" NIMA / NRO "(2) Provide National Level Intelligence and " "(4223) Direct Munitions at Designated Targets" 11 Visualization Products (DODAF Artifacts) Warfighting in Southwest Asia Tactical Use Case Precision Strike Direct Action Armed Recon Special Reconnaissance C2 Info, Collaboration, COI and ISR Info ISR, Publish, Subscribe OV-1 Network Centric Domain OV-1 1 Operational Concept Graphic 9 Structured and Described & Data Mission Function Task UJTL SN ST OP TA Warfighting in Southwest Asia Tactical Use Case SI - NCES to Global Hawk SI - CIA Client Services Environment to NCES SI - Global Hawk to NCES SI - NCES to CIA Client Services Environment SV-1 SV-1 1 System Interface OV-3/SV-6 Nodes Warfighting in Southwest Asia Tactical Use Case MANAGE Warfighting in Southwest Asia OV-5 5 Node Tree Tactical Use Case SV-2 2 Systems Communications Description OV-4 VISUALIZE SV-2 Systems Functions OV-5 System Components ARCHITECT Warfighting in Southwest Asia Tactical Use Case Allied and Coalition Forces - NCID NCID - Allied and Coalition Forces DIA - NCID NCID - DIA USCENTCOM - NCID NCID - USCENTCOM NSA - NCID NCID - NSA Billet Components CIA - NCID JSOTF - NCID NCID - CIA NCID - JSOTF NCID NIMA / NRO NIMA / NRO - NCID Air Ops - NCID NCID Air Ops OV-2 OV-2 2 Operational Node Connectivity Program Documents & Reports Architecture Effort K/S/A Components Unresolved information & data: Discovery, Indexing and Clustering Activity Task Phone 216-570-8775 Operational Function Mission Chores Operational Nodes - SubNodes System Functions Cluster System Nodes DISCOVER Knowledge Skills Abilities Organization Personnel 5
6 Root Process Problem Complexity of data elements is overwhelming Difficult to support the book-keeping management of all of the data elements and their relationships across all the echelons of the Enterprise Structuring complexity Echelon integration and enterprise description everything is a part of a larger system Persistent, iterative, and evolutionary incorporation in a knowledge and reuse environment
7 Discovery Every object, relationship and aggregation of objects in the knowledge metamodel is in documents, the universe of textual models Discovery is about finding the objects, relationships, aggregations and descriptions of each of these in the authoritative and original data sources Integration is about using Discovery to build and describe the Architecture using an architecture meta-model
8 Concept, Themes, and Description A concept, or theme, is the encapsulation of a pattern that is identified as a gestalt: a persistent and unique signature Documents are textual patterns Models are labeled, structured patterns Labels are knowledge anchors to concepts and themes Knowledge is pattern recognition, association and application in integrated textual and model gestalts
9 DISCOVERING CONCEPTS / THEMES ' can be treated as quantifiable symbols in communications Natural language has a high degree of unessential content, the less frequently a unit of communication occurs, the more information it conveys objects extracted from Natural Language text form a index unique to that concept The architecture metamodel is the syntactic of the knowledge pattern and is semantically rigorous objects cluster based upon an inference relationship measuring semantic completeness
Mapping and Demonstrating Impactful Relationships 10 Cluster the indexes of the information objects using Statistical Inference! Example Cluster Picture from the Cartia: ThemeScape Web Site Define the information objects and index them Program email Reportingphone company Object McKinsey #1Consulting Program Reporting VoIP (Voice-over-IP) Object #N Info-Tech Research Program Reporting Object #2 Program Implementation Baseline standard phone lines VoIP (Voice-over-IP) Legacy and low-end VoIP systems de facto standard misnomers and myths Program Reporting Object #R Long distance call THE UNIVERSE OF DOCUMENTS CONTAINS THE INFORMATION OBJECTS THAT DESCRIBE THE IMPLEMENTATION BASELINE
11 Cluster and Relationship Visualizations Pictures from Battelle, PNNL Starlight Web Site http://starlight.pnl.gov/ Cluster and integrate using the architecture meta model Visualization can take many forms presenting many perspectives. Tracing of the models back to the authoritative and original data sources.
DISCOVERY PROCESS Theory Statistical Inference 1.0 DISCOVER Objects 1.1 INDEX Indexed Objects Architecture Conceptual Data Model - Metamodel 1.2 CLUSTER Clusters Semantic Completeness Phone 216-570-8775 1.3 ANALYZE Iterative Labeled Concept Descriptions Encapsulated Concepts 1.4 DESCRIBE Rich Concepts, Indexes and Clusters Discovery works best when it has a pre-existent form upon which it can operate. 12
13 ARCHITECTURE & DISCOVERY Architecture is the description of the intrinsic relationships, characteristics and behaviors of the system under study All systems have an architecture intentionally architected or not and that architecture is a primary determinant of the system s behavior. Brad Mercer, MITRE Principal Architect Architecture is the model in Modeling and Simulation and a rigorous and well-constructed model can be executed Discovery: the process for identifying the conceptual syntactic of architecture and the rich semantics Present architecture efforts are neither semantically complete nor rich: they contain a series of model artifacts (products) built and limited to labeled components and relationships; it has no processes, only product templates
14 Taxonomies of Primitives Indexing and clustering builds initial identification and organization of labeled themes and concepts Clusters are labeled taxonomical elements Rich taxonomies can be developed from clusters Structured and organized categorization of information Syntactic and semantic descriptions Parent child relationships Labeled themes and concepts are the architecture primitives
Topologies in Domains (information, behavioral, functional) 15 Topology in architectures relates to the connectedness of child child with order of precedence and importance object references contain topological reference information useful in describing and identifying the syntactic and semantic elements The taxonomical and topological elements provide the structure and precedence of concepts and their references provide the content for specification
Persistence (Primitives) and Re-use (Encapsulations) 16 To be Persistent, the model must decompose to its fundamental components, its primitives. Activity Rules x Consumed Data or Message State Activity y Produced Data or Message IDEF0 MODELS mix component information and concerns and are a visualization standard, not a data standard. Aggregation y = f(x) Op At a Node Node For a Given State According to a set of rules To be Re-useable, the model must encapsulate its fundamental components, or primitives into re-useable Objects.
17 Enterprise Decomposition by Echelon x Rul e 1 f(x) Oper Node A y x f(x) Rul e 1 f(x) f(x) f(x) 1.De-confliction of meta-model components to remove mixing of concerns 2.Encapsulation represents the statement of a gestalt. 3.Incremental instances of encapsulation represent Rules and States. 4.Decomposition is a basic principle of Architecting and Engineering Oper Node A.c Oper Node A.a Oper Node A.d Oper Node A Decomposition Oper Node A.b f(x) Decomposition f(x) 1. Decomposition is Echelon by Echelon: as two separate synchronous taxonomies 2. Functional Decomposition is done with IDEF0, and the Operational Node Decomposition is done synchronously to this 3. Inputs-Output of the IDEF 0 Model and their mapping to the Node Model are the Flow Model. These Inputs-Outputs are the Elements that provide topological reference, precedence of function and critical exchange information for interoperability concerns 4. This process PROVIDES THE RIGOR for the architecture primitives. y
18 View Relationships: Simplified Calculus KSA BILLET PERSONNEL /ORGANIZATION Activity NODE TRAINING A KSA done at a Billet produces an Output DOCTRINE An Activity done at a Node produces an Output System Function System MATERIEL / FACILITY A System Function done at a System produces an Output
19 DISCOVERY ENABLED ARCHITECTURE SPECIFICATION Document information objects describe the taxonomy and topology of architecture primitives and relationships Integration is accomplished using the principles and practices of a tightly coupled discovery-based architecting process Indexing and Clustering provide navigation to the authoritative and original sources for descriptions of the information objects Clustering, using these descriptions, iteratively refines and extracts more relevant information objects This enables the Synthesis of Form Discovery described Architectures enables the development of Rigorous, Semantically complete Architecture Specifications, i.e., engineerible requirements This enables the Analysis of Function
20 QUESTIONS Advantage Development, Inc. Michael R. Collins 440-808-1250 Office 216-570-8775 Cellular