Information Technology and the New Threat Environment

Transcription

1 Warfighter Performance S&T Visionary Research: Human Robot Interaction Information Technology and the New Threat Environment Dr. Terry Allard ONR34 Department Head Warfighter Performance S&T 4 Feb 2015 DISTRIBUTION STATEMENT A. Approved for public release

2 Code 34: Warfighter Performance S&T Dept. N84M NRL Chief of Naval Research Executive Director ACNR AVCNR PMR -51 ONRG Vice Chief of Naval Research BIZOPS Comptroller Office of Research (03R) Office of Technology (03T) Code 30 Expeditionary Warfare & Combating Terrorism Code 31 C4ISR Code 32 Ocean Battlespace Sensing Code 33 Sea Warfare & Weapons Code 34 Code 34 Warfighter Performance Warfighter Performance Code 35 Naval Air Warfare & Weapons DISTRIBUTION STATEMENT A. Approved for public release 2

3 Code 34 s Mission Enhance warfighter effectiveness and efficiency through bioengineered and bio-robotic systems, medical technologies, improved manpower, personnel, training and system design. DISTRIBUTION STATEMENT A. Approved for public release 3

4 ONR34 Leadership of Naval S&T Strategy Focus Area Assure Access to Maritime Battlespace Autonomy & Unmanned Systems Electromagnetic Maneuver Warfare Expeditionary & Irregular Warfare Information Dominance - Cyber Platform Design & Survivability Power & Energy Power Projection & Integrated Defense Warfighter Performance DISTRIBUTION STATEMENT A. Approved for public release 4

5 Warfighter Performance STRATEGIC DRIVERS: Rising personnel costs & force reductions Complex manning requirements Challenging operational environments OBJECTIVES: Efficient Manpower, Personnel, Training, and Education Systems Effective Human Systems Design & Decision Support Useful Bioengineered Systems Improved Warfighter Health and Survivability DISTRIBUTION STATEMENT A. Approved for public release 5

6 ONR34 Points of Contact ONR34 Warfighter Performance S&T Department Head Dr. Terry Allard ONR341 Human & Bioengineered Systems Division Dr. Dr. John Tangney ONR342 Warfighter Protection & Applications Division CAPT Buhari Tony Oyofo ONR343 Research Protections Division Mr. Terrence Clemmons DISTRIBUTION STATEMENT A. Approved for public release 6

7 FOCUS AREAS: Warfighter Performance Autonomy and Unmanned Systems Human Robot Interaction ADDRESSES FUTURE NAVAL CHALLENGES: Peer-to-peer human-to-machine interaction in naval task domains Supervisory control of autonomous systems to reduce warfighter cognitive load Enable trust in autonomous systems Ability to train robotic systems for complex tasks Navy combat damage recovery mandates robot firefighting Affordable inspection and maintenance RECENT SUCCESSES: Shipboard autonomous firefighting robot (SAFFiR) demonstration of fire suppression Natural language dialogue with mobile robots Human training of robot manipulation DISTRIBUTION STATEMENT A. Approved for public release 7

8 Basic and Applied Thrusts Social Networks & Computational Social Science Socio-cultural research, visualization and modeling of human security issues, terrorism, crisis and disaster situations / environments Decision support technologies for managing novel, diverse information streams for operational needs in crisis, disaster and conflict operations. 7 Universities 2 National Labs 4 Small Business Research initiatives IMPACT Research has driven REQUIREMENTS at USASOC and SOCOM Ongoing partnerships in EDUCATING NAVY OPERATORS at NPS Transition of technical approaches SOCOM social media fusion cell at NGA DISTRIBUTION STATEMENT A. Approved for public release 8

9 Human Robot Interaction Dr. Thomas McKenna Program Officer Code Feb 2015 DISTRIBUTION STATEMENT A. Approved for public release

10 Hybrid Force Warfighters and Autonomous Systems Working as Teams Objective: Human-level Machine Intelligence for Autonomous Systems Peer-to-peer, human-to-machine interaction, and high levels of autonomous behavior in highly dynamic and complex battlespaces. Humanoid Shipboard Robotics Firefighting First responder Inspection and maintenance Shipboard Autonomous Firefighting Robot (SAFFiR) Computational Cognitive Science Cognitive architectures Natural language dialogue Social cognition Moral decision-making Future Impact: Minimally supervised, easily tasked autonomous vehicles, robots and systems Natural, intuitive control interfaces Enhanced overall system performance with human-robot teams DISTRIBUTION STATEMENT A. Approved for public release 10

11 Warfighter Interaction with Autonomous Systems: From Tele-operation to Supervisory Control Remote Operator Mission Assignment Remotely Supervised Autonomous Vehicles Science & technology topics: Gesture and natural language dialogue with autonomous systems Future: Supervise Mission Assign Tasks Communicate Status Situational Awareness Mission Execution Communicate Status Common representation of plans and goals Embedded cognitive architectures to support highlevel tasking and push-back on plans Goal: To develop human-centric autonomous systems that are compatible with human cognitive, attentive, and communication capabilities and limitations. DISTRIBUTION STATEMENT A. Approved for public release 11

12 Computer Display Interfaces Grow in Complexity with Advanced Robotics: Shown: MIT team at DARPA Robotic Challenge operating Atlas Robot with 10 displays, multiple operators with doctorate degrees Computer display interfaces continue to grow in complexity with dexterous robot capabilities. Simpler interfaces are needed for small warfighter teams. DISTRIBUTION STATEMENT A. Approved for public release 12

13 Collaboration Between Humans and Machines via Mental-State Attribution Representing and reasoning about the mental states of teammates, adversaries and others Cognitively Compatible Interfaces Natural language dialogue Gesture Human-like learning Inferring intentions Moral cognition Trust DISTRIBUTION STATEMENT A. Approved for public release 13

14 Training Robotics for Complex Skills Description: 1. Robots learning complex tasks via goal-based imitation from human teacher 2. Developing neurocognitive models of mental simulation Naval Need: Easily trainable intelligent systems for: Vehicle/humanoid autonomy Software agents Impact: Reduced requirement for robot programming through learning from demonstration and instruction Development of a principled framework for unifying low-level sensorimotor & high-level cognitive computation. Socially Intelligent Machines Lab, Georgia Institute of Technology Significant impact to all autonomous systems seeking to move beyond tele-operation DISTRIBUTION STATEMENT A. Approved for public release 14

15 Robot Controller Learns Procedures by Observing a Demonstrator Imitation Learning-Based on Internal Simulation Cognitive level: Sensorimotor level: mental simulation forward, inverse models Robot Imitator Human Demonstrator Reggia, Gentili, Gupta, Nau U Maryland (ONR BRC) DISTRIBUTION STATEMENT A. Approved for public release 15

16 Learning dexterous movements involving fluid manipulation is very challenging Learning Dexterous Movements from Human Error Recovery Methods used by human demonstrators to recover from errors guide robotic imitation learning Reggia, Gentili, Gupta, Nau U Maryland (ONR BRC) Dynamic fluid pouring task DISTRIBUTION STATEMENT A. Approved for public release 16

17 Training Based on Shared Mental Models Objective: Enable experts to easily train robots through learning algorithms and interfaces 1. Use hierarchical task networks (HTNs) HTNs are computationally more tractable and more intuitive for interaction with non-programmers 2. Apply collaborative discourse theory To design a natural and effective human-robot interaction based on shared mental models between the human teacher and robot learner Framework for collaborative dialogue between human teacher and robot learner 3. Develop attributive motion planning Motion planner returns attributes, such as cost and reliability, of alternative plans Rich, Berenson, Chernova, Sidner WPI (ONR BRC) DISTRIBUTION STATEMENT A. Approved for public release 17

18 Robot Maintenance Task Simulated car maintenance environment with PR2 robot is easily understandable proxy domain for naval inspection and maintenance attributive motion planner First example task: tire rotation DISTRIBUTION STATEMENT A. Approved for public release 18

19 Embodied Turn Taking for Robots Human-to-robot collaboration in shared workspace requires turn taking Bottlenecking resources Conversational floor Shared object or physical space Multimodal process Speech, gesture, gaze Reciprocal behavior Balanced give and take Fluency Andrea Thomaz Georgia Tech DISTRIBUTION STATEMENT A. Approved for public release

20 Shipboard Robotics Navy-wide workshops on shipboard robotics at NSWC Carderock identified firefighting and damage control as priority opportunities Drivers for autonomous shipboard firefighting: Navy combat damage recoverability mandates Reduced shipboard manning on new ships Manning minimum limited by damage control needs Protect naval personnel from hazardous conditions: Human firefighters can only perform for 15 minutes due to heat, radiation, smoke and steam Humans susceptible to toxic gases DISTRIBUTION STATEMENT A. Approved for public release 20

21 Humanoid Robot Design Is Well-Suited to Shipboard Environments Shipboard environments are designed for the human form Humanoid robots can effectively navigate and interact with the environment, such as surmounting obstacles and utilizing existing fire fighting tools and protection Legged locomotion is more readily shielded from heat due to the discontinuous nature of its contact with the ground Humanoids are more adaptable to future applications such as damage control, shipboard monitoring, and maintenance tasks Jerry Pratt, IHMC DISTRIBUTION STATEMENT A. Approved for public release 21

22 SAFFiR Shipboard Autonomous Firefighting Robot Damage Control for the 21 st Century (DC-21) Smart Sensors in spaces for alerts Microflyer mapping Human-robot firefighter teams Concept developed with John Farley, Susan Rose-Pehrsson, Naval Research Laboratory CNR-Leap Ahead and Swampworks SAFFiR Robot Dennis Hong & DISTRIBUTION STATEMENT A. Approved for public release Brian Lattimer VA Tech 22

23 Humanoid Robotics: SAFFiR Shipboard Autonomous Firefighting Robot Description: Develop humanoid robot system technologies and components Develop interfaces that enable natural human-robot partnering Demonstrate technologies in humanoid and human-robot tasks Naval Need: Force multiplier for physical indoor tasks: Shipboard firefighting First responder for CBRNE Ship survey and pipe/hull inspection Roaming watch FY14 Accomplishments: Novel hip and knee designs based on human to maintain mechanical advantage SAFFIR (ONR) & THOR (DARPA) completed THOR-OP competed in DARPA Robotic Challenge SAFFIR successful fire suppression demonstration aboard ex-uss Shadwell Impact: Shipboard maintenance, safety and damage control Increased robustness to combat damage: Anticipatory performance Reduced human risk Future Plans: Integrate natural language dialogue and gesture human interfaces with robots Design of affordable, human safe humanoid robot DISTRIBUTION STATEMENT A. Approved for public release 23

24 Successful SAFFiR Fire Suppression Demonstration Successfully demonstrated SAFFiR robot fire suppression capability aboard ex-uss Shadwell in November 2014 Shipboard navigation of quadrotor in smoke and localization of fire DISTRIBUTION STATEMENT A. Approved for public release 24

25 Inspection Tasks Roving watch and inspection for maintenance Avoids costly maintenance and inspection Relieves sailors from low skill tasks Robot learns ship spaces autonomous navigation in emergency DISTRIBUTION STATEMENT A. Approved for public release 25

26 New Affordable Robot Designs Affordable, maintainable, stowable humanoid robots Safe for human contact via compliant limb control Dennis Hong DISTRIBUTION STATEMENT A. Approved for public release UCLA 26

27 Hybrid Force Warfighters and Autonomous Systems Working as Teams Objective: Human-Level Machine Intelligence for Autonomous Systems Peer-to-peer human-machine interaction High levels of autonomous behavior in highly dynamic and complex battlespaces Humanoid Shipboard Robotics Mission-capable, affordable robots On-board perception and intelligence to enable autonomy, natural language dialogue, and human training on complex tasks Dialogue enables trust Social cognition to infer goals and intentions and support collaboration with humans SAFFIR Ship-board Autonomous Fire-Fighting Robot Future Impact Minimally supervised, easily taskable autonomous vehicles, robots & systems Cognitively-compatible control interfaces DISTRIBUTION STATEMENT A. Approved for public release 27

28 Information Technology and the New Threat Environment Dr. Rebecca Goolsby Program Officer 4 Feb 2015 DISTRIBUTION STATEMENT A. Approved for public release

29 Basic and Applied Thrusts Social Networks & Computational Social Science Socio-cultural research, visualization and modeling of human security issues, terrorism, crisis and disaster situations / environments Decision support technologies for managing novel, diverse information streams for operational needs in crisis, disaster and conflict operations. 7 Universities 2 National Labs 4 Small Business Research initiatives IMPACT Research has driven REQUIREMENTS at USASOC and SOCOM Ongoing partnerships in EDUCATING NAVY OPERATORS at NPS Transition of technical approaches SOCOM social media fusion cell at NGA DISTRIBUTION STATEMENT A. Approved for public release 29

30 The Human Security Domain Has Changed INFORMATION is a CHEAP, increasingly DANGEROUS WEAPON France 2015 Nigeria 2014 India 2008 Ukraine 2014 Norway 2011 ISIS DISTRIBUTION STATEMENT A. Approved for public release 30

31 The Social Innovations The Technical Layer Cell phones, tables, computers, clouds, platforms, apps, etc. The Socio-Technical Layer The Social Layer The world of face to face relationships Smart Crowds DISTRIBUTION STATEMENT A. Approved for public release 31

32 The Positive Uses of Twitter CRISIS RESPONSE Disaster relief Humanitarian Assistance Crisis monitoring PROMOTES: - Order and discourse - Cooperative behavior - Information sharing COMMUNITY DIALOGUE Anti-propaganda Rumor squelch Outreach PROMOTES: - Discussion expansion - Spread of verifiable information Goals: Improve DISASTER OPERATIONS Improve COMMUNITY ENGAGEMENT DISTRIBUTION STATEMENT A. Approved for public release 32

33 INFLUENCE Propaganda Rebellion cry Hate speech The Negative Uses of Twitter From 2011 onward, ONR researchers began to see INCREASING USE of Social Media for NEGATIVE effects PROMOTES: - Points of view - Bandwagon effects - Conflict and argument - Mass protests SOCIAL CYBER-ATTACK Crowd manipulation Hysteria propagation PROMOTES: - Rumor Escalation - Confusion - Violence - Chaos How would These IMPACT NAVY MISSIONS? Goolsby, Rebecca On Crowdsourcing, Cybersecurity and Social Cyber-Attack Woodrow Wilson Common Labs, Memo #1. DISTRIBUTION STATEMENT A. Approved for public release 33

34 The New Information Environment ONR realized early on that NEW TECHNOLOGIES and NEW SOCIAL BEHAVIORS would TRANSFORM military operations Information from GROUND ZERO Actionable Information Analysis Centers Multi-Source Information KNOW what the CROWD KNOWS IMPROVE OODA Speed DISTRIBUTION STATEMENT A. Approved for public release 34

35 Cyber Collective Action: Saudi Women s #Right2Drive campaign YouTube link: DISTRIBUTION STATEMENT A. Approved for public release 35

36 Deception / Influence Detection The Social Bot / Botnet Coded programs to spread information on all kinds of social media platforms Occur in armies called botnets DISTRIBUTION STATEMENT A. Approved for public release 36

37 An example of a likely bot or a hybrid Same story repeated many times. Retweets of bot accounts Frequent tweets Odd messages that make no sense (to hide better from algorithms) In this example, the account ONLY tweets RT.Com and ActualidadRT.Com stories, nothing else. Bots are hard to find even with special tools! DISTRIBUTION STATEMENT A. Approved for public release 37

38 The SCRAAWL Project Intelligent Automation Inc. Vikram Manikonda, POC Built on successes and experiences from ONR research for the past seven years for creating actionable information for disaster and crisis response Designed to provide a big data understanding of rapid, high volume social media streams Emphasis on filtering, summarizing and visualizing data Extensible framework approach based on an updated Google Lab concept SOCOM is currently testing and evaluating DISTRIBUTION STATEMENT A. Approved for public release 38

39 New Threats / New Approaches The Evolving Threat Environment Technologies to spread (dis)information Capabilities to organize on the fly Video, Twitter and other novel propaganda methods creating / promoting crisis New Threats Recruitment for violent action via Internet Rampant rumor in complex crisis (ebola) Socially organized cyber-attacks The Structure of a Complex Information Campaign Mastering the New Information Environment - Understand New Threats - Counter Information Maneuvers - Improve Strategic Communications DISTRIBUTION STATEMENT A. Approved for public release 39

40 The Way Ahead In 2015 and beyond, this program will continued discussions, training and consultations to develop new approaches to novel threats with: Technical Transitions Demonstrations of information technologies at USASOC and like SOCOM SCRAAWL to government, Continued military and training operations and exercise research development test facilities with Naval Postgraduate School, Transition International of models engagements and information with management the Philippines, programs NATO to and Partnership Pacific Disaster for Peace Center, nations serving Pacific Command and Southern Command Marine Corps Information Operations Center to assist in development of Continued a 21 st development of new models, visualizations and data collection Century approach to information operations training and tools for disaster, conflict, and crisis operations approaches. POC: Dr. Rebecca Goolsby Rebecca.Goolsby@navy.mil Product Demonstrations are available here at the ONR Expo in the Warfighter Performance Breakout Room 209B. DISTRIBUTION STATEMENT A. Approved for public release 40