Panel: Experiences with. Engineering in the Defense Industry. Moderator: Mary Ann Lapham, PMP, CSM

Transcription

1 Panel: Experiences with Agile for Systems Engineering in the Defense Industry Moderator: Mary Ann Lapham, PMP, CSM Principal Engineer Software Engineering Institute Carnegie Mellon University Lapham NDIA System Engineering Conference Oct 30, Carnegie Mellon University

2 Agile and Systems Engineering? Lapham NDIA System Engineering Conference Oct 30, Carnegie Mellon University

3 Agile & Systems Engineering: Software Drivers for Systems Engineering copyright Carnegie Mellon University All rights reserved. Lapham NDIA System Engineering Conference Oct 30, Carnegie Mellon University

4 Agile Teams/Systems Engineering Communication Challenges copyright Carnegie Mellon University All rights reserved. Lapham NDIA System Engineering Conference Oct 30, Carnegie Mellon University

5 Panel Discussion Diverse set of panelists Government, Industry, academia, and FFRDCs Diverse experience and views of Agile within the government Touch on challenges, successes, what works and what doesn t Lapham NDIA System Engineering Conference Oct 30, Carnegie Mellon University

6 Introductions Brian Gallagher CACI Eileen Wrubel SEI Carmen Graver USMC Rich Turner Stevens Institute Peter Christensen Mitre Lapham NDIA System Engineering Conference Oct 30, Carnegie Mellon University

7 Copyright 2013 Carnegie Mellon University This material is based upon work funded and supported by the Department of Defense under Contract No. FA C-0003 with Carnegie Mellon University for the operation of the Software Engineering Institute, a federally funded research and development center. Any opinions, findings and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of the United States Department of Defense. NO WARRANTY. THIS CARNEGIE MELLON UNIVERSITY AND SOFTWARE ENGINEERING INSTITUTE MATERIAL IS FURNISHEDON AN AS-IS BASIS. CARNEGIE MELLON UNIVERSITY MAKES NO WARRANTIES OF ANY KIND, EITHER EXPRESSED OR IMPLIED, AS TO ANY MATTER INCLUDING, BUT NOT LIMITED TO, WARRANTY OF FITNESS FOR PURPOSE OR MERCHANTABILITY, EXCLUSIVITY, OR RESULTS OBTAINED FROM USE OF THE MATERIAL. CARNEGIE MELLON UNIVERSITY DOES NOT MAKE ANY WARRANTY OF ANY KIND WITH RESPECT TO FREEDOM FROM PATENT, TRADEMARK, OR COPYRIGHT INFRINGEMENT. This material has been approved for public release and unlimited distribution. This material may be reproduced in its entirety, without modification, and freely distributed in written or electronic form without requesting formal permission. Permission is required for any other use. Requests for permission should be directed to the Software Engineering Institute at permission@sei.cmu.edu. Carnegie Mellon is registered in the U.S. Patent and Trademark Office by Carnegie Mellon University. DM Lapham NDIA System Engineering Conference Oct 30, Carnegie Mellon University

8 Experiences with Agile for Systems Engineering in the Defense Industry Brian Gallagher Senior Vice President, Operational Excellence October 30, 2013 INFORMATION DEPLOYED. SOLUTIONS ADVANCED. MISSIONS ACCOMPLISHED.

9 One Example Wanted to increase delivered capability over time Productivity Numbers: Moved from Iterative Development to Agile Period PRs/CRs Delivered Months PRs/CRs per Month 09/01/ /19/ months 532/28 = 19/Month 01/20/ /09/ months 710/12 = 59/month Additional Benefits: Reduced Wasted Development Effort Did not build things the customer did not need Reduced Rework Got it right the first time more often Lower bug rates Customer Satisfaction Increased Development Team Satisfaction Increased 9 CACI Information Solutions and Services

10 The Trouble with Terminology Agile Systems Engineering or Engineering Agile Systems? Do we want Agile or agility? When we stick the term Agile in front of everything, it means nothing: Ail Agile Systems Engineering i Agile Earned Value Agile Project Management Agile Architecture I have only made this letter longer because I have not had the time to make it shorter. - Blaise Pascal, The Provincial Letters, CACI Information Solutions and Services

11 Disciplined Agility D i s c i p l i n e H L Compliance over Mission Mission-driven Performance Slow to change or react Quick to React and Replan Repeatably late Architecture-centric Inability to change quickly Predict Outcomes Heavy reliance on CMMI Highly Collaborative Process Impedes Mission Process and Performance Balance Poor Results Activity over Progress Lack of Speed and Urgency Lack of Architectural Focus Lethargic Progress High Cost of Change Complexity Stifles Creativity Staff Burn-out Ignorance of Best Practice Methodology over Performance L Agility H 11 CACI Information Solutions and Services

12 Which Approach is Better? Traditional Approach System Context Architecture & Design Evolutionary Approaches requirements cost schedule business processes operational procedures, etc. Implementation COTS products Strongly influenced NDI by products and standards Known Rqmnts Buy, Re-use, Build, Integrate, Refresh 12 CACI Information Solutions and Services

13 Choosing the Systems Engineering Approach Dial in the appropriate amount of agility based on program characteristics, customer, team capabilities, and risk Example: Quick reaction capability drops in an evolving li operational environment versus deploying a highly reliable infrastructure Building Sandcastles Building Sandboxes Development Method Plan Driven Agile Development Method Plan Driven Agile 13 CACI Information Solutions and Services

14 What Does Agility Mean in this Context? Acquirer Developer Operational Insight Enhanced Capability User Is it enough to require developers to Go Agile? 14 CACI Information Solutions and Services

15 Software and Systems Engineering for DoD using Agile Eileen Wrubel Senior Engineer Software Engineering Institute Carnegie Mellon University Wrubel NDIA System Engineering Conference Oct 30, Carnegie Mellon University

16 Agile software/systems engineering in the DoD Lots of historical tension between these disciplines even when you don t have Agile in the mix Our research effort: how are Agile software teams interacting with systems engineering teams on DoD programs? What works? What crashes & burns? What environments are set up for success? Tech Note Agile Software Teams: How They Engage with Systems Engineering on DoD Acquisition Programs (working title) in internal review at SEI. Wrubel NDIA System Engineering Conference Oct 30, Carnegie Mellon University

17 Interaction cases we envisioned Wrubel NDIA System Engineering Conference Oct 30, Carnegie Mellon University

18 Thinking about systems engineering & Agile Wrubel NDIA System Engineering Conference Oct 30, Carnegie Mellon University

19 Do contract vehicles matter? Wrubel NDIA System Engineering Conference Oct 30, Carnegie Mellon University

20 Training and awareness at the PMO matters. ALOT LOT. Wrubel NDIA System Engineering Conference Oct 30, Carnegie Mellon University

21 Copyright 2013 Carnegie Mellon University and IEEE This material is based upon work funded and supported by the Department of Defense under Contract No. FA C with Carnegie Mellon University it for the operation of the Software Engineering i Institute, t a federally funded research and development center. Any opinions, findings and conclusions or recommendations expressed in this material are those of the author(s) () and do not necessarily reflect the views of the United States Department of Defense. NO WARRANTY. THIS CARNEGIE MELLON UNIVERSITY AND SOFTWARE ENGINEERING INSTITUTE MATERIAL IS FURNISHED ON AN AS-IS BASIS. CARNEGIE MELLON UNIVERSITY MAKES NO WARRANTIES OF ANY KIND, EITHER EXPRESSED OR IMPLIED, AS TO ANY MATTER INCLUDING, BUT NOT LIMITED TO, WARRANTY OF FITNESS FOR PURPOSE OR MERCHANTABILITY, EXCLUSIVITY, OR RESULTS OBTAINED FROM USE OF THE MATERIAL. CARNEGIE MELLON UNIVERSITY DOES NOT MAKE ANY WARRANTY OF ANY KIND WITH RESPECT TO FREEDOM FROM PATENT, TRADEMARK, OR COPYRIGHT INFRINGEMENT. This material has been approved for public release and unlimited distribution. This material may be reproduced in its entirety, without modification, and freely distributed in written or electronic form without requesting formal permission. Permission is required for any other use. Requests for permission should be directed to the Software Engineering Institute at permission@sei.cmu.edu. edu Carnegie Mellon is registered in the U.S. Patent and Trademark Office by Carnegie Mellon University. DM Wrubel NDIA System Engineering Conference Oct 30, Carnegie Mellon University

22 United States Marine Corps Agile and Systems Engineering Marriage Carmen Graver Version: 13 May 08 Unclassified

23 MC-Agile Development Process Increment X Capability Initial Release Planning Review Release 1 Release 2 Release N Release Retro Technical Reviews Release 2 Planning (R) SFR Release Retro Release Planning Release Retro Software Verification Review Operational Test Readiness Review Infrastructure Review SRR2/SFR/IR Sprint 1 UPDATE UPDATE UPDATE Continuous Integration Testing Final Hardware Review SVR (S)PDR (S)PDR Initial Infrastructure Final Hardware CDD Release Backlog Release Summary Report Release Backlog Report Release Summary Report Release Backlog Report Release Summary Report Data and Documentation Product Backlog SSS Version: XX YYY 08 Unclassified

24 MC-Agile Supporting Documentation SPRINT 0 SPRINT 1 SPRINT 2 SPRINT 3 SPRINT N 2-3 Weeks 2-3 Weeks 2-3 Weeks SEP Agile Annex SEMP Update SEMP 1 3 pages Retrospective SEMP DOORS Database Product Backlog Sprint 1 Design Sprint 2 Design Sprint 3 Design Release Design TEMP Agile Annex Sprint 1 Test Plan Program RTM Sprint 2 Test Plan Sprint 3 Test Plan Comprehensive Test Report/Plan Visibility thru Forge.Mil Continuous Feedback and Traceability Unclassified Version: XX YYY 08 24

25 Successful Marriage Lessons Learned Training at all levels is absolutely vital It s okay to raise issues It s okay to change your process Involve all disciplines up front and early Develop a common program vision Technical reviews need to be collaborative conversations All documentation must be value added Ensure that all team members have access to collaborative tools and environments Share lessons across programs Version: XX YYY 08 Unclassified

26 Lean Agile Systems Engineering in Defense Panel Richard Turner Stevens Institute NDIA SE Conference October 30, 2013 Alexandria, VA

27 The World is Changed Traditional systems engineering assumptions Requirements are predefined and generally stable Resources and technologiesare predictable and stable Values remain stable There is sufficient time to complete the work Reductionism is the best way to approach large problems Some results of these assumptions The V model and its (apparent) waterfall like flllik once through happroach Addiction to plans and schedules rather than value and solutions Focus on precision and coherence (if not accuracy) with requirements Change is seen as the enemy (along with the customer who wants it) Deep specializations in engineering Local optimization in processes and designs NDIA SE October

28 The World as Changed That was so 20th Century! In the 21st Century: System contexts have multiplied, and change in customer needs and developer solution technologies has accelerated accelerated. Requirements are less tangible, more evolving, and sometimes emergent Systems are both complex and constantly adapting Given the actual terrain has changed, we need some new mapping tools and techniques Need proof of the change? The venerable PMI has adapted (finally) V5 of the Guide to the PMBOK provides for both predictive (plan driven) and adaptive (agile) project lifecycles! NDIA SE October

29 A (Very) Few Lean and Agile Pioneers Fighter pilots John Boyd Pella Ehn Gerry Weinberg Designers Psychologists Taiichi Ohno Manufacturers Researchers Software developers Alan Shalloway Vic Basili Barry Boehm David Anderson Product developers and entrepreneurs Ken Schwaber Kent Beck Systems engineers (?) Don Reinertsen Mary & Tom Poppendieck NDIA SE October

30 Fundamental things apply Stakeholder Value based Evolution Incremental Commitment and Accountability Concurrent Multi discipline Engineering Evidence and Risk based Decisions Value, Flow Adapted from The Incremental Commitment Spiral Model Boehm, Lane, Koolmanojwong, and Turner Agility, Response ability NDIA SE October

31 Sticking Points Large scale budgeting and estimation Long lead items Operational systems of independently evolving systems Highly regulated ltddomains (e.g. defense, financial, health) Command and control environments (low trust, bureaucratic) NDIA SE October

32 Answers? There is still no Silver Bullet ICSM principles Service orientation is promising Trust is a key ingredient and often difficult to find Maybe is better than Hell, No! Patience, but not abdication Creativity and Collaboration can be better than Command & Control Santayana was hlfih half right i it s only the mistakes that you don t want to repeat, not the successes NDIA SE October

33 Questions? NDIA SE October