Defense Cost and Resource Center The Defense Cost and Resource Center: An Update

Transcription

1 Defense Cost and Resource Center The Defense Cost and Resource Center: An Update Ronald Lile 40 th DoDCAS February 2007

2 We need good data reporting!! Acquisition Executives need to make decisions based on actual experience 2

3 DCARC Mission & Objectives Mission To collect historical Major Defense Acquisition Program cost and software resource data and make those data available for use by authorized government analysts to estimate the cost of ongoing and future government programs, particularly DoD weapon systems. Objectives Make CSDR reporting as inexpensive and least disruptive as possible for contractors. Provide wide availability of CSDR data to legitimate government users. Maintain integrity and accuracy of data collected. Improve quality of data reported by industry. Primary Objective: Ensure that DoD cost estimates provided to senior management reflect as accurately as possible DoD s experience 3

4 Actual Contractor Cost Data Provides basis of cost estimates of future systems Long and painful DoD experience has shown that actual cost of producing systems are, by far, the best basis for cost estimates To be useful for this purpose, definitionally consistent historical data are needed CCDRs are DoD s only systematic mechanism for capturing actual data 4

5 Software Resource Data Software is a cost driver on many systems and the DoD has little historical data upon which to base future estimates There are no data to compare estimated software cost and size with actual program results; no records of software metrics Tried and failed to match CARDs with CCDR data Software data routinely reported as red at annual DoD Cost Analysis Symposium 5

6 DCARC Goal Collect and make available data that are: Comparable (i.e., across programs) Meaningful (i.e., level of detail that provides insight) Transparent (i.e., well defined) Accurate Auditable 6

7 So where are we? 7

8 DoD 5000 Compliance 8

9 Active Programs w/caig Approved CSDR Plans & No Issues ACAT IC/ID CSDR Status Post-Dropping of Advisory Ratings Active Programs w/caig Approved CSDR Plans & Minor Issues 1 Active Programs w/caig Approved CSDR Plans & Major Issues 3 Pre-MDAP Programs Not Rated AARGM AMRAAM ADS 21" MRUUVS AWACS Upgrade AEHF** B-2 RMP C-130 AMP** ACS C-5 AMP AIM-9X CEC CH-47F AIAMD ERM ARH CH-53K COBRA JUDY APS FAB-T ATIRCM/CMWS DDG 1000 (DD(X)) CVN-21 AR/LSB JSTARS BRADLEY UPGD** E-2C REPROD EELV BMTC MEADS** C-130J F/A-18 E/F** F-22 CG(X) RMS C-17A F-35 GLOBAL HAWK** DCGS-A SIAP C-5 RERP FBCB2 GMLRS DCGS-AF VTUAV Fire Scout E/A-18G** FCS H-1 Upgrades** JNN No Action E-2D ADV Hawkeye JLENS JTRS GMR (CL 1) LBSD Programs Waived EFV LPD-17** JTRS HMS (CL 5) NGLRS EXCALIBUR MPS JTRS Joint Waveform ODSI CHEM DEMIL FMTV NAVSTAR GPS** LAND WARRIOR SR HPCM GBS NPOESS LB APACHE BLK III* STS CONNECTOR JPATS HIMARS SSGN** LCS** MIDS LVT JASSM V-22 LHA Replacement AOC-WS NAS JDAM (EMD) WIN-T MH-60R E-10 SSDS JSOW MIDS JTRS ECSS MH-60S MM III PRP JTRS AMF MM III GRP MP RTIP Programs Grandfathered MUOS NAVSTAR GPS UE B-2 EHF CVN77 P-8 (MMA) SM 2 (IV) BAMS DDG51 PATRIOT PAC-3 SSN 774 CSAR-X BMDS SBIRS HIGH T-AKE JCA SDB I JHSV SM-6 (ERAM) JPALS STRYKER JUCAS TAC TOMAHAWK Early Problems KC-X UH-60M Upgrade LUH VH-71 (VXX) WGS MPF(F) NAVSTAR GPS III NMT SDB II TSAT TOTAL PROGRAMS 126 As of January 10, Or Agreed Upon Path Forward 2- Includes Data Issues or Plan Implementation Issues 3- Includes No Progress on Data Issues or Plan Implementation Issues *-Initial Assessment **-Withhold program on a get well plan Proper CSDR Planning 9

10 CSDR Plans Approved Plans Analytical Activities CY2002 CY2003 CY2004 CY2005 CY2006 Total Plans IC ID Total IC ID Total IC ID Total IC ID Total IC ID Total IC ID Total Program Contract Subcontract Total ,042 Plans in progress Plans in Progress Plans IC ID Total Program Contract Subcontract Total As of December 31,

11 CY 2006 CSDR Plan Statistics Distribution of Plans Approved in CY Program Plans Approved Contract Plans Approved Subcontract Plans Approved Army Navy Air Force DoD Total 11

12 CY 2006 CSDR Plan Statistics- Cont d CY2006 CSDR Plans Approved 250 More than 50% of CY2006 Plans were revisions Revised New Program Plans Contract Plans Subcontract Plans 12

13 Analysis of CY2006 CSDR Plans NEW 1st Revision(R) 2nd Revision(R1) 3rd Revision(R2) 4th Revision(R3) Count (70%) 62(32%) 12(6%) 4(2%) Air Force Army Navy DoD 3 9 Aircraft Air Force Army 26 7 Navy DoD 1 9 Missile Army 18 An Example CSDR Plan Revisions Ordnance Revisions Air Force 2 2 1st 2nd 3rd 4th Navy 2 3 Missile 18 Electronics Army 18 Air Force 7 3 Javelin Jt Venture, Orlando JAVELIN Army 10 9 Raytheon, Tucson JAVELIN Navy 24 2 LMM&FC, Orlando JAVELIN DoD 2 LMM&FC, Dallas PAC-3, HIMARS GMLRS, HIMARS Space Aerojet GMLRS Air Force General Dynamics GMLRS Navy 2 Surface Vehicle Army 12 Navy 6 2 Ship Navy UAV Air Force 4 2 Navy 7 Sys of Sys Army 11 CAUSALITY: - AMCOM - EDUCATION & TRAINING - DEVIATIONS IN CWBS FROM MIL-HDBK-8881A MISSILE SYSTEM WBS - MULTIPLE PHASES PER CONTRACT - MULTIPLE VARIANTS PER CONTRACT - IMPROPER RFP PACKAGES - LACK OF PRIME-SUBCONTRACTOR-GOV'T PLANNING & POST-AWARD EXECUTION - WRONG WBSs in RFPs - LACK OF PRIME OVERSIGHT ON SUBCONTRACTOR REPORTING- 13

14 Why so many Plan Revisions? Systemic Problems- What we are doing wrong Incorrect, Incomplete & Non-Compliant WBS in RFP (e.g. NLOS-LS) Lack of CAIG-Approved CSDR Plan in RFP (JTRS SRW 1 day notice before contract award) Program Manager s & Contracting Officers uninformed/don t care about CSDR Requirements (e.g. MDA- SM-3) Prime-Subcontractor Flow-Down Requirement Deficiencies (e.g. Lockheed Martin failed to flow down requirement to Boeing on RF Missile Seeker- PAC-3) Lack of Discipline & Management Oversight by Gov t CWIPT leads (F Years of neglect lead to Resubmissions by Prime & Subs) Acquisition Reform Policies (e.g. AMRAAM, JASSM retroactive reporting) Program Unique- Normal Reasons for Revisions Restructures Contract Type Changes Make/Buy Changes Updated based on Contractor Responses 14

15 Analytical Activities Validate CSDR Submissions CCDR Metrics: CY2002 CY2003 CY2004 CY2005 CY2006 Total CCDR Reports Received CCDR Reports Validated CCDR Reports Accepted CCDR Reports Rejected Validation Rate/Yr 73% 59% 86% 100% 100% 98% Acception Rate/Yr 21% 11% 30% 47% 61% 49% SRDR Metrics: CY2002 CY2003 CY2004 CY2005 CY2006 Total SRDR Reports Received SRDR Reports Validated SRDR Reports Accepted SRDR Reports Rejected Validation Rate/Yr N/A N/A N/A 0% 100% 64% Acception Rate/Yr N/A N/A N/A 0% 18% 18% As of December 31,

16 CSDR Training Statistics CSDR Training Metrics > 1200 Students Trained # of Students Industry Gov't CY 2004 CY2005 CY2006 CY

17 DACIMS Holdings 17

18 Reports by Commodity Mil Handbook Number of Reports Aircraft Electronic/Automated Software 3507 Missile 9607 Ordnance 517 Ship 222 Space 1140 Surface Vehicle 708 System of System 9 UAV 95 Total

19 Top Aircraft Programs Program Number of Reports F F/A A EA A E-2 (Hawkeye) 583 P A UH AH

20 Current Aircraft Programs Program Number of Reports F/A AH CH F C V F EA MH H-1 Upgrades 45 E-2 (Advanced Hawkeye) 26 VH-71 (Presidential Helicopter) 20 P-8 (MMA) 8 CH-53K (HLR) 5 RAH-70 (ARH) 3 20

21 Top Missile Programs Program Number of Reports AIM-9 (Sidewinder) 1057 AIM-7; RIM-7 (Sparrow; Sea Sparrow) 973 AIM-54 (Phoenix) 707 LGM-118 (Peacekeeper) 597 AGM-84; RGM-84; UGM-84 (Harpoon) 548 AGM-114 (Hellfire) 540 FIM-92 (Stinger Basic) 441 MIM-72 (Chaparral) 434 UGM-96 (Trident I (C-4)) 376 MIM-104 (Patriot)

22 Current Missile Programs Program Number of Reports AIM-9 (Sidewinder) 1057 AIM-120 (AMRAAM) 292 LGM-30 (Minuteman III) 71 GMLRS (Guided Multiple Launch Rocket System) 64 AGM-154 (Joint Standoff Weapon (JSOW)) 55 MIM-104D (Patriot PAC-3) 26 MGM-164 (ATACMS BLOCK II) 24 NLOS-LS (Non-Line-of-Sight Launch System) 14 Extended Range Active Missile (Standard Missile-6) 10 RIM-66 (Standard Missile-2 (SM-2 MR )) 10 AGM-158 (Joint Air-To-Surface Standoff Missile (JASSM)) 8 RIM-156 (Standard Missile 2 (SM-2 ER)) 7 Joint Common Missile 6 R/UGM-109 (Tactical Tomahawk) 5 RIM-67 (Standard Missile 2 (SM-2)) 2 HIMARS (High Mobility Artillery Rocket System) 1 22

23 Top E/ASS Programs Program Number of Reports F-14 (Tomcat) 457 AH-64 (Apache) 279 B-1 (Lancer) 209 E-8 (Joint STARS) 185 Future Combat Systems (FCS) 153 F-16 (Fighting Falcon) 145 FBCB2 (FORCE XXI Battle Command Brigade & Below) 129 PLRS/JTIDS (Position Locating Reporting System/Joint Tactical Information Distribution 127 MIDS-LVT (Multifunctional Information Distribution System-Low Volume Terminal) 115 F/A-18 (Hornet)

24 Current E/ASS Programs Program Number of Reports AH-64 (Apache) 279 E-8 (Joint STARS) 185 Future Combat Systems (FCS) 153 FBCB2 (FORCE XXI Battle Command Brigade & Below) 129 MIDS-LVT (Multifunctional Information Distribution System-Low Volume Terminal) 115 CEC (Cooperative Engagement Capability) 63 Warfighter Information Network-Tactical (WIN-T) 62 F-35 (Joint Strike Fighter) 41 P-8 (MMA) 33 E-2 (Advanced Hawkeye) 27 F-22 (Raptor) 24 SSN-21 (Seawolf Submarine Combat System) 24 V-22 (Osprey) 22 JTRS Cluster 1 (Joint Tactical Radio System) 16 UH-60 (Black Hawk) 13 MP-RTIP (Multi-Platform Radar Technology Insertion Program) 12 Land Warrior 11 Cobra Judy Replacement (CJR) 9 GBS (Global Broadcast Service) 6 Electromagnetic Aircraft Launch System (EMALS) 4 24

25 Top Space Programs Program Number of Reports LS-3 (Defense Support Program (DSP)) 191 SLV-5 (Titan III) 145 NS-7 (Global Positioning System (NAVSTAR GPS)) 140 ES-8 (MILSTAR) 76 Transformational Satellite Communications System (TSAT) 69 WS-1 (Defense Meteorological Satellite Program (DMSP) 59 Advanced Extremely High Frequency (AEHF) Satellite 55 SB-5 (Titan IV) 49 SSB-7 (Inertial Upper Stage (IUS)) 47 SB-3 (Delta II) 42 25

26 Current Space Programs Program Number of Reports NS-7 (Global Positioning System (NAVSTAR GPS)) 140 Transformational Satellite Communications System (TSAT) 69 Advanced Extremely High Frequency (AEHF) Satellite 55 LS-3 (SBIRS-HIGH) 38 National Polar-orbiting Operational Environmental Satellite System (NPOESS) 30 Mobile User Objective System (MUOS) 27 EELV (Evolved Expendable Launch Vehicle) 7 ABL (Airborne Laser) 5 26

27 Surface Vehicle Programs Program Number of Reports Expeditionary Fighting Vehicle (EFV) 204 M2, M3 (Bradley Fighting Vehicle System (BFVS)/Upgrade) 194 M270 (Multiple Launch Rocket System (MLRS)) 90 M1126-M1135 (Stryker) 75 FMTV (Family of Medium Tactical Vehicles) 42 M1074; M1075 (Palletized Loading System (PLS)) 33 Future Combat Systems (FCS) 21 M1 (Abrams) 15 M6 (Bradley Linebacker) 12 HIMARS (High Mobility Artillery Rocket System) 11 27

28 Sea System Programs Program Number of Reports Littoral Combat Ship (LCS) 61 DDG 1000 (Zumwalt Class) 46 T-AKE (ADC(X) Auxiliary Dry Cargo Carrier) 26 LPD-17 (San Antonio Class) 19 FFG 7 (Guided Missile Frigate) 17 CVN SSGN (Trident) 11 SSN 21 (Seawolf Class) 6 SSBN 726 (Ohio Class Trident) 4 28

29 SRDR Holdings Number of Available Submissions Number of Available Submissions Total Number of 2630 Submissions Program B-2 RMP 1 1 C-130J 1 1 CEC Cobra Judy Replacement 1 1 DDG EA-18G 2 2 EFV FBCB FCS H-1 Upgrades 1 1 ISPAN JSF 3 3 LCS 1 1 MP-RTIP 2 2 THAAD TSAT 1 1 WIN-T Total

30 IT Systems 30

31 Public Web Site Today IT Systems Launch Pad 31

32 Today: User Registration Access of DCARC Systems requires a DCARC issued certificate. Register to Obtain a certificate Request account to access to DACIMS Request account to access to eroom Limitations Access to DACIMS is restricted to Govt only. Access to eroom areas is by MDAP. CSDR Submission Only Requires Certificate. 32

33 Today: User Registration New User Registration After you register, DCARC IT Support generates a digital certificate for you. Come back to this page to retrieve it 33

34 Today: User Registration Step 1 Request Roles: Submitter, DACIMS Access, or eroom Access 34

35 Today: User Registration Step 2 35

36 Today: User Registration Step 3 36

37 CSDR and EVM Reporting: Current Status Defense Acquisition Board CSDR EVM Metrics Summary level only EVM Cost Estimates & Analysis OSD/(AT&L) & Joint Staff Takes 3-6 months** post as of date, summary level only DoD Cost Community SERVICES **- For the Army it is 1-2 months post as of date Request DCARC CSDR Data Request PMs & Other DoD Organizations CSDR Data Data ready 15 days after receipt 75 days post as of date EVM Data: Manually entered, Summary level only Service Program Office CARS/DAMIR Joint Program Office Event-driven CSDR, 60 days post as of date, detailed Excel Industry PDF Word Paper Excel Monthly EVM, days post as of date, detailed WBS 37

38 Today: DACIMS 3.0a 38

39 Today: DACIMS 3.0a Search Button Weapon System Type (based on military designation) Program Name Model/Subsystem MIL-HDBK Category Organized around Mil Handbook, Weapon System Type, Program, and Model 39

40 Sample Search: F-22 Today: DACIMS 3.0a Info Opens page with metadata and attachment list Open Opens cost report in new window All file cabinets are accepted or historical reports and should contain DCARC memo Download Opens box with option to open/save (this will be the fastest way to download data in bulk) 40

41 Today: DACIMS 3.0a Data Record Types Folder Cabinets: typical for newer records to keep the submission components together Single files: Icon identifies file time; title describes content. Legacy TIF format (A) = Accepted (R) = Rejected (P) = Pending (H) = Historical 41

42 Today: DACIMS 3.0a Sample Data Record Detail (part 1) 42

43 Today: DACIMS 3.0a Sample Data Record Detail (part 1) 43

44 Coming Soon 44

45 DoD 5000 Compliance 45

46 Submitted for approval Policy Activities Revised CSDR Manual Revised CCDR Forms and DIDs SRDR DIDs Expect Approval by March 1, 2007 Effective April 2,

47 DoD M-1, CSDR Manual Transferred to the DCARC public web site: CSDR Plan (DD2794) format and instructions Contracting language (RFP & CDRL examples) SRDR Sample Format 1, Government Report Streamlined the Manual Deleted some background & introductory info Eliminated duplicative material, Combined Chapters 4, 5, and 6 into one Chapter (4), Processing and Reporting 47

48 DoD M-1, CSDR Manual Added pre-contract or post contract award conference Revised recurring and nonrecurring definitions Clarified reporting for undefinitized contractual actions Updated and added more detail to the CSDR Process Model in Chapter 4 48

49 CCDR Forms and DIDs Changed Progress Curve Report to its own form and DID Specified cost interrelationships among the three reports Revised recurring and nonrecurring definitions Changed the Manufacturing functional category to Manufacturing Operations Revised definitions of Tooling and Material (including subclasses) Added definition and reporting instructions for intercompany transfers Revised instructions for quantity to date Clarified reporting requirements for Initial, Interim, & Final Provided for submission of reports in XML format in addition to the Excel compatible formats 49

50 SRDR DIDs Disestablished DD Form & -3 Added sample formats Removed sample data dictionary Provided guidance on minimum acceptable set of information required in the SRDR data dictionary Added meta data fields to improve the clarity and context of the data Software functional descriptions Characterization of software development effort Software development method(s) used Cross-references to contract DD 2794 & contract WBS 50

51 SRDR DIDs Added required data fields to improve reported software size data Autogenerated code, Carryover code from previous builds, and Percent re-design, re-code, re-test (to be explained in the data dictionary) to clarify reporting of sub-contractor developed software code and sub-contractor software development effort Added optional data fields for: COTS/GOTS SW integration efforts Standardized software sizing counts via a code counting tool directed by the Government 51

52 DACIMS Holdings 52

53 Future Submissions Type Total CCDR Reports SRDR Reports Total Commodity CCDR SRDR Total Aircraft Electronic/Automated Software Missile Ordnance Ship Space Surface Vehicle System of Systems UAV Grand Total

54 Future Aircraft Submissions Program Total AB ARH C-5 RERP CH-47F CH-53K E-2C REPRO E-2D EA-18G F FA-18EF H-1 Upgrades JSF Longbow Apache MH-60R MH-60S MMA T - 45TS UH-60M V VH Total

55 Future E/ASS Submissions Program Total ADS AESA AOC-WS ATIRCM/CMWS B-2 EHF B-2 RMP CEC FBCB JLENS JTRS AMF JTRS GMR JTRS HMS JTRS SRW MIDS - JTRS 2 2 MP-RTIP MPS Total

56 Future Space Submissions Program Total AEHF EELV 2 2 FAB-T GPS MUOS NMT NPOESS SBIRS HI TSAT WGS Total

57 Future Ship Submissions Program Total CJR CVN DDG LCS LHA(R) LPD RMS SSGN SSN T-AKE Total

58 Future Missile Submissions Program Total AARGM AIM-9X AMRAAM GMLRS JASSM JSOW MM III GRP MM III PRP NLOS PAC SM SM Tactical Tomahawk Total

59 Future SV & UAV Submissions Program Total Bradley Upgrade EFV FMTV HIMARS Stryker Total Program Total Global Hawk NUCAS VTUAV Total

60 IT Systems 60

61 cpet 1.0 beta CSDR Planning & Execution Tool (cpet) Major functions: Implemented against Draft XML Schema. Development of Program / Contract plans Generates form DD2794 based on the selected program or contract. Create Responsibility Assignment Matrix. Creation and validation of 1921 and reports. 61

62 Basic Information cpet 1.0 beta 62

63 cpet 1.0 beta CSDR Planning Major Components 63

64 cpet 1.0 beta Creating the WBS, defaults to Mil Handbook 64

65 cpet 1.0 beta Block 15: Submission Events 65

66 Create DD2794 cpet 1.0 beta 66

67 cpet 1.0 beta Responsibility Assignment Matrix 67

68 Validation Example cpet 1.0 beta 68

69 Validation Example cpet 1.0 beta 69

70 Validation Example cpet 1.0 beta 70

71 CSDR and EVM Reporting: Improved Model Decisions required: 1. Location of repository 2. Single format and submission path 3. Business rules regarding data availability DoD Cost Community Request Cost Estimates & Analysis Data Defense Acquisition Board EVM Metrics OSD/(AT&L) & Joint Staff SERVICES PMs & Other DoD Organizations Data Request DAMIR Data ready 15 days after receipt 75 days post as of date EVM Data available to PMs Immediately upon receipt, days post as of date EVM Data Available via preset business Monthly EVM, days post as of date, detailed WBS Event-driven CSDR, 60 days post as of date, detailed WBS Format Excel Detailed EVM Data via Virtual Library Summary level EVM Data via Purview Industry 71

72 DACIMS 4.0 beta Limited beta test to begin Mar 2007 Organized around user functions Search CSDR FPR DCARC/OSD Review Area Integrated Web-Upload Function NOTES: Will support both certificates and CAC Submitters will need certificate AND username/password 72

73 Sample CSDR Search DACIMS 4.0 beta 73

74 DACIMS 4.0 beta Sample CSDR Search Results (contract list) Number of document meeting search criteria Organized by contract 74

75 DACIMS 4.0 beta Sample CSDR Search Results (document list) 75

76 EVM Central Repository Pilot DACIMS 4.0 Interface, Organized by User Role 76

77 EVM Central Repository Pilot Reviewer Pending Activity 77

78 EVM Central Repository Pilot Document Review Process: Document Detail 78

79 EVM Central Repository Pilot Document Review Process During review process, PM controls access to submission data. Can invite submitting contractor and support contractors to participate in review and provided comments. 79

80 Summary Actual Experience is the best predictor DCARC Tasked with collecting actual cost and software data Activities designed to Make CSDR reporting as inexpensive and least disruptive as possible for contractors Provide wide availability of CSDR data to legitimate government users Maintain integrity and accuracy of data collected Improve quality of data reported by industry Need proactive participation by CWIPT members Leads to collecting the right type of data 80