Quality Assurance. Monitoring

Transcription

1 Quality Assurance State and Local Level Monitoring National DOE Conference New Orleans, LA December 14, 2011 Hoyt O Brien Wisconsin Division of Energy Services 1

2 ARRA Monitoring Staffing Wisconsin Quality Assurance Division Staff Section includes; Two Administrative Review positions. Six On-site and file review positions. Multi-family unit monitor. Subcontracted inspections. Davis-Bacon monitor. Additional desk monitoring and support staff. 2

3 3

4 Performance July 2009 March 2011 Grantee Expenditures Total (All Funds) = $190,884,840 ARRA = $113,903,188 Production Total = 23,313 (16,247 Mar 10 Mar 11) ARRA = 17,036 4

5 Total ARRA through October 2011 Total ARRA Expenditures through October 31, 2011 which includes the October invoices from the grantees and A&E s was $133,653, (94.45%) of ARRA funds expended As of 1:15 p.m. on Wednesday, November 16, 2011 we now have 20,816 ARRA units complete!!!!! We have exceeded our goal 5

6 Overview of Production Since beginning work on the American Recovery and Reinvestment Act, Wisconsin Weatherization subgrantees completed nearly 21,000 ARRA units and over 2,000 non-arra units. 6

7 Monitoring All That Work To meet the Federal and State mandates for Quality Assurance Wisconsin Quality Assurance monitors and subcontractors completed 3000 on-site unit inspections several hundred file reviews and 21 administrative i ti reviews 7

8 You gotta have some tools 8

9 Cameras Infrared digital 9

10 combustion analyzer 10

11 Ladders 11

12 Blower doors 12

13 13

14 Tape measure Battery powered drill High temp caulk Screwdrivers Smoke generator Tool bag Pressure gauge Test hole plugs 14

15 Additional Important Tools Weatherization Field Guide Weatherization Manual Technical Assistance Training Help Desk 15

16 Trainings and Certifications Effectiv e Complaint Resolution Deferral of Service - New Developing & Implementing Effective Presentations (Train-the-Trainer) Asbestos O&M Training for DES Staff - New State Procurement Training Understanding Boiler Systems Monitoring Weatherization Assistant Working with the Electronic Diagnosti c Workbook Wisconsin Weatherization Manual Multi-family Policy & Reporting Component Classroom Deferral of Services Policies Team Building Coaching & Retaining Staff The Manager's Dilemma: Do I Manage the Work or the People Inventory Management State & Federal Requirements Subcontractor Management Procurement Success from Start to Finish Federal Fiscal Requirements & Davis-Bacon OSHA Basics for Managers WI WX Asbestos Draft Policy Roundtable Discussion - New Session Component Roundtable Discussions Managing Systems I (data, purchase orders, timesheets) & Managing Systems II (equipment, vehicles) Working with the Weatherization Guidebook Mobile Home WisWAP Data Entry New Worker WisWAP Data Entry Advanced WisWAP Reporting for Management WisWAP Training Topic TBD Wx Auditor/Inspector Guide Review 12 Acts of Courage to Change Meetings for Weatherization Assistant Update Good Weatherization Assistant Software Update FY12 Keeping Morale High During Difficult Times Working on a Team for Auditors & Inspectors On-the-Job Ethics (Management perspective) 16

17 Dozens of trainings 100 s trained Asbestos Management Planner Asbestos Inspector Project Timeline Management Planning for End State Component Classroom w/field Basic Energy Auditor Intermediate Energy Auditor Final Inspector Training Lead Renovator Lead to Renovator Refresher Asbestos O&M Asbestos Supervisor/Contractor Initial Weatherization Refresher Mobile Home Weatherization Installing Ventilation Systems Spray Foam in Weatherization Understanding Boilers Mold Awareness Forced Air Heating System Testing & Diagnosis OSHA Construction Voluntary 30 hr Certificate (including combustion safety) OSHA Construction Voluntary Mobile Home Energy Auditor Training Component Classroom w/field Component Classroom w/computer Lab Weatherization Boot Camp Weatherization Assistant Beginner Infrared Scanning Weatherization Assistant Intermediate Mobile Home Weatherization (regional field) Weatherization Assistant Multi-family Targeted Densepack Insulation WI Wx Installer Field Guide Review Distribution System Testing & Sealing Basic Diagnostics (Blower door, WCD, etc.) Advanced Diagnostics (ZPD) WCD, Water Heater Draft, Zone Pressure Diagnostics 17

18 Reporting Tools WisWAP Customer information Action dates Application Energy Audit Final Inspection Invoice date Measure costs Unit counts Average costs Quality Assurance Reporting Database Selection of homes to inspect Inspection results by measure Tracking of inspected units Inspector statistics 18

19 19

20 20

21 21

22 22

23 23

24 24

25 25

26 26

27 27

28 28

29 Why do we monitor? 29

30 Nice Even Insulation 30

31 Well Done Knee Wall Attic 31

32 Good Lead Safe Work 32

33 Outside too 33

34 Good CFL Selection 34

35 Good Lead Safe Work Photos 35

36 More 36

37 Mobile Home Repair and Insulation 37

38 Well Sealed Filter Cover 38

39 Good Air Sealing 39

40 Why Do We Monitor? What were they thinking? 40

41 41

42 42

43 43

44 44

45 Looks Good From Here 45

46 How Do You Remove the Cover? 46

47 Poor Furnace Set Up 47

48 Missed Bypass 48

49 Soffit Bypass 49

50 Missed Slope 50

51 Agencies are required to have proper documentation in files required photos in the file Refrigerators/Freezers Doors & Windows for replacement LSW ensure forms are filled out accurately and completely. Blower door/combustion safety/zpd Heating system checklists 51

52 Poor Heating System Checklist List not checked off No measured input No static ti pressure No SSE test 52

53 Missing DTL Calculations 53

54 No Appliance Test Data 54

55 Administrative Monitoring Administrative Review Questionnaire File Review Checklist Procurement Review Checklist 55

56 56

57 57

58 Most important. Crews Contractors Management of installers Tools, training, compensation 58

59 Technical Assistance Pilot Review local agency history. Complete fact finding agency visits. Identify areas of concern and identify areas of strength. th Determine best methods to strengthen agencies. Transfer knowledge, skills and best practice. 59

60 PLAN GOAL Improve the consistency and quality of work in the weatherization program by providing technical assistance (TA) to weatherization agencies and subcontractors. 60

61 Strategy The needs of each agency will be assessed based on past and future Quality Assurance (QA) inspections and Administrative Reviews as well as targeted reviews of agency files for compliance with program standards. Agencies will also be invited to ask for TA for self-identified needs. QA will work with the Policy Team to improve measures and their descriptions. 61

62 measurement of success improved passing ratios for agencies on QA inspections improved performance on Administrative Reviews reduced help desk calls reduced d customer complaints 62

63 Wisonsin Quality Assurance Hoyt K. O Brien Quality Assurance Manager State of Wisconsin Division of Energy Services Heat@wisconsin.gov hoyt.obrien@wisconsin.gov 63