Quality Assurance State and Local Level Monitoring National DOE Conference New Orleans, LA December 14, 2011 Hoyt O Brien Wisconsin Division of Energy Services 1
ARRA Monitoring Staffing Wisconsin Quality Assurance Division Staff Section includes; Two Administrative Review positions. Six On-site and file review positions. Multi-family unit monitor. Subcontracted inspections. Davis-Bacon monitor. Additional desk monitoring and support staff. 2
3
Performance July 2009 March 2011 Grantee Expenditures Total (All Funds) = $190,884,840 ARRA = $113,903,188 Production Total = 23,313 (16,247 Mar 10 Mar 11) ARRA = 17,036 4
Total ARRA through October 2011 Total ARRA Expenditures through October 31, 2011 which includes the October invoices from the grantees and A&E s was $133,653,111.91 111 (94.45%) of ARRA funds expended As of 1:15 p.m. on Wednesday, November 16, 2011 we now have 20,816 ARRA units complete!!!!! We have exceeded our goal 5
Overview of Production Since beginning work on the American Recovery and Reinvestment Act, Wisconsin Weatherization subgrantees completed nearly 21,000 ARRA units and over 2,000 non-arra units. 6
Monitoring All That Work To meet the Federal and State mandates for Quality Assurance Wisconsin Quality Assurance monitors and subcontractors completed 3000 on-site unit inspections several hundred file reviews and 21 administrative i ti reviews 7
You gotta have some tools 8
Cameras Infrared digital 9
combustion analyzer 10
Ladders 11
Blower doors 12
13
Tape measure Battery powered drill High temp caulk Screwdrivers Smoke generator Tool bag Pressure gauge Test hole plugs 14
Additional Important Tools Weatherization Field Guide Weatherization Manual Technical Assistance Training Help Desk 15
Trainings and Certifications Effectiv e Complaint Resolution Deferral of Service - New Developing & Implementing Effective Presentations (Train-the-Trainer) Asbestos O&M Training for DES Staff - New State Procurement Training Understanding Boiler Systems Monitoring Weatherization Assistant Working with the Electronic Diagnosti c Workbook Wisconsin Weatherization Manual Multi-family Policy & Reporting Component Classroom Deferral of Services Policies Team Building Coaching & Retaining Staff The Manager's Dilemma: Do I Manage the Work or the People Inventory Management State & Federal Requirements Subcontractor Management Procurement Success from Start to Finish Federal Fiscal Requirements & Davis-Bacon OSHA Basics for Managers WI WX Asbestos Draft Policy Roundtable Discussion - New Session Component Roundtable Discussions Managing Systems I (data, purchase orders, timesheets) & Managing Systems II (equipment, vehicles) Working with the Weatherization Guidebook Mobile Home WisWAP Data Entry New Worker WisWAP Data Entry Advanced WisWAP Reporting for Management WisWAP Training Topic TBD Wx Auditor/Inspector Guide Review 12 Acts of Courage to Change Meetings for Weatherization Assistant Update Good Weatherization Assistant Software Update FY12 Keeping Morale High During Difficult Times Working on a Team for Auditors & Inspectors On-the-Job Ethics (Management perspective) 16
Dozens of trainings 100 s trained Asbestos Management Planner Asbestos Inspector Project Timeline Management Planning for End State Component Classroom w/field Basic Energy Auditor Intermediate Energy Auditor Final Inspector Training Lead Renovator Lead to Renovator Refresher Asbestos O&M Asbestos Supervisor/Contractor Initial Weatherization Refresher Mobile Home Weatherization Installing Ventilation Systems Spray Foam in Weatherization Understanding Boilers Mold Awareness Forced Air Heating System Testing & Diagnosis OSHA Construction Voluntary 30 hr Certificate (including combustion safety) OSHA Construction Voluntary Mobile Home Energy Auditor Training Component Classroom w/field Component Classroom w/computer Lab Weatherization Boot Camp Weatherization Assistant Beginner Infrared Scanning Weatherization Assistant Intermediate Mobile Home Weatherization (regional field) Weatherization Assistant Multi-family Targeted Densepack Insulation WI Wx Installer Field Guide Review Distribution System Testing & Sealing Basic Diagnostics (Blower door, WCD, etc.) Advanced Diagnostics (ZPD) WCD, Water Heater Draft, Zone Pressure Diagnostics 17
Reporting Tools WisWAP Customer information Action dates Application Energy Audit Final Inspection Invoice date Measure costs Unit counts Average costs Quality Assurance Reporting Database Selection of homes to inspect Inspection results by measure Tracking of inspected units Inspector statistics 18
19
20
21
22
23
24
25
26
27
28
Why do we monitor? 29
Nice Even Insulation 30
Well Done Knee Wall Attic 31
Good Lead Safe Work 32
Outside too 33
Good CFL Selection 34
Good Lead Safe Work Photos 35
More 36
Mobile Home Repair and Insulation 37
Well Sealed Filter Cover 38
Good Air Sealing 39
Why Do We Monitor? What were they thinking? 40
41
42
43
44
Looks Good From Here 45
How Do You Remove the Cover? 46
Poor Furnace Set Up 47
Missed Bypass 48
Soffit Bypass 49
Missed Slope 50
Agencies are required to have proper documentation in files required photos in the file Refrigerators/Freezers Doors & Windows for replacement LSW ensure forms are filled out accurately and completely. Blower door/combustion safety/zpd Heating system checklists 51
Poor Heating System Checklist List not checked off No measured input No static ti pressure No SSE test 52
Missing DTL Calculations 53
No Appliance Test Data 54
Administrative Monitoring Administrative Review Questionnaire File Review Checklist Procurement Review Checklist 55
56
57
Most important. Crews Contractors Management of installers Tools, training, compensation 58
Technical Assistance Pilot Review local agency history. Complete fact finding agency visits. Identify areas of concern and identify areas of strength. th Determine best methods to strengthen agencies. Transfer knowledge, skills and best practice. 59
PLAN GOAL Improve the consistency and quality of work in the weatherization program by providing technical assistance (TA) to weatherization agencies and subcontractors. 60
Strategy The needs of each agency will be assessed based on past and future Quality Assurance (QA) inspections and Administrative Reviews as well as targeted reviews of agency files for compliance with program standards. Agencies will also be invited to ask for TA for self-identified needs. QA will work with the Policy Team to improve measures and their descriptions. 61
measurement of success improved passing ratios for agencies on QA inspections improved performance on Administrative Reviews reduced help desk calls reduced d customer complaints 62
Wisonsin Quality Assurance Hoyt K. O Brien Quality Assurance Manager State of Wisconsin Division of Energy Services http://homeenergyplus.wi.gov/ Heat@wisconsin.gov hoyt.obrien@wisconsin.gov 63