Sheriffs Child Protective Investigations

Sheriffs Child Protective Investigations PROGRAM PERFORMANCE EVALUATION REPORT Fiscal Year 09-10 Conducted by the Broward, Citrus Hillsborough, Manatee, Pasco, Pinellas, Seminole County Sheriff s Offices

TABLE OF CONTENTS INTRODUCTION... 3 EVALUATION PLAN AND DESIGN... 4 QUALITY PERFORMANCE REVIEW... 5 OUTCOME MEASURES AND STANDARDS... 5 CONCLUSIONS... 6 QUALITY PERFORMANCE REVIEW... 6 OUTCOME MEASURES... 7 RECOMMENDATIONS... 7 INTRODUCTION-PROGRAM PERFORMANCE EVALUATION... 8 SHERIFF S INVOLVEMENT IN CHILD PROTECTIVE INVESTIGATIONS IN FLORIDA... 8 PERFORMANCE EVALUATION PLAN AND DESIGN... 10 PERFORMANCE EVALUATION QUESTIONS... 10 DEVELOPMENT OF THE EVALUATION DESIGN AND PLAN... 10 SAMPLING METHODOLOGY AND SIZE... 10 QUALITY PERFORMANCE REVIEW... 11 PEER REVIEW TEAMS... 11 REVIEW INSTRUMENTS... 11 PROGRAM MANAGEMENT... 12 ASSESSING PERFORMANCE... 12 OUTCOME MEASURES ATTAINMENT... 12 MEASURES AND STANDARDS... 12 SOURCES OF DATA AND ANALYSIS METHODS... 13 QUALITY PERFORMANCE (CASE REVIEWS)... 13 MANATEE COUNTY... 15 PASCO COUNTY... 16 BROWARD COUNTY... 17 CITRUS COUNTY... 18 HILLSBOROUGH COUNTY... 19 PINELLAS COUNTY... 20 SEMINOLE COUNTY... 21 OUTCOME MEASURES ATTAINMENT... 22 ANNUAL OUTCOMES FOR COMMENCEMENTS OF REPORTS WITHIN 24 HOURS...23-31 ANNUAL OUTCOMES FOR REPORT CLOSURES WITHIN 60 DAYS...32-39 ANNUAL OUTCOMES FOR INITIAL SUPERVISORY REVIEWS WITHIN 72 HOURS...40-47 ADDITIONAL OUTCOME PERFORMANCE...48-51 PROGRAM MANAGEMENT...52-53 COST EFFICIENCY...54-55 RECOMMENDATIONS... 56 2

EXECUTIVE SUMMARY INTRODUCTION In February 2010, the Office of Program Policy and Government Accountability (OPPAGA) released a research memorandum that concluded Sheriff s Offices have advantages for conducting child abuse investigations. This OPPAGA review of costs, processes and outcomes of child protective investigations conducted by the Sheriff s Offices as compared to those conducted by the Department of Children and Families did note in part that due to their law enforcement affiliation, child abuse investigators working for Sheriffs generally have greater access to training and specialists, as well as enhanced cooperation and community respect not always afforded to DCF investigators. For those communities in Florida with a Sheriff s Office handling the responses to an abuse hotline call, OPPAGA s conclusions regarding the community deference, respect and enhanced partnerships are not surprising. From the initial pilots with Sheriff s Offices dating back over 15 years to our present day system, wherein a quarter of Florida s communities are now covered by Sheriff-driven child protective investigations, the enhanced community-based approach has thrived and become intertwined in these Sheriff-led communities. These child protection response systems integrated with Sheriff s Offices were once touted as different and innovative, but over the years they have become so integrated and interdependent within their local communities that their differently structured, efficient service delivery has become the rule and the expectation. These Sheriff-run operations are held accountable not only by the State, but also by their community systems; as a result, their balanced, comprehensive and effective integrated responses continue to be commended. Following some successful pilots in Manatee in the mid 1990 s, support for expansion came through the Florida Legislature in 1998 under House Bill No. 3217, which allowed the Department of Children and Families (DCF) to initiate an expanded model program for child protective investigative services, which involved contracting with three county Sheriffs (Manatee, Pasco and Pinellas) for FY 1998-1999. The bill also required the transfer of all the responsibilities for child protective investigations to these Sheriffs in FY 1999-2000. In 1999, Broward County Sheriff became the fourth Sheriff to assume the responsibility for child protective investigations, and Seminole County Sheriff became the fifth Sheriff in 2000. In 2005, Hillsborough County Sheriff assumed the role, and that Office was followed by the seventh Sheriff, Citrus County Sheriff, in 2007. The annual oversight for the Sheriffs was initially defined under Florida Law 98 180, which required a committee of seven persons appointed by the Governor to address Sheriffs program performance. That committee met with the respective Sheriffs and developed criteria mutually agreed upon for an annual review. The committee held the responsibility for submitting an annual report regarding quality performance, outcome- 3

measurement attainment and cost efficiency. In 2000, under Florida Law 2000-139, the committee ended and an annual report on program performance by the Sheriff s Offices was mandated, based on an annual review using criteria mutually agreed upon by the Sheriffs and DCF. This report addresses quality performance, outcome-measure attainment, and cost efficiency and is completed by a team of Peer Reviewers from the Sheriff s Offices performing child protective investigations with support from the Department. This is the 11 th Annual Sheriff Peer Review Report. EVALUATION PLAN AND DESIGN The program performance evaluation questions for this evaluation are based upon language in ss. 39.3065(3)(d), F.S. In summary, these questions are: 1. How does the quality of performance involving the Sheriff's Offices conducting child protective investigations comply with the requirements of Chapter 39, F.S.? 2. Have the participating Sheriff's Offices achieved the performance standards and outcome measures specified in their grant agreements? 3. Are the participating Sheriff s Offices performing child protective investigations in a cost efficient manner? Representatives from the seven Sheriff s Offices with support from the Department comprised the program evaluation planning team. The Sheriff Representatives were as follows: Broward County Sheriff: Capt. Andrew Koerick, Program Administrator; Joseph Paduano, Child Protective Investigation (CPI) Supervisor Seminole County Sheriff: Capt. Greg Barnett, Captain; Jay Saucer, Quality Assurance Pinellas County Sheriff: Brandi Lazaris, Program Administrator; Katie Favara, Supervisor Citrus County Sheriff: Lt. Dave Wyllie, Lieutenant; Richard Patterson, CPI Supervisor Hillsborough County Sheriff: Major Robert Bullara, Division Commander; Jennifer Hock, Program Administrator Pasco County Sheriff: Steve Blumenthal, Program Director; Fawn Moore, Asst. Program Director Manatee County Sheriff: Joyce Edick, Operations Program Specialist 4

In 2010, the planning committee adopted several changes to the Peer Review Tool. Two questions were added to the tool, and one question, relating to the completion of a form, was eliminated from the tool. DCF accepted the revisions to the Peer Review Tool. On-site reviews were scheduled for each Sheriff s Office. Reviewers from each Sheriff s Office and from DCF were present for on-site case file reviews and conducted entry and exit presentations. QUALITY PERFORMANCE REVIEW The 2010 Sheriff s Peer Review process included 2 ½ day on-site visits for each Sheriff s location. The plan developed collaboratively included case file reviews and reviews of performance measures as core components of quality performance. The 2010 process fully addressed the quality of practice standards utilizing the revised standardized review tool. The number of files reviewed at each site was determined using a statistical 90% confidence level, with a +/-10% confidence interval. For all review sites, the sample size was 65 files. Excluded from the sample were duplicate reports, institutional reports, foster care referrals, special condition reports, out of town inquiries (OTI s), and no-jurisdiction reports. The sample pulled was comprised of fifty percent (50%) reports with a judicial action and 50% non-judicial in disposition. The overall score for each Sheriff s Office includes only the results of the internal case file review and the side-by-side review, and was calculated using the Sheriff s Peer Review Access database with each file receiving equal weight in scoring. OUTCOME MEASURES AND STANDARDS Subsection 39.3065(3)(b), F.S., requires that the Sheriffs performing child protective investigations operate, at a minimum, in accordance with the performance standards and outcome measures established for protective investigations conducted by the Department of Children and Families. The General Appropriations Act sets forth appropriations for the Sheriff s Offices. These funds are allocated through multi-year Grant Agreements with the seven Sheriff s Offices performing child protective investigations. The Grant Agreements reference three performance measures, which are used to determine outcome attainment for the Sheriffs and the DCF districts/region: 1. One hundred percent (100%) of investigations commenced within 24 hours. 2. Ninety percent (90%) of investigations completed within 60 days. 3. One hundred percent (100%) of reports reviewed by supervisors in accordance with Department s timeframes. 5

These measures were amended in the Grant Agreements beginning July 2010. The 60- day closure measure was eliminated for Fiscal Year 2010-2011, but was replaced with a performance measure that tracks the timeliness of victims seen within 24 hours of a report being received by the Florida Abuse Hotline. The data for these performance measures and others are entered by users into the child-welfare information system, Florida Safe Families Network (FSFN). This system produces statewide management reports, which are used for determining statewide outcomes. CONCLUSIONS QUALITY PERFORMANCE REVIEW Sheriff s Office involvement in child protection investigations began in the mid 1990 s when calls for reform led to successful pilots that spurred legislative commitment to implement statutory changes. During this time, the Legislature also passed new statutes requiring the outsourcing of foster care and related services statewide. It was the Legislature s intent to encourage communities and other stakeholders in the well-being of children to participate in assuring that children were safe and well-nurtured in their local community. DCF moved aggressively and successfully outsourced the state s foster care and related services to community-based care lead agencies. Florida has used the community-based care philosophy, including contracting with Sheriff s Offices, to safely reduce the number of children in foster care and embrace familycentered practices when working with families. Recommendations from the Subcommittee for Children and Families to Governor-Elect Scott s Health and Human Services Transition Team, dated December 20, 2010, noted in part, that DCF under the leadership of former Secretaries Bob Butterworth and George Sheldon, and today, under Secretary David Wilkins was, widely recognized by many Floridians as the best run Department in the state. It further concluded, This leadership has been open to finding innovative solutions such as privatization, technology, and leveraging existing resources in local communities. DCF has truly leveraged well with the involvement of these Sheriff s Offices. Successful leveraging of community law-enforcement personnel and their existing resources for conducting child protective investigations continues to result in quality outcomes for protecting children and supporting families. The results of the 2010 review once again validate that effective, quality and efficient child protective investigation services are conducted by the Broward, Citrus, Manatee, Pasco, Pinellas, Hillsborough and Seminole County Sheriff s Offices. 6

OUTCOME MEASURES The performance outcomes reported in this review confirm Sheriff s Offices continue to achieve the performance outcome measures established by the Legislature. Broward, Citrus, Manatee, Pasco, Pinellas, Hillsborough and Seminole County Sheriff s Offices all achieved passing ratings in the record reviews in this year s Peer Review. RECOMMENDATIONS 1. The Department of Children and Families should continue their grants to the Sheriff s Offices in Manatee, Pasco, Seminole, Broward, Hillsborough, Pinellas, and Citrus counties to conduct child protective investigations. 2. The commendable, longstanding and successful roles that Sheriff s Offices have had in Florida for providing child protective investigative services should warrant DCF and the legislature to encourage more sheriff expansions along with corresponding funding for all of their successful operations. 3. The Department of Children and Families should continue to report on the participating Sheriff's Offices with regard to achieving the performance measures and targets. 4. The Department of Children and Families should continue involving representatives from the Sheriff s Offices in identifying appropriate practice standards and performance measures for child protective investigations. 5. The Department of Children and Families and the Sheriffs Offices should use the results of this year s quality performance review to identify and implement improvements for pre-service and in-service training of investigators and supervisors. 7

INTRODUCTION PROGRAM PERFORMANCE EVALUATION The annual oversight for the Sheriff s Offices conducting child protective investigations was initially defined under Florida Law 98-180 which required a committee of seven persons appointed by the Governor to address Sheriffs program performance. That committee met with the respective Sheriffs and developed criteria mutually agreed upon for an annual review. The committee held the responsibility for submitting an annual report regarding quality performance, outcome-measurement attainment and cost efficiency. In 2000, under Florida Law 2000-139, the committee ended and an annual report on program performance by the Sheriff s Offices was mandated, based on an annual Peer Review by the respective Sheriffs using criteria mutually agreed upon by Sheriffs and DCF. The report addresses quality performance, outcome measure attainment, and cost efficiency and is completed by a team of Peer Reviewers from the Sheriff s Offices performing child protective investigations with support from the Department. SHERIFF S INVOLVEMENT IN CHILD PROTECTIVE INVESTIGATIONS According to FSFN data, some population shifts were seen within Florida over the past fiscal year. Broward had a slight population decrease while the other Sheriff-jurisdiction counties had population increases. Overall, 27.73% of the state s children reside within a county where the Sheriff has jurisdiction for child protective investigations. Child Population Total Population % Child population % State population Total 09-10: All Initial, Additional, Special Condition Reports Reports: % State total Broward 407,694 1,751,406 9.86% 9.33% 14,086 7.47% Citrus 21,996 142,202 0.53% 0.76% 1,769 0.94% Hillsborough 298,584 1,203,245 7.22% 6.41% 11,747 6.23% Manatee 65,374 319,293 1.58% 1.70% 3,878 2.06% Pasco 89,970 440,628 2.18% 2.35% 5,658 3.00% Pinellas 171,861 927,994 4.16% 4.94% 9,789 5.19% Seminole 98,034 420,100 2.37% 2.24% 4,035 2.14% Sheriff totals 1,153,513 5,204,868 27.90% 27.73% 50,962 27.02% DCF totals 2,981,286 13,567,484 72.10% 72.27% 137,670 72.98% State total 4,134,799 18,772,352 188,632 Sources: Florida State Office of Economic & Demographic Research / [http://edr.state.fl.us/population.htm] Data on the next page reflect initial, additional, and special condition reports from Florida Safe Families Network (FSFN) reports. Report distribution across Sheriff s Offices and percent of reports received by month for initial, additional and special condition reports are presented on the following charts. 8

by Month Initial & Addls Special Condition % received Total Reports Initial & Addls Special Condition % received total Initial & Addls Special Condition % received total Jul-09 220 15 1.71% 251 854 56 7.10% 910 130 4 1.00% 134 Aug-09 291 22 2.17% 313 992 73 7.70% 1065 139 4 1.00% 143 Sep-09 289 16 2.07% 305 967 72 7.45% 1039 122 5 0.85% 127 Oct-09 286 26 2.02% 312 1,078 109 8.11% 1187 119 3 0.77% 122 Nov-09 263 17 1.97% 280 979 96 7.70% 1075 134 4 0.95% 138 Dec-09 304 14 2.15% 318 1,017 98 8.10% 1115 108 5 0.73% 113 Jan-10 262 40 2.03% 302 1,071 136 8.23% 1207 138 11 0.97% 149 Feb-10 265 53 1.99% 318 1,036 165 7.80% 1201 135 12 0.92% 147 Mar-10 430 66 2.65% 496 1,180 176 7.46% 1356 170 8 0.94% 178 Apr-10 339 57 2.12% 396 1,127 216 7.42% 1343 142 11 0.82% 153 May-10 389 61 2.39% 450 1,205 213 7.66% 1418 162 15 0.92% 177 Jun-10 272 38 1.90% 310 997 173 7.52% 1170 162 19 1.10% 181 09-10 FY Total 3,610 425 2.1% 4035 12,503 1,583 7.7% 14086 1,661 101 0.9% 1762 Hillsborough Manatee by Month Initial & Addls Special Condition % received total Initial & Addls Special Conditions % received Total Reports Jul-09 733 47 5.79% 780 272 14 2.07% 286 Aug-09 750 55 5.61% 805 269 6 1.85% 275 Sep-09 896 71 6.56% 967 302 12 2.09% 314 Oct-09 831 78 5.90% 909 297 18 2.00% 315 Nov-09 774 91 5.88% 865 263 14 1.87% 277 Dec-09 869 66 6.47% 935 258 22 1.91% 280 Jan-10 848 93 6.23% 941 287 21 2.05% 308 Feb-10 838 136 6.19% 974 304 33 2.12% 337 Mar-10 1,020 177 6.26% 1197 335 44 1.97% 379 Apr-10 938 199 6.08% 1137 331 42 1.99% 373 May-10 1,105 168 6.60% 1273 371 56 2.21% 427 Jun-10 869 156 6.34% 1025 274 39 1.89% 313 09-10 FY Total 10,471 1,337 6.2% 11808 3,563 321 2.0% 3884 Pasco Pinellas by Month Initial & Addls Special Conditions % received Total Reports Initial & Addls Special Conditions % received Total Reports Jul-09 403 18 3.12% 421 708 30 5.36% 738 Aug-09 442 24 3.19% 466 667 51 4.92% 718 Sep-09 451 26 3.21% 477 677 49 4.86% 726 Oct-09 446 26 3.03% 472 729 60 4.98% 789 Nov-09 394 28 2.95% 422 679 48 5.06% 727 Dec-09 436 24 3.10% 460 752 52 5.52% 804 Jan-10 405 25 2.82% 430 743 67 5.14% 810 Feb-10 429 38 2.92% 467 737 154 5.51% 891 Mar-10 469 39 2.62% 508 887 185 5.11% 1072 Apr-10 467 34 2.63% 501 845 135 4.93% 980 May-10 511 41 2.91% 552 837 143 4.71% 980 Jun-10 437 45 2.88% 482 735 153 5.01% 888 09-10 FY Total 5,290 368 2.9% 5658 8,996 1,127 5.1% 10123 9

PERFORMANCE EVALUATION PLAN AND DESIGN PERFORMANCE EVALUATION QUESTIONS The program performance questions for this evaluation were based upon language in ss. 39.3065(3)(d), F.S. These questions are: 1. How does the quality of performance involving the Sheriff's Offices conducting child protective investigations comply with the requirements of Chapter 39, F.S.? 2. Have the participating Sheriff's Offices achieved the performance standards and outcome measures specified in their grant agreements? 3. Are the participating Sheriff s Offices performing child protective investigations in a cost efficient manner? DEVELOPMENT OF THE EVALUATION DESIGN AND PLAN For the FY 2009-2010 Review, representatives from the Department and the Sheriff s Offices agreed to apply a revised QA review instrument. This automated instrument includes evaluation tools for the functional areas of initial response as well as emergency removal and program management. The resulting detailed case review report for each county totals an average of 130 pages with specifics on each case and summaries of each category for the overall office. Also agreed upon were sampling methodology and instrument scoring procedures. SAMPLING METHODOLOGY AND SIZE The Peer Review assesses investigative casework on the fiscal year basis. A change from calendar year to state fiscal year was made in last year s report. The investigative casework and performance outcomes are based on work from July 01, 2009, through June 30, 2010. The methodology for the quality performance component of the evaluation called for a review of closed investigation records. The definition of a closed report as used in this Peer Review is an investigation that has been completed, reviewed, signed by the investigator and supervisor, and closed in the FSFN system. As in prior reviews, reviewers considered the fact that many closed investigations were still potentially active in initial court dependency proceedings involving the investigator, with final judicial disposition outcomes not finalized. The sample size was based on the number of investigations completed during the 12- month period ending June 30, 2010. A random sample of closed child abuse reports was selected from the FSFN system from the list of reports received on or after July 1, 2009, and closed on or before June 30, 2010. The number of reports to be sampled was determined though the use of the DCF Sample Size Calculator utilizing a confidence level of 90 percent with an error rate of plus or minus 10 percent. Excluded from the sample were duplicate, institutional and special condition reports. Also excluded were reports where it was determined that there was no jurisdiction to investigate and out-of- 10

town requests (OTI s). The sample was stratified so that fifty percent (50%) of the sample consisted of reports which resulted in judicial action and fifty percent (50%) were non-judicial in disposition. QUALITY PERFORMANCE REVIEW PEER REVIEW TEAMS Subsection 39.3065(3)(d), F.S., requires that the program performance evaluation be conducted by a team of Peer Reviewers composed of representatives from the Sheriff s Offices with support from the Department. The approach to the Peer Review was originally developed by the Department s Quality Assurance program. The case review instruments used by DCF Quality Assurance were modified for this evaluation and included a program management instrument. The Peer Review process is based upon procedures similar to those used by national accreditation organizations. The definition of peer, as used in this performance evaluation, means Sheriff and Department personnel who perform protective investigations and their respective quality assurance personnel, where applicable. The criteria established for Peer Reviewers included experience in child protective investigations; certification or, minimally, completion of child protective investigative training; supervisory level staff or above, or a staff member of the Department s Quality Assurance program. In FY 2010, the Peer Review teams included participants from each Sheriff s Office and two representatives from the Department of Children and Families local Circuit Offices. The Peer Review team did not collect or analyze cost data for the cost efficiency component of this evaluation. Cost data were provided by the Department of Children and Families, based upon expenditure reports provided by each Sheriff s Office for Fiscal Year 2009-2010. REVIEW INSTRUMENTS ABUSE REPORT RECORD REVIEW The Peer Review team conducted a review of the 65 selected files. The abuse report review instrument addresses the statutory requirements for the investigator s initial response to the report of alleged child maltreatment and the emergency removal and placement of children, if this occurred. The instrument contains a number of statements or questions that address indicators used to determine how well essential steps in the investigation have been achieved. Indicators cover such areas as thoroughness of background checks, timeliness of investigations, and thoroughness of child safety assessments. In all, 22 indicators comprise the initial response and emergency removal and placement review form. PROGRAM MANAGEMENT 11

Representatives from the Peer Review Team agreed to go through the program management instrument with Citrus County Sheriff s Office since the Citrus program had been operational for only one year and never had a prior management review. The other six Sheriff s Offices were not reviewed this year in the management category, because the scores for the past several years have all been 100% in the management category for these Sheriff s Offices. ASSESSING PERFORMANCE This year, the rating on the file reviews used a four-step scale with four possible numerical scores. Ratings used were: not achieved, partially achieved, substantially achieved and achieved. Point values were assigned as follows: 0 - Not Achieved 5 - Partially Achieved 7 - Substantially Achieved 9 - Achieved Overall performance was based upon the sum of the indicator scores, divided by the maximum possible score, which produced a percentage. Using the performance categories, the derived percentages translate into the following performance levels: Passing 70-100 % Non-Passing 0-69 % OUTCOME MEASURES ATTAINMENT MEASURES AND STANDARDS Subsection 39.3065(3)(b), F.S., requires that the Sheriffs operate in accordance with the performance standards and outcome measures established by the Legislature for protective investigations conducted by the Department. Since Fiscal Year 2000-2001, the General Appropriations Act has contained three measures which apply to child protective investigations. The performance measures and standards used to determine outcome attainment for the Sheriffs and the comparison counties are: 1. One hundred percent (100%) of investigations commenced within 24 hours. 2. Ninety percent (90%) of investigations completed in 60 days. 3. One hundred percent (100%) of reports reviewed by supervisors in accordance with Department s timeframes. SOURCES OF DATA AND ANALYSIS METHODS The data for all three measures come from the FSFN management report, Leaderboard for Investigations. The report lists performance for each DCF Region and Sheriff s Office that operates a child protective investigation program. 12

The report period represents state Fiscal Year 2009-2010. The algorithms for calculating the outcome measures are those established by the Department in consultation with the Governor s Office of Policy and Budget as well as the substantive and appropriations committees of the Legislature having jurisdiction for the Department. The algorithms are as follows: The first performance measure (Investigations commenced within 24 hours): The numerator is the number of reports commenced within 24 hours of receipt of the report. The denominator is the total number of reports closed in the report period. The second performance measure (Investigations closed within 60 days): The numerator is the number of child protective investigations received during the period where the investigation completed date is within 60 days of the received date. The denominator is the total number of reports closed during the report period. The third performance measure (Child Safety Assessments or CSA) reviewed by supervisors in accordance with Department s timeframes): The numerator is the number of initial Child Safety Assessments reviewed by the supervisor within 72 hours from the time when the initial CSA was submitted for review. The denominator is the total number of reports closed in the report period. Quality Performance A summary of the performance findings is presented in the table below. The true percentages, if all reports rather than samples had been used, can be assumed with confidence to fall somewhere within plus or minus 10 percent at the 90 percent confidence level. Core components of questions within the quality assurance (QA) tool were listed under the following titled categories: Initial Response 1. Background Checks 2. Victim Contact 3. Contact with other Children 4. Interviews with Victims and Children 5. Observations of all Victims and Children 6. Interviews with Adult Subjects & Household Members 7. Indian Child Welfare Act (ICWA) 8. Relevant Collateral Contacts 9. Contact with Reporter 10. Communication Between the Investigator & Case Manager 11. Child Protection Team 12. Children s Legal Services Staffing 13. Safety Assessment Submission 14. Supervisor Review of Safety Assessment 15. Second Party Review of Safety Assessment 13

16. Completion of Supervisory Direction 17. Maltreatments 18. Investigative Summary 19. Safety Decision Removal 20. Reasonable Efforts 21. Psychotherapeutic Medication 22. Placement Priority 23. Home Study The results of the assessment on the above areas are entered into an electronic format that captures the responses of the reviewer and identifies the reviewer s assessment of each question. This allows for the site visited to receive immediate feedback at the end of the review period via a document averaging 150 pages, showing each reviewer s ratings for each question area shown above on cases assigned to the reviewer. The electronic program allows the reviewers to complete an on-site stratification of the data at the conclusion of the review. The electronic program is capable of drilling down in the data to identify specific areas of concern by pinpointing a question and then identifying the unit, supervisor or child protective investigator responsible. This allows the program administrator to take action in correcting any area of deficiency indentified within any unit, or by supervisor or investigator. Exit interviews were completed at each site with reviewers presenting trends and information on cases that they reviewed for management staff and supervisors at the site. All information discussed at the exit conferences was fully documented in the finalized report issued to the review site prior to the exit conference. 14

Manatee County Sheriff s Office Manatee site visit conducted: October 12-14, 2010 Reviewers: Joseph Paduano, Broward Sheriff s Office Jay Saucer, Seminole Sheriff s Office Richard Patterson, Citrus Sheriff s Office Cindy Harrell, Citrus Sheriff s Office Marion Tarallo, Hillsborough Sheriff s Office Kathleen Mathews, Hillsborough Sheriff s Office Dana Levy, Pasco Sheriff s Office Katie Favara, Pinellas Sheriff s Office Peggy Niermann, DCF Suncoast Region Quality Assurance Renee Gill, DCF Central Region Quality Assurance Kathy Newcomb, DCF Suncoast Region Quality Assurance Core components of questions within the QA tool were listed under the following titled categories. The overall average score at that site is listed to the right. Initial Response 1. Background Checks Average agency score 9.00 2. Victim Contact Average agency score 8.73 3. Contact with other Children Average agency score 8.65 4. Interviews with Victims and Children Average agency score 8.76 5. Observations of all Victims and Children Average agency score 8.88 6. Interviews with Adult Subjects & Household Members Average agency score 8.97 7. Indian Child Welfare Act (ICWA) Average agency score 9.00 8. Relevant Collateral Contacts Average agency score 8.64 9. Contact with Reporter Average agency score 8.88 10. Communication Between the Investigator & Case Manager Average agency score 8.66 11. Child Protection Team Average agency score 8.44 12. Children s Legal Services Staffing Average agency score 8.22 13. Safety Assessment Submission Average agency score 8.35 14. Supervisor Review of Safety Assessment Average agency score 7.50 15. Second Party Review of Safety Assessment Average agency score 8.05 16. Completion of Supervisory Direction Average agency score 9.00 17. Maltreatments Average agency score 9.00 18. Investigative Summary Average agency score 8.86 19. Safety Decision Average agency score 8.64 Removal 20. Reasonable Efforts Average agency score 8.63 21. Psychotherapeutic Medication Average agency score 8.54 22. Placement Priority Average agency score 8.29 23. Home Study Average agency score 8.57 Final Score: 96.10 15

Pasco County Sheriff s Office Pasco site visit conducted: August 17-19, 2010 Reviewers: Joseph Paduano, Broward Sheriff s Office Jay Saucer, Seminole Sheriff s Office Richard Patterson, Citrus Sheriff s Office Kathleen Mathews, Hillsborough Sheriff s Office Joyce Edick, Manatee Sheriff s Office Katie Favara, Pinellas Sheriff s Office Kimberly Williams, DCF Suncoast Region Quality Assurance Core components of questions within the QA tool were listed under the following titled categories. Additionally, the overall average score at that site is listed to the right. Initial Response 1. Background Checks Average agency score 9.00 2. Victim Contact Average agency score 7.28 3. Contact with other Children Average agency score 8.85 4. Interviews with Victims and Children Average agency score 9.00 5. Observations of all Victims and Children Average agency score 8.23 6. Interviews with Adult Subjects & Household Members Average agency score 8.82 7. Indian Child Welfare Act (ICWA)) Average agency score 8.76 8. Relevant Collateral Contacts Average agency score 8.75 9. Contact with Reporter Average agency score 8.72 10. Communication Between the Investigator & Case Manager Average agency score 8.57 11. Child Protection Team Average agency score 9.00 12. Children s Legal Services Staffing Average agency score 8.42 13. Safety Assessment Submission Average agency score 8.85 14. Supervisor Review of Safety Assessment Average agency score 9.00 15. Second Party Review of Safety Assessment Average agency score 7.71 16. Completion of Supervisory Direction Average agency score 8.69 17. Maltreatments Average agency score 8.86 18. Investigative Summary Average agency score 8.86 19. Safety Decision Average agency score 8.14 Removal 20. Reasonable Efforts Average agency score 8.48 21. Psychotherapeutic Medication Average agency score 8.25 22. Placement Priority Average agency score 8.85 23. Home Study Average agency score 8.69 Final Score: 95.79 16

Broward County Sheriff s Office Broward site visit conducted: August 31- September 2, 2010 Reviewers: Joseph Paduano, Broward Sheriff s Office Jay Saucer, Seminole Sheriff s Office Richard Patterson, Citrus Sheriff s Office Kathleen Mathews, Hillsborough Sheriff s Office Katie Favara, Pinellas Sheriff s Office Mark Holsapfel, DCF Southeast Region Quality Assurance Sharon Mitchell, DCF Southeast Region Quality Assurance Core components of questions within the QA tool were listed under the following titled categories. Additionally, the overall average score at that site is listed to the right. Initial Response 1. Background Checks Average agency score 9.00 2. Victim Contact Average agency score 8.71 3. Contact with other Children Average agency score 8.93 4. Interviews with Victims and Children Average agency score 9.00 5. Observations of all Victims and Children Average agency score 8.86 6. Interviews with Adult Subjects & Household Members Average agency score 8.88 7. Indian Child Welfare Act (ICWA) Average agency score 8.58 8. Relevant Collateral Contacts Average agency score 8.43 9. Contact with Reporter Average agency score 8.94 10. Communication Between the Investigator & Case Manager Average agency score 8.40 11. Child Protection Team Average agency score 9.00 12. Children s Legal Services Staffing Average agency score 8.56 13. Safety Assessment Submission Average agency score 8.86 14. Supervisor Review of Safety Assessment Average agency score 9.00 15. Second Party Review of Safety Assessment Average agency score 7.88 16. Completion of Supervisory Direction Average agency score 9.00 17. Maltreatments Average agency score 9.00 18. Investigative Summary Average agency score 9.00 19. Safety Decision Average agency score 8.69 Removal 20. Reasonable Efforts Average agency score 8.50 21. Psychotherapeutic Medication Average agency score 8.52 22. Placement Priority Average agency score 8.70 23. Home Study Average agency score 8.87 Final Score: 97.30 17

Citrus County Sheriff s Office Citrus site visit conducted: October 27-29, 2010 Reviewers: Joseph Paduano, Broward Sheriff s Office Jay Saucer, Seminole Sheriff s Office Joyce Edick, Manatee Sheriff s Office Kathleen Mathews, Hillsborough Sheriff s Office Dana Levy, Pasco Sheriff s Office Katie Favara, Pinellas Sheriff s Office Yolanda Ellison, DCF Central Region Quality Assurance Lance Morgan, DCF Central Region Quality Assurance Core components of questions within the QA tool were listed under the following titled categories. Additionally, the overall average score at that site is listed to the right. Initial Response 1. Background Checks Average agency score 9.00 2. Victim Contact Average agency score 9.00 3. Contact with other Children Average agency score 9.00 4. Interviews with Victims and Children Average agency score 9.00 5. Observations of all Victims and Children Average agency score 8.51 6. Interviews with Adult Subjects & Household Members Average agency score 8.91 7. Indian Child Welfare Act (ICWA) Average agency score 8.83 8. Relevant Collateral Contacts Average agency score 8.29 9. Contact with Reporter Average agency score 8.78 10. Communication Between the Investigator & Case Manager Average agency score 8.50 11. Child Protection Team Average agency score 8.97 12. Children s Legal Services Staffing Average agency score 8.51 13. Safety Assessment Submission Average agency score 8.68 14. Supervisor Review of Safety Assessment Average agency score 9.00 15. Second Party Review of Safety Assessment Average agency score 8.59 16. Completion of Supervisory Direction Average agency score 9.00 17. Maltreatments Average agency score 9.00 18. Investigative Summary Average agency score 9.00 19. Safety Decision Average agency score 9.00 Removal 20. Reasonable Efforts Average agency score 8.54 21. Psychotherapeutic Medication Average agency score 8.46 22. Placement Priority Average agency score 8.42 23. Home Study Average agency score 8.66 Final Score: 96.85 18

Hillsborough County Sheriff s Office Hillsborough site visit conducted: November 16-18, 2010 Reviewers: Joseph Paduano, Broward Sheriff s Office Jay Saucer, Seminole Sheriff s Office Richard Patterson, Citrus Sheriff s Office Joyce Edick, Manatee Sheriff s Office Dana Levy, Pasco Sheriff s Office Cindy Harrell, Citrus Sheriff s Office Katie Favara, Pinellas Sheriff s Office Beth Pasek, DCF Suncoast Region Quality Assurance Lisa Rivera, DCF Suncoast Region Quality Assurance Core components of questions within the QA tool were listed under the following titled categories. Additionally, the overall average score at that site is listed to the right. Initial Response 1. Background Checks Average agency score 9.00 2. Victim Contact Average agency score 8.64 3. Contact with other Children Average agency score 9.00 4. Interviews with Victims and Children Average agency score 9.00 5. Observations of all Victims and Children Average agency score 8.06 6. Interviews with Adult Subjects & Household Members Average agency score 8.65 7. Indian Child Welfare Act (ICWA) Average agency score 8.53 8. Relevant Collateral Contacts Average agency score 8.72 9. Contact with Reporter Average agency score 8.90 10. Communication Between the Investigator & Case Manager Average agency score 8.70 11. Child Protection Team Average agency score 8.45 12. Children s Legal Services Staffing Average agency score 8.24 13. Safety Assessment Submission Average agency score 8.55 14. Supervisor Review of Safety Assessment Average agency score 9.00 15. Second Party Review of Safety Assessment Average agency score 6.12 16. Completion of Supervisory Direction Average agency score 9.00 17. Maltreatments Average agency score 8.73 18. Investigative Summary Average agency score 9.00 19. Safety Decision Average agency score 8.34 Removal 20. Reasonable Efforts Average agency score 8.30 21. Psychotherapeutic Medication Average agency score 8.54 22. Placement Priority Average agency score 8.48 23. Home Study Average agency score 8.50 Final Score: 94.20 19

Pinellas County Sheriff s Office Pinellas site visit conducted: September 14-16, 2010 Reviewers: Joseph Paduano, Broward Sheriff s Office Jay Saucer, Seminole Sheriff s Office Richard Patterson, Citrus Sheriff s Office Kathleen Mathews, Hillsborough Sheriff s Office Dana Levy, Pasco Sheriff s Office Joyce Edick, Manatee Sheriff s Office Shawn Creney, DCF Suncoast Region Quality Assurance Selga Sakss, DCF Suncoast Region Quality Assurance Core components of questions within the QA tool were listed under the following titled categories. Additionally, the overall average score at that site is listed to the right. Initial Response 1. Background Checks Average agency score 8.67 2. Victim Contact Average agency score 6.29 3. Contact with other Children Average agency score 8.85 4. Interviews with Victims and Children Average agency score 8.89 5. Observations of all Victims and Children Average agency score 8.69 6. Interviews with Adult Subjects & Household Members Average agency score 8.97 7. Indian Child Welfare Act (ICWA) Average agency score 8.90 8. Relevant Collateral Contacts Average agency score 8.77 9. Contact with Reporter Average agency score 8.44 10. Communication Between the Investigator & Case Manager Average agency score 8.48 11. Child Protection Team Average agency score 8.80 12. Children s Legal Services Staffing Average agency score 7.72 13. Safety Assessment Submission Average agency score 6.68 14. Supervisor Review of Safety Assessment Average agency score 9.00 15. Second Party Review of Safety Assessment Average agency score 8.05 16. Completion of Supervisory Direction Average agency score 8.76 17. Maltreatments Average agency score 8.86 18. Investigative Summary Average agency score 9.00 19. Safety Decision Average agency score 9.00 Removal 20. Reasonable Efforts Average agency score 8.19 21. Psychotherapeutic Medication Average agency score 8.40 22. Placement Priority Average agency score 8.25 23. Home Study Average agency score 8.17 Final Score: 93.50 20

Seminole County Sheriff s Office Seminole site visit conducted: September 28-30, 2010 Reviewers: Joseph Paduano, Broward Sheriff s Office Joyce Edick, Manatee Sheriff s Office Richard Patterson, Citrus Sheriff s Office Kathleen Mathews, Hillsborough Sheriff s Office Dana Levy, Pasco Sheriff s Office Katie Favara, Pinellas Sheriff s Office Teresa Vella, DCF Central Region Quality Assurance Renee Gill, DCF Central Region Quality Assurance Core components of questions within the QA tool were listed under the following titled categories. Additionally, the overall average score at that site is listed to the right. Initial Response 1. Background Checks Average agency score 9.00 2. Victim Contact Average agency score 9.00 3. Contact with other Children Average agency score 8.93 4. Interviews with Victims and Children Average agency score 8.57 5. Observations of all Victims and Children Average agency score 8.97 6. Interviews with Adult Subjects & Household Members Average agency score 9.00 7. Indian Child Welfare Act (ICWA) Average agency score 9.00 8. Relevant Collateral Contacts Average agency score 8.76 9. Contact with Reporter Average agency score 8.97 10. Communication Between the Investigator & Case Manager Average agency score 8.44 11. Child Protection Team Average agency score 8.72 12. Children s Legal Services Staffing Average agency score 8.57 13. Safety Assessment Submission Average agency score 9.00 14. Supervisor Review of Safety Assessment Average agency score 9.00 15. Second Party Review of Safety Assessment Average agency score 8.14 16. Completion of Supervisory Direction Average agency score 9.00 17. Maltreatments Average agency score 9.00 18. Investigative Summary Average agency score 9.00 19. Safety Decision Average agency score 9.00 Removal 20. Reasonable Efforts Average agency score 8.88 21. Psychotherapeutic Medication Average agency score 8.63 22. Placement Priority Average agency score 7.98 23. Home Study Average agency score 8.41 Final Score: 97.27 21

Outcome Measures Attainment The performance measures used to determine outcome performance attainment for the Sheriffs are based on those measures listed within the Sheriffs Grant Agreements. Data came from the Florida Safe Families Network (FSFN) management reports generated monthly and are based on closed report information. These three measures with their statutory or agency basis are noted below: I One hundred percent (100%) of investigations commenced within 24 hours This performance measure is captured in FSFN only on reports coded in-home and institutional. The special condition reports and reports closed as duplicate or no-jurisdiction are not applicable to this measure. The performance measure is in the Sheriffs Grant Agreements. Additionally, the performance measure is based foremost on Florida Statutes, and is also referenced in administrative code. Florida Statutes ss. 39.201(5) in part states, If it appears that the immediate safety or well-being of a child is endangered, that the family may flee or the child will be unavailable for purposes of conducting a child protective investigation, or that the facts otherwise so warrant, the department shall commence an investigation immediately, regardless of the time of day or night. In all other child abuse, abandonment, or neglect cases, a child protective investigation shall be commenced within 24 hours after receipt of the report. II Ninety percent (90%) of investigations completed in 60 days This performance measure is captured only on those reports coded in-home and institutional. The special condition reports and reports closed as duplicate or no-jurisdiction are not applicable to this measure. This performance measure was in the Sheriffs Grant Agreements through the end of FY 09-10. The performance measure is based on Florida Statutes ss. 39.301(16) that states, The department shall complete its protective investigation within 60 days after receiving the initial report, unless: (a) There is also an active, concurrent criminal investigation that is continuing beyond the 60-day period and the closure of the protective investigation may compromise successful criminal prosecution of the child abuse or neglect case, in which case the closure date shall coincide with the closure date of the criminal investigation and any resulting legal action. (b) In child death cases, the final report of the medical examiner is necessary for the department to close its investigation and the report has not been received within the 60-day period, in which case the report closure date shall be extended to accommodate the report. (c) A child who is necessary to an 22

investigation has been declared missing by the department, a law enforcement agency, or a court, in which case the 60-day period shall be extended until the child has been located or until sufficient information exists to close the investigation despite the unknown location of the child. III One hundred percent (100%) of reports reviewed by supervisors within 72- hours. This performance measure is captured only on those reports coded in-home and institutional. The special condition reports and reports closed as duplicate or no-jurisdiction are not applicable to this measure. This performance measure is also a requirement in the Sheriffs Grant Agreements with DCF. The performance measure is based on Florida Administrative Code 65C-29.003(6)(b) - which states, Supervisors must review all child protective assessments and assure that safety plans are in place when needed, and that the plan appropriately addresses the identified safety threats. The review shall be completed within seventy-two hours from the time the automated assessment tool is submitted to the supervisor for review. Fiscal Year 2009-2010 Outcomes for Commencements of Reports within 24 hours This performance outcome is significant as Florida Statutes require the Department to be capable of receiving and investigating reports of known or suspected child abuse, abandonment, or neglect, 24 hours a day, 7 days a week. In FY 2009 2010, child protective investigators handled 188,632 initial and additional reports as well as special condition referrals. All of these required an initial 24-hour or immediate response. FSFN reports exclude special conditions referrals from this tracking. This excludes: child-on-child sexual abuse referrals, foster care referrals, parent unavailable referrals, and parent in need of assistance referrals. Statewide, these special condition referrals comprised approximately 16% of all intakes accepted and handled in FY 2009-2010. This is a significant increase from FY 2008-2009, when special conditions referrals totaled only 6% of the workload. The increase in special condition reports was due to a change in practice where prevention referrals previously not tracked in the computer system were, by policy, deemed to be taken as special conditions referrals during the fiscal year. If it appears that the immediate safety or well-being of a child is endangered, that the family may flee, or the child will be unavailable for purposes of conducting a child protective investigation, or that the facts otherwise so warrant, the department is required to commence an investigation immediately. In all other child abuse, abandonment, or neglect cases, a child protective investigation is to be commenced within 24 hours after report is received. 23

The abuse report commencement outcomes are based on the final closed record data from the monthly FSFN Leaderboard reports.. Fiscal Year 09-10: Percentage of Investigations Commenced within 24 Hours Sheriff / District Jul-09 Aug-09 Sep-09 Oct-09 Nov-09 Dec-09 Jan-10 Feb-10 Mar-10 Apr-10 May-10 Jun-10 District 01 99.42 99.49 98.81 99.44 99.47 99.39 99.62 99.24 98.49 99.38 99.84 99.45 99.34 District 02 98.53 99.88 99.35 98.83 99.03 99.18 98.32 98.11 98.48 97.72 98.05 98.27 98.65 District 03 99.81 98.83 99.06 98.86 98.66 99.45 99.30 98.61 99.11 99.32 99.37 98.72 99.09 District 04 99.90 100.00 99.90 99.77 100.00 100.00 99.87 99.60 99.46 99.78 99.69 99.91 99.82 District 07 99.74 99.70 99.77 99.67 99.72 100.00 99.30 99.43 99.17 99.94 99.94 99.90 99.69 District 08 99.59 100.00 99.81 99.69 99.82 99.85 100.00 99.66 98.93 99.49 99.37 99.17 99.62 District 09 99.28 99.68 99.53 100.00 99.72 99.76 99.86 99.58 98.79 99.73 99.20 99.08 99.52 District 11 99.53 100.00 99.88 99.60 99.35 99.48 99.75 98.88 99.51 99.57 99.69 99.53 99.56 District 12 99.49 99.69 99.85 99.58 99.85 99.74 98.85 99.11 99.46 99.32 99.57 99.46 99.50 District 13 99.88 99.85 99.41 99.87 99.86 99.88 99.37 99.85 98.91 99.48 99.77 99.63 99.65 District 14 99.50 100.00 100.00 99.52 99.47 99.45 99.84 98.40 98.93 99.38 100.00 99.56 99.50 District 15 99.73 100.00 99.36 100.00 100.00 100.00 99.04 99.70 100.00 99.76 100.00 99.49 99.76 Suncoast District 100.00 100.00 99.50 99.06 99.55 99.45 100.00 98.75 99.56 99.59 100.00 99.66 99.59 DCF Average 99.57 99.78 99.56 99.53 99.58 99.66 99.47 99.15 99.14 99.42 99.58 99.37 99.48 Broward Sheriff 99.67 99.37 99.51 99.45 99.20 99.90 99.56 99.13 99.61 99.47 99.71 99.73 99.53 Citrus Sheriff 100.00 100.00 99.17 100.00 100.00 97.92 100.00 100.00 99.25 100.00 99.28 99.32 99.58 Hillsborough Sheriff 99.42 99.30 99.21 99.36 98.72 99.13 98.64 99.56 99.02 99.16 98.79 98.77 99.09 Manatee Sheriff 99.64 99.62 99.17 99.62 99.53 98.89 98.60 99.61 100.00 98.93 99.00 99.40 99.33 Pasco Sheriff 99.12 98.96 98.77 100.00 98.74 99.47 99.43 98.90 99.76 98.77 98.90 99.34 99.18 Pinellas Sheriff 99.86 99.84 99.83 100.00 99.66 99.85 99.72 99.69 99.86 99.72 99.86 100.00 99.82 Seminole Sheriff 99.57 98.96 98.77 99.58 98.84 99.25 99.59 98.69 98.78 100.00 99.65 100.00 99.31 Sheriff Average 99.61 99.44 99.20 99.72 99.24 99.20 99.36 99.37 99.47 99.44 99.31 99.51 99.41 DCF Average 99.57 99.78 99.56 99.53 99.58 99.66 99.47 99.15 99.14 99.42 99.58 99.37 99.48 Sheriff Average 99.61 99.44 99.20 99.72 99.24 99.20 99.36 99.37 99.47 99.44 99.31 99.51 99.41 State Average 99.58 99.66 99.43 99.60 99.46 99.50 99.43 99.23 99.25 99.43 99.48 99.42 99.46 Fiscal Year For Fiscal Year 2009-2010, the Sheriff s Offices averaged 99.41% - an improvement over FY 2008-2009 (99.37%) on commencements within 24 hours. The average for DCF districts was 99.48%, also an improvement over FY 2008-2009 (99.23%). The statewide average for FY 09-10 was 99.46%. 24