Child Welfare Partnership. Quarterly Report. Katharine Cahn, Ph.D., Executive Director. Marty Lowrey, LCSW, Director of Workforce Development

Transcription

1 April- June 2018 Child Welfare Partnership Quarterly Report cwpsalem.pdx.edu Katharine Cahn, Ph.D., Executive Director Marty Lowrey, LCSW, Director of Workforce Development Noor Delaughn, MBA, Director of Finance & Operations Brooke Rizor, LCSW, Director of System of Care Institute Beth Green, Ph.D., Director of Early Childhood & Family Support Research Page 0

2 Table of Contents Executive Director s Overview 2 Child Welfare Education & Training Director s Overview.3 Child Welfare Training..4 Adoptive & Foster Family Therapy Certificate Program Child Welfare Education Program 38 Self-Sufficiency Programs (SSP).40 Research and Evaluation 41 Systems of Care Training and Technical Assistance..45 Page 1

3 Executive Director s Overview Executive Director s Overview Katharine Cahn, Executive Director Overview Biennium The future of Oregon rests on the safety, stability, and well-being of all our children and families. Oregon DHS holds a major stewardship role in this future through programs in child welfare, self-sufficiency, and through the system of care partnership with the Oregon Health Authority. PSU s School of Social work also holds a stewardship role by developing the professional workforce, and professional knowledge necessary to meet these goals. Since it s founding in 1993 as the Child Welfare Partnership the partnership described in the following pages has drawn on the shared resources of both partners to implement training, research, and professional education to build good systems for children and families. The following pages capture the work of the summer quarter of the Biennium. This report will show that we have met or exceeded program goals, and have made accountable use of the trust and the public funds invested in this important Partnership. The report demonstrates a solid track record of workforce development, professional education, and research/program evaluation that assured the quality of our safety net for Oregon s vulnerable children, youth and their parents, and our support as Oregon implements new policies and practices. The following pages document things that can be counted numbers of people trained, numbers of days of trainings, and the programs and products developed and delivered. These efforts are all designed to contribute to family stability, safety, and well-being across Oregon s communities. What can t be counted is the passion, dedication, and ongoing learning as we work to promote the agency s goals related to the safe reduction of children in care, improving the equity of agency outcomes and services, developing of diverse professional leadership at all levels in the agency, a focus on integrated community and professional services and tapping family, community, and service user voice to build safe and self-sufficient families. We are also proud of our work to help the agency realize these less-quantifiable outcomes. Page 2

4 Overview of Child Welfare Training Unit Deliverables Child Welfare Education & Training Director s Overview Marty Lowrey, Director of Workforce Development In the fourth quarter of the biennium, the Child Welfare Education Program, the Adoption Therapy Certificate Program & the Child Welfare Training Program continued to provide very high levels of service delivery. Each program area was called upon in unique ways to respond to emerging needs & priorities. A strength of the Workforce Development programming is the ability to be nimble and responsive as the needs of our Child Welfare Agency change. The Child Welfare Education Program graduated 13 students this quarter, 1 BSW and 12 MSWs. Five students were from the distance MSW program increasing the availability of workers with a master s degree in our more rural areas of the state. 38% of the students represented racially or ethnically diverse identities supporting the agency s commitment to diversifying its workforce. Twenty-one applicants were interviewed for admittance into CWEP for the next academic year, 15 were accepted with 3 also being accepted into the Culturally Responsive Leaders program. The CWEP team under the leadership of its Assistant Director is preparing a matrix for the CWEP Advisory Council to consider that would help align our admittance into the program with the agency s and program s core values. The Adoption Therapy Certificate Program delivered three courses this quarter to Mental Health therapists and Child Welfare professionals: Treating the Continuum of Attachment Difficulties for Adoptive and Foster Families; Essential Clinical Interventions for Adoptive and Foster Families; and Life Story Work: A Model Recovery for Youth. These courses were live streamed allowing for statewide access and increased access to specialized training in rural areas of the state. There are currently 181 Oregon Therapists in the directory that have completed this educational program and are available to work with families that have are fostering or have adopted out of the Child Welfare system. The last three cohorts had a 95% or higher completion rate. The Child Welfare Training Program delivered 66 trainings this quarter attended by 499 Child Welfare staff, 294 Caregivers and 41 community partners. Essential Elements was delivered 4 times, one over contract as a result of an additional class delivered in May due to the creation of the MAPS positions. Family Conditions was offered once, Well Being Needs of Children and Young Adults (3 times), Trauma Informed Practice (3 times), Preparing and Presenting for Success in Court (2 times), Foundations Professional Development Day (1 time), Adoption Tools and Techniques (1 time), Supervisory (3 modules), Social Service Assistant Training (1 time), Confirming Safe Environments for SSAs (1 time), and Adoption Committee Part 1 and Part 2 (each 1 time). Additionally, three staff NetLinks were delivered this quarter (attended by 71 staff) and 40 caregiver trainings were offered (3 in Spanish). During this quarter, the Caregiver Areas of Knowledge and Skills were identified through a facilitated committee process lead by our Partnership Evaluations Manager. These will move through a formal vetting process in the next quarter & become the foundation for future revisions to the Caregiver Training. A well received presentation was jointly developed & delivered for the Unified Safety Advisory Committee regarding the Caregiver Redesign work. Lastly, Oregon Child Welfare & our Partnership successfully hosted the National IV E Roundtable where Oregon s Partnership was recognized as national model for workforce development. Page 3

5 Overview of Child Welfare Training Unit Deliverables This Quarter To Date Classroom Training Offered Distance Training Offered Total Training Offered Staff Trained Caregivers Trained Other Guests Trained Total Trained Training Provided Outside Work Order Deliverables This Quarter To Date Classroom Training Offered 0 15 Distance Training Offered 0 N/A Total Training Offered 0 15 Staff Trained Caregivers Trained 0 N/A Other Guests Trained 0 N/A Total Trained Page 4

6 Work Order Component : New Caseworker Training: Essential Elements of Child Welfare Practice Distance Training for Social Service Specialists 1 Staff Other Current To Date Secondary Traumatic Stress CBT Child Welfare Ethics and DHS Values CBT CANS CBT Multi-Ethnic Placement Act CBT Adoption and Safe Families Act CBT Guardianship Assistance CBT Totals Essential Elements of Child Welfare Practice (97.5 hours, 22 per Biennium) Classroom Training, 25 Participant Capacity Number Times Offered: Current To Date 4 11 Number of Participants Trained: Current To Date Staff Members Other Guests 2 5 Totals Page 5

7 Other Deliverables Current To Date CPS Field Follow Up Observations 2 24 Activity Guide: Transition Period Deliverables Classroom Training Number Times Offered: Current To Date Fundamentals 0 2 Life of a Case 0 1 Confirming Safe Environments 0 2 Total Offered 0 5 Number of Participants Trained: Current To Date Staff Members Other Guests 0 6 Totals Work Order Component : Evaluation Summary Distance Training: Secondary Traumatic Stress Average Overall Rating* = 3.8 Average Usefulness Rating* = 4.1 *1-5 scale, 5 is highest rating Participant self-assessed knowledge gained: Pre-training knowledge = 3.6 (fair) Post-training knowledge = 4.3 (good) Increase of 0.7 or 14% Page 6

8 Child Welfare Ethics & DHS Values Average Overall Rating* = 3.4 Average Usefulness Rating* = 4.2 *1-5 scale, 5 is highest rating Participant self-assessed knowledge gained: Pre-training knowledge = 3.2 (fair) Post-training knowledge = 4.1 (good) Increase of 0.9 or 18% CANS Average Overall Rating* = 2.9 Average Usefulness Rating* = 3.9 *1-5 scale, 5 is highest rating Participant self-assessed knowledge gained: Pre-training knowledge = 2.3 (minimal) Post-training knowledge = 3.1 (fair) Increase of 0.8 or 16% MEPA Average Overall Rating* = 4.1 Average Usefulness Rating* = 4.5 *1-5 scale, 5 is highest rating Participant self-assessed knowledge gained: Pre-training knowledge = 2.8 (minimal) Post-training knowledge = 4.6 (good) Increase of 1.8 or 36% Adoption & Safe Families Act None this quarter Guardianship Assistance Only 1 respondent this quarter Average Overall Rating* = 3.0 Average Usefulness Rating* = 3.0 *1-5 scale, 5 is highest rating Participant self-assessed knowledge gained: Pre-training knowledge = 2.0 (minimal) Post-training knowledge = 4.0 (good) Increase of 1.8 or 40% Essential Elements: Average Overall Rating* = 3.6 Average Usefulness Rating* = 4.1 *1-5 scale, 5 is highest rating 98.7% agreement that the trainers were knowledgeable Page 7

9 98.0% agreement that the learning objectives were achieved 93.2% agreement that the materials were helpful 90.0% agreement that the activities were useful 93.7% agreement that simulations were helpful 89.4% agreement that the simulation process was clear 95.7% agreement that the support and resources needed to prepare for simulations was received Participant self-assessed knowledge gained: Pre-training knowledge = 2.6 (minimal) Post-training knowledge = 4.1 (good) Increase of 1.5 or 30% Work Order Component : New Caseworker Training: Family Conditions Family Conditions (19.5 hours, 8 per Biennium) Classroom Training, 60 Participant Capacity / Live Stream Sites, 20 Participant Capacity Number Times Offered: Current To Date 1 3 Number of Participants Trained: Current To Date Staff Members Other Guests 0 0 Work Order Component : Evaluation Summary Average Overall Rating* = 3.8 Average Usefulness Rating* = 4.2 *1-5 scale, 5 is highest rating 97.2% agreement that the trainers were knowledgeable 95.5% agreement that the learning objectives were achieved 96.0% agreement that the materials were helpful 76.9% agreement that the activities were useful Totals Page 8

10 Participant self-assessed knowledge gained: Pre-training knowledge = 3.1 (fair) Post-training knowledge = 4.2 (good) Increase of 1.1 or 22% Work Order Component : New Caseworker Training: Well Being Needs of Children and Young Adults Distance Training for Social Service Specialists 1 Staff Other Current To Date Advocating for Educational Services Netlink Totals Well Being Needs of Children and Young Adults (26 hours, 12 per Biennium) Classroom Training, 30 Participant Capacity Number Times Offered: Current To Date 3 7 Number of Participants Trained: Current To Date Staff Members Other Guests 1 1 Totals Work Order Component : Evaluation Summary Advocating for Educational Services: Average Overall Rating* = 3.8 Average Usefulness Rating* = 4.1 *1-5 scale, 5 is highest rating Page 9

11 94.2% agreement that the trainers were knowledgeable 92.2% agreement that the learning objectives were achieved 92.2% agreement that there was sufficient interaction 94.1% agreement that the training effectively incorporated stories, scenarios or examples to enhance the content 94.2% agreement that the materials were helpful Participant self-assessed knowledge gained: Pre-training knowledge = 2.7 (minimal) Post-training knowledge = 3.9 (fair) Increase of 1.2 or 24% Well Being: Average Overall Rating* = 3.9 Average Usefulness Rating* = 3.5 *1-5 scale, 5 is highest rating 95.7% agreement that the trainers were knowledgeable 95.3% agreement that the learning objectives were achieved 90.1% agreement that the materials were helpful 83.0% agreement that the activities were useful Participant self-assessed knowledge gained: Pre-training knowledge = 3.1 (fair) Post-training knowledge = 4.1 (good) Increase of 1.0 or 20% Page 10

12 Work Order Component : New Caseworker Training: Trauma Informed Practice Strategies Trauma Informed Practice Strategies (13 hours, 24 per Biennium) Classroom Training, 25 Participant Capacity Number Times Offered: Current To Date 3 12 Number of Participants Trained: Current To Date Staff Members Other Guests 0 1 Totals Work Order Component : Evaluation Summary Average Overall Rating* = 3.5 Average Usefulness Rating* = 4.0 *1-5 scale, 5 is highest rating 97.8% agreement that the trainers were knowledgeable 97.8% agreement that the learning objectives were achieved 95.5% agreement that there was sufficient interaction 95.5% agreement that the materials were helpful Participant self-assessed knowledge gained: Pre-training knowledge = 3.3 (fair) Post-training knowledge = 4.4 (good) Increase of 1.1 or 22% Page 11

13 Work Order Component : New Caseworker Training: Preparing and Presenting for Success in Court Preparing and Presenting for Success in Court (32.5 hours, 12 per Biennium) Classroom Training, 30 Participant Capacity Number Times Offered: Current To Date 2 5 Number of Participants Trained: Current To Date Staff Members Other Guests 0 0 Totals Work Order Component : Evaluation Summary Average Overall Rating* = 3.9 Average Usefulness Rating* = 4.4 *1-5 scale, 5 is highest rating 99.7% agreement that the trainers were knowledgeable 99.4% agreement that the learning objectives were achieved 95.1% agreement that the materials were helpful 91.8% agreement that the activities were useful 91.1% agreement that simulations were helpful 76.5% agreement that the simulation process was clear 84.9% agreement that the support and resources needed to prepare for simulations was received Participant self-assessed knowledge gained: Pre-training knowledge = 2.7 (minimal) Post-training knowledge = 3.9 (fair) Increase of 1.2 or 24% Page 12

14 Work Order Component : Caregiver Training Unit Caregiver Training Unit - Classroom Training* Number of Times Offered Number of Participants Training Title (Number of Hours) This Quarter To Date Total Deliverables Foster Parents Relatives Adoptive Parents Staff Community Partners Total this Quarter Total to Date Ayudando a los Ninos con las Visitas (3 hrs) BCMT (12 hrs) Behavior: Pouting to Punching (3 hrs) Building Resilience for Children in Care (3 hrs) CPR/First Aid ( hrs) Caregivers and Caseworkers Teaming: The Heart of Child Welfare (3 hrs) Caregiver s Guide to Adolescent Sexuality (3 hrs) Page 13

15 Caring for the Sexually Abused Child (3 hrs) Children Can Hear (3 hrs) Collaborative Problem Solving (3 hrs) Collaborative Problem Solving II (3 hrs) Comunicacion Efectiva (3 hrs) Creating Positive Behaviors in Teens (6 hrs) Criando de acuerdo al Temperamento de los Ninos (3 hrs) Diez Consejos Para Criar a Adolescentes (3 hrs) Desarrollar la Capacidad de Recuperacion de los Ninos en Cuidado (3 hrs) Desarrollo Infantil: Del Nino Pequeno al Preadolescente (3 hrs) Educational Rights of Children and Youth Effects of Trauma on Learning in Children 0 to 18 (3 hrs) Facilitating Developmental Attachment (3 hrs) Fetal Alcohol Spectrum Disorder Fundamentals (3 hrs) Foster Parents in Juvenile Court (3 hrs) Page 14

16 Fun & Creative Parenting (3 hrs) Good Times for Tweens & Teens (3 hrs) Helping Children with Visitation (3 hrs) Living Under the Influence of Addiction (3 hrs) Loving and Letting Go (3 hrs) Managing Difficult Behaviors in Young Children (3 hrs) Motivating Youth to Make Positive Changes (3 hrs) Parenting a Child with Special Needs (3 hrs) Parenting in the Digital Age (3 hrs) Parenting Methamphetamine Exposed Children (3 hrs) Permanency Options for Caregivers (3 hrs) Positive Behavior Management (6 hrs) Relative Caregivers Self-Harm: Putting the Puzzle Pieces Together (3 hrs) Strategies in Successful Fostering (3 hrs) Supporting Children Exposed to Domestic Violence (3 hrs) Page 15

17 Talking with Children about Difficult Issues (3 hrs) The Foster to Adoption Shift (3 hrs) The Significance of Siblings (3 hrs) Transitioning Children with Sensitivity (3 hrs) Trauma Informed Parenting (6 hrs) Tu Y Yo Understanding & Responding to the Sexual Behaviors of Children (3 hrs) Vicarious Trauma: Surviving & Thriving as a Caregiver (3 hrs) Viviendo Bajo la Influencia de Adiccion (3 hrs) You and Them (3 hrs) CTU Classroom Training Totals * 13 Classroom sessions were cancelled this quarter. Page 16

18 Caregiver Training Unit - Distance Training (56 sessions) Number of Times Offered Number of Participants Training Title (Number of Hours) This Quarter To Date Total Deliverables Foster Parents Relatives Adoptive Parents Staff Community Partners Total this Quarter Total to Date Apoyando a los Ninos Expuestos a la Violencia Domestica (3 hours) Building Resilience for Children in Care (3 hrs) Caring for Children of Incarcerated Parents (3 hrs) Child Development: Teens to Young Adulthood (3 hrs) Child Development: The Tween Puzzle (3 hrs) Child Development: Toddlers through Pre-Tweens (3 hrs) Connections: Children, Birth Families & Caregivers (3 hrs) Desarrollar la Capacidad de Recuperacion de los Ninos en Cuidada (3 hrs) Educational Rights of Children and Youth (3 hrs) Effects of Trauma on Learning in Children 0 to 18 (3 hrs) Foster Parents in Juvenile Court (3 hrs) Page 17

19 Helping Children with Visitation (3 hrs) Los Parientes Como Cuidadores (3 hrs) Loss & Grief (3 hrs) Making the Most of Caseworker Monthly Visits (3 hrs) Parenting from the Heart and the Brain (3 hrs) Parenting in the Digital Age (3 hrs) Parenting to a Child s Temperament (3 hrs) Promoting and Maintaining Cultural Identities of Youth (3 hrs) Relative Caregivers (3 hrs) The Important Role of Dads (3 hrs) Vicarious Trauma: Surviving & Thriving as a Caregiver (3 hrs) CTU Distance Training Totals Page 18

20 Caregiver Training Unit Overall Totals Number of Times Offered Number of Participants This Quarter To Date Total Deliverables Foster Parents Relatives Adoptive Parents Staff Community Partners Total this Quarter Total to Date CTU Classroom Training Totals CTU Distance Training Totals Caregiver Training Unit Totals Other Deliverables This Quarter To Date Total Deliverables CTU Training Curriculum Translated into Spanish Develop Brown Bag Topics for Support Groups 0 0 As resources allow Foster Parent College (2000 Units) Units Completed this Quarter Units Expired this Quarter Completed/Expired to Date Page 19

21 Work Order Component : Evaluation Summary Caregiver Classroom Training: Average Overall Rating* = 4.4 Average Usefulness Rating* = 4.7 *1-5 scale, 5 is highest rating 99.5% agreement that the trainers were knowledgeable 98.1% agreement that the learning objectives were achieved 99.1% agreement that there was sufficient interaction 99.5% agreement that the materials were helpful Participant self-assessed knowledge gained: Pre-training knowledge = 2.9 (minimal) Post-training knowledge = 4.6 (good) Increase of 1.7 or 34% Caregiver NetLink Training: Average Overall Rating* = 4.6 Average Usefulness Rating* = 5.0 *1-5 scale, 5 is highest rating 100% agreement that the trainers were knowledgeable 100% agreement that the learning objectives were achieved 100% agreement that there was sufficient interaction 100% agreement that the training effectively incorporated stories, scenarios or examples to enhance the content 89.2% agreement that the materials were helpful Participant self-assessed knowledge gained: Pre-training knowledge = 3.1 (fair) Post-training knowledge = 4.5 (good) Increase of 1.4 or 28% Page 20

22 Work Order Component : Foundations Training of Regional Trainers Foundations Training of Regional Trainers (26 hours, 2 per Biennium) Classroom Training, 25 Participant Capacity Number Times Offered: Current To Date 0 1 Number of Participants Trained: Current To Date Staff Members 0 13 Other Guests 0 1 Totals 0 14 Foundations Professional Development Days (6.5 hours, 8 per Biennium) Classroom Training, 25 Participant Capacity Number Times Offered: Current To Date 1 2 Number of Participants Trained: Current To Date Staff Members Other Guests 0 0 Totals Other Deliverables This Quarter To Date Total Individual Mentoring (Up to 10 Days) Page 21

23 Work Order Component : Evaluation Summary Average Overall Rating* = 4.0 Average Usefulness Rating* = 4.3 *1-5 scale, 5 is highest rating Participant self-assessed knowledge gained: Pre-training knowledge = 3.8 (moderate) Post-training knowledge = 4.5 (good) Increase of 0.7 or 14% Work Order Component : Social Services Assistant Training Social Services Assistant (39 hours, 4 per Biennium) Classroom Training, 25 Participant Capacity Number Times Offered: Current To Date 1 2 Number of Participants Trained: Current To Date Staff Members Other Guests 0 0 Totals Social Services Assistant Regional Summit (6.5 hours, 4 per Biennium) Classroom Training, 25 Participant Capacity Locations Offered Staff Other Total for Quarter To Date Totals Page 22

24 Work Order Component : Evaluation Summary Average Overall Rating* = 3.5 Average Usefulness Rating* = 3.9 *1-5 scale, 5 is highest rating 97.2% agreement that the trainers were knowledgeable 94.2% agreement that the learning objectives were achieved 97.5% agreement that there was sufficient interaction 96.0% agreement that the materials were helpful Participant self-assessed knowledge gained: Pre-training knowledge = 3.1 (fair) Post-training knowledge = 4.4 (good) Increase of 1.3 or 26% Page 23

25 Work Order Component : Specialized Training Professional Development Professional Development Classroom Training Number of Times Offered Number of Participants Training Title (Number of Hours) This Quarter To Date Total Staff Community Partners Other Total this Quarter Total to Date Confirming Safe Environments for SSA s Staff Classroom Totals Page 24

26 Professional Development Distance Training Number of Times Offered Number of Participants Training Title (Number of Hours) This Quarter To Date Total Staff Community Partners Other Total this Quarter Total to Date Adoption Assistance CBT N/A N/A N/A Assessing and Ensuring Child Safety Culturally Competent Interviewing Involving Fathers in Case Planning Living Under the Influence of Addiction Nurturing Our Most Precious Resource: A Caseworker s Guide to Supporting Caregivers Sexual Behaviors of Youth Talking to Caregivers About Discipline The Importance of Sibling Relationships What You Need to Know about Substance Abuse Staff Distance Training Totals Page 25

27 Professional Development Overall Total Number of Sessions Offered Number of Participants This Quarter To Date Total Staff Community Partners Other Total this Quarter Total to Date Staff Classroom Totals Staff Distance Training Totals Professional Development Totals Page 26

28 Work Order Component : Evaluation Summary Professional Development NetLinks Average Overall Rating* = 3.7 Average Usefulness Rating* = 4.3 *1-5 scale, 5 is highest rating 96.7% agreement that the trainers were knowledgeable 96.5% agreement that the learning objectives were achieved 82.7% agreement that there was sufficient interaction 93.1% agreement that the training effectively incorporated stories, scenarios or examples to enhance the content 100% agreement that the materials were helpful Participant self-assessed knowledge gained: Pre-training knowledge = 3.3 (fair) Post-training knowledge = 4.2 (good) Increase of 0.9 or 18% Confirming Safe Environments for SSAs Average Overall Rating* = 3.5 Average Usefulness Rating* = 4.1 *1-5 scale, 5 is highest rating 94.1% agreement that the trainers were knowledgeable 76.5% agreement that the learning objectives were achieved 88.3% agreement that there was sufficient interaction 94.1% agreement that the materials were helpful Participant self-assessed knowledge gained: Pre-training knowledge = 2.8 (fair) Post-training knowledge = 4.3 (good) Increase of 1.5 or 30% Page 27

29 Work Order Component : Supervisory Training Supervisory (68.25 hours, 4 per Biennium) Classroom Training, 25 Participant Capacity Number Times Offered: Current To Date.5 2 Number of Participants Trained: Current To Date Staff Members 20* 32 Other Guests 0 0 Totals *Carried over from first half of cohort and reported in prior quarter. Work Order Component : Evaluation Summary Average Overall Rating* = 3.7 Average Usefulness Rating* = 4.2 *1-5 scale, 5 is highest rating 100% agreement that the trainers were knowledgeable 97.4% agreement that the learning objectives were achieved 92.1% agreement that there was sufficient interaction 97.4% agreement that the materials were helpful Participant self-assessed knowledge gained: Pre-training knowledge = 2.4 (minimal) Post-training knowledge = 3.8 (good) Increase of 1.4 or 28% Page 28

30 Work Order Component : Adoption Tools & Techniques and Adoption Committee Training Adoption Tools and Techniques (19.5 hours, 4 per Biennium) Classroom Training, 25 Participant Capacity Number Times Offered: Current To Date 1 2 Number of Participants Trained: Current To Date Staff Members Other Guests 0 0 Totals Adoption Committee Training (6 hours, 12 per Biennium) Distance Training, 25 Participant Capacity Number Times Offered: Current To Date Part Part Total Offered 2 10 Number of Participants Trained: Current To Date Staff Members Other Guests Totals Page 29

31 Work Order Component : Evaluation Summary Adoption Committee Training: Average Overall Rating* = 3.5 Average Usefulness Rating* = 4.0 *1-5 scale, 5 is highest rating 100% agreement that the trainers were knowledgeable 85.7% agreement that the learning objectives were achieved 71.4% agreement that there was sufficient interaction 78.5% agreement that the training effectively incorporated stories, scenarios or examples to enhance the content 85.7% agreement that the materials were helpful Participant self-assessed knowledge gained: Pre-training knowledge = 2.5 (minimal) Post-training knowledge = 3.6 (fair) Increase of 1.1 or 22% Adoption Tools & Techniques Average Overall Rating* = 3.8 Average Usefulness Rating* = 4.6 *1-5 scale, 5 is highest rating 100% agreement that the trainers were knowledgeable 95.2% agreement that the learning objectives were achieved 98.0% agreement that content was applicable 92.1% agreement that the materials were helpful 90.9% agreement that the activities were useful Participant self-assessed knowledge gained: Pre-training knowledge = 2.2 (minimal) Post-training knowledge = 4.0 (good) Increase of 1.8 or 36% Page 30

32 Work Order Component : Certification and Adoption Worker Training Certification and Adoption Worker Training (61.5 hours, 4 per Biennium) Classroom Training, 25 Participant Capacity Number Times Offered: Current To Date.5 2 Number of Participants Trained: Current To Date Staff Members 19* 45 Other Guests 1* 1 Totals 20* 46 *Carried over from first half of session and reported last quarter. SAFE Home Study (13 hours, 4 per Biennium) Classroom Training, Up to 30 Participant Capacity Number Times Offered: Current To Date 0 3 Number of Participants Trained: Current To Date Staff Members 0 74 Other Guests 0 1 Totals 0 75 Page 31

33 Supervising SAFE Training (61.5 hours, 4 per Biennium) Classroom Training, Up to 10 Participant Capacity Number Times Offered: Current To Date 0 3 Number of Participants Trained: Current To Date Staff Members 0 15 Other Guests 0 0 Totals 0 15 Work Order Component : Evaluation Summary Certification & Adoption Worker Training (reported in last quarter report as well): Average Overall Rating* = 3.3 Average Usefulness Rating* = 4.2 *1-5 scale, 5 is highest rating 100% agreement that the trainers were knowledgeable 99.6% agreement that the learning objectives were achieved 100% agreement that the content was applicable to their jobs 98.4% agreement that the materials were helpful 93.6% agreement that the activities were useful Participant self-assessed knowledge gained: Pre-training knowledge = 3.3 (fair) Post-training knowledge = 4.2 (good) Increase of 0.9 or 18% Page 32

34 Work Order Component : Adoption and Foster Family Therapy Certificate Program for Mental Health Professionals Adoption and Foster Family Therapy Certificate Program for Mental Health Professionals (Part 1) 2 per Year, 14 Workshops Total Number of Times Offered Number of Participants Training Title (Number of Hours) This Quarter To Date Total Therapist DHS Staff in Class Total this Quarter Total to Date Building Resiliency & Stability for Adoptive and Foster Families (9 CEUs) 2 2 Classroom: Classroom: Classroom: Classroom: 55 Distance: Distance: Distance: Distance: 51 Fetal Alcohol Spectrum Disorder & Other Drug Effects: Understanding & Application of a Brain- Based Approach for Adoptive & Foster Families (9 CEUs) Impact of Complex Trauma on Neurological and Physiological Systems: Family Based Therapeutic Strategies to Support Healing (16 CEUs) 2 2 Classroom: Classroom: Classroom: Classroom: 55 Distance: Distance: Distance: Distance: Classroom: Classroom: Classroom: Classroom: 66 Distance: Distance: Distance: Distance: 55 Page 33

35 Treating the Continuum of Attachment Difficulties for Adoptive & Foster Families (16 CEUs) Classroom: 27 Classroom: 8 Classroom: 32 Classroom: 58 Distance: 26 Distance: 7 Distance: 27 Distance 61 Essential Clinical Interventions for Adoptive & Foster Families (9 CEUs) Classroom: 26 Classroom: 7 Classroom: 27 Classroom: 60 Distance: 26 Distance: 2 Distance: 28 Distance: 63 Life Story Work: A Model Recovery for Youth (9 CEUs) Classroom: 23 Classroom: 2 Classroom: 25 Classroom: 50 Distance: 32 Distance: 0 Distance: 32 Distance: 74 Case Consultation Session (5 CEUs) ***Required Component for Sept 2016-Jan 2017 cohort, optional for Feb-June 2017 cohort. 2 2 Classroom: Classroom: Classroom: Classroom: 7 Distance: Distance: Distance: Distance: 1 Totals Classroom: 76 Distance: 84 Classroom: 8 Distance: 3 Classroom: 84 Distance: 87 Classroom: 351 Distance: 359 Page 34

36 Work Order Component : Adoption and Foster Family Therapy Certificate Program for Mental Health Professionals Adoption and Foster Family Therapy Certificate Program for Mental Health Professionals (Part 2) 2 per Year, 12 Workshops Total Number of Times Offered Number of Participants Training Title (Number of Hours) This Quarter To Date Total Therapist DHS Staff in Class Total to Date Building Resiliency & Stability for Adoptive and Foster Families (9 CEUs) 2 Classroom: Classroom: Classroom: Distance: Distance: Distance: Fetal Alcohol Spectrum Disorder & Other Drug Effects: Understanding & Application of a Brain-Based Approach for Adoptive & Foster Families (9 CEUs) 2 Classroom: Classroom: Classroom: Distance: Distance: Distance: Impact of Complex Trauma on Neurological and Physiological Systems: Family Based Therapeutic Strategies to Support Healing (16 CEUs) 2 Classroom: Classroom: Classroom: Distance: Distance: Distance: Treating the Continuum of Attachment Difficulties for Adoptive & Foster Families (16 CEUs) 2 Classroom: Classroom: Classroom: Distance: Distance: Distance: Page 35

37 Essential Clinical Interventions for Adoptive & Foster Families (9 CEUs) 2 Classroom: Classroom: Classroom: Distance: Distance: Distance: Life Story Work: A Model Recovery for Youth (9 CEUs) 2 Classroom: Classroom: Classroom: Distance: Distance: Distance: Totals 12 Classroom: Classroom: Classroom: Distance: Distance: Distance: Page 36

38 Other Deliverables This Quarter There are 181 Oregon Therapists in the Directory, which can be found here: Cohort 4 (Feb 2018-June 2018) completed this quarter with 55 participants. Two participants will complete the program with the Fall cohort (96% completion rate). Follow-up for this cohort is complete. Cohort 3 (Sept 2017-Jan 2018) closed this quarter. 5 participants completed this quarter bringing the total participants to 61 who were awarded a Certificate of Completion (100% completion rate). Follow-up for this cohort is complete. Cohort 2 (Feb-June 2017) closed this quarter. 11 participants completed this quarter bringing the total participants to 63 who were awarded a Certificate of Completion (95% completion rate). Follow-up for this cohort is complete. Marketing at the GOHBI conference resulted in hundreds of contacts, and 65 names added to the mailserve for upcoming application periods. GOHBI offered the table at no charge in a continued partnership. Quarterly Advisory Board meetings are scheduled throughout Evaluation Summary The overall average rating of the courses offered this quarter was 4.5 (SD=0.78), on a scale of 1-5. The average rating of the usefulness of the content presented was 4.7 (SD=0.64). Respondents agreed that the trainers were knowledgeable (98%). Nearly all agreed that the learning objectives were achieved (95%), the materials were helpful (97%), and that the content presented would be able to be used in their work (99%). Participants self-assessed their knowledge gained as a result of the training. The average pre-training rating was 2.9, which increased to 4.1 post training. Page 37

39 Work Order Component : Child Welfare Education Program Jessica Schmidt, MSW, PhD, Assistant Director reporting to Marty Lowrey, MSW, LCSW, Director of Workforce Development The goal of this agreement is to support Oregon s Child Welfare system in the recruitment, training and retention of professional child welfare workforce by the provision of enriched social work education for current and potential employees. Specific deliverables for this biennium are: Provision of the CWEP program including tuition support and regular meetings with agency representatives to coordinate program activities. Collaboration with agency partners for the recruitment of employees and potential employees as well as management of the application and selection process of CWEP students. Provision of academic activities to CWEP students including advising, student field placement support, field instructor recruitment and field placement development, delivery of academic courses, seminars, and coordination of academic activities with the School of Social Work at Portland State University. Provision of professional development and post-graduation transition support. Evaluation of program effectiveness. April-June 2018 Progress on Deliverables CWEP faculty met regularly (at least once a month) with child welfare agency staff, partner agencies, and PSU instruction and field faculty to coordinate program activities. An MSW course sponsored and instructed through CWEP titled Partnering with and Practice in Child Welfare successfully served 14 MSW students within the School of Social Work. Additionally, a BSW course sponsored and instructed through CWEP titled Intro to Child Welfare served 38 students at PSU. Advising, tuition support, and on-going field placement support were provided for 24 students currently enrolled in the CWEP program. The current cohort of students for the academic year represents the following characteristics: One BSW student and 23 MSW students, nine of whom are in distance option placements across the state and one in the online cohort. Nineteen student who are DHS child welfare employees and five who are recruits. One-third of whom represent racially or ethnically diverse identities. Five students who are in the Culturally Responsive Leadership Program (CRL). Monthly seminars were held which focused on the development culturally responsive leaders within child welfare while the Introduction to Child Welfare Class was provided to BSW students and undergraduate PSU students. Page 38

40 Data for current student and alum, including demographics, academic and employment outcomes, was updated to facilitate evaluation of the CWEP program. CWEP had 13 students who graduated from the School of Social Work this year including: One BSW student and 12 MSW students; Five students of whom were Distance Option; one who was online and six who were campus based students. Nine students were DHS CW employees, one was a tribal employee and three were recruits. About 38% of the graduates represented racially or ethnically diverse identities. Two students were also Culturally Responsive Leaders (CRL) students (one tribal employee and one DHS employee.) We interviewed 21 CWEP applicants of whom: 3 were BSW; 6 were Distance Option; 2 were Online Option and 10 were campus based MSW students. 13 students were DHS CW employees and 8 were recruits. Six were interested in CRL. About 1/3 represented racially or ethnically diverse identities. We accepted 15 applicants into CWEP for the Academic Year: 3 BSW, 7 campus, 3 Distance Option, and 2 Online Option students. Nine students are DHS CW employees while six are recruits. Three students were accepted into CRL (one DO, one Online Option, and one campus) About just over ¼ of the students represent racially or ethnically diverse identities. Page 39

41 Work Order Component : Self-Sufficiency Programs (SSP) Katharine Cahn, Ph.D., Executive Director The goal of this agreement is to offer workforce development and knowledge partnership for the Self Sufficiency Strategic plan. Specific deliverables for this year are: Training for staff on working with clients facing mental health challenges (note: this has been completed) Adaptation of mental health training to fit staff in varied functions, and delivery of such training within resources (note: this training has been delivered in all of the primary districts across the state). Support in developing assessment and other clinical tools for program staff Co-training or training on the assessment tool (note: this has been completed) Support in design and delivery of Branch Operations Manager (BOM) training Other activities as requested Qtr. 4: Activity and Progress on Deliverables In the spring quarter, services delivered included: consulting to revise the Assessment tool based on evaluation feedback, continued support for internal delivery of the Branch Operations Manager training, training development for Vicarious Trauma for Engagement Specialists and development of an Advanced Skills training for family coaches with emphasis on executive functioning skills. The following personnel provided the following specific training, consultation, and support activities: Susie Barrios provided training development and consultation for staff on: - Vicarious Trauma training development with SSP training unit staff (7 sessions) - Advanced Skills for Family Coaches training development with SSP training unit staff (4 sessions) - Assessment tool revision development (2 sessions) She also provided 4 hours of consultation to support the integration of Reflective Supervision curriculum into the Branch Operation Managers training. Katharine Cahn met regularly with Director Fredlund to review program progress and the implementation of the SSP Strategic Plan. She participated in a workgroup and advised on the developing concept of statewide summits on Poverty Reduction. Marilyn Shawe provided a wide range of administrative support activities including preparation of training materials, review and display of evaluation materials, and other supports for the team. Page 40

42 Work Order Component : Research and Evaluation Beth Green, Ph.D., Director of Early Childhood and Family Support Research Carrie J. Furrer, Ph.D., Research Assistant Professor This report includes progress on the LIFE evaluation. Objectives for this quarter (4/1/2018-6/30/2018) Participate in planning committees (Steering, Program Design, Evaluation) Plan and participate in monthly LIFE Team meetings Conduct observations of CPMs Youth interviews Quarterly Youth Advisory Board meetings Provide monthly data collection reports to Parent Mentors Case progress tracking/case file review Family finding and relative search tracking, meeting preparation tracking and documentation PM outreach, participation decision and exit tracking, monthly contacts and service provision documentation, termination summary On-demand evaluation training for new LIFE staff Recruitment and data collection for families of color Using Y1/Y2 Entry Cohort, refine progress monitoring indicator calculations, comparison group selection Analysis of Families of Color and Youth interviews Parent and youth outcome surveys Data collection with Case Progress Tool Finalize Youth Advisory Board video Branch-specific data collection support report Shared Parent Mentor fidelity indicators with each PM agency Participate in Casey Waiver Convening Share results of Round 6 Meeting Feedback Surveys (D8,D3) Prepare presentation & participate in June 18 LIFE Quarterly Training Develop and administer LIFE Quarterly Training evaluation Semi-annual report (January June 2018) Time Frame Done Done Done Done Done Done Done Done Page 41

43 Objectives for this quarter (4/1/2018-6/30/2018) Submitted presentation (and was accepted) on LIFE values-based practice to International Conference on Innovations in Family Engagement (co-present with LIFE leadership, FEF, and PM) Time Frame Done Progress Notes Research Partnerships. The Evaluation Team is involved in DHS workgroups (Program Design, Steering, Evaluation Committee) related to program monitoring and improvement. We also participate in monthly meetings with the D2/15, D8, and D3 LIFE Teams (FEFs and their supervisors, consultant, PMs and their supervisors, LIFE Coordinators and their supervisors). During these meetings, we review and make meaning from findings, discuss implementation issues, and collect feedback on the evaluation processes. At every Quarterly Training, the Evaluation Team presents evaluation findings; we also administer and analyze Quarterly Meeting evaluation surveys, and then provide the results to various workgroups. The LIFE Youth Advisory Board continues to have 6 active members. The purpose of the YAB is to advise/guide the evaluation, particularly around incorporating youth voice. The YAB convened in the last quarter to present preliminary youth interview findings at the LIFE Quarterly Training in June Products. In the past quarter, we provided monthly data collection support reports for parent mentors, including referral and acceptance, and data collection progress. We also met with each Parent Mentor agency to review their fidelity data and discuss possible fidelity thresholds. We worked with the Youth Advisory Board to prepare a presentation for the Quarterly Training in June 18, collected evaluation surveys, and reported findings. We produced a reports (semi-annual January-June 2018 to submit in July). Data Collection. CPM observations continued in all sites using the updated Meeting Facilitation Fidelity Observation form. We regularly compile data about LIFE eligibility and referrals, family meeting preparation, and family finding. The LIFE Eligibility and Referral Database is up to date and used at all branches. Branches stopped taking new LIFE cases as of June 30, 2018 (LIFE service ends September 2019). Parent and youth short-term outcome surveys are being administered at all sites. Youth interviews are underway, as well as meeting observations and interviews with families involved in the FOC study. Case file reviews for the case progress tracking component are also underway. Specific data collection activities in the past quarter are: o Families of Color study: 9 CPM observations, 3 family interviews, 2 FEF interviews o CPM Observations (not part of Families of Color study): 5 o Youth interviews (not part of Families of Color study): 7 o Other process evaluation activities: 5 LIFE Team Meetings o 198 Parent Short-term Outcome Surveys sent to branches to distribute o 135 Youth Short-term Outcome Surveys sent to branches to distribute Page 42

44 o Case Progress Tracking: 5 cases Waiver Evaluation Project: Products This Quarter Parent Mentor: Monthly Service Navigation Tracking data collection report Quarterly Training: Youth Advisory Board presentation, evaluation form, evaluation summary report Semi-annual report January-June 2018 Meeting observation practice analysis Presentation on LIFE values-based practice accepted at International Conference on Innovations in Family Engagement (co-present with LIFE leadership, FEF, and PM) Eligibility, Referral and Intake Process Accounting LIFE Totals as of June 30, Cases initially eligible* for LIFE services (identified by algorithm): 653 (908 children)** 2. Cases opened for LIFE services: 498 (710 children)*** 3. Cases participating in D2/D15/D3 families of color study: 12 *initially eligible case = at least one child on case scored 12+ (13+ starting 2/6/17) on risk algorithm **children associated with initially eligible case = a child placed in out-of-home care associated with a case in which at least one sibling scored 12+ (13+ after 2/6/17) on risk algorithm ***30 cases currently missing eligibility information Objectives for next quarter (7/1/2018-9/30/2018) Participate in planning committees (Steering, Program Design, Evaluation) Plan and participate in monthly LIFE Team meetings Conduct observations of CPMs Youth interviews Quarterly Youth Advisory Board meetings Provide monthly data collection reports to Parent Mentors Case progress tracking/case file review Family finding and relative search tracking, meeting preparation tracking and documentation Time Frame Page 43

45 Objectives for next quarter (7/1/2018-9/30/2018) Time Frame PM outreach, participation decision and exit tracking, monthly contacts and service provision documentation, termination summary On-demand evaluation training for new LIFE staff Recruitment and data collection for families of color Using Y1/Y2 Entry Cohort, refine progress monitoring indicator calculations, comparison group selection Analysis of Families of Color and Youth interviews Parent and youth outcome surveys Data collection with Case Progress Tool Attend Waiver Grantee Meeting July 18 Wrap up CPM meeting observations (not including families of color) August 18 Develop July FEF Training Evaluation form; collect, analyze and report August 18 Launch parent follow-up interviews August 18 Finalize process for reporting fidelity indicators August 18 2-page summary of Semi-annual report Jan-June 2018 August 18 Discuss meeting facilitation practice data with FEFs August 18 Assist YAB in preparing for Shoulder to Shoulder conference September 18 Launch provider/professional survey September 18 Present at September LIFE Quarterly Training September 18 Develop LIFE Quarterly Training evaluation September 18 Wrap up T1 parent and youth outcome surveys September 18 Page 44

46 Work Order Component : Systems of Care Training and Technical Assistance Brooke Rizor, LCSW, Systems of Care Institute Overview The partnership s System of Care Institute provides training, consultation, workforce development, and system improvement across Oregon to support the implementation of high fidelity Wraparound and technical assistance for the development of a System of Care for children with multi-system involvement, as part of the legislatively driven Statewide Children s Wraparound Initiative (SCWI). SOCI provides training and technical assistance to Coordinated Care Organizations (CCOs), CMHPs, providers, and system partners serving all thirty-six Oregon counties. In addition, the System of Care Institute offers training specific to the integration of the CANS into Wraparound work statewide. The team is to provide a minimum of 125 training and consultation sessions over the biennium to system leaders and community stakeholders on subject matters including: Cross-system collaboration; SOC governance; Care coordination; Culturally responsive practice; Data driven practice; and CANS Quarter Activities: The System of Care Institute provided the following activities to realize these deliverables: A. Training Modules/Consultation on Wraparound/System of Care PSU designed and delivered training, consultation and coaching sessions specific to the practice of Wraparound. All training and consultation sessions were grounded in foundational Wraparound principles/values and tailored to reflect the local. This level of local customization accounts for how each individual community is operationalizing Wraparound development. In all communities the entity providing Wraparound is not the CCO, rather it is a contracted provider or entity. Trainings have been adjusted to account for developmental shifts and identified needs in the participant cohorts. SOCI has continued to meet with stakeholders, community leaders, and governance structures around the state to advance Oregon s System of Care. SOCI has continued with the System of Care training, Ideas to Action which has been very well received to aid Page 45