AMY RICHMOND, JD, MA, MPhil, CE Partner

Transcription

1 , JD, MA, MPhil, CE Partner Amy Richmond, Partner at PRA, offers clients a breadth of experience. As a lawyer, Amy brings that expertise to managing justice projects in civil and criminal law. She has also worked extensively in other subject areas, including health, education, and social services research. With over ten years of program evaluation experience, Amy has strong skills in evaluation design, particularly mixed-methods approaches that combine the strengths of qualitative and quantitative research. She has also assisted clients with various other research needs, including facilitating sessions on performance measurement, developing performance measurement and evaluation strategies, and conducting evaluability assessments, needs assessments, and operational reviews. Amy provides clients with reports that synthesize multiple lines of inquiry to produce balanced, well-documented findings. She has also assisted clients by presenting research findings to external stakeholder groups. Amy is on the Board of the Manitoba Chapter of the Canadian Evaluation Society (CES) and is currently serving on the CES National Council. She is a Credentialed Evaluator (CE). With expansive professional experience and a thorough understanding of program evaluation, Amy offers clients clear and effective analysis and support for managing program, policy, and organizational change. Areas of Expertise Program evaluation Policy design, program development and planning resulting from evaluation results Program management, including managing multiple-year evaluations and design of large federal evaluations Methodology design (survey questionnaires, key informant guides, moderator s guides for focus groups) Planning and policy development Education and Professional Designations BA (Hons.) (Political Science) University of Chicago MA, M Phil (Political Science) Yale University JD Baylor University Certification from the National Committee on Accreditation of the Federation of Law Societies of Canada Credentialed Evaluator (CE) Professional Experience 2005 present PRA Inc. (Partner) PRA Inc. (Senior Research Associate) PRA Inc. (Research Associate) Canadian Human Rights and Civil Liberties, University of Winnipeg (Instructor) Baker Botts, LLP (London, UK office) (Associate Attorney) Department of Political Science, Yale University (Teaching Assistant) Baker Botts, LLP (Houston, TX office) (Associate Attorney) Memberships, Affiliations and Awards Canadian Evaluation Society (CES) American Evaluation Association State Bar of Texas WINNIPEG OTTAWA EDMONTON REGINA admin@pra.ca

2 Survey of Legal Aid Applicants Legal Aid Alberta Annual since 2004 Evaluation of the Health Care Policy Contribution Program Health Canada March 15, 2012 to present Strategic Organizational Review of the Legal Services Board Nunavut Legal Services Board February 2, 2012 to present Evaluation of the Institute for Safe Medication Practices Canada Institute for Safe Medication Practices in Canada May 25, 2012 to May 13, 2013 Since 2004, PRA has conducted an annual client satisfaction survey for LAA. The survey asks clients about their experiences applying for legal aid across a number of dimensions, including timeliness of service and quality of service from LAA. Recipients of legal aid are also asked about the service they received from their legal aid lawyer. Each subsequent survey compares the findings with the previous years. To comply with the requirements in the Federal Accountability Act, the 2009 Treasury Board Policy on Evaluation, and Health Canada s 2010 Evaluation Policy, Health Canada hired PRA to conduct an evaluation of the Health Care Policy Contribution Program (HCPCP), which will cover the years from In accordance with the Treasury Board Policy on Evaluation, the evaluation will assess the relevance and performance (effectiveness, efficiency, and economy) of the HCPCP. In order to fully assess the HCPCP s success in achieving its outcomes, the evaluation will consider activities funded under both Vote 1 (operating) and Vote 10 (contribution). The Legal Services Board (LSB) provides criminal law, family law, and poverty law legal aid services to eligible Nunavummiut. It also manages the court worker program and provides legal education and information. LSB contracted PRA to assist in undertaking a Strategic Organizational Review to review the existing LSB structure and, in particular, its quasi-governmental nature and operational relations to the Government of Nunavut (GN). Phase 1 of the review involves analyzing the current organizational structure in terms of effectiveness and efficiency, and the implications of greater independence from the GN; and making recommendations on operational improvements. Phase 2 involves development of a change management plan for operationalizing recommended changes. The Institute for Safe Medication Practices (ISMP) Canada evaluated its Canadian Medication Incident Reporting and Prevention System (CMIRPS) activities as part of its obligations under the Health Care Policy Contribution Program (HCPCP). The evaluation assessed the relevance, implementation, effectiveness and performance of ISMP Canada s CMIRPS activities between fiscal year 2010/ /12, inclusive. It also highlighted program achievements and identified challenges and lessons learned. Amy served as project director. She designed and managed the survey and assisted with reporting. is responsible for client liaison, methodology and instrument design, interviews, survey and file review management, the document and literature review, and reporting. Amy is project director and is responsible for client liaison, research design, instrument design, site visits, key informant interviews, analysis, and reporting. Amy was project director; in that capacity, she served as client liaison and oversaw the evaluation design, data collection, and reporting.

3 Evaluation of the Drug Treatment Funding Program Canadian Centre on Substance Abuse September 8, 2011 to April 29, 2013 Evaluation Strategy for the Business and Regulatory Law Portfolio November 21, 2012 to April 1, 2013 Evaluation of the Public Law Sector November 15, 2011 to April 1, 2013 The Canadian Centre for Substance Abuse (CCSA) receives funding from Health Canada under the Drug Treatment Funding Program (national funding component for national or multi-jurisdictional initiatives). CCSA s DTFP project, Promoting Evidence- Based System Development, aims to coordinate and promote the implementation of specific recommendations pertaining to Canada s National Treatment Strategy. The project has four key components: providing support for the National Treatment Strategy leadership team; promoting and facilitating the implementation of the Tiered Model of services and supports; coordinating system measurement through the development of National Treatment Indicators; and developing a Knowledge Exchange framework. The Business and Regulatory Law Portfolio (BRLP) of the Department of Justice provides integrated legal advisory, litigation, and support for legislative drafting services to 37 client departments, agencies, and federal entities. The work of the BRLP covers several areas of the law, including those traditionally considered part of business law (e.g., commercial law, intellectual property law, procurement law, contract law, real property law, bankruptcy) as well as the legal areas that support the business lines of the client departments and agencies (e.g., environmental, administrative, aboriginal, transportation, health). PRA worked with an advisory committee to develop an evaluation strategy (logic model, performance measures, evaluation matrix, and methodologies) for the BRLP. The Public Law Sector (PLS) provides highly specialized legal advice, litigation services and support, and support for legislative and regulatory drafting services to counsel within the Department of Justice (DOJ). In doing so, the Sector assists the Department in coordinating legal advice across government and central agencies. The purpose of this evaluation was to assess the PLS in terms of relevance (continued need, alignment with government priorities and federal roles and responsibilities) and performance (effectiveness, efficiency, and economy). As project director, Amy oversaw all aspects of data collection, including document and data review, key informant interviews, and the online survey. As project director, Amy designed the evaluation and data collection instruments. She also oversaw all aspects of the evaluation. Amy directed this multi-method evaluation, which included a document, literature, and data review; key informant interviews with officials and representatives of the PLS client department/agencies; a file review; case studies of 10 files that focus on complex matters and demonstrate how the PLS handles high profile files; and focus groups with client groups.

4 Evaluation of the Tax Law Services Portfolio September 28, 2011 to March 11, 2013 Evaluation of the Enabling Accessibility Fund Human Resources and Skills Development Canada October 26, 2010 to June 25, 2012 Development of Integrated Logic Model and Evaluation Framework Institute for Safe Medication Practices in Canada March 19, 2012 to May 28, 2012 The Tax Law Services (TLS) Portfolio was created in 1995 to provide legal services (including litigation and advisory services) in all areas of tax law to the Canada Revenue Agency (CRA). This evaluation assessed the extent to which the TLS Portfolio provided effective and responsive legal services to the CRA. The evaluation aimed to address key issues related to: rationale and relevance (i.e., the continued need for TLS Portfolio services and their alignment with government priorities and strategic outcomes); effectiveness (i.e., the degree to which expected outcomes are being achieved); and efficiency and economy (i.e., the degree to which the most appropriate and efficient means are being employed to achieve desired outcomes). The Enabling Accessibility Fund (EAF) is a federal initiative with the overall objective of enabling Canadians with disabilities to participate in the economy and their communities, regardless of physical ability. The program began in 2007 with a three-year budget of $45 million, and Budget 2010 announced its extension for another three years with an additional $45 million. Phase I of the Summative Evaluation of the EAF was the first part of a multi-part evaluation strategy developed by Human Resources and Skills Development Canada (HRSDC). It was developed in response to Treasury Board s requirement that the department conduct an evaluation of the program after March 31, PRA was contracted to conduct the evaluation. The main objective of the evaluation generally, and of Phase I specifically, was to examine issues of relevance and performance of the EAF, including effectiveness, efficiency, and economy. PRA developed a combined evaluation and performance measurement framework to support the upcoming evaluation of the Institute for Safe Medication Practices Canada s (ISMP Canada s) activities under the Canadian Medication Incident Reporting and Prevention System (CMIRPS). The framework built on work undertaken as part of the 2010 evaluation of ISMP Canada s CMIRPS activities, also conducted by PRA. It was intended to support the next evaluation, which, under the terms of ISMP Canada s contribution agreement with Health Canada, was to occur in To develop the framework, ISMP Canada hosted a two-day workshop with three participants from ISMP Canada and a representative of Health Canada. The workshop was facilitated by PRA. As project director, Amy designed the evaluation and data collection instruments. She also oversaw all aspects of the evaluation. As project director, Amy served as a resource to the project team and reviewed deliverables. Amy led the project, facilitated the workshop, and drafted all deliverables.

5 Evaluation Strategy for the Litigation Branch August 5, 2011 to April 16, 2012 Safer Care for Older Persons (in residential) Environments (SCOPE) Evaluation University of Alberta February 6, 2011 to March 12, 2012 Assessing the Impact of the Spousal Support Advisory Guidelines February 9, 2011 to February 13, 2012 Consultation on Revisions to the 2006 Root Cause Analysis Framework Canadian Patient Safety Institute June 13, 2011 to January 6, 2012 The Litigation Branch is one of the specialized groups within that provide legal services to departments and agencies to help them meet their policy and programming priorities and advance the overall objectives of the government. To respond to the Treasury Board evaluation requirements that all direct program spending be evaluated, needed to develop evaluation strategies for all of its legal services. PRA was engaged to develop the evaluation strategy. The Safer Care for Older Persons (in residential) Environments (SCOPE) program was a two-year ( ) pilot study aiming to improve work life, patient care, and safety in long-term care facilities (nursing homes). It was based at the University of Alberta s Faculty of Nursing and funded by Health Canada through the Health Care Policy Contribution Program (HCPCP). PRA assisted the University of Alberta, Faculty of Nursing with their evaluation of the SCOPE program. In September 2001, the Department of Justice sponsored the development of a set of guidelines to respond to concerns about the inconsistency and discretionary nature of Canadian spousal support law. The Spousal Support Advisory Guidelines (SSAG) are designed to be used within the existing legislative framework to aid lawyers, mediators, judges, and spouses in decisions about the amount and duration of spousal support, after a finding of entitlement. The Department of Justice hired PRA to conduct a research study to evaluate the use of the SSAG, and to assess the impact of the SSAG on the process of determining the amount and duration of spousal support. The Canadian Patient Safety Institute (CPSI) is a not-forprofit organization that aims to raise awareness and facilitate the implementation of best practices to improve patient safety. CPSI revised the Root Cause Analysis Framework first published in 2006 and proceeded with consultations to receive stakeholder input. CPSI retained the services of PRA in order to evaluate the revised framework. Amy reviewed documents, cofacilitated the workshop, and drafted all deliverables. Amy directed this project. In that capacity, she reviewed deliverables and served as client liaison. Amy was the legal advisor for this project and assisted with interviews. Amy was project director and oversaw all aspects of the project, including instrument design, survey management, and reporting.

6 Evaluation of the Youth at Risk Development Program Public Safety and Emergency Preparedness Canada September 18, 2008 to August 22, 2011 Legal Aid Program Impact Evaluation August 26, 2010 to August 15, 2011 Performance Analysis of the Canadian Innovation Commercialization Program Public Works and Government Services Canada February 14, 2011 to May 2, 2011 Evaluation Design Study of the Tax Law Services Portfolio September 17, 2010 to April 25, 2011 The Youth at Risk Development (YARD) program is a joint initiative of the Calgary Police Service (CPS) Community and Youth Services Section (CYSS) and the City of Calgary Community and Neighbourhood Services (CNS) Children and Youth Services (CYS) branch. The YARD program targets youth between the ages of 10 and 17 who are gang-involved or at risk of engaging in gang-related activity, with the aim of intervening prior to heavy gang involvement. YARD also engages the youths families. PRA conducted an evaluation of the YARD program over three years. s Legal Aid Program manages federal contributions to legal aid across Canada, with the goal of enabling provinces and territories to deliver legal aid to economically disadvantaged people. This evaluation investigated the impacts of the program through each of its five components: federal contributions to legal aid for criminal and youth criminal justice in provinces and territories, as well as civil legal aid in the territories; immigration and refugee legal aid funding; Public Security and Anti-Terrorism legal aid funding; funded counsel for court-ordered counsel in federal prosecution; and the secretariat for the Permanent Working Group on Legal Aid. The Canadian Innovation Commercialization Program (CICP) is a two-year initiative intended to encourage innovation in Canada s business sector. Through CICP, the federal government awards contracts to entrepreneurs with innovations at the precommercialized stage of development; offers feedback on products/service performance; provides innovators the opportunity to enter the marketplace; and provides information on how to do business with the government. PRA was hired to analyze the performance of the CICP. The April 2009 Treasury Board Evaluation Policy required that all direct program spending be evaluated. To respond to the new evaluation requirements, the Department of Justice hired PRA to develop an evaluation framework for Tax Law Services Portfolio (TLS). The framework included a description of TLS, including a description of its program logic; an evaluation matrix that identified the evaluation issues and questions, along with their proposed indicators and data sources; and a proposed methodology for the evaluation. was involved in research design and in all aspects of data collection and reporting. She conducted interviews with program staff, stakeholders, and youth. As project director/manager, Amy drafted all deliverables, conducted interviews, oversaw the document and data review, and served as client liaison. She also presented the findings to the senior team at Justice. As project director, Amy reviewed all deliverables, conducted interviews, and served as client liaison. Amy served as the client liaison, reviewed documents, cofacilitated the workshop, and drafted all deliverables.

7 Formative Evaluation of the Specific Claims Action Plan Indian and Northern Affairs Canada June 15, 2010 to March 14, 2011 Evaluation of the Canadian Medication Incident Reporting and Prevention System Institute for Safe Medication Practices in Canada May 3, 2010 to October 25, 2010 Summative Evaluation of the Youth Justice Initiative Funding Components June 9, 2009 to June 14, 2010 In June 2007, the federal government launched the Justice At Last: Specific Claims Action Plan, in order to improve the process by which it addressed specific claims that First Nations have made against the federal government. Typically, these claims are related to the administration of land and other First Nations assets and the fulfillment of Indian Treaties. The primary purpose of this evaluation was to assess how the Action Plan has impacted the Specific Claims process and affected the roles and responsibilities of different stakeholders. The evaluation was conducted by PRA under the direction of the EPMRB and with the support of an advisory committee comprising of representatives from the Specific Claims Branch and the Department of. The Canadian Medication Incident Reporting and Prevention System (CMIRPS) is a national, collaborative effort led by Health Canada, the Institute for Safe Medication Practices Canada (ISMP Canada), the Canadian Institute for Health Information (CIHI), and the Canadian Patient Safety Institute (CPSI). The goal of CMIRPS is to strengthen Canada s ability to minimize and prevent harmful medication incidents, as well as to manage and share knowledge about voluntary reported medication incidents. ISMP Canada engaged PRA to conduct this evaluation of its CMIRPS services. The evaluation focused on the impact of the products/services offered by ISMP Canada and their associated risk reduction and financial impact (i.e., value for money). The Youth Justice Initiative (YJI) is a multi-faceted approach to youth justice designed to encourage a fairer and more effective youth justice system, respond to emerging youth justice issues, enable greater citizen/community participation in the youth justice system, and support federal policy objectives through the delivery of youth justice services. The primary purpose of this evaluation was to assess the relevance, program design and implementation, success, and costeffectiveness and alternatives for each of the three funding components of the YJI for the fiscal years to An Evaluation Advisory Committee (EAC) from the DOJ guided the evaluation. As a team member, Amy conducted key informant interviews and assisted with the file review. As project director, Amy served as client liaison, designed the instruments, conducted interviews, document and data review, managed the survey, and drafted the final report. As project director, Amy oversaw all aspects of this project, including reviewing all deliverables and assisting with the evaluation design and final reporting.

8 Evaluation Strategy for the Department of Justice Policy Function February 22, 2009 to April 5, 2010 Evaluation of the Victims of Crime Protocol Alberta Solicitor General and Public Security July 2, 2008 to March 22, 2010 Implementation Evaluation of the National Anti-Drug Strategy December 8, 2008 to February 1, 2010 The new Treasury Board Evaluation Policy expands evaluation requirements beyond grants and contributions to include all direct program spending. To respond to the new evaluation requirements, the Department of Justice developed an evaluation strategy for its policy function. The evaluation strategy was to provide a research plan so the Department will be able to demonstrate whether its policy work is relevant, effective, efficient, and of high quality. The objective of the evaluation strategy of the policy function was to identify and address gaps in evaluation coverage. To identify gaps and to formulate a preliminary evaluation strategy, the Evaluation Division and PRA conducted two rounds of interviews with management and senior counsel across the Department of Justice. The resulting evaluation frameworks focused on areas of the Department without evaluation coverage. Alberta Solicitor General and Public Security engaged PRA to conduct a formative evaluation of their recently implemented Victims of Crime Protocol. The Protocol includes a handbook for victims of crime that outlines, step-by-step, what to expect from the criminal justice system. It also includes a roles and responsibilities binder for criminal justice service providers. The evaluation measured the benefits of the Protocol, identified how it assists victims of crime, and identified opportunities for improvement. The National Anti-Drug Strategy is a horizontal initiative of 12 federal departments and agencies, led by the Department of (DOJ). The Strategy is comprised of approximately 20 different programs and has as its overall goal to contribute to safer and healthier communities through coordinated efforts to prevent use, treat dependency, and reduce production and distribution of illicit drugs. The primary purpose of the implementation evaluation was to assess the extent to which the Strategy has been implemented as planned. Amy directed this project. In that capacity, she drafted all deliverables, and conducted interviews. Amy drafted three unique evaluation frameworks for this project. Amy directed the project and in that capacity was responsible for research design, management of all data collection activities, data collection, and reporting. Amy co-directed this project. She assisted as client liaison, conducted interviews, and participated in the document review.

9 Evaluation Framework for Legal Risk Management in the Department of Justice January 6, 2009 to August 31, 2009 Evaluability Assessment, Evaluation Framework and Plan for the Safe Communities Secretariat Alberta Justice August 27, 2008 to August 17, 2009 Environmental Scan of Policy and Legislation as it Relates to Skin Cancer Prevention Canadian Partnership Against Cancer August 5, 2008 to May 19, 2009 Summative Evaluation of the Drug Treatment Court Funding Program September 8, 2008 to April 15, 2009 Legal risk management (LRM) involves taking actions to reduce the negative impacts that legal risks entail to the Government. LRM includes the identification, assessment, communication, reporting, prevention, mitigation, and management of legal risks. In 2008, the Department evaluated LRM. In response to one of the evaluation s recommendations, PRA was contracted to develop an evaluation framework. This framework was to assist the Department in preparing for the next evaluation of LRM, which would focus less on implementation and more on results and the effectiveness of the changes to LRM since the 2008 evaluation. The Safe Communities Secretariat (the Secretariat) also known as SafeCom was established in April 2008 in response to Alberta s Crime Reduction and Safe Communities Task Force report, Keeping Communities Safe: Report and Recommendations. The Secretariat, composed of nine partnering ministries, had a threeyear mandate to develop a province-wide crime reduction and prevention strategy and to coordinate the implementation of the Task Force s recommendations. The Canadian Partnership Against Cancer was established to implement the Canadian Strategy for Cancer Control and to foster the sharing of knowledge about cancer prevention, screening, diagnosis, and treatment across Canada. PRA conducted an environmental scan of policy and legislation as it relates to skin cancer. The scan had two components: a compilation of government legislation and policies that promote skin cancer prevention behaviour settings; and a review of recent literature on evidence-based strategies and best practices in legislation and policies. The Drug Treatment Court Funding Program (DTCFP) is a contributions funding program that provides financial support and administers funding agreements to six drug treatment court (DTC) sites that were selected through a call for proposals. The six sites include two original DTCs in Toronto and Vancouver and an additional four DTCs located in Edmonton, Winnipeg, Ottawa, and Regina. This evaluation examined issues of relevance, design and delivery, success, and costeffectiveness/alternatives. Amy conducted the document review, co-facilitated the workshop, and had primary responsibility for drafting the evaluation framework. was involved in designing the strategy for conducting the assessment, conducting consultations with the partnering ministries, reporting on the situational analysis, and developing the evaluation framework and plan. Amy directed this project. She oversaw a team that conducted the legislative and policy scan and drafted the final report. Amy served as co-director. In that capacity, she served as client liaison, designed the evaluation and the data collection instruments, conducted interviews, and participated in reporting.

10 Evaluation of the Canadian Institutes of Health Research HIV/AIDS Community-Based Research Program Canadian Institutes of Health Research June 24, 2008 to April 6, 2009 Survey of Roster and Non- Roster Lawyers Legal Aid Alberta March 8, 2008 to August 29, 2008 Evaluation of Legal Risk Management in the Department of Justice December 7, 2007 to August 13, 2008 Needs Assessment for Legal Aid Alberta Legal Aid Alberta April 17, 2007 to July 14, 2008 The Canadian Institutes of Health Research (CIHR) hired PRA Inc. to evaluate the Human Immunodeficiency Virus (HIV)/Acquired Immunodeficiency Syndrome (AIDS) Community-Based Research (CBR) Program and its funding tools. The purpose of the evaluation was to assess the rationale for the program, the effectiveness of its design and delivery processes, and its successes. The CBR Steering Committee and the Canadian Institutes of Health Research (CIHR) used the results of the evaluation to strengthen the program maximize its impact on Canada s response to the HIV/AIDS epidemic. Legal Aid Alberta wanted to get a better understanding of lawyers concerns about handling legal aid certificates, and how it might improve the legal aid system and encourage lawyers to represent legal aid clients. PRA was hired to conduct separate surveys of active legal aid roster lawyers, and lawyers who practice in areas covered by legal aid but who have not recently handled legal aid certificates. Legal risk management involves taking actions to reduce the frequency and severity of legal problems that limit the government s ability to meet its objectives. Recognizing that the management of legal risk has always been an inherent part of every lawyer s work, the federal government developed the Legal Risk Management (LRM) Initiative in 1999 in order to bring a more systematic approach to identifying, mitigating, and managing legal risks. The purpose of this evaluation was to examine how legal risk management has been implemented in the Department of Justice and to assess whether the structures and processes put in place to support legal risk management contribute to the effective management of legal risk in the federal government. The results of the evaluation were used to provide strategic advice to senior management of the Department of Justice. As part of its commitment to facilitate equal access to justice, Legal Aid Alberta (LAA) desired a needs assessment to review its programs and services. LAA hired PRA to conduct this research. The objectives of the needs assessment were to determine whether LAA was meeting the legal needs of low-income Albertans and to assist LAA in improving programming. Amy directed this project. She served as client liaison, conducted interviews, and assisted with facilitating the workshop, as well as reporting, Amy served as project director and oversaw all aspects of the project, which included instrument design, survey management, and reporting. designed the research and was involved in all aspects of data collection and reporting. Amy also presented preliminary findings to the Evaluation Advisory Committee, which included representatives from across the Department of Justice. designed the research and was involved in all aspects of data collection and reporting. Amy also presented findings at a oneday workshop with LAA senior management.

11 Formative Evaluation of the Court Services Law Information Centres Alberta Justice October 17, 2007 to June 30, 2008 Review of the Provision of Brydges Duty Counsel Services Legal Aid Alberta July 27, 2007 to February 19, 2008 Research and Evaluation Services for Alberta Legal Aid and Court Services Legal Aid Alberta and Alberta Justice February 14, 2006 to January 22, 2008 Consultations on Proposed National Guidelines on the Disclosure of Adverse Events Canadian Patient Safety Institute February 7, 2007 to August 16, 2007 Alberta Justice engaged PRA to conduct a formative evaluation of their Law Information Centres (LInCs). LInCs are a new initiative of Alberta Justice with locations in Edmonton, Red Deer, and Grande Prairie. LInCs are intended to address the increasing number of self-represented litigants (SRLs) coming to court. SRLs are often unfamiliar with the justice system and confused about how to go about resolving their legal issues. LInCs assist SRLs by providing them with legal information, assistance with court forms, and referrals to other agencies that can assist them. Legal Aid Alberta (LAA) desired a review of its Brydges duty counsel services and engaged PRA to conduct the review. Brydges services, which are offered by legal aid plans across Canada, most often consist of immediate legal information and advice given over the telephone to a detained person. The main objectives of the review were to examine if LAA s Brydges services and its various service delivery methods were meeting the needs of detainees requiring immediate legal advice; ascertain the level of client satisfaction; determine if there were any service gaps; and assess any differences in outcomes related to the first three objectives among each of the three service delivery models. Legal Aid Alberta and Alberta Justice Court Services contracted PRA to conduct a research study on the impact of changes in courts intake and legal aid application. These changes to intake and legal aid application were made in response to the new Family Law Act enacted in October, Research objectives were to examine the number of self-represented family law litigants, make some comparisons to sites where intake and/or the legal aid application process had not changed, and assess the implications of expanded legal aid coverage and court intake services. The Canadian Patient Safety Institute (CPSI) and the National Disclosure Working Group (NDWG) developed draft National Guidelines for the Disclosure of Adverse Events for health care organizations. These guidelines built on various disclosure initiatives underway across Canada. The CPSI conducted a nation-wide consultation with health care organizations and stakeholders regarding the draft guidelines. As part of this consultation, PRA conducted an online survey with representatives of health care and related organizations in order to obtain feedback that was to be used to finalize the guidelines. oversaw project design, data collection, and reporting. oversaw project design, data collection, and reporting. oversaw project design, data collection, and reporting. Amy served as project director and oversaw all aspects of the project, which included instrument design, survey management, and reporting.

12 Evaluation of Phase 1 of the Safer Healthcare Now! Campaign Canadian Patient Safety Institute October 25, 2006 to July 31, 2007 Evaluation of the Civil Mediation Program of the Court of Queen s Bench of Alberta Alberta Justice August 17, 2006 to May 31, 2007 Summative Evaluation of the Department of Justice Public Safety and Anti-Terrorism Initiative August 24, 2006 to March 31, 2007 Domestic Violence Court Program Evaluation Ontario Ministry of the Attorney General July 4, 2005 to May 9, 2006 The Canadian Patient Safety Institute (CPSI) engaged PRA to conduct an evaluation of Phase 1 of Safer Healthcare Now! (SHN). SHN is a campaign to enrol health care organizations across Canada in implementing targeted interventions intended to promote patient safety and improve quality of care. The evaluation of SHN assessed the project s implementation and achievements. The Civil Mediation Program (CMP or the Program ) of the Court of Queen s Bench of Alberta is a pilot program that operates in two sites: the Judicial Districts of Edmonton and Lethbridge/MacLeod. In January 2005, CMP began offering interest-based mediation through a roster of qualified mediators to eligible civil, non-family cases filed in the Court of Queen s Bench. The evaluation considered the Program s implementation and effectiveness after just over two years of operation. In response to the September 11 th terrorist attacks on the United States, the Canadian government announced the Public Safety and Anti-Terrorism (PSAT) Initiative (or the Initiative ) to support the government s commitment to fight terrorism and address related national security and public safety concerns. In order to fulfil Treasury Board reporting requirements, the DOJ contracted with PRA to conduct a summative evaluation of the DOJ component of the PSAT Initiative. The summative evaluation built upon the 2005 formative evaluation, which focused on the issues of design, effectiveness and efficiency. It assessed the relevance, success, and cost-effectiveness of the DOJ s contribution to the PSAT Initiative, as well as the effectiveness of the performance measurement system in documenting outcomes. The Domestic Violence Court (DVC) Program is a specialized process for handling domestic violence cases. The goal of the Program is to intervene early, improve victim support, and increase the effectiveness in how domestic violence cases are investigated and prosecuted so that offenders are held accountable. The mandate of this evaluation was to assess the efficiency and effectiveness of the DVC Program, identify areas for improvement, and consider the experiences of diverse communities with the DVC. oversaw the consultation process, conducted three of the consultations, developed the evaluation design, conducted interviews with health care professionals, managed the data collection, and wrote the final report. designed the evaluation and a program logic model and conducted all aspects of data collection including interviews; survey with lawyers; analysis of mediation feedback forms; a document review of CMP documentation; Court of Queen s Bench data; and evaluations of other civil mediation programs. liaised with the client, conducted key informant interviews with senior government officials, and reviewed Department of Justice data on its activities under the Initiative and relevant literature. oversaw and participated in all aspects of the project.

13 Evaluation of the Manitoba Victims Bill of Rights Manitoba Justice October 18, 2005 to March 31, 2006 Operational Review of Legal Aid Manitoba Legal Aid Manitoba March 3, 2005 to March 27, 2006 Evaluation of the Canadian Centre for Professional Legal Education Training and Licensing Program Canadian Centre for Professional Legal Education February 26, 2005 to March 6, 2006 Evaluation of "Strengthening our Circle": A Model of Community Support National Crime Prevention Centre November 4, 2002 to February 28, 2006 This evaluation of Manitoba s Victims Bill of Rights (VBR) considered the delivery of services to victims under the VBR, gaps and barriers in service delivery, and compared VBR with victims legislation and service delivery in other jurisdictions. Legal Aid Manitoba (LAM) contracted PRA to conduct an operational review to determine how to maintain its core services and maximize its efficiency given the current level of funding. The review involved three main modes of evaluation. A financial evaluation of LAM s service delivery model determined whether LAM administered its resources efficiently and effectively. A review of LAM s mixed model of service delivery determined whether this approach was most effective for delivering services. The study also reviewed LAM s specialized services and compared them to legal aid programs in other provinces. The Canadian Centre for Professional Legal Education (CPLED) program is a multi-jurisdictional effort among the legal profession's governing bodies and educational organizations in Alberta, Manitoba, and Saskatchewan. The three participating law societies undertook an operational evaluation to consider whether the CPLED training and licensing program was working as intended and to provide preliminary information on outcomes. The Strengthening Our Circle project was a multi-year demonstration pilot focusing on children and youth (Kindergarten to Grade Nine) through a school-based peer support model centred on caring, respect, responsibility, and strong community support. The Research and Evaluation Section of the National Crime Prevention Centre (NCPC), Department of Justice Canada hired PRA to conduct a process and outcome evaluation of the Strengthening Our Circle project. In addition to the evaluation, a "theory of change" model was developed and costing data collected. This evaluation enabled NCPC to respond to and expand on Canadian crime prevention experience and knowledge. Furthermore the evaluation allowed NCPC to understand more fully the elements of an effective approach to dealing with the multiple risk factors linked with indicators of criminal behaviour in children. As co-project manager, Amy was involved in all aspects of this research. Amy s responsibilities included key informant interviews, and survey management. Amy was responsible for all aspects of the project, including client liaison, instrumentation, survey management, interviewing, and reporting. managed data collection; attended site visits; conducted interviews; oversaw administration of surveys; analyzed data; and wrote the process, outcome, and final reports.

14 Survey of Lawyers Legal Aid Alberta July 13, 2005 to September 23, 2005 Comparison of Legal Aid Plans Legal Aid Alberta May 17, 2005 to August 17, 2005 Evaluation of the Nurse Practitioners Demonstration Project Ontario Ministry of Health and Long-Term Care September 23, 2004 to July 11, 2005 Consultations for the Manitoba Institute for Patient Safety Manitoba Institute for Patient Safety February 12, 2005 to June 5, 2005 Evaluation Framework for the Winnipeg Partnership Agreement City of Winnipeg, Province of Manitoba, Western Economic Diversification Canada December 16, 2004 to March 31, 2005 LAA requested that PRA conduct a survey with lawyers who practice in areas of law covered by legal aid, but who have not recently handled legal aid certificates. The survey was intended to help LAA understand lawyers' concerns about handling legal aid certificates, and how it might improve the legal aid system and encourage lawyers to represent legal aid clients. LAA conducted two in-depth comparisons of LAA and other provincial and territorial legal aid plans across a number of key indicators, such as revenues, funding sources, expenditures, type of delivery model, eligibility requirements, tariff structures, and services. In May 2002, the Ministry initiated the Nurse Practitioners (NP) Demonstration Project. The Ministry provided $3 million annually for three years to place up to 22 NPs in 12 underserviced communities. MOHLTC conducted the evaluation of the NP Demonstration Project to assess the project s effectiveness in improving access to primary health care services, to evaluate the project s design, implementation, and ongoing administration, and to identify recommendations for program improvements. Incorporated in May 2004, the Manitoba Institute for Patient Safety (MIPS) is a non-profit organization intended to support activities designed to enhance patient safety and quality care in Manitoba. To assist in the development of its strategic direction, MIPS asked PRA to conduct a series of consultations across Manitoba to gather input from stakeholders on patient safety issues and priorities. This consultation process included front-line service providers and the public at 15 sites, including three First Nations communities. The Winnipeg Partnership Agreement is a five-year urban development agreement between the Governments of Canada and Manitoba and the City of Winnipeg, which is intended to coordinate and implement a community and economic development strategy for Winnipeg. PRA developed an evaluation framework that included a program profile, a logic and performance model, and an evaluation matrix and methodology. Amy served as project manager. She designed the mail-out survey questionnaire, managed the survey, and was responsible for the reporting. As project director, Amy oversaw all aspects of this project. Amy conducted two site visits, consisting of interviews and a document review, which were analysed in a site visit report. oversaw the consultation process, conducted consultations in eight of the sites, and wrote the final report. served as the client liaison and assisted in all aspects of the work.

15 Evaluation of Family Law Case Management Manitoba Justice January 20, 2004 to October 6, 2004 Evaluation of the Family Law Project Legal Aid Alberta October 3, 2001 to September 17, 2004 Evaluation of the First Nations and Inuit Home and Community Care Program (Study 1) Health Canada February 23, 2003 to July 12, 2004 Saskatchewan Family Violence Tracking Study Saskatchewan Justice April 4, 2000 to March 31, 2004 In November 1995, the Court of Queen's Bench (Family Division) judiciary, working with Court Administration and the Family Law Bar, began the Case Management Pilot Project in the Court of Queen s Bench (Family Division), Winnipeg Centre. Initially, 10% of Family Division cases were randomly selected to enter the case management process. However, after a 1998 evaluation of the pilot project found that case management was achieving its objectives, case management was continued at 20%, and, as of November 1, 2002, 100% of eligible cases in the Court of Queen s Bench (Family Division), Winnipeg Centre must enter case management. As a follow-up to the 1998 evaluation, the Court of Queen's Bench (Family Division), through the federal Department of Justice Child-Centred Family Justice Fund, commissioned this evaluation to study the case management process since 100% case management began. Two pilot Family Law Offices opened in Alberta in Legal Aid Alberta commissioned this study of the pilot offices to determine whether they improve access to family law legal aid services and whether they are costeffective. The study included surveys with legal aid clients and family lawyers; key informant interviews with judges and legal aid staff; the development of a baseline measure for the current system of providing family law legal aid; and monitoring the new Family Law Offices The First Nations and Inuit Home and Community Care Program (FNIHCCP or "the Program") was launched by the federal government through the First Nations and Inuit Health Branch (FNIHB) of Health Canada in late The purpose of the Program was to address the growing need for home care and local care services in First Nation and Inuit communities. This was the first of three FNIHCCP evaluation studies. This study was designed to track police, Crown, and the court system s responses to family violence. Tracking was done at two sites over a one-year period, and the results were entered into a database for analysis. The research also included interviews with victims and key informants. was responsible for all aspects of the project, including client liaison, instrumentation, survey management, interviewing, analysis of administrative data, and preparation of interim and final reports. was responsible for client liaison, instrumentation, survey management, interviewing, data analysis, and report writing. For this study, Amy conducted two site visits consisting of interviews, focus groups, and a document review, which were analysed in a site visit report. Amy also assisted with key informant interviews. Amy co-managed this study.

16 Measures to Combat Organized Crime Formative Evaluation July 4, 2003 to January 5, 2004 Multi-Site Survey of Victims of Crime and Criminal Justice Professionals Across Canada March 4, 2002 to October 22, 2003 Evaluation of the Canada Prenatal Nutrition Program: Case Study Component Health Canada January 23, 2003 to February 10, 2003 Evaluation of the NOR-MAN Community Nurse Resource Centre Manitoba Health March 8, 2002 to December 19, 2002 Inventory and Assessment of Services and Resources in Winnipeg Related to Bloodborne Pathogens: HCV, HIV and Co-infection Health Canada, Winnipeg Regional Health Authority, and the Hepatitis C Society of Canada, Manitoba Chapter April 30, 2001 to March 18, 2002 On April 5, 2001, the Government of Canada announced the Measures to Combat Organized Crime Initiative. This formative evaluation examined the relevance, design and delivery (appropriateness),and early outcomes of the Department of Justice component of the Initiative. The purpose of this study was to document information on a wide range of issues concerning the criminal justice system as it pertains to victims and criminal justice professionals, with a particular emphasis on then-recent Criminal Code provisions. Findings from this study provided insight into use and awareness of reforms by criminal justice professionals as they pertain to victims of crime; the nature of information provided to victims during the criminal justice process; victims' experiences with the legal provisions and other services that are intended to benefit them throughout the criminal justice process; and barriers to the implementation of reforms for criminal justice professionals. The six case studies included in this research provide the qualitative dimension to a larger evaluation of the Canada Prenatal Nutrition Program (CPNP). The case studies involved interviews, focus groups, and document reviews. The NOR-MAN Community Nurse Resource Centre (CNRC) provides health information and services to two northern Manitoba communities. This evaluation used key informant interviews, focus groups, a document review, and general population and client surveys to consider the work of the CNRC. The purpose of this research was to develop an inventory of existing resources in Winnipeg for people with HCV, HIV, and co-infection; to identify gaps; and to provide recommendations to fill these gaps. oversaw and participated in all aspects of the project. Amy co-managed this project and was involved in instrumentation, data collection, analysis, and reporting. Amy conducted one of the case study site visits (which was a First Nations community) and analysed the data in a site report. was involved in preparing the instrumentation and gathering, analysing, and reporting the data. Amy was involved in conducting interviews, analyzing the data, and reporting the findings.

17 A Client-Focused Needs Assessment for Low-Income Francophones Legal Aid Ontario August 1, 2001 to January 29, 2002 Legal Aid Ontario conducted an assessment to determine how best to provide legal services to lowincome francophones in Ottawa. This study was based on focus groups, key informant interviews, and a telephone survey of past and potential francophone clients of community legal clinics. Amy designed all of the instruments used in this study and conducted some interviews. She also managed the telephone survey. Publication "Supranational Institution Building in the European Union: A Comparison of the European Court of Justice and the European Central Bank," Journal of European Public Policy 9 (April 2002): (co-authored with Dorothee Heisenberg).