College of Dietitians of Ontario

Transcription

1 College of Dietitians of Ontario Request for Proposals The College of Dietitians of Ontario seeks a consultant to evaluate the achievement and impact of the College s goal to support Registered Dietitians (RDs) in Ontario to provide safe, competent and ethical practice. 1.0 About the College of Dietitians of Ontario The College of Dietitians of Ontario exists to regulate and support all RDs in the interest of the public of Ontario. We are dedicated to the ongoing enhancement of safe, ethical and competent nutrition services provided by RDs in their fields of practice. The College of Dietitians of Ontario is one of 22 health regulatory bodies in Ontario established by the Regulated Health Professions Act to protect the public s right to safe, effective, ethical health care. The College was founded and incorporated in 1993, and has the authority under the Regulated Health Professions Act and Dietetics Act to: Establish requirements for becoming a dietitian in Ontario Issue certificates of registration to dietitians who are qualified to practice dietetics in Ontario Set and monitor high standards of conduct and practice Promote continuing competence among members Help individuals exercise their right to quality dietetic services by investigating complaints about dietitians Assist dietitians with remediation or impose sanctions against dietitians who have been found incompetent or have behaved in an unprofessional way Support planning for an adequate supply of RDs in Ontario. The College has a governing board called a Council headed by a President and an administrative staff headed by a Registrar & Executive Director. The Council governs the College and is responsible for establishing the policies, programs, and standards that regulate the profession of dietetics; the staff is responsible for supporting the policy work of the Council and Committees and administering the College programs. There are seven committees, which are required under the Regulated Health Professions Act. The College has a staff of 9.4 FTE (ten people) and an annual expenditure of approximately $1.5 million. Revenues are from membership fees. Presently, the College has almost 3000 members. 1

2 2.0 Strategic Goals and Programs The strategic goals of the College are articulated in its strategic plan ( ) and are accomplished through its programs, products and services. STRATEGIC GOALS 1. Support RDs to provide safe, ethical and competent services to people in Ontario. 2. Support the public's access to the services of RDs. 3. Develop a CDO Regulatory Standards Framework 4. Ensure Effective Compliance with CDO Standards A detailed strategic plan is available at: PROGRAMS The College s programs contribute to the achievement of the strategic goals. te that a number of programs can contribute to the achievement of a single goal. 1. Patient Relations Program The Patient Relations Program provides information and services to support the public s access to RDs and the College s services. 2. Registration Program The primary goal of the Registration program is to ensure that only qualified and competent people become RDs in Ontario, that only the College s members use the RD title, and that registration practices are fair, objective, transparent and impartial. The Program ensures that the College has accurate information and financial resources to regulate and support RDs in the interest of the public. The other focus is the College s collaborative work to increase the supply of RDs by expanding practical training opportunities in Ontario. 3. Standards and Compliance Program Standards and Compliance develops and maintains programs and standards to assist individuals to exercise their rights under the Regulated Health Professions Act, 1991 (RHPA) and to ensure that RDs practice competently and ethically in keeping with the standards and laws that affect them. 4. Quality Assurance Program The Quality Assurance Program develops, operates and monitors learning and assessment tools to support RDs in continuing competency and education to enhance the delivery of high quality dietetic services to the Ontario public. 5. Practice Advisory Practice Advisory supports compliance with standards, provides advice, assistance and education to members on practice issues such as standards, laws, ethics and regulations. For further information about the College and its programs, please visit our website at The Results-Based Management Accountability Framework The College has a history and culture of assessment. In the Fall of 2007, the College Staff, with the guidance of a facilitator, developed a Results-based Management Accountability Framework (RMAF) and approach to measure and report on the performance of the organization s programs, products and services in an efficient and meaningful way. The two primary purposes for the framework are: 2

3 1. Accountability. We wanted the framework to enable us to demonstrate to our internal and external stakeholders accountability for competent regulatory and business practices and the achievement of our mandate, strategic goals and activities; 2. Management. We wanted the framework to enable us to manage our programs, services and products more efficiently and effectively by monitoring return on investment and identifying areas that need improvement through targets and benchmarking (where applicable). The RMAF includes: logic models for each of the five programs, in addition to one for the organization as a whole; performance measures for each program and the organization; a data collection framework; an evaluation strategy that includes key evaluation questions, our evaluation goals, and an evaluation plan for the first year; a communication plan. An evaluation cycle and reporting schedule are also included. See for an abridged version of the RMAF. 4.0 Statement of Need & Deliverables As part of our evaluation cycle, in 2009 we would like to evaluate how successful we have been in advancing the achievement of our goal to support RDs to provide safe, ethical and competent services to people in Ontario and to measure the impact of our efforts. Some of the questions that could be considered, for example, are: What tools or services have contributed to RDs feeling supported in their practice? Have RDs changed their practice as a result of any of the College s programs, tools or services? The College has conducted some evaluations that can assist in informing these questions and other questions that can be considered when evaluating how successful we have been in achieving our goal. For example, Since Spring 2007, we have been running a quarterly satisfaction survey on our Practice Advisory Service to those RDs who have used the service. In 2005, we evaluated the Jurisprudence Handbook for Dietitians in Ontario, a key tool the College developed to inform RDs on the laws that govern professional dietetic practice, with reference to the public interest principles that are at the root of professional ethics and laws. Our Quality Assurance Program has evaluated key tools used in its program; namely the Self-Directed Learning Tool (2005) and the Jurisprudence Knowledge & Assessment Tool (2007, 2008 and 2009). We have also done an evaluation on our quarterly newsletter, résumé (2006). See Appendix 1 for copies of these evaluations. The College has envisioned that it would be best to seek quantitative and qualitative data to determine our impact in supporting RDs to practice safely, competently and ethically, and that the measurement method might be a combination of an online survey to the entire College membership and interviews/focus groups with smaller groups of RDs in Ontario. However, we remain open to recommendations for different measurement method(s) that will enable the collection of information in a cost-effective manner. 3

4 The results of the evaluation will assist the College to identify areas of success and effectiveness and to address areas needing improvement. The results will feed into future program and strategic planning sessions. In the RMAF, we have a set of indicators of success that we would like to be used in addition to any other measures that would inform the evaluation. See Appendix 2 for the indicators of success outlined in the RMAF. Deliverables The College has decided to enlist the help of experts to do the following: 1. Design and conduct the evaluation of the goal, Support the College membership in providing safe, competent and ethical practice. This would include the design of the questions, survey, additional indicators of success and conducting interviews/focus groups (if these are the agreed upon methods). 2. Analyze the results and report on the findings to the College s Council in January Proposal Timelines Proposals due July 31, 2009 at 12:00 noon The College will be available to respond to vendors questions until July 24, Vendor selection target date: August 21, 2009 Detailed project planning and timeframes negotiated between College of Dietitians of Ontario and selected vendor August 24-September 4, 2009 and incorporated into the contract. The College and RDs will be engaged in annual membership renewal (August 15- October 31) and workshops on professional practice issues (September-vember). For these reasons, we would suggest conducting the evaluation from October-vember Proposal Content At a minimum, proposals should include the following: Detailed project plan, including the project development timelines showing steps, deliverables and milestones An explanation of your process for the survey and interview/focus group design and implementation. Or, if you feel that a different measurement method would be better, an explanation of that method and the benefits A description of the project team and each individual s role, qualifications and relevant experience A payment schedule based on specific deliverables and/or milestones Descriptions of comparable projects you have been involved with Three client references from similar organizations and projects and permission to speak to anyone within those organizations for reference. Total costs showing detailed cost structure, for example, per diems 7.0 Selection Criteria The College will use the following criteria to select the appropriate vendor: Value for price Cost structure Ability of process and approach to meet objectives of the College Demonstrated ability to meet timelines Proven experience with similar organizations and projects Customer references 4

5 If you have questions you would like answered before developing the proposal, please contact Antiope Papageorgiou, Quality Assurance & Information Coordinator at or ext 234 or before July 24, Please note that all responses will be shared with all vendors. Proposals will be used by the College to select a vendor and will remain confidential outside of the selection process. 8.0 Consultants Invited to Submit a Proposal The College has invited the following consultants to submit a proposal and has posted this Request for Proposal on the Canadian Evaluation Society s website. Association Research Centre Cathexis Consulting Ekos Research Assoc. Inc. Environics Communications Harry Cummings and Associates Inc. Ipsos Reid Leger Marketing Malatest & Associates Limited Metta Market Research RSG Research Strategy 9.0 Appendices APPENDIX 1: Samples of current surveys on College programs, products and services APPENDIX 2: RMAF Indicators of Success 5

6 APPENDIX 1: Samples of current surveys on College programs, products and services 1 PRACTICE ADVISORY SERVICE SURVEY, Have you used the Practice Advisory Service before? 2. How did you initially contact the Practice Advisory Service? Check all that apply. Phone Other (please specify) 3. Was the response timely? 4. Was your issue/question sufficiently addressed? 5. Did you find you had enough information to move forward with your inquiry? 6. Overall, how satisfied were you with the response you received from the Practice Advisory Service? Very Satisfied Somewhat Satisfied Neutral Somewhat Unsatisfied Unsatisfied 7. Would you use the Practice Advisory Service again? 8. Would you recommend the Practice Advisory Service to others following your experience? 9. What did you like about the service? 10. What improvements would you like to see in the Practice Advisory Service? 11. Any additional comments? 12. Please select your areas of practice. Check all that apply. Clinical Practice 1 te that questions on the surveys that are administered on a regular basis may be worded slightly differently from survey to survey depending on our needs at the time or refinements that were necessary. 1

7 Community (Includes: Population Health; Health Promotion and Chronic Disease Prevention; Food Security; Policy Development and Program Planning in Public/Population Health) Food & Nutrition Management Clinical Nutrition Management Quality Management Other Management Policy Development (Outside of Public Health/Population Health) Program Planning (Outside of Public Health/Population Health) Sales/Marketing Communication Academic Teaching and Education Research Other (please specify) 13. Please select your work setting(s). Check all that apply. Business and Industry (includes Health-Related, Retail and Commodities) Public Health Department Occupational Health/Corporate Wellness Media, Public Relations and Communications Agencies University Hospital including Chronic Care Institutions Rehabilitation Centre Elementary/Secondary School Home Care agency Research Facility Community Health Centre/Health Services Organization Long Term Care Organization Private Practice Family Health Team or Family Health Network Government (Federal or Provincial)Diabetes Education Centre n-government Organization and Association (e.g Heart &Stroke Foundation, Dietitians of Canada) Mental Health and Addiction Facility Cancer Centre Telephone Health Advisory Service Other (please specify) 2

8 EVALUATION OF THE JURISPRUDENCE HANDBOOK FOR DIETITIANS IN ONTARIO, How much of the Jurisprudence Handbook have you read? All Most Some ne 2. Have you used the Jurisprudence Handbook as a resource for dealing with ethical/legal questions or issues in your practice? N/A (since I have not had an ethical/legal issue to deal with) 3. Have you used the Jurisprudence Handbook as a resource for group discussion among Registered Dietitians and/or other health professionals? 4. Have you used the Jurisprudence Handbook as a resource for developing work place or practice policies? 5. Have you used the Jurisprudence Handbook as a resource for teaching, supervising or guiding other Registered Dietitians or dietetic interns? 6. Have you used the Jurisprudence Handbook for preparing for a Practice Assessment? 7. In the future, do you expect to use the Jurisprudence Handbook? 8. If you answered to question 7, specify any of the following future purposes: Dealing with ethical and legal issues. Group discussion. Policy development. Supervision/education 9. If you have used the Jurisprudence Handbook, do you feel more informed or more confident about ethics and laws affecting you as Registered Dietitian? Significantly Somewhat t at all N/A 10. If you have used the Jurisprudence Handbook, has it in any way changed any aspect of how you practice? Significantly Somewhat 3

9 t at all N/A 11. How would you rate the value of the Jurisprudence Handbook as a resource for yourself, where 1 is low and 5 is high? N/A 12. How would you rate the value of the Jurisprudence Handbook as a resource for the profession, where 1 is low and 5 is high? N/A 13. What additions or changes would you suggest for the Jurisprudence Handbook for future printings? 14. Your area of practice: Clinical nutrition or one-on-one client intervention Food and nutrition management Sales Marketing Policy Development Program Planning Clinical Nutrition Management Education Research Other (please specify) 15. Your status: Practicing RD Inactive 16. Years since completion of dietetic education: < > 30 4

10 EVALUATION OF 2005 SDL TOOL 1. Completion of the SDL Tool encouraged me to reflect on my practice. Strongly Somewhat Somewhat 2. Completion of the SDL Tool helped me to highlight gaps in my knowledge and skills. Strongly Somewhat Somewhat 3. Language used in the SDL Tool is easy to understand. Strongly Somewhat Somewhat 4. The amount of time taken to complete the SDL Tool is reasonable. Strongly Somewhat Somewhat 5. Rating the key indicators in the Professional Activity Areas allowed me to identify areas of my practice that need improvement or development. Strongly Somewhat Somewhat 6. The rating scales provided in the SDL Tool are appropriate for assessing my practice. Strongly Somewhat Somewhat 5

11 7. Completion of the Self-Assessment, Challenges & Barriers to Quality Practice and Evaluation of Professional Improvement Plans component of the SDL Tool prepared me to identify learning goals for my Professional Improvement Plans. Strongly Somewhat Somewhat 8. My practice will benefit from completion of the SDL Tool. Strongly Somewhat Somewhat 9. I contacted CDO staff and they answered my questions satisfactorily. Strongly Somewhat Somewhat 10. The Guide to Completing Your Self-Directed Learning Tool helped me to complete the Tool. Strongly Somewhat Somewhat 11. The Professional Development Portfolio is useful for tracking my other professional development activities and keeping a portfolio. Strongly Somewhat Somewhat 12. Any other comments? 6

12 EVALUATION OF THE JURISPRUDENCE KNOWLEDGE & ASSESSMENT TOOL (JKAT), Please tell us about your practice. Check all that apply. Clinical nutrition or one-on-one client intervention Food and nutrition management Sales, Communication & Marketing Policy Development & Program Planning Clinical Nutrition Management Education & Research Other (please specify) 2. What is your primary practice setting? Check all that apply. Business and industry Hospital or other care facility Home Care (CCAC case management or in-home service) Community Health Centre/Health Service Organization Long term care home Family Health Team or Family Health Network Education Institution Diabetes Education Centre Private Practice (Primary Care) Public Health Unit Government Other (please specify) 3. As a result of completing the JKAT, my overall knowledge about the laws, standards and guidelines that affect Registered Dietitians has: 1 - t improved 2 - Improved somewhat 3 - Stayed the same 4 - Improved 5 - Improved significantly 4. As a result of completing the JKAT, I have made or expect to make changes to my practice/work: 5. The changes I have made or plan to make are related to... Check all that apply. Click on each category to see what it includes. My professional Obligations The requirements under the Regulated Health Professions Act (RHPA Privacy and Confidentiality Conflicts of Interest Boundary Issues Scope of Practice Consent to Treatment Record Keeping I do not plan to make changes 6. My knowledge and application about the laws, standards and guidelines will have an impact my practice and or clients. 1 7

13 2 - Somewhat 3 Neutral Comments (describe how your learning will impact your work or clients): 8. Completing the JKAT was of value to me Somewhat 3 - Neutral CDO supports me in my learning about laws, standards, guidelines and ethical principles related to my profession Somewhat 3 Neutral 4 5-8

14 EVALUATION OF RÉSUMÉ, To what extent do you read résumé? 1 - don't usually read 2 - scan some 3 - read some 4 -usually read all 5 -always read all 2. If you selected 1- don't usually read, 2 - scan some, or 3 - read some, why? Check all that apply. Too busy t relevant to my practice Other (please specify) 3. What sections of résumé do you read? Check all that apply. Professional Practice articles College & Council News & tes (includes President and Registrar letters) Quality Assurance Program Information Renewal and Registration Information Certificates of Registration (List of new members and changes in member status) Events I don't read any of the above 4. As a result of reading résumé, has your awareness of College goals, activities and achievements increased? 5. As a result of reading résumé, are you more aware of professional practice issues in dietetics? 6. What would increase the value and relevance of résumé to you? 7. Any Comments about résumé? 8. In Spring 2006, the CDO launched e-résumé. Do you have any comments or suggestions for improvement about e-résumé that you would like to share? 9. Your primary area of practice (select one): Clinical nutrition or one-on-one client intervention Food and nutrition management Sales Marketing Policy Development Program Planning Clinical Nutrition Management Education Research Public Health Other (please specify) 9

15 APPENDIX 2: RMAF Indicators of Success The following table highlights the existing performance measures from the RMAF that relate to the goal we wish to evaluate. See for an abridged version of the RMAF. PROGRAM OUTPUT/OUTCOME INDICATOR OF SUCCESS The College as a whole Patient Relations Program RDs are competent and comply with policies, regulations, laws, standards, and guidelines RDs feel supported in their practice Education and communication tools for RDs résumé articles Jurisprudence Handbook Workshops Developing member education materials Website Online education modules % report improvement in the areas of safety, competency and ethical practice % of members indicating that the products and services of the College programs support them to practice safely, competently and ethically % of RDs reporting improvement in their own safety, competency and ethical practice related to appropriate relationships with patients Practice Advisory Program RDs feel supported in their practice PAS strengthened to be more relevant to RDs in all areas of dietetic practice More RDs contact the College with practice issues # of RDs in all areas of practice that report being supported by the College to provide safe, ethical and competent practice. Quality Assurance Program RDs are competent and comply with policies, regulations, laws, standards, and guidelines Competence: QA tools strengthened to be more relevant to RDs in all areas of dietetic practice. RDs report that they find value (i.e., enhanced knowledge, skills, judgement and practice performance) from completion of QA tools # of RDs in all areas of dietetic practice who report relevance in the QA tools (SDL Tool, Practice Assessment, JKAT) # of RDs in all areas of practice reporting value in completing the SDL Tool # of RDs reporting learning from preparation for Practice Assessment # of RDs in all areas of practice reporting value in Practice Assessment # of RDs in all areas of practice reporting

16 Registration Program RDs feel supported in their practice value in completing the JKAT # of RDs who report satisfaction with education and communication tools regarding registration/application process # of RDs who report receiving adequate assistance from College staff with respect to registration and renewal