Practice Change: No Shows to Medical Appointments: Where Is Everyone?

Similar documents
Employers are essential partners in monitoring the practice

Improving POLST/Advanced Directive Completion in the Primary Care Setting

AIM Alberta Online Measurement Tool Manual. Instructions for Use Part 1: Set Up and Data Collection

PATIENT PORTAL USERS GUIDE

Text Messaging Appointment Reminders to Reduce No-Shows: A Pilot Study

Office of Clinical Research. CTMS Reference Guide Patient Entry & Visit Tracking

Patient Payment Check-Up

Chapter 2 Provider Responsibilities Unit 6: Behavioral Health Care Specialists

Small Numbers, Big Impact: Collaborating with a Coordinated Care Organization to Initiate Pediatric Developmental Screening at a Primary Care Practice

To join Patient Ally, use the Manage Office tab and select the Patient Ally Settings link.

Clinical Research Proposal To the Jersey City Medical Center Institutional Review Board

Barriers & Incentives to Obtaining a Bachelor of Science Degree in Nursing

Promoting Sexual Health With SMS Texting Technology

Referred Patient Alerts & Online Recruitment Manager for Sites Instructions

GENERAL DENTIST. Dental Receptionist Manual

Optima 101: PARTICIPANT GUIDE

20 STEPS FROM STUDY IDEA INCEPTION TO PUBLISHING RESEARCH/ Evidence-Based Practice

PEDIATRIC DENTIST. Dental Receptionist Manual

UNIVERSITY OF NEVADA, LAS VEGAS SCHOOL OF NURSING. NURS 733: Nursing Education Practicum I

Wellness Guide for LCRA Retirees

Quality Improvement Plan (QIP): 2015/16 Progress Report

6/5/2013 7:22:00 AM Building Teams at the Associates in Internal Medicine: The Medical Huddle as a First Step

IMPACT OF SIMULATION EXPERIENCE ON STUDENT PERFORMANCE DURING RESCUE HIGH FIDELITY PATIENT SIMULATION

Title: Preparedness to provide nursing care to women exposed to intimate partner violence: a quantitative study in primary health care in Sweden

NEW Patient Reported Medications & Reconciliation

Back Office-General Quick Reference Guide. Enter a Home Health Referral

Chapter Subject Page _. Chapter 1 School Zone Overview 3 Overview. Chapter 2 Finding Your Schools 5 Schools Search by RSID Search by School Name

Organization Review Process Guide Perinatal Care Certification

2011 PCMH Element 2D or 2014 PCMH Element 3D: Use Data for Population Management

A Qualitative Study of Master Patient Index (MPI) Record Challenges from Health Information Management Professionals Perspectives

AUDIT AND FINANCE COMMITTEE Wednesday, April 15, 2009

DEPARTMENT OF HEALTH AND MENTAL HYGIENE MENTAL HYGIENE ADMINISTRATION MARYLAND S PUBLIC MENTAL HEALTH SYSTEM 2011 PROVIDER SURVEY EXECUTIVE SUMMARY

Four Game-Changing Strategies for Transforming the Patient Experience

Clinic Appointment Book & Appointment Card Templates

International Research Agendas Programme

Household survey on access and use of medicines

Sevocity v.12 Patient Reminders User Reference Guide

MODULE ELEVEN. Getting Credit for the Work You Do: Entering Units of Service

Online Panel shortlisting

Comparing Job Expectations and Satisfaction: A Pilot Study Focusing on Men in Nursing

PICO Question: Considering the lack of access to health care in the pediatric population would

Improving Nursing Workflow Efficiency & Nurses Knowledge & Attitude Toward Computers. WellStar Health System. Background

A Study of the Awareness Levels of Universal Precautions in High-risk Areas of a Super-specialty Tertiary Care Hospital

mcare: The Results of a Secure, Bi-Directional Mobile Phone Messaging System for U.S. Army Wounded Warriors

The Patient-Centered Medical Home & You: Frequently Asked Questions (FAQ) for Patients and

University of Nevada, Las Vegas School of Nursing Summer 2017

Improving Quality Outcomes in a Risk-Based World: A Davies Story Session #100, March 7, 2018

BUILDING BLOCKS OF PRIMARY CARE ASSESSMENT FOR TRANSFORMING TEACHING PRACTICES (BBPCA-TTP)

Accessing Standard UDS Reports

CITY OF GRANTS PASS SURVEY

Using PowerChart: Organizer View

Church-based Health Education: Topics of Interest

Guidelines for Telemedicine Scheduling and Patient Care Co-ordination

IHI Open School Advanced Case Study

Implementation Guide Version 4.0 Tools

14. Appendix- Sample Questionnaire

Fulbright Distinguished Awards in Teaching Program Overview of Online Application Process

PowerChart Maternity COLUMNs and ICONs- OB Beds Tab

Abstract. Are eligible providers participating? AdvancedMD EHR features streamline meaningful use processes: Complete & accurate information

Using BIOVIGIL Technology to Improve Hand Hygiene Compliance and Awareness. by Kevin Wittrup Research by Mike Burba

Activities, Accomplishments, and Impact. Report on the Implementation of the School Based Health Center Quality Improvement Initiative

NC Division of Mental Health, Developmental Disabilities, and Substance Abuse Services (DMH/DD/SAS)

Unit 4 Evidence-Based Clinical Practice Guidelines (CPG)

NEW PATIENT PACKET. Address: City: State: Zip: Home Phone: Cell Phone: Primary Contact: Home Phone Cell Phone. Address: Driver s License #:

DEPARTMENT OF COUNSELOR EDUCATION AND FAMILY STUDIES. LiveText Field Experience Manual Practicum & Internship

of Entry And Client Tracking System For Community Home Visiting Program Supervisor / Program Administrator Level

TSWF Pulmonary CPG AIM Form User Guide September 2018

INTEGRATION OF PRIMARY HEALTH CARE NURSE PRACTITIONERS INTO EMERGENCY DEPARTMENTS

Effort Reporting & Commitments (ERC) Application Training: Departmental Administrators

How to Implement Standing Orders

Residential Rehabilitation Services (RRS) Part 1

Physician Job Satisfaction in Primary Care. Eman Sharaf, ABFM* Nahla Madan, ABFM* Awatif Sharaf, FMC*

Veterans Pulse Survey

PCORI Online. Training for Pre-Award Management System April 2017

The Cost of No Shows. Defining the problem, understanding the impact, and reviewing the solutions. Missed appointments by type

Oklahoma Health Care Authority. ECHO Adult Behavioral Health Survey For SoonerCare Choice

Pearson's Comprehensive Medical Assisting

GM CORPORATE GIVING ONLINE SUBMISSION GUIDE

ValueOptions Maryland Tips for Submitting Authorization Requests through ProviderConnect

Quality Management and Improvement 2016 Year-end Report

Psychiatry Online. Accessing the Database

Undergraduate Nursing Students' Perceptions of Preparedness as They Prepare to Graduate

INTERGY MEANINGFUL USE 2014 STAGE 1 USER GUIDE Spring 2014

A Training Resource of the International Society of Managing and Technical Editors and Aries Systems

A Comparison of Job Responsibility and Activities between Registered Dietitians with a Bachelor's Degree and Those with a Master's Degree

Methotrexate in General Practice Audit Methotrexate: Using audit to enhance safer use of toxic medication Good for patients, Good for doctors.

SAMPLE WORKFLOW. DAY OF CONSULT - Patient Site (Pease refer to the flow chart for event timing and site participation requirement)

MONITORING PATIENTS. Responding to Readings

California HIPAA Privacy Implementation Survey: Appendix A. Stakeholder Interviews

Site Manager Guide CMTS. Care Management Tracking System. University of Washington aims.uw.edu

Dianne Conrad DNP, RN, FNP-BC Cadillac Family Physicians, PC Cadillac, MI July 21, 2011

Improvement in Documentation of Intake and Output Chart

ADVANCES IN Telehealth: The best ways to engage with patients using different mediums

Bridging the Digital Divide: Patient-Focused Technology for Better Care Outcomes

University of Nevada, Las Vegas. School of Nursing

UnitedHealthcare Community Plan 2016 Long Term Care Member/Responsible Party Satisfaction Survey

Improving Intimate Partner Violence Screening in the Emergency Department Setting

Soarian Clinicals Results Viewing Quick User Guide

Toward the Electronic Patient Record:

Patient Safety in the Ambulatory Setting No News is Not Always Good News Tracey L. Henry, MD, MPH NPA 2015 Copello Fellow

Transcription:

University of Portland Pilot Scholars Nursing Graduate Publications and Presentations School of Nursing 2015 Practice Change: No Shows to Medical Appointments: Where Is Everyone? Jill Cohen Lisa Bennett Follow this and additional works at: http://pilotscholars.up.edu/nrs_gradpubs Part of the Nursing Commons Citation: Pilot Scholars Version (Modified MLA Style) Cohen, Jill and Bennett, Lisa, "Practice Change: No Shows to Medical Appointments: Where Is Everyone?" (2015). Nursing Graduate Publications and Presentations. 3. http://pilotscholars.up.edu/nrs_gradpubs/3 This Doctoral Project is brought to you for free and open access by the School of Nursing at Pilot Scholars. It has been accepted for inclusion in Nursing Graduate Publications and Presentations by an authorized administrator of Pilot Scholars. For more information, please contact library@up.edu.

Practice Change: No Shows to Medical Appointments: Where Is Everyone? Jill Cohen FNP-DNP student, Lisa Bennett FNP-DNP student University of Portland School of Nursing (cohen15@up.edu and bennett15@up.edu) Abstract The purpose of this practice change was to increase the percentage of patients attending their appointments with their health care providers at an urban health center serving female patients. When patients fail to attend their scheduled medical appointment it impacts the organizational efficiency, continuity of care, and can affect patient health care outcomes (Perron et al., 2010). The health center in this project had a patient no-show rate of approximately 13%. With input from the authors, the health center manager made the decision to use the innovation of having medical assistants make patient reminder telephone calls at 48 and 24 hours prior to all scheduled appointments. Evidence from research reports show this technique is effective in reducing the number of patient no-shows in various clinical settings. The practice change project was initiated after developing and reviewing a proposal with the health center manager. A Call Tracking Form was completed by the medical assistants making reminder phone calls in order to identify who was called, at what interval(s), and if the appointment was confirmed. During the nine-weeks of practice change implementation a total of 699 appointments were scheduled with fifty-seven percent of these patients receiving reminder phone calls at 24 and 48 hours. In a nine week period prior to implementing this change, forty five of the 355 scheduled patients failed to attend their scheduled appointment, for a no-show rate of 13%. This is compared to 72 of the 699 patients with scheduled appointments during the practice change failing to attend a scheduled appointment, for a post-change no-show rate of 10%. In conclusion, reminder phone calls were effective in increasing the number of patients who attended their scheduled medical appointments. The combined effect of the reminder phone calls reduced the no-show rate by approximately 3%. Background Managing missed patient appointments represent a challenge for those working in health care systems. Non-attendance at appointments decreases healthcare revenue, causes suboptimal use of clinical and administrative staff, can impact wait times for patients, and negatively affects continuity of care (Perron et al., 2010). Several innovations have had varying degrees of success in reducing the number of patients missing scheduled appointments (Chen, Fang, Chen, & Dai, 2008; Fairhurst & Sheikh, 2008; Liew et al., 2009; Perron et al, 2010; Stockwell et al., 2014). A review of the evidence conducted by the authors indicated instances where staff made personal appointment phone calls, mailed letters, used text messaging, and automated voice messaging to

remind patients of their scheduled appointments (Chen et al., 2008; Fairhurst & Sheikh, 2008; Leong et al., 2006; Liew et al., 2009; Perron et al., 2010; Stockwell et al., 2014). This article describes a change in clinical practice conducted by the authors who were doctor of nursing practice-family nurse practitioner students with a goal to increase the percentage of patients attending their scheduled medical appointments at a women s health clinic where the no-show rate was 13%. This practice change was approved by the University of Portland Institutional Review Board. Organizational Context The site targeted for this practice change project is a community-based, outpatient primary health care center primarily serving Caucasian and Hispanic female adult patients that is focused on women s health care needs including family planning, ante/post-partum care services. The health center is located on the same campus as its parent organization and is part of a larger health care network. Strategic and financial objectives are typically disseminated from the parent company s executive leadership through face-to-face director meetings and emails. The organization s charity and financial policy is written to ensure a fair, equitable, and comprehensive system of distributing charity care to the financially burdened within the available resources of the hospital while also ensuring that the hospital is financially capable of providing the highest quality healthcare to the community. Personal Context The need for a practice change was identified by the health center s manager who noted patient absences from their scheduled medical appointment. Ten medical assistants provide support services to the health center s six health care providers. The medical assistant s responsibilities include performing clinical procedures under the supervision of the health center s physicians and midwives; escorting patients to exam rooms; interviewing patients and taking vital signs; ensuring reports, labs, and other patient information are updated in patient medical records; stock exam rooms with medical supplies and instruments; and make/take telephone messages to and from patients, providers, and other organizational staff. The health center manager started tracking patient no-shows to identify patterns in appointment times most often missed, what type of appointments were being missed, and which patients chronically missed appointments. With this information an informal test of change was started with one of the health center s medical assistant being assigned to make reminder phone calls as a method of encouraging attendance. These phone calls were reportedly not made consistently, nor were they made for every scheduled patient appointment because of a lack of medical assistant time. Problem The recognition by the manager that the medical assistant s efforts at making patient reminder phone calls made minimal change to the no show rate is what motivated the need to make a practice change by seeking an evidence-based solution to increase the number of patients who attend their scheduled medical appointments.

Solution Evidence Based Innovation The authors reviewed the literature to provide the health center manager with evidence-based innovation suggestions for a practice change that could improve the percentage of patients attending scheduled medical appointments. It has been stated that patients who receive some form of reminder are more likely to keep their appointments than those who received no reminders (Chen et al., 2008). In their work Perron et al., (2010), reported that a strategy of using several interventions at once, such as phone calls, text messages, and mailed reminders was effective and economical. At the time 62% of their patient population had cellular phones. In two clinical trials by Liew et al., (2009) and Chen et al., (2008) it was concluded that both text messaging and telephone reminders were effective in reducing non-attendance rates. They also stated that text messaging was fast, convenient and cost-effective as long as the patient population had cellular telephones and could receive messages. Three randomized controlled trials concluded texting was cost effective and a quick way to send a large number of text messages (Stockwell et al., 2014; Fairhurst & Sheikh, 2008; Leong et al., 2006). One of the trials indicated that using text messages moderately increased the number of clients who appeared for their annual vaccines (Stockwell et al., 2014). Techniques considered to reduce no-shows in this project were as follows: 1) establishing a missed appointment policy (Jain, & Chou, 2000); 2) double-booking most frequently missed appointment times (Wilkinson, & Daly, 2012); 3) providing intake counseling with new patients to explain center policies and importance of rescheduling appointments (Jain, & Chou, 2000); 4) making reminder phone calls at 48 and 24 hours prior to scheduled appointment (Kaplan-Lewis, & Percac-Lima, 2013; Woods, 2011); 5) text messaging patient reminders before scheduled appointment (Youssef, 2014); and 6) sending patients prompt letters in the mail prior to their scheduled appointments (Jayaram, Rattehalli, & Kader, 2008). Implementing the Practice Change The health center manager considered the list of innovations as a means of increasing patients attendance at scheduled appointments. The innovation option chosen for this health center was to have the medical assistants make patient reminder telephone calls at 48 and 24 hours prior to all scheduled appointments and to document these calls on a Call Tracking Form (Appendix A). In preparation for making this practice change, the authors met with the medical assistants in two separate educational meetings. The first meeting was held with the medical assistants during their morning shift report to discuss the issue of patients missing their scheduled medical appointments and the impact these absences had on the health center. The practice change of having the medical assistants make patient reminder phone calls was discussed and a written information letter explaining the practice change was distributed for their records. The second meeting with the medical assistants was held one week later to discuss the use of the Reminder Phone Call Process Checklist (Appendix B). At the beginning of each shift, the medical assistants were expected to use the Reminder Phone Call Process Checklist and generate a report of scheduled appointments that needed reminder phone calls in the next 48 and 24 hours. The process required that the medical assistants to log into the health center s computer system and

enter a future date range to reflect the 24 and 48 hour intervals. When the medical assistants made the patient reminder phone calls the results of these calls were documented on the call tracking form with a check-mark placed in the column that reflected the 48 and/or 24 call interval and appointment confirmation. The authors made weekly visits to the health center during the project to collect call tracking forms and to answer questions. At the end of the implementation phase of the practice change the medical assistants were asked to complete a Post-Project Implementation Process Evaluation Questionnaire (Appendix C) to evaluate their perception of the practice change. Results Fifty-seven percent of patients received reminder phone calls at both 48 and 24 hours during the implementation phase of the practice change, while forty-three percent of patients received a phone call at the 24 hour interval prior to their appointment. During the nine weeks of the practice change implementation, 72 of the 699 patients with scheduled appointments failed to appear at their scheduled time, for a no-show rate of 10%, as compared to the nine weeks preinnovation implementation no show rate of 13%, which had 45 of the 355 patients fail to appear. (The variation in the number of scheduled patients for the pre and post innovation implementation periods reflects office closure for furlough and holidays). The Post Implementation Process Evaluation Questionnaire was distributed to all ten medical assistants involved in the practice change project, with six questionnaires returned. The medical assistants were asked if the Reminder Phone Call Process Checklist provided for guidance when making patient reminder phone calls was helpful. The majority of the medical assistants strongly disagreed that the form was helpful; with one respondent neither agreeing nor disagreeing with the question. Two of the medical assistants commented that the Reminder Phone Call Process Checklist form was too complicated to follow. The majority of the medical assistants who completed the evaluation questionnaire did not believe that the training provided to them on the Reminder Phone Call Process Checklist was helpful in implementing the practice change. The overall opinion about the value of the practice change project as it related to the medical assistants professional experience was negative. The Post Implementation Process Evaluation Questionnaire data can be found in Appendix D. Conclusion The health center s decreased no-show rate demonstrated by the practice change supports the continued implementation of the innovation of making patient reminder phone calls at 48 and 24 hours prior to scheduled appointments. Although many patients did not receive both 48 and 24 hour reminder phone calls, the consistency of making patient reminder phone calls may have contributed to the decreased number of no-shows. The information obtained from the Post Implementation Process Evaluation Questionnaires will aid the health center manager in identifying areas of the practice change that were well implemented and those areas that were not. Understanding the medical assistant s perceptions about the practice change and barriers to engagement in the project can help the manager to make implementation changes that will support the sustainability of the new practice. During the practice change implementation, analysis of data, and reporting, the following observations were made by the authors.

Unresolved Questions and Lessons for the Field When attempting to implement a practice change within an organization it is important to identify if other projects are being conducted concurrently. When more than one practice change is in process simultaneously, the potential to strain the organization s resources such as money or staff time can occur; negatively impacting the success of the practice change. It is important to encourage the health center leadership and management teams to attend scheduled practice change meetings in order to help foster a sense of interest and engagement with staff about the project and to be available to answer organizational questions that the authors may not have answers for. Additionally, it is important to schedule meetings with the practice change participants when interruptions are minimal. There must be sufficient time allowed to clearly explain the procedure of the practice change in its initial stages and to ensure all questions/concerns can be addressed. In the future, it would be helpful when implementing a practice change to identify a person from each stakeholder group to serve as the Practice Change Champion. In this role, these people would represent the interests of their respective disciplines, disseminate information about the change, and be available for consultation with the practice change authors. Providing an executive summary of the practice change outline, including the implementation details, to all stakeholders for review prior to starting the practice change could help eliminate confusion and miscommunication when the practice change is implemented. When a number of stakeholders are going to be impacted by a practice change, all stakeholders should be included in the discussion(s), potential resolutions, and have the opportunity to express their opinions about the proposed practice changes. It is important for authors to be mindful that when stakeholders are compliant with a practice change process, they may not really be engaged or committed to the success of the project or its sustainability. Complacency does not equal engagement when it pertains to translating evidence into practice The information obtained from the Post Implementation Process Evaluation Questionnaires may aid the health center manager in identifying areas of the practice change process that were well implemented and those that were not. This may help to improve those areas of the practice change not rated as well implemented, which can then be improved or eliminated from future practice changes. The authors learned that the task of identifying and implementing an organizational practice change is challenging and requires skills not easily learned from textbooks or leadership camps.

References Chen, Z-W., Fang, L-Z., Chen, L-Y., & Dai, H-L. (2008). Comparison of an SMS text messaging and phone reminder to improve attendance at a health promotion center: A randomized controlled trial. Journal of Zhejiang University Science B, 9(1), 34-38. Fairhurst, K., & Sheikh, A. (2008). Texting appointment reminders to repeated non-attenders in primary care: Randomized controlled study. Quality & Safety in Health Care 17, 373-376. doi: 10.1136/qshc.2006.020768. Jain, S., & Chou, C.L. (2000). Use of an orientation clinic to reduce failed new patient appointments in primary care. Journal of General Internal Medicine, 15 (12), 878-880. Jayaram, M., Rattehalli, R. D., & Kadar, I. (2008). Prompt letters to reduce non-attendance: Applying evidence-based practice. BMC Psychiatry, 8(90), 1-8. doi: 10.1186/1471-244X-8-90. Kaplan-Lewis, E., & Percac-Lima, S. (2013). No-show to primary care appointments: Why patients do not come. Journal of Primary Care & Community Health, 4(4), 251-255. doi: 10.1177/215013193498513. Leong, K. C., Chen, W. S., Leong, K. W., Mastura, I., Mimi, O., Sheikh, M. A., & Teng, C. L. (2006). The use of text messaging to improve attendance in primary care: A randomized controlled trial. Family Practice Advance Access, 699-705. doi: 0.1093/fampra/cm1044. Liew, S-M., Tong, S. F., Lee, V. K. M., Ng, C. J., Leong, K. C., & Teng, C. L. (2009). Text messaging reminders to reduce non-attendance in chronic disease follow-up: A clinical trial. British Journal of General Practice 59, 916-920. doi: 10.3399/bjgp09X472250. Perron, N. J., Dao, M. D., Kossovsky, M. P., Miserez, V., Chuard, C., Calmy, A., & Gaspoz, J- M. (2010). Reduction of missed appointments at an urban primary care clinic: A randomized controlled study. BMC Family Practice, 11(79), 1-8. doi: 10.1186/1471-2296-11-79. Stockwell, M. S., Westhoff, C., Kharbanda, E. O., Vargas, C. Y., Camargo, S., Vawdrey, D. S., & Castano, P. M. (2014). Influenza vaccine text message reminders for urban, low-

income pregnant women: A randomized controlled trial. American Journal of Public Health, 104(S1), e7-e12. Wilkinson. J., & Daly, M. (2012). Reasons for non-attendance: Audit findings from a nurse-led clinic. Journal of Primary Health Care, 4(1), 39-44. Woods, R. (2011). The effectiveness of reminder phone calls on reducing no-show rates in ambulatory care. Nursing Economics, 29(5), 278-282. Youssef, A. (2014). Use of short message service reminders to improve attendance at an internal medicine outpatient clinic in Saudi Arabia: A randomized controlled trial. Eastern Mediterranean Health Journal, 20(5), 317-323.

Appendix A Call Tracking Form Date: Instructions: The first column (Patient by scheduled appt. time) refers to the time slot on your patients scheduled to be seen report. Please place a check-mark in the column of the task you are completing (phone call at 48 or 24 hours), (patient confirmed their medical appointment or if unable to reach the patient you left a voice message), etc. Please add a comment if needed, for example if the patient rescheduled the appointment. No patient contact information is to be documented on this form. Please place this form in the envelope in the manager s office when completed. Please use more than one form if needed to document all the patient calls. Patient by scheduled appt. time: 24 hour Contact 48 hour Contact Confirmed Appointment (Yes or No) Voicemail left Comments 1 2 3 4 5 6 7 8 9 10 11 12 13

Appendix B Reminder Phone Call Process Checklist Reminder Phone Call Process Checklist Purpose: To provide a standardized workflow process for making patient reminder phone calls at 48 and 24 hour intervals prior to patients scheduled appointments and documenting these calls on the Call Tracking forms. Inputs: Medical Assistants 1. At the beginning of each shift, the medical assistant will log into the health center s computer-based patient scheduling system and generate a patient schedule report. 2. Once logged onto the computer system, the medical assistant will click on to the Patient Schedule tab and then click on the Appointment folder. 3. In the top right corner of the Appointment folder is a date finder button. The medical assistant will input a specific date or date range to generate a report for patients scheduled to be seen in the next 24 and 48 hours. 4. The medical assistant will click the Run button at the bottom on the page and a report of patients needing reminder phone calls will be generated. 5. The medical assistant will print a copy of the Patient Scheduled Appointment Report to use for making the reminder phone calls. 6. The medical assistant will retrieve the patient s contact information from the Demographic section of the electronic record. Contact information is to be kept confidential and will not be transcribed on to the medical assistant s documents. 7. The medical assistant will make the patient reminder phone calls throughout the shift and will document these phone calls on the Call Tracking forms. 8. Information to be documented on the Call Tracking forms will include: calls made at the 24 and 48 hour intervals, attendance confirmed or not-confirmed (if unable to speak with patient, leave a voice mail message). A comment section is available to make comments as needed. 9. The medical assistant will place a check-mark in the columns that reflect the results of their phone calls. Written comments can be documented in the comment section as needed.

Appendix C Post-Project Implementation Process Evaluation Questionnaire Medical Assistants: Completing this questionnaire is voluntary. Whether you complete the questionnaire or not, please return it to the marked envelope as you leave the meeting room today. Thank you for your participation in this process and providing feedback on the process! Instructions: Please place a check-mark in the column that reflects your answer. Questions Using the standard workflow form to make and document patient reminder phone calls was helpful The training I received regarding the use of the standard workflow form and documentation process was appropriate Questions that I had about the project were answered timely and appropriately Changing how I do my job helps to improve patient care delivery Participating in the practice improvement change project was a valuable experience Strongly Disagree Neither Agree nor Disagree Strongly Agree 1 2 3 4 5 6 7 8 Comments:

Appendix D Post Implementation Process Evaluation Questionnaire Data Questions Using the standard workflow process form to make and document phone calls was helpful The training I received regarding the use of the standard workflow form and documentation was helpful Questions that I had about the project were answered timely and appropriately Changing how I do my job helps to improve patient care delivery Participation in the practice improvement project was a valuable experience *No answer from one respondent to this question Strongly Neither Agree or Strongly Agree Disagree Disagree 5 1 0 4 2 0 0 4 2 0 3 2* 1 5 0