Biomedical Equipment Technician Capacity Building Using a Unique Evidence-Based Curriculum Improves Healthcare

Similar documents
CHUK Hospital Statistics 1

What Job Seekers Want:

TFN Impact Report. MAITS (Multi-Agency International Training and Support)

PROJECT LIFE RAFT DESIGNING A LOWER COST INFANT INCUBATOR

Medical Equipment Management. Medical Equipment Management Activities (EC and EC )

Rwanda EPCMD Country Summary, March 2017

Technical Job Family: Technician Progression

EXECUTIVE SUMMARY NURSING PROGRAM EVALUATION 2012

LIFE CARE planning. Advance Health Care Directive. my values, my choices, my care WASHINGTON. kp.org/lifecareplan

HIGH SCHOOL STUDENTS VIEWS ON FREE ENTERPRISE AND ENTREPRENEURSHIP. A comparison of Chinese and American students 2014

The American Board of Dermatology is embarking on an initiative to significantly change our certifying examination. The current certifying exam is

Quality Assessment and Performance Improvement in the Ophthalmic ASC

Employee Telecommuting Study

IN EFFORTS to control costs, many. Pediatric Length of Stay Guidelines and Routine Practice. The Case of Milliman and Robertson ARTICLE

Maternal and Child Health, Chronic Diseases Alaska Division of Public Health, Section of Women's, Children's, and Family Health

Mutah University- Faculty of Medicine

Part 3. Condition of medical equipment

Mentoring Advice on Nomination for IEEE Fellow

Optimizing Nursing and Midwifery Practice in Rwanda

Writing a shared instrumentation grant (successfully)

Structured Practical Experiential Program

SURGICAL SAFETY CHECKLIST

smart technologies Neonatal incubator from standard to intensive care

Quantitative Findings from On-Site Evaluation of Energy Efficiency Program Service Delivery

Shifting Public Perceptions of Doctors and Health Care

Survey Instruments And Documents Revised 2/01, 10/03

General practitioner workload with 2,000

Using Lean, Six Sigma to Improve Surgical Services James Pearson J.O.P. Consulting

Offshoring of Audit Work in Australia

NOT YOUR ORDINARY BIOMED JOB

Manager. 2. To establish procedures for selecting and acquiring biomedical equipment.

Emergency Department Patient Experience Survey Highlights

Airwave Health Monitoring Study Information Leaflet for Health Screening

The Milestones provide a framework for the assessment

Creating a Patient-Centered Payment System to Support Higher-Quality, More Affordable Health Care. Harold D. Miller

Health Professional Awareness and Attitudes on Organ and Tissue Donation and Transplantation. Including Donation after Cardiocirculatory Death

Long-Term Care. Background

Careers in Patient Care: A Look at Former Students from Nursing and other Health Programs that Focus on Patient Care

ARTICULATED PROGRAM GUIDE FOR HEALTH OCCUPATIONS IN THE SECONDARY SCHOOLS

Equipment Technology Malfunctions

CAREER AWARD FOR SCIENCE AND MATHEMATICS TEACHERS (CASMT) Application deadline: September 24, 2018

ORIGINAL ARTICLE. Prevalence of nonmusculoskeletal versus musculoskeletal cases in a chiropractic student clinic

Reasons for Patient Preference of Primary Care Provider Type Session T239 November 12, Margaret Gradison, MD, MHS-CL, FAAFP

Minnesota s Physician Assistant Workforce, 2016

Current practice of closed-loop mechanical ventilation modes on intensive care units a nationwide survey in the Netherlands

Medical Decision Making

University of Pittsburgh

Advance Care Planning Communication Guide: Overview

Content Sheet 11-1: Overview of Norms and Accreditation

A Systems Approach to Patient Safety at the VA

Surveyors Ombudsman Service. Customer Satisfaction 2010

OBTAINING STEM SUPPORT FROM PRIVATE FOUNDATIONS: A TEAM APPROACH

Healthcare- Associated Infections in North Carolina

Evaluation of the WHO Patient Safety Solutions Aides Memoir

Department of Veterans Affairs VHA HANDBOOK HOME RESPIRATORY CARE PROGRAM

Nuclear Pharmacy. Background

This report describes the methods and results of an interim evaluation of the Nurse Practitioner initiative in long-term care.

PRIMARY PARTNERS, LLC. Our Journey with the State HIE

North Carolina. CAHPS 3.0 Adult Medicaid ECHO Report. December Research Park Drive Ann Arbor, MI 48108

MASSACHUSETTS ADVANCE DIRECTIVES

Two Keys to Excellent Health Care for Canadians

SUMMER RESEARCH ASSISTANTSHIP IN EMERGENCY MEDICINE (SRA-EM) LIST OF PROJECTS FOR SUMMER 2017

Maternal and Child Health North Carolina Division of Public Health, Women's and Children's Health Section

EQUIPMENT MANAGEMENT MEDICAL EQUIPMENT: EC , EC UTILITY SYSTEMS: EC , EC

Family Inpatient Communication Survey. Instructions and Instrument

YOUR RIGHT TO MAKE YOUR OWN HEALTH CARE DECISIONS

Making the Most of Your Florida Medicaid and ibudget Services

The Pediatric Pathology Milestone Project

Individual and Family Guide

IARS, AUA and SOCCA 2018 Annual Meetings Abstract Submission Guidelines and Instructions

NHS Rushcliffe CCG Latest survey results

2014 ANCC National Magnet Conference. Safeguarding Valuable Resources through Partnership, Technology, and Education

University of Michigan Health System Program and Operations Analysis. Analysis of Pre-Operation Process for UMHS Surgical Oncology Patients

A Comparison of Job Responsibility and Activities between Registered Dietitians with a Bachelor's Degree and Those with a Master's Degree

Dialysis Laboratory Services and Reports December 2012 January 2013

2018 Corn Research and Education Request for Proposals

Surgical counts are an established routine. An OR nurse performs them dozens

Essential Skills for Evidence-based Practice: Evidence Access Tools

Healthcare- Associated Infections in North Carolina

Measuring Patient Safety Culture Manual, Part I: Getting Started & Planning Your Survey Process

Trends in Merger Investigations and Enforcement at the U.S. Antitrust Agencies

2011 Client Satisfaction Survey Results

ORGANIZATION OF SERVICES AND EFFICIENCY IN HEALTH SYSTEM PERFORMANCE

2018 BFWW Questions. If so what kind of support letter do I have to get from the Department Chair (i.e., he will be promoted to Assistant Professor).

Career Options in Health Care Informatics

9. Guidance to the NATO Military Authorities from the Defence Planning Committee 1967

GE Energy Connections

Bluewater Health. Sarnia/Lambton, Ontario, Canada. Case Study

Online Courses in Medical Technology Application, Support and Management Improve Cost- Effectiveness and Patient Safety

LIFE CARE planning. Advance Health Care Directive. my values, my choices, my care OREGON. kp.org/lifecareplan

Healthcare, and Types of Health Care Organizations. Dr. Waddah D emeh

Certificate of Need (CON) Review Standards for NICU Beds & Special Newborn Nursery Services Effective March 3, 2014

Compounded Sterile Preparations Pharmacy Content Outline May 2018

6.1 ELA: The Systematic Plan for Evaluation will include all of the following data with discussion of results and action for development

Hospital Planning. Principles of. medical architecture planning systems. hospital planners & medical technology consultants

University of Michigan Health System Programs and Operations Analysis. Order Entry Clerical Process Analysis Final Report

University of Michigan Health System Analysis of Wait Times Through the Patient Preoperative Process. Final Report

Jason Litt Allan F. Keeth Elementary Winter Springs, FL

QA offers significant economic benefits!

The State of the Ohio Nonprofit Sector. September Proctor s Linking Mission to Money 471 Highgate Avenue Worthington, OH 43085

Transcription:

Biomedical Equipment Technician Capacity Building Using a Unique Evidence-Based Curriculum Improves Healthcare Robert A. Malkin, PhD, PE and Chelsea Whittle, MSc This article assesses the impact of a unique evidence-based biomedical equipment technician training program on the healthcare infrastructure and the productivity of technicians in Rwanda. Matched cohorts of hospitals included 9 technicians who received no training and 11 with 1 year of training. Equipment from selected departments were surveyed and classified based on functionality and use. Technician and hospital director interviews included management processes and requests for technical assistance and details of equipment repairs from the past 12 months. Obstacles to returning partially functional and out-of-service equipment to use were recorded. Nearly twice as much equipment is out of service at hospitals where the technicians are not trained (10.2% vs 17.8%, P G.01). Trained technicians show 114% higher productivity and are using more of the unique elements of the curriculum than nontrained technicians P G.05). Biomedical equipment technicians seek assistance 3 times more often within Rwanda (245% increase, P G.05) and 5 times more outside Rwanda (461%, P G.001). Technicians who completed 1 year of this unique biomedical equipment technician training program are dramatically improving healthcare by effectively using and sharing taught skills. Corresponding author: Robert A. Malkin, PhD, PE, Duke University, 136 Hudson, Durham, NC 27708 (robert.malkin@duke.edu). Robert A. Malkin, PhD, PE, is the director of the Developing World Healthcare Technology Laboratory at Duke University, Durham, North Carolina, where he is a professor of the Practice of Biomedical Engineering and Global Health. Dr Malkin is an expert advisor to the World Health Organization on Health Technology and serves on the Innovation in Health Technology and Medical Equipment Donation subcommittees of the World Health Organization. Dr Malkin is a Fellow of the American Institute for Medical and Biological Engineering. Chelsea Whittle, MSc, is a program coordinator in Robert Malkin_s Developing World Healthcare Technology Laboratory and is a graduate of the Masters of Science in Global Health program at the Duke University Global Health Institute, Durham, North Carolina. Funding was received from GE Foundation. The authors declare no conflicts of interest. DOI: 10.1097/JCE.0000000000000008 The secretary general of the United Nations stated that 70% of essential medical equipment is not functioning in the developing world. 1 Our data suggest that 40% of all medical equipment is out of service in low- and middleincome countries. 2 The health impact of this vast sea of dilapidated equipment is unknown. However, it must result in delayed surgeries, infants placed 2 or 3 to 1 incubator, phototherapy lights shared between children, and asthmatics going untreated for lack of a working nebulizer. As just an example, placing 2 underweight infants in a single incubator likely increases infant mortality by 17% because it is no longer possible to use closed-loop temperature control. 3 Conditions are very different for medical equipment in the developing world compared with the United States and Europe. There are problems obtaining the required consumables, accessories, and spare parts. 4 Users may not be trained in the proper use of the equipment, or the equipment may be donated to a hospital that lacks the electrical or physical infrastructure to accept the equipment. 5 In 2010, Malkin and Keane 5 published a study of more than 2,849 work tickets (also known as work orders or work cases) from 60 resource-poor hospitals in 11 countries. In each case, an engineer reviewed the service record of the equipment and the steps that were necessary to repair the equipment and place it back into service. That study showed that a limited set of nonyequipment-specific skills were required to place 66% of the medical equipment back into service without importing spare parts. 5 Here, we refer to these 118 skills as biomedical techniciany associated skills (BTA skills). From these data, the Developing World Healthcare Technology Laboratory at Duke University developed an evidencebased curriculum for training high schoolyeducated students to repair medical equipment in a resource-poor setting. This curriculum is unlike any biomedical equipment technician (BMET) curriculum taught in the United States or Europe. For example, a traditional approach to training BMETs might have modules covering incubators, anesthesia machines, and patient monitors. The evidence-based curriculum emphasizes nonyequipment-specific skills and professional Journal of Clinical Engineering www.jcejournal.com 37

development. The nonyequipment-specific skills include topics such as finding leaks, cleaning inside tubes, finding substitute fuses, and rewiring battery packs. Professional development emphasizes skills such as how to train users, how to interact with a hospital director, English language, Internet skills (e-mail and searching), and basic letter writing. In addition, each technician receives support between training sessions in the form of hospital visits and phone mentoring on specific repairs, imitating the technical forums common to BMET work. In 2010, The GE Foundation, Duke University, and Engineering World Health (EWH) formed a collaboration to offer the new curriculum in Rwanda. Rwanda is an African country of approximately 10 million people with 38 public, district hospitals serving the majority of the population. The EWH BMET curriculum includes the evidencebased curriculum and some traditional elements. It also includes medical equipmentyspecific repair, anatomy and physiology, and mathematics. At the time of this study, EWH had trained 2 cohorts. The first cohort (17 technicians) entered the program in March 2010 and the second cohort (21 technicians) entered in March 2011. The entire program is taught over 3 years. Table 1 shows a schedule of the subjects offered. We wanted to know whether the curriculum was working. Did training the BMETs improve healthcare in their hospitals? This article describes a matched cohort study of hospitals with trained and untrained technicians to assess the healthcare impact of the EWH BMET training with a particular emphasis on the determination of which elements of the curriculum are most impactful. TABLE 1. Contents of Unique Curriculum Classroom Training Topic Total Classroom Hours NonYequipment-specific repair skills 168 Healthcare technology management 360 Equipment-specific training 660 Electronics 180 Communications and networking 20 Professional development 20 Biomedical-specific tools and use 20 Anatomy and physiology 120 Math 60 English 20 In-hospital supervised training 300 Total assigned 1,628 Arranged in six 8-week sessions On-the-Job Training Topic Total Anticipated Hours Homework (nonyequipment-specific) 192 Equipment-specific 48 Total anticipated 240 Arranged between 8-week sessions 38 www.jcejournal.com Volume 39 & Number 1 & January/March 2014

Methods Of 38 public, district hospitals in Rwanda, 20 were surveyed: 9 with technicians who have received no training from EWH (control group) and 11 who have received 1 year of EWH BMET training (study group). The list of hospitals is shown in Table 2. The 9 technicians in the control group have since been enrolled in the EWH training program. The surveyed hospitals were chosen to represent a broad spectrum of geographical locations and hospital sizes. The 2 groups represented hospitals of similar size (no statistically significant difference in the number of hospital beds or the total amount of surveyed equipment) and geographical location (same average distance from the capital). Interviews were conducted in English if the interviewee spoke English comfortably. All other interviews were conducted through an interpreter, in Kinyarwanda or French. At each hospital, the director was interviewed at the beginning of the visit. If the director was not available, another administrator was interviewed instead (usually the chief of nursing or deputy director). The administrators were asked questions regarding the size of their hospital, medical equipment status, frequency of interaction with technicians, reporting procedures, and presence of other aid organizations and service contract usage. For hospitals with EWH-trained technicians, administrators were also asked about their interaction with EWH and satisfaction with the program. At each hospital, all medical equipment in the operating rooms, clinical laboratories, and intensive care units was examined. These departments are chosen because they represent critical areas of the hospital with high concentrations of medical equipment. For each piece of equipment, both users and technicians were interviewed. Users were defined as anyone who typically operates the equipment. Users were generally nurses, except in the clinical laboratory, where they were laboratory technicians. For each piece of equipment, the equipment type, manufacturer, model number, serial number, age, location, source (purchase or donation), and service contract status were recorded. Photographs were recorded of each piece of equipment and the equipment s nameplate. Every examined piece of equipment was further categorized as (1) in service, (2) partially functional, (3) out of service, or (4) not clinically needed. The categories were assigned by the user of the equipment and the technician. A piece of equipment was considered in service if it was used in the last 6 months and all needed functions worked. A piece of equipment was considered partially functional if the user and technician identified a desired unavailable features. Out-of-service equipment was those pieces that could not be used or had not been used for more than 6 months, but the user considered them clinically needed. Not clinically needed equipment was out of service and was not considered clinically necessary by the user. TABLE 2. Included Hospitals by Region No Duke-EWH Training 1 y of Duke-EWH Training Hospital District Province Hospital District Province Mibilizi Rusizi West Kibogora Nyamasheke West Gahini Kayonza East Rwamagana Rwamagana East Kabutare Huye South Nyanza Nyanza South Rutongo Rulindo North Gitwe Ruhango South Kabgayi Muhanga South Nyamata Bugesera East Muhima Nyarungenge Kigali Kanombe Kicukiro Kigali Muhororo Ngororero West Nemba Gakenke North Kaduha Nyamagabe South Ngarama Gatsibo East Munini Nyaruguru South Kigeme Nyamagabe South Kabaya Ngororero West Murunda Rutsiro West Twenty of the 38 public hospitals in Rwanda were surveyed as part of this study. Hospitals were selected to create a matched study by size, location, and proximity to the capital between hospitals that had 1 year of DukeYEngineering World Health (EWH) training and hospitals with no Duke-EWH training. Hospitals that had no Duke-EWH training also had to be eligible for entry into the program (the majority of which did enter the program after this study was conducted). Journal of Clinical Engineering www.jcejournal.com 39

For every piece of out-of-service or partially functional equipment, the technician and user were asked to describe the problem with the equipment, how long the equipment had been out of service, and what they thought were the obstacles to repair. Each was asked to select from a list of obstacles. The user selected as many as applied from (1) not needed, (2) I don t have the training, (3) I don t have the supplies, (4) I don t have the accessories, (5) I have not told the technician about this, or (6) I have already told the technician about this and I am waiting. Technicians selected as many as applied from (1) user says it is not needed, (2) I didn t know it was broken, (3) I have not looked at it yet, (4) I am afraid to make it worse, (5) It is under service contract, (6) I don t have the authority to fix it, (7) I don t have the tools to repair it, (8) I don t have the supplies or parts to repair it, or (9) I don t have the accessories needed. An attempt was made to access all sections of every surveyed department in every hospital. However, if access to a room was denied, for example an operating room during surgery, no equipment was recorded for that room. If users were unavailable or unwilling to be interviewed, the user interview was conducted with the technician instead. At least 1 EWH-trained or EWH trainingyeligible technician was interviewed at each hospital. Often, this was the only technician at the hospital. For the purposes of this study, technicians were defined as any person who repairs or would repair medical equipment in the hospital. Each technician was asked about their language capabilities and their educational background. If a technician claimed to speak English, a brief English test was given. The technician was asked to read and respond to 3 questions: (1) Show me your tool box. (2) What are your normal work hours? (3) What is your job title? The number of questions appropriately answered was recorded. The technicians were also asked about their usage of work tickets, parts acquisition paperwork, incoming equipment process, and presence of an inventory. They were also asked if they performed preventive maintenance (PM) and used service contracts in the hospital. In addition, they were asked about the frequency of their interaction with the hospital administration as well as the frequency and method of requests for technical assistance. The senior technician was asked about what tools they had in their workshop. A visual aid with images of the various workshop tools was used to aid communication. Ideally, a review of work tickets would suffice to analyze productivity as every piece of equipment repaired or serviced in the previous year would have been recorded on a work ticket. However, work tickets are rarely recorded in any of the hospitals in Rwanda. If there was no work ticket for a case, a work ticket was created from the technician s memory. Therefore, the technician was also interviewed about all equipment that he/she had worked on in the past 12 months. Each instance of work performed was recorded as a case. Cases included all corrective maintenance, PM, installation, and user training. All available paperwork (work tickets, PM records, etc) was obtained digitally or photographed. For each case, technicians were asked the date of repair, the problem addressed, tools used, the use of outside assistance, Internet use, spare parts used, and if the machine was opened. For each case, the technician was asked about the problem(s) that was (were) repaired. The technician was shown a list of BTA skills and asked which of those skills were applied. Communication was analyzed as the number of requests for technical assistance, both within Rwanda (but outside their hospital) and outside Rwanda. Slightly different questions were used for PM cases because they are generally performed many times during a year. Instead of the date of repair, technicians were asked how many times PM was planned and how many times PM was performed for each piece of equipment in the past 12 months. All cases were categorized as (1) fully resolved, (2) partially resolved, (3) resolved by retiring the equipment, or (4) unresolved. A fully resolved repair was one where the user s complaint was fully addressed, and the equipment was sent back to the floor, and it was used on patients. Partially resolved repairs were for those sent back to the floor and used on patients but all of the user s complaints could not be addressed. If a piece was removed from inventory, it was considered retired. All other cases were considered unresolved. Data Analysis Significance was defined by P G.05 for all tests. Statistical tests used for this study were the W 2 test for a difference of proportions and Welch t test for a difference of means. Unless explicitly stated otherwise, not needed equipment was excluded from equipment analyses. Unless explicitly stated otherwise, PM cases were excluded from productivity analyses. Results A total of 953 pieces of medical equipment were analyzed. There were 308 PM cases recorded and 203 corrective maintenance, training, or installation cases recorded. No data were removed or excluded from analysis, unless otherwise indicated. Most of the technicians (70%) had an advanced high school education, whereas 30% had only a high school education. Only 1 surveyed technician from either the control or study group had formal education beyond high school. The most common types of out-of-service equipment were sterilizers, automated laboratory analyzers, and patient 40 www.jcejournal.com Volume 39 & Number 1 & January/March 2014

monitors. The average downtime of the equipment was more than 2 years. Only 22.2% of cases reported by untrained technicians had paperwork, whereas 50.9% of EWH-trained technicians cases had supporting paperwork (P G.01, W 2 test). Every technician had access to basic tools, for example, screwdrivers. No technician had access to specialized tools, for example, patient simulators. Engineering World Health training for 1 year had a dramatic impact on healthcare in the hospitals. Hospitals with technicians without EWH training had 74.5% more out-of-service equipment (17.8%) than hospitals with EWHtrained technicians (10.2%) (P G.01, W 2 test). This difference is shown in Figure 1. Trained technicians work on more equipment, contributing to their success. Trained technicians worked on an average of 9.8 corrective maintenance cases, whereas untrained technicians worked on only 4.5 corrective maintenance cases in the last 12 months (P G.1, Welch t test). Although the numbers are somewhat low, probably due to the technician s lack of documentation, this does correspond to a 118% increase in productivity. In other words, trained technicians are working on a higher percentage of the critical equipment at their hospitals. The fact that trained technicians are more productive suggests that trained technicians are more proactive in their work, more confident, or more trusted by their colleagues. Another reason that trained technicians were more productive is that they were more likely to seek out technical assistance, both inside Rwanda and outside Rwanda. Only 14% of technicians without EWH training requested assistance from someone within Rwanda 10 or more times within the past 12 months. In contrast, 47% of technicians with 1 year of EWH training had 10 or more in-country requests for technical assistance. This corresponds to a 245% increase (P G.05, W 2 test), as seen in Figure 2. FIGURE 1. Capacity building for biomedical equipment technicians following the DukeYEngineering World Health curriculum dramatically reduces the amount of equipment that is out of service in critical areas of the hospital such as the operating room (43% decrease, *P G.01). Perhaps even more important is the ability to gather information about their medical equipment from outside the country, where the equipment was manufactured and where there is a better chance of finding a manual or spare part. Only 14% of technicians without EWH training had 1 or more contacts outside Rwanda, whereas 76% of EWH-trained technicians had made 1 or more contacts outside Rwanda within the previous 12 months. This corresponds to a 460.8% increase (P G.01, W 2 test). Information exchanged included availability of parts or equipment, techniques to diagnose or repair a problem, and obtaining manuals. This is particularly impressive considering that few of the technicians had Internet access at home or at their hospitals. One would assume that students would preferentially work on equipment taught in the EWH training. Therefore, the status of taught medical equipment should be superior to that which had not been taught. Because this study was after only 1 year of training, we could classify each examined piece of equipment as corresponding to equipment the technician had been taught or had not been taught. Indeed, the percentage of in-service equipment was higher if the equipment had been covered by the EWH courses the technicians had attended (87% vs 73%; P G.01, W 2 test). This suggests that equipment-specific training is important. When we examine the nonyequipment-specific BTA skills taught in the curriculum, we find that there is a 276% increase in the number of cases using the BTA skills for EWH-trained technicians as opposed to technicians with no EWH training (P G.01, W 2 test). Engineering World HealthYtrained technicians are using 42 different BTA skills, compared with 22 skills at hospitals with no trained technician. Anecdotally, several technicians mentioned that the nonyequipment-specific skills were at least as valuable, if not more valuable, than the equipmentspecific training. The fact that technicians without EWH training were using any BTA skills is surprising. However, EWH-trained technicians were highly communicative within their country. Many of those calls were with technicians at hospitals who were not in the EWH program asking for advice on how to fix the medical equipment. These calls probably augmented their already existing set of basic skills. Undoubtedly, the confidence of the technician improves his/her ability to repair equipment. Technicians with EWH training were statistically significantly less likely to say they have not touched the equipment (100% decrease; P G.05, W 2 test), are afraid to make the problem worse (100% decrease; P G.05, W 2 test), or need more knowledge (58% decrease; P G.05, W 2 test). Lack of tools was never cited as an obstacle by either trained and untrained technicians. This could be seen to refute the hypothesis that the lack of tools is an obstacle to maintenance for Journal of Clinical Engineering www.jcejournal.com 41

FIGURE 2. Part of the reason that the DukeYEngineering World Health curriculum is successful is that it stresses nonyequipment-specic training, such as networking skills. Trained technicians dramatically increased the number of in-country (245% increase, *P G.02) and out-of-country technical contacts as a result of their training (461% increase, *P G.01). biomedical technicians in Rwanda, or this might indicate a continuing lack of knowledge of the values of taskspecific tools. Technicians that were trained by EWH had a higher level of English proficiency (80% answering all 3 questions correctly). This is important when considering that nearly all medical equipment service and users manuals are found on the Internet (forums, search, or e-mail) using English. Every EWH-trained technician reported using a search engine in the last year (100%); 81% reported using the Internet to find technical information. Only 50% of nony EWH-trained technicians had used a search engine, and only 24% had used the Internet for technical information in the last 12 months. Fully 94% of EWH-trained technicians had used the Internet to search for a manual for a piece of medical equipment, whereas only 41% of the nonyewh-trained technicians had searched for a manual. Discussion Impact This study shows that training BMETs can have a large impact on healthcare. Hospitals without a trained technician have nearly twice as much out-of-service equipment. Trained technicians are more than twice as productive. Although not directly measured in this study, we can extrapolate the level of health (as opposed to healthcare) impact potentially gained. Some of this can be extracted from the student s anecdotal evidence. For example, after learning the nonyequipment-specific skill of finding and fixing leaks in tubing, 1 technician repaired 32 sphygmomanometers in his hospital. In another case, the technician had repaired the only working anesthesia machine in the hospital, returning the operating room to use. Likewise, in a different hospital, the technician had repaired the hospital s only ventilator. In both cases, surgeries were delayed or referred out because the equipment had not been working for months. However, the evidence can be directly implied. There were a combined 32 surveyed incubators at the hospitals. There were 30 total cases of incubator repair (6 of those by technicians without EWH training). Every hospital reported that when 1 of their incubators went down, they had to double up children in the incubator. We know that doubling up patients in incubators increases mortality by 17% because it is no longer possible to use closed-loop temperature control. 3 Thus, every time a repaired incubator allowed 2 babies to be separated, we can project a dramatically improved prognosis. Yet another way of looking at the healthcare impact is to compare the 2 options that a funder might face, whether to fund a donation of medical equipment or to fund the training of local technicians to repair the equipment they already have. We reported 7.6% less of the hospital s inventory is out of service with trained technicians after 1 year. Because these hospitals have a nearly endless supply of broken equipment, it is reasonable to assume that the trained technicians will continue to repair 42 www.jcejournal.com Volume 39 & Number 1 & January/March 2014

an equal amount of equipment each year. A hospital with a total of 1,000 pieces of equipment corresponds to 76 more pieces per year available for clinical care at hospitals with trained technicians. Over 20 years, a donor would therefore need to provide 1,520 working pieces of equipment to the hospitals to provide a donation as powerful as the training program. In our datavspanning equipment donations over 20 yearsvthere are 504 pieces of donated equipment from 27 known donors, an average of about 19 pieces per donor for a 20-year period. Therefore, an average donor would need to donate 80 times their average yearly contribution (1,520/19) to match the impact of the training program studied here over 20 years. A Unique Curriculum There are a number of organizations that deliver BMET training. There can be considerable differences in the curricula offered between the organizations. Probably the most notable difference is the relative emphasis placed on equipment-specific training, such as training on ventilators and electrocardiograms versus the emphasis on skills such as soldering and pipe fitting, which are not equipment-specific and can be used on many pieces of medical equipment. The training delivered here adds at least 1 additional dimension, the BTA skills, which emphasize generic skills tailored to resource-poor settings, such as finding substitute fuses and improvising filters. There is evidence that equipment-specific training was helpful; a 28% increase in cases involving taught equipment. Yet, technicians were 277% more likely to use BTA skills when trained to do so. When faced with large volumes of out-of-service equipment and a nearly complete lack of a maintenance budget, it is not realistic for most of the surveyed technicians to use manufacturer-recommended parts. In addition, much of the surveyed equipment was donated and used and is now too old to be supported by the manufacturer (if the manufacturer still exists). Therefore, the technicians were often faced with the need to improvise solutions to basic problems such as broken fuses, incorrect plugs, hosing leaks, rust on moving parts, and impossible-to-find filters. However, no prior curriculum included the explicit teaching of these improvisation skills. This is a unique feature of this curriculum. We feel that the dramatic improvement in healthcare and the equally dramatic improvement in technician productivity are at least partially due to the explicit teaching of basic skills tailored to a resource-poor setting. Other nonyequipment-specific aspects of the curriculum, including professional development, for example, English and Internet skills, are also important. A successful technician using modern medical equipment will often need support from others to achieve a repair, seeking assistance to do things such as finding parts, troubleshooting problems, obtaining manuals, and deciphering diagnostic codes. This assistance not only helps them repair individual pieces of equipment, but the sense of community offered by communication may also increase their confidence, desire to improve, and job satisfaction. These outcomes have secondary effects. When the technicians become more productive, they are more respected in their hospitals. Most technicians, including heads of departments, reported not having been introduced to the director of the hospital at the outset of the training. However, EWH held workshops for the directors of the hospitals on the importance of involving the technician in the acquisition of the medical equipment, management of the budgets for medical equipment, and training the staff in the use of the equipment. It is extraordinarily rare for a BMET training program to include any training for hospital directors. This is another unique feature of the EWH BMET training curriculum. Despite the increased success of the trained technicians, they continued to suffer from a lack of resources and not only financial resources. Most lacked regular access to the Internet, although EWH provided laptops. Some completely lacked a budget for spare parts. In many cases, equipment was donated without a manual. Lacking a service manual, it was impossible for the technician to identify which part was needed. In many cases, the equipment was no longer manufactured, so that even if they knew what part was needed they might not be able to find it. Without the means to communicate between technicians across the world, it would be impossible for them to find advice on spare parts for out-of-date equipment. The lack of Internet, and in some cases lack of English-language proficiency, also hampered their ability to join forums, attend conferences, and otherwise improve their ability to participate in the BMET community. Study Limitations We believe this to be the first matched, controlled study of the impact of BMET training on healthcare. As such, we believe this to represent the best available data on the topic. Nevertheless, there are limitations to this study. This study uses sampled inventories (3 departments were surveyed) instead of complete hospital inventories to calculate equipment status. Other departments, store rooms, and closets that would have included other clinically necessary equipment were not surveyed in this study. Presumably, there would be a large amount of nonfunctional equipment in store rooms and closets, and therefore the actual out-of-service percentages would be much higher than found in this study. This is likely the reason why Perry and Malkin 2 reported a far larger out-of-service percentage. An ideal study would show the impact on patient health. This study measured only the impact on the healthcare (infrastructure), particularly medical equipment. Although the link between medical equipment and patient health is Journal of Clinical Engineering www.jcejournal.com 43

strong, it is not immutable. For example, a hospital may need only 1 suction machine. In this case, 1 in 10 machines working (10% in service) and 1 in 2 machines working (50% in service) would result in the same clinical outcomes. Although evaluating hospital equipment maintenance based on paperwork would have been more objective and accurate, paperwork was often not available for this study. Instead, work cases were reproduced post facto, relying on the technician s memory, which may not be comprehensive or accurate. The high case resolution rate (92.1% for untrained, 94.4% for trained) appears incongruent with the percentage of equipment out of service, suggesting that technicians selectively remember the cases that were successfully resolved. The fact that the non-ewh hospitals are using many BTA skills most likely highlights the fact that technicians are speaking with each other. This high degree of communication is desirable and encouraged but does complicate the interpretation of the results by removing a degree of independence between the control and study groups. The use of matched pairs and the fact that we based our conclusions on the differences between trained and untrained cohorts largely mitigates these weaknesses. References 1. Chan M. Medical devices: an area of great promise. Presented at the Global Forum on Medical Devices, Bangkok, Thailand; 2010. 2. Perry L, Malkin R. Effectiveness of medical equipment donations to improve health systems: how much medical equipment is broken in the developing world? Med Biol Eng Comput. 2011;49(7):719-722. 3. Sinclair J. Servo-control for maintaining abdominal skin temperature at 36C in low birth weight infants. Cochrane Database Syst Rev. 2002;1:1-10. 4. Malkin R. Design of healthcare technology for the developing world, Annu Rev Biomed Eng. 2007;9:567-587. 5. Malkin R, Keane A. Evidence-based approach tothe maintenance of laboratory and medical equipment in resource-poor settings. Med Biol Eng Comput. 2010; 48(7):721-726. 44 www.jcejournal.com Volume 39 & Number 1 & January/March 2014