Voice enabled Internet of Health" Nitin Gujral Director of Software Engineering, Innovation Boston Children s Hospital
Innovation & Digital Health Accelerator: Shaping the future of health care and extending Boston Children s pediatric leadership globally + Industry Boston Children s Expertise & Capabilities: Partners & Startups, like: Clinical Expertise BCH Data HCIT Development = To Launch Commercially Successful: Products Platforms Ventures
Innovation & Digital Health Accelerator: Capabilities and Collaborations Dedicated team Combining talent from Informatics, Strategy, IAP, Telehealth, ISD, PCS Working collaboratively Clinicians, researchers, innovators TIDO, legal/regulatory, marketing Providing support to innovators by accelerating projects internally, to market Software development Informatics & research expertise Commercialization strategy and partnerships
Why voice and conversational technology? Immediate access to difficult to find information Engaging, natural Consumer devices + Open development platforms
Ask the internet? Parents are actively looking for guidance traditional search and medical content sites lack the customized, interactive approach of conversational technologies Although I will ALWAYS go with my gut about my kids being sick, I typically ask the internet to confirm my suspicion about what might be happening with them. Female, 36, Kids ages 1 & 4 Source: 3 rd Party consumer research survey (n=200)
Working with consumer brands on decision support Boston Children s Data & Expertise
web mobile voice device Kids.MD powered by: Boston Children s Hospital research platform Kids.MD is delivering consumer facing digital health tools to patients and families across digital mediums, extending Boston Children s pediatric expertise beyond our walls. Through meaningful interactions and wellness support, consumers can leverage high quality clinical knowledge at home, in technologically relevant ways.
Alexa, ask KidsMD
Voice and conversations are highly contextual Context: Users: @ home by patients & families @ inpatient by clinicians @ outpatient
Voice skills for Home Care BCH MyChildren's Alexa, ask MyChildren s when is my child s next appointment. Alexa, ask MyChildren s to read my last visit note. Ok Google, ask MyChildren s for {Kim s} asthma action plan. Hey Cortana, tell MyChildren s that I need to reschedule {Kim s} appointment. Hey Siri, tell MyChildren s to record my child s most recent temperature.
Home Health Hubs Actively partnering with industry (pharma, med device, other providers) to develop new integrated voice experiences
Exploring Voice in clinical settings New ways for patients and clinicians to access health information Voice Mashup Patients, Providers, Industry partners Usages: Health screening Patient education and engagement Bedside control and distraction Photo credit The Boston Globe Virtual assistant for Clinicians
Voice isn t new to clinical settings Physicians dictate notes Surgical and radiology applications with voice commands Voice as the key User Interface driven by AI and digital content
IoT / Consumer Device Network
Voice enabled IoTs in the ICU Core Use Cases: Get clinical assignments for a patient Access on-call information for the unit Get capacity information for various units Access key policy / guideline documents Query policies with specific questions Get medication dosage details from the code cart Walk through clinical pathways
Alexa, ask ICU
Initial findings Around 70% of all interactions resulted in exactly what a clinician was looking for A learning system - identify accuracy of interactions to improve responses Error rate also reflected a need for user training with current conversational systems More interactions occurred around nursing areas than physician offices Only 10% unofficial interactions
A case for efficiency We had a critically ill patient who was rapidly decompensating after intubation. We needed a STAT beside ECHO to evaluate the patient s heart function. No one knew the number for the ECHO attending. Alexa gave us the correct number instantly, and I called the ECHO attending to get the bedside ECHO. This HANDS DOWN sped up the process of getting an ECHO for this patient. - A critical care physician
A case for efficiency I could save 15 to 30 minutes per patient if using a voice-activated system to get that [lab] information. - A Boston Children s Hospital IV/Infusion Nurse
Voice skills in clinical settings Alexa, ask Children s Hospital when my doctor is checking in today. Alexa, ask Children s Hospital what s for {lunch} today. Alexa, ask Children s Hospital when my next {Tylenol} is scheduled. Voice enabled IoTs Alexa, ask Children s Hospital to page {Dr. Smith}. Alexa, tell Children s Hospital to display {Kim s} lab results. Alexa, ask Children s Hospital for Kim s recommended {Tylenol} dose by weight. Alexa, tell Children s Hospital to send {Kim s} {mom} a list of her medications.
Enterprise deployment challenges Security and Multi-User access Training Note: Most consumer voice services are not yet HIPAA compliant, which currently limits our use to applications not requiring transmission of PHI.
The Future: Voice technologies will become the bridge between machine intelligence and natural human interaction
Future of voice in healthcare Context: Voice and AI technologies will enable enhanced user context and intelligence On-Demand: Voice based remote care will enable an AI health professional at home and a clinical partner for care teams User Interface: Device & screen-based interfaces will be augmented or replaced by voice-enabled technologies Ubiquity: Voice technology will be in homes, on most devices, public places and in hospitals
Thank you! bostonchildrens.org/accelerator Nitin Gujral nitin.gujral@childrens.harvard.edu