Text-based Document. Addressing National Research Priorities in Improvement Science. Authors Stevens, Kathleen R. Downloaded 17-Jul :38:21

Similar documents
Evolving Evidence to Excellence. Kathleen R. Stevens, RN, EdD, ANEF, FAAN Academic Center for Evidence-Based Practice

This transition guide serves to outline the updates and new content found in Management and Leadership for Nurse Administrators, Seventh Edition.

James L. Harris, PhD, APRN-BC, MBA, CNL, FAAN. Linda Roussel, PhD, RN, NEA-BC, CNL, FAAN. Patricia Thomas, PhD, RN, FACHE, NEA-BC, ACNS-BC, CNL

A Multi-Phased Approach to Using Clinical Data to Drive Evidence-Based EMR Redesign. Kulik, Carole Marie; Foad, Wendy; Brown, Gretchen

Objectives. Empowering Nurses Through Evidence-Based Practice (EBP), Quality Improvement (QI), and Research. Announcements and Disclosures

Empowering Nurses Through Evidence-Based Practice (EBP), Quality Improvement (QI), and Research

DNP Programs: Making the most of faculty resources

THE ROLE OF THE RN IN AN INTERPROFESSIONAL PRIMARY HEALTH CARE TEAM

Laverne Estañol, M.S., CHRC, CIP, CCRP Assistant Director Human Research Protections

New Evidence-Based Practice Competencies for Practicing Nurses and Advanced Practice Nurses: From Development to Real World Implementation

Text-based Document. Defining Scholarship. Authors Whitlatch, Joy A.; Hall, Virginia L. Downloaded 7-Apr :31:41

from bench to bedside

Objectives. Preparing Practice Scholars: Implementing Research in the DNP Curriculum. Introduction

Text-based Document. Direct Care RN Perceptions of the Healthy Work Environment. Downloaded 28-Apr :39:51.

CROSSING THE CHASM: ENGAGING NURSES IN QUALITY IMPROVEMENT AND EVIDENCE BASED PRACTICE

APRN Transformational Leadership: Implementation of Advanced Practice Nursing Leadership Structure Within an Academic Medical Center

Text-based Document. Overcoming Buzzwords and Variability Through a Nurse EBP Mentor Program. Downloaded 18-Jun :51:12

Text-based Document. Advancing Nursing Informatics to Improve Healthcare Quality and Outcomes. Authors Sensmeier, Joyce E.

Event Based Nursing Peer Review: Knowing Harm to No Harm

Evidence-based Practice, Research, and Quality Improvement What s the Difference?

Using Systems Thinking Leadership and QSEN Competencies to Design a Nursing Career Development Framework

CNO Panel Discussion: Executive Leadership and the Doctor of Nursing Practice. Linda Roussel, PhD, RN, NEA-BC Moderator

Evidence-Based Practice. An Independent Study Short Course for Medical-Surgical Nurses

The Doctoral Journey: Exploring the Relationship between Workplace Empowerment of Nurse Educators and Successful Completion of a Doctoral Degree

SPECIAL SESSION: Creating Academic Service Partnerships for Education, Practice and Research

Text-based Document. Preparing Baccalaureate Nursing Students to be Microsystem Leaders. Belchez, Chito Arcos; Martin, David

Practical Application of High Reliability Principles in Healthcare to Promote Clinical Quality and Safety Outcomes

The Global Quest for Practice-Based Evidence An Introduction to CALNOC

Text-based Document. Authors Hande, Karen A. Downloaded 14-Jun :17:51

Text-based Document. Effectiveness of Educational Interventions on the Research Literacy of Post-Registration Nurses: A Systematic Review

Education Strategies to Promote Interprofessional Team Collaboration Skills for Health Professions Students: Efficacy and Impact

Scaling Up and Validating a Nursing Acuity Tool to Ensure Synergy in Pediatric Critical Care

Writing Manuscripts About Quality Improvement: SQUIRE 2.0 and Beyond

Turning Quality Upside Down: Using a Perfect Storm to Change the Quality Performance Culture. Centura Health. Centura Health 9/20/2011

Nurses as Leaders in Disaster Preparedness and Response: A Call to Action

Text-based Document. Nurse Practitioners Reshaping Health Care: From Roots to Shoots. Downloaded 13-May :09:44

Case-Based Nursing Peer Review Using Just Culture Principles. Jochem, Kathleen; Scott, Connie Ann; Stuckman, Cheryl Lynn

Text-based Document. The Indiana University Nursing Learning Partnership. Authors Broome, Marion E.; Everett, Linda Q. Downloaded 29-Jun :30:53

Evidence-based Practice (EBP) Robin Newhouse, PhD, RN, NEA-BC

The National Association of Clinical Nurse Specialists (NACNS)

TRANSFORMING NURSING EDUCATION FOR THE FUTURE

Application of QSEN competencies in a practice setting: The case of Cincinnati Children s Hospital Medical Center

Text-based Document. Bedside Shift Report: A Patient-Centered Approach to Improving Satisfaction Scores. Downloaded 9-May :22:54

Text-based Document. AACN Standards for Healthy Work Environments: After More Than a Decade, Where Are We Now? Barden, Connie; Cassidy, Linda

Targeted Strategies to Promote Nursing Faculty Individual and Collective Scholarly Excellence

The Committee on the Robert Wood Johnson Foundation Initiative on the Future of Nursing at the Institute of Medicine

Text-based Document. Academic Mentoring and Job Satisfaction of Baccalaureate Nursing Faculty. Authors Wilson, Kimberly M.

Workforce Development: The Future of Nursing Informatics

Patient Safety: 10 Years Later Why is Improvement So Hard? Patient Safety: Strong Beginnings

The Role of the Agency for Healthcare Research and Quality (AHRQ) in the US Drug Safety System

[Free Sigma Book Excerpt Chapter 1] Identify Triggering Issues/Opportunities

Creating an Ohio Nurse Competency Model-Based RN Job Description Utilizing Delphi Methodology

Text-based Document. Perceptions and Writing Experiences of Nursing Students: A Mixed Methods Exploration of Writing Self-Efficacy

Rutgers School of Nursing-Camden

Text-based Document. Implementing Strategies to Improve Patient Perception of Nursing Communication. Dunbar, Ghada; Nagar, Stacey

NDNQI Rhythms in Quality 2010 Data Use Conference

Text-based Document. Formalizing the Role of the Clinical Nurse Leader in a Progressive Care Unit. Authors Ryan, Kathleen M.

PATIENT-CENTERED OUTCOMES RESEARCH INSTITUTE (PCORI)

Lessons From Infection Prevention Research in Emergency Medicine: Methods and Outcomes

Innovations for Integrating Quality and Safety in Education and Practice: The QSEN Project

Text-based Document. Patients' Perceptions of Hope and Hope-Engendering Nurse Interventions. Stavarski, Debra Haas. Downloaded 30-Apr :22:42

2018 Nurse.com. Nursing Salary Research Report

Problem The Joint Commission (JC) and Institute of Medicine (IOM) identify inpatient falls as a significant patient safety risk However research regar

Blueprint For Success: The Patient Centered Medical Home

Equipping for Leadership: A Key Mentoring Practice. Eliades, Aris; Weese, Meghan; Huth, Jennifer; Jakubik, Louise D.

Text-based Document. Emancipatory Nursing Praxis: A Theory of Social Justice in Nursing. Authors Walter, Robin R. Downloaded 26-Jun :00:44

Establishing Ambulatory Nursing- Sensitive Indicators

Text-based Document. Building a Culture of Safety: Aligning innovative leadership rounding and staff driven hourly rounding strategies

The Future of Nursing and the Role of Accelerated Degree Students

Creating Care Pathways Committees

Text-based Document. National Survey of Opinions and Preferences About the Required Culminating Project of DNP Programs. Daroszewski, Ellen Beth

The Influence of Technology on the Nurse's Technical-Clinical- Ethical Training

COOK COUNTY HEALTH & HOSPITALS SYSTEM

Clinical Research Proposal To the Jersey City Medical Center Institutional Review Board

HELP WANTED: THE DNP IN MAINSTREAM PRACTICE. Mary Jo Assi, DNP, RN, NEA-BC, FNP-BC, AHN-BC

21 st Century Health Care: The Promise and Potential of a Learning Health System

13th Annual Meridian Nursing Research and Evidence Based Practice Conference 2017 General Guidelines for Abstract Submission

Learning Activity: 1. Discuss identified gaps in the body of nurse work environment research.

Text-based Document. Data Acquisition Collaboration for Nursing-Cost Study Using. Authors Jenkins, Peggy A.; Chipps, Esther M.

Care of Veterans: A Patient with Post Traumatic Stress Disorder and Depression in a Peri-operative Scenario

Creating an Interactive DNP Project Repository:A Model for Change

Accelerated Translational Incubator Pilot (ATIP) Program. Frequently Asked Questions. ICTR Research Navigators January 19, 2017 Version 7.

School of Nursing Applying Evidence to Improve Quality

The presentation will begin shortly.

Strategic Plan wmich.edu/research

DNP-Specific Policies and Procedures

Invited Speech: Evidence Based Practice: Acuity Based Care and Research Practice Change

An Analysis of Peer Teaching Between Adult Health and Nursing Assessment Students

Taking the Next Step in Your Nursing Education

Integrated Leadership for Hospitals and Health Systems: Principles for Success

Text-based Document. Developing Cultural Competence in Practicing Nurses: A Qualitative Inquiry. Edmonds, Michelle L.

Artificial Intelligence Changes Evidence Based Medicine A Scalable Health White Paper

Title Student and Registered Nursing Staff's Perceptions of 12- Hour Clinical Rotations in an Undergraduate Baccalaureate Nursing Program

ST JOHN FISHER COLLEGE WEGMANS SCHOOL OF NURSING DOCTOR OF NURSING PRACTICE PROGRAM DNP PROJECT HANDBOOK

ANA Nursing Indicators CALNOC

MAP 1: Seriously Delinquent Rate by State for Q3, 2008

UNIVERSITY OF CALIFORNIA, IRVINE INTEGRATED UC IRVINE MEDICAL CENTER & SUE & BILL GROSS SCHOOL OF NURSING STRATEGIC PLAN

Text-based Document. Nursing Students' Perceptions of Satisfaction and Self- Confidence with High Fidelity Simulation. Authors Berkvam, Geraldine M.

HHS DRAFT Strategic Plan FY AcademyHealth Comments Submitted

Text-based Document. The Effect of a Workplace-Based Intervention on Moral Distress Among Registered Nurses. Powell, Nancy Miller

Transcription:

The Henderson Repository is a free resource of the Honor Society of Nursing, Sigma Theta Tau International. It is dedicated to the dissemination of nursing research, researchrelated, and evidence-based nursing materials. Take credit for all your work, not just books and journal articles. To learn more, visit www.nursingrepository.org Item type Format Title Presentation Text-based Document Addressing National Research Priorities in Improvement Science Authors Stevens, Kathleen R. Downloaded 17-Jul-2018 02:38:21 Link to item http://hdl.handle.net/10755/308761

Symposium Addressing National Research Priorities in Improvement Science November 19, 2013 1. Creating a National Research Agenda for Improvement Science 2. National Network Study of Operational Failures in Frontline Nursing 3. Best Practices in Team Science within a Healthcare Improvement Research Network 4. Human Subjects Review of a Multi-site Quality Improvement Study Conducted through a National Research Network Presenters Kathleen R. Stevens, RN, EdD, ANEF, FAAN Frank Puga, PhD Darpan I. Patel, PhD 2013

Creating a National Research Agenda for Improvement Science Presented by Kathleen R. Stevens, RN, EdD, ANEF, FAAN University of Texas Health Science Center San Antonio Supported by NIH/NINR 1RC2NR011946-01 3RC2NR011946-01S1 3RC2NR011946-01S2 RWJF INQRI grant ID: 63510 UL1RR025767

Mission: To advance the scientific foundation for quality improvement, safety, and efficiency through transdisciplinary research addressing healthcare systems, patient-centeredness, and integration of evidence into practice Core Business: To conduct improvement research studies.

Setting the Stage The Need for Improvement We ve seen the reports To Err is Human Crossing the Quality Chasm McGlynn, et al., The quality of health care delivered to adults in the United States, NEJM, 2003. AHRQ Quality Reports, care remains suboptimal

So why is it 150 years after Semmelweis hand washing still an issue Central line infections we know how to prevent them Early return to hospitals patients not adequately prepared for discharge

Catalysts Improving our work is our work. Future of Nursing calls for nurses to lead and manage collaborative efforts with other members of the health care team to conduct research and to redesign and improve practice environments and health systems. (IOM, 2011) Lead with evidence of what works

Strategies for Implementing EBP require an evidence base of their own (Shojania & Grimshaw. 2005)

Setting the Stage: Need for Improvement Science Patient safety and quality improvement are clearly-stated national priorities. Improvement science still nascent, particularly in multidisciplinary care processes within the hospital setting. Small tests of improvement strategies are insufficient large samples are needed Discovering what works in improvement strategies requires rigorous evaluation approaches = improvement science

Definitions IMPROVEMENT SCIENCE rigorous, multisite, transdisciplinary research that Focuses on healthcare improvement (QI, safety) Determines improvement strategies that work Evaluates improvement strategies in healthcare, systems, and safety (ISRN, 2010) 9

Challenges of Terminology Healthcare Delivery Science Translational Science Knowledge Translation Evidence- Based Practice/CER Dissemination and Implementation Science GOAL: Shorten time between discovery and full implementation 10

1 New Resource: A Unique Research Laboratory

How Do We Know An Improvement Strategy Works? What work environment details prevent medication errors? Orange vests What impact does improved team performance have on patient safety? TeamSTEPPS training

R & D Strategies for the Improvement Science Research Network Create a shared vision for the work to be done (research priorities) Assure academic-practice partnership for relevancy Provide cyber infrastructure hub for interprofessional improvement and implementation research Launch landmark multi-site research studies Provide essential support though the ISRN Coordinating Center

Shared Vision: Stakeholder Informed Research Priorities A systematic approach to create the research agenda. Purpose: To identify views about national priorities for improvement science and build agreement for action in a national improvement research and development network in the USA.

Research Priorities in Improvement Science: setting the national agenda Improvement Research Priorities Stakeholders RAND Delphi Survey

PRIORITIES Available: www.isrn.net 16

STRUCTURE The ISRN includes: Mission Priorities Network Associates Steering Council Coordinating Center (Base: Academic Center for Evidence-Based Practice, University of Texas Health Science Center San Antonio) Network Studies and Collaboratives Technology infrastructure Website: www.isrn.net

1 New Resource: A Unique Research Laboratory

19 ISRN Members

20 ISRN Steering Council

21 ISRN Coordinating Center Team

2 New Resource: A Unique Research Laboratory

Definition Collaboratory Center without walls in which researchers can work together regardless of physical location. (Wulf, 1993) spans distance supports rich human interaction oriented to a common research area access to data sources and tools RESOURCE: Olson, Zimmerman, & Bos, 2008 23

Why a Collaboratory for Improvement Science Complex scientific problems beyond the realm of single discipline or single scientist Evidence that collaboration increases quality of research Information and communication technologies-now cost-effective and reliable 24

2 New Resource: A Unique Research Laboratory

26 FUNDED: NINR/NIH $3.2 million 2009-2012 AIM: Accelerate interprofessional improvement science in a systems context across multiple hospital sites. Create a large-scale research collaboratory to conduct improvement research studies. Coordinating Center (ACE/UTHSC) Cyberinfrastructure (virtual collaboration) Research Partners Reflects many CTSA Principles

Structuring the Improvement Science Collaboratory Practice Based Research Networks 25 years of AHRQ development ISRN is registered PBRN with AHRQ Science of Team Science Research Collaboratives Collaboration on the Internet Evidence-Based Assessment and Development 27

Improvement Science Research Network Study Guidelines Network Studies are landmark studies conducted across multiple settings Key Features include: Research Collaborative Rigorous design Science of team science for virtual collaboration Co-led by scientists and clinicians Network PIs; Site PIs Coordinating Center support

STUDY 2: Impact of Cognitive Load, Interruptions and Distractions on Procedural Failures and Medication Administration Errors

30 STUDY 1: Small Troubles, Adaptive Responses (STAR-2): Frontline Nurse Engagement in Quality Improvement

3 New Resource: How well does it work?

National Network Study of Operational Failures in Frontline Nursing Small Troubles, Adaptive Responses (STAR-2): Frontline Nurse Engagement in Quality Improvement Presenting Kathleen R. Stevens, RN, EdD, ANEF, FAAN University of Texas Health Science Center at San Antonio

Small Troubles, Adaptive Responses (STAR-2): Frontline Nurse Engagement in Quality Improvement BACKGROUND In frontline nursing, workarounds are a response to first order operational failures exposing patients to errors and creating inefficiencies in care. (Hassmiller) Endemic shortages of nursing staff and difficult working conditions present substantial barriers on the path to improvement. (Tucker)

Study Background Failures occur about one per hour per nurse on hospital units and 95% of problems are managed through workarounds. (Observational, Tucker) Detection of first order operational failures provides opportunities to fix problems and contributes to organizational learning. Frontline engagement produces better solutions

Network Study of Operational Failures 1. Detect 2. Eliminate

DETECT Aims of STAR-2 Describe first-order operational failures (defects) Investigate relationships among Detection of first-order operational failures Organizational context, and Outcomes related to quality improvement Results will guide redesign to decrease defects

Does the ISRN work? Conduct in the ISRN research laboratory Multisite, cross-sectional, multivariate research 55 sites applied 14 sites, 41 med/surg units, ~840 RNs 4 Pediatric Hospitals Analyze data using descriptive, multivariate, and path analysis methods

STAR-2 Research Collaborative Study Teams from 14 sites Deaconess Hospital, Evansville, Indiana Site PI: Ellen Wathen, PhD, RN-BC Research Coordinator: Claire Bennett, BSN, RN University South Alabama Medical Center, Mobile, Alabama Site PI: Lisa Mestas, MSN, RN Site PI: Linda Roussel, DSN, RN, NEA-BC Research Coordinator: Ellen Buckner, DSN, RN, CEA Research Coordinator: Valorie Dearmon, DNP, RN, NEA-BC Baptist Memorial Hospital DeSoto, Southaven, Mississippi Site PI: Mary Townsend-Gervis, BSN, MSN Research Coordinator: Lauren Yates, RN Research Coordinator: Diana Baker, Ed.D., APRN-BC, NEA-BC Huntington Memorial Hospital, Pasadena, California Site PI: Linda Searle Leach, RN, PhD Research Coordinator: LuLu Rosales, RN, MSN Loma Linda University Medical Center, Loma Linda, California Site PI: Ellen D'Errico, PhD, RN NEA-BC Research Coordinator: Patricia Radovich, MS Ochsner Medical Center, New Orleans, Louisiana Site PI: Karen Rice, DNS, APRN, ACNS-BC, ANP Research Coordinator: Rachael Ballas- RN Research Coordinator: Shelley Thibeau- MSN, RN-C The Reading Hospital and Medical Center, West Reading, Pennsylvania Site PI: Vicki Smith, MS, RN Research Coordinator: Debra Stavarski, MSN, RN Palmetto Health Richland, Columbia, South Carolina Site PI: Janice Withycombe, PhD, RN Janice.Withycombe@PalmettoHealth.org) Research Coordinator: Marie Frick-, RN Research Coordinator: Christine Walukewicz, RN, MN Colorado Children s Hospital, Aurora, Colorado Site PI: Anne Marie Kotzer, PhD, RN, CPN Research Coordinator: Joleen Fischer, BSN, RN, CPN Research Coordinator: Jessica Perdue, BSN, RN, CPN Research Coordinator: Nicki Shonka, BSN, RN, CPN Children s National Medical Center, Washington, D.C. Site PI: Eileen Engh, MSN, RN-BC, CPN Research Coordinator: Andrea Colevas, MSN, RN,CPN Research Coordinator: Catherine Williams, RN, BSN, MS, NE-BC Research Coordinator: Sharon Bostic, MBA, BSN, RN Nationwide Children s Hospital, Columbus, Ohio Site PI: Nancy Ryan Wegner, PhD., RN Research Coordinator: Carol Risch, RN, MSN Maine Medical Center, Portland, Maine Site PI: Marthe Riehle, RN, MSN, MBA, NEA-BC Research Coordinator: Denise Dende, MFA Cincinnati Children s Hospital Medical Center, Cincinnati, Ohio Site PI: Heather Tubbs-Cooley, PhD, RN Research Coordinator: Carolyn Smith, MSN, RN Doctor s Hospital - Baptist Health South Florida, Miami, Florida Site PI: Carolyn Lindgren, PhD, RN Research Coordinator: Cheryl Brown, BSN, RN

STAR-2 and STAR-2+ Research Collaborative

Virtual Collaboration Tools Using the ISRN Collaboratory, STAR-2 was designed to capture a national sample in order to obtain a larger database of operational failures and interacting systemslevel variables. Fidelity of the protocol is assured through the ISRN s Coordinating Center. Using ISRN s unique infrastructure, STAR-2 is able to capture a large, national sample through multiple study sites that are associates in this virtual research network.

Protocol Implementation Kit

Data Collection-Plan Identical across all sites Supported though Coordinating Center Data aggregated via electronic database Collected 10 shifts over 20 days Analysis Aggregate Site-Specific report

Survey Packet

Evidence-Based Field Guide for Collaboration

Results: Small Troubles 14 hospitals completed 716 RNs engaged 85% of enrollment for 14 sites 3,902 pocket cards submitted 5.53 cards per RN 24,014 operational failures reported 6,420 Equipment/Supplies Most reported operational failure 4,396 Information/Communication- Second most operational reported failure 3,648 Other- Third most reported operational failure 6.15 failures per 12 hour shift

Average Number of Operational Failures Per 12 hr Shift Operational Failures Per 12 hr Shift (N=2,930 Shifts) 2 1.8 1.55 1.6 1.4 1.21 1.2 0.91 1.07 0.96 1 0.8 0.6 0.45 0.4 0.2 0 Equipment Layout Information Staffing Medication Other

Discussion: Study and ISRN Frequency of operational failures occurring in med-surg units Frontline engagement, context, and quality improvement Satisfaction Rating: ISRN infrastructure is effective for conducting multisite improvement research: Enthusiasm for engagement in rigorous research Broad national representation Clinical relevance Rapid deployment & completion Scale up and spread Virtual Collaboration Regulatory-IRB

Using the ISRN Collaboratory, STAR-2 was designed to capture a national sample in order to obtain a larger database of operational failures and interacting systems-level variables. Fidelity of the protocol is assured through the ISRN s Coordinating Center. Using ISRN s unique infrastructure, STAR-2 is able to capture a large, national sample through multiple study sites that are associates in this virtual research network. 49

STUDY 3: System Factors that Facilitate Uptake of Team Performance for Patient Safety (TeamSTEPPS )

TeamSTEPPS

Note that each Network Study is open for ISRN members to become Site Investigators Study Priority Status STAR-2 B-Microsystem PHASE 2 ACTIVE: Currently building research collaborative with 12 hospitals. Phase 1 complete in 14 hospitals. 20,000+ data points gathered and analyzed. Medication Errors and Cognitive Load B-Microsystems PHASE 2 ACTIVE: Currently building research collaborative with 4 hospitals. Phase 1 near finalizing data entry. Data analysis currently underway STAR-RT B-Microsystem IN DEVELOPMENT: Project is under development by Network PI. Call for interested hospitals to participate in this study will be released 1st quarter of 2014. TeamSTEPPS Care Coordination Care Transition STAR-3 Improvement Collaborative Your 52 Study Here B-Microsystems D-Macrosystems A-Transitions and Coordination in Care A-Transitions and Coordination in Care B-Microsystems C-Uptake of Evidence- Based Practice A, B, C, or D IN DEVELOPMENT: Project is under development by Network PI. Call for interested hospitals to participate in this study will be released 1st quarter of 2014. In DEVELOPMENT: Archived Web Seminar August 2012 to activate ISRN member interest. Potential intervention identified for Network testing. IN DEVELOPMENT: Archived Web Seminar July 2012 to activate ISRN member interest. IN DEVELOPMENT: Project to test interventions for STAR-2 are currently being developed. IN DEVELOPMENT: Project is on the drawing board You are invited to design a Network Study for launch across our 200+ member network.

Best Practices in Team Science within a Healthcare Improvement Research Network Presented by Frank Puga, PhD University of Texas Health Science Center San Antonio

A Collaborative Approach Health care quality improvement is a complex process requiring partnerships between scientist and academicians. Collaboration and team science is growing as a methodology to address complex problems (Stokols et al., 2008). 54

A Framework for Collaborative Research The Science of Team Science (SciTS): Provides the evidence base for scientific teams. Benefits of collaboration Factors that contribute to success Systematic approach to building a research collaborative Taken from Falk-Krzesinski et al., 2010

Theory of Remote Scientific Collaboration Factors for Successful Virtual Collaboration Nature of the Work Common Ground Collaboration Readiness Management, Planning, and Decision Making Olson, G.M., Zimmerman, A., & Bos, N. (2008) Technology Readiness 56

Building ISRN Research Collaboratives Research Network Strategies: Virtual Collaboratory Readiness for Collaboration Shared Mental Model Project Support and Management 57

ISRN Research Infrastructure Coordinating Center Support Academic-Practice Partnerships Training meetings Capacity Building A protocol implementation kit Technical resources (e.g. centralized database) 58

Success Indicators Study management (# protocol deviations) Engagement (meeting participation) Readiness (timeline adherence) Virtual Readiness (quality of research infrastructure, collaborative success) 59

Case Study 14 hospitals engaged in an ISRN Network Study Average size: 425 beds Average Daily Census: 74.7% Site Study Team: Site Principal Investigator, Site Coordinator, and Research Associates 60

Data Collection Review of Regulatory documents Survey: Site Principal Investigators and Site Coordinators 61

Table 2. Protocol Deviations, Emails Received, Timeline Adjustments Collaborating Protocol Emails Received Timeline Meeting Site Deviations (N) (N) Adjustment Attendance (%) Site 1 2 55 Yes 83.3% Site 2 NA 104 No 100.0% Site 3 6 42 No 100.0% Site 4 NA 75 Yes 100.0% Site 5 1 39 No 100.0% Site 6 10 32 Yes 100.0% Site 7 19 78 No 100.0% Site 8 2 101 No 100.0% Site 9 NA 43 Yes 100.0% Site 10 4 32 No 83.3% Site 11 NA 81 No 100.0% Site 12 14 33 No 100.0% Site 13 0 20 Yes 66.7% Site 14 15 37 No 83.3% 62 NA = Not Available (Puga, Stevens, and Patel 2013)

Table 3. Summary on the Quality of Services offered by the ISRN Coordinating Center Quality (% responses) ISRN COORDINATING CENTER SERVICES & RESOURCES Low Medium High Total (Puga, Stevens, and Patel 2013) Focused on improvement science as the Network mission 0 0 100 100 Responded quickly and effectively to Site PIs emails and phone calls. 0 6 94 100 Provided clear description of the structure of ISRN (e.g., Network PIs; Site PIs; Network Studies) 0 6 94 100 Established Network structure and processes that supported collaboration 0 19 81 100 Furnished clear call for letters of intent and application for STAR-2 sites. 0 6 94 100 Supported Site PIs and Collaborators as full partners in the study. 0 13 88 100 Outlined fair guidelines for collaboration (e.g., publication credits) 0 25 75 100 Provided a useful SharePoint site 7 13 80 100 Engaged 63 sites in an action plan for continuing in ISRN Network studies. 13 20 67 100

SciTS-Based Research Infrastructure Conclusions SciTS created a robust research environment that fosters transdisciplinary collaboration Fidelity of the protocol was assured across multiple sites. Time lines and deliverables were met Collaboration success was positively rated (Bietz et al., 2012) What about impact on research results? 64

General Conclusions Transdisciplinary models are effective in improvement research SciTS provides a strong framework Further research is needed to study the impact on dissemination and implementation of effective improvement strategies 65

Resources Stevens, Puga, and Patel 2012 http://isrn.net/researchcollaborativeguide 66

Resources https://isrn.net/learningmodules 67

Human Subjects Review of a Multi-site Quality Improvement Study Conducted through a National Research Network Presented by Darpan I. Patel, PhD University of Texas Health Science Center San Antonio

69

Gap in Knowledge There is a need to figure out what works in our healthcare systems. Need to increase the quantity, quality and generalizability of improvement research. (Berwick, 2008) Initiated by the IOM report indicating a need to transform the healthcare system. (IOM 2000, 2008)

But what is it? Research Quality Improvement

Is it Research? Research a systematic investigation, including research development, testing and evaluation, designed to develop or contribute to generalizable knowledge. (45 CFR 46.102(d)) Quality Improvement

Is it Quality Improvement? Research Quality Improvement -systematic, data-guided activities designed to bring about immediate positive changes in the delivery of health care in particular settings. (Baily et al., 2006)

Regulatory Difficulties in Improving Care Michigan Keystone ICU project (Pronovost et al., 2006) Exempt from IRB review OHRP sends Determination Letter indicating it conducted non-exempt human subjects research; deemed the study should have had full board review PBRN Health Services Research Variations in review type, time to approval and consenting requirements Delays in study start up, due to regulatory processes

Regulatory Difficulties in Improving Care

Regulatory Challenges Improvement Science determine which improvement strategies work Generalizable Knowledge Informed Consent Analysis of Administrative Data HIPAA

Test Your Knowledge If I plan to carry out a quality improvement project and publish the results, does the intent to publish mean I have to submit my project for IRB review?

Regulatory Challenges Intent to Publish Does it mean I need to go through IRB? Major implications on DNP projects Need to assure that ethical standards have been addressed in the planning and implementation of the QI activity (Ogrinc, et al., 2008) ISRN Blog

Purpose Review the processes and variations in the IRB approvals in the implementation of a multi-site, improvement study.

Facilitating IRB Submissions ISRN Coordinating Center produced Protocol Implementation Kits for each site. PIKs contained IRB templates Standardized Protocol Sample IRB Application Sample Consent Form Sample Information Brochure Study promotion materials Sites were asked to sign investigator agreements to facilitate a quicker study start up

Methods An ad hoc review of IRB application materials and correspondences was conducted. Identified the level of review conducted and noted any changes that were made in the final approved documents. Time to submission, time to approval and time to study start was calculated.

Results 13 of the 14 study sites conducted independent IRB review 1 study site signed an agreement to fall under the UTHSCSA FWA. No changes to the protocol or ICF were requested.

Results Table 1. IRB Review Type and Requirement for Documented Consent Wave Hospital IRB Type Review Type Documented Consent 1 A Academic Expedited No 1 B Academic Expedited Yes 2 C Hospital Expedited Yes 2 D Academic Expedited Yes 2 E Hospital Full Board Yes 2 F Hospital Expedited Yes 2 G Hospital Expedited No 2 H Hospital Expedited Yes 3 I Hospital Expedited Yes 3 J Hospital Full Board Yes 3 L Hospital Expedited Yes 3 K Hospital Expedited Yes 3 M Academic Expedited Yes 3 N Hospital Expedited Yes

Results Table 2. Study start-up times (in business days) Days to Submission Days to Approval Days to Study Start All Hospitals 45.1 ± 31.8 14 ± 5.7 29.9 ± 10.1 Academic IRB 24.0 ± 22.0 16.3 ± 10.6 22.75 ± 10.2 Hospital-based IRB 54.1 ± 32.2 13.7 ± 2.8 32.7 ± 9.1

Areas of concern for the IRBs Data security Consenting Process Data Collection

Limitations If you ve seen one IRB you ve seen one IRB! Risk was minimal higher risk studies may result in greater variations.

Conclusions Lack of investigator agreements indicate IRBs wanted direct oversight of improvement research at their facilities. IRB approvals, facilitated by the ISRN Coordinating Center and the PIK, resulted in no resubmissions and quick turn around times. IRB review was seemingly streamlined and timely Working with research organizations can provide resources to clinician researchers.

SUMMARY Symposium Addressing National Research Priorities in Improvement Science November 19, 2013

Summary The Improvement Science Research Network (ISRN) aims to accelerate the development and dissemination of interprofessional improvement science in a systems context across multiple sites. Membership organization comprised of hospitals and universities wanting to engage in quality improvement research The uniqueness of the ISRN is that its focus on organizational systems makes it possible to scientifically explore the system effect(s) on the delivery of healthcare in the acute care setting. The Improvement Science Research Network (ISRN) aims to accelerate the development and dissemination of interprofessional improvement science in a systems context across multiple sites. 90

Summary The ISRN actively drives advancements in improvement science by: Creating an infrastructure for multidisciplinary acute care providers to collaborate on improvement science projects through ISRN membership Directing national improvement science research priorities Supporting Network members in developing theories, methods, and designs for achieving rigorous improvement science research Offering central data management and expert analysis for improvement science research studies 91

ISRN as a Research Laboratory The ISRN is dedicated to building a foundation for CER in improvement. ISRN provides a laboratory to greatly enhance feasibility and generalizability of research projects. Provides a robust infrastructure for national programs of research to test quality improvement interventions. Managed by a coordinating center with expertise in evidence-based practices, project implementation, project management, regulatory aspects of research, statistical analysis, and team science principles. Research Portfolio: Frontline engagement in quality improvement and detecting operational failures Impact of cognitive load, interruptions and distractions on medication administration errors Investigating the role of team performance in clinical outcomes 92

93 Resources

94 Resources

Resources-Bibliography Berwick, D. M. (2008). The science of improvement. JAMA, 299, 10, p. 1182-1184. Ferrer, R. L., Stevens, K. R, Sintes, A., Patel, D. I, & Puga, F. (In Review). Real-time reporting of small operational failures in nursing care. BMJ Quality and Safety. Stevens, K. R & Ovretveit, J. (2013). Improvement research priorities: USA survey and expert consensus. Nursing Research and Practice. 2013 (Article ID 695729), 1-8. Stevens, K. R. (2013). The impact of evidence-based practice in nursing and the next big ideas. Online Journal of Nursing Issues. 8 (2), 4. Patel, D. I., Stevens, K. R., & Puga, F. (2013). Variations in institutional review board approval in the implementation of an improvement research study. Nursing Research and Practice. 2013, Article ID 548591, 6. Puga, F., Stevens, K. R., & Patel, D. I. (2013). Adopting of best practices in team science within a healthcare improvement research network. Nursing Research and Practice. Volume 2013 (2013), Article ID 814360, 7 pages. Retrieved from http://dx.doi.org/10.1155/2013/814360. Bietz, M. J., Abrams, S., Cooper, D., Stevens, K.R., Puga, F., Patel, D. I., Olson, G. M., & Olson, J. S. (2012). Improving the odds through the Collaboration Success Wizard. Translational Behavioral Medicine, 1-7, Retrieved from http://dx.doi.org/10.1007/s13142-012- 0174-z. 95

Resources-Bibliography Ogrinc, G., Mooney, S.E., Estrada, C., et al. (2008). The SQUIRE (Standards for QUality Improvement Reporting Excellence) guidelines for quality improvement reporting: explanation and elaboration. Quality and Safety in Health Care, 17, :i13-i32 doi:10.1136/qshc.2008.029058. Stevens, K. R, Puga, F., & Patel, D. I. (2012). An Evidence-Based Research Collaborative Guide. San Antonio, Texas: University of Texas Health Science Center San Antonio. Stevens, K. R. (2012). Delivering on the promise of EBP. Nursing Management, 43(4), 19-21. Stevens, K. R. (2010). Evidence-based practice: Destination or journey? Nursing Outlook, 58(6), 273-275. Stevens, K. R. (2009). Essential competencies for evidence-based practice in nursing (2nd ed.). San Antonio, TX: Academic Center for Evidence-based Practice (ACE) of the University of Texas Health Science Center San Antonio. Stevens, K. R. (2009). Companion instrument, ACE EBP Readiness inventory ( 2nd ed.) Academic Center for Evidence-based Practice (ACE). San Antonio, TX: University of Texas Health Science Center San Antonio. Available from ACESTAR@uthscsa.edu. Trochim, W. M., Marcus, S. T., Masse, L. C., Moser, R. P., & Weld, P. C. (2008). The evaluation of large research initiatives: A participatory integrative mixed-methods approach. American Journal of Evaluation, 29(1), 8-28. 96

Resources-Other Improvement Science Research Network. Visit www.isrn.net. ISRN Research Agenda available at http://www.isrn.net/research Network News. ISRN Newsletters, chronicling the development and projects of the ISRN. http://www.isrn.net/newsletter Building Successful Research Collaboratives for Healthcare Improvement is an evidencebased guide based on best practices for research collaboration in investigative teams. Adventures in Evidence-Based Practice: Accelerating Discoveries to Outcomes. A 38- minute streaming video highlighting knowledge transformation and improvement science. http://www.acestar.uthscsa.edu/ Summer Institutes on Quality Improvement: A cluster of interprofessional conferences. August 4-8, 2014. San Antonio. Improvement Science Summit. The first national research methods conference highlighting the unique and expanding designs and statistics used in improvement science, implementation research, and quality improvement projects. Summer Institute on Evidence-Based Quality Improvement. The nation s leading interprofessional conference dedicated solely to moving research into practice. 97

Acknowledgements FUNDING This project was supported by National Institute of Nursing Research-Grand Opportunities ARRA 1RC2NR011946-01 3RC2NR011946-01S1 3RC2NR011946-01S2 RWJF INQRI grant ID: 63510 National Center for Research Resource Clinical and Translational Science Award UL1RR025767 This content is solely the responsibility of the authors and does not necessarily reflect the official views of the funding agency. PEOPLE Thanks to ISRN Coordinating Center team for their essential support. Thanks to ISRN associates that formed the ISRN and Network Study Research Collaboratives. Thanks to the ISRN Steering Council who saw the ISRN on a blank slate.

Contact Information www.isrn.net ImprovementScienceResearch@ISRN.net 210-567-1480 StevensK@uthscsa.edu PatelD7@utscsa.edu Puga

PURPOSE: to advance cutting evidence-based nursing practice, research, and education within an interdisciplinary context. GOAL: to turn research into action, improving health care and patient outcomes through evidence-based practice, research, and education. www.acestar.uthscsa.edu EMAIL: acestar@uthscsa.edu

To move the world we must first move ourselves. -- Socrates