An update on UPLOADS: New Insights, New Methods and a New Dawn for the Led Outdoor Activity Domain

Transcription

1 An update on UPLOADS: New Insights, New Methods and a New Dawn for the Led Outdoor Activity Domain Dr Paul Salmon Monash University Injury Research Institute Australia Camps Association Conference, 1 st September 2012

2 Content UPLOADS Database characteristics - review and Delphi survey Accident data analysis Development of accident analysis framework Phase 2 2

3 What if? We all collected detailed data on accidents and near miss incidents. Analysed this data using a valid, universal accident analysis framework. Shared these analyses with one another. Talked openly about accident causation and near misses Reported often on countermeasures and their success. 3

4 UPLOADS Project 1. Methodological development. Prototype incident reporting, storage and analysis methods will be developed, forming a prototype accident & injury surveillance system; 2. Methodological validation and refinement. Surveillance system methods will be trialled and refined using led outdoor activity injury incident data; 3. In-depth incident study. Injury surveillance system will be implemented in order to conduct an in-depth study of injury causing incidents in the led outdoor activity domain in Australia; and 4. Accident causation model development. Based on the findings, a systems-based model of injury incident causation for the led outdoor activity domain will be developed.

5 UPLOADS Data collection UPLOADS system Data analysis Reporting of aggregate data Led Outdoor Activity Providers Process Instructor/Safety manager Instructor/Safety manager Instructor/Safety manager Instructor/Safety manager Report incident Report incident Report incident Report incident Organisation s data system Organisation s data system Organisation s data system Organisation s data system Auto de-identification Auto de-identification Auto de-identification Auto de-identification Auto de-identification USC UPLOADS USC Activity Incident Injury Contributory factors *Note data is non-identifiable regarding organisations, instructors, participants etc USC UPLOADS annual report Periodic reporting to industry Ad hoc data requests Instructor/Safety manager Report incident Organisation s data system *Note reporting shows aggregate data only and is non-identifiable *Note; organisations can run their own in-house analyses using own organisation level database Products Standardised incident/near miss reporting form Organisation level database UPLOADS aggregate database UPLOADS analysis framework 5

6 UPLOADS development UPLOADS system needs to be: Data driven - Analysis of existing led outdoor activity accident data Theory driven - Review of accident causation theory Domain expert driven - Delphi study 6

7 Data Driven NZ/Australian accident data analysis 7

8 Accident causation Laws Regulations Company Policy Government Regulators, Associations etc Company Management Safety is impacted by the decisions of all actors politicians, CEOs, managers, safety officers and work planners not just the front-line workers alone (Cassano-Piche et al, 2009) Plans Staff Action Work

9 Accimap

10 New Zealand National Incident Database New Zealand Outdoor Education/Recreation data Jan 2007 Dec 2011, 1017 cases (Data de-identified) Australian data Data coded by 3 analysts Frequency counts 10

11 Incident type Fatalities Injuries Illnesses Near misses 11

12 Activities Activity Type Injury Illness Near Miss Fatalities Miscellaneous Ball sports Free time Climbing activities Walking/Running activities Weapons Camping activities Boating activities Caving Swimming Cycling Ropes Skiing/Boarding Horse riding Initiatives Motor bikes Total

13 Causal factors

14 Most common causal factors Hazardous terrain Instructor judgement errors Participant unsafe acts 14

15 Causal factors across system Government Policy and Budgeting Government Actions (12) Actions of other companies (2) Regulatory Bodies and Associations Industry body failures (2) Local area government, parents, schools and activity centre management, planning and budgeting Company policy failures (27) Company systems (74) Parent factors (13) School factors (6) Technical and operational management Poor planning (82) Operational management factors (39) Site maintenance (1) Management communication factors (7) Supervisor factors (179) Physical processes and instructor/participant activities Participant factors (834) Instructor factors (499) Leader factors (4) Group factors (30) Communication failures (51) Other actors (30) Bad luck (9) Equipment and surroundings Equipment factors (328) Environmental factors (683) 15

16 Domain Expert Driven Database characteristics 16

17 Domain expert Delphi study Literature review to identify characteristics of accident/injury databases/surveillance systems Range of key characteristics identified Delphi study to identify industry/sme perspectives 25 participants (25 different organisations) Current practice, UPLOADS scope, and desirable characteristics 17

18 Results - definitions Multiple definitions of an incident Multiple definitions of a near miss Multiple definitions of an injury 18

19 Results - Current systems Yes No N/A Near misses Injuries Property damage Incident reporting system? What type of incidents? 19

20 Results - What is data used for? Insurance purposes Legal purposes Track staff problems Inform changes to policy and practice Training How is the data used 20

21 What sort of incidents should be included in UPLOADS? Near misses Injuries Property damage Only serious injuries All injuries Unsure Incident types Severity 21

22 Results - UPLOADS system? Yes No Yes No Online Manual Paper Manual Hands on Seminar Online Video Paper + electronic system Smart phone App Training 22

23 Desirable characteristics - Essential Characteristic Essential (%) Desirable (%) Not required (%) Representativeness Clear case definitions Ease of reporting Usefulness Utility Non punitive Credible Sustainability (system) Positive predictive value Use of uniform classification systems Simplicity Independent Data confidentiality and individual privacy Guidance material for data interpretation

24 Less important characteristics Clear purpose and objectives Data collection process described Sensitivity System security Systems oriented Flexibility Stability of the system Sustainability (sustained leadership support) Data completeness Quality control measures Expert analysis Accessibility Availability Acceptability Specificity Timeliness Responsive

25 Round 2 UPLOADS MUST have Property Yes No Clear purpose and objectives % 0% Data collection process described % 0% Flexibility % 0% Accessibility % 0% Stability of the system 94.70% 5.30% Systems oriented 89.50% 10.50% Sustainability (sustained leadership support) 89.50% 10.50% Quality control measures 89.50% 10.50% System security 84.20% 15.80% Data completeness 84.20% 15.80% Sensitivity 78.90% 21.10% Availability 78.90% 21.10% Specificity 73.70% 26.30% Timeliness 73.70% 26.30% Expert analysis 68.40% 31.60% Responsive 68.40% 31.60% Acceptability 63.20% 36.80% 25

26 The UPLOADS accident analysis framework 26

27 Accimap

28 UPLOADING Accimap Develop taxonomies of factors at each Accimap level based on: 1. Analysis of existing outdoor ed incident data; 2. Review of the literature on outdoor ed accident causation frameworks/taxonomies; 3. Review of general accident causation/taxonomy literature; and 4. Review of accident analysis methods Test and refine taxonomies throughout Taxonomies will grow during 6 month test of system 28

29 Accimap OE Accimap + taxonomies Provides structure for incident reporting forms Used to analyse incident data Report aggregate analyses across Accimap levels 29

30 Outdoor Ed Actor-Map Led outdoor activity ACTOR-MAP Government Policy and Budgeting Government bodies State Departments of Education e.g. Dept of Education and ECD State Departments of Land Management e.g. Parks Vic Regulatory Bodies and Associations Regulatory bodies Accreditation bodies Auditing bodies Peak bodies for outdoor recreation, outdoor education, and adventure tourism Victorian Adventure Activity Standards Standards Australia Outdoor Council of Australia (e.g. National outdoor leaders reg scheme) Local area government, parents, schools and activity centre management, planning and budgeting Activity centre senior management/ board level Local Govt & councils Schools, school principals and school councils Parents Emergency services Technical and operational management Supervisors Managers (e.g. programs, training, risk, teaching) Physical processes and instructor/participant activities level Instructor Participants Group Physical processes and instructor/participant activities level Equipment Physical environment Meteorological conditions Ambient conditions 30

31 Taxonomies Equipment and surroundings; Physical processes and instructor/participant activities; Technical and operational management; Local area government, activity centre management planning and budgeting, schools and parents; Regulatory bodies and associations; and Government policy and budgeting 31

32 Equipment and surroundings Equipment and materials Physical Environment Ambient & Meteorological conditions Activity equipment Terrain Temperature Lack of equipment Wet and slippery Hot Inadequate equipment Rocky Cold Inappropriate equipment Uneven walking surface Other Faulty/Broken equipment Poor road surface Weather Failure to use equipment Other Rain Equipment not used properly Water Drought New/unfamiliar equipment Strong current Hail Other Fast flowing water Sun Clothing & PPE Rocks under water Storm Lack of clothing/ppe Rising water levels (flood) High winds Inadequate activity clothing/ppe Waves Other Inappropriate clothing/ppe Low visibility in water Other Ambient conditions Restrictive clothing/ppe Other Noise Faulty/Broken clothing/ppe Trees and Vegetation Vibrations Activity clothing/ppe not used Trees and branches Lighting Activity clothing/ppe not used Falling branches Humidity properly Other Plant hazard e.g. thorns Dust Medication Other Air quality/pressure Lack of medication Environment Other Wrong medication Unfamiliar environment Other Other Lack of safe exits Food and drink Failure to maintain activity area Lack of food Falling object Lack of drink Man made structure Poor diet during activity Other Other Animals and insects Documentation Bite Lack of documentation Animal/insect hazard Inadequate documentation Other Incorrect documentation Documentation not used Other Other 32

33 Decision gates 33

34 34

35 Preliminary testing UPLOADS framework used to classify factors involved in Mangatepopo and Lyme Bay incidents 6 analysts Short introduction to method Comparison with expert analysis 35

36 % Agreement Mangatepopo Lyme Bay Identifying causal factors from incident description Classifying causal factors using taxonomy 36

37 Next steps Refining taxonomies Build UPLOADS system Phase 2 6 month trial of UPLOADS system 37

38 Next steps 1. Methodological development. Prototype incident reporting, storage and analysis methods will be developed, forming a prototype accident & injury surveillance system; 2. Methodological validation and refinement. Surveillance system methods will be trialled and refined using led outdoor activity injury incident data; 3. In-depth incident study. Injury surveillance system will be implemented in order to conduct an in-depth study of injury causing incidents in the led outdoor activity domain in Australia; and 4. Accident causation model development. Based on the findings, a systems-based model of injury incident causation for the led outdoor activity domain will be developed.

39 Thanks for the opportunity! 39