Impact The so what question.

Transcription

1 Impact The so what question. Dr Mark A Taylor Bristol 18 th November 2015

2 Today Introduction Issues around impact Work of NIHR CCF

3 Introduction Merck KGaA Isis Innovation Ltd 3i plc Oxford University Consulting Ltd NHS Institute of Innovation and Improvement NIHR Biomedical Research Centre, Oxford NIHR (PT) NIHR CCF (PT) PG Diploma Organisational Theory Said Business School PG Certificate Health Technology Assessment University of Sheffield 26/11/2015 3

4 Introduction I also run. A lot. Long term RRMS Past Trustee MS Society Current Trustee Asthma UK 26/11/2015 4

5 Introduction NIHR 26/11/2015 5

6 Introduction RDD NIHR CCF NETSCC NIHR TCC NIHR CRN Universities (Russell Group?) NHS (Shelford Group?) Other funders 26/11/2015 6

7 Issues around Impact Why is NIHR interested in impact? Is this just more work repeating the recent REF exercise? 26/11/2015

8 Issues around Impact Research Councils UK (RCUK) defines research impact as 'the demonstrable contribution that excellent research makes to society and the economy'. Assessing the non-academic impacts of research is far from new, but in recent years there has been growing interest, both in the UK and abroad, about how to measure the impact of research. From the general NIHR perspective are we just joining in or do we have a particular perspective? 26/11/2015 8

9 Issues around Impact Currently fund 1.03 billion of research a year How do we (should we) capture the patient benefit of such research? As NIHR do we capture the social, political and cultural impacts of academic research? What methodological approaches are most suitable and why? Is impact actually an appropriate metric for research, or does it simply make academics conform to funders research agendas? 26/11/2015 9

10 Health and Social Care Act 2012 Promotion in England of a comprehensive health service designed to secure improvement (a) in the physical and mental health of the people of England, and (b) in the prevention, diagnosis and treatment of physical and mental illness. Duty as to research In exercising functions in relation to the health service, the Secretary of State must promote (a) research on matters relevant to the health service, and (b) the use in the health service of evidence obtained from research. 26/11/

11 Issues around impact Impact assessment can have four main purposes; to provide accountability, analysis, advocacy, steer allocation of future funding. Impact assessment is only fair if evaluation is based on what was intended. Discuss. As REF14 shows impact takes time. 26/11/

12 Issues around impact What makes a good proxy impact? How do we attribute funding against impact? How do we ensure assessment is proportionate and not onerous? How can we ensure that NIHR (the Managing Agents) become impact savvy? 26/11/

13 Work of NIHR CCF RAND Europe independent examination of the Invention for Innovation Programme Internal lessons Data is key Definitions need work Staff training and expertise External lessons Clarity (where possible) of the difference between outcomes and impact 26/11/

14 Work of NIHR CCF Training Kings Policy Institute 10 modules re impact assessment (in house) Project work Impact Squad One NIHR CCF senior staff member per funding stream Other institutions Coventry University 26/11/

15 Work of NIHR CCF External Advisory Board Two academics Two research managers Two AMRC charity reps One industry rep Still to appoint, ideas gratefully received Shelford Group interviews 5 research intensive hospitals How do you define impact in terms of patient benefit? Other discussions 26/11/

16 Work of NIHR CCF Joint Workshop with the AMRC on Impact Policy Metric Proportionality Databases Research and Education International School of Research Impact Assessment (ISRIA) 26/11/

17 Work of NIHR CCF Long term Possible seconding post doc from Kings to research impact from within a funding organisation Issues surrounding external validation Impact assessment of the whole rather than bits Accepted protocols, second nature. 26/11/

18 Summary Observation, hypothesis, experiment Cultural change Data / definition challenge Training and education - impact savvy Patient benefit models of impact External validation 26/11/

19 Thank you for your time! Any questions?