Draft KPI dashboard
European Skills, Competences, Qualifications and Occupations 7 th Member States Working Group on ESCO ESCO (2018) SEC 008 DRAFT Document Date: 09/05/2018 Last update: 06/06/2018 Purpose of document Key performance indicators (KPI) are an important instrument to measure the success and quality of ESCO. The Commission presented a status update on the ESCO KPI framework to the ESCO Maintenance Committee on its 25 th meeting. The purpose of this document is to present a format for dashboards in which the KPI would be used for regular reporting to the committee and to the Member States Working Group on ESCO. These dashboards will use and show the KPIs that the Commission and the committee already discussed at previous meetings. At this stage, the dashboards are only based on sample data. The members of the Maintenance Committee members were invited to provide feedback on the format of the dashboards during its 26 th meeting, which took place in Brussels the 5 of June 2018. Five dashboards The ESCO team suggests to present group the KPI in dashboards along the following five topics: 1. Acceptance of ESCO as a de facto standard 2. ESCO in EURES 3. Evolution of the ESCO qualifications pillar 4. Conceptual and terminological coverage 5. Level of granularity of ESCO The five draft dashboards are shown below. Next steps In the implementation, the ESCO team would give priority to the KPIs that can be measured first. Once in place, dashboards will be regularly updated. Summer 2018 September 2018 MAI meeting Cooperation with EURES team and Cedefop to identify the best datasets and ways of measuring KPIs Real data for dashboard #1 (Acceptance as de facto standard) and possibly #3 (evolution of the qualifications) November 2018 MAI meeting First version of dashboard #2 (ESCO in EURES) and #4 (conceptual and terminological coverage) 2019 First version of dashboard #5 (ESCO granularity) Draft KPI dashboard-june 2018 2
Jan-18 Feb-18 Mar-18 Apr-18 May-18 Jun-18 Jul-18 Aug-18 Sep-18 Oct-18 Nov-18 Dec-18 1. ESCO acceptance as de facto standard Downloads of ESCO API and datasets 250 200 150 100 50 API Datasets 0 Downloads by user type Download by purpose 6% 8% 34% 14% 23% 21% 28% 4% 2% 17% 4% 8% 11% 5% 15% Public employment service Private employment service Integration in applications Mapping Job portal Education/training institution Statistical research Consultation Social Partner Application developer Curricula development Recruitment Career adviser Other Other EURES Cedefop Big Data Analysis of Job Vacancies Skills Profile Tool for Third Country Nationals PES Ireland (JobsIreland) PES Iceland (under development) OPENSKIMR Transparency in Art Levels and Qualifications (TALQ) E-Skills Match ACROSS: green your skills Textkernel Docebo Milch & Zucker (JobStairs) List of known organisations or services using ESCO Skilllab.io Boost.rs Draft KPI dashboard-june 2018 3
Occupations 2. ESCO in EURES Mapping to ESCO Skills Planning to map Started mapping Finished mapping 3 Planning to adopt Started implementation Implemented % of EURES job vacancies annotated with ESCO Unknown Not part of EURES 2 1 % of EURES user profiles and CVs annotated with ESCO 3 2 1 Draft KPI dashboard-june 2018 4
Jan-18 Feb-18 Mar-18 Apr-18 May-18 Jun-18 Jul-18 Aug-18 Sep-18 Oct-18 Nov-18 Dec-18 3. Evolution of the ESCO qualifications pillar Qualifications in ESCO Qualifications in ESCO National qualification database established, but not in ESCO National qualification database under development No national qualification database No information Not part of EQF 5000 4000 3000 2000 1000 Number of qualifications in ESCO 0 % of qualifications linked to ESCO skills Linked 3% Not linked 97% Draft KPI dashboard-june 2018 5
4. Conceptual and terminological coverage of ESCO Conceptual and terminological coverage per ESCO version 8 6 4 2 v1.0.0 v1.0.3 v1.0.5 Occupations Skills Terminological coverage by language 10 8 6 4 2 Terminological coverage by economic sector A Agriculture, Forestry, Fishing F Construction B Mining and Quarrying C Manufacture G Wholesale and retail trade, repair of motor vehicles and E Water supply, sewerage, waste management and D Electricity, gas, steam and air conditioning supply 84% 81% 76% 76% 65% 64% 61% 1 2 3 4 5 6 7 8 9 Occupations English teacher Demi-chef de rang Most frequently appearing candidate terms Skills Augmented reality GDPR Draft KPI dashboard-june 2018 6
5. Granularity of ESCO # concepts 600 500 Concepts in ESCO with high granularity Level of granularity per occupation Concepts in ESCO with low granularity 400 300 200 100 0-10 -9-8 -7-6 -5-4 -3-2 -1 0 1 2 3 4 5 6 7 8 9 10 # of national classifications with more generic concepts (broader) - # of national classifications with more detailed concepts (narrower) Most granular Aquaculture environmental analyst Aquaculture rearing technician Aquaculture hatchery technician Aquaculture recirculation manager Occupations in ESCO with the highest/lowest granularity Least granular Sales assistant Shop supervisor Shop assistant Specialised doctor Draft KPI dashboard-june 2018 7