State of the art of CSPA Implementation

Transcription

1 State of the art of CSPA Implementation Marco Silipo THE CONTRACTOR IS ACTING UNDER A FRAMEWORK CONTRACT CONCLUDED WITH THE COMMISSION

2 Outline A brief history Focus for 2016/2017 The Implementation Group project The six main subgroups A governance model

3 1. Seasonal adjustment France, Australia, New Zealand 2. Confidentiality on the fly Canada, Australia 3. SVG generator OECD 4. SDMX transform OECD 5. Sample selection Netherlands 6. Linear error localisation Netherlands 7. Linear rule checking Netherlands 8. Error correction Italy Services built in 2014

4 New Services built in 2015 Classification retrieval service Testing Probabilistic record linkage service Web dissemination service Confidentialised analysis of microdata service

5 Service Candidate name services Designer for 2016 / Builder Structured Validation Service Transformation Service Content Validation Time Series Questionnaire Generation Metadata Dissemination ESSnet ESSnet ESSnet

6 The focus of CSPA for 2016 and 2017 Further expand the implementation support for CSPA to ensure that: Modular components Standard architecture, and Design for sharing can work for your organisation

7 Taking the CSPA journey let s get started Achieving change, of any significance within an organization, is in inverse proportion to the success that it has had up to the time that management feels a change is needed. It s worth the trip The greater the success of the company, the less likely it is to change

8 And so, our journey begins Step 1: Assessing the readiness for change Modernisation Maturity Assessments currently under development CSPA Modernisation Maturity Service Oriented Architecture (SOA) Maturity Organisational Change Maturity

9 Step 2: Align investment decisions with sharing intentions CSPA Investment Planning Survey currently underway Expose Investment Intentions Identify investment alignment intentions Statistical Services to be developed and/or used identified. Collaboration opportunities identified

10 Step 3: Improve support materials & technical guidance, Support Implementation CSPA Implementation Group Key Focus Areas you will hear more information on these areas throughout the course Collabo ration CSPA, ESSNE T and ESS Vision 2020 EARF Clarify criteria and assessment for compliance process, align governance to ensure no duplication Communication and Develop key promotion materials areas of the this will include LIM, Time training material Use, Questionnair es and clarification of variables Catalogue updates and changes Technical Implementation Support and Architecture Patterns

11 CSPA 2015 project 7 task teams 50 task team members

12 Focus areas in these presentations The CSPA Logical Information Model Architecture Patterns and technical implementation guidance

13 CSPA Implementation Group: An Introduction

14 Governance Structure

15 Terms of Reference CSPA will be managed and implemented as an ongoing asset of the HLG-MOS The CSPA Implementation Group will provide implementation support, and be responsive to the needs of the statistical community

16 1 Implementation Group United Kingdom FAO 26 individuals

17 Membership 26 people, 17 organisations Chair: Rosemary McGrath, New Zealand Cambodia - Kimhor Meng Canada - Robert McLellan, Flavio Rizzolo Colombia - Luis Edgar Sanchez, Juan Carlos Paz France - Franck Cotton, Romain Tailhurat Italy - Marco Silipo, Carlo Vaccari Mexico - Juan Munoz-Lopez, Lizette Traconis Lugo Netherlands - Matjaz Jug Norway - Trygve Falch Serbia - Mira Nikic Slovenia - Tomaz Speh Sweden - Eva Holm, Jakob Engdahl United Kingdom - Eric Deeben United States - Lorna Drennen - Jean-Marc Museux, Hubertus Cloodt, Pierre Peyronnel OECD - David Barraclough UNECE - Steven Vale

18 6 Sub-groups Assess compliance of candidate CSPA Services Maintain / develop the CSPA logical information model Maintain / develop the layers of the CSPA catalogue Practical technical assistance to CSPA implementers CSPA promotion and communication Maintain / develop CSPA architectural patterns

19 assess compliance sub-group Goal is to guide the CSPA compliance of Statistical Services, therefore Service Definitions and Service Specifications are assessed taking into account: The granularity of the service The naming of the service The information in the templates is understandable/readable Whether the service is "clean" that is, it stands alone The methods The input and the outputs The Non Functional Requirements

20 assess compliance sub-group Overview of Progress: Developed a Governance process workflow Created a temporary tacking spreadsheet while an automated workflow is developed Developed a Draft Governance Review Document Next steps Continue to run new services through the process Finalize automated workflow for the catalog Consider the development of a separate but related automated workflow for tracking services in place of the spreadsheet

21 LIM sub-group Create UML models for set of LIM classes related to statistical variables, including their representations (value domains) and associated concepts, conceptual domains, unit types, universe, population and any other classes that might be relevant. In addition to GSIM, we will use Neuchatel and DDI 4 (especially the Variable Cascade) as reference models. Provide short, preliminary guidance document that covers only the most common use cases (exact use cases TBD). Provide recommendations to extend/amend GSIM based on the activity findings.

22 LIM sub-group Provide full, detail guidance and use cases on how to use the Variable LIM classes across the GSBPM (i.e. what are the roles that variables can play in the data structures produced in each of the GSBPM phases). Develop a Best Practices document

23 CSPA catalogue sub-group Goal of subgroup is to define Catalogue use cases ad review workflow of services release Application is now in version 2 Uses Confluence wiki pages at its core Different layers for the different service documents Sorting based on GSBPM level 1 processes Hosted in European Commission network needs ECAS account, but has a public landing page

24 Technical support sub-group Goal Defining the CSPA support model and Service Level Agreements Providing practical technical assistance to CSPA implementation projects in statistical organizations when requested either through their own efforts or through a network of developers in the community Reviewing the CSPA Technical Implementation guidance and other available documentation that could be of use for CSPA service implementation Work together with Catalogue subgroup to better define support use cases Agree on a common project and implement CSPA

25 Technical support sub-group Next steps: Improve the technical implementation guidance- Need of more services Set up recommendations in terms of support material for CSPA implementation FAQs, tutorials, webinars, etc) Start reviewing first available services documentation and determine what is missing Identify the service owner Missing service details Configuration of the service, advice, ask for more complete documentation, Transfer/migrate existing services in CSPA Update technical guidance

26 promotion and communication sub-group Goal promoting CSPA to different levels of executive managers and to implementers Define promotional material, organize workshops, publish articles, brochures Define impact on organizations Determine Maturity of organisation to adopt What capability is needed to participate, contribute, adopt The maturity of CSPA services (what's available, who's using it, who's maintaining/contributing to it's further development

27 Architectural patterns sub-group Goal is trying to address crucially strategical questions on how to build an environment to support statistical production utilizing CSPA: Invest in small or big services? Which GSBPM level should a service fit? Which level of granularity? Understand if wrapping smaller services could be an idea Understand whether investigate on integration or orchestration platforms Microservices/containerization Migration issues

28 Progress towards target architecture (CSPA) in ESS Project ESS.VIP.SERV: Sharing common functionalities in the ESS CSPA certified Builds on and implements the CSPA architecture ESS CSPA basecamp

29 Main Deliverables of ESS.VIP.SERV 1. Governance Guidelines, Templates Service Catalogue Service Certification 2. Platform Hosting ESTAT and MS services Facility offered, not mandatory 3. Statistical Services E.g. Structural Validation, Transformation, Seasonal adjustment (JDemetra)

30 Identification and implementation of statistical services Identification Does Re-use make sense? Analysis 3A- Attractiveness, Achievability, Affordability Business, Legal, Technical Analysis Methodology Standard description Service Catalogue

31 Conclusions and ressources

32 ESS Architecture Community platforms

33 Achieving success through HLG projects Objective: To facilitate the transitioning of CSPA governance from HLG project governance arrangements

34 HLG 2011: Process & Industrialisation HLG Strategy "Statistical organizations should create environments that facilitate the reuse and sharing of methods, components, processes and data repositories 7

35

36 CSPA Assets built Defined the concept and proved it 2014 Proved that we can develop production services and make them visible and available 2015 Address remaining implementation challenges and made the assets sustainable Assets: CSPA the architecture v1.5 Logical Information Model Catalogues

37 Proposed new governance from 2016 onwards