Horizon 2020-LEIT-ICT Work Programme Big Data topics ICT-11 ICT-12 ICT-13

Transcription

1 Horizon 2020-LEIT-ICT Work Programme Big Data topics ICT-11 ICT-12 ICT-13 Kimmo Rossi DG CNECT.G1 Data Policy and Innovation Unit, Luxembourg Zagreb, 19/01/2018

2 Relevant policy context A Digital Single Market Strategy for Europe COM(2015)192, Third Pillar: launch of a Free Flow of Data Initiative Digitisation of European Industry COM(2016)180 Big Data is an important contributor/element in the DEI Big Data Value Public-Private Partnership (BDV PPP) Communication: Building a European Data Economy - COM(2017) 9 final, adopted on 10/01/2017 Data Protection reform (GDPR package) EuroHPC Joint undertaking

3 Disclaimer The only authoritative source for Horizon 2020 callrelated information is the Participant Portal. In case of discrepancies between this presentation and the Participant Portal, the latter will prevail.

4 Overview of Big Data topics in H2020 ICT WP ICT : HPC and Big Data enabled Large-scale Test-beds and Applications (IA: 50M in IA: 40M in 2019) Technology integration topic! ICT Big Data Technologies and Extremescale Analytics (RIA: 30M in CSA: 1M in continuation in 2020, tbc) ICT : Supporting the emergence of data markets and the data economy (IA: 48M in 2019, RIA: 10M in 2018, CSA: 3M in 2018) DT-ICT : Big Data solutions for energy (IA: 30M) In total: 202 MEUR in

5 ICT-11a (IA): What are we looking for? Large-scale HPC-enabled industrial pilot test-beds supporting BD applications and services Combining and/or adapting existing relevant technologies (HPC / BD / cloud) to optimize the specific features of processing very large data sets. Strong industrial commitment Fostering innovation potential and digitisation on in EU key industrial Sectors: e,g healthcare, manufacturing, energy, etc.

6 ICT-11a: Scope Large-scale HPC-enabled industrial pilot test-beds supporting BD applications and services Combining and/or adapting existing relevant technologies (HPC / BD / cloud) optimize the specific features of processing very large data sets. Massive amounts of diverse types of data Clearly demonstrating innovation and value creation. Description of the data assets/standards/ interoperability Simple secure access and secure service provisioning of highly demanding data use cases for industry, via the cloud

7 ICT-11b (IA): the challenge A new generation of 'Lighthouse projects' (IA) taking advantage of integration of data processing technologies: - Big Data - Cloud/edge computing Leveraging on IoT data sources and technologies Contributing to the build-up of a European data Infrastructure

8 ICT-11b: what are we looking for? Large Scale Pilot Actions in data intensive sectors involving key European industrial actors. Their objective is to demonstrate how industrial sectors will be transformed by putting data technologies (Big Data/Cloud/IoT) at their core. The industrial pilot test-beds shall also address the relevant networking connectivity and large-scale data collection, management and interoperability issues.

9 ICT-11b: Characteristics Possible industrial sectors for Large Scale Pilot actions include (but are not limited to) healthcare, manufacturing, energy, finance & insurance, agri-food, space and security. Despite the differences it is worth for proposers to take stock of the running 'Lighthouse' projects funded through ICT-15 of the H2020-ICT Work Programme: DataBio (2016 Call) TT (2016 Call) Boost 4.0 (2017 Call) Bigmedilytics (2017 Call)

10 ICT-11b: Requirements (1) The data assets available to the test-beds should be described in the proposal. The data assets shall be appropriately large, complex and realistic. Pilot test-beds should also aim to provide, via the cloud, simple secure access and secure service provisioning of highly demanding data use cases for companies and especially SMEs.

11 ICT-11b: Requirements (2) A Consortium where industrial partners are represented by professionals who work in core business operations (as opposed to research laboratories) Develop a plan that is consistent with the business strategy of the industrial partners concerned (e.g. avoid committing to technologies that the decision makers in the respective companies have no intention of deploying) Innovations developed in the pilot must work in actual operating conditions and are consistent with important business parameters such as reliability, accuracy, cost structure. To explicitly evaluate/measure changes in the cost structure and in the technological constraints and performance (at the end of the pilot)

12 ICT-11 a and b: Impact Demonstrated increase of innovation and productivity in the main target sector of the Large Scale Pilot Action Increase of market share of Big Data technology providers if implemented commercially within the main target sector of the Large Scale Pilot Action Effective integration of HPC/BD/Cloud/IoT technologies in the main target sector(s) of the Large Scale Action, resulting into integrated value chains and efficient business processes of the participating organizations Widening the use of and facilitating the access to advanced HPC, big data and cloud infrastructures stimulating the emergence of the data economy in Europe

13 ICT-11 a and b: Impact Stimulating additional private and public target investments in HPC and Big Data technologies from industry, Member States and Associated Countries, and other sources, as referred to in the contractual arrangements of the HPC and/or the Big Data Value Public Private Partnerships. Now explicitly calling for synergies with other innovation programmes and national/regional initiatives for cooperation and co-funding

14 ICT-11: DOs and DON'Ts ICT-11a: Big Data + High-Performance computing ICT-11b: Big Data + cloud, IoT, connectivity, edge computing,... DO provide detailed information on the IT/Big Data/Cloud/HPC platform on which the project will run on DO explain how the project will credibly reach the impact goals set in the Work Programme (i.e. it is not sufficient to state 'we will reach the impact goals set in the Work Programme) DO explain how the private investment of the Consortium partners (additional to the EU funding) is connected to the participation of company X in the project (i.e. generally providing information on company X's investment in R&D does not really address the Work Programme requirement of leveraging the EC investment)

15 The Call for proposals: subtopic ICT-11a The Call opened on 31/10/2017 The call is open! The Call will close on 17/04/2018 at 17:00 CET Budget: 50 M Proposals expected average size: M Article 30.3 (Commission right to object to transfers or licensing) to be added to all Grant Agreements

16 The Call for proposals: subtopic ICT-11b The Call will open on 26/07/2018 The Call will close on 14/11/2018 at 17:00 CET Budget: 40 M Proposals expected average size: M Article 30.3 (Commission right to object to transfers or licensing) to be added to all Grant Agreements

17 ICT-12 Big Data technologies and extreme-scale analytics Two sub-topics: a) Research and Innovation Actions b) One Coordination and Support Action

18 ICT-12a (RIA): the challenge Rapidly increasing volumes of diverse data from distributed sources create challenges for extracting valuable knowledge and commercial value from data. This calls for novel methods, approaches and engineering paradigms in analytics and data management. Not a new topic, it follows the footprints of ICT-16 of the H2020-ICT Work Programme. The state-of-the-art evolves constantly!

19 ICT-12a (RIA) Have a look what is already being done in the ICT-16 Project Portfolio WP : 10 projects WP : 7 projects - to be published soon

20 ICT-12a (RIA) Research and Innovation Actions developing new big data analytics methodologies and engineering solutions addressing industrial and/or societal challenges. Proposals may cover (but are not limited to): architectures for collecting and managing vast amounts of data; system engineering/tools to contribute to the co-design of secure federated/distributed systems (to involve all stakeholders/technology areas); new methods for extremescale analytics, deep analysis, precise predictions and decision making support; novel visualization techniques; standardized interconnection methods for efficient sharing of heterogeneous data pools, seamlessly using distributed tools and services.

21 ICT-12a (RIA): Requirements R&D work addressing industrial and/or societal requirements. Testing in real world scenarios (i.e. usability, robustness, performance, privacy aware) on real datasets, by professional/domain experts as opposed to researchers or software developers. Quantifiable progress beyond the state-of-the-art whatever the technical domain chosen performance measured against industry validated benchmarks. Proposals must demonstrate that they have access to appropriately large, complex and realistic data sets. From day 1 of the project!

22 ICT-12a (RIA) Not in a vacuum! Success will require not only efficient data processing/management but also sufficient computing capacity and connectivity, a coordinated action with all related areas (e.g. analytics, software engineering, HPC, Cloud technologies, IoT) is necessary and will contribute to a European leadership in these areas.

23 ICT-12a (RIA): Impact Increased productivity and quality of system design and software development thanks to better architectures and tools for complex federated/distributed systems handling extremely large volumes and streams of data; Demonstrated, significant increase of speed of data throughput and access, as measured against relevant, industry-validated benchmarks; Demonstrated adoption of results of the extreme-scale analysis and prediction in decision-making (in industry and/or society)

24 ICT-12a and Artificial Intelligence Connection with ICT-26 'Building a European AI on-demand platform' It also builds on (big) data assets It builds on technologies also commonly associated to big data technologies: machine learning, deep learning It benefits from the scale enabled by big data assets It also supports European industry being more competitive An opportunity for traditional big data stakeholders.

25 ICT-12b (CSA) One CSA to ensure coordination between the different existing activities in HPC/BD/Cloud technologies, including Public-Private Partnerships, digital innovation hubs, and relevant national and regional initiatives, in particular the European Network of National Big Data Centres of Excellence

26 ICT-12b (CSA): Impact Effective cooperation of the participating initiatives and platforms as measured by the jointly participating members/users, countries/regions/cities and projects, and the organisation of common events and joint initiatives, resulting in an increased prevalence of data value chains and related technologies (HPC/BD/Cloud/IoT) in the national and regional strategies.

27 The Call for proposals ICT The Call opened on 31/10/2017 The Call will close on 17/04/2018 at 17:00 CET Budget: ICT-12a (RIA) 30 M ICT-12b (CSA) 1 M Proposals expected average size: 3-6 M (RIA) Proposals expected average size: 1 M (RIA) Article 30.3 (Commission right to object to transfers or licensing) to be added to all Grant Agreements

28 ICT-13 Three different sub-topics: a) Innovation Actions (2019) b) Research and Innovation Actions (2018) c) One Coordination and Support Action

29 ICT-13 problem statement Sharing and re-using of Open Data is well underway PSI directive (since 2003) European Open Data portal ODINE Open Data Incubator But "closed data" (e.g. data from connected vehicles, industrial sensors, client/patient data...) is not re-used because of many obstacles (legal, commercial, attitudes...). Data anonymization is difficult and can often be cracked. No culture of data sharing/trading!

30 ICT-13a (IA): the challenge Fostering the European Data Economy by setting up platforms for sharing/trading industrial and/or personal data to create new business opportunities.

31 ICT-13a (IA): What are we looking for? Innovation Actions for setting up and operating platforms for secure and controlled sharing of "closed data" (proprietary and/or personal data). The actions should address the necessary technical, organisational, legal and commercial aspects of data sharing/brokerage/trading, and build on existing computing platforms. Proposals shall address one or both of the following sub-topics:

32 ICT-13a: two kinds of platforms Personal data platforms shall ensure respect of prevailing legislation and allow data subjects and data owners to remain in control of their data and its subsequent use. Solutions should preserve utility for data analysis and allow for the management of privacy / utility trade-offs, metadata privacy, including query privacy. Solutions should also develop privacy metrics that are easy to understand for data subjects and contribute to the economic value of data by allowing privacy-preserving integration of independently developed data sources. Industrial data platforms shall enable and facilitate trusted and secure sharing and trading of proprietary/commercial data assets with automated and robust controls on compliance (including automated contracting) of legal rights and fair remuneration of data owners.

33 ICT-13a (IA) Set-up and operations Adoption of privacy preserving technologies Trusted and secure sharing Automated contracting Sustainable business models

34 ICT-13a: additional information See a Commission paper on "Personal information management services Current state of service offers and challenges" analysing feedback from public consultation See "Industrial Data Platforms Key Enablers of Industry Digitization", IDC study report 28/7/2016

35 ICT-13b (RIA): the challenge Provide secure, privacy respecting operations for industrial and personal data platforms. Make data providers confident in participating in data sharing mechanism Provide citizens privacy safeguards Make industrial/personal data platform GDPR compliant

36 ICT-13b (RIA): the challenge Not a new topic, it follows the footprints of ICT-18 of the H2020-ICT Work Programme ICT-18 Funded Projects: SPECIAL: data sticky policies and queryable encryption SODA: multi-party computation (MPC) techniques. MyHealth-MyData: distributed, peer-to-peer architecture, based on Blockchain. e-sides: a CSA researching the ethical and societal implications of data and its use

37 ICT-13b: What are we looking for? Research and Innovation Actions to advance the state of the art in the scalability and computational efficiency of methods for securing desired levels of privacy of personal data and/or confidentiality of commercial data, particularly when they are combined from multiple owners. Proposals shall also analyse and address, as appropriate, privacy/confidentiality threat models and/or incentive models for the sharing of data assets.

38 ICT-13b (RIA): Impact Personal data protection is improved, and compliance with the General Data Protection Regulation (and other relevant legislation) is made easier for economic operators Citizens' trust is improved as privacy-aware transparency and control features are increasingly streamlined across data platforms and Big Data applications. Better value-creation from personal and proprietary/industrial data. 20% annual increase in the number of data provider organisations in the personal and industrial data platforms

39 ICT-13b (RIA): Impact ( continued) 30% annual increase in the number of data user/buyer organisations using industrial data platforms 50% annual increase in number of users (data subjects) in the personal data platforms 20% annual increase in volume of business (turnover) channelled through the platforms

40 ICT-13b (RIA): Requirements Focused to be an enabler of trusted, secure data markets. ICT-13a proposals will build on such technologies. Computationally efficient Capable of handling very large volumes of data Manages composition of independent data sets about the same subjects Trade-offs/customization are explained in a way that can be understood by a data subject or a data controller who are not scientists Addresses the operational constraints of likely application domains (telecom, geospatial, IoT, )

41 ICT-13c (CSA) Support the emergence of a data economy by ensuring SME inclusion, entrepreneurial support and trust-building, address the data skills gap. The CSA action shall liaise with and complement related initiatives, and shall support and work in collaboration with the platforms under ICT-13 a). In line with the Communication on ICT Standardisation Priorities for the Digital Single Market, promote standardization, interoperability and policy support in the field of data and federated/networked computing systems.

42 ICT-13c (CSA): Impact Demonstrated success stories among clients as a result of the services offered by the CSA and at least 50 clients (e.g. start-ups, SMEs) served annually in partner finding, matchmaking, venture capital raising, training, coaching etc. Improved standardisation and interoperability especially in the context of cross-sector applications and technology convergence (data, Cloud, IoT, connectivity a.o.)

43 The Call for proposals ICT-13 a) The Call will open on 16/10/2018 The Call will close on 28/03/2019 at 17:00 CET Budget: 48 M Proposals expected average size: 4-6 M ICT-13 b) and c) The Call opened on 31/10/2017 The Call will close on 17/04/2018 at 17:00 CET Budget: ICT-13b (RIA) 10 M ICT-13c (CSA) 3 M Article 30.3 (Commission right to object to transfers or licensing) will be added to all Grant Agreements

44 Big Data Solutions for Energy DT-ICT The Challenge Tomorrow's energy grids consist of heterogeneous interconnected systems, of an increasing number of small-scale and of dispersed energy generation and consumption devices, generating huge amounts of data. The electricity sector, in particular, needs big data tools and architectures for optimized energy system management under these demanding conditions.

45 Big Data Solutions for Energy DT-ICT The Work Programme Innovation Actions targeting large-scale pilot test-beds for big data application in the electricity sector. The aim is to develop/pilot and deploy a reference architecture for large-scale multi-party data exchange, management & governance and real-time processing (including distributed/edge processing) in the electricity sector and to translate this reference architecture into an open, modular data analytics toolbox for the safe and effective operation of grids and provision of innovative energy services.

46 Big Data Solutions for Energy DT-ICT The Work Programme ( continues) The reference architecture should ensure compatibility with legacy formats, interfaces and operating systems of the energy system, allow replication and scale-up, be compliant with applicable EU standards, and should enable the integration of relevant digital technologies like IoT, AI, cloud and big data services. The analytics toolbox shall be able to handle a wide variety of data and support the development of a wide range of energy services, at least to increase the efficiency and reliability of the operation of the electricity network (e.g. by predictive maintenance), to optimize the management of assets connected to the grid (in particular small-scale/renewable electricity generation and those used for demand response), to increase the efficiency and comfort of buildings, and to de-risk investments in energy efficiency (e.g. by reliably predicting and monitoring energy savings).

47 Big Data Solutions for Energy DT-ICT The Work Programme ( continues) Proposers should demonstrate that they have access to appropriate large-scale and realistic datasets, and should involve as many as necessary of the following types of participants: network operators, suppliers, independent aggregators, ESCO's, power exchanges, building management and renovation sectors, software integrators/developers. Proposals should address, as appropriate, analytics, simulation, prediction, cloud computing. Projects shall collaborate with EU-funded projects through the BRIDGE initiative.

48 Big Data Solutions for Energy DT-ICT Impact Effective integration of relevant digital technologies in the energy sector, resulting in integrated value chains and efficient business processes of the participating organizations; Enhancing energy asset management, increasing consumer participation and innovative network management, creating new data-driven business models and opportunities and innovative energy services; Contribution to increasing the use of renewable energy and increased energy efficiency based on optimised energy asset management, offering access to cheaper and sustainable energy for energy consumers and maximising social welfare; New data-driven paradigms for energy management systems able to deal with increased complexity of the energy systems; Improving availability of big data and big data management & analysis facilities for real-life scale research, simulation and test purposes.

49 Big Data Solutions for Energy DT-ICT Requirements A Consortium where industrial partners are represented by professionals who work in core business operations (as opposed to research laboratories) Develop a plan that is consistent with the business strategy of the industrial partners concerned (e.g. avoid committing to technologies that the decision makers in the respective companies have no intention of deploying) Innovations developed in the pilot must work in actual operating conditions and are consistent with important business parameters such as reliability, accuracy, cost structure. To explicitly evaluate/measure changes in the cost structure and in the technological constraints and performance (at the end of the pilot)

50 Big Data Solutions for Energy DT-ICT Requirements ( continues) To account of the ownership, user right, cost structure of the data assets to be used and/or produced during the pilot, and at the end of the pilot. Privacy General Data Protection Regulation (GDPR)

51 Big Data Solutions for Energy DT-ICT DT-ICT The Call opens on 16/10/2018 The Call closes on 02/04/2019 Budget available: 30 M Expected project size: 10 M Article 30.3 (Commission right to object to transfers or licensing) to be added to all Grant Agreements

52 Additional information Big Data Value Association (BDVA) updated Strategic Research and Innovation Agenda, version 4 Questions: CNECT-G1@ec.europa.eu Kimmo.Rossi@ec.europa.eu

53