Citizens Science and Smart Cities JRC Ispra 5-7 February The Brokering Approach

Transcription

1 Citizens Science and Smart Cities JRC Ispra 5-7 February 2014 The Brokering Approach STEFANO NATIVI (CNR -IIA), MAX CRAGLIA (EC-JRC) AND MAT TIA SANTORO (CNR-IIA)

2 Rationale Build «Network of Networks» Large or complex networks Heterogeneous networks Independent networks Evolving networks Reuse/share of (open) data Heterogeneity Technology Domain/Goal Organization Maturity level Policy

3

4 Network of Networks Principles Build on existing (Community) network/system/ infrastructures Supplement but not supplant network/system (i.e. Community) mandates and governance arrangements Address heterogeneity to lower barriers avoiding to impose any common (federal) technology Be flexible and extensible to Interconnect new network/system (Community) Sustain and advance the achieved interoperability Allow each network/system (i.e. Community) to evolve

5 Network of Networks Interoperability THE EUROGEOSS LEGACY

6 Interoperability Approaches Two main (complementary) approaches Standardization Controlled and mature environments Intermediation (i.e. System Brokering) Heterogeneous and rapidly-evolving environments

7 The Brokerage Approach INTERMEDIATION OF EXISTING NETWORKS AND COMMUNITIES

8 Network interoperability

9 Network service bus Network service bus Network service bus Network service bus...

10 Interoperability with «Authoritative Systems»...

11 Network service bus Network service bus Brokering Infrastructure Network service bus Network service bus...

12 empowered by Brokering Framework

13 Brokering Benefits Lowers barriers to participation in distributed systems for both users and resource providers minimal burden or cost impact on existing systems; Accelerates interconnection of disparate systems; Facilitates sustainability, reusability, extensibility, and flexibility of the infrastructure Enhances cross-domain interoperability via introduction of new capabilities across multiple domains; Removes need to impose common (e.g. federal, top-down ) specifications and software components enabling a more adaptive bottom-up evolution of the infrastructure nativi@iia.cnr.it

14 Brokering Challenges Scalability Intermediation services introduce a overhead Governance A new service layer is introduced: it must be a third party infrastructure Brokering agreements Trustiness Sustainability A Bokering layer is a complex piece of technology Evolve along with Community standards and Best Practices Business model nativi@iia.cnr.it

15 Projects dealing with Brokering technology APPLYING, ADVANCING AND BUILDING ON A BROKERING FRAMEWORK

16 Facing Scalability

17 Current Assets GEO Home Page GEOSS Portal

18 Current Assets About 20 brokered data providers capacities, systems, Communities... Publish More than 7 Million (1.2 Million GEOSS Data Core) Discoverable and potentially Accessible aggregated resources (mix of data collections, datasets and individual images) Contain [source: data providers] More than 65 Million (50 Million GEOSS Data Core) Discoverable and potentially Accessible individual resources (e.g. satellite scenes, rain gauge records) nativi@iia.cnr.it

19 GEO DAB in the Cloud

20 GEO DAB Cloud capabilities Elastic Load Balancing Load Balancing Each DAB component is replicated on multiple machines Amazon Load Balancers take care of routing requests to machines with lighter loads New machine can be added on-the-fly as needed Tiles and Data Caches DAB makes use of Hadoop-based solutions for storing and retrieving maps and data. Instance with CloudWatch Monitoring system usage and resource consuming (number of queries, use of CPU, memory, etc.) Store user s queries and selections to improve ranking of results (under development) nativi@iia.cnr.it

21 Typical Configuration

22 Ranking Metrics applied by DAB A weight-based algorithm rewarding a set of criteria belonging to four high-level principles Data accessibility & quality of service GEOSS SBA Essential Variables GEOSS Data Core Metadata Completeness The solution applied by DAB is configurable and flexible nativi@iia.cnr.it

23 Studying Governance & Sustainability

24

25 BCUBE

26