Towards a Global Cyberinfrastructure for the Geociences U32A, 05 dec 2012
The Brokering approach for Multidisciplinary Data Discovery and Access Stefano Nativi National Research Council of Italy (CNR - IIA)
[email protected]
Global Cyberinfrastructure for the Geosciences
[email protected]
Interdisciplinarity • The serious challenges in the global environment demand a renewed and more integrated effort to connect research activities • If the science community is to find solutions to these challenges (and inform decision makers), it will need to be more interdisciplinary, drawing on natural, economic and social sciences • For Climate Change, Food Security, Water Availability and access to Energy, we need to develop an integrated multi-disciplinary approach to advance our understanding of the complex relationships between environmental and social phenomena
[email protected]
A Disciplinary or Domain infrastructure is a Universe (with Planets) • Address Interoperability for a given (disciplinary) realm – – – – – –
Technical Semantic Organizational Cultural, Legal, ..
[email protected]
Multi-disciplinary and Global Infrastructure • Address Interoperability across heterogeneous (disciplinary) realms – – – – – –
Technical Semantic Organizational Cultural, Legal, ..
[email protected]
Multi-disciplinary and Global Infrastructure An ecosystem of multiple Universes and contained Planets
• Address Interoperability across heterogeneous (disciplinary) realms – – – – – –
Technical Semantic Organizational Cultural, Legal, ..
[email protected]
Global & Multidisciplinary = Complex Environment • un-controlled (technological) environment – – – – – – –
global dimension multi-disciplinary multi-organizational based both on voluntary and funded contributions Different maturity levels and growing velocity Diverse needs, scopes and targets etc.
• almost impossible to “impose” and “sustain” a limited set of common technological solutions (e.g. standard interfaces or data models) • apply System of Systems (SoS) or Network of Networks (NoN) principles to achieve interoperability
[email protected]
System of Systems (Network of Networks) principles • Build on existing (disciplinary) system/network infrastructures (i.e. Universes and Planets) • Supplement but not supplant system/network mandates and governance arrangements • Address heterogeneity to lower entry barriers avoiding to impose any common (federal) technology • Be flexible and extensible to – Interconnect new system/network infrastructures – Sustain and advance the achieved interoperability – Allow each system/network infrastructure to evolve
[email protected]
System of Systems (Network of Networks) principles • Build on existing (disciplinary) system/network infrastructures (i.e. Universes and Planets) • Supplement but not supplant system/network mandates and governance arrangements • Address heterogeneity to lower entry barriers avoiding to impose any common (federal) technology • Be flexible and extensible to – Interconnect new system/network infrastructures – Sustain and advance the achieved interoperability – Allow each system/network infrastructure to evolve
[email protected]
Disciplinary/Domain infrastructure (Universe) Service Bus
[email protected]
Disciplinary/Domain infrastructure (Universe) Service Bus Discover
Evaluate
Access
Use
[email protected]
Disciplinary/Domain infrastructure (Universe) Service Bus
[email protected]
Multidisciplinary common Service Bus (Global Federation)
[email protected]
Multidisciplinary common Service Bus (Global Federation)
[email protected]
The Brokering Approach
[email protected]
The Brokering Approach
[email protected]
Brokering Benefits • Lowers barriers to participation in distributed systems for both users and resource providers – minimal burden or cost impact on existing systems;
• Accelerates interconnection of disparate systems; • Facilitates sustainability, reusability, extensibility, and flexibility of the infrastructure • Enhances multi-disciplinary interoperability via introduction of new capabilities across multiple domains; • Removes need to impose common (e.g. federal, “top-down”) specifications and software components enabling a more adaptive “bottom-up” evolution of the infrastructure
[email protected]
Broker types • Discovery Broker • Access Broker • Semantic Broker • Business Process Broker • Quality Broker • Policy Brokers
• …
[email protected]
empowered by
Existing Brokering Framework
[email protected]
empowered by
Existing Brokering Framework
[email protected]
The GEO Discovery & Access Broker (DAB)
[email protected]
Maturity level • More than 15 brokered capacities/systems • About 14 Miliion resources; less than 14,000 GEOSS Data Core • About 400,000 requests per year
[email protected]
Maturity level GEOSS Resources 16000000 14000000
Resources
12000000
10000000
Introduction of the Brokering approach
8000000 6000000 4000000 2000000 0 Resources
2010 300
2011 (Sep) 100000
2011 (Nov) 2012 (Nov) 1002000
[email protected] 14000000
The NSF EarthCube experience
[email protected]
Challenges • Intermediation solutions introduce overhead and latency to data processing – Cloud computing and caching techniques are used to address these
• A new organizational and governance philosophy: the thirdparty multidisciplinary infrastructure – Three tiers architecture governance
• The development of new brokers to provide new capabilities at the multi-disciplinary level – security, advanced resources evaluation, data mining, processing, etc.
• The development of new frameworks building on brokers – e.g. The «Model Web»
[email protected]
Thank you ! Questions ?
[email protected]
