Distribution: â« iRODS clients: Web Browser, iCOMMADS, iDROPWEB ... authentication module that interacts with the LDAP (PAM - Pluggable. Authentication ...
An iRODS-based Distributed and Federated Data Repository for a Multi-CMF Network for Experimentation Thiago Holenweger, Jose A. Suruagy and Joberto S. B. Martins João Pessoa – October 02, 2015
8th Latin American Network Operations and Management Symposium
AGENDA
FIBRE Project – Scenario Future Internet testbed/experimentation between BRasil and Europe
Requirements iRODS-based Repository Final considerations
www.fibre-ict.eu
2
FIBRE Intercontinental Testbed UFPA
UNIFACS
U. Bristol
UFPE UFSCar
OCF OMF
WDM
OCF
OCF OMF
OCF OMF
UFG
OCF OMF
PoP-UB PoP-BA
PoP-PA
PoP-PE PoP-i2CAT
OCF OMF
PoP-SP
PoP-GO PoP-DF PoP-RJ
PoP-UTH
GENI OCF OMF
OCF
USP
OCF OMF
RNP WDM
OCF OMF
OCF OMF OCF OMF
UFRJ
i2CAT CPqD
UTH
UFF
• 13 remote testbeds: large-scale federated facility between Brazil and Europe • Heterogeneous Network resources: OpenFlow switches, wireless infrastructures, optical devices, virtualization XEN servers, other • A federation of CMFs and Monitoring tools: OCF, OMF and ProtoGeni • A dedicated “per slice” SDN controller
FIBRE Islands/ Members
4
Objective •
To provide data storage for a multi-CMF (OFELIA, OMF and ProtoGeni Control and Monitoring Frameworks) testbed interconnecting institutions FIBRE Instrumentation and Monitoring Architecture I&M FIBRE-BR
• • •
OFELIA (OpenFlow in Europe: Linking Infrastructure and Applications) OMF (ORBIT Management Framework) ProtoGENI
5
FIBRE Architecture – I&M FIBRE-BR
FIBRE Instrumentation and Monitoring Architecture Source: PINHEIRO, MACÊDO, et al., 2012
6
FIBRE Implementation Requirements • Enable transparent access to monitoring data from native distinct CMFs in distributed experiments • Support "Federation" among distinct CMFs storage instances and institutions: – Allow storage/retrieval of monitoring data using distinct database management system (SQL, RRD, Postgres,…) – Slices running on institutions
• Implement a monitoring data storage strategy and metadata in a standardized way (for FIBRE) – NMWG (Network Measurement Workgroup: XML, set of metrics/ parameters, web services, …) – MDIP – Measurement Data Integration Point
• Monitoring data collected by both native CMFs monitoring tools and new tools implemented • Data and metadata semantics • Distributed client interface
General Requirements • Scalability • Distribution • Federation • •
Transparent storage Access control (various institutions)
• Standardization • •
Monitoring (standard and semantics) Data storage and retrieval
• Security
8
iRODS Architecture - Overview Overview of iRODS basic components
Source: adapted from (MOORE, 2010)
9
iRODS Architecture - Overview Scalability: Alternatives to distributed operation (03 options) Distribution: iRODS clients: Web Browser, iCOMMADS, iDROPWEB Federation: supports federation Security: Access levels: rodsadmin and rodsuser Availability: Replication of iRODS data between servers (pgPool) Access control: GSI support, Kerberos, Challenge-response or Shibboleth and has an authentication module that interacts with the LDAP (PAM - Pluggable Authentication Modules) Semantics: Namespace, AVU metadata stored in database
10
FIBRE I&M Architecture with iRODS Components
11
iRODS basic Operation per Island Experimenter
iRODS Web Browser iRODS Client iCOMMANDS
MDIP “StorageData” Repository /InBox /OutBox
iput, imeta , ils
iRODS Server iCAT
iput
Move
Environment Variables Configuration
12
Data Storage Alternatives for I&M Multi-CMF with iRODS
13
Data Storage Alternatives for I&M Multi-CMF with iRODS
14
Data Storage Alternatives for I&M Multi-CMF with iRODS
15
FIBRE iRODS I&M Multi-CMF Storage Implementation Choice FIBRE Implementation option: RODS-based distributed data repository Centralized iCAT Server
16
FIBRE iRODS I&M Multi-CMF Storage Overall Considerations Storage of monitoring distributed data: FIBRE has several islands scattered in Brazil / Europe (centralized iRODS alternative off) Reduces bandwidth usage of the testbed backbone (monitoring data is stored on the local server) Transparence: Monitoring data abstracts physical location (regardless the island on which the experiment is executed through iCAT features) Transparent monitoring data access in a federated environment (experimenter with appropriate access permissions) Scalability and Federation: All iRODS strategies scale in relation to federation between zones Access control : Federated authentication scheme compatible with FIBRE (LDAP ) Availability : The iRODS has replication mechanisms 17
FIBRE iRODS I&M Multi-CMF Storage Proof of Concept
Tests performed on virtual machines with multi-CMF data and distinct islands:
Test to simulate testbed scalability:
Prototype implementation at UNIFACS and UFPE New institution on the FIBRE testbed iRODS-Federation
Application (DataStores) supporting I&M instrumentation
18
FIBRE iRODS I&M Multi-CMF Storage Prototype Implementation • 03 islands with 07 hosts (experimenters using OCF and OMF and servers) • OFELIA (OCF) and OMF operating on each island • iRODS Server, iCAT Server (metadata and access control) and MDIP iRODS Clients (iCommands)
N ...
N ...
19
FIBRE iRODS I&M Multi-CMF Storage Prototype Implementation ISLAND
CMF OFELIA
UNIFACS (unifacsResc)
UFPE (ufpe-Resc)
Thiago host_ifacebw.rrd
Marcelo Flowtp.rrd attribute=metrics value=throughput
Metadata OMF
OML001.sql
Metadata
attribute=metrics value=delay
OFELIA
host_ifacebw.rrd
Metadata
Igorluiz host_ifacebw.rrd attribute=metrics value=bandwidth consumption
OML002.sql
Igorleonardo
OML004.sql attribute=metrics value=throughput
host_ifacebw.rrd
Flowtp.rrd attribute=metrics value=throughput
Metadata OMF
USERS Adriano
OML001.sql
OML002.sql
OML003.sql attribute=metrics value=delay
20
FIBRE iRODS I&M Multi-CMF Storage Prototype Implementation Query data and metadata - iRODS Web Browser
21
FIBRE iRODS I&M Multi-CMF Storage Prototype Implementation Query metadata
Query result
22
FIBRE iRODS I&M Multi-CMF Storage Prototype Implementation FIBRE zone federated with IFBA zone
23
FIBRE iRODS I&M Multi-CMF Storage Prototype Implementation Federation FIBRE zone with the IFBA zone
24
FIBRE iRODS I&M Multi-CMF Storage Evaluation Considerations Allows integration of CMFs monitoring data with transparent access Allows metadata insertion and metadata query Scalable testbed supported by the distributed data repository strategy: Simple monitoring data access through a logical directory (monitoring data distributed among FIBRE islands) Supports the inclusion of new testbed and/or institution to the storage through federation Application “StorageData“: Simplifies the client application setup process (iRODS iCOMMANDS) Sends data collected and metadata by script
25
Future Work • Make full transparent data storage to the experimenter: • MDIP as the intermediary between the portal I&M FIBRE and the iRODS client application • Automating the experimenter's identification process by collecting portal information such as login, password, island and CMF
• Analysis of iRODS performance in the context of FIBRE network • Impact on bandwidth and other aspects of network usage
• Deployment on all FIBRE islands
26
Thank you/ Obrigado
twitter.com/FIBRE_project www.facebook.com/fibre.project www.fibre-ict.eu www.irods.org 27
FIBRE Brazilian Team (2012)
28
FIBRE Brazilian Team (2013)
29