An iRODS-based Distributed and Federated Data

An iRODS-based Distributed and Federated Data Repository for a Multi-CMF Network for Experimentation Thiago Holenweger, Jose A. Suruagy and Joberto S. B. Martins João Pessoa – October 02, 2015

8th Latin American Network Operations and Management Symposium

AGENDA

 FIBRE Project – Scenario  Future Internet testbed/experimentation between BRasil and Europe

 Requirements  iRODS-based Repository  Final considerations

www.fibre-ict.eu

2

FIBRE Intercontinental Testbed UFPA

UNIFACS

U. Bristol

UFPE UFSCar

OCF OMF

WDM

OCF

OCF OMF

OCF OMF

UFG

OCF OMF

PoP-UB PoP-BA

PoP-PA

PoP-PE PoP-i2CAT

OCF OMF

PoP-SP

PoP-GO PoP-DF PoP-RJ

PoP-UTH

GENI OCF OMF

OCF

USP

OCF OMF

RNP WDM

OCF OMF

OCF OMF OCF OMF

UFRJ

i2CAT CPqD

UTH

UFF

• 13 remote testbeds: large-scale federated facility between Brazil and Europe • Heterogeneous Network resources: OpenFlow switches, wireless infrastructures, optical devices, virtualization XEN servers, other • A federation of CMFs and Monitoring tools: OCF, OMF and ProtoGeni • A dedicated “per slice” SDN controller

FIBRE Islands/ Members

4

Objective •

To provide data storage for a multi-CMF (OFELIA, OMF and ProtoGeni Control and Monitoring Frameworks) testbed interconnecting institutions FIBRE Instrumentation and Monitoring Architecture I&M FIBRE-BR

• • •

OFELIA (OpenFlow in Europe: Linking Infrastructure and Applications) OMF (ORBIT Management Framework) ProtoGENI

5

FIBRE Architecture – I&M FIBRE-BR

FIBRE Instrumentation and Monitoring Architecture Source: PINHEIRO, MACÊDO, et al., 2012

6

FIBRE Implementation Requirements • Enable transparent access to monitoring data from native distinct CMFs in distributed experiments • Support "Federation" among distinct CMFs storage instances and institutions: – Allow storage/retrieval of monitoring data using distinct database management system (SQL, RRD, Postgres,…) – Slices running on institutions

• Implement a monitoring data storage strategy and metadata in a standardized way (for FIBRE) – NMWG (Network Measurement Workgroup: XML, set of metrics/ parameters, web services, …) – MDIP – Measurement Data Integration Point

• Monitoring data collected by both native CMFs monitoring tools and new tools implemented • Data and metadata semantics • Distributed client interface

General Requirements • Scalability • Distribution • Federation • •

Transparent storage Access control (various institutions)

• Standardization • •

Monitoring (standard and semantics) Data storage and retrieval

• Security

8

iRODS Architecture - Overview Overview of iRODS basic components

Source: adapted from (MOORE, 2010)

9

iRODS Architecture - Overview  Scalability:  Alternatives to distributed operation (03 options)  Distribution:  iRODS clients: Web Browser, iCOMMADS, iDROPWEB  Federation: supports federation  Security:  Access levels: rodsadmin and rodsuser  Availability: Replication of iRODS data between servers (pgPool)  Access control:  GSI support, Kerberos, Challenge-response or Shibboleth and has an authentication module that interacts with the LDAP (PAM - Pluggable Authentication Modules)  Semantics:  Namespace, AVU metadata stored in database

10

FIBRE I&M Architecture with iRODS Components

11

iRODS basic Operation per Island Experimenter

iRODS Web Browser iRODS Client iCOMMANDS

MDIP “StorageData” Repository /InBox /OutBox

iput, imeta , ils

iRODS Server iCAT

iput

Move

Environment Variables Configuration

12

Data Storage Alternatives for I&M Multi-CMF with iRODS

13

Data Storage Alternatives for I&M Multi-CMF with iRODS

14

Data Storage Alternatives for I&M Multi-CMF with iRODS

15

FIBRE iRODS I&M Multi-CMF Storage Implementation Choice  FIBRE Implementation option:  RODS-based distributed data repository  Centralized iCAT Server

16

FIBRE iRODS I&M Multi-CMF Storage Overall Considerations  Storage of monitoring distributed data:  FIBRE has several islands scattered in Brazil / Europe (centralized iRODS alternative off)  Reduces bandwidth usage of the testbed backbone (monitoring data is stored on the local server)  Transparence:  Monitoring data abstracts physical location (regardless the island on which the experiment is executed through iCAT features)  Transparent monitoring data access in a federated environment (experimenter with appropriate access permissions)  Scalability and Federation:  All iRODS strategies scale in relation to federation between zones  Access control :  Federated authentication scheme compatible with FIBRE (LDAP )  Availability :  The iRODS has replication mechanisms 17

FIBRE iRODS I&M Multi-CMF Storage Proof of Concept 

Tests performed on virtual machines with multi-CMF data and distinct islands: 



Test to simulate testbed scalability:  



Prototype implementation at UNIFACS and UFPE New institution on the FIBRE testbed iRODS-Federation

Application (DataStores) supporting I&M instrumentation

18

FIBRE iRODS I&M Multi-CMF Storage Prototype Implementation • 03 islands with 07 hosts (experimenters using OCF and OMF and servers) • OFELIA (OCF) and OMF operating on each island • iRODS Server, iCAT Server (metadata and access control) and MDIP iRODS Clients (iCommands)

N ...

N ...

19

FIBRE iRODS I&M Multi-CMF Storage Prototype Implementation ISLAND

CMF OFELIA

UNIFACS (unifacsResc)

UFPE (ufpe-Resc)

Thiago host_ifacebw.rrd

Marcelo Flowtp.rrd attribute=metrics value=throughput

Metadata OMF

OML001.sql

Metadata

attribute=metrics value=delay

OFELIA

host_ifacebw.rrd

Metadata

Igorluiz host_ifacebw.rrd attribute=metrics value=bandwidth consumption

OML002.sql

Igorleonardo

OML004.sql attribute=metrics value=throughput

host_ifacebw.rrd

Flowtp.rrd attribute=metrics value=throughput

Metadata OMF

USERS Adriano

OML001.sql

OML002.sql

OML003.sql attribute=metrics value=delay

20

FIBRE iRODS I&M Multi-CMF Storage Prototype Implementation Query data and metadata - iRODS Web Browser

21

FIBRE iRODS I&M Multi-CMF Storage Prototype Implementation Query metadata

Query result

22

FIBRE iRODS I&M Multi-CMF Storage Prototype Implementation FIBRE zone federated with IFBA zone

23

FIBRE iRODS I&M Multi-CMF Storage Prototype Implementation Federation FIBRE zone with the IFBA zone

24

FIBRE iRODS I&M Multi-CMF Storage Evaluation Considerations  Allows integration of CMFs monitoring data with transparent access  Allows metadata insertion and metadata query  Scalable testbed supported by the distributed data repository strategy:  Simple monitoring data access through a logical directory (monitoring data distributed among FIBRE islands)  Supports the inclusion of new testbed and/or institution to the storage through federation  Application “StorageData“:  Simplifies the client application setup process (iRODS iCOMMANDS)  Sends data collected and metadata by script

25

Future Work • Make full transparent data storage to the experimenter: • MDIP as the intermediary between the portal I&M FIBRE and the iRODS client application • Automating the experimenter's identification process by collecting portal information such as login, password, island and CMF

• Analysis of iRODS performance in the context of FIBRE network • Impact on bandwidth and other aspects of network usage

• Deployment on all FIBRE islands

26

Thank you/ Obrigado

twitter.com/FIBRE_project www.facebook.com/fibre.project www.fibre-ict.eu www.irods.org 27

FIBRE Brazilian Team (2012)

28

FIBRE Brazilian Team (2013)

29