Proceedings of the Asia-Pacific Advanced Network 2013 v. 36, p. 17-22. http://dx.doi.org/10.7125/APAN.36.3 ISSN 2227-3026
OF@TEIN: An OpenFlow-enabled SDN Testbed over International SmartX Rack Sites JongWon Kim1, *, ByungRae Cha1 , Jongryool Kim1 , Namgon Lucas Kim1 , Gyeongsoo Noh1 , Youngwan Jang2 , Hyeong Geun An2 , Hongsik Park2 JiHoon Hong3 , DongSeok Jang 3 , TaeWan Ko3 , Wang-Cheol Song3 Seokhong Min4 , Jaeyong Lee4 , Byungchul Kim4 Ilkwon Cho5 , Hyong-Soon Kim5 , and Sun-Moo Kang5 1 School of Information and Communications, Gwangju Institute of Science & Technology, Gwangju, Korea 2 KOREN Network Operation Center, Seoul, Korea 3 Dept. of Computer Eng., Jeju National University, Jeju, Korea 4 Dept. of Infocomm. Eng., Chungnam National University, Daejeon, Korea 5 National Information Society Agency, Seoul, Korea
E-Mails:
[email protected] * Tel.: +82-62-715-2219; Fax: +82-62-715-3155
Abstract: In this paper, we will discuss our on-going effort for OF@TEIN SDN (Software-Defined Networking) testbed, which currently spans over Korea and five South-East Asian (SEA) collaborators with internationally deployed OpenFlowenabled SmartX Racks. Keywords: Software-Defined Networking; OpenFlow; SmartX Racks; and Future Internet testbed.
1. Introduction For the successful verification of Future Internet research ideas, the construction and federated operation of testbeds over international research & engineering networks is highly important. In this context, starting from 2008, various projects on Future Internet testbeds, such as US GENI (Global Environment for Network Innovations), EU FIRE (Future Internet Research & Experimentation), and Japan NWGN (New-Generation Network), have been initiated along with the wide adoption for OpenFlow-enabled SDN (Software-Defined Networking) technology
17
[1]. Especially, GENI has been deploying GENI Racks to promote the easy construction and wide expansion of SDN-enabled testbeds in US national scale. Similarly in OF@TEIN project, launched in July 2012 as one of e-TEIN projects sponsored by Korean Government via NIA (National Information Society Agency), we target to gradually build and operate an OpenFlow-enabled SDN testbed over TEIN4 (Trans-Eurasia Information Network 4). This OF@TEIN collaboration project is being carried out by a consortium of Korean universities and international collaboration sites, led by GIST (Gwangju Institute of Science & Technology), Korea. More specifically, unique SmartX Racks are deployed to promote the international collaboration with TEIN NRENs (National Research & Education Networks), resulting in an OpenFlow-enabled SDN testbed over 7 international sites. Thus, in this paper, we will review and discuss the development and deployment of on-going progress 2. OF@TEIN: Initial Phase Tasks
PKU (Busan)
EU (Ofelia, …)
KPU(Daegu)
SmartX Rack OF@TEIN SDN Tools OF@TEIN Portal Exp. Node (with HD camera) Exp. Node (traffic generator) Exp. Node OpenFlow FlowVisor OpenFlow Controller OpenFlow Production Switch (NariNet, HP) OpenFlow Switch with NetFPGA
VoD
OF@KOREN JNU (Gwangju)
USA (OS3E-NDDI, …)
NIA(Seoul)
SKKU (Suwon)
VoD
KAIST ICC (Daejeon)
VoD
OF@KOREA
OpenFlow Switch
Live HD Video
Live HD Video
Jeju (Jeju)
GIST (Gwangju)
OF@TEIN Vietnam VoD VoD
CNU (Daejeon )
OF@FIRST VoD ETRI (Daejeon)
Live HD Video
Networked Tiled Display
KHU / Postech Live HD Video (Suwon / Pohang)
Thailand
Philippines
SmartX Racks
VoD
Indonesia VoD
Malaysia VoD Live HD Video
VoD VoD
Fig. 1. OF@TEIN OpenFlow-enabled SDN testbed (planned concepts). In year 2012, the main target of OF@TEIN was to initiate the deployment for an OpenFlowenabled SDN testbed for Korean and South-East Asian (SEA) collaborators over TEIN4. The five collaborators from SEA are HUST @Hanoi, Vietnam; ASTI @Manila, Philippines; Chulalongkorn University @Bangkok, Thailand; ITB @Bandung, Indonesia; and University of Malaya @Kuala Lumpur, Malaysia. The overview diagram for initially planned OF@TEIN infrastructure is presented in Fig. 1, where the dotted SmartX Rack clouds and dotted links represent the portion of future expansion.
18
In this initial phase of OF@TEIN project, we are currently focusing on following three tasks to prepare the resources and tools for the experiments: -
Design and prototype verification of SmartX Racks: We first design unique SmartX Racks with OpenFlow switching and remote management capabilities. We then verify our design by prototyping two types of SmartX Racks (Type A and Type B) to match different needs of participating sites [2, 5]. - Site installation and network connection of OF@TEIN system/network: As part of OF@TEIN installation, we install SmartX Racks at participating sites. Also, we connect them to TEIN via the support of NRENs while deploying the system and network monitoring tools to assist the persistent operation of OF@TEIN [3]. - Design and development of OF@TEIN SDN tools: To enable OpenFlow-enabled SDN experiments, we design and develop several OF@TEIN SDN tools to assist both experimenters and managers [4, 5].
3. OF@TEIN: Task Details and Progress for Initial Phase 3.1. Design and verification of SmartX Rack Management Plane Data Plane
SmartX Rack (Type A) Management Switch
OF@TEIN Portal Server
Open vSwitch
NARINET OF Switch & Capsulator Node
Worker VM #2 Worker VM #1
Worker VM #3
OF@TEIN SDN Tool Node
Worker VM #2
Dataplane OF Switch OMX Server
NOX
MediaX-VT Agent OpenFlow Agent
Worker VM #1
SmartX Web Server
Monitoring (perfSONAR) SmartX Rack Agent
VM #1
Worker VM #2 Worker VM #3
PerfSONAR Collector
Remote Power M ng.
MediaX-VT Agent OpenFlow Agent
OF@TEIN Network Management & Monitoring Node
SmartX Rack (Type B)
VM #2
Worker VM #1
Monitoring (perfSONAR) SmartX Rack Agent
VM #1
OpenFlow Agent
FlowVisor
VM #1
MediaX-VT Agent
Opt-In Manager
VM #2
VM #2
SmartX Rack Agent
MediaX-VT AM
OF@TEIN OpenFlow Management Node
Worker VM Management VM
SmartX Rack (Type B) Remote Power M ng.
OFELIA+ Monitoring (perfSONAR)
Tunneled Data Plane
Data
Worker VM #3
Manag.
NF/OVS Capsulator Node
Dataplane OF Switch Data
Manag.
NF/OVS Capsulator Node
Fig. 2. OF@TEIN testbed: SmartX Racks and Server Nodes. As shown in Fig. 2, we utilize SmartX Racks and Server Nodes to simultaneously support computing/networking resources. We design two types (Type A / Type B) of SmartX Racks to provide varying combinations of computing/networking resources. Each SmartX Rack (Type B) consists of four devices such as Management & Worker node, Capsulator node, OpenFlow switch, and Power management device. Especially, as shown in Fig. 3, OpenFlow switching with
19
tunneling is adopted to enable the multi-international connections among SmartX Racks. That is, OpenFlow switches (that connects the experimenter VMs (virtual machines)) are linked by the L2-GRE tunneling of Narinet/NF/OVS Capsulators. We also verify the functionalities of SmartX Racks by checking their SDN capability as well as remote management support. VM.A.1
VM.B.2
VM.C.2
Linux Bridge
SmartX Rack Type B SmartX Rack Type A
VM.A.3 L2 GRE Tunnel
SmartX Rack Type B
VM.B.1
Linux Bridge
L2 GRE Tunnel
Management + Worker Node OpenFlow Switch with OVS / NetFPGA
Linux Bridge VM.A.2
OpenFlow Production Switch (HP)
VM.C.1
OpenFlow Production Switch (Narinet)
Fig. 3. Connecting VMs with OpenFlow-aware Capsulators (via GRE tunneling). 3.2. Site installation and network connection of OF@TEIN system/network The initial version of OF@TEIN system/network was constructed by installing SmartX Racks (Type B), as depicted in Fig. 4. We also deployed several monitoring tools (based on perfSONAR, catti, and others) to check the operation status of OF@TEIN system/network. Philippines PREGINET AS9821 ASTI@Manila
NREN City (SmartX Rack)
TEIN-HK AS 24489
Vietnam Vinaren AS24175 HUT@Hanoi
Indonesia Inherent AS18007 ITB@Bandung
Malaysia Myren AS24514 UM@Kuala Lumpur
155M
10G TEIN-SG AS 24490
Primary Path Secondary Path
KOREA KOREN AS9270
10G TEIN-JP 24287
GIST@Gwangju
10G APANJP (AS7660)
Thailand THAIREN AS24475 CU@Bangkok
Fig. 4. OF@TEIN network connections and SmartX Rack site installation. 3.3. Design and development of OF@TEIN SDN tools We design and develop several tools for OF@TEIN management and experiments, as shown in Fig. 5. It allows us to conveniently manage the computing/networking/FlowSpace resources for SDN experiments. Based on OCF (OFELIA Control Framework), we develop OF@TEIN
20
Portal to provide UIs for administrators and experimenters. We also offer SDN Experiment UI to support smooth service creation by interactively monitoring experiment status. Slice #1
Provisioning for Users
OF@TEIN Portal Interface
OCF
Admin. Slice
Networking Resource
Service (S12)
OF Controller
OF Controller
User Experiment Script (OMX, …)
Slice #2
Slice #3
SDN Experiment UI NOX Core
Service (S2)
Service (S3)
OF Controller
OF Controller
FlowSpace Resource FlowSpace Slices Virtually linked FlowVisor
FlowSpace UI
SmartX Resource Aggregation Manager NOX Core
VM VM
SmartX Racks
Node-/Connection-centric
Computing Resource
Service (S11)
Service-/Content-biased
OF@TEIN FlowSpace
Fig. 5. OF@TEIN SDN Tools to support experimenters.
4. OF@TEIN: Preliminary Verification After completing the initial installation, we verified its operation by performing a pilot experiment as shown in Fig. 6. Since then, OF@TEIN has been undergoing beta testing to fix issues, mostly tied with stabilized operation for simultaneous experimenters. Also, OF@TEIN training workshop was successfully held in Feb. 2013 at MYREN NOC with international collaborators to promote their understanding and utilization of OF@TEIN. < OF@TEIN Portal Interface >
OF@TEIN Experiment @ GIST < OF@TEIN Experiment UI >
MY
ID
PH
VN
Jeju
TH
Fig. 6. OF@TEIN experiment @ GIST with related UIs.
21
5. Conclusions The on-going effort for OF@TEIN SDN (Software-Defined Networking) testbed has been successfully launched in 2012 with internationally deployed OpenFlow-enabled SmartX Racks. In coming years, we hope to gradually extend and upgrade OF@TEIN so that we can facilitate the realistic Future Internet research collaboration of all Asian countries. Acknowledgements We would like to appreciate all OF@TEIN international partners for their sincere collaboration (including SmartX Rack hosting and OF@TEIN utilization). Also special thanks go for GIST students (Namgon Kim and Jaeyong Yoo) who significantly contributed in the initial setup stage. Finally, we appreciate the effort of KTNetworks staffs (Jaesoo Park, Yongjin Kim, and Boshik Shin) in SmartX Rack site installations. References 1.
N. McKeown, T. Anderson, H. Balakrishnan, G. Parulkar, L. Peterson, J. Rexford, S. Shenker, and J. Turner, “Openflow: Enabling innovation in campus networks,” ACM SIGCOMM CCR, vol. 38, no. 2, Mar. 2008.
2.
S. Han and J. Kim, “Preparing experiments with media-oriented service composition for Future Internet,” in Proc. Int. Conf. on Future Internet Technologies (CFI 2010), Seoul, Korea, June 2010.
3.
N. Kim, J. Kim, C. Heermann, and I. Baldine, “Interconnecting international network substrates for networking experiments,” in Proc. Tridentcom 2011, Shanghai, China, Apr. 2011.
4.
S. Han and J. Kim, “Understanding resource-aware control of media-centric service composition over future internet testbeds,” in Proc. Int. Conf. on Future Internet Technologies (CFI 2012), Seoul, Korea, Sep. 2012.
5.
J. Kim, “Realizing futuristic service composition with programmable and virtualized pools of unified resources,” in Proc. Int. Conf. on Future Internet Technologies (CFI 2013), Beijing, China, June 2013.
© 2013 by the authors; licensee Asia Pacific Advanced Network. This article is an open-access article distributed under the terms and conditions of the Creative Commons Attribution license (http://creativecommons.org/licenses/by/3.0/).
22