OSA/OFC/NFOEC 2011
JWA1.pdf JWA1.pdf
Joint Storage-Network Resource Management for Super High-Definition Video Delivery Service Kazuhisa Yamada*, Yukio Tsukishima*, Kazuhiro Matsuda†, Masahiko Jinno*, Yusuke Tanimura‡, Tomohiro Kudoh‡, Atsuko Takefusa‡, Ryousei Takano‡ and Takashi Shimizu* *NTT Network Innovation Laboratories 1-1 Hikarino-oka, Yokosuka-shi. Kanagawa, 239-0847 Japan NTT Energy and Environment Systems Laboratories 3-9-11 Midori-cho, Musashino-shi, Tokyo, 180-8585 Japan ‡ National Institute of Advanced Industrial Science and Technology 1-1-1 Umezono, Tsukuba-shi, Ibaraki, 305-8568 Japan *{yamada .kazuhisa, tsukishima.yukio, jinno.masahiko, shimizu.takashi}@lab.ntt.co.jp, †
[email protected], ‡ {yusuke.tanimura, t.kudoh, atsuko.takefusa, takano-ryousei}@aist.go.jp †
Abstract: This paper proposes a joint storage-network resource management for a super highdefinition video delivery service. The method for allocating storage and optical path resources is discussed. The feasibility of the proposed system is shown. OCIS codes: (060.4250) Networks; (060.4256) Networks, optimization
1. Introduction The main cause for the increase in Internet traffic in recent years is the proliferation of video content and the availability of high-definition video content. In the future, the demand for high-quality video will increase and the push from standard definition (SD) to high definition (HD), 4K and super hi-vision (SHV) will accelerate. Optical path networks based on circuit switching are more suitable than packet switching networks to handle high capacity data such as super high-definition video content. However, it is difficult to guarantee the quality of super highdefinition video delivery service when allocating only optical path resources. To deliver super high-definition video content with stability, it is necessary to allocate and offer resources of widely distributed storage and optical path that simultaneously ensure I/O performance [1] and guarantee bandwidth to the user. Some studies reported on providing computer resources and optical path resources respectively to the reservation request from the users [2, 3]. However, little work has been done on storage resources and optical path resources are managed in a joint manner and offered to users. In this paper, we propose a joint storage and network resource management system for a super high-definition video delivery service. The proposed system provides performance guaranteed storage resources and optical path resources at the same time. We discuss the method for discovery and allocation of storage and network resources. Finally, we present experimental results on the prototype system. 2. System architecture Figure 1 shows proposed system architecture for a super high-definition video delivery service. This system consists of a service coordinator (SC), resource coordinator (RC), and several resource managers (RMs). Because storage resources and network resources belong to the management domain, which differs depending on types, locations and providers, a RM must be established for each domain. The RC reserves the resources across two or more domains cooperatively with the RMs. The Storage Resource Manager (SRM) manages storage resources in a storage domain and the Network Resource Manager (NRM) manages network resources in a network domain. The required video content is delivered from the delivery storage to the user. When the required content is not in the delivery storage, it is replicated from the archive storage to the delivery storage. The SC manages information specific to the application. In a video delivery service, the SC manages the storage capacity, I/O bandwidth, and network bandwidth required for video content delivery. The SC also manages replica information, which is address information regarding the delivery storage where the replication content is stored. When the reservation request from a user is accepted, the SC extracts the content information and replica information from the content name specified by the user, and requests the reservation of resource to deliver the content. If there is no replica information, SC deems that a replica must be generated, and reserves resources to replicate the content from the archive storage to the delivery storage. The RC searches for available resources in cooperation with RMs, and reserves the resources to deliver the content. When the reserved time comes, the NRMs establish an optical path from the delivery storage to the user. We adopted GNS-WSI3 (Grid Network Services -Web Service Interface version 3) [4] in the resource reservation interface between the RC and RM.
OSA/OFC/NFOEC 2011
JWA1.pdf JWA1.pdf
Fig. 1. System architecture
3. Joint storage-network resource management This section describes the proposed method used by the RC in cooperation with the RMs to search for storage and network resources. The RC treats the resource information in the storage and network domain as a virtual resource. The RC treats the storage managed by a SRM as virtual storage, and manages its capacity and I/O bandwidth. The RC manages a virtual port, which is a domain boundary port, and manages a virtual link, which is a connection between virtual ports. Figure 2 shows the flow for resource allocation by the RC and RMs. First, the RC discovers and allocates logical connections between domains with the virtual resources. Next, the RMs discover and allocate resources in each domain in parallel, but those allocation supports end-to-end delivery. The details regarding the resource discovery and allocate algorithm are given hereafter. When the SC receive reservation request from the user, the RC selects the available virtual storages that satisfy the required capacity and I/O bandwidth. Next, the RC searches for the optical path routes from the selected virtual storages based on virtual resources. The RC lists the combination of virtual resources that available from the selected virtual storages using the searched optical path route. The RMs are queried regarding whether or not the virtual resources in the list are actually available. The unavailable virtual resources are excluded from the list. A combination of the optimal virtual resources is selected from the list. It is assumed that many users share storage to achieve optimal conditions. In this case, the number of delivery storages that operate at the same time is decreased. If the storage does not deliver content it can be put in the sleep mode and power consumption is decreased. The selected virtual resources are reserved from the RC to the RMs, and the physical resources are reserved by the RMs.
Fig. 2. Flow of resource allocation
4. Experimental results We implemented a prototype system comprising a SC, RC, SRM and NRM and constructed an experimental system using the prototype system, performance guaranteed storage system and optical cross-connect switches (OXCs) to evaluate the proposed method. Figure 3 shows an experimental network, reservation timetable and parameters. Six OXCs (OXC1~OXC6) were connected to the JGN2plus network [5], and a transparent optical path network was constructed. Storage S is archive storage and the other storages are used as delivery storage. Storage S, A, and B and users A-1, A-2, and B used a 1-Gbps optical path, storage D and user C used a 10-Gbps optical path, and storage C and users D and E used a 43-Gbps optical path. Storage C is not managed by a SRM, and manages only a 43Gbps optical path. Reservation resource information and the state of the storage and optical path resources were acquired and displayed on a reservation resource monitor (RRM). Figure 4 shows the state of the resource reservation via the RRM. It was confirmed that storage A was selected appropriately to reduce the number of storages for the reservation of user A-2, and an optical path from storage A to user A-2 was established. Moreover, because the resources of an optical path from storage A to user B was insufficient, storage B was selected for the reservation of user B, and an optical path from storage B to user B was established. We measured the reservation response time to evaluate the system performance. Figure 4 shows the
OSA/OFC/NFOEC 2011
JWA1.pdf JWA1.pdf
measurement results. The reservation response time was less than or equal to 4 sec. We confirmed that this result is sufficient for a reservation video delivery service.
Fig. 3. Experimental network, reservation timetable, and parameters
Fig. 4. Experimental results
5. Conclusion We proposed a joint storage and network resource management system for a super high-definition video delivery service. We discussed the method for discovery and allocation of storage and network resources in which the RC cooperates with the RMs. We implemented and evaluated a prototype system. Based on the experimental results, we confirmed the operation of the integrated storage and network resource management system. We also confirmed that the reservation performance is sufficient for a video content delivery service. 6. Reference [1] Y.Tanimura, H.Koike, T.Kudoh, I.Kojima, Y,Tanaka, “Performance assurance of distributed storage by application-driven, advanced and time-based reservation,” 8th USENIX Conference on File and Storage Technologies,2010. [2] A. Takefusa, M. Hayashi, N. Nagatsu, H. Nakada, T. Kudoh, T. Miyamoto, T. Otani, H. Tanaka, M. Suzuki, Y. Sameshima, W. Imajuku, M. Jinno, Y. Takigawa, S. Okamoto, Y. Tanaka, and S. Sekiguchi, “G-lambda: Coordination of a grid scheduler and lambda path service over GMPLS,” Future Generation Computer Systems, Vol. 22, Issue 8, pp. 868-875, October 2006. [3] Y. Tsukishima, A. Hirano, A. Taniguchi, W. Imajuku, M. Jinno, Y. Hibino, Y. Takigawa, K. Hagimoto, X. Wang, L. Renambot, B. Jeong, R. Jagodic, S. Nam, J. Leigh, T. DeFanti, and A. Verlo, “The first optically-virtual-concatenated lambdas over multiple domains in Chicago metro area network achieved through interworking of network resource managers,” OECC/IOOC2007, 12A2-5. [4] “GNS-WSI version 3 (Grid Network Service – Web Service Interface, version3),” http://www.glambda.net/wordpress/wpcontent/uploads/2008/11/glambda-gns-wsi3.pdf. [5]”JGN2plus,”http://www.jgn.nict.go.jp/english
