A Gentle Introduction to Grid Computing and Technologies - CiteSeerX

COMPUTER SOCIETY OF INDIA

A Gentle Introduction to Grid Computing and Technologies
 

               

           

  !             "        #        !   $                                  %                  

     & 

     $                        '    ( )  *  +  %  ,   +%(-         +  .   (  

                      

/               : ;= # "00= ### 0 = # 0#= 

5*? 1  ,#   #  UV60   #   R       #        "

!  !  +  ##           #   " # 

 "

0          #  # 

  "#    +   #    !  #   #! "    "

  "  0 " "  # 0  !   !"        ""  #  3   0      0  !    "    "      #  

#     # 2"       

"  !  

E 

 ! #  "       #    #   2"    



  #         ? 0   # !        "         

     "  ! 0"     #U/V # "!  " #    "     

    

!   '  "   

 E / !        "   

 CSI Communications

Distributed data

Peers sharing ideas and collaborative interpretation of data/results Scientist

Remote Visualization 2100 2100 2100 2100 Distributed computation 2100 2100 2100 2100 Data & Compute Service

Distributed instruments

Fig. 1: A typical eScience scenario.

'   9      

  #   #  "  "  0  #  # #  #   "      ! #    #  # B

 

COMPUTER SOCIETY OF INDIA + 

0     ! 

! !  # # G   0 #   0 "  # 

  +  !    "        " #  #  #

     # 0 

  ! 0  "# 

0 "  "  #  

 !   " 0 #     " "   = # "U.VULVUV+          "    #  " !#  0 " !!0 #"# 0  "       "   

"!    '            " $  #  

# 

  #! " = #

 #   " "   #   0 !  #   = #  # + =  3 $ #  = #  S          #0  

! # " 0

0 # 0 #     # # # "

H T'      # = # #   "

 #   = #  3 $  S= #    "  "  # #  #        0  0 #       " #  #S   T   #  

#"#  !  0"  0 "

0  0 #  > 9   !

9 T + #! "   = #    0   #  #   0                 # #! "  

 # # #  + $

 "  ## # = ##! "   " ! !# 

!  % & & &

" ! #  #  

     !     #

  K

" !  !    # # #  "  #      # " K# " !#      

   #  !         #    "   #  #  " ! " #! 

' ! !  ! ! !#    #   = # !     CSI Communications

 E   = #       # 



 

 = # 

   ! + #       ""  9     = #     # !  

    9   

   !0 #"" $ 

2  

   #   

   "      "#'

 "2   # ! ! 

 9  #  

0 = # !  ! !  !     0 

 0 # 

0      0 ""  #! "0 2  0

    0##  

 #  ! " !#  "      " "   # #    

#  

""

 #  #   #  

     !  = ###  

#  " !#  " ! 0= ###  #

 ! !  

         = # UV 4         !     0     #  # 0  "#   = # '   ! !  #  = #       " #   "  #   "

# # # # !  

 #  

H       !   # "

  = #      " #   9    # !#  

" 

  !

9  #+0#   = #! "    

Grid Information Service

Grid Resource Broker

R2

R3

R5

Application

database

R4

RN

Grid Resource Broker R6

R1

Resource Broker

Grid Information Service

Fig. 2: A world-wide Grid computing environment.

To tackle these challenges, a Grid architecture has been proposed based on the creation of Virtual Organizations (VOs)
        

COMPUTER SOCIETY OF INDIA [7] by different physical (real-world) organizations coming together to share resources and collaborating in order to achieve a common goal. A VO defines the resources available for the participants and the rules for accessing and using the resources. Within a VO, participants belonging to member organizations are allocated resource share based on urgency and priority of a request as determined by the objectives of the VO. Another complimentary Grid architecture [8] is based on economic principles in which resource providers (owners) compete to provide the best service to resource consumers (users) who select appropriate resources based on their specific requirements, the price of the resources and their expectations of Quality-of-Service (QoS) from the providers. Two examples of QoS terms are the deadline by which the resource needs to be available and the maximum price (budget) that can be paid by the user for the service. QoS terms are enforced via SLAs (Service Level Agreements) between the providers and the consumers, the violation of which results in penalties. 

  ! 

##= #! 0"     # ""

#% & & & & & & & & & & & & &

? 

#R

 "  #

3   #   #       G 

  # 

   ;

         5# #  "    6 3    !# 

 "    #  # ""   #!      "  #  "   - !     #       

   - !    "    

8"" # #  $  5'  

#  # !6   0  

0     $  2  8 !   #R#    # "##  #    *

 9   ! 9  8 #'     

CSI Communications

+ !" = # "!  "    !    0  0 #  ""   7   = #  "  " !#   ! "    

#      *    #    !

 #     ##   #   "    "     ! 50 ?     !    "    !" !## 

## 6E .    #  #        " = #            %  0 

 ## 0  ! ## 0 # ""  #"

   +,)    #  #      " 0 

0 

 #! #     +  "     "  "   0"  " 0  !  #

#  3    !  

"  5;Y! 


# 6        " # 



" !# #  # #      "  

   

#   #   + ##     !     " 0       0

 0

    ## ! 0  0 #" C   !5C 6   

 !  #  # +  !      "2  #        ! " !#  #

#  #

   - ' + ##  H    " !##  !##  " !# !     #  ! + # ""  #! " ! 0 "   

 #     

     # # ""  

 2    

  

+         "  #! "#  = # # "   !  #  #  ## !" !##  !## '2""" 0  "    

   # " 0  # 9   "  "  0      #0 #   #          = # "

  
  # ""   !0        #   

 $        
 

       

COMPUTER SOCIETY OF INDIA

Scientific

…

Prob. Solving Env.

Collaboration

Engineering

Web enabled Apps

USER LEVEL MIDDLEWARE

Development Environments and Tools Languages/Compilers

Libraries

Debuggers

…

Monitors

Web tools

Resource Management, Selection, and Aggregation (BROKERS)

CORE MIDDLEWARE

Distributed Resources Coupling Services Security

Information

Data

Process

Trading

…

QoS

SECURITY LAYER

FABRIC

Local Resource Managers Operating Systems

Queuing Systems

Libraries & App Kernels

…

Internet Protocols

Networked Resources across Organizations Computers

Networks

Storage Systems

Data Sources

…

Scientific Instruments

Fig. 3: A Layered Grid Architecture and components.

 !  : 73 ; +   "          $    0  2  0$  

#   + "  = " %

4 6
     )46
*; =?'8 " !#   2  "   #

"

 

       2  '  9  $        " #     +" #        

H# 50     

# # ""      $          6 4  ! 0"   $      #  

  $

2  F       # #"#   #   =?'8    !     #    3

  (   53(60 1 #   E  51E6 # 1 #1! 

properties and status and translate them into the format defined by the object classes. The Grid Resource Information Service (GRIS) forms the second tier and is a daemon that runs on a single resource. GRIS responds to queries about the resource properties and updates its cache at intervals defined by the time-to-live by querying the relevant IPs. At the topmost level, the GIIS (Grid Information Index Service) indexes the resource information provided by other GRISs and GIISs that are registered with it. ## &! +"!> +#"" !##   

  0 

 #  ! #     "  # "       " ""  +  " % GridFTP: It is an extension of the standard FTP protocol that provides secure, efficient and reliable data movements in grid environments. In addition to standard FTP functions, GridFTP provides GSI support for authenticated data transfer, third-party transfer invocation and striped, parallel and partial data transfer support.

+ $  #   " #    =  ?   "   1 5?160    "   =?'8 ?1 " !#  2     ! " 

 #     

9 #

$ #

#   3;

Replica Location and Management: This component supports multiple locations for the same file throughout the grid. Using the replica management functions, a file can be registered with the Replica Location Service (RLS) and its replicas can be created and deleted. Within RLS, a file is identified by its Logical File Name (LFN) and is registered within a logical collection. The record for a file points to its physical locations. This information is available from the RLS upon querying.

4
  )4
*;='        ""    "   # "    #     ='  #

  "  # 2 

$ #

  ! "    #      #     # #

" # 

     $  ='   ,++3 #  ##  = #     

  "  

 ##

 #% 3 !  ,> + 

   ! " " !#  # #  " "     #     #    = # + =   "    "  # 8 

 # - !  !58-6 MDS provides support for publishing and querying of resource information. Within MDS, schema define classes that represent various properties of the system. MDS has a three-tier structure at the bottom of which are Information Providers (IPs) that gather data about resource CSI Communications

The major Grid tools and application projects making use of Globus as their low-level middleware include: AppLeS, Ninf, Nimrod-G, NASA IPG, Condor-G, Gridbus Broker, UK eScience Project, GriPhyN, and EU Data Grid. 

8  + 7 = #      =  " !# "  #  ! 9 #

    # 2    $         

          , ! 0 

!   " !   = #     " ! 0       #  ## #+ # "          #  # "" 0

     #  # 

# ## ! "" 0 # = #


0        

COMPUTER SOCIETY OF INDIA    

 # 0 ""   ! "  0 #        "  + ""  #! " # #"   ! #     # " !      = # # #   ""



 # ""  The Gridbus project is engaged in the design and development of service-oriented cluster and Grid middleware technologies to support eScience and eBusiness applications. It extensively leverages related software technologies and provides an abstraction layer to hide idiosyncrasies of heterogeneous resources and lowlevel middleware technologies from application developers. In addition, it extensively focuses on realization of utility computing model scaling from clusters to Grids and to peer-to-peer computing systems. It uses economic models in efficient management of shared resources and promotes commoditization of their services. Thus, it enhances the tradability of Grid services and manages efficiently the supply and demand for resources. = # ""

  #H  = # ! !  !% & & &

?   !503; # 

   6

'""  ! 50    # 

"  

# #"" 6 ' # !50  # 

 ! "# 6

+ #    "      "      !

#  "       ! " !#    "#  !  #   "   ""  #  0 #    9 0  # "H    !   9  #  

#    # = #  "H  #  # 9   ! # !   "       !   !   0 "  " 5336

0#= #



 #  #  " 0 #0 # ""   !

CSI Communications

Applications WorkFlow and Application Programming Interface Gridbus Grid Service Broker Adapter Layer Alchemi Actuator

Globus Actuator

Unicore Actuator

Alchemi

Globus

Unicore

… …

Grid Economy and Allocation Grid Trading and Banking Services

Grid Resources and Local Services

Fig. 6: The Gridbus Architecture.

E    #  #" = #   "    $    ##       =   !  ## 

 = #  " !#        " #      

% & & & & & & & & &

* " = #8## 5'6

 !1! '  # '    ?  51 6

= # *    # 7  * "  5= # 8 - 

0 "3  8 6 = # + # # '   ! 5= #(6

= # ?   (   # # 5= # (  6

= #


  85= # 


   *6 = #'"" 3   57 3   8 # 6 = #3

5=8 

0= #"6

= #8 ## 5= #6


; +     "  !  !     ;2 "   0  ! $

    "       "  # 8  
# '


2        

COMPUTER SOCIETY OF INDIA  #! "#   ##   #   " 

  # "  #     H  #  " "  " # ! 

 3 # 

  
#   

H  '  "#   "   8   *+ E 

 # " !#    

  ## "= #    " !#  $

# "    #    !   !   #  "  !  ""

4'3Y81    5 ;1  # "

  !!   #                

 $ $  "# ## " #     " !##    9 #

F   " 9 ##

9   # 

 2# ##+01 #!  !   #        2" 

$   #

4   8 ( )4(*%  " !#   !  !" !#   ! # "    !  >  " !# #     9       !     9            !     " 0 "  #    ! !#  0  8 )0*;      #

  ## #! "#

!   FY+' "

     #  #  "  "   !  33 

 + 38  "   "   0    # " !#    8   ! 0 8  ?   '0 #8 ?  (  58?(6""

!       #

     # #   !    # " !#  #   "  #  #


   2