Algorithms and Tools for (Distributed) Heterogeneous Computing - Lara

Laboratoire de l’Informatique du Parall´elisme

SPI

´ Ecole Normale Sup´erieure de Lyon Unit´e Mixte de Recherche CNRS-INRIA-ENS LYON no 5668


  
        

 



  


      

´ Ecole Normale Sup´erieure de Lyon 46 All´ee d’Italie, 69364 Lyon Cedex 07, France T´el´ephone : +33(0)4.72.72.80.37 T´el´ecopieur : +33(0)4.72.72.80.80 Adresse e´ lectronique :
   


  
        

  
  




 
          
  


 
          
     
  
         !    !       "  

  #     !  
        
 $   !     
!     

  %& '       
        
    Æ   (   
 


  ) *     +
  
 
! , 
  
   
! - 
       ! .     
       
              
) /
 - 0 . /1!

0-! ,
! 0!       
          % 

 "   





  2          
    

        3      45/# .       #/-2    5
 6!     5/#     
 "

    
!  
  "! 
    !  
  



0  
  
7 8
    !  

7 4 


6! 


9

 

   
 



 7 

  8 /

  7
  8  
         9
    
 
7 
!  
  
  +
    +
 8    
  

 Æ        *   8  ! 
  
    77
' 
7 
 $ 

  7 ! 8    !    +
   

 & 
 7  
 +
+

  

' 8   +
       

   Æ  (

   8      
  

) : 2 +
 9    7 
  
 
 

! : . 8   
 7 
 7 
! : 7  
    7
      
! : 8     
 
   7
 9    

  ) /


- 0 . /1!

0-! ,
! 0!      
 
 

  
          


   8 
     

        4 
6! 4
    6!    77 8

;




  

  
 .       ;     -  #
  / G?AH   .# G=H -   
    


 
    

      
 '  .#  
J  
 
   2      ,
 GAH $

  &  0 G=;H $

  

& ,
    

   
    

 2   
            ! 
 
   ! 
!  
        "        
 
  2"! 
      .  #   $.#&   
  /  - $     


 &    !

     ,    - - ?;        ,
 0     
     "       
  
 
  # 
 ! 0  
   !             E   >   - - ?        0 #   


   0  "
    

    G=DH  .# GH    2        
    

    -! 
     !       J!    
     !    ! 
! 

B

a at

D

Input Data NetSolve client Result

NetSolve ScaLAPACK server

lic yc ion C t k ibu c o tr Bl is D D 2− ata D

ScaLAPACK Processor Grid (NoW or MPP)

es

ul

t

c cli ng Cy ri k he oc at Bl G D ult 2− Res

R

I
 A) 2  - 0 . /1 - -  . 

'





#     !   
  
     
 
 
   
 @     )               
  5
 !           '       - !   5
   
     . /#  )   . /# .                 Æ   5
  2  Æ
     
     
   *   !  
 
!     !   "        '        
 2   '  Æ
    '   


          
           
!     
  '
   
     
  
 $     !  ! & #               
    *    
  ! 
        5'        *        !   

    +
  
    " 
     

      
      "  
  
  -        Æ        "    I   '  
 !     J 
  
     " $
 !  
!

      &      K
         4   


 Æ6 
M 




  

   
    
  
  
, 2 
 

 





  

   3

, 2  

  

  
   
 
    , 





0"  " !     "

  $  % 
     &               
!  !  
     Æ    0"   !  
   "

     F
!   
!       
    

         
  
   
     
  )  
    !  


           O   

  +
         '  
         M

=D

( GH    ! I ,
 !   V
          ' 
        
   
 !
  

 
        ! ! B$&)A:B! = G;H @5 C !  C  !  @ ! / R ! 1 0 ! 2 W
!  I 1  " .     
           " #    $! $&):=D! B GH @5 C !  . ! 2 1 ! R  !    
  !   >  .  
    
 )        # %& '
& (  !  ;D:;=!  G=H .@ C" ! .1 I !  I @
  5Æ 
  

 
 . - # )
 *    !

  
 )*!+,-! /  ! #0! B #555 /
 - .  G?H I C   @       
  # # I  / 1 !  ! # .
/ 
   01  
   !  ;A:D   1
 !  GH I C     " 2 

  )  
    # * 
    - 0%    $ 
! A      GAH I C  !  "! - I
 ! R -  !  , - 

   
   
  
  " # * 
   $ 
 2,,3 #555 /


- . !      E/-* /- 2    /-=B; GBH 0 C " ! R / !  / ! R *! # * ! R *

! - @  ! , @ !  .! 1 - ! *  " !   /   -  ")          
  
    
      # $ 


+,3 #555 /
 -!  GH 0 - C " ! R / !  / ! 5 *9 J! R *! # * ! R *

! - @   ! , @ !  .! 1 - ! *  " !   /   $ '"*"4 5+ .
 -# ! A GDH > C
! I  !  .!  3   *        

 "    
     2      ! 0#.! 50!       #$ 2

  .*/-9! C GH > C
! I  !  3         
 
 - 0  . /1 $   & 2      A! 0#.! 5- 0!       #$ G;H > C
! I    !  3      
  $ 
&   
 
    #  "
 C
  2 / !  !    
 #  
6 %
 6  "

 7#%"+,,8 /-5 . !  5'        0#. 2      

=

GH > C
! I    !  3        
 


- 0 . /1 $   & # @    !  !  
      *    !

 * 
 # 
  "

 7*!*#"+,,8 /-5 . !  5'       0#. 2      A G=H .

 C
! R " *

! I    ! 3  !  I 77  >    
   
 
    #     
  .
 (   

  
     
! B 5'       0#. 2      B= G?H .

 C
! R " *

! 3  !  I 77  > -     
 
    *    
 ! ;?)?=A:?B!  GH 2* C
! @R -!  C"! 00 CWW!    !  
  ! R.  ! * 2 ! C 3 ! * @!  I I 
   
    

 
       "   
 
  # %
 )     
 (  !  ?:; #555 /
 - . !  GAH - C ! @ /   !  R *

 .    @ .    /
 2  # R  "! R *

! 1  !  *   ! A GH # I ! R , !  , 

!  1 ! 5 0
"! , 2 
 
" !  - 2
"               *    
 ! ;=)A?:A=! B GAH # I  / 1  ,
)  
  

 "   $

 "

! $;&)?:;B! A GBH # I  / 1 !   # .
/ 
   01  
      1
 !  GH , I'! -   !  G=H 2 1 ! I@ @ ! @5 C !  . !   I C     )  9   
      
     # $ " $.*'"0 $ 
  *

  * 
  *   *  
 ** **+,,!  :=D!   ! , !  G=AH /  @ 1! *  C 0 !   - -  ! ,
 0 - R !    5 V # )
 *    <   )    2  #2 . ! = G=BH > 1
 !  ,  !  ,
 !  , 1     
  *    
  2  C (/
 .
  / ! #! = G=H 5 0
! .   !  @ V  <
) @ 
 
      " *   * 
 '!  2

  G?DH  0J"!  0!   
"  / 
    "  # * 
    -  
      !

  
 $!  D=: #555 /
 - . ! BB G?H    ! - ! @R -! * @!  I I 
 *       
        "   
 
  # %
 )    
 (  !  D:== #555 /
 - . !  G?;H      @ R -        
       
 
  # $ )    
 (   #555 /


- . ! B G?H 1 1   * ,  *    
     
 
 


   
 ! ):A! B G?=H R <   /@  2   "      J       *    
 ! A)=:;! BB ==

G??H  .! @ /   ! R *

! 3  !  /   .    
 % 
) 
          9     # R C JJ! 1 5" ! C . 
!  *2  !  ! )     *    !

 * 
  -  >  !      0 . /1  "   G?H  ! R , !   C
 /
              $ " 
 ! ==);:;A;! B G?AH / 
! 1 -  !   I
 -


  

   
    "  )    
 
       
   
 ! )?:A! B G?BH >" - "  * 


    
         
   . ! B G?H @R -! @, *J!  R1  -  


    
 
 "  
 $! ;B$&);A:;!  GDH ,/ -  5  0    
 
      
   
 %%% #  
  *    !

 $! =$;&)A?:BA!  GH  - ! -