Parallel Iterative Solvers for Ill-conditioned Problems ...

Procedia Computer Science Volume 80, 2016, Pages 1635–1645 ICCS 2016. The International Conference on Computational Science

3DUDOOHO,WHUDWLYH6ROYHUVIRU,OOFRQGLWLRQHG3UREOHPV ZLWK+HWHURJHQHRXV0DWHULDO3URSHUWLHV .HQJR1DNDMLPD 1

Information Technology Center, The University of Tokyo, Tokyo, Japan [email protected]

 $EVWUDFW 7KHHIILFLHQF\DQGUREXVWQHVVRISUHFRQGLWLRQHG SDUDOOHO LWHUDWLYHVROYHUVEDVHGRQ GRPDLQ GHFRPSRVLWLRQ IRU LOOFRQGLWLRQHG SUREOHPV ZLWK KHWHURJHQHRXV PDWHULDO SURSHUWLHV DUH HYDOXDWHG LQ WKH SUHVHQW ZRUN 7KH SUHFRQGLWLRQLQJ PHWKRG LV EDVHG RQ WKH%,/87p,d,t PHWKRGSURSRVHGE\WKHDXWKRULQDSUHYLRXVVWXG\DQGWZRW\SHVRI GRPDLQGHFRPSRVLWLRQSURFHGXUHV/%-/RFDOL]HG%ORFN-DFREL DQG+,'+LHUDUFKLFDO ,QWHUIDFH'HFRPSRVLWLRQ DUHFRQVLGHUHG7KHSURSRVHGPHWKRGVDUHLPSOHPHQWHGXVLQJ WKH +HWHUR' FRGH ZKLFK LV D SDUDOOHO ILQLWHHOHPHQW EHQFKPDUN SURJUDP IRU VROLG PHFKDQLFVSUREOHPVDQGWKHFRGHSURYLGHVH[FHOOHQWVFDODELOLW\DQGUREXVWQHVVRQXSWR  QRGHV  FRUHV  RI WKH )XMLWVX 35,0(+3& ); 2DNOHDI);  DW WKH ,QIRUPDWLRQ 7HFKQRORJ\ &HQWHU WKH 8QLYHUVLW\ RI 7RN\R *HQHUDOO\ +,' SURYLGHV EHWWHUHIILFLHQF\DQGUREXVWQHVVWKDQ/%-IRUDZLGHUDQJHRIYDOXHVRISDUDPHWHUV  Keywords:3DUDOOHO,WHUDWLYH6ROYHUV3UHFRQGLWLRQLQJ0HWKRGV,OOFRQGLWLRQHG3UREOHPV

 ,QWURGXFWLRQ 7KUHVKROG LQFRPSOHWH /8 IDFWRUL]DWLRQ ,/87  >@ LV D ZLGHO\XVHG SUHFRQGLWLRQLQJ WHFKQLTXH IRUVROYLQJYDULRXVW\SHVRISUREOHPVZLWKLOOFRQGLWLRQHGPDWULFHV,/87p,d,t >@SURSRVHGE\WKH DXWKRULVDPRUHSUDFWLFDOPHWKRGZKHUHDPD[LPXPILOOOHYHOpLVVSHFLILHGEHIRUHIDFWRUL]DWLRQDQG dDQGtDUHSDUDPHWHUVIRUWKHGURSSLQJWROHUDQFHEHIRUHDQGDIWHUIDFWRUL]DWLRQUHVSHFWLYHO\)LJXUH GHVFULEHVWKHSURFHGXUHVIRUWKH,/87p,d,t PHWKRG7KHSURFHVVE LQ)LJFDQEHVXEVWLWXWHGIRU RWKHU IDFWRUL]DWLRQ PHWKRGV RU PRUHSRZHUIXOGLUHFWOLQHDUVROYHUVVXFKDVMUMPS >@ RUSuperLU >@ ,Q WKH SUHVHQW ZRUN SDUDOOHO SUHFRQGLWLRQHG LWHUDWLYH VROYHUV EDVHG RQ WKH ,/87p,d,t  PHWKRG ZHUHGHYHORSHGDQGZHUHLPSOHPHQWHGXVLQJWKHHetero3DFRGH+HWHUR'LVDSDUDOOHO)(0ILQLWH HOHPHQWPHWKRG FRGHDQGLWVROYHVOLQHDUHODVWLFLW\SUREOHPVZLWKKHWHURJHQHRXVPDWHULDOSURSHUWLHV ZKLFKRIWHQDSSHDULQJHRSK\VLFVDSSOLFDWLRQV   

Selection and peer-review under responsibility of the Scientific Programme Committee of ICCS 2016

 c The Authors. Published by Elsevier B.V. doi:10.1016/j.procs.2016.05.498

1635

Parallel

Iterative Solvers for Ill-conditioned Problems ...

K. Nakajima

,W LV ZLGHO\ NQRZQ WKDW WKH FRQYHUJHQFH RI SDUDOOHO SUHFRQGLWLRQHG LWHUDWLYH VROYHUV LV VWURQJO\ DIIHFWHG E\ WKH FKRLFHRI PHWKRGIRUGRPDLQGHFRPSRVLWLRQHVSHFLDOO\IRU LOOFRQGLWLRQHG SUREOHPV >@ ,Q WKH SUHVHQW ZRUN WZR W\SHV RI GRPDLQ GHFRPSRVLWLRQ PHWKRGV /%- /RFDOL]HG %ORFN -DFREL  >@ DQG +,' +LHUDUFKLFDO ,QWHUIDFH 'HFRPSRVLWLRQ  >@ DUH DSSOLHG /DUJHVFDOH LOO FRQGLWLRQHGPDWULFHVZLWKKHWHURJHQHRXVPDWHULDOSURSHUWLHV GHULYHG IURP WKH +HWHUR' FRGH ZHUH VROYHG XVLQJ XS WR  QRGHV  FRUHV  RI WKH )XMLWVX 35,0(+3& ); Oakleaf-FX  VXSHUFRPSXWHU DW WKH ,QIRUPDWLRQ 7HFKQRORJ\ &HQWHU 8QLYHUVLW\ RI 7RN\R >@ )LQDOO\ WKH HIILFLHQF\DQGUREXVWQHVVRISUHFRQGLWLRQHGSDUDOOHOLWHUDWLYH VROYHUV EDVHG RQ WKH GRPDLQ GHFRPSRVLWLRQ IRU LOO FRQGLWLRQHGSUREOHPVDUHHYDOXDWHG 7KHUHVWRIWKLVSDSHULVRUJDQL]HGDVIROORZV,Q6HFWLRQ  ZH RXWOLQH WKH WDUJHW DSSOLFDWLRQ DQG SUHFRQGLWLRQHG LWHUDWLYH VROYHUV ,Q 6HFWLRQ  DQ RYHUYLHZ RI WKH WDUJHW KDUGZDUHLVSURYLGHG,Q6HFWLRQVDQGWKHUHVXOWVRIWKH FRPSXWDWLRQV DUH GHVFULEHG ZKLOH UHODWHG ZRUN DQG ILQDO UHPDUNVDUHRIIHUHGLQ6HFWLRQVDQG

D

$

$¶

'URSSLQJ &RPSRQHQWV _$LM_d /RFDWLRQ

,QLWLDO 0DWUL[

'URSSHG 0DWUL[

,/8p )DFWRUL]DWLRQ

,/87 ¶ ,/87p,d.t

F

E

,/8 ¶

'URSSLQJ &RPSRQHQWV ,/8 _0LM_t /RFDWLRQ )DFWRUL]DWLRQ

)LJXUH  3UHFRQGLWLRQLQJ LQ WKH ,/87p,d,t  PHWKRG p OHYHO RI ILOO LQ¶V d GURSSLQJ WROHUDQFH EHIRUH IDFWRUL]DWLRQ t GURSSLQJ WROHUDQFH DIWHUIDFWRUL]DWLRQ

 7DUJHW$SSOLFDWLRQDQG/LQHDU6ROYHU  +HWHUR' 7KH +HWHUR' FRGH VROYHV OLQHDU HODVWLFLW\ SUREOHPV LQ PHGLD ZLWK VLPSOH FXEH JHRPHWULHV DQG KHWHURJHQHRXVPDWHULDOSURSHUWLHV)LJD XVLQJSDUDOOHO)(07KLVW\SHRIKHWHURJHQHRXVSUREOHP DULVHV RIWHQ LQ JHRSK\VLFV DSSOLFDWLRQV >@ 7ULOLQHDU KH[DKHGUDO FXELF  HOHPHQWV DUH XVHG IRU WKH GLVFUHWL]DWLRQDQGDKHWHURJHQHRXVGLVWULEXWLRQRI@7KHERXQGDU\FRQGLWLRQVDUH GHVFULEHGLQ)LJE   ] D E  8QLIRUP'LVWULEXWHG)RUFHLQ 

       

]GLUHFWLRQ#] =PD[ 8\ #\ @ DQGWKH*HR)(0ORFDOGDWDVWUXFWXUHLVDSSOLHG+HWHUR'JHQHUDWHVSDUDOOHOGLVWULEXWHGORFDOPHVKHV DQGFRHIILFLHQWPDWULFHVLQDSDUDOOHOPDQQHUXVLQJ03,,Q+HWHUR'WKHWRWDOQXPEHURIYHUWLFHVLQ HDFK GLUHFWLRQ Nx, Ny, Nz  DQG WKH QXPEHU RI SDUWLWLRQV LQ HDFK GLUHFWLRQ Px, Py, Pz  DUH VSHFLILHG EHIRUHFRPSXWDWLRQ7KHQXPEHURIWRWDO03,SURFHVVHVLVHTXDOWRPx uPy uPzDQGHDFK03,SURFHVV KDV NxPx  u NyPy  u NzPz  YHUWLFHV 7KH VSDWLDO GLVWULEXWLRQ RI @7KLVEORFNZLVHPDQQHULVHIILFLHQWIRUSHUIRUPLQJPDWUL[RSHUDWLRQVLQ +HWHUR' ,/87p,d,t  SUHFRQGLWLRQLQJ LV DOVR GRQH LQ WKLV EORFNZLVH PDQQHU WKHUHIRUH WKH ,/87p,d,t PHWKRGLVFDOOHG%,/87p,d,t %ORFN,/87 %,/87p,d,t SUHFRQGLWLRQLQJVKRZQLQ)LJ LVDSSOLHGWRHDFKORFDOPDWUL[IRUHDFK03,SURFHVV,Q%,/87p,d,t GURSSLQJRSHUDWLRQVIRUdDQG tDUHGRQHEDVHGRQWKHODUJHVWDEVROXWHYDOXHRIWKHFRPSRQHQWVLQHDFKuEORFNRIWKHPDWULFHV ,W LV ZLGHO\ NQRZQ WKDW WKH FRQYHUJHQFH RI SDUDOOHO SUHFRQGLWLRQHG LWHUDWLYH VROYHUV LV VWURQJO\ DIIHFWHG E\ PHWKRGV IRU GRPDLQ GHFRPSRVLWLRQ HVSHFLDOO\ IRU LOOFRQGLWLRQHG SUREOHPV >@ ,Q WKH SUHVHQW ZRUNWZRW\SHV RI GRPDLQGHFRPSRVLWLRQ PHWKRGV/%-/RFDOL]HG%ORFN-DFREL  >@DQG +,'+LHUDUFKLFDO,QWHUIDFH'HFRPSRVLWLRQ >@DUHDSSOLHG

 /RFDOL]HG%ORFN-DFREL/%-  ,Q WKH SUHVHQW ZRUN WKH GLVWULEXWHG ORFDO GDWD VWUXFWXUH IRU SDUDOOHO )(0 LV EDVHG RQ WKDW RI WKH *HR)(0>@9HUWLFHVQRGHV LQHDFKORFDO PHVK LQWKH*HR)(0GDWDVWUXFWXUHDUHFODVVLILHG LQWR WKHIROORZLQJWKUHHFDWHJRULHVIURPWKHYLHZSRLQWRIPHVVDJHSDVVLQJ)LJD >@  x ,QWHUQDOQRGHVRULJLQDOO\DVVLJQHGWRWKH03,SURFHVVSDUWLWLRQ  x ([WHUQDOQRGHVIRUPLQJDQHOHPHQWLQWKHSDUWLWLRQEXWDUHIURPH[WHUQDOSDUWLWLRQV  x %RXQGDU\QRGHVH[WHUQDOQRGHVRIRWKHUSDUWLWLRQV  



1637

Parallel

Iterative Solvers for Ill-conditioned Problems ...

K. Nakajima

(DFK RI 3(3( GHQRWHV HDFK 03, SURFHVV DQG HDFK QXPEHU FRUUHVSRQGV WR ORFDO YHUWH[ ,' RQ HDFK03,SURFHVVSDUWLWLRQ LQ)LJD  /%-EDVHG SUHFRQGLWLRQHUV DUH ZLGHO\ XVHG IRU SDUDOOHO LWHUDWLYH VROYHUV 7KH\ SURYLGH H[FHOOHQW SDUDOOHO SHUIRUPDQFH IRU ZHOOGHILQHG SUREOHPV EXW WKH\ DUH QRWUREXVW IRU LOOFRQGLWLRQHG SUREOHPV ZLWKPDQ\SURFHVVRUVEHFDXVHWKH\LJQRUHWKHJOREDOHIIHFWRIH[WHUQDOQRGHVLQRWKHUSDUWLWLRQV7KH JHQHUDOO\XVHGUHPHG\LVDQH[WHQVLRQRIWKHRYHUODSSLQJHOHPHQWVEHWZHHQ03,SDUWLWLRQV>@)LJ E  ,Q WKH SUHVHQW ZRUN YDULRXV FRQILJXUDWLRQV RI WKLFNQHVV IRU WKH RYHUODSSLQJ ]RQHV EHWZHHQ GLVWULEXWHG ORFDO PHVKHV IRU SDUDOOHO )(0 DUH HYDOXDWHG IRU /%- ZKHUH /%-x PHDQV /%- ZLWK x OD\HUVRIRYHUODSSLQJHOHPHQWV ,W LV ZLGHO\ NQRZQ WKDW WKH UHRUGHULQJ RI YHUWLFHV VWURQJO\ DIIHFWV WKH FRQYHUJHQFH RI LWHUDWLYH VROYHUVZLWK,/8W\SHSUHFRQGLWLRQHUV>@ ,Q>@5&0HQWLUHQXPEHULQJZDVLQWURGXFHGZKHUHERWKWKHLQWHUQDODQGH[WHUQDOQRGHVLQHDFK SDUWLWLRQ DUH UHRUGHUHG DFFRUGLQJ WR WKH 5HYHUVH &XWKLOO0FNHH5&0  PHWKRG >@ ,W PD\ EH QRWHG WKDWERWKWKHEDQGZLGWKRIORFDOFRHIILFLHQWPDWULFHVDQGWKHQXPEHURIILOOLQ¶VRIIDFWRUL]HGPDWULFHV DUH VPDOOHU WKDQ WKDW RI PDWULFHV GHULYHG IURP RULJLQDO LQWHUQDOH[WHUQDO QXPEHULQJ >@ ,Q WKH SUHVHQWZRUN5&0HQWLUHQXPEHULQJLVDSSOLHG  D E 3(  3(                                                     䖃䠖,QWHUQDO1RGHV䠈䖃䠖([WHUQDO1RGHV         䕔䠖2YHUODSSHG(OHPHQWV 3( 3(  )LJXUH/RFDOGDWDVWUXFWXUHIRUSDUDOOHO)(0ZLWKH[WHQVLRQRIGHSWKRIRYHUODSSLQJ>@D GLVWULEXWHGORFDO GDWDVWUXFWXUHLQWKH*HR)(0>@HDFKRI3(3(GHQRWHVHDFK03,SURFHVVHDFKQXPEHUFRUUHVSRQGV WRORFDOYHUWH[,'RQHDFK03,SURFHVVSDUWLWLRQ E H[WHQVLRQRIGHSWKRIRYHUODSSLQJ>@

 +LHUDUFKLFDO,QWHUIDFH'HFRPSRVLWLRQ+,'  +,' >@ SURYLGHV D PHWKRG IRU GRPDLQ GHFRPSRVLWLRQ WKDW LV UREXVW DQG VFDODEOH IRU SDUDOOHO SUHFRQGLWLRQHUVEDVHGRQWKH,/8DQG,&,QFRPSOHWH&KROHVN\ IDFWRUL]DWLRQVDQGLWLVH[SHFWHGWREH PRUHUREXVWWKDQ/%-EDVHGRQHV 7KH +,' SURFHVV VWDUWV ZLWK D SDUWLWLRQLQJ RI WKH JUDSK LQWR VXEJUDSKV ZKHUH WKHUH LV QR RYHUODSSLQJ EHWZHHQ VXEJUDSKV 7KHVH VXEJUDSKV DUH FDOOHG connectors with level-1 &  %HFDXVH HDFK&FRQQHFWRUFRUUHVSRQGVWRDSDUWLWLRQLQSDUDOOHOFRPSXWDWLRQVZLWKGRPDLQGHFRPSRVLWLRQ& FRQQHFWRUVDUHFDOOHGsub-domains7KHlevelsDUHGHILQHGUHFXUVLYHO\IURPWKLVSDUWLWLRQLQJZLWKHDFK OHYHOFRQVLVWLQJRIDVHWRIYHUWH[JURXSV(DFKYHUWH[JURXSRIDJLYHQOHYHOLVDVHSDUDWRUIRUYHUWH[ JURXSV RI D ORZHU OHYHO ,Q >@ WKH FRQFHSWV RI FRQQHFWRUV RI GLIIHUHQW OHYHOV &N  DUH LQWURGXFHG ZKHUH&NFRQQHFWRUVDUHDGMDFHQWWRNVXEGRPDLQV)LJXUHD VKRZVWKHH[DPSOHRIWKHSDUWLWLRQRI WKHWZRGLPHQVLRQDOJULGEDVHGRQDSRLQWVWHQFLOLQWRSDUWLWLRQVVXEGRPDLQV 7KHQXPEHUVLQ )LJD  DQG )LJE  GHQRWH ,'¶V RI sub-domain’s & FRQQHFWRUV  DGMDFHQW WR HDFK FRQQHFWRU &N DW HDFK OHYHO 1RWH WKDW GLIIHUHQW FRQQHFWRUV RI WKH VDPH OHYHO DUH QRW FRQQHFWHG GLUHFWO\ EXW DUH VHSDUDWHG E\ FRQQHFWRUV RI KLJKHU OHYHOV ,I WKH XQNQRZQV DUH UHRUGHUHG DFFRUGLQJ WR WKHLU OHYHO QXPEHUVIURPWKHORZHVW WR KLJKHVW WKHEORFN VWUXFWXUHRI WKHUHRUGHUHG PDWUL[ LVDV VKRZQ LQ)LJ E 7KLVEORFN VWUXFWXUHOHDGVWR DQDWXUDO SDUDOOHOLVP LI ,/8,&IDFWRUL]DWLRQ RU IRUZDUGEDFNZDUG VXEVWLWXWLRQ SURFHVVHV DUH DSSOLHG 'HWDLOV RI DOJRULWKPV IRU WKH FRQVWUXFWLRQ RI LQGHSHQGHQW 1638 

Parallel Iterative Solvers for Ill-conditioned Problems ...

K. Nakajima

FRQQHFWRUVDUHSURYLGHGLQ>@7KXV+,'EDVHG,/8,&W\SHSUHFRQGLWLRQHUVFDQFRQVLGHUWKHJOREDO HIIHFW LQSDUDOOHOFRPSXWDWLRQVDQGDUHH[SHFWHGWREH PRUHUREXVWWKDQ/%-EDVHGRQHV,Q>@WKH RULJLQDOSDUWLWLRQHUIRUWKH*HR)(0IRUGRPDLQGHFRPSRVLWLRQZDVPRGLILHGVRWKDWLWFRXOGFUHDWHD GLVWULEXWHG KLHUDUFKLFDO GDWD VWUXFWXUH IRU +,' *OREDO FRPPXQLFDWLRQV XVLQJ KLHUDUFKLFDO FRPPXQLFDWLRQWDEOHVIRU+,'SURFHGXUHVRFFXUDWWKHHQGRIWKHFRPSXWDWLRQDWHDFKOHYHO+,'LV PRUHH[SHQVLYHWKDQ/%-GXHWRWKHVHDGGLWLRQDOFRPPXQLFDWLRQV$OWKRXJKWKHDXWKRUH[WHQGHG+,' IRUUREXVWQHVVXVLQJWKLFNHUVHSDUDWRUVLQ>@RULJLQDOLPSOHPHQWDWLRQRI+,'LQ>@LVDSSOLHGLQWKLV VWXG\  D E        

          





















 













 













 



































/HYHO

     

/HYHO OHYHO䖃 OHYHO䖃 OHYHO䕿

 

/HYHO

 

)LJXUH'RPDLQEORFNGHFRPSRVLWLRQRIWKHPDWUL[DFFRUGLQJWRWKH+,'UHRUGHULQJHDFKQXPEHUGHQRWHV,' RIHDFKsub-domain&FRQQHFWRU DGMDFHQWWRHDFKFRQQHFWRU&NDWHDFKOHYHO D GRPDLQGHFRPSRVLWLRQconnectorsDQGkeys E VWUXFWXUHRIGRPDLQEORFNPDWUL[

 +DUGZDUH(QYLURQPHQW 7KH Fujitsu FX10 V\VWHP DW WKH 8QLYHUVLW\ RI 7RN\R Oakleaf-FX  >@ LV D )XMLWVX 35,0(+3& ); PDVVLYHO\ SDUDOOHO VXSHUFRPSXWHU ZLWK D SHDN SHUIRUPDQFH RI  3)/236 2DNOHDI); FRQVLVWVRIFRPSXWLQJ QRGHV RI63$5&Œ,;I[ SURFHVVRUVZLWKVL[WHHQ FRUHV*+]  ZLWK*%RIPHPRU\SHUQRGHDQGLWVSHDNSHUIRUPDQFHLV*)/236>@7KHHQWLUHV\VWHP FRQVLVWVRIFRUHVDQG7%PHPRU\(DFKFRUHKDVD.%/LQVWUXFWLRQGDWDFDFKH$ 0% / FDFKH LV VKDUHG E\ VL[WHHQ FRUHV RQ HDFK QRGH 1RGHV DUH FRQQHFWHG YLD D GLPHQVLRQDO PHVKWRUXVLQWHUFRQQHFWFDOOHGTofu

 3UHOLPLQDU\5HVXOWV ,QWKLVVHFWLRQDSUHOLPLQDU\VWXG\ZDVFRQGXFWHGWRGHWHUPLQHWKHDSSURSULDWHFRQILJXUDWLRQVIRU WKHIROORZLQJLVVXHV  x 2SWLPXPYDOXHRIdLQ%,/87p,d,t GURSSLQJWROHUDQFHRI%,/87p,d,t EHIRUHIDFWRUL]DWLRQ x 2SWLPXP YDOXHRIxLQ/%-xWKLFNQHVV RIRYHUODSSLQJ ]RQHV EHWZHHQ GLVWULEXWHG ORFDO PHVKHV IRUSDUDOOHO)(0  7KHWDUJHWSUREOHPLVD'OLQHDUHODVWLFSUREOHPZLWKuuYHUWLFHV uYHUWLFHV HOHPHQWVu'2) QRGHVFRUHV RIWKH2DNOHDI);V\VWHPZHUHXVHG



1639

Parallel

Iterative Solvers for Ill-conditioned Problems ...

K. Nakajima

 (IIHFWRIdDQGtLQWKH%,/87p,d,t PHWKRG )LUVW RI DOO WKH HIIHFW RI SDUDPHWHUV d DQG t LQ %,/87p,d,t +,' ZDV HYDOXDWHG LQ D ' OLQHDU HODVWLFSUREOHP7KHPLQLPXPDQGPD[LPXPYDOXHVRI0@´LQ)LJVD DQGE UHIHUVWRWKHWRWDO QXPEHURIQRQ]HURFRPSRQHQWV11= LQWKHIDFWRUL]HGPDWULFHVIRUWKH%,/87p,d,t >0@ PHWKRG ³,WHUDWLRQV´PHDQVWKHQXPEHURILWHUDWLRQVXQWLOFRQYHUJHQFHZKLOH³6ROYHU7LPH´PHDQVWKHHODSVHG FRPSXWDWLRQ WLPH IRU WKH OLQHDU VROYHU ZKHUH WKH WLPH IRU IDFWRUL]DWLRQ DQG GURSSLQJ VHWXS  LV QRW LQFOXGHG,Q)LJD dLVIL[HGDVtLVYDULHGIURPWRuDQGWKHUHVXOWVDUHQRUPDOL]HG E\WKRVHRIWKH%,/87 +,'*HQHUDOO\VSHDNLQJNNZGHFUHDVHVDQGWKHQXPEHURILWHUDWLRQV XQWLO FRQYHUJHQFH LQFUHDVHV LI d LQFUHDVHV %HFDXVH 11= FRUUHVSRQGV WR WKH FRPSXWDWLRQDO FRVW IRU HDFKLWHUDWLRQWKHSURGXFWRI11=DQGWKHQXPEHURILWHUDWLRQVZLOOEHWKHWLPHIRUFRPSXWDWLRQ,Q WKLVFDVHt uSURYLGHVWKHEHVWHIILFLHQF\IURPWKHYLHZSRLQWRIWRWDOFRPSXWDWLRQWLPH,It LV RSWLPXP WKH HODSVHG FRPSXWDWLRQ WLPH IRU WKH OLQHDU VROYHU RI WKH %,/87u +,' LV RQO\  DV ODUJH DV WKDW RI WKH %,/87 +,' ZLWKRXW GURSSLQJ ,Q )LJ E  t LV IL[HG DW WKH RSWLPXPYDOXHIURP)LJD t u dLVFKDQJHGIURPWRuDQGWKHUHVXOWVDUH QRUPDOL]HGE\WKRVHRIWKH%,/87u +,'7KHHIIHFWRIdLVYHU\VPDOOLIdLVOHVVWKDQ uDQGFRQYHUJHQFHJHWVVLJQLILFDQWO\ZRUVHLIdLVODUJHUWKDQuZKHUHWKHLPSRUWDQW IHDWXUHVRIWKHRULJLQDOPDWULFHVDUHORVW 7KHVH UHVXOWV VKRZ WKDW LQWURGXFLQJ WKH WKUHVKROG SDUDPHWHU d LV QRW HIIHFWLYH IRU LPSURYLQJ WKH FRQYHUJHQFH RI WKH %,/87p,d,t +,'*3%L&* WKHUHIRUH ZH IL[ d DW  LQ WKH SUHVHQW ZRUN ,Q FRQWUDVWWKHFRQWULEXWLRQRIGURSSLQJDIWHUIDFWRUL]DWLRQRQLPSURYHPHQWLVYHU\ODUJH7KHRSWLPXP YDOXHRItYDULHVDFFRUGLQJWRWKHIHDWXUHVRIWKHSUREOHPEHLQJFRQVLGHUHGWKHFRQGLWLRQQXPEHUWKH VL]HRIWKHSUREOHPVDQGPDQ\RWKHUIDFWRUV:HZLOOLQYHVWLJDWHWKHHIIHFWRItLQWKHQH[WVHFWLRQLQ PRUHGHWDLOV 

5DWLR

5DWLR

 D E  11=RI>0@   ,WHUDWLRQV   6ROYHU7LPH                ( ( (  (  W%,/87W +,'



11=RI>0@  

,WHUDWLRQV 6ROYHU7LPH

     (

(

(

(

(

G%,/87GH +,'

)LJXUH(IIHFWRIdDQGtRQWKHFRQYHUJHQFHDQGHIILFLHQF\RIWKH%,/87d,t +,'*3%L&*ZLWKQRGHV FRUHV RIWKH2DNOHDI);Emax Emax 11=RI>0@7KHWRWDOQXPEHURIQRQ]HURFRPSRQHQWV 11= LQWKHIDFWRUL]HGPDWULFHVIRU%,/87p,d,t >0@ D %,/87t +,'UHVXOWVDUHQRUPDOL]HGE\WKRVHRI %,/87 +,'E %,/87du +,'QRUPDOL]HGE\%,/87u +,'

1640 

Parallel Iterative Solvers for Ill-conditioned Problems ...

K. Nakajima

 (IIHFWRIWKLFNQHVVRIRYHUODSSLQJ]RQHV 1H[WWKHHIIHFWRIWKHWKLFNQHVVRIWKHRYHUODSSLQJ]RQHVEHWZHHQGLVWULEXWHGORFDOPHVKHVIRUWKH SDUDOOHO )(0 LV HYDOXDWHG IRU /%- ZKHUH /%-x PHDQV /%- ZLWK x OD\HUV RI RYHUODSSLQJ HOHPHQWV 7KH PLQLPXP DQG PD[LPXP YDOXHV RI @DUHSURSRVHGDQG HYDOXDWHG

 6XPPDU\ 7KH HIILFLHQF\ DQG UREXVWQHVV RI SUHFRQGLWLRQHG SDUDOOHO LWHUDWLYH VROYHUV EDVHG RQ GRPDLQ GHFRPSRVLWLRQIRULOOFRQGLWLRQHGSUREOHPVZLWKKHWHURJHQHRXVPDWHULDOSURSHUWLHVZHUHHYDOXDWHGLQ WKHSUHVHQWZRUN7KLVW\SHRISUREOHPKDVQXPHURXVDSSOLFDWLRQVLQJHRSK\VLFV7KHSUHFRQGLWLRQLQJ PHWKRGZDVEDVHGRQWKH%,/87p,d,t PHWKRGSURSRVHGE\WKHDXWKRULQDSUHYLRXVZRUNDQGWZR W\SHV RI GRPDLQ GHFRPSRVLWLRQ SURFHGXUHV /%- /RFDOL]HG %ORFN -DFREL  DQG +,' +LHUDUFKLFDO ,QWHUIDFH 'HFRPSRVLWLRQ  ZHUH FRQVLGHUHG 7KH SURSRVHG PHWKRGV ZHUH DSSOLHG WR +HWHUR' FRGH ZKLFK LV D SDUDOOHO ILQLWHHOHPHQW EHQFKPDUN SURJUDP IRU VROLG PHFKDQLFV SUREOHPV DQG WKH FRGH SURYLGHG H[FHOOHQW VFDODELOLW\ DQG UREXVWQHVV IRU XS WR  QRGHV  FRUHV  RI WKH )XMLWVX 35,0(+3& ); 2DNOHDI);  DW WKH ,QIRUPDWLRQ 7HFKQRORJ\ &HQWHU WKH 8QLYHUVLW\ RI 7RN\R *HQHUDOO\ +,' SURYLGHG EHWWHU HIILFLHQF\ DQG UREXVWQHVV WKDQ /%- IRU D ZLGH UDQJH RI SDUDPHWHU YDOXHV *HQHUDOO\,/87p,d,t ZLWK+,'SURYLGHGHIILFLHQWDQGUREXVWFRQYHUJHQFH%HFDXVHRQO\DVLQJOH DSSOLFDWLRQZDVHYDOXDWHGKHUHWKHSURSRVHGPHWKRGVKRXOGEHDSSOLHGWRRWKHUDSSOLFDWLRQVLQIXWXUH VWXGLHV 0RUHRYHU WKH SURSRVHG PHWKRGV VKRXOG EH HYDOXDWHG RQ YDULRXV W\SHV RI VXSHUFRPSXWHU V\VWHPVDOWKRXJKRQO\WKH)XMLWVX35,0(+3&);V\VWHPKDVEHHQDSSOLHGLQWKLVVWXG\%DODQFH DPRQJ YDULRXV W\SHV RI KDUGZDUH SDUDPHWHUV LQ VXSHUFRPSXWHU V\VWHPV VXFK DV &38 SHUIRUPDQFH PHPRU\ EDQGZLGWK DQG QHWZRUN SHUIRUPDQFH LV LPSRUWDQW EHFDXVH LW PD\ DIIHFW WKH HIILFLHQF\ LQ SDUDOOHOFRPSXWDWLRQZLWKODUJHQXPEHURIFRPSXWLQJQRGHV9DULRXVW\SHVRIDSSOLFDWLRQVZLWKZLGH UDQJHRISUREOHPVL]HVVKRXOGEHHYDOXDWHGRQYDULRXVW\SHVRIVXSHUFRPSXWHUV\VWHPV $OWKRXJK WKH HIIHFW RI LQWURGXFLQJ DGGLWLRQDO SDUDPHWHUV ZDV HYDOXDWHG LQ WKH SUHVHQW ZRUN RSWLPL]LQJ WKH SDUDPHWHU VHOHFWLRQ LV DOVR LPSRUWDQW DV LW ZLOO LPSURYH WKH HIILFLHQF\ LQ D UDQJH RI VFLHQWLILF FRPSXWLQJ DSSOLFDWLRQV &XUUHQWO\ WKHUH KDYH EHHQ QR SUDFWLFDO VWXGLHV LQ WKLV DUHD IRU SDUDOOHO FRPSXWLQJ DOWKRXJK WKHUH KDYH EHHQ VRPH IRU VHULDO FRPSXWLQJ VXFK DV >@  $V VKRZQ LQ WKH YHU\ XQLTXH EHKDYLRU RI %,/87î /%- LQ )LJ E  LW LV JHQHUDOO\ YHU\ GLIILFXOWWRHVWLPDWHDQGXQGHUVWDQGWKHEHKDYLRURIWKHFRQYHUJHQFHRISDUDOOHOSUHFRQGLWLRQHUVIRULOO FRQGLWLRQHGSUREOHPV2QHSRVVLEOHFULWHULRQLVWKHFRQGLWLRQQXPEHURIWKHPDWUL[EXWWKHFDOFXODWLRQ LV JHQHUDOO\ H[SHQVLYH IRU ODUJHVFDOH DQG GLVWULEXWHG  VSDUVH PDWULFHV ([WHQVLRQ RI WKH PHWKRGV GHVFULEHGLQ>@WRSDUDOOHOFRPSXWDWLRQLVDSULRULW\IRUIXWXUHZRUN $OWKRXJK WKH DXWKRU GHYHORSHG DQ H[WHQGHG YHUVLRQ RI +,' >@ RQO\ WKH RULJLQDO +,' ZDV HYDOXDWHGLQWKHSUHVHQWZRUN,PSOHPHQWDWLRQRIWKHH[WHQGHG+,'LQ+HWHUR'DQGRWKHUJHRSK\VLFV DSSOLFDWLRQV LV DOVR DQ LPSRUWDQW DUHD IRU IXWXUH ZRUN ,PSOHPHQWDWLRQ RI GLUHFW OLQHDU VROYHUV DV D ORFDOSUHFRQGLWLRQHURQHDFK03,SURFHVVLVDOVRFRQVLGHUHG)LQDOO\DQ2SHQ0303,K\EULGYHUVLRQ RI WKH SUHFRQGLWLRQHG LWHUDWLYH VROYHU LV QRZ XQGHU GHYHORSPHQW DQG WKDW ZLOO EH DSSOLHG WR PXOWLFRUHPDQ\FRUHFOXVWHUVLQWKHQHDUIXWXUH

1644 

Parallel Iterative Solvers for Ill-conditioned Problems ...

K. Nakajima

$FNQRZOHGJHPHQWV 7KLVZRUNLVVXSSRUWHGE\WKH&RUH5HVHDUFKIRU(YROXWLRQDO6FLHQFHDQG7HFKQRORJ\&5(67 WKH -DSDQ 6FLHQFH DQG 7HFKQRORJ\ $JHQF\ -67 -DSDQ DQG E\ WKH *HUPDQ 3ULRULW\ 3URJUDPPH  6RIWZDUHIRU([DVFDOH&RPSXWLQJ633(;$,, 

5HIHUHQFHV >@ 6DDG@ 6DDG@ 1DNDMLPD . 3DUDOOHO 0XOWLVWDJH 3UHFRQGLWLRQHUV E\ ([WHQGHG +LHUDUFKLFDO ,QWHUIDFH 'HFRPSRVLWLRQ IRU ,OO&RQGLWLRQHG 3UREOHPV $GYDQFHV LQ 3DUDOOHO &RPSXWLQJ9RO )URP 0XOWLFRUHVDQG*38¶VWR3HWDVFDOH,26SUHVV >@ 1DNDMLPD . 3DUDOOHO 3UHFRQGLWLRQLQJ 0HWKRGV IRU ,WHUDWLYH 6ROYHUV %DVHG RQ %,/87p,d,t  +3& LQ $VLD 3RVWHU 6HVVLRQ ,QWHUQDWLRQDO 6XSHUFRPSXWLQJ &RQIHUHQFH ,6&¶  /HLS]LJ *HUPDQ\ >@ 08036 D 08OWLIURQWDO 0DVVLYHO\ 3DUDOOHO VSDUVH GLUHFW 6ROYHU  KWWSPXPSVHQVHHLKWIU DFFHVVHGRQ$SULO  >@ 6XSHU/8KWWSFUGOHJDF\OEOJRYa[LDR\H6XSHU/8DFFHVVHGRQ$SULO  >@ ,QIRUPDWLRQ 7HFKQRORJ\ &HQWHU 7KH 8QLYHUVLW\ RI 7RN\R KWWSZZZFFXWRN\RDFMS DFFHVVHGRQ$SULO  >@ 1DNDMLPD . 6WUDWHJLHV IRU 3UHFRQGLWLRQLQJ 0HWKRGV RI 3DUDOOHO ,WHUDWLYH 6ROYHUV LQ )LQLWH (OHPHQW $SSOLFDWLRQV RQ *HRSK\VLFV $GYDQFHV LQ *HRFRPSXWLQJ /HFWXUH 1RWHV LQ (DUWK 6FLHQFH >@ 'HXWVFK &9 DQG -RXUQHO $* *6/,% *HRVWDWLVWLFDO 6RIWZDUH /LEUDU\ DQG 8VHU¶V *XLGH 6HFRQG(GLWLRQ2[IRUG8QLY3UHVV >@ *HR)(0KWWSJHRIHPWRN\RULVWRUMSDFFHVVHGRQ$SULO  >@ =KDQJ 6/ *3%L&* *HQHUDOL]HG 3URGXFWW\SH PHWKRGV EDVHG RQ %L&* IRU VROYLQJ QRQV\PPHWULFOLQHDUV\VWHPV6,$0-RXUQDORI6FLHQWLILF&RPSXWLQJ >@ +HQRQ3DQG6DDG@ *XSWD $ DQG *HRUJH 7 $GDSWLYH 7HFKQLTXHV IRU ,PSURYLQJ WKH 3HUIRUPDQFH RI ,QFRPSOHWH )DFWRUL]DWLRQ3UHFRQGLWLRQLQJ6,$0-RXUQDORQ6FLHQWLILF&RPSXWLQJ >@ =KDQJ