An Autostereoscopic Display System for Image-Guided Surgery Using ...

$Q$XWRVWHUHRVFRSLF'LVSOD\6\VWHPIRU ,PDJH*XLGHG6XUJHU\8VLQJ+LJK4XDOLW\,QWHJUDO 9LGHRJUDSK\ZLWK+LJK3HUIRUPDQFH&RPSXWLQJ +RQJHQ/LDR1REXKLNR+DWD0DNRWR,ZDKDUD,FKLUR6DNXPDDQG 7DNH\RVKL'RKL 

*UDGXDWH6FKRRORI,QIRUPDWLRQ6FLHQFHDQG7HFKQRORJ\7KH8QLYHUVLW\RI7RN\R ^OLDRQRE\LZDKDUD`#DWUHWXWRN\RDFMS  *UDGXDWH6FKRRORI)URQWLHU6FLHQFHV7KH8QLYHUVLW\RI7RN\R ^VDNXPDGRKL`#PLNLSHXWRN\RDFMS $EVWUDFW7KLVSDSHUSUHVHQWVDKLJKTXDOLW\JODVVOHVVDXWRVWHUHRVFRSLFGLVSOD\ V\VWHP WKDW LV LQWHJUDWHG LQWR LPDJHJXLGHG VXUJHU\ 7KH JODVVOHVV DXWRVWHUHRVFRSLF LPDJH ZDV FUHDWHG E\ HPSOR\LQJ D PRGLILFDWLRQ RI ,QWHJUDO 9LGHRJUDSK\,9 ZKLFKLVDQDQLPDWHGH[WHQVLRQRI,QWHJUDO3KRWRJUDSK\,9 UHFRUGV DQG UHSURGXFHV ' LPDJHV XVLQJ D PLFUR FRQYH[ OHQV DUUD\ DQG SODW GLVSOD\ZKLFKFDQGLVSOD\JHRPHWULFDOO\DFFXUDWH'DXWRVWHUHRVFRSLFLPDJHV DQG UHSURGXFH PRWLRQ SDUDOOD[ ZLWKRXW DQ\ QHHG IRU VSHFLDO YLHZLQJ GHYLFHV 7KLVSDSHUUHSRUWVWKHXVHRIKLJKUHVROXWLRQ,9GLVSOD\DQGKLJKSHUIRUPDQFH FRPSXWLQJIRUSURGXFLQJPHGLFDO'LPDJH:HHYDOXDWHWKHIHDVLELOLW\RIWKLV GLVSOD\E\XVLQJDVHWRIPHGLFDOLPDJHZLWKVHJPHQWDWLRQDQGUHSURGXFLQJ' &7 DQG 05, DXWRVWHUHRVFRSLF LPDJH IRU VXUJLFDO SODQQLQJ DQG LQWUDRSHUDWLYH JXLGDQFH7KHPDLQFRQWULEXWLRQRIWKLVSDSHULVDSSOLFDWLRQDQGPRGLILFDWLRQRI PHGLFDO ' GLVSOD\ WHFKQLTXH RULJLQDOO\ GHYHORSHG LQ KLJKUHVROXWLRQ DXWRVWHUHRVFRSLFGLVSOD\DQGKLJKSHUIRUPDQFHFRPSXWLQJ

,QWURGXFWLRQ ,PDJHJXLGHGVXUJHU\KDVEHHQHYROYHGE\LQFRUSRUDWLQJDGYDQFHGWHFKQRORJ\IURP PHGLFDO LPDJLQJ FRPSXWHU VFLHQFH VHQVRU HQJLQHHULQJ DQG URERWLFV >@ 7KH REMHFWLYHRIWKHLPDJHJXLGHGVXUJHU\LVWRHQKDQFHWKHVXUJHRQ VFDSDELOLW\WRXWLOL]H PHGLFDO LPDJHU\ WR GHFUHDVH WKH LQYDVLYHQHVV RI VXUJLFDO SURFHGXUHV DQG LQFUHDVH WKHLUDFFXUDF\DQGVDIHW\7KHVHV\VWHPVIRFXVHGRQVXUJLFDOJXLGDQFHWHQGWRSUHVHQW WKH VXUJHRQ ZLWK GDWD WKDW ZDV JDWKHUHG SULRU WR VXUJHU\ WUDFN VXUJLFDO LQVWUXPHQWV ZLWKLQWKHRSHUDWLQJILHOGDQGUHQGHUWKHWUDFNHGGHYLFHVDORQJZLWKWKHGDWD 6WHUHRVFRSLFWHFKQLTXHKDVEHHQWDNLQJDQLPSRUWDQWUROOLQLPDJHDVVLVWHGVXUJHU\ DQG GLDJQRVLV UHFHQWO\ ZLWK YDULRXV PRGHV RI YLVXDOL]DWLRQ RQ RIIHU >@ $PRQJ SUHYLRXVUHSRUWHGPHWKRGVXVHSRODUL]HGRUVKXWWHULQJJODVVHVRULJLQDOO\GHYHORSHGLQ DXJPHQWHGUHDOLW\GRPDLQDQGDSSOLHGLQVXUJLFDOVLPXODWLRQDQGGLDJQRVLV+RZHYHU WKHELQRFXODUVWHUHRVFRSLFGLVSOD\UHSURGXFHVWKHGHSWKRISURMHFWHGREMHFWVE\IL[HG ELQRFXODUVDQGSURGXFHVDGLVSDULW\DVWKHLPDJHVIRUOHIWDQGULJKWH\HDUHSUHSDUHG 5((OOLVDQG703HWHUV(GV 0,&&$,/1&6SS± ‹6SULQJHU9HUODJ%HUOLQ+HLGHOEHUJ

+/LDRHWDO

VHSDUDWHO\7KHUHIRUHDVLVGLVFXVVHGLQ>@WKLVLVDOZD\VSRWHQWLDOLQFRQVLVWHQFLHVRI GHSWK SHUFHSWLRQ DPRQJ YLHZHUV ,Q WKH FDVH RI WKLV NLQG RI VWHUHRVFRSLF GLVSOD\V WKH\ FDQ REVHUYH SUHIL[HG ' LPDJHV ZKLFK FUHDWH TXDVL ' LPDJHV ZLWK GLVWRUWLRQ 6XEMHFWLYHO\ WKH\ SHUFHLYH LW DV ' EXW WKHUH PD\ EH VLJQLILFDQW LQDFFXUDFLHV LQ UHJLVWUDWLRQ 0RWLRQ SDUDOOD[ DQ DOWHUQDWLYH VWHUHRVFRSLF YLVLRQ FDQQRWEHUHSURGXFHGZLWKRXWZHDULQJDWUDFNLQJGHYLFH 2XUSUHYLRXVUHSRUWVSURSRVHGDQDSSURDFKWRRYHUFRPHWKHVH LVVXHVRI ELQRFXODU VWHUHRVFRSLF YLVLRQ E\ XVLQJ ,QWHJUDO 9LGHRJUDSK\ ,9  ZKLFK ZDV DQ DQLPDWHG H[WHQVLRQ RI ,QWHJUDO 3KRWRJUDSK\ ,3  >@ ,9 SURMHFWV D FRPSXWHUJHQHUDWHG JUDSKLFDOREMHFWJHQHUDWHGE\PXOWLSOHUD\VFRPLQJWKURXJKPLFURFRQYH[OHQVDUUD\ 7KHGHWDLOHGGHVFULSWLRQRI,3DQG,9FDQEHIRXQGLQ>@:HIXUWKHUH[WHQGHGRXU ZRUN IRU VXUJLFDO DVVLVWDQFH LQ RUWKRSHGLF VXUJHU\ >@ DQG DQ LQWUDRSHUDWLYH QDYLJDWLRQLQWKHWULDOVRIFOLQLFDODSSOLFDWLRQ>@ 7KRXJKWKHDGYDQWDJHRI,9KDVEHHQSURYHQLQERWKIHDVLELOLW\VWXGLHVDQGFOLQLFDO DSSOLFDWLRQV>@LWLVQHFHVVDU\WRGHYHORSDKLJKTXDOLW\'YLVXDOL]DWLRQV\VWHP WKDW LQWHJUDWHV FDSDELOLWLHV IRU GDWD DQDO\VLV DQG RQOLQH LQWHUYHQWLRQDO JXLGDQFH LQWR WKHVHWWLQJRILQWHUYHQWLRQDOLPDJH7KHPRWLYDWLRQRIWKLVSDSHULVWRRYHUFRPHWKHVH LVVXHV E\ XVLQJ PXOWLSURMHFWLRQ DXWRVWHUHRVFRSLF ,9 GLVSOD\ ZKLFK FRPELQHG ZLWK KLJKSHUIRUPDQFHFRPSXWLQJ+3& IRUIDVWUHQGHULQJDQGGDWDDQDO\VLVVRIWZDUHIRU SUHVXUJLFDO  LQWUDRSHUDWLYH GDWD VHJPHQWDWLRQ :H HYDOXDWH WKH IHDVLELOLW\ RI WKLV GLVSOD\ E\ GHYHORSLQJ D ' &7 DQG 05, DXWRVWHUHRVFRSLF LPDJH DQG DSSO\LQJ IRU VXUJLFDOSODQQLQJDQGJXLGDQFH

0DWHULDOVDQG0HWKRGV $ VFKHPDWLF SUHVHQWDWLRQ RI WKH KLJKTXDOLW\ PXOWLSURMHFWLRQ ,9 GLVSOD\ V\VWHP LV SUHVHQWHG LQ )LJ 7KH FRPSRQHQWV RI WKH GLVSOD\ V\VWHP LQFOXGH   +LJKTXDOLW\ PXOWLSURMHFWLRQ ,9 DXWRVWHUHRVFRSLF GLVSOD\ V\VWHP   ,PDJH DQDO\VLV DQG GDWD VHJPHQWDWLRQ RI NH\ DQDWRPLFDO DQG IXQFWLRQ VWUXFWXUH   +LJK SHUIRUPDQFH FRPSXWLQJIRUSDUDOOHOUHQGHULQJLQVXUJLFDODXWRVWHUHRVFRSLFGLVSOD\ +LJK4XDOLW\,9$XWRVWHUHRVFRSLF6XUJLFDO'LVSOD\ 7KH VSDWLDO UHVROXWLRQ RI WKH ,9 DXWRVWHUHRVFRSLF LPDJH SURMHFWHG LV SURSRUWLRQDO WR WKHUDWLRRIWKHOHQVGLDPHWHULQWKHOHQVDUUD\WRWKHSL[HOSLWFKRIGLVSOD\7KXVWKH SURMHFWHG SL[HO SLWFK QHHGV WR EH PDGH PXFK VPDOOHU ,Q RXU V\VWHP PXOWLSOH SURMHFWRUV RI WKH GLVSOD\ DUH DUUDQJHG LQ GLVSOD\ DUUD\ SURGXFLQJ D KLJKUHVROXWLRQ DQG KLJKGHQVLW\ LPDJH DFURVVDUHDU SURMHFWLRQ VFUHHQ E\ XWLOL]LQJ ORQJ ]RRPV OHQV SURMHFWLRQWHFKQLTXH ,Q WKLV FDVH DQ LPSRUWDQW LVVXH LV WKH FRRUGLQDWLRQ RI PXOWLSOH FRPPRGLW\ SURMHFWRUV WR DFKLHYH VHDPOHVV HGJH EOHQGLQJ DQG SUHFLVH DOLJQPHQW 6HDPOHVV HGJH EOHQGLQJ FDQ UHPRYH WKH YLVLEOH GLVFRQWLQXLWLHV EHWZHHQ DGMDFHQW SURMHFWRUV :H REWDLQ SUHFLVH DOLJQPHQW RU PLVDOLJQPHQW  LQIRUPDWLRQ ZLWK D GLJLWDO FDPHUD E\ PHDVXULQJWKHSRVLWLRQDQGFRORUIHDWXUHVRIWKHSL[HOVSURMHFWHGRQDVFUHHQDQGWKHQ IHHGEDFNWKHFDOLEUDWLRQLQIRUPDWLRQWRWKH LPDJHSURFHVVLQJKDUGZDUH WR PDNH ILQH

$Q$XWRVWHUHRVFRSLF'LVSOD\6\VWHPIRU,PDJH*XLGHG6XUJHU\

DGMXVWPHQWV RI WKH SURMHFWHG LPDJH RQ WKH VFUHHQ ,W UHTXLUHV RQO\ WKH FRDUVHVW SK\VLFDODOLJQPHQWRIWKHSURMHFWRUV 6\QFKURQLFGLVSOD\FOXVWHU

+LJKTXDOLW\PXOWLSURMHFWLRQ ,9DXWRVWHUHRVFRSLFGLVSOD\

,PDJHSURFHVVLQJ KDUGZDUH

+LJKVSHHGLPDJHUHQGHULQJ DQGSDUDOOHOGLVSOD\

$XWRVWHUHRVFRSLF ,9LPDJH

6\VWHPDUHD (WKHUQHWQHWZRUN 6HUYHUFRQVROH GDWDVWRUDJH

0HGLFDO'DWD

+LJKSHUIRUPDQFH FRPSXWHUFOXVWHU

,PDJHDQDO\VLV'DWD VHJPHQWDWLRQHWF

05,HWF

)LJ6FKHPDRIWKHKLJKTXDOLW\,9DXWRVWHUHRVFRSLFVXUJLFDOGLVSOD\

$Q8'3EDVHGQHWZRUNVRIWZDUHPHFKDQLVPV\QFKURQL]HGHDFKIUDPHRIWKHYLGHR LPDJHV 7KHYLGHRRXWSXWIURP HDFK 3& ZDV QRW GLUHFWO\ VXSSOLHG WR SURMHFWRUV EXW UDWKHU WKH YLGHR VLJQDO ZHQW WKURXJK LPDJH SURFHVVLQJ KDUGZDUH WKDW ZRUNHG DV D ILOWHUWRJHRPHWULFDOO\ZDUSDQGPRGXODWHWKHFRORURIWKHLPDJHHQFRGHGLQWKHYLGHR VLJQDO %\ WKH QDWXUH RI WKH ,9 SULQFLSOH GHVFULEHG WKH KLJK UHVROXWLRQ DQG KLJKGHQVLW\ LPDJH SURMHFWHG RQ VFUHHQ PXVW EH IUHH IURP GLVWRUWLRQ DQG UHIOHFWLRQ VR DQ DQWLUHIOHFWLYHDQWLVWDWLFFRDWLQJIODWVFUHHQLVXVHGWRGLVSOD\WKHLPDJH7KLVVFUHHQLV SODFHGLQWKHUHDURIPLFURFRQYH[OHQVDUUD\:KHQWKHUHQGHUHGHOHPHQWDO,9LPDJH LV SURMHFWHGRQ WKH VFUHHQ WKH DXWRVWHUHRVFRSLF LPDJH ZLOO EH IRUPDWWHG WR D VSDWLDO LPDJH ,PDJH$QDO\VLVDQG'DWD6HJPHQWDWLRQ 'DWDDQDO\VLVVRIWZDUH'6OLFHUGHYHORSHGDWWKH$UWLILFLDO,QWHOOLJHQFH/DERUDWRU\ 0DVVDFKXVHWWV ,QVWLWXWH RI 7HFKQRORJ\ &DPEULGJH 0DVV DQG DW %ULJKDP DQG :RPHQ¶V+RVSLWDO+DUYDUG0HGLFDO6FKRRO%RVWRQ0DVV>@ ZDVLQVWDOOHGRQDQ LQGHSHQGHQWZRUNVWDWLRQ6XQ%ODGH6XQ0LFURV\VWHPV0RXQWDLQ9LHZ&$ DQG FRQQHFWHGZLWKWKH&7VFDQQHURU05LPDJHUE\DQHWZRUNFDEOH7KLVVRIWZDUHZDV WKHQFXVWRPL]HGWRSURYLGHGDWDDQDO\VLVIRULPDJHJXLGHGSODQQLQJDQGQDYLJDWLRQ$ VHUYHU SURJUDP WKDW FRQWLQXRXVO\ VHQGV WKH DFTXLUHG &7 RU 05 LPDJHV DQG LQIRUPDWLRQRQWKHSRVLWLRQZDVLQWHJUDWHGZLWKWKH&705V\VWHP+LJKUHVROXWLRQ WKUHHGLPHQVLRQDO &705 GDWD ZHUH DFTXLUHG MXVW EHIRUH WKH VXUJLFDO SURFHGXUHV RU GXULQJWKHRSHUDWLRQDQGZHUHLQSXWRQWKHFRPSXWHUZLWKWKHGDWDDQDO\VLVVRIWZDUH

+/LDRHWDO

9ROXPHWULFGDWDFDQEHVHPLDXWRPDWLFDOO\VHJPHQWHGXVLQJWKH'6OLFHU VVXLWHRI HGLWLQJ WRROV 2QH VWUHQJWK RI RXU V\VWHP LV WKDW HIIHFWV FDQ EH YLVXDOL]HG E\ RYHUOD\LQJWKHHGLWHGYROXPHWUDQVOXFHQWO\RQWKHRULJLQDOYROXPHDQGH[SORULQJERWK LQ WKH WKUHHGLPHQVLRQDO YLHZ DV VKRZQ LQ )LJ 7KH VHJPHQWDWLRQ GDWD DQG WKH LPDJHDQDO\VLVUHVXOWVDUHWUDQVPLWWHGWRKLJKSHUIRUPDQFHFRPSXWHU

)LJ7KHRXWSXWRIVHJPHQWDWLRQLVGLVSOD\HGZLWKYDULDEOHRSDFLW\

+LJK3HUIRUPDQFH&RPSXWLQJDQG3DUDOOHO'LVSOD\ :H LPSOHPHQWHG WKH SDUDOOHOL]HG ,9 UHQGHULQJ VRIWZDUH LQ 603EDVHG KLJK SHUIRUPDQFH FRPSXWHU :H DOVR GHYHORSHG D GLVWULEXWHG V\VWHP WR VHSDUDWH WKH ,9 GLVSOD\XQLWIURP+3&XQLWVLQFHWKHVL]HRI+3&XQLWLVQRWVXLWDEOHWRILWLQRSHUDWLYH URRP 7KH FRPPXQLFDWLRQ WR WUDQVIRUP WKH UHQGHUHG LPDJH WR WKH GLVSOD\ XQLW LV SRVVLEOH E\ XVLQJ 7&3,3 &OLHQW6HUYHU PHFKDQLVP FRPELQHG ZLWK VRFNHW FRPPXQLFDWLRQ$7FOWNDSSOLFDWLRQZRUNVRQWKHGLVSOD\DVVRFNHWFOLHQW 7KHRYHUDOOVWUDWHJ\LQLQFUHDVLQJWKHUHQGHULQJSHUIRUPDQFHRI,9LQWKLVVWXG\LV WR XVH SDUDOOHO FRPSXWLQJ LQWHJUDWHG LQ VKDUHG PHPRU\ +3& 7KH EDVLF SULQFLSOH RI ,9 UHQGHULQJ LV SURMHFWLQJ UD\V WKURXJK D OHQV RULJLQDWHG IURP WKH VXEGLYLVLRQ RI FRPSXWHU GLVSOD\ SODFHG LQ WKH EDFNVLGH RI OHQV DUUD\ 7KH UHQGHULQJ LV FRPSXWDWLRQDOO\DOPRVWHTXLYDOHQWWRUD\WUDFLQJLQYROXPHUHQGHULQJ :H LQWHJUDWHG 0HVVDJH 3DVVLQJ ,QWHUIDFH 03,  >@ WR LQFUHDVH WKH UHQGHULQJ SHUIRUPDQFH RI ,9 03, LV DQ LQGXVWU\ZLGH PHVVDJHSDVVLQJ VWDQGDUG FRPPRQ IRU SURJUDPPLQJ LQ D GLVWULEXWHG RU D VKDUHG PHPRU\ HQYLURQPHQW >@ 7KH SDUDOOHOL]DWLRQLVEDVHGRQVWDWLFSDUWLWLRQLQJRIWKHUHQGHULQJLPDJH(DFKQRGHLQD FOXVWHUFRPSXWHULVDVVLJQHGDVHFWLRQRIWKHOLQHWRUHFRQVWUXFW7KHQRGHHODERUDWHV WKHLU VHFWLRQ LQ SDUDOOHO DQG RQFH ILQLVKHG VHQGV UHFRQVWUXFWHG VHFWLRQ WR D PDVWHU SURFHVV 7KH PDVWHU SURFHVV LV LQ FKDUJH RI ,2 RU QHWZRUN FRPPXQLFDWLRQ $3, ZKLFKFROOHFWVVRXUFHLPDJHVDQGVHQGVWKHUHQGHUHGLPDJHWRSDUDOOHOGLVSOD\FOXVWHU

$Q$XWRVWHUHRVFRSLF'LVSOD\6\VWHPIRU,PDJH*XLGHG6XUJHU\

&OLQLFDO6HWWLQJRI,9'LVSOD\6\VWHP 6LQFHWKHODUJHGHYLFHLVOLPLWHGLQWKHRSHUDWLYH URRP ZHSXW WKH LPDJLQJ XQLWV RI PXOWLSURMHFWLRQ GHYLFH IRU GLVSOD\LQJ ,9 LPDJHV LQ WKH RSHUDWLRQ URRP DQG KLJK SHUIRUPDQFHFRPSXWHURXWRIWKHRSHUDWLYHURRP

&OLQLFDO)HDVLELOLW\6WXGLHV 7R HYDOXDWH WKH IHDVLELOLW\ RI WKLV VWXG\ ZH DSSOLHG WKLV GLVSOD\ V\VWHP WR LPDJH JXLGHGVXUJHU\7KHVHDXWRVWHUHRVFRSLFLPDJHVFDQHQKDQFHWKHVXUJHRQ¶VFDSDELOLW\ WR XWLOL]H PHGLFDO ' LPDJHU\ WR GHFUHDVH WKH LQYDVLYHQHVV RI VXUJLFDO SURFHGXUHV DQGLQFUHDVHWKHLUDFFXUDF\DQGVDIHW\7KHVHDSSOLFDWLRQVLQFOXGHVXUJLFDOSODQQLQJ VXUJLFDO JXLGDQFH DQG VXUJLFDO JXLGDQFH ZLWK LQWUDRSHUDWLYH XSGDWHV 2XU SULRU ZRUNV IRFXVHG RQ VXUJLFDO JXLGDQFH WR SUHVHQW WKH VXUJHRQ ZLWK ,9 LPDJH WKDW ZDV JDWKHUHG LQ SUHRSHUDWLYH WUDFN VXUJLFDO LQVWUXPHQWV ZLWKLQ WKH RSHUDWLQJ ILHOG DQG GLVSOD\ LQ D UHDOWLPH ,9 DXWRVWHUHRVFRSLF LPDJH >@ ,Q WKLV VWXG\ ZH SHUIRUP VXUJLFDO SODQQLQJ DQG VLPXODWLRQ E\ WKLV QHZO\ GHYHORSHG ,9 DXWRVWHUHRVFRSLF GLVSOD\ 3.1 Equipments and Results

:H GHYHORSHG D PXOWLSURMHFWRU V\VWHP ZLWK  SURMHFWRUV ;*$ 8 3/86 9LVLRQ &RUS 7RN\R -DSDQ  DUUDQJHG LQ D î DUUD\ ZKLFK SURGXFLQJ D GLVSOD\ RI îSL[HOVDFURVVDîPPGSL UHDUSURMHFWLRQVFUHHQE\XWLOL]LQJ ORQJ]RRPOHQVSURMHFWLRQWHFKQLTXH7KHOHQVHVRIORQJ]RRPOHQVSURMHFWLRQXVLQJLQ WKLVSURMHFWRULQFOXGHVHWVDQGSLHFHVRIOHQVHV7KHSLWFKRIHDFKSL[HOSURMHFWHG RQWKHVFUHHQLVPP0LFUROHQVDUUD\SODFHGRQWKHVFUHHQKDVKH[DJRQDOPLFUR OHQVHVZLWKGLDPHWHU RI DSSUR[LPDWHO\ PP FRYHUV SL[HOV LQ WKH ORQJ]RRP OHQV SURMHFWLRQ VFUHHQ :H REWDLQ SUHFLVH DOLJQPHQW LQIRUPDWLRQ ZLWK D FDPHUD 1LNRQ '; GLJLWDO FDPHUD  DQG WUDQVPLW WKH FRUUHFWLRQ SDUDPHWHU WR WKH LPDJH SURFHVVLQJ KDUGZDUH 0RGHO 3$ ;*$ 0+]  IUDPHV VHFRQG 6\VWHP 'HYHORSPHQW/DERUDWRU\+LWDFKL/WG  ,QRUGHUWRREVHUYHWKH'LPDJHZLWKFRUUHFWPRWLRQSDUDOOD[RQHVKRXOGREVHUYH DWDGLVWDQFHRIDERXWFPIURPWKHV\VWHP7KHFRQGLWLRQZKHUHLQWKHSURMHFWHG,9 LPDJH ZDV FRQWLQXRXVO\ REVHUYHG ZDV H[DPLQHG )LJ  7KH ,9 DXWRVWHUHRVFRSLF GLVSOD\ KDV D VSDWLDO UHVROXWLRQ RI PP PP PP LQ PP PP PP IURQW DQGEHKLQGWKHOHQVDUUD\VHSDUDWHO\ 3.2 High Performance Computing

(DFKQRGHLQDFOXVWHUFRPSXWHULVDVVLJQHGDVHFWLRQRIWKHOLQHWRUHFRQVWUXFW7U\LQJ RQGLIIHUHQW&38VIURPWRHDFKWULDODUHUHSHDWHGWLPHV7KHUHVXOWVIURPWKH SHUIRUPDQFH WHVW LQGLFDWHG WKDW WKH VFDODELOLW\ LV JXDUDQWHHG LQ +3& 6XQ)LUH . 8OWUD6SDUF,,, 0+] î &38*%\WH 5$0 0RXQWDLQ9LHZ &$ ZLWKXS WR QRGHVDQGWKHDGGLWLRQDOQRGHVZLOOQRWLQFUHDVHFRPSXWLQJVSHHG7KHFRPSXWLQJ WLPH KDV GHFUHDVHG IURP  VHFRQGVIUDPH ;*$ &38 3HQWLXP ,,,  0+]

+/LDRHWDO

0HPRU\ 0% ',00  WR  VHFRQGVIUDPH ZLWK +3& 7KH IHDVLELOLW\ VWXG\ LQGLFDWHGWKDWWKHUHQGHULQJSHUIRUPDQFHDFKLHYHGZLWKWKHSURSRVHGPHWKRGLVDERXW WLPHV DV IDVW DV SUHYLRXV V\VWHP ZKLFK LV VDWLVIDFWRU\ DQG VXLWDEOH LQ VXUJLFDO VHWWLQJ 8/

85

//

/5

)LJ0RWLRQSDUDOOD[RI,9DXWRVWHUHRVFRSLFVNXOOLPDJHVWDNHQIURPYDULRXVGLUHFWLRQV7KH OHWWHUGHQRWHVWKHSRVLWLRQRIWKHREVHUYHUWRWKH,9DXWRVWHUHRVFRSLFLPDJH8/XSSHUOHIW85 XSSHUULJKW//ORZHUOHIW/5ORZHUULJKW $

3.3 Pre-surgical Planning and Intra-operative Guidance

,QWUDRSHUDWLYHO\ ,9 DXWRVWHUHRVFRSLF LPDJH FDQ KHOS ZLWK WKH QDYLJDWLRQ RI LQVWUXPHQWVE\SURYLGLQJDEURDGHUYLHZRIWKHRSHUDWLRQILHOG,QFRPELQDWLRQZLWK URERWLFDQGVXUJLFDOLQVWUXPHQWLWHYHQFDQVXSSO\JXLGDQFHE\SUHGHILQLQJWKHSDWK RIDELRSV\QHHGOHRUE\SUHYHQWLQJWKHVXUJLFDOLQVWUXPHQWVIURPPRYLQJLQWRFULWLFDO UHJLRQV :HHYDOXDWHGWKHXVHIXOQHVVRIWKHQHZO\GHYHORSHGV\VWHPLQRSHUDWLYHVHWWLQJ,Q FOLQLFDO IHDVLELOLW\ VWXG\ ZH SHUIRUPHG &7 VFDQQLQJ WR WDNH SKRWR RI LQYLYR NQHH 7KHYROXPHWULF&7LPDJHVRINQHH îSL[HOVîVOLFHVWKLFNQHVVRIPP ZHUHVHJPHQWHGE\'6OLFHUDQGWKHUHVXOWVZHUHUHQGHUHGE\+3&DQGGLVSOD\HGLQ PXOWLSURMHFWLRQ ,9 GLVSOD\ :H LQWHJUDWHG ,9 VHJPHQWDWLRQ LPDJH LQ NQHH DUWKURSODVW\ )LJD  DQG VXSHULPSRVHG ,9 LPDJH LQWR WKH SDWLHQW LQ VXUJLFDO LPSOHPHQWDWLRQ7KHVHFRPELQDWLRQVHQDEOHGVDIHHDV\DQGDFFXUDWHQDYLJDWLRQ :HDOVRSHUIRUPHG&7VFDQQLQJWRWDNHSKRWRRILQYLYRKXPDQKHDUWSKDVHVLQ RQH FDUGLDF F\FOH 7KHYROXPHWULF &7 LPDJHV RI KXPDQ KHDUW îSL[HOVFî VOLFHV IRU RQH SKDVH WKLFNQHVV RI PP  ZHUH UHQGHUHG  WLPHV VHSDUDWHO\ LQ RQH KHDUWEHDW 7KH UHQGHUHG HOHPHQWDO ,9 LPDJHV ZHUH SURMHFWHG FRQWLQXDOO\ RQ WKH ,9 VWHUHRVFRSLFGLVSOD\ZLWKWKHVDPHKHDUWEHDWSHULRGRIWKHSDWLHQW)LJE 

$Q$XWRVWHUHRVFRSLF'LVSOD\6\VWHPIRU,PDJH*XLGHG6XUJHU\



)LJ,9LPDJHIRUVXUJLFDOSODQQLQJDQGQDYLJDWLRQ6XUJLFDOLPSOHPHQWDWLRQLQWHJUDWHGZLWK ,9LPDJHIRUNQHHDUWKURSODVW\ZLWKGDWDVHJPHQWDWLRQ

)LJ,9&7DXWRVWHUHRVFRSLFDQLPDWHGLPDJH7KHKHDUWEHDWRISDWLHQWKDVDUDWHRIEHDWV SHUPLQXWHFDUGLDFF\FOHRIVD 6HJPHQWDWLRQGDWDE\'6OLFHUE ,9LPDJHE\PXOWL SURMHFWLRQ,9GLVSOD\

 'LVFXVVLRQVDQG&RQFOXVLRQ 7KH ,9 DXWRVWHUHRVFRSLF GLVSOD\ V\VWHP GHYHORSHG LQ WKLV VWXG\ KDV WKUHH SULPDU\ PHULWV 6XSHULPSRVLQJ WKH UHDO LQWXLWLYH ' LPDJH IRU PHGLFDO GLDJQRVLV DQG VXUJLFDOJXLGDQFH$YRLGLQJWKHQHHGRIH[WUDGHYLFHVVXFKDVWKHZHDULQJRIVSHFLDO JODVVHV DQG RIIHULQJ D JHRPHWULFDO DFFXUDF\ LPDJH RYHU WKH SURMHFWHG REMHFWV HVS 'HSWK SHUVSHFWLYH  9LVLELOLW\ RI PRWLRQ SDUDOOD[ RYHU D ZLGH DUHD VLPXOWDQHRXV REVHUYDWLRQE\PDQ\SHRSOH $V DFFXUDF\ LV PRVW LPSRUWDQW HOHPHQW LQ PHGLFDO LPDJLQJ WKLV V\VWHP KDV DGYDQWDJHVRYHURWKHU'LPDJHGLVSOD\PHWKRG7KHRUHWLFDOO\ZKHQWKHLGHDOOHQV LV XWLOL]HG ,9 FDQ SURYLGH D WKUHHGLPHQVLRQDO GLVSOD\ WKDW LV IUHH IURP DQ\ GLVFRQWLQXRXV FKDQJH RI LPDJHV WKDW RFFXU ZLWK WKH REVHUYHU¶V PRYHPHQW DQG ZLWK WKH VDPH UHVROXWLRQ WKDW FRQYHQWLRQDO WZRGLPHQVLRQDO GLVSOD\V IHDWXUH >@ 7KH PHDVXUHPHQWVRIVSDWLDOUHVROXWLRQRI,9DXWRVWHUHRVFRSLFGLVSOD\VKRZWKHTXDOLW\RI

+/LDRHWDO

,9 LPDJH FDQ EH LPSURYHG $FWXDOO\ WKH ,9 DXWRVWHUHRVFRSLF GLVSOD\ V\VWHPV GHYHORSHG LQ WKLV VWXG\ KDYH D SL[HO GHQVLW\ RI RQO\ DERXW GSL 7KH VSDWLDO UHVROXWLRQRIWKH'LPDJHSURMHFWHGLVSURSRUWLRQDOWRWKHUDWLRRIWKHOHQVGLDPHWHU LQ WKH OHQV DUUD\ WR WKH SL[HO SLWFK RI GLVSOD\ 7KXV ERWK WKH OHQV GLDPHWHU DQG WKH SURMHFWHGSL[HOSLWFKQHHGWREHPDGHPXFKVPDOOHU2QHRIWKHSRVVLEOHVROXWLRQVWR UHDOL]H KLJKHU SL[HO GHQVLW\ LV WKH XVH RI PRUH PXOWLSURMHFWRUV RU SURMHFWRU ZLWK KLJKHU UHVROXWLRQ 6;*$ RU PRUH SL[HOV  WR FUHDWH PRUH KLJKUHVROXWLRQ LPDJH $ PRUHODUJHFRPSXWDWLRQSRZHULVDOVRQHHGHGWRFRUUHVSRQGWRPXOWLSURMHFWRUV\VWHP 7KH+3&XVLQJIRUWKH,9LPDJHUHQGHULQJFDQDFFHOHUDWHFDOFXODWLRQ7KHUHVXOWV RIWKHSHUIRUPDQFHWHVWLQGLFDWHGWKDWWKHVFDODELOLW\LVJXDUDQWHHGLQ+3&ZLWKXSWR QRGHV7KLVPD\EHSDUWLDOO\GXHWRWKHQHWZRUNWUDIILFMDP\HWSULPDU\GXHWRXQ RUJDQL]HG FRPPXQLFDWLRQ RI 03, $GGLWLRQDO SHUIRUPDQFH DQDO\VLV LV UHTXLUHG WR IXOO\LQYHVWLJDWHFDXVHRIWKHXQEDODQFHGVFDODELOLW\ ,QFRQFOXVLRQZHKDYHGHYHORSHGDKLJKUHVROXWLRQZLWKKLJKSL[HOGHQVLW\GHYLFH IRU,9DXWRVWHUHRVFRSLFGLVSOD\V\VWHPXVLQJPXOWLSURMHFWRUDQGUHGXFWLRQSURMHFWLRQ PHWKRG7KHIHDVLELOLW\VWXG\LQGLFDWHGWKDWWKHPXOWLSURMHFWRUDQGSDUDOOHOUHQGHULQJ SHUIRUPDQFH DFKLHYHG ZLWK WKH SURSRVHG PHWKRG LV VDWLVIDFWRU\ DQG VXLWDEOH LQ VXUJLFDOGLDJQRVLVDQGSODQQLQJVHWWLQJ:HHYDOXDWHWKHIHDVLELOLW\RIWKLVGLVSOD\E\ GHYHORSLQJD'&7DXWRVWHUHRVFRSLFLPDJHDQGDSSO\LQJLWWRVXUJLFDOSODQQLQJ7KH PDLQ FRQWULEXWLRQ RI WKLV SDSHU LV DSSOLFDWLRQ DQG PRGLILFDWLRQ RI DXWRVWHUHRVFRSLF VXUJLFDO GLVSOD\ WHFKQLTXH RULJLQDOO\ GHYHORSHG LQ KLJKUHVROXWLRQ PXOWLSURMHFWRU DXWRVWHUHRVFRSLFGLVSOD\V\VWHPDQGKLJKSHUIRUPDQFHFRPSXWLQJ $FNQRZOHGJHPHQWV This study was partly supported by the Grant-in-Aid for the Development of Innovative Technology (12113) by the MEXT in Japan. We are deeply indebted to Ferenc A. Jolesz and Ron Kikinis of Brigham and Women’s Hospital, Boston, Mass, for donating the 3D Slicer software, and Takafumi Koike, Yasuyuki Momoi, Masami Yamasaki, Haruo Takeda of the System Development Laboratory, Hitachi, Ltd, for their contribution in seamless technique in multiprojector display.

5HIHUHQFHV  $)+LQVFKH 506PLWK ³,PDJHJXLGHG VXUJHU\´ &XUUHQW 2UWKRSDHGLFV 9RO 1R SS±  $DURQ)HQVWHU.DWKOHHQ6XUU\D:HQG\6PLWKD-HUHP\*LOODDQG'yQDO%'RZQH\³' XOWUDVRXQG LPDJLQJ DSSOLFDWLRQV LQ LPDJHJXLGHG WKHUDS\ DQG ELRSV\´ &RPSXWHU *UDSKLFV9RO1RSS±  0$*XWWPDQ (50F9HLJK ³7HFKQLTXHV IRU IDVW VWHUHRVFRSLF 05,´ 0DJQHWLF 5HVRQDQFHLQ0HGLFLQHV9ROSS±  0%ODFNZHOO &1LNRX $0'LJLRLD 7.DQDGH ³$Q LPDJH RYHUOD\ V\VWHP IRU PHGLFDO GDWDYLVXDOL]DWLRQ´0HGLFDO,PDJH$QDO\VLV9ROSS±  %7%DFNXVHWDO³+RUL]RQWDODQGYHUWLFDOGLVSDULW\H\HSRVLWLRQDQGVWHUHRVFRSLFVODQW SHUFHSWLRQ´9LVLRQ5HVHDUFK9RO1RSS±  0*/LSSPDQQ ³(SUHXYHV UHYHUVLEOHV GRQQDQW OD VHQVDWLRQ GX UHOLHI´ - GH 3K\V 9RO WKVHULHVSS±

$Q$XWRVWHUHRVFRSLF'LVSOD\6\VWHPIRU,PDJH*XLGHG6XUJHU\  +/LDR 61DNDMLPD 0,ZDKDUD (.RED\DVKL ,6DNXPD 1