Multispectral Image Encoding and Compression - IngentaConnect

IS&T/SID Ninth Color Imaging Conference



0XOWLVSHFWUDO,PDJH(QFRGLQJDQG&RPSUHVVLRQ /LQGVD\0DF'RQDOG6WHSKHQ:HVWODQGDQG'RQJPHL/LX &RORXU ,PDJLQJ,QVWLWXWH 8QLYHUVLW\RI'HUE\8QLWHG.LQJGRP  

$EVWUDFW 'LJLWDO LPDJH DUFKLYHV PD\ VWRUH LPDJHV LQ HLWKHU GHYLFH GHSHQGHQWRUGHYLFHLQGHSHQGHQWIRUPEXWWKHODWWHUSODFHV PRUH VWULQJHQW GHPDQGV RQ WKH LPDJH FDSWXUH SURFHVV 0XOWLVSHFWUDO LPDJH DUFKLYHV FDQ UHGXFH WKH SUREOHPV RI FRORXULQFRQVWDQF\DVVRFLDWHGZLWKWULFKURPDWLFLPDJHV$Q H[SHULPHQWDO VWXG\ ZDV FRQGXFWHG WR GHWHUPLQH WKH HIILFLHQF\ RI D QHZ PHWKRG IRU HQFRGLQJ PXOWLVSHFWUDO LPDJHVXVLQJWKUHHRUWKRJRQDOEDVLVIXQFWLRQVGHULYHGIURP FRQH IXQGDPHQWDOV SOXV DGGLWLRQDO SULQFLSDO FRPSRQHQWV 7KHUHVXOWVLQGLFDWHGWKDWWKHHQFRGLQJPHWKRGJDYHDJRRG DSSUR[LPDWLRQWRWKHRULJLQDODQGWKDWLPDJHVRIUHDVRQDEOH TXDOLW\ FRXOG EH UHFRQVWUXFWHG IURP ILOHV FRPSUHVVHG E\ VSDWLDO VXEVDPSOLQJ RI WKH FRPSRQHQWV ZLWK DQ RYHUDOO FRPSUHVVLRQUDWLRLQWKHUDQJH

0XOWLVSHFWUDO,PDJH&DSWXUH 7KH GLJLWDO UHSURGXFWLRQ RI D FRORXU LPDJH W\SLFDOO\ LQYROYHV D FKDLQ RI SURFHVVHV IURP RULJLQDO VFHQH WR GHVWLQDWLRQ LPDJH 7KH RULJLQDO VFHQH PD\ EH FDSWXUHG GLUHFWO\ E\ PHDQV RI D GLJLWDO FDPHUD RU GLJLWLVHG IURP D SKRWRJUDSKWKHQVWRUHGLQDVRXUFHLPDJHILOH7KLVILOHPD\ VXEVHTXHQWO\ EH SURFHVVHG E\ VXLWDEOH LPDJH SURFHVVLQJ DOJRULWKPV RIWHQ ZLWK WKH LQWHUDFWLYH FRQWURO RI D KXPDQ RSHUDWRU IRU HGLWRULDO FRUUHFWLRQ RU HQKDQFHPHQW DQG WKH UHVXOW VWRUHG LQ D GHVWLQDWLRQ LPDJH ILOH 7KLV PD\ WKHQ EH WUDQVPLWWHG WR D GHVWLQDWLRQ GHYLFH RU SURFHVV WR UHSURGXFH WKHLPDJHLQDSDUWLFXODUPHGLXPIRUH[DPSOHSULQWHGZLWK FRORXUHGLQNRQSDSHU 7KHPXOWLVSHFWUDOGLJLWDOLPDJHLQWHUPVRILWVSODFHLQ WKH UHSURGXFWLRQ FKDLQ LV DQ DOWHUQDWLYH UHSUHVHQWDWLRQ RI WKHRULJLQDOVFHQHRUREMHFWLQWKHGLJLWDOVRXUFHLPDJHILOH %HFDXVHLWFDUULHVPRUHGHWDLOHGVSHFWUDOLQIRUPDWLRQWKDQD FRQYHQWLRQDOWKUHHEDQGGLJLWDOLPDJHLWFDQSURYLGHDPRUH FRPSOHWHUHSUHVHQWDWLRQRIWKHFRORUDQWVRIWKHRULJLQDODQG KHQFH D PRUH DFFXUDWH UHFRUG RI WKH UHIOHFWDQFH XQGHU GLIIHUHQW VRXUFHV RI LOOXPLQDWLRQ 7KXV LW KDV SRWHQWLDO WR RYHUFRPH PDQ\ RI WKH SUREOHPV RI PHWDPHULVP RU FRORXU LQFRQVWDQF\DVVRFLDWHGZLWKFRQYHQWLRQDOLPDJHDUFKLYHV $Q LGHDO DUFKLYDO LPDJH ZRXOG FRQWDLQ DOO WKH LQIRUPDWLRQ SUHVHQW LQ WKH RULJLQDO VFHQH RU REMHFW ,I WKH ILQDOPHGLXPUHQGHULQJLQWHQWDSSOLFDWLRQDQGWDVNDUHQRW NQRZQDWLPDJHFDSWXUHWLPHWKHQWKHDUFKLYHLPDJHVKRXOG LGHDOO\ EH DEOH WR VXSSRUW DQ\ DQG HYHU\ SRVVLEOH FRPELQDWLRQ ,W VKRXOG DOORZ WKH XVHU WR µ]RRP LQ¶ FORVH HQRXJKWRGLVFHUQWKHILQHVWGHWDLOSUHVHQWLQWKHRULJLQDORU

 135

WR YLVXDOLVH WKH VFHQH IURP DQ\ DQJOH RU YLHZSRLQW RU WR VLPXODWH LWV DSSHDUDQFH XQGHU DQ\ W\SH RI OLJKWLQJ LQ DQ\ YLHZLQJHQYLURQPHQW,QSUDFWLFHVXFKDQREMHFWLYHLVRQO\ SRVVLEOH IRU D FRPSXWHUUHQGHUHG PRGHO ZKHUH WKH LPDJH KDVEHHQV\QWKHVLVHGIURPDVSHFLILHGSDUDPHWHUVHW $ UHDO DUFKLYDO LPDJH PXVW DOZD\V GLIIHU IURP WKH RULJLQDO VFHQH RU REMHFW DV LW LV D UHSUHVHQWDWLRQ DFTXLUHG WKURXJKRSWLFDOSURMHFWLRQDQGVDPSOLQJLQFOXGLQJ • JHRPHWU\RILOOXPLQDWLRQVRXUFHV DQGFDPHUDUHODWLYHWR WKHVFHQH • 'RULJLQDORSWLFDOO\SURMHFWHGRQWRWKH'LPDJHSODQH ZLWKLQFDPHUD • VDPSOHG LQ WLPH HLWKHU D VWDWLF RQHRII  LPDJH RU D SURJUHVVLYHVHULHV • VDPSOHGLQZDYHOHQJWKLQWRVSHFLILHGQXPEHURIVSHFWUDO FKDQQHOV • VDPSOHGVSDWLDOO\DFURVVWKH'LPDJHSODQH

/LPLWVRI5HVROXWLRQ %HFDXVH UHIOHFWDQFH VSHFWUD DUH IXQFWLRQV RI ZDYHOHQJWK ZKLFK FDQ EH H[SUHVVHG DV F\FOHV SHU QP WKH\ FDQ EH UHSUHVHQWHG E\ )RXULHU VSHFWUD 7KH 8QLIRUP 6DPSOLQJ 7KHRUHP VWDWHV WKDW ³LI [W  LV EDQGOLPLWHG ZLWK QR FRPSRQHQWV JUHDWHU WKDQ IK +] WKHQ LW LV FRPSOHWHO\ VSHFLILHG E\ VDPSOHV WDNHQ DW WKH IUHTXHQF\ IV !  IK +]´ 7KH PLQLPXP VDPSOLQJ IUHTXHQF\ IV LV WKH 1\TXLVW IUHTXHQF\7KHSUREOHPWKDWWKHVSHFWUDOUHIOHFWDQFHGDWDLV QRW D FRQWLQXRXV IXQFWLRQ RI ZDYHOHQJWK EXW D ILQLWH VHW RI YDOXHV VDPSOHG DW UHJXODU LQWHUYDOV W\SLFDOO\  RU  QP  FDQEHRYHUFRPHYLDWKH'LVFUHWH)RXULHU7UDQVIRUP')7  7KH UHVWULFWLRQRIWKHOLPLWHGUDQJHRIWKHYLVLEOHVSHFWUXP DSSUR[LPDWHO\  WR  QP  FDQ EH FRUUHFWHG E\ D +DQQLQJ ZLQGRZ ZKLFK SUHYHQWV WKH LQWURGXFWLRQ RI VSXULRXV IUHTXHQF\ FRPSRQHQWV LQWR WKH )RXULHU VSHFWUXP DV VKRZQ LQ )LJXUH  ,I UHIOHFWDQFH VSHFWUD ZHUH VDPSOHG E\ D VSHFWURSKRWRPHWHU DW  SRLQWV LQ WKH YLVLEOH UDQJH  QP LH DW  QP LQWHUYDOV WKH PD[LPXP GHWHFWDEOHIUHTXHQF\ZRXOGEHFRQVWUDLQHGWRF\FOHVSHU QPRUF\FOHVQP ,W LV LQWHUHVWLQJ WR FRQVLGHU WKH UHODWLRQVKLS EHWZHHQ VSHFWUDO IUHTXHQF\ DQG FRORXU VDWXUDWLRQ +LJKHU VSHFWUDO IUHTXHQFLHV FRUUHVSRQG WR VWHHSHU VORSHV DQG PRUH UDSLG UDWHV RI FKDQJH RIUHIOHFWDQFHDVDIXQFWLRQRIZDYHOHQJWK +HQFH D FRORXU WKDW KDV PRUH SRZHU DW KLJK VSHFWUDO IUHTXHQFLHV ZLOO H[KLELW PRUH FKURPDWLF SXULW\ VR ZLOO EH IXUWKHU IURP WKH ZKLWH SRLQW DQG QHDUHU WR WKH JDPXW ERXQGDU\ RI WKH FRORXU VSDFH 7KH OLPLWLQJ FDVH LV IRU

IS&T/SID Ninth Color Imaging Conference

 PRQRFKURPDWLFFRORXUVZKHUHDOOWKHSRZHULVFRQFHQWUDWHG DW D VLQJOH ZDYHOHQJWK LH DW LQILQLWH VSHFWUDO IUHTXHQF\ FRUUHVSRQGLQJ WR D SRLQW RQ WKH VSHFWUDO ORFXV RI WKH &,( FKURPDWLFLW\ GLDJUDP DV VKRZQ LQ )LJXUH  7KHRUHWLFDO µEORFN G\HV¶ XVHG LQ WKH DQDO\VLV RI VXEWUDFWLYH FRORXU UHSURGXFWLRQ V\VWHPV DOVR KDYH LQILQLWH VSHFWUDO IUHTXHQF\ FRPSRQHQWV EHFDXVH RI WKHLU LQILQLWH VORSHV LQ UHIOHFWDQFH VSDFHDQGOLHFORVHWRWKHVSHFWUDOORFXV  

 )LJXUH  )RXULHU DQDO\VLV RI D W\SLFDO UHIOHFWDQFH VSHFWUXP OHIW  VKRZLQJWKH)RXULHUDPSOLWXGHDIWHU+DQQLQJFRUUHFWLRQULJKW 

HDFKSL[HORIWKHLPDJHFRQVWUXFWHGDVOLQHDUFRPELQDWLRQV RIWKHVSHFWUDOFKDQQHOVIURPWKHFDSWXUHGHYLFH 0DQPDGH REMHFWV KRZHYHU KDYH DQ LQKHUHQW UHVROXWLRQ OLPLW H[FOXGLQJ WKH PLFURVWUXFWXUH RI WKH PHGLXP)LQHDUWSDLQWLQJKDVDPD[LPXPUHVROYDEOHGHWDLO RI DERXW  OLQHVPPDQGWUDQVSDUHQF\SKRWRJUDSKVDERXW  OLQHVPP )RU PDQPDGH REMHFWV WKHUHIRUH RQFH WKH PHGLXP KDV EHHQ SURSHUO\ FKDUDFWHULVHG LW LV SRVVLEOH WR HVWDEOLVK D VSDWLDO VDPSOLQJ OLPLW ZKLFK FDQ EH JXDUDQWHHG WRFDSWXUHDOOWKHVSDWLDOLQIRUPDWLRQLQWKHRULJLQDOREMHFW 7KH KXPDQ YLVXDO V\VWHP KDV VLJQLILFDQWO\ KLJKHU VSDWLDO VHQVLWLYLW\ IRU OXPLQDQFH FRPSRQHQWV WKDQ IRU FKURPLQDQFH 7KH FRQWUDVW VHQVLWLYLW\ IXQFWLRQ &6)  IRU OXPLQDQFHLVEDQGSDVVLQQDWXUHSHDNLQJDWDERXWF\FOHV SHU GHJUHH RI YLVXDO DQJOH FSG  DQG DSSURDFKLQJ ]HUR DW ERWK YHU\ ORZ OHVV WKDQ  FSG  DQG YHU\ KLJK JUHDWHU WKDQ  FSG  VSDWLDO IUHTXHQFLHV 7KH SHDN VHQVLWLYLW\ IRU OXPLQDQFHLVDERXWWLPHVWKDWIRUFKURPLQDQFHDQGIRUD JLYHQOHYHORIVHQVLWLYLW\WKHOXPLQDQFHFKDQQHOFDQGHWHFW VSDWLDO IUHTXHQFLHV DERXW  WLPHV KLJKHU WKDQ WKH FKURPLQDQFH FKDQQHO ,W IROORZV WKDW WKH FKURPLQDQFH FRPSRQHQWVRIDQLPDJHFDQEHGRZQVDPSOHGE\XSWR WLPHVLQOLQHDUGLPHQVLRQZLWKRXWSHUFHSWLEOHGHJUDGDWLRQRI LPDJH TXDOLW\ SURYLGHG WKDW WKH OXPLQDQFH FRPSRQHQW LV PDLQWDLQHG,WDOVRIROORZVWKDWLPDJHVKDUSQHVVSURFHVVLQJ HQKDQFHPHQW RI HGJHV RU ILQH GHWDLO LQ DQ LPDJH  FDQ EH SHUIRUPHG HIIHFWLYHO\ RQ WKH OXPLQDQFH FRPSRQHQW DORQH OHDYLQJWKHFKURPLQDQFHFRPSRQHQWVXQFKDQJHG

3URSRVDOIRUD0XOWLVSHFWUDO,PDJH$UFKLYH )RUPDW

 )LJXUH  (IIHFW RI LQFUHDVLQJ VSHFWUDO IUHTXHQF\ RQ FKURPDWLF SXULW\7KHVROLGFXUYHVKRZVWKHJDPXWRIFRORXUVFRUUHVSRQGLQJ WR EDQGOLPLWHG VSHFWUDO IUHTXHQFLHV RI  F\FOHVQP 176& SULPDULHV DUH VKRZQ IRU FRPSDULVRQ WULDQJOH  $GDSWHG IURP %XFKVEDXP *RWWVFKDON 

 )RUPXOWLVSHFWUDOLPDJHFDSWXUHDNH\TXHVWLRQLV+RZ PDQ\ VSHFWUDO FRPSRQHQWV VKRXOG EH FDSWXUHG" 6WXGLHV RI LPDJHV XVLQJ 3ULQFLSDO &RPSRQHQW $QDO\VLV 3&$  KDYH UHYHDOHGWKDWWKHVSHFWUDOUHIOHFWDQFHVRIERWKQDWXUDOVFHQHV DQG PDQPDGH VFHQHV FDQ LQ PRVW FDVHV EH DSSUR[LPDWHG DFFXUDWHO\ ZLWK ILYH RU VL[ EDVLV IXQFWLRQV ,W IROORZV WKDW IRU HIILFLHQW VWRUDJH RI PXOWLVSHFWUDO LPDJHV LQVWHDG RI VWRULQJ WKH UHIOHFWDQFH RI HDFK ZDYHEDQG LW LV EHWWHU WR GHULYH DQG VWRUH WKH FRHIILFLHQWV RI WKH EDVLV IXQFWLRQV IRU  136

$ QHZ WHFKQLTXH ZDV UHFHQWO\ SURSRVHG IRU HQFRGLQJ PXOWLVSHFWUDO LPDJHV ZLWK WKH GXDO EHQHILWV RI GDWD FRPSUHVVLRQ UHGXFLQJ WKH YROXPH RI GDWD UHTXLUHG IRU PXOWLVSHFWUDOLPDJHDUFKLYHVWRUDJH DQGJUHDWHUSURFHVVLQJ HIILFLHQF\ EHLQJ EHWWHU VXLWHG WR LPDJH SURFHVVLQJ RSHUDWLRQV IRU FRORXU UHSURGXFWLRQ  7KH DUFKLYHG LPDJH GDWDZRXOGFRQVLVWRI • $ EURDGEDQG PRQRFKURPDWLF UHSUHVHQWDWLRQ RI WKH LPDJH DW WKH KLJKHVW DYDLODEOH VSDWLDO UHVROXWLRQ GHVLJQDWHGOXPλ FDOFXODWHGDVDZHLJKWHGVXPRIWKH FKDQQHOV WR JLYH DQ RYHUDOO VSHFWUDO UHVSRQVLYLW\ FORVH WR WKH VWDQGDUG VSHFWUDO OXPLQRXV HIILFLHQF\ IXQFWLRQ 9λ  • 7ZR RUWKRJRQDO FRPSRQHQWV FORVHO\ UHODWHG WR WKH RSSRQHQW FRORXU FKDQQHOVRIWKHKXPDQYLVXDOV\VWHP GHVLJQDWHGUJλ DQGE\λ  • $VHWRIDGGLWLRQDOVSHFWUDOFRPSRQHQWVUHSUHVHQWLQJDOO RI WKH UHPDLQLQJ FKURPDWLF LQIRUPDWLRQ UHGXFHG WR D VLJQLILFDQWO\ ORZHU VSDWLDO UHVROXWLRQ ZLWK FRHIILFLHQWV GHULYHGIURPSULQFLSDOFRPSRQHQWVDQDO\VLV  6XFK D IRUPDW ZRXOG EH ZHOO VXLWHG WR WKH QHHGV RI FRORXU LPDJH UHSURGXFWLRQ EHFDXVH RI WKH UHGXFHG VSDWLDO VHQVLWLYLW\ RI WKH KXPDQ YLVXDO V\VWHP WR FKURPDWLF LQIRUPDWLRQ DV GHVFULEHG LQ WKH SUHYLRXV VHFWLRQ )RU VWDQGDUG FRORULPHWU\ WKH ; DQG = WULVWLPXOXV YDOXHV FRXOG UHDGLO\ EH FDOFXODWHG DV OLQHDU FRPELQDWLRQV RI WKH

IS&T/SID Ninth Color Imaging Conference



 lum     rg  = W '  by   

L   M   S  







 

∫$λ Gλ∫3λ Gλ∫4λ Gλ ΓΓΓ 

L(λ ) = 0.1551646 x(λ ) + 0.5430763 y (λ ) − 0.0370161z (λ )

 

ZKHUH x(λ ), y(λ ) DQG z (λ ) DUH WKH &,( ;