Gaussian and Weighted guided filter is using in the method. This ... guided image filter (WGIF) is introduced by adding an edge aware weighting into an existing ...
Available online at www.sciencedirect.com
ScienceDirect Procedia Technology 25 (2016) 293 – 301
*OREDO&ROORTXLXPLQ5HFHQW$GYDQFHPHQWDQG(IIHFWXDO5HVHDUFKHVLQ(QJLQHHULQJ6FLHQFHDQG 7HFKQRORJ\ 5$(5(67
:HLJKWHG*XLGHG*DXVVLDQ6LQJOH,PDJH'HKD]LQJ 6DMDQD0,TEDOD $WKLUD$EUDKDPE0XKDPPHG1L]DU%.F DEF
&ROOHJH2I(QJLQHHULQJ.LGDQJRRU.HUDOD,QGLD
$EVWUDFW 5HPRWHVHQVLQJLPDJHVVXFKDVVDWHOOLWHDQGXQGHUZDWHULPDJHVDUHZLGHO\XVHGLQYDULRXVILHOGVRIFRPSXWHUYLVLRQ%XWGXHWR IRJ PLVW DQG YDULRXV DHURVROV LQ WKH DWPRVSKHUH WKHLU FRQWUDVW JHW UHGXFHG 6R KHUH SURSRVLQJ D VLPSOH DQG QRYHO PHWKRG WR HOLPLQDWHWKHKD]HRQUHPRWHVHQVLQJLPDJHVXVLQJWZRILOWHUV*DXVVLDQDQG:HLJKWHGJXLGHGILOWHULVXVLQJLQWKHPHWKRG7KLV PHWKRGLVEDVHGRQWKHGDUNFKDQQHOSULRUDQGDFRPPRQKD]HLPDJHPRGHODQGWZRILOWHUV,QRUGHUWRHOLPLQDWHKDORDUWLIDFWV ILUVWZHXVHDORZSDVV*DXVVLDQILOWHU7RUHILQHWKHFRDUVHHVWLPDWHGDWPRVSKHULFYHLODOVRZHXVHWKLVILOWHU:HFDQUHGHILQH WKH WUDQVPLVVLRQ IRU SUHYHQWLQJ WKH FRORU GLVWRUWLRQ RI WKH UHFRYHUHG LPDJHV LQ WKH RXWSXW *DXVVLDQ ILOWHU LV EDVHG RQ ORFDO RSWLPL]HGHGJHSUHVHUYLQJVPRRWKLQJWHFKQLTXH%XWWKLVILOWHUVXIIHUVIURPKDORDUWLIDFWVDQGJUDGLHQWUHYHUVDO6RDZHLJKWHG JXLGHG LPDJH ILOWHU :*,) LV LQWURGXFHG E\ DGGLQJ DQ HGJH DZDUH ZHLJKWLQJ LQWR DQ H[LVWLQJ JXLGHG LPDJH ILOWHU *,) WR LQFUHDVHWKH1DWXUDOQHVVDQG6KDUSQHVVDORQJZLWKYLVXDOFODULW\7KH:*,)KDGDGYDQWDJHVRIERWKJOREDODQGORFDOVPRRWKLQJ ILOWHUV WKHFRPSOH[LW\RI:*,)LV2 1 IRUDQLPDJHZLWK1SL[HOVZKLFKLVVDPHDVWKH*,)XVHGEHIRUH 7KH:*,)FDQ DYRLGKDORDUWLIDFWVOLNHWKHH[LVWLQJJOREDOVPRRWKLQJILOWHUVZLWKLQFUHDVHGYLVLELOLW\:LWKVKRUWLQFUHPHQWRQUXQQLQJWLPHVLWLV HIIHFWLYH IRU YLVXDOO\ DSSHDOLQJ UHPRWH VHQVLQJ LPDJHV :H ZLOO XVH WKH *XLGHG LPDJH ILOWHULQJ DOJRULWKP DQG %R[ ILOWHU DOJRULWKPIRUGHKD]LQJWKHLPDJHV Crown Copyright © 2016 Published by Elsevier Ltd. This is an open access article under the CC BY-NC-ND license 7KH$XWKRUV3XEOLVKHGE\(OVHYLHU/WG (http://creativecommons.org/licenses/by-nc-nd/4.0/). 3HHUUHYLHZXQGHUUHVSRQVLELOLW\RIWKHRUJDQL]LQJFRPPLWWHHRI5$(5(67 Peer-review under responsibility of the organizing committee of RAEREST 2016
Keywords: Dark channel,Edge preserve smoothing,Edge aware weighting,Haze removal algorithms,Gaussian Filter, Weighted Guided Filter
,QWURGXFWLRQ )RU HIIHFWLYH LQIRUPDWLRQ KLJK VSDWLDO UHVROXWLRQV DQG FXUUHQW ORFDWLRQV UHPRWH VHQVLQJ LPDJHV KDYH EHHQ ZLGHO\ XVHGLQYDULRXVILHOGVLQFOXGLQJDJULFXOWXUHIRUHVWU\K\GURORJ\DQGPLOLWDU\%XWZLGHVSUHDGXVHRIUHPRWHVHQVLQJ LPDJHVLVQRZSUHGLFDWHGRQKLJKTXDOLW\LPDJHV5HPRWHVHQVLQJLVXVXDOO\GHSHQGHGRQZHDWKHUHIIHFWV>@>@
2212-0173 Crown Copyright © 2016 Published by Elsevier Ltd. This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/). Peer-review under responsibility of the organizing committee of RAEREST 2016 doi:10.1016/j.protcy.2016.08.110
294
Sajana M. Iqbal et al. / Procedia Technology 25 (2016) 293 – 301
7KHLPDJHVZHUHWDNHQDWDFRQVLGHUDEOHGLVWDQFHIURPWKHHDUWK¶VVXUIDFH6RHOHFWURPDJQHWLFHQHUJ\FDQQRWUHDFK WKH VHQVRU ,W SDVVHV WKURXJK WKH DWPRVSKHULF SDWK HYHU\ WLPH 'XULQJ SURSDJDWLRQ WKH LQFRPLQJ HQHUJ\ LQWHUDFWV ZLWKWKHDWPRVSKHULFDHURVROV7KHDWPRVSKHULFHIIHFWVVXFKDVKD]HIRJFORXGDQGVPRNHGHJUDGHWKHTXDOLW\RI WKHUHFHLYHGLPDJHV>@7KHVPRRWKLQJSURFHVVLQDQLPDJHXVXDOO\GHFRPSRVHVDQLPDJHWREHILOWHUHGLQWRWZR OD\HUV DEDVHOD\HUIRUPHGE\KRPRJHQHRXVUHJLRQV,WKDVVKDUSHGJHV$QGWKHUHLVDGHWDLOOD\HUZKLFKFDQEH HLWKHUQRLVHDUDQGRPSDWWHUQZLWK]HURPHDQRUWH[WXUHVXFKDVDUHSHDWHGSDWWHUQZLWKUHJXODUVWUXFWXUH7KHUHDUH WZRW\SHVRIHGJHSUHVHUYLQJLPDJHVPRRWKLQJWHFKQLTXHVQRZDGD\V2QHW\SHLVJOREDORSWLPL]DWLRQEDVHGILOWHUV >@ >@ >@ >@ 7KH RSWLPL]HG SHUIRUPDQFH FULWHULRQ FRQVLVWV RI D GDWD WHUP DQG D UHJXODUL]DWLRQ WHUP 7KH GDWD WHUPPHDVXUHVILGHOLW\RIUHFRQVWUXFWHGLPDJHWRWKHLPDJHWREHILOWHUHGZKLOHWKHUHJXODUL]DWLRQWHUPSURYLGHVWKH VPRRWKQHVVOHYHORIWKHUHFRQVWUXFWHGLPDJHHIIHFWLYHO\7KHJOREDORSWLPL]DWLRQEDVHGILOWHUVRIWHQ\LHOGH[FHOOHQW TXDOLW\EXWWKH\KDYHKLJKFRPSXWDWLRQDOFRVW&RPSDUHGZLWKWKHJOREDORSWLPL]DWLRQEDVHGILOWHUVWKHORFDOILOWHUV ORRNVLPSOHU+RZHYHUORFDOILOWHUVFDQQRWSUHVHUYHVKDUSHGJHVOLNHWKHJOREDORSWLPL]DWLRQEDVHGILOWHUV>@> @ :KHQDGRSWHGWRVPRRWKHGJHVKDORDUWLIDFWVDUHXVXDOO\SURGXFHGE\WKHORFDOILOWHU> @,WZDVPHQWLRQHGLQ>@ WKDWWKHORFDOILOWHUVVXFKDVWKH%)*,)ZRXOGFRQFHQWUDWHEOXUULQJQHDUWKHVHHGJHV7KH\SURGXFHKDORV%XWWKH JOREDORSWLPL]DWLRQEDVHGILOWHUV HJ ZHLJKWHGOHDVWVTXDUHVILOWHU LQ>@ZRXOGGLVWULEXWHVXFKEOXUULQJJOREDOO\,Q WKLV SDSHU DQ HGJHDZDUH ZHLJKWLQJ LV LQWURGXFHG DQG LQFRUSRUDWHG LQWR WKH *,) >@ WR IRUP D :HLJKWHG *,) :*,) :HNQRZIRUKXPDQYLVXDOSHUFHSWLRQHGJHVSURYLGHDQHIIHFWLYHDQGH[SUHVVLYHVWLPXODWLRQWKDWLVYLWDO IRUWKHQHXUDOLQWHUSUHWDWLRQRIDVFHQH>@6RLQWKHLQSXWLPDJHODUJHUZHLJKWVDUHWKXVDVVLJQHGWRSL[HOVDWHGJHV WKDQ SL[HOV LQ IODW DUHDV 7KHUH DUH PDQ\ PHWKRGV WR FRPSXWH WKH HGJHDZDUH ZHLJKWLQJ /RFDO YDULDQFH LQ î ZLQGRZV RI D SL[HO LQ D JXLGDQFH LPDJH LV DSSOLHG WR FRPSXWH WKH HGJHDZDUH ZHLJKWLQJ 7KH ZHLJKWLQJ FDQ EH HDVLO\ FRPSXWHG YLD WKH ER[ ILOWHU LQ > @ IRU DOO SL[HOV LQ WKH JXLGDQFH LPDJH 7KH ORFDO YDULDQFH RI D SL[HO LV QRUPDOL]HGE\WKHORFDOYDULDQFHVRIDOOSL[HOVLQWKHJXLGDQFHLPDJH7KHQRUPDOL]HGZHLJKWLQJLVWKHQDGRSWHGWR GHVLJQ WKH :*,) 'XH WR WKH SURSRVHG ZHLJKWLQJ WKH :*,) FDQ SUHVHUYH VKDUS HGJHV 6R WKHVH W\SHV RI JOREDO ILOWHUV>@>@>@>@DUHEHLQJZLGHO\XVHG$VDUHVXOWKDORDUWLIDFWVFDQEHUHGXFHGDYRLGHGE\XVLQJWKH:*,) *DXVVLDQFRPELQDWLRQRIILOWHUV6LPLODUWRWKH*,)LQ> @WKH:*,)DOVRDYRLGVJUDGLHQWUHYHUVDO 5HODWHGZRUNV 7KHHGJHSUHVHUYLQJILOWHULQJWHFKQLTXHVZHUHGLVFXVVLQJLQWKLVVHFWLRQ:HVSOLWWKHPDVH[SOLFLWLPSOLFLWZHLJKWHG DYHUDJHILOWHUVDQGQRQDYHUDJHILOWHUV([LVWLQJHGJHSUHVHUYLQJVPRRWKLQJWHFKQLTXHVDUHDOVRVXPPDUL]HGZLWKWKH HPSKDVLVRQWKH*,)LQ> @DQGWKH:/6ILOWHULQ>@ ([SOLFLW:HLJKWHG$YHUDJH)LOWHUV 7KHELODWHUDOILOWHU>@LVWKHVLPSOHVWDQGPRVWXVHGRQHDPRQJDOOH[SOLFLWZHLJKWHGDYHUDJHILOWHUV,WFRPSXWLQJ WKHILOWHULQJRXWSXWDWHDFKSL[HOLQWKHLPDJH,WGRQHE\DYHUDJLQJWKHQHLJKERULQJSL[HOVDURXQGLW:HLJKWLQJ LV JLYHQ E\ WKH *DXVVLDQ RI ERWK VSDWLDO DQG LQWHQVLW\ GLVWDQFH IURP ORFDWHG SL[HO 7KH ELODWHUDO ILOWHU VPRRWK WKH LPDJH 7KH\ DOVR SUHVHUYH HGJHV 7KH ELODWHUDO ILOWHU KDV OLPLWDWLRQV HYHQ WKH\ KDYH SRSXODULW\ ,W ZDV QRWLFHG LQ >@>@DQG>@WKDWWKHELODWHUDOILOWHUVXIIHULQJIURP³JUDGLHQWUHYHUVDO´SUREOHP,WH[LVWVZKHQDSL[HO RIWHQRQ DQHGJH IRXQGIHZVLPLODUSL[HOVDURXQGLW7KHQ*DXVVLDQZHLJKWHGDYHUDJHLVXQVWDEOH,QWKLVFDVHWKHUHVXOWV PD\H[KLELWXQZDQWHGSURILOHVDURXQGHGJHVWKDWFDXVHYDJXHQHVV ,PSOLFLW:HLJKWHG$YHUDJH)LOWHUV ,PSOLFLWILOWHULQJWRDQLPDJHE\DQLQYHUVHPDWUL[LVHTXLYDOHQWWRRSWLPL]LQJDTXDGUDWLFFRVWIXQFWLRQDQGVROYHD OLQHDUV\VWHP7KHVHRSWLPL]DWLRQEDVHGDSSURDFKHVRIWHQJHQHUDWHKLJKTXDOLW\UHVXOWV6ROYLQJWKHOLQHDUV\VWHPLV YHU\ WLPHFRQVXPLQJ *DXVVLDQ (OLPLQDWLRQ LV QRW SUDFWLFDO GXH WR WKH PHPRU\GHPDQGLQJ DQG JUDGLHQW UHYHUVDO SUREOHPV (GJHSUHVHUYHVPRRWKLQJ 7KHHGJHSUHVHUYLQJVPRRWKLQJWDVNLVGHFRPSRVLQJDQLPDJH;LQWRWZRSDUWV:HFDQUHSUHVHQWLWDVIROORZV
Sajana M. Iqbal et al. / Procedia Technology 25 (2016) 293 – 301
295
; 3 = 3 H 3 :KHUH = LV D UHFRQVWUXFWHG LPDJH IRUPHG E\ KRPRJHQHRXV UHJLRQV 7KLV LPDJH KDYH VKDUS HGJHVH LV WH[WXUH RU QRLVHDQG3 [\ LVDSRVLWLRQLQWKHLPDJH=DQGHDUHIRUPLQJWKHEDVHOD\HUDQGGHWDLOOD\HUUHVSHFWLYHO\2QH W\SHRIHGJHSUHVHUYLQJVPRRWKLQJWHFKQLTXHLVEDVHGRQORFDOILOWHULQJ%)ZLGHO\XVHGGXHWRLWVVLPSOLFLW\>@ +RZHYHU%) FRXOG VXIIHU IURP ³JUDGLHQW UHYHUVDO´ DUWLIDFWV GHVSLWH LWV SRSXODULW\ > @ DQG WKH UHVXOWV PD\ H[KLELW XQGHVLUHGSURILOHVDURXQGHGJHV*XLGHGLPDJHILOWHULVLQWURGXFHGWRRYHUFRPHWKLVSUREOHP *XLGHGLPDJHILOWHU 7KHWUDQVODWLRQLQYDULDQW*XLGHGILOWHULQYROYHVDJXLGDQFHLPDJH,DILOWHULQJLQSXWLPDJHSDQGDQRXWSXWLPDJH T%RWK,DQGSDUHJLYLQJEHIRUHKDQGDFFRUGLQJWRWKHDSSOLFDWLRQDQGWKH\FDQEHLGHQWLFDO7KHILOWHULQJRXWSXWDW DSL[HO,LVH[SUHVVLQJDVDZHLJKWHGDYHUDJH TL :LM , 3M :KHUHLDQGMDUHSL[HOLQGH[HVLQWKHSDWFK7KHILOWHUNHUQHO:LMLVDIXQFWLRQRIWKHJXLGDQFHLPDJH,DQGLWLV LQGHSHQGHQWRIWKHLQSXWLPDJH7KLVILOWHULVOLQHDUZLWKWKHLQSXWLPDJH7KHPDLQDVVXPSWLRQRIWKHJXLGHGILOWHULV DORFDOOLQHDUPRGHO,WSURYHVEHWZHHQWKHJXLGDQFH,DQGWKHILOWHULQJRXWSXWT:HDVVXPHWKDWLQZLQGRZ:NWKH RXWSXWTLVDOLQHDUWUDQVIRUPRIJXLGDQFHLPDJHDQGLWLVFHQWHUHGDWWKHSL[HON TL DN,LENZKHUHDOO,ȯ:N :KHUH WKH OLQHDU FRHIILFLHQWV DN EN DUH DVVXPHG WR EH FRQVWDQW LQ ZLQGRZ :. :H XVH UDGLXV VL]H U LQ VTXDUH ZLQGRZ:.7KLVORFDOOLQHDUPRGHOVD\VWKDWTKDVDQHGJHRQO\LI,KDVDQHGJHEHFDXVHǻT Dǻ,7RGHWHUPLQH WKH OLQHDU FRHIILFLHQWV DNEN ZH QHHG VRPH FRQVWUDLQWV LQ ILOWHULQJ LQSXW S :H PRGHO WKH RXWSXW T DV WKH LQSXW S VXEWUDFWLQJVRPHXQZDQWHGFRPSRQHQWVOLNHWH[WXUHRUQRLVH TL SL±QL 7KHH[SHFWHGVROXWLRQVKRXOGPLQLPL]HWKHGLIIHUHQFHEHWZHHQTDQGSZKLOHPDLQWDLQLQJWKHOLQHDUPRGHOH[SODLQHG EHIRUH:HPLQLPL]HFRVWIXQFWLRQLQWKHZLQGRZ:NİLVLQWURGXFLQJDVWKHUHJXODUL]DWLRQSDUDPHWHU%XWLWLVIL[HG LQ *XLGHG ILOWHU EXW FDQ EH FRQWHQW YDULHG LQ :*,)6R ZH ZLOO FKRRVH :*,) DV WKH FRPELQHG ILOWHU DORQJ ZLWK *DXVVLDQILOWHUEXWFDQEHFRQWHQWYDULHGLQ:*,)*,)DQG*DXVVLDQFDQQRWSUHVHUYHVKDUSHGJHV:KHQSUHVHUYLQJ VKDUSHGJHVLWSURGXFHKDORV7KH*,)EDVHGRQORFDORSWLPL]DWLRQ*,)ZRXOGFRQFHQWUDWHEOXUULQJQHDUHGJHVDQG LQWURGXFHKDORV6REHWWHUWRXVH:/6ILOWHUV1RWHWKDWZHZLOOWDNHWKH*XLGHG)LOWHUDQG%R[)LOWHU> @DOJRULWKPV IRUUHPRYLQJWKHKD]H 1DWXUDOQHVV &RORU UHSURGXFWLRQ %ULJKWQHVV YLVLELOLW\ FRQWUDVW DQG UHSURGXFWLRQ RI GHWDLOV DUH FRQVLGHUHG DV WKH LPDJH SDUDPHWHUV7KHUHVXOWVVKRZWKDWDPRQJDOOWHVWHGDWWULEXWHVEULJKWQHVVDQGFRQWUDVWKDYHPRUHFRUUHODWLRQZLWKWKH QDWXUDOQHVV RI DQ LPDJH 6R QDWXUDOQHVV PRGHO FDQ EH PDGH EDVHG RQ WKHVH WZR DWWULEXWHV QDPHG EULJKWQHVV DQG FRQWUDVW 7KHVH LQJUHGLHQWV RI QDWXUDOQHVV DUH UHODWHG WR WKH WRQH PDSSLQJ HYDOXDWLRQ SUREOHP +HUH EULJKWQHVV PDSSLQJ LV DQ LQHYLWDEOH LVVXH LQ DOO WRQH PDSSLQJ RSHUDWLRQV EHLQJ FRQVLGHUHG :H FDQ GHILQH RXU QDWXUDOQHVV PHDVXUHDV 1 .>3S3F@ 6KDUSQHVV ,PDJHVKDUSQHVVLVDQHIIHFWLYHSDUDPHWHUWRILQGKD]HGLPDJH¶VTXDOLW\$QLPDJHVKDUSPHDQVWKHGHWDLOVDUHFOHDU LQWKHRXWSXW7KHODUJHUWKHPHDVXUHWKHVKDUSHUWKDWLPDJH,WLVGHILQHGDVWKHQRUPDOL]HGVXPRIWRWDOJUDGLHQWV ,I1LVWKHQXPEHURISL[HOV
296
Sajana M. Iqbal et al. / Procedia Technology 25 (2016) 293 – 301
6 1Јǻ,Ј :HLJKWHG*XLGHG,PDJH)LOWHULQJ ,QWKLVVHFWLRQSURSRVLQJDQHGJHDZDUHZHLJKWLQJ7KHQLWLVIL[LQJLQWRWKH*XLGHGLPDJHILOWHULQ> @WRIRUP WKH:*,) ZHLJKWHGJXLGHGILOWHU A. An Edge-Aware Weighting Scheme /HWJXLGDQFHLPDJHEH*DQGı* S EHWKHYDULDQFHRI*LQîZLQGRZȍ S $QHGJHDZDUHZHLJKWLQJī* S LVGHILQHGXVLQJWKLVORFDOYDULDQFHRIDOOSL[HOVDVIROORZV 1 ī* S 1 ı* S İ ı* S İ 3 :KHUHİLVDVPDOOFRQVWDQWDQGLWVYDOXHVHOHFWHGDV î/ +HUH/LVWKHG\QDPLFUDQJHRIWKHLQSXWLPDJH $OO SL[HOV LQ WKH JXLGDQFH LPDJH ZHUH XVHG LQ WKH FRPSXWDWLRQ RI ī* S $OVR WKH ZHLJKWLQJ ī* S PHDVXUHV WKH LPSRUWDQFHRISL[HOSZLWKUHVSHFWRQWKHZKROHJXLGDQFHLPDJH'XHWRWKHER[ILOWHULQ> @WKHFRPSOH[LW\RIī* S LV2 1 7KHYDOXHRIī* S LVODUJHUWKDQRQHLISLVDWDQHGJHDQGVPDOOHUWKDQRQHLISLVLQDVPRRWKDUHDDQGDQG ODUJHUZHLJKWVZHUHDVVLJQHGWRSL[HOVDWHGJHV7KHSL[HOVLQIODWDUHDVKDYHORZZHLJKWDJH7KHVPRRWKHGZHLJKWV RIDOOSL[HOVLQ)LJ D DUHVKRZQLQ)LJ E &OHDUO\ODUJHUZHLJKWVDUHDVVLJQHGWRSL[HOVDWHGJHVWKDQSL[HOVLQIODW DUHDVLQWKHLPDJH7KHSURSRVHGZHLJKWLQJPDWFKHVRQHIHDWXUHRIKXPDQYLVXDOV\VWHPFODULW\LHSL[HOVDWVKDUS HGJHVDUHXVXDOO\PRUHYDOXDEOHWKDQWKRVHLQIODWDUHDV>@ )LJ An image and its edge-aware weighting 7KHILQDODVVXPSWLRQRIWKH:*,)LVDORFDOOLQHDUPRGHOEHWZHHQWKHILOWHULQJRXWSXW=DQGJXLGDQFHLPDJH*7KLV PRGHO HQVXUHV WKDW WKH RXWSXW = KDV DQ HGJH RQO\ LI WKH JXLGDQFH LPDJH * KDV DQ HGJH 7KH ZHLJKWLQJ ī* S LQ (TXDWLRQ ZDV LQFRUSRUDWHG LQWR WKH FRVW IXQFWLRQ ( DS ES 7KH VROXWLRQ ZDV REWDLQHG E\ PLQLPL]LQJ WKH GLIIHUHQFHEHWZHHQWKHLPDJHWREHILOWHUHG;DQGWKHILOWHULQJRXWSXW=ZKLOHPDLQWDLQLQJWKHOLQHDUPRGHOLHE\ PLQLPL]LQJDFRVWIXQFWLRQ( DS ES ZKLFKLVGHILQHGDV ( >DS * S ES í; S Ȝ»ī* S DS @ 3ȯȍ S 7KHYDOXHVRIDS DQGESϐDUHFRPSXWHGDVIURPWKHHTXDWLRQVVDPHDVLQWKHZHLJKWHGJXLGHGILOWHU>@:KHUHĬLV WKHHOHPHQWE\HOHPHQWSURGXFWRIWZRPDWULFHVYDOXHV)RUHDV\DQDO\VLVWKHLPDJHV;DQG*LVDVVXPHGWREHWKH VDPHWRUHPRYHKD]HIURPWKHLPDJH&RQVLGHUWKHFDVHWKDWWKHSL[HOSLVDWDQHGJH7KHYDOXHRIī* S LVXVXDOO\ PXFKODUJHUWKDQRQH DS LQWKH:*,)LVFORVHUWRRQHWKDQ DS LQWKH *,)> @7KLVUHYHDOVWKDWVKDUSHGJHVDUH
Sajana M. Iqbal et al. / Procedia Technology 25 (2016) 293 – 301
297
SUHVHUYHGEHWWHU E\ WKH:*,),W LV FOHDUHU WKDQ*,)$V VKRZQ LQ)LJ HGJHV DUHSUHVHUYHG PXFKEHWWHU E\ WKH :*,) %DFNJURXQG A. Dark Channel Prior )RUDQRXWGRRUKD]HIUHHLPDJHGDUNFKDQQHOSULRULVEDVHGRQWKHIROORZLQJREVHUYDWLRQ,QPRVWRIWKHPLQVN\ SDWFKHVSL[HOVLQDWOHDVWRQHFRORUFKDQQHO UJRUE KDYHORZLQWHQVLW\YDOXHDQGDUHHYHQFORVHWR]HUR)RUDQ LPDJH-ZHGHILQHLWVGDUNFKDQQHO-GDUNDV
-GDUN [ PLQ PLQ-F \ \ȯȍ [ Fȯ^UJE` %XWIRUWKHLPDJHVWDNHQXQGHUKD]HFRQGLWLRQGDUNFKDQQHOSULRUEHFRPHVLQYDOLG B. Estimate the Atmospheric Light $LVWKHDWPRVSKHULFOLJKWHVWLPDWHGLQWKHPRVWKD]HRSDTXHUHJLRQ:HILUVWFKRRVHWKHWRSEULJKWHVWSL[HOV DV WKH PRVW KD]HRSDTXH UHJLRQ LQ GDUN FKDQQHO /DWHU WKH YDOXH RI $ LV H[WUDFWHG IURP WKH VDPH ORFDWLRQ , RULJLQDOKD]\LPDJH DVLWVGDUNFKDQQHOLPDJH7KHEULJKWHVWSL[HOLQWKHRULJLQDOLPDJH‘,¶ZDVFRQVLGHUHGDVWKH JOREDODWPRVSKHULFOLJKWWDNHQLQDQ\FOLPDWH7KLVDSSURDFKLVPRUHVLPSOHDQGUHOLDEOH,WDYRLGVRQO\VHDUFKLQJ IRUWKHVLQJOHEULJKWHVWSL[HOLQWKHHQWLUHLPDJH C. Estimate the Coarse Atmospheric Veil :HILUVWGHILQHWKHDWPRVSKHULFYHLO9 [ DVIROORZV 9 [ W [ 2EYLRXVO\WKHWUDQVPLVVLRQW [ H íȕG [ LVZLWKLQ 7KHDWPRVSKHULFYHLO9 [ LVZLWKLQWKH LQWHUYDO7KH DWPRVSKHULFYHLOSUHVHQWVWKHDGGLWLYHDLUOLJKWWRWKHVFHQHLPDJLQJDQGLWLVHVWLPDWHGDVWKHLQFUHDVLQJIXQFWLRQ ZLWKWKHGLVWDQFHG [ IURPWKHREMHFWWRWKHREVHUYHU7KHYDOXHRI $LVQRWWKHPD[LPXP LQWKHRULJLQDOKD]\ LPDJHZKLFKZLOOFDXVHWKHIUDFWLRQWREHJUHDWHUWKDQIRUSL[HOVZKRVHLQWHQVLWLHVDUHKLJKHUWKDQWKHDWPRVSKHULF OLJKW $ 6R ZH IXUWKHU UHVWULFW WKH QRUPDOL]HG LPDJH ZLWK OLQHDU VWUHWFK PHWKRG LQWR >@ 7KHUHIRUH WKH KD]H LPDJLQJPRGHOFDQEHUHZULWWHQDV , [ $ >- [ $@W [ 9 [ :HFDQH[WUDFWWKHDWPRVSKHULFYHLOVLPSO\E\ 9 [ PLQ PLQ>,F \ $F@ \ȯȍ [ Fȯ^UJE` ,QWKLVOHWWHUZHRQO\FRPSXWHWKHPLQLPXPFRORUFKDQQHOZKLFKDLPVWRJHWWKHFRDUVHDWPRVSKHULFYHLO5HILQHG $WPRVSKHULF9HLOXVLQJ*DXVVLDQ 9 [ PLQ>,F [ $F@ Fȯ^UJE`
298
Sajana M. Iqbal et al. / Procedia Technology 25 (2016) 293 – 301
:HXVH*DXVVLDQILOWHUWRUHILQHWKHDWPRVSKHULFYHLO*DXVVLDQILOWHULVDQRQOLQHDUILOWHUWKDWFDQVPRRWKLPDJHV :HVPRRWKWKHDWPRVSKHULFYHLOXVLQJDORZSDVV*DXVVLDQILOWHUDQGWKHUHILQHGDWPRVSKHULFYHLO9 [ H[SUHVVHGDV 9 [ :J *ıŇŇ[\ŇŇ 9 \ () \ȯ6 7KHZHLJKWHGVXPRIWKHORFDOSDWFKFHQWHUHGDWSL[HO[:JLV :J :J *ıŇŇ[\ŇŇ \ȯ6 +HUH*LVD*DXVVLDQIXQFWLRQ *ı [ H^[ı` DQGıUHSUHVHQWVWKHVL]HRIWKHQHLJKERUKRRGXVHGWRVPRRWKDSL[HOZLWKLQWKHUDQJH$ODUJHıZLOOVPRRWKPRUH GLVWDQW LPDJH ORFDWLRQV LQ WKH LPDJH WDNHQ :H IL[ LW WR IRU DOO UHVXOWV LQ WKLV OHWWHU $FFRUGLQJ WR WKH ORZSDVV *DXVVLDQILOWHUWKRVHSL[HOVFORVHUWRWKHFHQWHUHGSL[HO[ZLOOJHWODUJHUZHLJKWV W [ í9 [ E. Recover the Haze-Free Image :LWK WKH REWDLQHG JOREDO DWPRVSKHULF OLJKW DQG WUDQVPLVVLRQ WKH VFHQH UDGLDQFH FDQ EH UHFRYHUHG 7KH VFHQH UDGLDQFH- [ FDQEHUHVWRUHGE\ - [ $[^>, [ $N9 [ @max W [ W ` 7RHVWLPDWHWKHDWPRVSKHULFYHLOZHXVHWKHSDWFKVL]HRIRQHLQHDFKSL[HO,QIDFWWKHPLQLPXPFRPSRQHQWRIWKH U J E FKDQQHO RI WKH KD]HIUHH LPDJH FDQQRW EH ]HUR ,Q RWKHU ZRUGV WKH WKUHVKROG LW XVLQJ WR ILQG WKH JOREDO DWPRVSKHULF OLJKW $ LV XVLQJ SUHGHILQHG YDOXH 0 ,I WKH GLIIHUHQFH LV VPDOOHU WKDQ 0 ZH UHFRPSXWHG WKH WUDQVPLVVLRQ W൏ [ PLQ PD[ M / Ň, [ $$Ň W [ )RU GLIIHUHQW UHPRWH VHQVLQJ LPDJHV VXFK DV VDWHOOLWH DQG XQGHUZDWHU SKRWRJUDSK\ ZLWK YDU\LQJ KD]H HIIHFW WKH WKUHVKROGPLJKWEHGLIIHUHQW6RWKHDWPRVSKHULFYHLOFDQEHFDOFXODWHGDV 9൏ [ íW൏ [ 7KH UHILQHG WUDQVPLVVLRQV UDQJLQJ IURP WR $OVR WKH FDOFXODWHG LQWHQVLW\ RI PRUH WKDQ SHUFHQW RI WKH SL[HOV LQ WKH WUDQVPLVVLRQ LV EHWZHHQ DQG IRU WKH LPDJHV ,W LV FRQVLVWHQW ZLWK WKH SK\VLFDO DWPRVSKHULF WUDQVPLWWDQFH7KHQWKHILQDOVFHQHUDGLDQFH- [ FDQEHUHVWRUHG7KHUHFRYHUHGVFHQHUDGLDQFHFDQEHZULWWHQDV - [ >, [ N$@W൏ [ N$ F. Filter with Gaussian and WGIF 7KH UHFRYHUHG LPDJH LV ILUVW JLYHQ WR *DXVVLDQ )LOWHU DQG RXWSXW LV JLYLQJ WR WKH JXLGDQFH LPDJH WR :*,) ,W LV SURYHGWKDWWKHLPDJHLVPRUHYLVXDOO\DSSHDOLQJZLWKUHGXFHGKDORVDQGZLWKKLJKHU1DWXUDOQHVVDQG6KDUSQHVVWKDQ *DXVVLDQDORQH
Sajana M. Iqbal et al. / Procedia Technology 25 (2016) 293 – 301
G . Comparison with the existing methods 7KHUHH[LVWDORWRIILOWHUVOLNH*,)%LODWHUDOILOWHU0HGLDQILOWHU*XLGHGMRLQWELODWHUDOILOWHU6XUURXQGILOWHU'LUHFW ILOWHUHWF:HFDQXVHFRPELQDWLRQRIILOWHUVVXFKDV*DXVVLDQZLWK*,)*DXVVLDQZLWK:*,)DOVR:HZLOOVHWWKH SDWFKVL]HWR[IRUWKHLPDJH)RUILQGLQJWKHUHILQHGYHLODQGUHFRPSXWLQJWUDQVPLVVLRQZHZLOOVHOHFWWKUHVKROG YDU\LQJ IURP WR UHJXODUL]DWLRQ SDUDPHWHU IRU *,) DQG :*,) LV GLIIHUHQW DV PHQWLRQHG LQ > @>@)RU WKH SURSRVHGPHWKRGZKLFKXVLQJ*DXVVLDQ:*,)XVHVı IRU*DXVVLDQILOWHU,IUHFRPSXWHGWUDQVPLVVLRQUHTXLUHG ZHFDQVHWSDUDPHWHUFRQVWDQWVWR 5HJXODUL]DWLRQSDUDPHWHUVHWWRPHQWLRQHGLQ>@ ),/7(5 1$785$/1(66 6+$531(66 Gaussian
0.8043
0.0284
Guided image filter(GIF)
0.812
0.0299
Gaussian+GIF
0.864
0.0378
Weighted guided filter(WGIF)
0.881
0.0394
Gaussian+WGIF
0.9633
0.0539
([SHULPHQWV5HVXOWV 7KHKD]\LQSXWLPDJHLVJLYHQ:HZLOOILUVWHVWLPDWHLWV'DUNFKDQQHOSULRU )LJ Input image
)LJ Dark channel prior
:H ZLOO QH[W ILQG WKH WRSPRVW EULJKWHVW SL[HOV WR ILQG WKH DWPRVSKHULF OLJKW 7KHQ$WPRVSKHULF 9HLO DQG 5HILQHG DWPRVSKHULFYHLOZLOOEHILQGLQJ7KHQZHUHGHILQHWKHWUDQVPLVVLRQDQGILOWHULWZLWK*DXVVLDQDQG:HLJKWHG*XLGHG )LOWHU
)LJ Coarse atmospheric veil
)LJ Refined atmospheric veil
299
300
Sajana M. Iqbal et al. / Procedia Technology 25 (2016) 293 – 301
7KLVUHILQHGYHLOLVXVHGIRUUHFRPSXWLQJWKHWUDQVPLVVLRQVLQFHWKHUHPD\EHVRPHZDWHUVXUIDFHVDQGPRUHVN\ SDWFKHVLQVRPHLPDJHV7KLVUHFRYHUHGLPDJHLVJLYHQWR*DXVVLDQILOWHUWKHQWR:*,)
)LJ Recomputed transmission image
)LJ Gaussian filtered image
)LJ Gaussian filtered image after WGIF &RQFOXVLRQ )RUPDQ\FRPSXWHUYLVLRQDSSOLFDWLRQVKD]HUHPRYDODOJRULWKPVEHFDPHPRUHXVHIXO,WZDVIRXQGWKDWPRVWRIWKH H[LVWLQJ WHFKQLTXHV KDYH JUDGLHQW UHYHUVDO LVVXH LH QR WHFKQLTXH LV DFFXUDWH IRU GLIIHUHQW NLQG RI FLUFXPVWDQFHV 7KH SUREOHP RI RYHULOOXPLQDWLRQ LV D SUREOHP IRU UHPRYLQJ KD]H IURP WKH LPDJHV'XH WR WKH VLPSOLFLW\ RI WKH :HLJKWHGJXLGHGILOWHULWKDVPDQ\DSSOLFDWLRQVLQWKHILHOGVRIFRPSXWDWLRQDOSKRWRJUDSK\DQGLPDJHSURFHVVLQJ WKURXJKRXW 3DUWLFXODUO\ LW LV DSSOLHG WR VWXG\ IXVLRQ RI GLIIHUHQWO\ H[SRVHG LPDJHV VLQJOH LPDJH GHWDLO HQKDQFHPHQWDQGVLQJOHUHPRWHVHQVLQJLPDJHKD]HUHPRYDO([SHULPHQWDOUHVXOWVVKRZWKDWWKHSURSRVHGPHWKRG FDQSURGXFHLPDJHVZLWKH[FHOOHQWYLVXDOTXDOLW\DVWKRVHRIJOREDOILOWHUVDQGDWWKHVDPHWLPHWKHUXQQLQJWLPHVRI WKH SURSRVHG DOJRULWKPV DUH FRPSDUDEOH WR WKH *,) EDVHG DOJRULWKPV DOVR 7KH RXWSXW LV EHWWHU LQ FDVH RI ERWK 1DWXUDOQHVVDQG6KDUSQHVV $FNQRZOHGJHPHQW ,ZLVKWRDFNQRZOHGJHWKHVXSSRUWRIPDQ\UHVSHFWHGSHUVRQVZKRSURYLGHGPHZLWKLQVSLUDWLRQVYDOXDEOHDGYLFHWR FRPSOHWHP\SDSHU,ZRXOGDOVROLNHWRWKDQN0U0XKDPPHG1L]DU%.IRUVXSSRUWLQJPHWRFRPSOHWHWKLVSDSHU
Sajana M. Iqbal et al. / Procedia Technology 25 (2016) 293 – 301
301
5HIHUHQFHV >@ ; :HQ DQG ; @@@3&KDUERQQLHU/%ODQF)HUDXG*$XEHUWDQG0%DUODXG³'HWHUPLQLVWLFHGJHSUHVHUYLQJUHJXODUL]DWLRQLQFRPSXWHGLPDJLQJ´,((( 7UDQVDFWLRQ,PDJH3URFHVVLQJYROQRSS )HE >@/5XGLQ/62VKHUDQG()DWHPL³1RQOLQHDUWRWDOYDULDWLRQEDVHGQRLVHUHPRYDODOJRULWKPV´3K\VLFD'YROSS >@=)DUEPDQ5)DWWDO'/LVFKLQVKLDQG56]HOLVNL³(GJHSUHVHUYLQJGHFRPSRVLWLRQVIRUPXOWLVFDOHWRQHDQGGHWDLOVPDQLSXODWLRQ´$&0 7UDQVRQ*UDSKLFVYROQRSS $XJ >@/;X&:/X
