Face Detection based on Skin Color in Image by ...

International Conference on Intelligent and Advanced Systems 2007

)DFH'HWHFWLRQEDVHGRQ6NLQ&RORULQ,PDJHE\ 1HXUDO1HWZRUNV 

$DPHU660RKDPHG@>@ ,Q WKH FRPSUHVVHG GRPDLQ FKURPLQDQFH VKDSH DQG '&7 LQIRUPDWLRQ FRHIILFLHQW ZDV FRPELQHG E\ :DQJ DQG &KDQJ >@WRDFKLHYHKLJKVSHHGIDFHGHWHFWLRQZLWKRXWGHFRGLQJRI WKHFRPSUHVVHGYLGHRLPDJH 7KH SURSRVHG WHFKQLTXH GHULYHG IURP >@ LQ WKHLU ZRUNV D GLUHFW DFFHVV FRQWHQW DQG H[WUDFWLRQ IHDWXUHV LQ FRPSUHVVHG GRPDLQLQVWHDGRISL[HOGRPDLQ7KHDOJRULWKPZRUNVGLUHFWO\ RQ WKH '&7 FRHIILFLHQW SDUDPHWHUV '&7 FRHIILFLHQW DV D IHDWXUHV EDVHG FRPSUHVVLRQ UHGXFH VSDWLDO UHGXQGDQF\ DQG FDSWXUHV WKH FRPSDFW LQIRUPDWLRQ D ERXW WKH SDWWHUQV FRORU LQIRUPDWLRQ LV XVHG DV WKH PDLQ GHWHFWLRQ FOXHV D VNLQ FRORU PRGHOLVFUHDWHGLQWKHOHYHORI\FEFUFRORUVSDFH7KHUHDVRQ IRU FKRRVLQJ &E DQG &U &RORU VSDFH WKDW WKHUH LV QR LQIRUPDWLRQ DERXW OXPLQDQFH FODVVLILFDWLRQ XVLQJ RQO\ SL[HO FKURPLQDQFH VNLQ VHJPHQWDWLRQ PD\ EHFRPH PRUH UREXVW WR

1-4244-1355-9/07/$25.00 @2007 IEEE

OLJKWLQJ YDULDWLRQV LI SL[HO OXPLQDQFH LV GLVFDUGHG DQG VSHHG XSWKHFDOFXODWLRQLQGHWHFWLQJWKHVNLQIDFHUHJLRQV 7KH REMHFWLYHV RI WKLV UHVHDUFK DUH WR GHYHORS EHWWHU QRUPDOL]DWLRQ PHWKRKG DQG DOVR DLP WR LPSURYH WKH VHJPHQWDWLRQ WKDW ZLOO DVVLVW DQG TXLFN GHWHFWLQJ IDFHV IURP LPDJHV $QG DOVR WR LPSOHPHQW D FODVVLILHU IDFH  EDVHG RQ QHXUDOQHWZRUNVIRUIDFHGHWHFWLRQ 0RVW RI WKH LQWHUHVW UHDGHU DUH UHIHUUHG WR WKH FRPSUHKDQVLYH VXUYH\ RQ IDFH GHWHFWLRQ E\ @ DQG E\ +MHOPDV DQG/RZ>@ 7KH QHZ DOJRULWKPV LQWURGXFHG FRPELQHV WZR PHWKRGV WR SHUIRUPIDVWDQGDFFXUDWHIDFHGHWHFWLRQV\VWHPZKLFKDUHD IHDWXUH EDVHG PHWKRGV DQG LPDJH EDVHG PHWKRGV WKH IHDWXUH EDVHGPHWKRGXVHGDSUHSURFHVVRURIWKHLPDJHEDVHGPHWKRG DQG JXLGHV WKH VHDUFK RI LPDJH EDVHG PHWKRGV XVLQJ QHXUDO QHWZRUNV WKDW H[DPLQH WKH IDFH FDQGLGDWH UHJLRQV LQVWHDG RI SHUIRUPLQJ KXJH VHDUFK LQ HYHU\ SDUW RI WKH WHVW LPDJH>@ +ZHLSURSRVHG([WUDFWLRQUHJLRQVRIVNLQFDQEHHLWKHUSL[HO± EDVHG >@ RU UHJLRQ EDVHG >@ >@ 7KH GLDJUDP RI RXU SURSRVHGWHFKQLTXHVLVSUHVHQWHGLQILJVNLQVHJPHQWDWLRQLV DSSOLHGXVLQJWKHSUHGHILQHGFRORUUDQJHWKUHVKROGRI &EDQG &U UDQJH ' 'LVFUHHW &RVLQH 7UDQVIHU '&7  IRU HDFK VXE EORFNLPDJHLVFRPSXWHGDQGIHDWXUHVYHFWRUDUHIRUPHGIURP WKH '&7 FRHIILFLHQWV ZKHUH '&7 FDQ EH DV VLJQDWXUH XVHIXO IRU UHFRJQLWLRQV WDVNV VXFK DV IDFLDO H[SUHVVLRQ UHFRJQLWLRQV >@>@  ,,)$&('(7(&7,21,1,0$*(  0DQ\WHFKQLTXHVIRUIDFHGHWHFWLRQLQLPDJHZHUH FODVVLILHGLQWRIRXUFDWHJRULHV x .QRZOHGJHEDVHGPHWKRG ,W GHSHQGHQFH RQ XVLQJ WKH UXOHV DERXW KXPDQ IDFLDO IHDWXUH,WLVHDV\WRFRPHXSZLWKVLPSOHUXOHVWRGHVFULEHWKH IHDWXUHVRIDIDFHDQGWKHLUUHODWLRQVKLSV)RUH[DPSOHDIDFH RIWHQDSSHDUVLQDQLPDJHZLWKWZRH\HVWKDWDUHV\PPHWULFWR HDFK RWKHU D QRVH DQG D PRXWK  DQG IHDWXUHV UHODWLYH GLVWDQFHDQGSRVLWLRQUHSUHVHQWUHODWLRQVKLSVEHWZHHQ IHDWXUH $IWHU GHWHFWLQJ IHDWXUHV YHULILFDWLRQ LV GRQH WR UHGXFH IDOVH GHWHFWLRQ 7KLV DSSURDFK LV JRRG IRU IURQWDO LPDJH WKH GLIILFXOW\ RI LW LV KRZ WR WUDQVODWH KXPDQ NQRZOHGJH LQWR NQRZQUXOHVDQGWRGHWHFWIDFHVLQGLIIHUHQWSRVHV  

~ 779

International Conference on Intelligent and Advanced Systems 2007

 x ,PDJH%DVHGPHWKRG ,QWKLVDSSURDFKWKHUHLVDSUHGHILQHGVWDQGDUGIDFHSDWWHUQ LVXVHGWRPDWFKZLWKWKHVHJPHQWVLQWKHLPDJHWRGHWHUPLQH ZKHWKHU WKH\ DUH IDFHV RU QRW ,W XVHV WUDLQLQJ DOJRULWKPV WR FODVVLI\ UHJLRQV LQWR IDFH RU QRQIDFH FODVVHV ,PDJHEDVHG WHFKQLTXHV GHSHQGV RQ PXOWLUHVROXWLRQ ZLQGRZ VFDQQLQJ WR GHWHFWIDFHVVRWKHVHWHFKQLTXHVKDYHKLJKGHWHFWLRQUDWHVEXW VORZHU WKDQ WKH IHDWXUHEDVHG WHFKQLTXHV (LJHQIDFHV DQG QHXUDOQHWZRUNVDUHH[DPSOHVRILPDJHEDVHGWHFKQLTXHV7KLV DSSURDFK KDV DGYDQWDJH RI EHLQJ VLPSOH WR LPSOHPHQW EXW LW FDQQRWHIIHFWLYHO\GHDOZLWKYDULDWLRQLQVFDOHSRVHDQGVKDSH x )HDWXUHV%DVHGPHWKRG 7KLVDSSURDFKGHSHQGVRQH[WUDFWLRQRIIDFLDOIHDWXUHVWKDW DUHQRWDIIHFWHGE\YDULDWLRQVLQOLJKWLQJFRQGLWLRQVSRVHDQG RWKHU IDFWRUV 7KHVH PHWKRGV DUH FODVVLILHG DFFRUGLQJ WR WKH H[WUDFWHG IHDWXUHV>@ )HDWXUHEDVHG WHFKQLTXHV GHSHQG RQ IHDWXUHGHULYDWLRQDQGDQDO\VLVWRJDLQWKHUHTXLUHGNQRZOHGJH DERXWIDFHV)HDWXUHVPD\EHVNLQFRORUIDFHVKDSHRUIDFLDO IHDWXUHV OLNH H\HV QRVH HWF )HDWXUH EDVHG PHWKRGV DUH SUHIHUUHG IRU UHDO WLPH V\VWHPV ZKHUH WKH PXOWLUHVROXWLRQ ZLQGRZ VFDQQLQJ XVHG E\ LPDJH EDVHG PHWKRGV DUH QRW DSSOLFDEOH +XPDQ VNLQ FRORU LV DQ HIIHFWLYH IHDWXUH XVHG WR GHWHFW IDFHV DOWKRXJK GLIIHUHQW SHRSOH KDYH GLIIHUHQW VNLQ FRORU VHYHUDO VWXGLHV KDYH VKRZQ WKDW WKH EDVLF GLIIHUHQFH EDVHGRQWKHLULQWHQVLW\UDWKHUWKDQWKHLUFKURPLQDQFH7H[WXUH V RI KXPDQ IDFHV KDYH D VSHFLDO WH[WXUH WKDW FDQ EH XVHG WR VHSDUDWH WKHP IURP GLIIHUHQW REMHFWV )DFLDO )HDWXUHV PHWKRG GHSHQGVRQGHWHFWLQJIHDWXUHVRIWKHIDFH6RPHXVHUVXVHWKH HGJHVWRGHWHFWWKHIHDWXUHVRIWKHIDFHDQGWKHQJURXSLQJWKH HGJHV 6RPH RWKHUV XVH WKH EOREV DQG WKH VWUHDNV LQVWHDG RI HGJHV)RUH[DPSOHWKHIDFHPRGHOFRQVLVWVRIWZRGDUNEOREV DQGWKUHHOLJKWEOREVWRUHSUHVHQWH\HVFKHHNERQHVDQGQRVH 7KH PRGHO XVHV VWUHDNV WR UHSUHVHQW WKH RXWOLQHV RI WKH IDFHV OLNH H\HEURZV DQG OLSV 0XOWLSOH )HDWXUHV PHWKRGV XVH VHYHUDOFRPELQHGIDFLDOIHDWXUHVWRORFDWHRUGHWHFWIDFHV)LUVW ILQGWKHIDFHE\XVLQJIHDWXUHVOLNHVNLQFRORUVL]HDQGVKDSH DQG WKHQ YHULI\LQJ WKHVH FDQGLGDWHV XVLQJ GHWDLOHG IHDWXUHV VXFKDVH\HEURZVQRVHDQGKDLU x 7HPSODWH0DWFKLQJPHWKRG 7HPSODWH PDWFKLQJ PHWKRGV XVH WKH FRUUHODWLRQ EHWZHHQ SDWWHUQ LQ WKH LQSXW LPDJH DQG VWRUHG VWDQGDUG SDWWHUQV RI D ZKROHIDFHIDFHIHDWXUHVWRGHWHUPLQHWKHSUHVHQFHRIDIDFH RU IDFH IHDWXUHV 3UHGHILQHG WHPSODWHV DV ZHOO DV GHIRUPDEOH WHPSODWHVFDQEHXVHG  ,,,)$&('(7(&7,21$/*25,7+06  ,QIRUPDWLRQRIVNLQFRORULQDFRORULPDJHLVDYHU\SRSXODU DQG XVHIXO WHFKQLTXH IRU IDFH GHWHFWLRQ 7KH REYLRXV DGYDQWDJHRIWKLV PHWKRGLVVLPSOLFLW\RIVNLQGHWHFWLRQUXOHV WKDWOHDGVWRFRQVWUXFWLRQRIDYHU\UDSLGFODVVLILHU:HFDQXVH FRORULQIRUPDWLRQDVDIHDWXUHWRLGHQWLI\DSHUVRQ¶VIDFHLQDQ LPDJH EHFDXVH KXPDQ IDFHV KDYH D VSHFLDO FRORU GLVWULEXWLRQ WKDW GLIIHUV VLJQLILFDQWO\ DOWKRXJK QRW HQWLUHO\ IURP WKRVH RI WKH EDFNJURXQG REMHFWV 3UHYLRXV VWXGLHV KDYH IRXQG WKDW SL[HOV EHORQJLQJ WR VNLQ UHJLRQ H[KLELW VLPLODU FKURPLQDQFH

780 ~

FRPSRQHQWV ZLWKLQ DQG DFURVV GLIIHUHQW KXPDQ UDFHV ,Q WKH @ ,QWKLVSDSHUZHFRQYHUWWKHLPDJHIURP5*%WR\FEFUZKHUH DUH5*%LVVHQVLWLYHWRWKHYDULDWLRQRILQWHQVLW\ 0DQ\ VNLQ GHWHFWLRQ PHWKRGV LJQRUH WKH OXPLQDQFH FRPSRQHQW RI WKH FRORU VSDFH WR DFKLHYH LQGHSHQGHQW PRGHO RIWKHGLIIHUHQFHVLQVNLQDSSHDUDQFHWKDW PD\DULVH IURPWKH GLIIHUHQFHRIKXPDQUDFHDQGDOVRUHGXFHWKHVSDFHGLPHQVLRQ $IWHU FROOHFWLQJ D GLIIHUHQW KXPDQ IDFHV DQG DQDO\]LQJ WKH KLVWRJUDP GLVWULEXWLRQ VDPSOH VNLQ FRORU YDOXHV RI FKURPLQDQFH FRPSRQHQW WR UHSUHVHQW WKH OLNHOLKRRG RI WKH SL[HOEHORQJLQJWRWKHVNLQUHJLRQ LW  ZDV IRXQG WKDW WKH FKURPLQDQFH FRPSRQHQW RI WKH VNLQ FRORU IDLOV LQ D FHUWDLQ  UDQJH ; LV VNLQ FRORU >@ LI LWV SURMHFWLRQ RQ WKH &E DQG &U SODQH LV LQVLGH SUHGHWHUPLQHG UHFWDQJOH  & E  5FE DQG  & U  5FU  LH & U d & U d & U   DQG 

& E d & E d & E  ZKHUH 5FE > & E  & E  @ DQG

International Conference on Intelligent and Advanced Systems 2007

5FU > & U  & U  @ ZKLFK DUH IRXQG H[SHULPHQWDOO\ XVHG WR HOLPLQDWHTXLFNO\QRQVNLQIDFHFRORUDQGDOVRWRLPSURYHWKH VHJPHQWDWLRQ RI VNLQ FRORU UHJLRQV )LJ VKRZV WKH GLVWULEXWLRQ KLVWRJUDP VNLQ UHJLRQV VDPSOH DQG WKH WKUHVKROG RIIRU&EDQG&UFRORUVSDFH 





D 5*%LPDJHE @ $&.12:/('*0(17 7KH$XWRUZRXOGOLNHWRWKDQN-LPDLQ-LDQJDQG@99H]KQHYHWV96D]RQRYDQG$$QGUHHYD³$VXUYH\RQSL[HOEDVHG VNLQFRORUGHWHFWLRQWHFKQLTXHV´LQ3URF*UDSKLFRQ  >@  + .UXSSD 0 $ %DXHU DQG % 6FKLHOH ³6NLQ SDWFK GHWHFWLRQ LQ UHDOZRUOGLPDJHV´LQ3URFRIWKH'$*06\PSRVLXPSS  >@   / 0D @ / 0D DQG . .KRUDVDQL ³)DFLDO H[SUHVVLRQ UHFRJQLWLRQ XVLQJ FRQVWUXFWLYH IHHGIRUZDUG QHXUDO QHWZRUNV´ ,((( 7UDQVDFWLRQV RQ 6\VWHPV 0DQDQG&\EHUQHWLFV3DUW%9RO1R-XQHSS±  >@/0D@-LDPLQ-LDQJ