Top Down Unsupervised Image Segmentation

7RS'RZQ8QVXSHUYLVHG,PDJH6HJPHQWDWLRQ LWVRXQGVOLNHDQR[\PRURQEXWDFWXDOO\LWLVQ¶W 

(PDQXHO'LDPDQW 9,',$PDQW32%.LULDW2QR,VUDHO  HPDQO#QHWLO  $EVWUDFW ± 3DWWHUQ UHFRJQLWLRQ LV JHQHUDOO\ DVVXPHG DV DQ LQWHUDFWLRQ RI WZR LQYHUVHO\ GLUHFWHG LPDJHSURFHVVLQJ VWUHDPV WKH ERWWRPXS LQIRUPDWLRQ GHWDLOVJDWKHULQJDQGORFDOL]DWLRQVHJPHQWDWLRQ VWUHDP DQG WKH WRSGRZQ LQIRUPDWLRQ IHDWXUHV DJJUHJDWLRQ DVVRFLDWLRQ DQG LQWHUSUHWDWLRQ UHFRJQLWLRQ  VWUHDP ,QVSLUHG E\ UHFHQW HYLGHQFH IURP ELRORJLFDO YLVLRQ UHVHDUFKDQGE\WKHLQVLJKWVRI.ROPRJRURY&RPSOH[LW\ WKHRU\ ZH SURSRVH D QHZ MXVW WRSGRZQ HYROYLQJ SURFHGXUH RI LQLWLDO LPDJH VHJPHQWDWLRQ :H FODLP WKDW WUDGLWLRQDO WRSGRZQ FRJQLWLYH UHDVRQLQJ ZKLFK LV VXSSRVHG WR JXLGH WKH VHJPHQWDWLRQ SURFHVV WR LWV ILQDO UHVXOW LV QRW DW DOO D SDUW RI WKH LPDJH LQIRUPDWLRQ FRQWHQWHYDOXDWLRQ $QG WKDW LQLWLDO LPDJH VHJPHQWDWLRQ LV FHUWDLQO\ DQ XQVXSHUYLVHG SURFHVV :H SUHVHQW VRPH LOOXVWUDWLYHH[DPSOHVZKLFKVXSSRUWRXUFODLPV .H\ZRUGV ±  SDWWHUQ UHFRJQLWLRQ LPDJH XQGHUVWDQGLQJ LPDJHLQIRUPDWLRQFRQWHQWGHVFULSWLRQ ,1752'8&7,21 3DWWHUQ UHFRJQLWLRQ LV JHQHUDOO\ DSSURDFKHG DV DQ LQWHUDFWLRQ RI WZR LQYHUVHO\ SURFHHGLQJ LPDJHSURFHVVLQJ VWUHDPV WKH ERWWRPXS LQIRUPDWLRQ IHDWXUHV ORFDOL]DWLRQ DQG VHJPHQWDWLRQ SURFHGXUH DQG WKH WRSGRZQ LQIRUPDWLRQ IHDWXUHV DVVRFLDWLRQ DJJUHJDWLRQDQGLQWHUSUHWDWLRQUHFRJQLWLRQ SURFHGXUH 7KH URRWV RI VXFK DQ DSSURDFK FDQ EH WUDFHG EDFN WR 7UHLVPDQ¶V )HDWXUH ,QWHJUDWLQJ 7KHRU\ >@ RU %LHGHUPDQ¶V 5HFRJQLWLRQE\FRPSRQHQWV WKHRU\ >@ %LRORJLFDO YLVLRQ KDV DOZD\V EHHQ DQ XQOLPLWHG VRXUFH RILQVSLUDWLRQIRUFRPSXWHUYLVLRQV\VWHPV GHVLJQHUV,W ZDVRQO\QDWXUDOWKDWZKHQFRPSXWHUYLVLRQVRFLHW\KDG PDWXUHG HQRXJK WR FRSH ZLWK SDWWHUQ UHFRJQLWLRQ SUREOHPV DSSURSULDWH ELRORJLFDO YLVLRQ VROXWLRQV KDYH EHHQ DFFHSWHG DQG DGRSWHG E\ WKH FRPSXWHU YLVLRQ VRFLHW\ DQG KDYH EHFRPH DQ LQGLVSHQVDEOH SDUW RI FRPSXWHUYLVLRQSUDFWLFH>@>@ +RZHYHU VWUDLJKWIRUZDUG LPLWDWLRQ RI ELRORJLFDO YLVLRQ VROXWLRQV LV QRW DOZD\V SRVVLEOH )RU H[DPSOH KRZ WKH NQRZOHGJH DERXW LQIRUPDWLRQ IHDWXUHV LQWHUUHODWLRQV IHDWXUHV¶ VHPDQWLFV XVXDOO\ DFTXLUHG LQ FRXUVH RI OHDUQLQJ DQG QDWXUDO H[SHULHQFH RI WKH OLYLQJ EHLQJV  LV PDGH DYDLODEOH WR WKH UHDVRQLQJ VWDJH RI D

FRPSXWHU YLVLRQ V\VWHP" +RZ WKLV H[WHUQDO NQRZOHGJH LV LQFRUSRUDWHG LQWR WKH VHJPHQWDWLRQ DQG SDWWHUQ LGHQWLILFDWLRQSURFHVVHV" 67$7(2)7+($57 &RQWHPSRUDU\ FRPSXWHU YLVLRQ V\VWHPV GRQ¶W KDYH FOHDUDQVZHUVWRWKHVHTXHVWLRQV6RPHRI WKHP UHO\ RQ H[SHUWNQRZOHGJHVTXHH]HGDQGUHVWULFWHG WR D VSHFLILF DSSOLFDWLRQ  ZKLFK LV LPSULQWHG LQWR WKH V\VWHP DW WKH GHVLJQ WLPH 6RPH DWWHPSW WR SURYLGH OLPLWHG LQLWLDO WUDLQLQJ DQG FRQFHSWUHVWULFWHG DGDSWDWLRQ IDFLOLWLHV +RZHYHU WKH EDVLF SULQFLSOH RI D ERWWRPXS LQLWLDO LQIRUPDWLRQFRQWHQWJDWKHULQJUHPDLQVLQYDULDEOH $FFRUGLQJ WR WKLV SULQFLSOH ORZOHYHO HOHPHQWDU\ LQIRUPDWLRQSLHFHVDUHILUVWVHDUFKHGDQGHYDOXDWHGRYHU WKH HQWLUH LPDJH VSDFH 7KHQ WKH\ DUH JURXSHG DQG DJJUHJDWHG LQWR ODUJHU DQG PRUH FRPSOH[ DJJORPHUDWLRQV ZKLFK DUH IHG WR WKH KLJKHU V\VWHP OHYHOVIRUIDUWKHUJHQHUDOL]DWLRQFODVVLILFDWLRQDQGRWKHU KLJKHUOHYHO SURFHVVLQJ >@ 7R DFFRPPRGDWH IRU H[WHUQDO XVHU RU V\VWHP  UHTXLUHPHQWV WKDW LV WR LQFRUSRUDWHWKHUXOHVDQGSULQFLSOHVE\ZKLFKGLVRUGHUHG LQIRUPDWLRQ SLHFHV DUH FRPELQHG DQG DJJORPHUDWHG D WRSGRZQFRQWUROIORZLVJHQHUDOO\DVVXPHG,WVDLPLVWR PHGLDWH WKH ERWWRPXS LQIRUPDWLRQ JDWKHULQJ ,W LV JHQHUDOO\EHOLHYHGWKDWWKLVVXSHUYLVHGLQWHUYHQWLRQRID WRSGRZQFRQVFLRXVFRQWUROZLOOOHDGWRDPRUHVXLWDEOH DQG PRUH WDVNILWWLQJ ORZOHYHO LQIRUPDWLRQ IHDWXUHV DFTXLVLWLRQ>@>@ 7KHUHLVQRQHHGWRVD\WKDWVXFKDQDSSURDFKZKHUH HYHU\ SL[HO ZLWKLQ DQ LPDJH PXVW EH YLVLWHG DQG LQYHVWLJDWHGDWWKHSUHSURFHVVLQJVWDJHFDQQRWIDLWKIXOO\ VHUYH WKH WRXJK UHTXLUHPHQWV RI WKH PRGHUQ YLVLRQ V\VWHPV ,W LV DOVR KDUG WR EHOLHYH WKDW LQ FRXUVH RI QDWXUDO HYROXWLRQ VXFK DQ DZNZDUG DQG LQHIILFLHQW PHFKDQLVPKDVEHHQVXUYLYHGDQGVXVWDLQHG WKH QDWXUDO VHOHFWLRQ $',))(5(17$3352$&+ 1HZ HYLGHQFH IURP ELRORJLFDO YLVLRQ UHVHDUFK ZKLFK EHFDPHDYDLODEOHLQWKHUHFHQW\HDUVSXWWKHFRUUHFWQHVV RI WKH WUDGLWLRQDO DSSURDFK LQ GRXEWV 7R SURSHUO\ XQGHUVWDQGWKHSRLQWDFRXSOHRIZRUGVPXVWEHVSHQWRQ

KXPDQ YLVLRQ SHFXOLDULWLHV +XPDQ H\H¶V UHWLQD LV D EL]DUUHVWUXFWXUH±RQO\DVPDOOIUDFWLRQRILWVYLHZILHOG DSSUR[LPDWHO\RXWRIWKHHQWLUHILHOGRI>@ LV GHQVHO\ SRSXODWHG ZLWK SKRWRUHFHSWRUV -XVW WKLV VPDOO IUDJPHQW RI WKH UHWLQD WKH VRFDOOHG IRYHD  LV UHVSRQVLEOH IRU RXU DELOLW\ WR VHH D VKDUS DQG FOHDU SLFWXUH RI WKH VXUURXQGLQJ ZRUOG 7KH UHVW RI WKH YLHZ ILHOG LV D IDVW GHVFHQGLQJ LQ VSDWLDO GHQVLW\  SODFHPHQW RIOLJKWVHQVLWLYHSKRWRUHFHSWRUV7RFRPSHQVDWHIRUWKH ODFN RI UHVROXWLRQ RYHU WKH HQWLUH ILHOG FRQWLQXRXV H\H PRYHPHQWVDOVRNQRZQDVH\HVDFFDGHV DUHSHUIRUPHG VHTXHQWLDOO\ SODFLQJ WKH KLJKUHVROXWLRQ IRYHD RYHU YDULRXVVFHQHORFDWLRQV $FFRUGLQJWRDWWHQWLRQYLVLRQWKHRULHVWKHGHFLVLRQWR PDNH D VDFFDGH DQG WR IL[ WKH IRYHD RYHU D QHZ LPDJH ORFDWLRQ SUHFHGHV WKH KLJKUHVROXWLRQ ORZOHYHO  LPDJH LQIRUPDWLRQJDWKHULQJDQGKHQFHLWFDQEH\LHOGHGRQO\ E\ WKH FRDUVH DQG SRRU LQIRUPDWLRQ GHOLYHUHG IURP WKH SHULSKHUDO YLVLRQ DUHDV 7KH IORZ RI QHZ HYLGHQFH FRQYLQFLQJO\ VXSSRUWV WKLV XQXVXDO K\SRWKHVLV YLVXDO UHFRJQLWLRQFDWHJRUL]DWLRQ WDVNV XVH ³H[SUHVV´ EXW FRPSDUDWLYHO\ LPSUHFLVH DQG FRDUVHVFDOH UHSUHVHQWDWLRQVEHIRUHWKHILQHVFDOHUHSUHVHQWDWLRQVDUH DFTXLUHG >@ WKH ILUVW VLJQDOV UHDFKLQJ WKH KLJKHVW SURFHVVLQJOHYHOVDUHIURPWKHH\H¶VSHULSKHU\QRWIURP WKH IRYHD >@ 1RW OHVV VXUSULVLQJ LV WKH HYLGHQFH WKDW WUDGLWLRQDO DVVXPSWLRQV DERXW WRSGRZQ LQWHUYHQWLRQ IURPWKHXSSHUFRJQLWLYHOHYHOVVLPSO\GRQRWKROGKHUH ,Q PRVW RI WKH FDVHV VDFFDGLF PRYHPHQWV DUH JXLGHG SUHDWWHQWLYHO\ DQG XQFRQVFLRXVO\ ,Q FRPSXWHU YLVLRQ WHUPLQRORJ\WKDWPHDQVWKDWLQLWLDOLQIRUPDWLRQJDWKHULQJ LV GHILQLWHO\ D WRSGRZQ SURFHVV EXW WKH WHUP ³WRSGRZQ´KDVKHUHDTXLWHGLIIHUHQWLQWHUSUHWDWLRQ7KH QHZ WRSGRZQ VHJPHQWDWLRQ SURFHGXUH GHILQLWHO\ FRPPHQFHV ZLWK D VTXHH]HG DQG VLPSOLILHG LPDJH UHSUHVHQWDWLRQGHOLYHUHGE\WKHH\H¶VSHULSKHU\ DQGWKH UHTXLUHGLQIRUPDWLRQGHWDLOVDUHXQYHLOHGJUDGXDOO\DWWKH ORZHU IRYHD FORVHU LQIRUPDWLRQ ULFK  UHSUHVHQWDWLRQ OHYHOV>@ 8QGHUSLQQLQJ WKHRUHWLFDO IRUPDOL]DWLRQ RI WKH REVHUYHG ELRORJLFDO HYLGHQFH FDQ EH GHGXFHG IURP WKH .ROPRJRURY&RPSOH[LW\WKHRU\>@2ULJLQDOO\GHYLVHG WRH[SORUHWKHQRWLRQRIUDQGRPQHVVLWKDVLQWURGXFHGD QHZ GHILQLWLRQ RI LQIRUPDWLRQ FRQWHQW &RQWUDU\ WR WKH ZHOONQRZQ DQG XELTXLWRXVO\ H[SORLWHG 6KDQQRQ¶V GHILQLWLRQZKLFKFDQEHVHHQDVDQDYHUDJHLQIRUPDWLRQ DYHUDJH UDQGRPQHVV  RYHU WKH ZKROH HQVHPEOH .ROPRJRURYFRPSOH[LW\DOORZVWRGHDOZLWKWKHTXDQWLW\ RI LQIRUPDWLRQ LQ LQGLYLGXDO REMHFWV :H EULHIO\ VXPPDUL]H WKH SULQFLSDO FODLPV RI .ROPRJRURY FRPSOH[LW\ WKHRU\ VOLJKWO\ WZLVWHG WR ILW WKH FDVH RI LPDJHLQIRUPDWLRQFRQWHQWH[SORUDWLRQ  N ,PDJH LQIRUPDWLRQ FRQWHQW LV D VHW RI GHVFULSWLRQVRIWKHREVHUYDEOHLPDJHGDWDVWUXFWXUHV

N

7KHVH GHVFULSWLRQV DUH H[HFXWDEOH WKDW LV IROORZLQJ WKHP WKH PHDQLQJIXO SDUW RI LPDJH FRQWHQWFDQEHIDLWKIXOO\UHFRQVWUXFWHG N 7KHVH GHVFULSWLRQV DUH KLHUDUFKLFDO DQG UHFXUVLYH WKDW LV VWDUWLQJ ZLWK D JHQHUDOL]HG DQG VLPSOLILHG GHVFULSWLRQ RI LPDJH VWUXFWXUH WKH\ SURFHHG LQ D WRSGRZQ IDVKLRQ WR PRUH DQG PRUH ILQH LQIRUPDWLRQ GHWDLOV UHVROYHG DW ORZHU GHVFULSWLRQOHYHOV N $OWKRXJKWKHORZHUERXQGRIGHVFULSWLRQGHWDLOV LVXQDWWDLQDEOHWKDWGRHVQRWSRVHDVHULRXVSUREOHP EHFDXVH LQIRUPDWLRQ FRQWHQW FRPSUHKHQVLRQ LV JHQHUDOO\ILQHGHWDLOVGHYRLG 0RUH ULJRURXV SUHVHQWDWLRQ RI WKHVH VXEMHFWV FDQ EH ILQGLQQXPHURXVWKHPHUHODWHGSXEOLFDWLRQV>±@ ,03/(0(17$7,21 )ROORZLQJ WKH PRGHUQ FRQFHSWV RI VHOHFWLYH DWWHQWLRQ YLVLRQ DQG WKH LQVLJKWV RI .ROPRJRURY &RPSOH[LW\ WKHRU\ ZH GDUH WR SURSRVH D QHZ VFKHPH IRU LQIRUPDWLRQFRQWHQWJDWKHULQJ,WVDUFKLWHFWXUHLVVKRZQ LQ)LJXUHDQGLWLVFRPSULVHGRIWKUHHPDLQSURFHVVLQJ SDWKV WKH ERWWRPXS SURFHVVLQJ SDWK WKH WRSGRZQ SURFHVVLQJ SDWK DQG D VWDFN ZKHUH WKH GLVFRYHUHG LQIRUPDWLRQFRQWHQWWKHJHQHUDWHGGHVFULSWLRQVRILW DUH DFWXDOO\DFFXPXODWHG 7R IDFLOLWDWH WKH UHTXLUHPHQW IRU D WRSGRZQ GLUHFWHG SURFHVVLQJ ZH LQWURGXFH D KLHUDUFK\ RI PXOWLOHYHO PXOWLUHVROXWLRQ LPDJH UHSUHVHQWDWLRQV FDOOHG PXOWLVWDJH LPDJH S\UDPLG >@ 6XFK S\UDPLG FRQVWUXFWLRQJHQHUDWHVDVHWRIFRPSUHVVHGFRSLHVRIWKH RULJLQDOLQSXWLPDJH(DFKLPDJHLQWKHVHTXHQFHFDQEH VHHQDVDQDUUD\HDFKGLPHQVLRQRIZKLFKLVKDOIDVODUJH DVLWVSUHGHFHVVRU7KHUXOHVRIWKLVVKULQNLQJRSHUDWLRQ DUH YHU\ VLPSOH DQG IDVW IRXU QRQRYHUODSSLQJ QHLJKERXUSL[HOVLQDQLPDJHDWOHYHO/DUHDYHUDJHGDQG WKH UHVXOW LV DVVLJQHG WR D SL[HO LQ D KLJKHU / OHYHO LPDJH 7KLV LV NQRZQ DV ³IRXU FKLOGUHQ WR RQH SDUHQW UHODWLRQVKLS´ $W WKH WRS RI WKH S\UDPLG WKH UHVXOWLQJ FRDUVH LPDJH XQGHUJRHV D URXQG RI IXUWKHU VLPSOLILFDWLRQ 6HYHUDO LPDJH ]RQHV UHSUHVHQWLQJ SHUFHSWXDOO\ GLVFHUQLEOH LPDJH IUDFWLRQV YLVXDOO\ GRPLQDWHG LPDJH SDUWV VXSHUREMHFWV  DUH GHWHUPLQHG VHJPHQWHG  DQG LGHQWLILHG E\ DVVLJQLQJ ODEHOV WR HDFK RI WKH VHJPHQWHG SLHFHV 6LQFH WKH LPDJH VL]H DW WKH WRS LV VLJQLILFDQWO\ UHGXFHGDQGVLQFHLQWKHFRXUVHRIWKHERWWRPXSLPDJH VTXHH]LQJDVHYHUHGDWDDYHUDJLQJLVDWWDLQHGWKHLPDJH VHJPHQWDWLRQFODVVLILFDWLRQ SURFHGXUH GRHV QRW GHPDQG VSHFLDO FRPSXWDWLRQDO UHVRXUFHV 7KXV DQ\ ZHOONQRZQ VHJPHQWDWLRQPHWKRGRORJ\ZLOOVXIILFH:HXVHRXURZQ SURSULHWDU\WHFKQLTXHWKDWLVEDVHGRQDORZOHYHOORFDO LQIRUPDWLRQFRQWHQWHYDOXDWLRQ>@

%RWWRPXSSDWK

7RSGRZQSDWK

/DVWWRS OHYHO WRFRPSUVG LPDJH

WRFRPSUHVVHG LPDJH

6HJPHQWDWLRQ &ODVVLILFDWLRQ

/HYHOQ

2EMHFWVKDSHV /DEHOHGREMHFWV

2EMHFWOLVW

7RSOHYHOREMHFWGHVFULSWRUV

WRH[SDQGHG REMHFWPDSV

/HYHOQREMHFWV

 WRFRPSUHVVHG LPDJH

2ULJLQDOLPDJH

/HYHO

/HYHO

WRH[SDQGHG REMHFWPDSV

/HYOREM

WRH[SDQGHG REMHFWPDSV

/

)LJ7KH%ORFN'LDJUDP6FKHPD RIWKHSURSRVHGDSSURDFK 7KLV WHFKQLTXH ILUVW RXWOLQHV WKH ERUGHUV RI WKH SULQFLSDO LPDJH IUDJPHQWV 7KHQ VLPLODUO\ DSSHDULQJ SL[HOV ZLWKLQ WKH ERUGHUV DUH DJJUHJDWHG LQ FRPSDFW VSDWLDOO\ FRQQHFWHG UHJLRQDO JURXSV FOXVWHUV  $IWHUZDUGVHYHU\FOXVWHULVPDUNHGZLWKDODEHO7KXVD PDS RI ODEHOHG FOXVWHUV FRUUHVSRQGLQJ WR SHUFHSWXDOO\ GLVFHUQLEOH LPDJH UHJLRQV LV SURGXFHG )LQDOO\ WR DFFRPSOLVK WRSOHYHO REMHFW LGHQWLILFDWLRQ IRU HDFK ODEHOHGUHJLRQLWVFKDUDFWHULVWLFLQWHQVLW\LVFRPSXWHGDV DQ DYHUDJH RI ODEHOHG SL[HOV 7KLV ZD\ D VHFRQG DGGLWLRQDO  VHJPHQWDWLRQ PDS LV SURGXFHG ZKHUH UHJLRQVDUHUHSUHVHQWHGE\WKHLUFKDUDFWHULVWLFLQWHQVLWLHV )URP WKLV SRLQW RQ WKH WRSGRZQ SURFHVVLQJ SDWK LV FRPPHQFHG $W HDFK OHYHO WKH WZR SUHYLRXVO\ GHILQHG PDSVDUHH[SDQGHGWRWKHVL]HRIWKHLPDJHDWWKHQHDUHVW ORZHUOHYHO7KHH[SDQVLRQUXOHLVYHU\VLPSOHWKHYDOXH RIHDFKSDUHQWSL[HOLVDVVLJQHGWRLWVIRXUFKLOGUHQLQWKH FRUUHVSRQGLQJ ORZHUOHYHO PDS D UHYHUVHG VKULQNLQJ RSHUDWLRQ  6LQFH WKH UHJLRQV DW GLIIHUHQW KLHUDUFKLFDO OHYHOV GR QRW H[KLELW VLJQLILFDQW FKDQJHV LQ WKHLU FKDUDFWHULVWLF LQWHQVLW\ WKH PDMRULW\ RI QHZO\ DVVLJQHG SL[HOV DUH GHWHUPLQHG LQ D VXIILFLHQWO\ FRUUHFW PDQQHU 2QO\ SL[HOV DW UHJLRQ ERUGHUV DQG VHHGV RI QHZO\ HPHUJLQJ UHJLRQV  PD\ VLJQLILFDQWO\ GHYLDWH IURP WKH DVVLJQHGYDOXHV7DNLQJWKHFRUUHVSRQGLQJFXUUHQWOHYHO LPDJH DV D UHIHUHQFH WKH OHIW VLGH ERWWRPXS SDWK EHORQJLQJ LPDJHV  WKHVH SL[HOV FDQ EH HDVLO\ GHWHFWHG DQG VXEMHFWHG WR D UHILQHPHQW F\FOH +HUH WKH\ DUH DOORZHG WR DGMXVW WKHPVHOYHV WR WKH ³SURSHU´ QHDUHVW QHLJKERUV ZKLFK FHUWDLQO\ EHORQJ WR RQH RI WKH

SUHYLRXVO\ ODEHOHG UHJLRQV RU WR WKH QHZO\ HPHUJLQJ RQHV  ,QVXFKDPDQQHUWKHSURFHVVLVVXEVHTXHQWO\UHSHDWHG DW DOO GHVFHQGLQJ OHYHOV XQWLO WKH VHJPHQWDWLRQFODVVLILFDWLRQ RI WKH ]HUROHYHO RULJLQDO LQSXW LPDJH  LV VXFFHVVIXOO\ DFFRPSOLVKHG $W HYHU\ SURFHVVLQJ OHYHO HYHU\ LPDJH REMHFWUHJLRQ MXVW UHFRYHUHG RU DQ LQKHULWHG RQH  LV UHJLVWHUHG LQ WKH REMHFWV¶ DSSHDUDQFH OLVW ZKLFK LV WKH WKLUG FRQVWLWXWLQJ SDUW RI WKH SURSRVHG VFKHPH 7KH UHJLVWHUHG REMHFW SDUDPHWHUV DUH WKH DYDLODEOH VLPSOLILHG REMHFW¶V DWWULEXWHVVXFKDVVL]HFHQWHURIPDVVSRVLWLRQDYHUDJH REMHFW LQWHQVLW\ DQG KLHUDUFKLFDO DQG WRSRORJLFDO UHODWLRQVKLS ZLWKLQ DQG EHWZHHQ WKH REMHFWV ³VXESDUW RI«´³DWWKHOHIWRI«´HWF 7KH\DUHVSDUVHJHQHUDO DQG \HW VSHFLILF HQRXJK WR FDSWXUH WKH REMHFW¶V FKDUDFWHULVWLFIHDWXUHVLQDYDULHW\RIGHVFULSWLYHIRUPV (;3(5,0(17$/5(68/76 7RLOOXVWUDWHWKHTXDOLWLHVRIWKHSURSRVHGDSSURDFKZH KDYHFKRVHQDQ$HULDO9LHZRIWKH/XSD&HQWHUIURPWKH 1$6$*ULQ&ROOHFWLRQ>@ )LJUHSUHVHQWVWKHRULJLQDOLPDJH)LJV  DQG  GHPRQVWUDWH KRZ WKH RULJLQDO LPDJH LV GHFRPSRVHG E\ WKH SURSRVHG URXWLQH WR UHJLRQV RI YDULRXV GHWDLO GHVFULSWLRQ FRPSOH[LW\/HYHO  )LJ   FRUUHVSRQGV WR WKH QHDU WKH WRSPRVW KLHUDUFKLFDO OHYHO WKLV SDUWLFXODU LPDJHUHVXOWVLQDOHYHOKLHUDUFK\ /HYHO)LJ LV WKHORZHUHQGFORVHVWGHFRPSRVLWLRQ



)LJ2ULJLQDOLPDJHVL]H[SL[HOV

)LJ/HYHOVHJPHQWDWLRQUHJLRQV

)LJ/HYHOVHJPHQWDWLRQUHJLRQV

)LJ/HYHOVHJPHQWDWLRQUHJLRQV

)RUVSDFHVDYLQJZHSURYLGHRQO\IHZH[DPSOHVIURP WKH LPDJH VHJPHQWDWLRQ JDOOHU\ ZKLFK IRU WKH UHDGHU¶V FRQYHQLHQFHDUHDOOH[SDQGHGWRWKHRULJLQDOLPDJHVL]H ([WUDFWHG IURP WKH REMHFW OLVW WKH QXPEHUV RI GLVWLQJXLVKHG VHJPHQWHG  DW HDFK FRUUHVSRQGLQJ OHYHO UHJLRQVDUHDOVRJLYHQLQHDFKILJXUHFDSWXUH %HFDXVHLQRXUDSSURDFKWKHUHDOWDUJHWREMHFWVDUHQRW NQRZQ LQ DGYDQFH RQO\ WKH JHQHUDOL]HG LQWHQVLW\ PDSV RI WKH SRVVLEOH UHJLRQV  DUH SUHVHQWHG (YHU\ RQH FDQ VHH WKDW WKH VLPSOLILHG UHSUHVHQWDWLRQ LV VXIILFLHQW WR JUDVSWKHLPDJHFRQFHSWWKDWLVWRLQWHUSUHWWKHSURYLGHG LPDJHLQIRUPDWLRQFRQWHQW,WLVQRZHDV\IRUWKHXVHUWR GHILQHZKDWUHJLRQFRPELQDWLRQGHSLFWVWKHWDUJHWREMHFW PRVWIDLWKIXOO\DQGWKHQXVLQJWKHUHVWRIWKHDYDLODEOH GHVFULSWLRQVQRWVKRZQKHUHEXWFRQWDLQHGLQWKHREMHFW OLVW WRPDNHDFRPSDULVRQDQDO\VLVIRUVXFFHVVIXOWDUJHW LGHQWLILFDWLRQ &21&/86,216 :H KDYH SURSRVHG D QHZ UHJLRQEDVHG LQIRUPDWLRQ FRQWHQW GHVFULSWLRQ DSSURDFK ZKLFK VROHO\ UHOLHV RQ D WRSGRZQ SURFHVVLQJ PHWKRGRORJ\ &RQWUDU\ WR

WUDGLWLRQDO DSSURDFKHV ZKLFK UHO\ RQ D ERWWRPXS UHVRXUFH H[KDXVWLYH  SURFHVVLQJ DQG RQ D WRSGRZQ PHGLDWLQJ LQWHUYHQWLRQ LQWHQGHG IRU XVHU¶V H[WHUQDO NQRZOHGJH LQFRUSRUDWLRQ  RXU SURSRVHG VFKHPD LV DQ HQWLUHO\ WRSGRZQ HYROYLQJ SURFHGXUH WKDW PHDQV FRQVLGHUDEOH FRPSXWDWLRQDO ORDG VKULQNLQJ LV DWWDLQHG  ZKLFK LV LQGLIIHUHQW WR DQ\ XVHU RU WDVNUHODWHG UHTXLUHPHQWV 8ELTXLWRXV FODLPV IRU ³XQVXSHUYLVHG´ RU ³DXWRPDWLF´ LPDJH VHJPHQWDWLRQ WHFKQLTXHV PXVW EH PRGHVWO\ SXW DVLGH ,Q VSLWH RI WKH IDFW WKDW RXU WRSGRZQ UHJLRQ GHFRPSRVLWLRQ VHJPHQWDWLRQ  LV GHILQLWHO\ XVHU LQGHSHQGHQW DQG XQVXSHUYLVHG WKH ILQDO GHFLVLRQ DERXW WKH VHJPHQWHG UHJLRQ LPSRUWDQFH LV DQ LQGLVSXWDEOH XVHU¶V SUHURJDWLYH &RQWUDU\ WR WUDGLWLRQDO DSSURDFKHV ZH SXW LW H[WHUQDO WR WKH VHJPHQWDWLRQ SDWK $W HDFK VHJPHQWDWLRQ OHYHO WKH UHVXOWLQJ UHJLRQ GHVFULSWLRQV IURPWKHREMHFWOLVWZKLFKLVDSDUWRIWKHVFKHPH DUH DYDLODEOHWRWKHXVHURUWRWKHV\VWHP¶VGHFLVLRQPDNLQJ XQLW  IRU IXUWKHU DQDO\VLV FRPSDULVRQ DQG ILQDO REMHFW UHJLRQ SDWWHUQ  UHFRJQLWLRQ FODVVLILFDWLRQ GHWHUPLQDWLRQLQWHUSUHWDWLRQHWF 

5()(5(1&(6

$7UHLVPDQDQG**HODGH³$IHDWXUHLQWHJUDWLRQWKHRU\ RI DWWHQWLRQ´&RJQLWLYH 3V\FKRORJ\  SS  -DQ  [2] , %LHGHUPDQ ³5HFRJQLWLRQE\FRPSRQHQWV $ WKHRU\ RI KXPDQLPDJHXQGHUVWDQGLQJ´3V\FKRORJLFDO5HYLHZYRO 1RSS [3]