Cluster analysis on data streams becomes more difficult, because the ... Data stream is also an appropriate model for access to large data sets stored in ...
&OXVWHULQJ&DWHJRULFDO'DWD6WUHDPV
=HQJ\RX+H ;LDRIHL;X 6KHQJFKXQ'HQJ -RVKXD=KH[XH+XDQJ
'HSDUWPHQWRI&RPSXWHU6FLHQFHDQG(QJLQHHULQJ+DUELQ,QVWLWXWHRI7HFKQRORJ\ :HVW'D]KL6WUHHW32%R[ +DUELQ35&KLQD ]HQJ\RXKH#\DKRRFRP^[LDRIHLGVF`#KLWHGXFQ (%XVLQHVV7HFKQRORJ\,QVWLWXWH7KH8QLYHUVLW\RI+RQJ.RQJ3RNIXODP+RQJ.RQJ 35&KLQD MKXDQJ#HWLKNXKN
5HFHLYHG;; DFFHSWHGLQUHYLVHGIRUP;;
$EVWUDFW 7KH GDWD VWUHDP PRGHO KDV EHHQ GHILQHG IRU QHZ FODVVHV RI DSSOLFDWLRQV LQYROYLQJ
PDVVLYHGDWDEHLQJJHQHUDWHGDWDIDVWSDFH:HEFOLFNVWUHDPDQDO\VLVDQGGHWHFWLRQRIQHWZRUN LQWUXVLRQVDUHWZRH[DPSOHV&OXVWHUDQDO\VLVRQGDWDVWUHDPVEHFRPHVPRUHGLIILFXOWEHFDXVHWKH GDWDREMHFWVLQDGDWDVWUHDP PXVWEHDFFHVVHGLQRUGHUDQGFDQEHUHDGRQO\RQFHRUIHZWLPHV ZLWKOLPLWHGUHVRXUFHV5HFHQWO\DIHZFOXVWHULQJDOJRULWKPVKDYHEHHQGHYHORSHGIRUDQDO\]LQJ QXPHULF GDWD VWUHDPV +RZHYHU WR RXU NQRZOHGJH WR GDWH QR DOJRULWKP H[LVWV IRU FOXVWHULQJ FDWHJRULFDOGDWDVWUHDPV,QWKLVSDSHUZHSURSRVHDQHIILFLHQWFOXVWHULQJDOJRULWKPIRUDQDO\]LQJ FDWHJRULFDO GDWD VWUHDPV ,W KDV EHHQ SURYHG WKDW WKH SURSRVHG DOJRULWKP XVHV VPDOO PHPRU\ IRRWSULQWV:HSURYLGHHPSLULFDODQDO\VLVRQWKHSHUIRUPDQFHRIWKHDOJRULWKPLQFOXVWHULQJERWK V\QWKHWLFDQGUHDOGDWDVWUHDPV .H\ZRUGV&OXVWHULQJ&DWHJRULFDO'DWD'DWD6WUHDP'DWD0LQLQJ
,QWURGXFWLRQ
)RU PDQ\ UHFHQW DSSOLFDWLRQV WKH FRQFHSW RI GDWD VWUHDP LV PRUH DSSURSULDWH WKDQ WKDW RI GDWDVHW %\QDWXUHDVWRUHGGDWDVHWLVDQDSSURSULDWHPRGHOZKHQVLJQLILFDQWSRUWLRQVRIWKHGDWD DUHTXHULHGUHSHDWHGO\DQGXSGDWHRIGDWDLVUHODWLYHO\LQIUHTXHQW,QFRQWUDVWDGDWDVWUHDPLVDQ DSSURSULDWHPRGHOZKHQDODUJHYROXPHRIGDWDLVDUULYLQJFRQWLQXRXVO\,WLVHLWKHUXQQHFHVVDU\RU LPSUDFWLFDOWRVWRUHDOODUULYLQJGDWDLQVRPHIRUPV)RUH[DPSOHFDOOGDWDDUULYLQJDWVZLWFKHVRID WHOHFRPPXQLFDWLRQ QHWZRUN DQG :HE ORJV LQ D :HE VHUYHU DOO EHORQJ WR GDWD VWUHDPV ,Q WKHVH DSSOLFDWLRQV GHFLVLRQV KDYH WR EH PDGH DW WLPHV ZKHQ LPSRUWDQW HYHQWV RFFXU 3URFHVVLQJ DFFXPXODWHGGDWDSHULRGLFDOO\E\EDWFKHVDVRWKHUGDWDPLQLQJDSSOLFDWLRQVLVXVXDOO\QRWDOORZHG 'DWDVWUHDPLVDOVRDQDSSURSULDWHPRGHOIRUDFFHVVWRODUJHGDWDVHWVVWRUHGLQVHFRQGDU\PHPRU\ ZKHUHSHUIRUPDQFHUHTXLUHPHQWVQHFHVVLWDWHOLQHDUVFDQV>@ ,QWKHGDWDVWUHDPPRGHOGDWDSRLQWVFDQRQO\EHDFFHVVHGLQWKHRUGHURIWKHLUDUULYDOVDQG UDQGRP DFFHVV LV QRW DOORZHG 7KH VSDFH DYDLODEOH WR VWRUH GDWD VWUHDPV LV RIWHQ QRW HQRXJK EHFDXVH RI WKH YROXPH RI XQERXQGHG VWUHDPLQJ GDWD SRLQWV +RZ WR HIIHFWLYHO\ RUJDQL]H DQG HIILFLHQWO\H[WUDFWXVHIXOLQIRUPDWLRQIURPDGDWDVWUHDPLVDSUREOHPWKDWKDVDWWUDFWHGUHVHDUFKHUV
&RUUHVSRQGLQJDXWKRU 7HO H[W
IURPPDQ\ILHOGV$OWKRXJKWKHUHDUHPDQ\DOJRULWKPVIRUGDWDPLQLQJWKH\DUHQRWGHVLJQHGIRU GDWDVWUHDPV>@ 7RSURFHVVKLJKYROXPHRSHQHQGHGGDWDVWUHDPVDQDOJRULWKPKDVWRPHHWVRPHVWULQJHQW FULWHULD ,Q >@ 'RPLQJRV SUHVHQWV D VHULHV RI GHVLJQHG FULWHULD IRU VXFK DOJRULWKP ZKLFK DUH VXPPDUL]HGDVIROORZV 7KHWLPHQHHGHGE\WKHDOJRULWKPWRSURFHVVHDFKGDWDUHFRUGLQWKHVWUHDPPXVWEHVPDOODQG FRQVWDQW RWKHUZLVHLWLVLPSRVVLEOHIRUWKHDOJRULWKPWRFDWFKXSWKHSDFHRIWKHGDWD 5HJDUGOHVVRIWKHQXPEHURIUHFRUGVWKHDOJRULWKPKDVVHHQWKHDPRXQWRIPDLQPHPRU\XVHG
PXVWEHIL[HG
,W PXVW EH D RQHSDVV DOJRULWKP VLQFH LQ PRVW DSSOLFDWLRQV HLWKHU WKH QHZ GDWD LV QRW \HW
DYDLODEOHRUWKHUHLVQRWLPHWRUHYLVLWROGGDWD
,W PXVW KDYH WKH DELOLW\ WR PDNH D XVDEOH PRGHO DYDLODEOH DW DQ\ WLPH VLQFH ZH PD\ QHYHU
PHHWWKHHQGRIWKHVWUHDP
7KH PRGHO PXVW EH XSWRGDWH DW DQ\ SRLQW LQ WLPH WKDW LV WR VD\ LW PXVW NHHS XS ZLWK WKH
FKDQJHVRIWKHGDWD
7KHILUVWWZRFULWHULDDUHPRVWLPSRUWDQWDQGKDUGWRDFKLHYH$OWKRXJKPXFKZRUNKDVEHHQ GRQHRQVFDODEOHGDWDPLQLQJDOJRULWKPVPRVWDOJRULWKPVUHTXLUHDORWRIPDLQPHPRU\WRKDQGOH WKHGDWDDQGWKHFRPSXWDWLRQFRPSOH[LW\RIWKHVHDOJRULWKPVLQFUHDVHVQRQOLQHDUO\DVWKHGDWDVL]H LQFUHDVHV7KHUHIRUHWKHVHDOJRULWKPVDUHXQDEOHWRFRSHZLWKGDWDVWUHDPVEHFDXVHPRVWRIWKHP ZLOOH[KDXVWDOODYDLODEOHPDLQPHPRU\RUIDOOEHKLQGWKHGDWD>@ &OXVWHULQJKDVEHHQXVHGDVDQHIIHFWLYHWHFKQLTXHIRUGHDOLQJZLWKGDWDVWUHDPV$FOXVWHULQJ DOJRULWKP GLYLGHV GDWD LQWR VXEVHWV VR WKDW WKH LQWUDFOXVWHU VLPLODULW\ LV PD[LPL]HG ZKLOH WKH LQWHUFOXVWHU VLPLODULW\ LV PLQLPL]HG 6RPH UHFHQW ZRUN RQ GHVLJQLQJ FOXVWHULQJ DOJRULWKPV IRU GDWD VWUHDPV KDV EHHQ IRFXVHG RQ QXPHULF GDWD VWUHDPV LH WKH GDWD LWHPV DUH QXPHULF YDOXHV +RZHYHU FOXVWHULQJ DOJRULWKPV IRU FDWHJRULFDO GDWD VWUHDPV DUH DOVR YHU\ LPSRUWDQW IRU UHDO DSSOLFDWLRQVVXFKDV:HEFOLFNVWUHDPDQDO\VLVDQGLQIRUPDWLRQFRQWHQWVHFXULW\7RWKHEHVWRIRXU NQRZOHGJHWKHUHLVQRSXEOLVKHGZRUNRQKRZWRFOXVWHUFDWHJRULFDOGDWDVWUHDPV,QWKLVSDSHU ZHSURSRVHDQHIILFLHQWFOXVWHULQJDOJRULWKPIRUDQDO\]LQJFDWHJRULFDOGDWDVWUHDPV:HVKRZWKDW WKH SURSRVHG DOJRULWKP KDV VPDOO PHPRU\ IRRWSULQWV :H SURYLGH HPSLULFDO DQDO\VLV RQ WKH SHUIRUPDQFHRIWKHDOJRULWKPLQFOXVWHULQJERWKV\QWKHWLFDQGUHDOGDWDVWUHDPV ,QWKHIROORZLQJVHFWLRQVZHEHJLQZLWKDUHYLHZRIUHODWHGZRUNLQWKUHHDUHDV VWUHDP GDWDPLQLQJ FOXVWHULQJGDWDVWUHDPV DQGFDWHJRULFDOGDWDFOXVWHULQJ7KHQZHGHVFULEHRXU DOJRULWKPLQGHWDLOVDQGSURYLGHHPSLULFDODQDO\VLVRQWKHDOJRULWKP¶VSHUIRUPDQFH
5HODWHG:RUN
5HODWHG:RUNRQ0LQLQJ'DWD6WUHDPV 9HU\UHFHQWO\VRPHLQWHUHVWLQJZRUNVKDYHEHHQSXEOLVKHGWRDGGUHVVGDWDVWUHDPVLQWKHGDWD PLQLQJFRPPXQLW\7KHVHSURSRVDOVKDYHWULHGWRDGDSWWUDGLWLRQDOGDWDPLQLQJWHFKQRORJLHVWRWKH GDWDVWUHDPPRGHO 7KH DXWKRUV RI >@ GLVFXVVHG WKH SUREOHPV RI HIILFLHQWO\ FRQVWUXFWLQJ GHFLVLRQ WUHHV DQG
FRQGXFWLQJ HQVHPEOH FODVVLILFDWLRQ LQ D GDWD VWUHDP HQYLURQPHQW /DVW SUHVHQWHG DQ RQOLQH FODVVLILFDWLRQV\VWHPEDVHGRQLQIRIX]]\QHWZRUNV>@ 0DQNX DQG 0RWZDQL GLVFXVVHG WKH SUREOHP RI IUHTXHQW SDWWHUQ PLQLQJ LQGDWD VWUHDPV >@ &KHQDQGHWDOSURSRVHGDOJRULWKPVIRUUHJUHVVLRQDQDO\VLVRIWLPHVHULHVGDWDVWUHDPV> @ /DPEHUWDQG3LQKHULRLQYHVWLJDWHGH[WUDFWLQJLQIRUPDWLRQDERXWFXVWRPHUVIURPDVWUHDPRI WUDQVDFWLRQV DQG PLQLQJ LW LQ UHDOWLPH >@ +DQFRFN D ODQJXDJH IRU H[WUDFWLQJ VLJQDWXUHV IURP GDWDVWUHDPVZDVSUHVHQWHGLQ>@ 7KH DXWKRUV RI >@ DGGUHVVHG WKH SUREOHP RI PLQLQJ PXOWLSOH GDWD VWUHDPV $OJRULWKPV IRU DQDO\]LQJ FRHYROYLQJ WLPH VHTXHQFHV WR IRUHFDVW IXWXUH YDOXHV DQG GHWHFW FRUUHODWLRQV ZHUH GHVFULEHG LQ >@ &KHQ DQG HW DO SURSRVHG D FROOHFWLYH DSSURDFK WR PLQLQJ %D\HVLDQ QHWZRUNV IURPGLVWULEXWHGKHWHURJHQHRXV:HEORJGDWDVWUHDPV>@ 'RPLQJRVDQG+XOWRQLQYHVWLJDWHGDIHZNH\DVSHFWVRIVWUHDPGDWDPLQLQJDOJRULWKPVDQG RXWOLQHGDQXPEHURISRVVLEOHGLUHFWLRQVIRUIXWXUHUHVHDUFK>@7KHSUREOHPRIFRPSXWLQJGHQVLW\ IXQFWLRQVRYHUGDWDVWUHDPVZDVH[DPLQHGLQ>@ 5HODWHG:RUNRQ&OXVWHULQJ'DWD6WUHDPV 7KHDXWKRUVRI>@VWXGLHGFOXVWHULQJLQWKHGDWDVWUHDPPRGHO7KH\H[WHQGHGFODVVLFDO FOXVWHULQJDOJRULWKPVVXFKDVNPHGLDQDQGNPHDQVWRGDWDVWUHDPDSSOLFDWLRQVE\DVVXPLQJWKDW WKH GDWD REMHFWV DUULYH DV FKXQNV 6SHFLDOO\ LQ >@ D /2&$/6($5&+ VXEURXWLQH ZDV SHUIRUPHG WZLFH HYHU\ WLPH D QHZ FKXQN DUULYHG ILUVW RQ WKH QHZ FKXQN RI SRLQWV WR JHQHUDWH FOXVWHU FHQWHUV DQG WKHQ RQ WKH VHW RI FOXVWHU FHQWHUV RI DOO REVHUYHG FKXQNV SURGXFHG E\ /2&$/6($5&+ WR ORFDWH WKH RYHUDOO FOXVWHU FHQWHUV ,W KDV EHHQ SURYHG WKDW WKH WZRSKDVH DOJRULWKP SURGXFHV D JRRG DSSUR[LPDWLRQ WR WKH RSWLPXP FOXVWHULQJ DQG LV PHPRU\ HIILFLHQW &KDULNDU DQG HW DO SURSRVHG D VWUHDPLQJ DOJRULWKP IRU WKH N0HGLDQ SUREOHP ZLWK DQ DUELWUDU\ GLVWDQFHIXQFWLRQ>@%DEFRFNDQGHWDO>@H[WHQGHGWKHLUSUHYLRXVPHWKRGLQ>@WRWKHGDWD VWUHDPZLQGRZVPRGHOV7KH9).0DOJRULWKPZDVSURSRVHGLQ>@ZKLFKH[WHQGVWKHNPHDQV FOXVWHULQJDOJRULWKPE\ERXQGLQJWKHOHDUQHU¶VORVVDVDIXQFWLRQRIWKHQXPEHURIH[DPSOHVXVHG DWHDFKVWHS ,Q > @ WKH DXWKRUV GHYHORSHG DQ HIILFLHQW PHWKRG FDOOHG &OX6WUHDP IRU FOXVWHULQJ ODUJH HYROYLQJGDWDVWUHDPV ,QVWHDGRIWU\LQJWRFOXVWHUWKHZKROHVWUHDPDWDWLPHWKHPHWKRGYLHZV WKH VWUHDP DV D FKDQJLQJ SURFHVV RYHU WLPH 7KH &OX6WUHDP PRGHO SURYLGHV D ZLGH YDULHW\ RI IXQFWLRQDOLW\ LQ FKDUDFWHUL]LQJ GDWD VWUHDP FOXVWHUV RYHU GLIIHUHQW WLPH KRUL]RQV LQ DQ HYROYLQJ HQYLURQPHQW ,Q>@WKHDXWKRUDGGUHVVHGWKHSUREOHPRIFOXVWHULQJGDWDVWUHDPVRIZKLFKGLPHQVLRQDOLW\ LQFUHDVHVRYHUWLPH7KDWLVDGDWDVWUHDPKDVN YDOXHV GLPHQVLRQV DWWKHNWKVQDSVKRWZKLOHWKH NYDOXHVDWWKH N WKVQDSVKRW$ZHLJKWHGGLVWDQFHPHWULFEHWZHHQWZRVWUHDPVZDVDSSOLHG DQGDQLQFUHPHQWDOFOXVWHULQJDOJRULWKPZDVGHYHORSHGWRSURGXFHFOXVWHUVRIVWUHDPV 5HODWHG:RUNRQ&OXVWHULQJ&DWHJRULFDO'DWD $ IHZDOJRULWKPVKDYHEHHQSURSRVHGLQUHFHQW\HDUVIRUFOXVWHULQJFDWHJRULFDOGDWD>@ +DQDQGHWDODGGUHVVHGWKHSUREOHPRIFOXVWHULQJFXVWRPHUWUDQVDFWLRQVLQDPDUNHWGDWDEDVH>@ 67,55DQLWHUDWLYHDOJRULWKPEDVHGRQQRQOLQHDUG\QDPLFDOV\VWHPVZDVSUHVHQWHGLQ>@7KH
FDWHJRULFDO FOXVWHULQJ SUREOHP ZDV PDSSHG WR D W\SH RI QRQOLQHDU V\VWHPV ,I WKH G\QDPLFDO V\VWHPFRQYHUJHVWKHFDWHJRULFDOGDWDEDVHVFDQEHFOXVWHUHG$QRWKHUUHFHQWUHVHDUFK>@VKRZHG WKDW WKH NQRZQ G\QDPLFDO V\VWHPV FDQQRW JXDUDQWHH FRQYHUJHQFH DQG SURSRVHG D UHYLVHG G\QDPLFDOV\VWHPLQZKLFKFRQYHUJHQFHFDQEHJXDUDQWHHG .PRGHV DQ DOJRULWKP H[WHQGLQJ WKH NPHDQV SDUDGLJP WR FDWHJRULFDO GRPDLQ ZDV LQWURGXFHG LQ >@ 1HZ GLVVLPLODULW\ PHDVXUHV WR GHDO ZLWK FDWHJRULFDO GDWD ZDV XVHG WR UHSODFH PHDQV ZLWK PRGHV DQG D IUHTXHQF\ EDVHG PHWKRG ZDV XVHG WR XSGDWH PRGHV LQ WKH FOXVWHULQJ SURFHVV WR PLQLPL]H WKH FOXVWHULQJ FRVW IXQFWLRQ %DVHG RQ WKH NPRGHV DOJRULWKP -ROORLV DQG 1DGLI SURSRVHG DQ DGDSWHG PL[WXUH PRGHO IRU FDWHJRULFDO GDWD ZKLFK JLYHV D SUREDELOLVWLF LQWHUSUHWDWLRQ RI WKH FULWHULRQ RSWLPL]HG E\ WKH NPRGHV DOJRULWKP >@ $ IX]]\ NPRGHV DOJRULWKP ZDV SUHVHQWHG LQ >@ DQG WKH WDEX VHDUFK WHFKQLTXH ZDV XVHG LQ >@ WR LPSURYH WKH IX]]\ NPRGHV DOJRULWKP $Q LWHUDWLYH LQLWLDOSRLQWV UHILQHPHQW DOJRULWKP IRU FDWHJRULFDOGDWDZDVSUHVHQWHGLQ> @7KHZRUNLQ>@FDQEHFRQVLGHUHGDVWKHH[WHQVLRQVRIWKH NPRGHVDOJRULWKPWRWUDQVDFWLRQGRPDLQV ,Q >@ WKH DXWKRUV LQWURGXFHG D QRYHO IRUPDOL]DWLRQ RI D FOXVWHU IRU FDWHJRULFDO GDWD E\ JHQHUDOL]LQJ D GHILQLWLRQ RI FOXVWHUV IRU QXPHULFDO GDWD $ IDVW VXPPDUL]DWLRQ EDVHG DOJRULWKP &$&786 ZDV SUHVHQWHG ZKLFK LV EXLOW RQ WKUHH SKDVHV VXPPDUL]DWLRQ FOXVWHULQJ DQG YDOLGDWLRQ 52&.DQDGDSWDWLRQRIDQDJJORPHUDWLYHKLHUDUFKLFDOFOXVWHULQJDOJRULWKPZDVLQWURGXFHG LQ >@ 7KLV DOJRULWKP VWDUWV E\ DVVLJQLQJ HDFK UHFRUG WR D VHSDUDWHG FOXVWHU DQG WKHQ PHUJLQJ FOXVWHUVUHSHDWHGO\DFFRUGLQJWRWKHFORVHQHVVEHWZHHQFOXVWHUV7KHFORVHQHVVEHWZHHQFOXVWHUVLV GHILQHG DV WKH VXP RI WKH QXPEHU RI ³OLQNV´ EHWZHHQ DOO SDLUV RI UHFRUGV ZKHUH WKH QXPEHU RI ³OLQNV´LVFRPSXWHGDVWKHQXPEHURIFRPPRQQHLJKERUVEHWZHHQWZRUHFRUGV ,Q >@ WKH DXWKRUV SURSRVHG WKH QRWLRQ RI ODUJH LWHP $Q LWHP LV ODUJH LQ D FOXVWHU RI WUDQVDFWLRQV LI LW LV FRQWDLQHG LQ D XVHU VSHFLILHG IUDFWLRQ RI WUDQVDFWLRQV LQ WKDW FOXVWHU $Q DOORFDWLRQ DQG UHILQHPHQW VWUDWHJ\ ZKLFK KDV EHHQ DGRSWHG LQ SDUWLWLRQLQJ DOJRULWKPV VXFK DV NPHDQV ZDV XVHG WR FOXVWHU WUDQVDFWLRQV E\ PLQLPL]LQJ WKH FULWHULD IXQFWLRQ GHILQHG ZLWK WKH QRWLRQ RI ODUJH LWHPV )ROORZLQJ WKH ODUJH LWHP PHWKRG LQ >@ D QHZ PHDVXUHPHQW FDOOHG WKH VPDOOODUJH UDWLR ZDV SURSRVHG DQG XWLOL]HG WR SHUIRUP FOXVWHULQJ >@ ,Q >@ WKH DXWKRUV FRQVLGHUHG WKH LWHP WD[RQRP\ LQ SHUIRUPLQJ FOXVWHU DQDO\VLV :KLOH WKH ZRUN >@ SURSRVHG DQ DOJRULWKPEDVHGRQ³FDXFXV´ZKLFKLVILQHSDUWLWLRQHGGHPRJUDSKLFJURXSVEDVHGRQWKHSXUFKDVH IHDWXUHVRIFXVWRPHUV 6TXHH]HUDRQHSDVVDOJRULWKPZDVSURSRVHGLQ>@6TXHH]HUUHSHDWHGO\UHDGVUHFRUGVIURP D GDWDVHW RQH DW D WLPH :KHQ WKH ILUVW UHFRUG DUULYHV LW IRUPV D FOXVWHU DORQH 7KH FRQVHFXWLYH UHFRUGV DUH HLWKHU SXW LQWR DQ H[LVWLQJ FOXVWHU RU UHMHFWHG E\ DOO H[LVWLQJ FOXVWHUV WR IRUP D QHZ FOXVWHUE\DJLYHQVLPLODULW\IXQFWLRQ &22/&$7 DQ HQWURS\EDVHG DOJRULWKP IRU FDWHJRULFDO FOXVWHULQJ ZDV SURSRVHG LQ >@ 6WDUWLQJIURPDKHXULVWLFPHWKRGRILQFUHDVLQJWKHKHLJKWWRZLGWKUDWLRRIWKHFOXVWHUKLVWRJUDP WKH DXWKRUV LQ > @ GHYHORSHG WKH &/23( DOJRULWKP &ULVWRIRU DQG 6LPRYLFL >@ LQWURGXFHG D GLVWDQFH PHDVXUH EHWZHHQ SDUWLWLRQV EDVHG RQ WKH QRWLRQ RI WKH JHQHUDOL]HG FRQGLWLRQDO HQWURS\ DQGDJHQHWLFDOJRULWKPDSSURDFKZDVXWLOL]HGWRGLVFRYHUWKHPHGLDQSDUWLWLRQ,Q>@WKHDXWKRUV IRUPDOO\ GHILQHG WKH FDWHJRULFDO GDWD FOXVWHULQJ SUREOHP DV DQ RSWLPL]DWLRQ SUREOHP IURP WKH YLHZSRLQWRIFOXVWHUHQVHPEOHDQGDSSOLHGWKHFOXVWHUHQVHPEOHDSSURDFKWRFDWHJRULFDOGDWD
6XPPDU\ 7R WKH EHVW RI RXU NQRZOHGJH WKLV SUREOHP RI FOXVWHULQJ FDWHJRULFDO GDWD VWUHDPV KDV QRW UHFHLYHGH[SOLFLWFRQVLGHUDWLRQWRGDWH6RPHFDWHJRULFDOGDWDFOXVWHULQJDSSURDFKHV>HJ@ RU DOJRULWKPV >HJ @ IRU FOXVWHULQJ QXPHULF GDWD VWUHDPV PD\ EH PRGLILHG WR GHDO ZLWK FDWHJRULFDOGDWDVWUHDPVEXWWKHWDVNLVQRQWULYLDO7KHSUREOHPLVRSHQDQGSURYLGHVSURPLVLQJ IXWXUHUHVHDUFKGLUHFWLRQV
1RWDWLRQV
/HWWKHGDWDVHW' ^; ; «; ` EHDVHWRIREMHFWVGHVFULEHGE\P FDWHJRULFDODWWULEXWHV $ «$ ZLWKGRPDLQV' «' UHVSHFWLYHO\7KHYDOXHVHW9 LVDVHWRIYDOXHVRI$ WKDWDUH SUHVHQW LQ ' )RU HDFK Y 9 WKH IUHTXHQF\ I Y GHQRWHG DV I LV WKH QXPEHU RI REMHFWV 2 '
P
Q
P
L
L
L
Y
Y 6XSSRVH WKH QXPEHU RI GLVWLQFW DWWULEXWH YDOXHV RI $ LV S :H GHILQH WKH
ZLWK 2 $
L
L
KLVWRJUDPRI$ DVWKHVHWRISDLUV K L
L
L
^ Y I Y I « Y S I S `(DFKHOHPHQWRIK LVFDOOHG
L
L
L
DQHQWU\LQWKHKLVWRJUDPRUMXVWDKLVWRJUDPHQWU\7KHKLVWRJUDPRIGDWDVHW' LVGHILQHGDV + ^K K « K ` ,Q WKH UHVW RI WKH SDSHU ZKHQHYHU QR FRQIXVLRQ DULVHV ZH VLPSOLI\ WR XVH ³KLVWRJUDP´DVWKHVKRUWKDQGIRU³WKHKLVWRJUDPRIDGDWDVHW´ /HW ; @7KHDOJRULWKPGLYLGHVQ UHFRUGV LQWR FOXVWHUV ,QLWLDOO\ WKH ILUVW UHFRUG LQ WKH GDWDVHW LV UHDG LQ DQG D QHZ KLVWRJUDP LV FUHDWHG7KHUHVWRIUHFRUGVDUHUHDGLWHUDWLYHO\)RUHDFKUHFRUGZHFRPSXWHLWVVLPLODULW\YDOXHV ZLWK DOO H[LVWLQJ FOXVWHUV XVLQJ (T $PRQJ WKHVH YDOXHV WKH PD[LPDO VLPLODULW\ YDOXH LV VHOHFWHG,IWKLVYDOXHLVJUHDWHUWKDQWKHJLYHQVLPLODULW\WKUHVKROGLWLVSXWLQWRWKHFOXVWHUWKDWKDV WKH ODUJHVW VLPLODULW\ 7KH KLVWRJUDP RI WKLV FOXVWHU LV DOVR XSGDWHG ZLWK WKH QHZ UHFRUG ,I WKH DERYH FRQGLWLRQ GRHV QRW KROG D QHZ FOXVWHU UHSUHVHQWHG E\ D KLVWRJUDP LV FUHDWHG 7KH DOJRULWKPFRQWLQXHVXQWLODOOWKHUHFRUGVLQWKHGDWDVHWDUHUHDG ,QWKHFOXVWHULQJSURFHVVWKHPDLQRSHUDWLRQRI6TXHH]HULVWRPDLQWDLQDQGXSGDWHPXOWLSOH KLVWRJUDPV%HFDXVHGDWDVWUHDPDOJRULWKPVKDYHOLPLWHGUHTXLUHPHQWVRQPDLQPHPRU\RXUILUVW JRDO ZLOO EH WR PDNH WKH FOXVWHULQJ EH FDUULHG RXW LQ D VPDOO VSDFH 7KHUHIRUH LQVWHDG RI PDLQWDLQLQJ DOO WKH YDOXH IUHTXHQFLHV LQ HDFK KLVWRJUDP ZH DSSO\ WKH DSSUR[LPDWLRQ FRXQWV WHFKQLTXHRYHUGDWDVWUHDPVGHYHORSHGE\0DQNXDQG0RWZDQL>@WRNHHSRQO\YDOXHIUHTXHQFLHV WKDWDUHUHODWLYHO\³ODUJH´,QWKHVHTXHOZHZLOOEULHIO\LQWURGXFHWKHLU/RVV\&RXQWLQJ$OJRULWKP 7KH ORVV\ FRXQWLQJ DOJRULWKP >@ XVHV WZR XVHUVSHFLILHG SDUDPHWHUV D VXSSRUW WKUHVKROG V DQGDQHUURUSDUDPHWHU H VXFKWKDW H V /HW1 GRQDWHWKHFXUUHQWOHQJWKRIWKH VWUHDPLHWKHQXPEHURIUHFRUGVVHHQVRIDU7KHLQFRPLQJVWUHDPLVFRQFHSWXDOO\GLYLGHGLQWR
ªº
EXFNHWV ZLWK Z « » WUDQVDFWLRQV HDFK %XFNHWV DUH ODEHOHG E\ EXFNHW LGV VWDUWLQJ IURP 7KH «H »
ª1 º
FXUUHQW EXFNHW LG LV GRQDWHG E\ EFXUUHQW ZKRVH YDOXH LV « » )RU DQ HOHPHQW H LWV WUXH «Z»
IUHTXHQF\ LQ WKH VWUHDP VHHQ VR IDU LV GHQRWHG E\ I 1RWH WKDW H DQG Z DUH IL[HG ZKLOH 1 H
E
DQG I FKDQJHYDOXHVDVWKHVWUHDPSURJUHVVHV7KHGDWDVWUXFWXUH' LVDVHWRIHQWULHVRI
WKHIRUP H I ' ZKHUHH LVDQHOHPHQWLQWKHVWUHDPI LVDQLQWHJHUUHSUHVHQWLQJLWVHVWLPDWHG IUHTXHQF\DQG ' LVWKHPD[LPXPSRVVLEOHHUURULQI ,QLWLDOO\' LVHPSW\:KHQHYHUDQHZHOHPHQWH DUULYHVZHILUVWORRNDW' WRVHHZKHWKHUDQ HQWU\IRUH DOUHDG\H[LVWVRUQRW,IWKHORRNXSVXFFHHGVWKHHQWU\LVXSGDWHGE\LQFUHPHQWLQJLWV FXUUHQW
H
IUHTXHQF\I E\RQH2WKHUZLVHDQHZHQWU\LQWKHIRUPRI H E
LVFUHDWHG$OVR' LV
SUXQHG E\ GHOHWLQJ VRPH RI LWV HQWULHV DW EXFNHW ERXQGDULHV LH ZKHQHYHU 1 { PRG Z 7KH FXUUHQW
GHOHWLRQUXOHLV DQHQWU\ H I ' LVGHOHWHGLII ' d E
ZLWKWKUHVKROGV RXWSXWWKRVHHQWULHVZLWKI t V H 1
FXUUHQW
:KHQDXVHUUHTXHVWVDOLVWRILWHPV
)RUDQHQWU\ H I ' I UHSUHVHQWVWKHH[DFWIUHTXHQF\FRXQWRIH HYHUVLQFHWKLVHQWU\ZDV LQVHUWHGLQWR' 7KHYDOXHRI ' DVVLJQHGWRDQHZHQWU\LVWKHPD[LPXPQXPEHURIWLPHVWKDWH KDV RFFXUUHG LQ WKH ILUVW E
EXFNHWV 7KLV YDOXH LV H[DFWO\ E
2QFH DQ HQWU\ LV
LQVHUWHGLQWR' LWV ' YDOXHUHPDLQVXQFKDQJHG 7KHRUHWLFDODQDO\VLV>@VKRZVWKDWDQVZHUVSURGXFHGE\WKH/RVV\&RXQWLQJ$OJRULWKPZLOO KDYHWKHIROORZLQJJXDUDQWHHV $OOLWHPVHWVZKRVHWUXHIUHTXHQF\H[FHHGVV1DUHRXWSXW7KHUHDUHQR IDOVHQHJDWLYHV 1RLWHPVHWZKRVHWUXHIUHTXHQF\LVOHVVWKDQ V H 1 LVRXWSXW (VWLPDWHGIUHTXHQFLHVDUHOHVVWKDQWKHWUXHIUHTXHQFLHVE\DWPRVW H 1 FXUUHQW
FXUUHQW
%DVHG RQ WKH 6TXHH]HU DOJRULWKP DQG WKH /RVV\ &RXQWLQJ $OJRULWKP ZH GHILQH WKH QHZ VWUHDPLQJFOXVWHULQJDOJRULWKP6WUHDP&OX&'DVVKRZQLQ)LJ7KHNH\VWHSVLQWKLVDOJRULWKP DUH 6WHS DQG 6WHS ,Q 6WHS WKH KLVWRJUDP LV SUXQHG E\ GHOHWLQJ VRPH HQWULHV DW EXFNHWERXQGDULHV7KDWLVDFFRUGLQJWRWKHGHOHWLRQUXOHHDFKKLVWRJUDP+ LVSUXQHGE\GHOHWLQJ VRPHHQWULHVDWEXFNHWERXQGDULHVZKHQHYHU1 { PRGZ ZKHUH1 GHQRWHVWKHFXUUHQWVL]HRI L
ªº
L
L
WKHFOXVWHU& DQGZ « » 1RWHWKDWHDFKHQWU\LQWKHKLVWRJUDPXVHGLQRXUDOJRULWKPLVLQWKH «H » L
IRUPRI H I ' ZKLOHWKHKLVWRJUDPHQWU\LQWKH6TXHH]HUDOJRULWKPLVIRUPRI H I ,Q 6WHS ZH FRPSXWH WKH VLPLODULW\ EHWZHHQ D UHFRUG DQG D FOXVWHU UHSUHVHQWHG E\ D KLVWRJUDP DFFRUGLQJ WR (T 6LQFH WKH KLVWRJUDP PD\ KDYH EHHQ SUXQHG LQ 6WHS WKH IUHTXHQF\RIHDFKHOHPHQWLQWKHKLVWRJUDPLVQRWDFFXUDWH7KHUHIRUHZKHQDSSO\LQJ(T LQWKH
6WUHDP&OX&'DOJRULWKPRQO\WKRVHHOHPHQWVZLWK³ODUJH´YDOXHIUHTXHQFLHVDUHFRQVLGHUHGLH WKH IUHTXHQF\ I RI DQ HOHPHQW VDWLVI\LQJ I t V H 1 ,Q RWKHU ZRUGV RQO\ WKRVH HOHPHQWV ZLWK
³ODUJH´ YDOXH IUHTXHQFLHV ZLOO FRQWULEXWH WR WKH VLPLODULW\ YDOXH :H ZLOO RIIHU VRPH DGGLWLRQDO LQVLJKWVRQWKHFKRLFHRIV LQ6HFWLRQ 0RUHRYHU WKH 6TXHH]HU DOJRULWKP LV D VSHFLDO FDVH RI WKH 6WUHDP&OX&' DOJRULWKP LQ QRQVWUHDPLQJHQYLURQPHQWLIZHVHWWKHLQSXWSDUDPHWHUVWRVRPHGHVLUDEOHYDOXHVLHV H DQG H 1 7KXVWKHGLIIHUHQFHEHWZHHQ6TXHH]HUDQG6WUHDP&OX&'LVPDLQO\GHWHUPLQHGE\KRZ WKHYDOXHVRIWKHVHWZRSDUDPHWHUVDUHVSHFLILHGE\XVHUV $OJRULWKP6WUHDP&OX&'
,QSXW '6 VW
H
WKHFDWHJRULFDOGDWDVWUHDP
XVHUGHILQHGVLPLODULW\WKUHVKROG
XVHUGHILQHGHUURUSDUDPHWHUIRUIUHTXHQWSDWWHUQ
V XVHUGHILQHGPLQLPDOVXSSRUWWKUHVKROGYDOXH
2XWSXW 7KHFOXVWHUGHVFULSWLRQVLQIRUPRIKLVWRJUDPVVRIDU %HJLQ
IRUHDFKUHFRUGW LQ'6GREHJLQ IRUHDFKH[LVWLQJFOXVWHU&L
FRPSXWLQJWKHVLPLODULW\EHWZHHQW DQG&L
JHWWLQJWKHPD[LPDOYDOXHRIVLPLODULW\ VLPBPD[
HQG
JHWWLQJWKHFRUUHVSRQGLQJFOXVWHU &PD[
LIVLPBPD[! VWWKHQ
XSGDWHHQWULHVRIWKHIRUP H I PD[LPDOHUURU LQFOXVWHU&PD[
LISUXQLQJFRQGLWLRQLVVDWLVILHG DWEXFNHWERXQGDULHV WKHQ
HQG
GHOHWLQJVRPHRILWVHQWULHVDFFRUGLQJWKHGHOHWLRQUXOH
HQG
HOVH
FUHDWLQJDQHZFOXVWHUZLWKW FUHDWLQJDQHZKLVWRJUDP
HQG
HQG
)LJ7KHVWUHDPLQJFOXVWHULQJDOJRULWKPIRUFDWHJRULFDOGDWD
$QDO\VLV
)LUVWO\ZHVKRZWKDWWKH6WUHDP&OX&'DOJRULWKPFDQEHSURYHGWRKDYHDVSDFHJXDUDQWHHRQ PDLQPHPRU\FRQVXPHG
7KHRUHP>@ /RVV\&RXQWLQJ$OJRULWKPFRPSXWHVDQ H GHILFLHQWV\QRSVLVXVLQJDWPRVW
ORJ H1 HQWULHVZKHUH1 GRQDWHVWKHFXUUHQWOHQJWKRIWKHVWUHDPLHWKHQXPEHURIUHFRUGV H
VHHQVRIDU 7KHRUHPLPSOLHVWKDWHDFKKLVWRJUDPLVVSDFHERXQGHG6WUDLJKWIRUZDUGO\ZHFDQKDYHWKH IROORZLQJWKHRUHP 7KHRUHP 7KH 6WUHDP&OX&'DOJRULWKP XVHV DW PRVW
ORJ H H
1 HQWULHV ZKHUH 1 N
N
L
L
GHQRWHVWKHFXUUHQWVL]HRIWKHFOXVWHU& N LVWKHFXUUHQWQXPEHURIFOXVWHUVDQG L
¦1 N
L
L
L
1
3URRI )URP 7KHRUHP ZH NQRZ WKDW IRU HDFK FOXVWHU & WKH VSDFH QHHGHG LV DW PRVW
ORJ H1 7KXVWKH6WUHDP&OX&'DOJRULWKPQHHGVVSDFHRIDWPRVW H L
L
¦ H ORJ H1 H ¦ ORJ H1 H ORJ H N
L
N
L
L
1 N
N
L
L
L
$FFRUGLQJ WR 7KHRUHP WKH PHPRU\ UHTXLUHPHQW RI RXU DOJRULWKP GHSHQGV RQ H 1L d L d N DQGN 7RUHGXFHWKHGHSHQGHQWYDULDEOHVZHKDYH/HPPD /HPPD /HW1 1N VDWLVI\
¦1 N
L
L
NTU U
1 WKHQ
1
N N DQGT EHQDWXUDOQXPEHUV,IN QDWXUHQXPEHUV1 1 «
N
L
L
dT
N
U
T KROGV U
7KH SURRI RI /HPPD FDQ HDVLO\ EH IRXQG LQ D QXPEHU WKHRU\ WH[WERRN )URP
/HPPDZHFDQGHULYH/HPPD
/HPPD /HW 1 EH D QDWXUDO QXPEHU ,I N QDWXUDO QXPEHUV 1 1 « 1N VDWLVI\
¦1 L
ª1 º 1 WKHQ 1 d « » «N» N
N
L
L
JHW
KROGV
L
3URRI 6XSSRVH1
KDYHWZRFDVHV
N
NTU U
&$6( ,I U WKHQ T
N 7KHQ T
1 U N
1 U $FFRUGLQJWRZKHWKHUU RUQRWZH N
1 T N
1 $FFRUGLQJ WR /HPPD ZH FDQ N
¦1 d T N
N
U
L
L
T
1 U N
&$6( ,I U z WKHQ T
¦1 N
L
L
dT
N
U
T
· §1· §1 ¨ ¸ ¨ ¸ ©N¹ ©N ¹ N
U
U
§ ª 1 º· §1· ¨ ¸ d ¨¨ « » ¸¸ ©N¹ © « N »¹ N
ª1 º « N » T « »
§ª1 º · ¨¨ « » ¸¸ ©« N » ¹
N
U
ª1 º « N » 7KHUHIRUH « »
§ ª 1 º· § ª 1 º· ¨¨ « » ¸¸ ¨¨ « » ¸¸ © « N »¹ © « N »¹ U
)URP7KHRUHPDQG/HPPDZHFDQJHW7KHRUHP 7KHRUHP 7KH 6WUHDP&OX&' DOJRULWKP XVHV DW PRVW
N
N
§ ª 1 º· N N ORJ H ORJ¨¨ « » ¸¸ HQWULHV H H © « N »¹
ZKHUH1 GHQRWHVWKHFXUUHQWOHQJWKRIWKHVWUHDPDQGN LVWKHFXUUHQWQXPEHURIFOXVWHUV
ª1 º 3URRI )URP/HPPDZHKDYH 1 d « » 7KXV «N» N
N
L
L
ORJ H H
ª1 º 1 d H ORJ H «« N »» N
N
N
N
L
L
§ ª 1 º· N N ORJ H ORJ¨¨ « » ¸¸ H H © « N »¹
7KHUHIRUH DFFRUGLQJ WR 7KHRUHP WKH 6WUHDP&OX&' DOJRULWKP XVHV DW PRVW
§ ª 1 º· N N ORJ H ORJ¨¨ « » ¸¸ HQWULHV H H © « N »¹
$FFRUGLQJ WR 7KHRUHP WKH PHPRU\ UHTXLUHPHQW RI RXU DOJRULWKP RQO\ GHSHQGV RQ WKUHH SDUDPHWHUV H N DQG1 7REHPRUHSUHFLVHLQFUHDVLQJ H ZLOOGHFUHDVHWKHPHPRU\XVDJHZKLOH LQFUHDVLQJN ZLOOLQFUHDVHWKHPHPRU\UHTXLUHPHQW,QIDFWLQWKHSURFHVVRIFOXVWHULQJFDWHJRULFDO GDWD VWUHDPV WKH YDOXHV RI H DQG N DUH XVXDOO\ IL[HG LQ WKH 6WUHDP&OX&' DOJRULWKP ZKLOH 1 FKDQJHV DV WKH VWUHDP SURJUHVVHV +HQFH WKH QXPEHU RI UHFRUGV 1 VHHQ VR IDU GHWHUPLQHV WKH PHPRU\XVDJHRIRXUDOJRULWKP $OWKRXJK WKHRUHWLFDOO\ WKH PHPRU\ UHTXLUHPHQW RI RXU DOJRULWKP LQFUHDVHV DV WKH VWUHDP VL]HLQFUHDVHVLWVLQFUHDVHLVLQSURSRUWLRQWRORJDULWKPRIWKHVWUHDPVL]H,WPHDQVWKDWHYHQZKHQ GDWD VWUHDP LQFUHDVHV YHU\ VLJQLILFDQWO\ WKH PHPRU\ XVDJH DOPRVW NHHSV FRQVLVWHQW :H ZLOO YHULI\WKLVSRLQWLQWKHHPSLULFDOHYDOXDWLRQVHFWLRQ )XUWKHUPRUHLIZHPDNHDQDVVXPSWLRQWKDWLQUHDOZRUOGGDWDVHWVHOHPHQWVZLWKYHU\ORZ
H1 WHQG WR RFFXU PRUH RU OHVV XQLIRUPO\ DW UDQGRP WKHQ WKH /RVV\ &RXQWLQJPHWKRGUHTXLUHVQRPRUHWKDQ VSDFHDVSURYHGLQ>@,WLVWUXHHYHQLIWKHSRVLWLRQV H IUHTXHQF\ DW PRVW
RI WKHKLJKIUHTXHQF\HOHPHQWVDUHFKRVHQE\DQDGYHUVDU\ RQO\WKHORZIUHTXHQF\HOHPHQWVDUH UHTXLUHGWREHGUDZQIURPVRPHIL[HGGLVWULEXWLRQ>@7KHUHIRUHIROORZLQJWKLVDVVXPSWLRQRXU
DOJRULWKPZLOOUHTXLUHDIL[HGDPRXQWRIPDLQPHPRU\JLYHQLQ7KHRUHP 7KHRUHP )RU WKH 6WUHDP&OX&' DOJRULWKP LI VWUHDP HOHPHQWV DUH GUDZQ LQGHSHQGHQWO\ IURP D IL[HG SUREDELOLW\ GLVWULEXWLRQ LW LV H[SHFWHG WKDW WKH DOJRULWKP XVHV DW PRVW
N HQWULHV H
ZKHUHN LVWKHFXUUHQWQXPEHURIFOXVWHUV 3URRI )RUHDFKFOXVWHU& ZLWKKLVWRJUDP+ ZHGHQRWHWKHH[SHFWDWLRQRQPHPRU\XVDJHDV
ª ( >_ + _@ $FFRUGLQJWR>@ ( >_ + _@ +HQFH ( «¦ _ + H ¬ L
L
N
L
L
L
H[SHFWHGWKDWWKHDOJRULWKPXVHVDWPRVW
L
º N _» KROGV7KDWLVLWLV ¼ H
N HQWULHV H
6LQFHWKHDERYHDVVXPSWLRQLVDOZD\VURXJKO\VDWLVILHGE\WKHUHDOZRUOGGDWDVHWV$FFRUGLQJ WR7KHRUHPZHFDQFRQFOXGHWKDWUHJDUGOHVVRIWKHQXPEHURIUHFRUGVRXUDOJRULWKPKDVVHHQ WKH DPRXQW RI PDLQ PHPRU\ XVHG LV IL[HG 7KLV SURSHUW\ LV PRVW GHVLUDEOH IRU VWUHDPLQJ DOJRULWKPV ,QFRQWUDVWWKH 6TXHH]HUDOJRULWKP>@FDQ¶WSURYLGHVXFKNLQGRIJXDUDQWHH7KXV WKH6WUHDP&OX&'DOJRULWKPLVVXSHULRUWRWKH6TXHH]HUDOJRULWKPZLWKUHVSHFWWRPHPRU\XVDJHLQ GDWDVWUHDPDSSOLFDWLRQV $IWHUGLVFXVVLQJWKHVSDFHFRPSOH[LW\RIWKHDOJRULWKPZHWDNHDORRNDWWKHWLPHFRPSOH[LW\ RIWKHDOJRULWKP)RUHYHU\UHFRUGSURFHVVHGZHRQO\KDYHWRFDOFXODWHWKHVLPLODULW\ZLWKH[LVWLQJ FOXVWHUV XSGDWH RU FUHDWH D QHZ KLVWRJUDP DQG GR WKH SUXQLQJ LI LW¶V DW WKH EXFNHW ERXQGDULHV 7KHUHIRUHZKHQWKHQXPEHURIFOXVWHUVLVIL[HGZHFDQVHHWKDWWKHFRPSXWDWLRQDO FRVWRIHDFK UHFRUGLVFRQVWDQW7KHWRWDOFRPSXWDWLRQDOFRVWLVOLQHDUWRWKHVL]HRIWKHGDWDVWUHDP:HKDYH GHWDLOHGDQDO\VLVDERXWLWLQWKHH[SHULPHQWDOSDUW
(QKDQFHPHQWIRU5HDO$SSOLFDWLRQV
7KH GDWD VHWV LQ UHDOOLIH DSSOLFDWLRQV DUH XVXDOO\ FRPSOH[ 7KH\ KDYH QRW RQO\ FDWHJRULFDO GDWD EXW DOVR QXPHULF GDWD 6RPHWLPHV WKH\ DUH LQFRPSOHWH )XUWKHUPRUH LQ UHDO DSSOLFDWLRQV WKHUHDUHXVXDOO\VRPHFRQVWUDLQWVRQWKHFOXVWHUVL]HVRUWKHQXPEHURIFOXVWHUV,QWKLVVHFWLRQZH GLVFXVVWKHWHFKQLTXHVIRUKDQGOLQJGDWDZLWKWKHVHFKDUDFWHULVWLFVLQ6WUHDP&OX&' +DQGOLQJQXPHULFGDWD7RSURFHVVQXPHULFGDWDZHDSSO\ WKHZLGHO\XVHGELQQLQJWHFKQLTXH >@ DQG FKRRVH HTXDOZLGWK PHWKRG IRU LWV IHDVLELOLW\ LQ WKH GDWD VWUHDP HQYLURQPHQW )RU D SUHGHILQHG ZLGWK YDOXH Z WKH QXPEHU RI ELQV LV DGMXVWHG G\QDPLFDOO\ WR DFFRPPRGDWH QHZ FRPLQJGDWDSRLQWV +DQGOLQJPLVVLQJYDOXHV7RKDQGOHLQFRPSOHWHGDWDZHSURYLGHWZRFKRLFHV,QWKHILUVWFKRLFH PLVVLQJ YDOXHV LQ DQ LQFRPSOHWH REMHFW ZLOO QRW EH FRQVLGHUHG ZKHQ XSGDWLQJ KLVWRJUDPV DQG FRPSXWLQJ VLPLODULWLHV ,Q WKH VHFRQG FKRLFH PLVVLQJ YDOXHV DUH WUHDWHG DV VSHFLDO FDWHJRULFDO DWWULEXWHYDOXHV +DQGOLQJFRQVWUDLQWV:HFRQVLGHUWZRNLQGVRIFRQVWUDLQWV EDODQFHGFOXVWHUVL]HDQGPD[LPDO QXPEHU RI FOXVWHUV 6LQFH VHYHUDO UHDO OLIH GDWD PLQLQJ DSSOLFDWLRQV GHPDQG FRPSDUDEO\ VL]HG
VHJPHQWVRIWKHGDWDLUUHVSHFWLYHRIZKHWKHUWKHQDWXUDOFOXVWHUVLQWKHGDWDDUHFRPSDUDEOHVL]HV RU QRW )RU H[DPSOH D GLUHFW PDUNHWLQJ FDPSDLJQ RIWHQ VWDUWV ZLWK VHJPHQWLQJ FXVWRPHUV LQWR JURXSVRIURXJKO\HTXDOVL]HRUHTXDOHVWLPDWHGUHYHQXHJHQHUDWLRQVRWKDWWKHVDPHQXPEHURI VDOHVWHDPVPDUNHWLQJGROODUVHWFFDQEHDOORFDWHGWRHDFKVHJPHQW>@7RKDQGOHVXFKEDODQFH FRQVWUDLQW LQ WKH FOXVWHULQJ SURFHVV ZH FDQ LQFRUSRUDWH WKH FOXVWHU VL]H LQWR VLPLODULW\ FRPSXWDWLRQDVDZHLJKWLHDVPDOOFOXVWHULQVL]HLVJLYHQDJUHDWHUZHLJKW ,Q WKH 6WUHDP&OX&'& DOJRULWKP WKH QXPEHU RI FOXVWHUV LV QRW IL[HG ,Q UHDO DSSOLFDWLRQV VRPHWLPHV ZH ZLOO JHW WRR PDQ\ FOXVWHUV ZLWK LQDSSURSULDWH SDUDPHWHU YDOXHV +HQFH ZH DGG DQRWKHU SDUDPHWHU PF WR FRQWURO WKH ODUJHVW QXPEHU RI FOXVWHUV 7KDW LV ZKHQ WKH QXPEHU RI FOXVWHUVLVHTXDOWRPFGXULQJWKHFOXVWHULQJSURFHVVZHZLOOQRWFUHDWHQHZFOXVWHUDJDLQ)RUWKH QHZFRPLQJGDWDREMHFWVWKH\DUHSXWLQWRWKHFOXVWHUWKDWLVPRVWVLPLODUWR
([SHULPHQWDO5HVXOWV
$ FRPSUHKHQVLYH SHUIRUPDQFH VWXG\ KDV EHHQ FRQGXFWHG WR HYDOXDWH RXU PHWKRG ,Q WKLV VHFWLRQZHGHVFULEHWKRVHH[SHULPHQWVDQGWKHLUUHVXOWV5HDOOLIHGDWDVHWVZHUHXVHGWRHYDOXDWH WKH TXDOLW\ RI WKH FOXVWHULQJ UHVXOWV SURGXFHG E\ RXU VWUHDP FOXVWHULQJ DOJRULWKP 6\QWKHWLF GDWDVHWVZHUHXVHGWRSULPDULO\GHPRQVWUDWHWKHVFDODELOLW\RIRXUDOJRULWKPDQGWRSURYHWKDWWKH WLPHFRVWSHUUHFRUGLVZLWKLQDVPDOOFRQVWDQWYDOXHZKLFKPHDQVWKHDOJRULWKPFDQRXWSXWWKH UHVXOWV LQ OLQHDU WLPH :H DOVR GLG H[SHULPHQWV WR VKRZ WKH DGYDQWDJH RI WKH 6WUHDP&OX&' DOJRULWKPZLWKUHVSHFWWRPHPRU\XVDJH$GGLWLRQDOO\ZHWHVWHGKRZWKHLQSXWSDUDPHWHUVDIIHFW HGWKHSHUIRUPDQFHRI6WUHDP&OX&' 2XU DOJRULWKPV ZHUH LPSOHPHQWHG LQ -DYD $OO H[SHULPHQWV ZHUH FRQGXFWHG RQ D 3HQWLXP* PDFKLQHZLWK0RI5$0DQGUXQQLQJ:LQGRZV 5HDO/LIH'DWDVHWDQG(YDOXDWLRQ0HDVXUHV
:H H[SHULPHQWHG ZLWK WKH 0XVKURRP GDWDVHW ZKLFK ZDV REWDLQHG IURP WKH 8&, 0DFKLQH /HDUQLQJ5HSRVLWRU\>@7KHPXVKURRPGDWDVHWKDVDWWULEXWHVDQGUHFRUGV(DFKUHFRUG UHSUHVHQWV SK\VLFDO FKDUDFWHULVWLFV RI D VLQJOH PXVKURRP $ FODVVLILFDWLRQ ODEHO RI SRLVRQRXV RU HGLEOH LV SURYLGHG ZLWK HDFK UHFRUG 7KH QXPEHUV RI HGLEOH DQG SRLVRQRXV PXVKURRPV LQ WKH GDWDVHWDUHDQG UHVSHFWLYHO\ 9DOLGDWLQJFOXVWHULQJUHVXOWVLVDQRQWULYLDOWDVN,QWKHSUHVHQFHRIWUXHODEHOVDVLQWKHFDVH RI WKHGDWDVHWVZHXVHGWKHFOXVWHULQJDFFXUDF\IRUPHDVXULQJWKHFOXVWHULQJUHVXOWVZDVFRPSXWHG DV IROORZV *LYHQ WKH ILQDO QXPEHU RI FOXVWHUV N FOXVWHULQJ DFFXUDF\ U ZDV GHILQHG DV U
¦
N
Q
L
D
L
ZKHUHQ LVWKHQXPEHURIUHFRUGVLQWKHGDWDVHWD LVWKHQXPEHURILQVWDQFHVRFFXUULQJ L
LQERWKFOXVWHUL DQGLWVFRUUHVSRQGLQJFODVVZKLFKKDGWKHPD[LPDOYDOXH,QRWKHUZRUGVD LVWKH QXPEHURIUHFRUGVZLWKWKHFODVVODEHOWKDWGRPLQDWHVFOXVWHUL &RQVHTXHQWO\WKHFOXVWHULQJHUURU LVGHILQHGDVH U )XUWKHUPRUHZHGHILQHWKHDEVROXWHFOXVWHULQJHUURUDFHDV DFH H Q L
&OXVWHULQJ5HVXOWV
,WKDVEHHQGHPRQVWUDWHGWKDWWKH6TXHH]HUDOJRULWKP>@DQGWKHNPRGHVDOJRULWKP>@ FDQ SURGXFH EHWWHU FOXVWHULQJ RXWSXW WKDQ RWKHU DOJRULWKPV LQ FOXVWHULQJ FDWHJRULFDO GDWDVHWV LQ WHUPV RI FOXVWHULQJ DFFXUDFLHV ,Q DGGLWLRQ WKH 6TXHH]HU DOJRULWKP LV D RQHSDVV FOXVWHULQJ DOJRULWKP IRU FDWHJRULFDO GDWD 7KXV WKLV VHFWLRQ LV PDLQO\ GHYRWHG WR GHPRQVWUDWH WKH HIIHFWLYHQHVV RI RXU VWUHDPLQJ FOXVWHULQJ DOJRULWKP 6WUHDP&OX&' LQ FRPSDULVRQ ZLWK WKH 6TXHH]HUDOJRULWKPDQGWKHNPRGHVDOJRULWKP :H XVHG WKH 6WUHDP&OX&' DQG 6TXHH]HU DOJRULWKPV WR FOXVWHU WKH 0XVKURRP GDWDVHW LQWR GLIIHUHQWQXPEHUVRIFOXVWHUVZLWKIL[HGWKUHVKROGYDOXHVRIVLPLODULW\YDU\LQJIURPWR)RU HDFK IL[HG WKUHVKROG YDOXH RI VLPLODULW\ WKH FOXVWHULQJ HUURUV RI GLIIHUHQW DOJRULWKPV ZHUH FRPSDUHG,QWKLVH[SHULPHQWWKHHUURUSDUDPHWHU H ZDVVHWWRDQGV ZDVVHWWRDQG UHVSHFWLYHO\ 7R PDNH UHVXOWV RI WKH NPRGHV DOJRULWKP FRPSDUDEOH ZLWK WKDW RI WKH RWKHU DOJRULWKPVZHOHWNPRGHVSURGXFHWKHVDPHQXPEHURIFOXVWHUVDVWKDWRI6TXHH]HULQDOOFDVHV 7KHNPRGHVVHOHFWHGWKHILUVWN GLVWLQFWUHFRUGVIURPWKHGDWDVHWDVWKHLQLWLDON PRGHV )LJ VKRZV WKH UHVXOWV RI WKH 0XVKURRP GDWDVHW IURP GLIIHUHQW FOXVWHULQJ DOJRULWKPV :H VXPPDUL]HGWKHUHODWLYHSHUIRUPDQFHRIWKHVHDOJRULWKPVLQ7DEOH U R U U ( J Q L U H W V X O &
6TXHH]HU
6WUHDP&OX&' V
6WUHDP&OX&G V
7KHVLPLODULW\WKUHVKROGYDOXH
NPRGHV
)LJ&OXVWHULQJUHVXOWVRQWKH0XVKURRPGDWDVHW
5DQNLQJ
7DEOH 5HODWLYHSHUIRUPDQFHRIGLIIHUHQWFOXVWHULQJDOJRULWKPV
$YHUDJH&OXVWHULQJ(UURU
6TXHH]HU
6WUHDP&OX&' V
6WUHDP&OX&' V NPRGHV
&RPSDULQJWRWKH6TXHH]HUDOJRULWKPDQGWKHNPRGHVDOJRULWKPWKH6WUHDP&OX&' V DOJRULWKPSHUIRUPHGEHVWLQFDVHVDQGVHFRQGEHVWLQFDVHV,WQHYHUSHUIRUPHGZRUVWLQRWKHU FDVHV:KHQV ZDVVHWWRDOWKRXJK6WUHDP&OX&'RQO\SHUIRUPHGEHVWLQRQHFDVHEXWLWQHYHU SHUIRUPHG ZRUVW ,W SHUIRUPHG VHFRQG EHVW RU WKLUG EHVW LQ PRVW RWKHU FDVHV )XUWKHUPRUH WKH DYHUDJHFOXVWHULQJHUURURIWKH6WUHDP&OX&'DOJRULWKPZDVVLJQLILFDQWO\VPDOOHUWKDQWKDWRIRWKHU DOJRULWKPV 2QH LPSRUWDQW REVHUYDWLRQ IURP )LJ DQG 7DEOH ZDV WKDW WKH FOXVWHULQJ DFFXUDF\ RI WKH 6WUHDP&OX&'DOJRULWKPZDVUHDVRQDEO\JRRGDOWKRXJKWKLVDOJRULWKPXVHVDSSUR[LPDWLRQFRXQWV WHFKQLTXH>@RQWKHRULJLQDO6TXHH]HUDOJRULWKP,WLPSOLHVWKDWWKH6WUHDP&OX&'DOJRULWKPFDQ SURGXFHJRRGFOXVWHULQJRXWSXWZLWKOLPLWHGPHPRU\LQWKHGDWDVWUHDPHQYLURQPHQW
2QH PD\ DUJXH WKDW WKH DEVROXWH DFFXUDF\ UDWHV OLVWHG LQ )LJ FDQ QRW SUHFLVHO\ UHIOHFW WKH SHUIRUPDQFH VLQFH WKH\ ZHUH QRW VWULFWO\ REWDLQHG XVLQJ WKH VDPH QXPEHU RI FOXVWHUV +RZHYHU IURP WKRVH UHVXOWV ZH DUH FRQILGHQW WRFODLP WKDW 6WUHDP&OX&'FRXOG SURYLGH DW OHDVW WKH VDPH OHYHORIDFFXUDF\DVRWKHUSRSXODUPHWKRGV $QRWKHU LQWHUHVWLQJ SKHQRPHQRQ ZH KDYH REVHUYHG LQ WKH H[SHULPHQW ZDV WKDW WKH 6WUHDP&OX&'DOJRULWKPWHQGVWRSURGXFHEDODQFHGFOXVWHUV7KLVLVDJRRGSURSHUW\VLQFH PDQ\ UHDOOLIHGDWDPLQLQJDSSOLFDWLRQVGHPDQGFRPSDUDEO\VL]HGVHJPHQWVRIWKHGDWDLUUHVSHFWLYHRI ZKHWKHUWKHQDWXUDOFOXVWHUVLQWKHGDWDKDYHEDODQFHGVL]HVRUQRW 7XQLQJ3DUDPHWHUV
7KH VXSSRUW WKUHVKROG V DQG WKH HUURU SDUDPHWHU H PDNH WKH 6WUHDP&OX&' DOJRULWKP GLIIHUHQW IURP WKH 6TXHH]HU DOJRULWKP 7KHVH SDUDPHWHUV FDQ DIIHFW WKH UHVXOWV RI FOXVWHULQJ DQG WKH VSHHG RI WKH DOJRULWKP ,Q WKH VHTXHO ZH ZLOO JLYH VRPH HPSLULFDO UHVXOWV RQ KRZ WKH\ FDQ DIIHFWWKH6WUHDP&OX&'DOJRULWKPZLWKWKH0XVKURRPGDWDVHW )LUVWO\ ZH RIIHU VRPH LQVLJKWV RQ HUURU SDUDPHWHU H $V GLVFXVVHG LQ 6HFWLRQ HDFK KLVWRJUDP+ LVSUXQHGE\GHOHWLQJVRPHHQWULHVDWEXFNHWERXQGDULHV$SSDUHQWO\ODUJH H UHVXOWV LQ PRUH SUXQLQJV )LJ VKRZV WKDW ZKHQ WKH VXSSRUW WKUHVKROG V ZDV IL[HG WR DQG WKH VLPLODULW\ WKUHVKROG VW ZDV VHW WR UHVSHFWLYHO\ WKH QXPEHU RI SUXQLQJV LQFUHDVHG ZLWK LQFUHDVHRI H 7KHQXPEHURISUXQLQJV RFFXUV
L
VW
VW
VW
VW
7KHHUURUSDUDPHWHU
)LJ7KHQXPEHURISUXQLQJVYVGLIIHUHQWHUURUSDUDPHWHUYDOXHV
)LJ DOVR VKRZV WKDW WKH LQFUHDVH LQ WKH VLPLODULW\ WKUHVKROG VW UHGXFHG WKH QXPEHU RI SUXQLQJV7KLVLVEHFDXVHWKHDOJRULWKPWHQGHGWRSURGXFHPRUHVWDEOHFOXVWHUVZKHQWKHVLPLODULW\ WKUHVKROG EHFDPH ODUJHU 7KDW LV ZKHQ WKH VLPLODULW\ WKUHVKROG YDOXH ZDV UHODWLYHO\ ODUJH DFFRUGLQJWKHH[HFXWLRQSURFHVVRIWKH6WUHDP&OX&'DOJRULWKPRQO\WKRVH³PRUHVLPLODU´LWHPV ZHUHSXWLQWRWKHVDPHFOXVWHU7KXVZHZRXOGKDYHOHVVRSSRUWXQLW\WRSUXQHWKHKLVWRJUDP )LJ JLYHV WKH UHVXOWV RQ WKH QXPEHU RI FOXVWHUV DV H FKDQJHG 7KH QXPEHU RI FOXVWHUV LQFUHDVHGQHDUO\OLQHDUZLWKUHVSHFWWRWKHYDOXHRI H 7KLVSKHQRPHQRQFDQEHLQWHUSUHWHGIURP IDFWWKDWWKHODUJHU H UHVXOWVLQLQFUHDVHRISUXQLQJV+HQFHPRUHFOXVWHUVZHUHIRUPHGWRKDQGOH XQVWDEOHQHVV $W WKH VDPH WLPH ZH DOVR QRWLFH WKDW WKH QXPEHU RI FOXVWHUV IRUPHG E\ WKH 6WUHDP&OX&' DOJRULWKP ZDV OHVV DIIHFWHG E\ WKH VLPLODULW\ WKUHVKROG VW 7KLV PHDQV WKDW WKH DOJRULWKPLVQRWVHQVLWLYHWRSDUDPHWHUVW
7KHQXPEHURIFOXVWHUV
VW
VW
VW
VW
7KHHUURUSDUDPHWHU
)LJ7KHQXPEHURIFOXVWHUVYVGLIIHUHQWHUURUSDUDPHWHUYDOXHV
&OXVWHULQJ(UURU
)LJVKRZVKRZWKHFOXVWHULQJHUURUFKDQJHGDV H LQFUHDVHG,WFDQEHREVHUYHGWKDWWKH FOXVWHULQJHUURUGLGQ¶WFKDQJHVLJQLILFDQWO\ZLWKUHVSHFWWRWKHHUURUSDUDPHWHU H 7KLVPHDQVWKDW WKHFOXVWHULQJDFFXUDF\ZDVOHVVDIIHFWHGE\FKDQJHVRQ H
VW
VW
VW
VW
7KHHUURUSDUDPHWHU
)LJ&OXVWHULQJHUURUYVGLIIHUHQWHUURUSDUDPHWHUYDOXHV
7KHQXPEHURISUXQLQJV RFFXUV
6HFRQGO\ ZH VWXGLHG ZKDW ZDV WKH HIIHFW RI WKH VXSSRUW WKUHVKROG V RQ WKH DOJRULWKP¶V SHUIRUPDQFH 7KH YDOXH RI H ZDV IL[HG WR DQG WKH VLPLODULW\ WKUHVKROG VW ZDV VHW WR UHVSHFWLYHO\ :H VWXGLHG KRZ WKH QXPEHU RI SUXQLQJV WKH QXPEHU RI FOXVWHUV DQG WKH FOXVWHULQJ HUURU FKDQJHG ZLWK UHVSHFW WR GLIIHUHQW V YDOXHV )LJ )LJ DQG )LJ VKRZ WKRVH H[SHULPHQWDOUHVXOWVZKHUHV YDULHGIURPWR
VW
VW
VW
VW
7KHVXSSRUWWKUHVKROG
)LJ7KHQXPEHURISUXQLQJVYVGLIIHUHQWVXSSRUWWKUHVKROGYDOXHV
7KHQXPEHURIFOXVWHUV
VW
VW
VW
VW
7KHVXSSRUWWKUHVKROG
)LJ7KHQXPEHURIFOXVWHUVYVGLIIHUHQWVXSSRUWWKUHVKROGYDOXHV
&OXVWHULQJ(UURU
VW
VW
VW
VW
7KHVXSSRUWWKUHVKROG
)LJ&OXVWHULQJHUURUYVGLIIHUHQWVXSSRUWWKUHVKROGYDOXHV
:LWKLQFUHDVHRIV ZHFDQVHHWKDWWKHQXPEHURISUXQLQJVGHFUHDVHG )LJ 7KHQXPEHURI FOXVWHUV LQFUHDVHG RQO\ ZKHQ WKH VXSSRUW WKUHVKROG YDOXH ZDV UHODWLYHO\ ODUJH )LJ DQG WKH FOXVWHULQJHUURUGLGQ¶WFKDQJHVLJQLILFDQWO\ )LJ +HQFHFKDQJHVRQSDUDPHWHUV GLGQRWDIIHFW WKHDOJRULWKPVLJQLILFDQWO\ ,QVXPPDU\ IURPWKHDIRUHPHQWLRQHGH[SHULPHQWVZH FDQVHHWKDWWKHSHUIRUPDQFHRIWKH 6WUHDP&OX&' DOJRULWKP ZDV PDLQO\ GHWHUPLQHG E\ WKH SDUDPHWHU H DQG OHVV DIIHFWHG E\ SDUDPHWHUV 7RSURSHUO\VHWDSSURSULDWHYDOXHVWRWKHVHSDUDPHWHUVLQSUDFWLFHZHVXJJHVWWKDWWKH VXSSRUWWKUHVKROGYDOXHV VKRXOGWDNHDPLGGOHYDOXHEHWZHHQDQG:KLOHKRZWRVHW H YDOXH LVDOLWWOHGLIILFXOWZHRIIHUPRUHHPSLULFDOLQVLJKWVRQWKLVSUREOHPLQWKHQH[WVHFWLRQ
([SHULPHQWVZLWK6\QWKHWLF'DWDVHW
:HSUHVHQWH[SHULPHQWVZLWKV\QWKHVL]HGFDWHJRULFDOGDWDVWUHDPVFUHDWHGZLWKWKHVRIWZDUH GHYHORSHGE\'DQD&ULVWRIRU>@7KHVWUHDPVL]H LHQXPEHURIURZV WKHQXPEHURIDWWULEXWHV DQG WKH QXPEHU RI FODVVHV DUH WKH PDMRU SDUDPHWHUV LQ WKH V\QWKHVL]HG FDWHJRULFDO GDWD VWUHDPV JHQHUDWLRQ 7DEOH VKRZV WKH GDWD VWUHDPV JHQHUDWHG ZLWK GLIIHUHQW SDUDPHWHUV DQG XVHG LQ WKH H[SHULPHQWV,QDOOGDWDVHWVZHVHWWKHUDQGRPJHQHUDWRUVHHGWR 6LQFHZHNQHZWKHWUXHQXPEHURIFOXVWHUVLQHDFKJHQHUDWHGGDWDVHWLQDOOH[SHULPHQWVZH VHW WKH PD[LPDO QXPEHU RI FOXVWHUV DV WKH QXPEHU RI FODVVHV VKRZQ LQ 7DEOH :H IL[HG WKH VXSSRUW WKUHVKROG YDOXH WR DQG WKH VLPLODULW\ WKUHVKROG YDOXH WR EH KDOI RI WKH QXPEHU RI DWWULEXWHV
7KHVRXUFHFRGHVDUHSXEOLFDYDLODEOHDW KWWS ZZZFVXPEHGXaGDQD*$&OXVWLQGH[KWPO
7DEOH 7HVW'DWD6WUHDPV
'DWD6WUHDPV
6WUHDP6L]H
1XPEHURI$WWULEXWHV
1XPEHURI&ODVVHV
'DWD6WUHDP
'DWD6WUHDP 'DWD6WUHDP
'DWD6WUHDP
7KH H[SHULPHQWV ZHUH GLYLGHG LQWR WKUHH SDUWV )LUVWO\ WKH WHVW RI WKH H[HFXWLRQWLPH RQ GDWDVWUHDPVRIGLIIHUHQWVL]HVUHYHDOHGWKDWWKHH[HFXWLRQWLPHRIRXUDOJRULWKPZDVOLQHDUWRWKH GDWDVL]H 6HFRQGO\ZHVWXGLHGWKHDIIHFWRIWKHHUURUSDUDPHWHU H RQWKHPHPRU\XVDJHZKLFK VKRZHGWKDWWKHPHPRU\XVDJHGHFUHDVHGZLWKLQFUHDVHRI H )XUWKHUPRUHZHHPSLULFDOO\YHULILHG WKHVWDWHPHQWWKDWWKH6WUHDP&OX&'DOJRULWKPZDVVXSHULRUWRWKH6TXHH]HUDOJRULWKPZLWKUHVSHFW WR PHPRU\ XVDJH 7KLUGO\ ZH GHPRQVWUDWHG WKDW FKDQJHV RQ H GLG QRW DIIHFW WKH FOXVWHULQJ
([HFXWLRQ7LPH VHF
DFFXUDF\RIRXUDOJRULWKPVLJQLILFDQWO\HYHQLQWKHGDWDVWUHDPHQYLURQPHQWZLWKODUJHGDWDVL]H )URP DQG ZHFDQPDNHWKHFRQFOXVLRQWKDWWKHSHUIRUPDQFHRIRXUDOJRULWKPZLOOVWLOOEH JRRG HYHQLIRQO\DVPDOOPHPRU\VSDFHLVDYDLODEOH7KLVLQGLFDWHVWKDWRXUDOJRULWKPLVVXLWDEOH IRUFOXVWHULQJFDWHJRULFDOGDWDVWUHDPV ([HFXWLRQ 7LPH 7KH FUXFLDO FKDUDFWHULVWLF RI WKH VWUHDP DOJRULWKP LV WR NHHS XS ZLWK FRQWLQXRXVO\FRPLQJGDWDVWUHDP7KDWLVWRVD\WKHH[HFXWLRQWLPHPXVWEHOLQHDUWRWKHGDWDVL]H :H WHVWHG GDWD VWUHDPV RI GLIIHUHQW VL]HV DQG UHFRUGHG FRUUHVSRQGLQJ H[HFXWLRQ WLPHV RI WKH DOJRULWKP )LJ VKRZVKRZWKHH[HFXWLRQWLPHVFDOHGXSRQWKHIRXUGDWDVHWV WKHHUURUSDUDPHWHUZDV IL[HGWR :HFDQVHHWKDWDVWKHVL]HRIWKHGDWDVHWVLQFUHDVHGWKHH[HFXWLRQWLPHLQFUHDVHG OLQHDUO\7KLVILJXUHDOVRH[KLELWVWKDWVORSHVRIWKHFXUYHVDUHGLIIHUHQW:HQRWLFHWKDWWKHFXUYH ZLWK KLJKHU VORSH UHSUHVHQWV WKH GDWD VWUHDP LQ ZKLFK ERWK WKH QXPEHU RI DWWULEXWHV DQG WKH QXPEHU RI FODVVHV DUH ODUJHU $SSDUHQWO\ WKLV LV GXH WR IDFW WKDW WKH WLPH FRPSOH[LW\ RI WKH DOJRULWKPLVOLQHDUWRERWKWKHQXPEHURIDWWULEXWHVDQGWKHQXPEHURIFODVVHV
'DWD6WUHDP 'DWD6WUHDP
)LJ ([HFXWLRQWLPHYVVWUHDPVL]H
'DWD6WUHDP 'DWD6WUHDP
1XPEHURI5HFRUGV
0HPRU\ 8VDJH 2QH GLVWLQFW IHDWXUH RI VWUHDPLQJ DOJRULWKPV LV WKDW WKH\ KDYH OLPLWHG PHPRU\ UHTXLUHPHQWV ,W LV DOVR WKH EDVLV IRU RXU DUJXPHQW WKDW WKH 6WUHDP&OX&' DOJRULWKP LV PRUHIDYRUHGLQWKHGDWDVWUHDPHQYLURQPHQWWKDQWKH6TXHH]HUDOJRULWKP
7RFRPSDUHWKH6WUHDP&OX&'DOJRULWKPDQGWKH6TXHH]HUDOJRULWKPRQPHPRU\XVDJHZH UDQJHGWKHVWUHDPVL]HIURPWRRQGDWDVWUHDP WKHHUURUSDUDPHWHUZDVIL[HGWR WR FKHFN WKH IOXFWXDWLRQ RI PHPRU\ UHTXLUHPHQWV LQ WHUPV RI WKH QXPEHU RI HQWULHV $V VKRZQ LQ )LJ ZKHQ WKH VWUHDP VL]H LQFUHDVHG WKH PHPRU\ XVDJH RI WKH 6TXHH]HU DOJRULWKP LQFUHDVHGOLQHDUO\ZKLOHWKHPHPRU\XVDJHRIWKH6WUHDP&OX&'DOJRULWKPNHSWDOPRVWFRQVWDQW )XUWKHUPRUH LQ DOO FDVHV WKH 6WUHDP&OX&' DOJRULWKP RXWSHUIRUPHG WKH 6TXHH]HU DOJRULWKP E\ IDFWRUVRIWR 7KH HUURU SDUDPHWHU H LV DQ LPSRUWDQW SDUDPHWHU LQ WKLV DOJRULWKP DQG KDV ELJ LPSDFW RQ PHPRU\ XVDJH DV SRLQWHG RXW 6HFWLRQ ,Q WKLV H[SHULPHQW ZH UDQJHG H IURP WR WR FKHFNWKHIOXFWXDWLRQRIPHPRU\XVDJHRQWKHIRXUGDWDVWUHDPV)LJVKRZVWKHUHVXOWV,WFDQ EH VHHQIURPWKHILJXUHWKDWZKHQWKH H YDOXHLQFUHDVHGWKHPHPRU\XVDJHGHFUHDVHGVLJQLILFDQWO\ ZKHQ H ZDVUHODWLYHO\VPDOODQGWKHUHDIWHUNHSWGHFUHDVLQJZLWKDVORZUDWH
1XPEHURI(QWULHV
6TXHH]HU
6WUHDP&OX&'
1XPEHURI5HFRUGV
)LJ0HPRU\XVDJHLQWHUPVRIWKHQXPEHURIHQWULHVYVVWUHDPVL]HIRUGDWDVWUHDP
1XPEHURI(QWHULHV
'DWD6WUHDP 'DWD6WUHDP
'DWD6WUHDP 'DWD6WUHDP
7KH(UURU3DUDPHWHU
)LJ0HPRU\XVDJHLQWHUPVRIWKHQXPEHURIHQWULHVYVHUURUSDUDPHWHU H
&OXVWHULQJ$FFXUDF\ $VZHKDYHSUHVHQWHGLQ6HFWLRQRQWKHUHDOGDWDVHWVWKH H GLGQRW DIIHFW WKH FOXVWHULQJ DFFXUDF\ RI RXU DOJRULWKP VLJQLILFDQWO\ ,Q WKLV H[SHULPHQW ZH SURYLGHG IXUWKHU HYLGHQFH XVLQJ ODUJH V\QWKHWLF GDWD VWUHDPV $V VKRZQ LQ )LJ ZKHQ WKH H YDOXH ZDV UDQJHG IURP WR WKH DEVROXWH FOXVWHULQJ HUURU RQ GDWD VWUHDP DQG DOPRVW NHSW FRQVWDQW 7KH PDLQ PHPRU\ LV RFFXSLHG E\ WKH HQWULHV LQ KLVWRJUDPV LQ ERWK 6WUHDP&OX&' DOJRULWKP DQG 6TXHH]HU DOJRULWKP7KHUHIRUHWKHPHPRU\XVDJHIRUHDFKDOJRULWKPFDQEHPHDVXUHGZLWKWKHQXPEHURIHQWULHVLQDOOWKH KLVWRJUDPV 6LQFHWKHFOXVWHUVRIWKHVHJHQHUDWHGGDWDVHWVDUHZHOOVHSDUDWHGVRWKHFOXVWHULQJDFFXUDF\LVUHODWLYHO\YHU\KLJK 7RPDNHWKHFKDQJHVRQFOXVWHULQJDFFXUDF\PRUHFOHDUZHXVHDEVROXWHFOXVWHULQJHUURULQ)LJ
$EVROXWH&OXVWHULQJ(UURU
7KLV ILJXUH DOVR VKRZV WKDW WKH FXUYH IRU GDWD VWUHDP FKDQJHV GLVWLQFWO\ RQ DEVROXWH FOXVWHULQJ HUURU FRPSDUHG ZLWK WKH RWKHU WKUHH FXUYHV +RZHYHU LQ WKH LQWHUYDO >@ WKLV FXUYHLVURXJKO\SDUDOOHOWRWKH[D[LV7KDWLVWRVD\IURPDJOREDOYLHZSRLQWWKHFOXVWHULQJHUURU GDWDVWUHDPDOVRNHSWQHDUO\FRQVWDQW
'DWD6WUHDP 'DWD6WUHDP
'DWD6WUHDP 'DWD6WUHDP
7KH(UURU3DUDPHWHU
)LJ&OXVWHUHUURULQWHUPVRIWKHQXPEHUPLVFODVVLILHGREMHFWVYVHUURUSDUDPHWHU H
7KH H[SHULPHQWDO UHVXOWV LQ WKLV 6HFWLRQ GHPRQVWUDWH WKH VFDODELOLW\ RI WKH 6WUHDP&OX&' DOJRULWKPZLWKUHVSHFWWRVWUHDPVL]HDQGOLPLWHGUHTXLUHPHQWVRQPDLQ PHPRU\ ,W TXDOLILHVWKH 6WUHDP&OX&'DOJRULWKPIRUFOXVWHULQJKLJKVSHHGHYROYLQJFDWHJRULFDOGDWDVWUHDPV
'LVFXVVLRQ ,Q WKLV VHFWLRQ ZH ILUVW GLVFXVV WZR GLIIHUHQW VWUDWHJLHV FRPPRQO\ XVHG LQ FOXVWHULQJ GDWD VWUHDPV6XEVHTXHQWO\ZHGLVFXVVWKHGLIIHUHQFHLQRXUDSSURDFKIURPWKRVHRIRWKHUUHVHDUFKHUV¶ VXFKDV*XKD>@)LQDOO\ZHGLVFXVVSRVVLEOHPRGLILFDWLRQVRQRWKHUH[LVWLQJFDWHJRULFDOGDWD FOXVWHULQJDOJRULWKPVWRPDNHWKHPVXLWDEOHLQFOXVWHULQJGDWDVWUHDPV 6WUDWHJLHVIRU&OXVWHULQJ'DWD6WUHDPV
6LQFH PRVW H[LVWLQJ FOXVWHULQJ DOJRULWKPV IRU GDWD VWUHDPV DUH GHULYHG IURP WUDGLWLRQDO QRQVWUHDPLQJDOJRULWKPV,QJHQHUDOWKHUHDUHWZRFRPPRQO\XVHGVWUDWHJLHVIRUFOXVWHULQJGDWD VWUHDPV 6WUDWHJ\ $OJRULWKPVLQWKLVFDWHJRU\UHTXLUHPXOWLSOHSDVVHVRYHUWKHZKROHGDWDVHWLQ QRQVWUHDPLQJHQYLURQPHQW0RVWRISUHYLRXVZRUNV>HJ@IDOOLQWRWKLVFDWHJRU\7KH\ H[WHQG WKH FODVVLFDO PXOWLSOHSDVV FOXVWHULQJ DOJRULWKPV VXFK DV NPHGLDQ DQG NPHDQV WR GDWD VWUHDPVE\DVVXPLQJWKDWWKHGDWDREMHFWVDUULYHDVFKXQNV; ; «;Q«DQGHDFKFKXQNILWVLQ WKHPDLQPHPRU\)RUHDFKFKXQNWKH\XVHDFOXVWHULQJDOJRULWKPVXFKDVNPHGLDQ RUNPHDQV RU /2&$/6(5$&+LQ>@ WRFOXVWHULW$IWHUFOXVWHULQJWKHPHPRU\LVSXUJHGRQO\N ZHLJKWHG FOXVWHUFHQWHUVRIWKHGDWDFKXQNUHPDLQ7KHFOXVWHULQJSURFHVVUHSHDWVIRUDOOFKXQNV)LQDOO\WKH NPHGLDQDOJRULWKPLVDSSOLHGWRWKHZHLJKWHGFHQWHUVRIWKHFKXQNVWRREWDLQDVHWRIFHQWHUVIRU WKHHQWLUHVWUHDP; ; « ;L 7KH PDLQ LGHDRI WKLV VWUDWHJ\ LV WR FRPSUHVV WKH VHW RI GDWD SRLQWV LQWR PLFURFOXVWHUV DQG SHUIRUPWKHPXOWLSOHSDVVFOXVWHULQJSURFHVVLQPDLQPHPRU\
6WUDWHJ\ 2XU DOJRULWKP IDOOV LQWR WKLV FDWHJRU\ 7KH DOJRULWKPV LQ WKLV FDWHJRU\ DUH PRGLILFDWLRQV RI WKRVH RQHSDVV FOXVWHULQJ DOJRULWKPV +HQFH WKH PDLQ IRFXV LQ WKH DOJRULWKP GHVLJQLVWRHQDEOHWKHDOJRULWKPWRXVHDIL[HGPDLQPHPRU\RQO\
7KH'LIIHUHQFHLQ2XU$SSURDFK)URP2WKHUV
,QFRPSDULVRQZLWKRWKHUH[LVWLQJVWUHDPLQJFOXVWHULQJDOJRULWKPVVXFKDVWKRVHLQ>@ WKH ELJJHVW GLIIHUHQFH LV WKDW RXU DOJRULWKP LV GHVLJQHG IRU FOXVWHULQJ FDWHJRULFDO GDWD VWUHDPV ZKLOHRWKHUDOJRULWKPVDLPDWFOXVWHULQJQXPHULFGDWDVWUHDPV )XUWKHUPRUH DV GLVFXVVHG LQ 6HFWLRQ ZH XWLOL]H D GLIIHUHQW VWUDWHJ\ LQ WKH DOJRULWKP GHVLJQ
0RGLI\LQJ2WKHU$OJRULWKPVWR&OXVWHU&DWHJRULFDO'DWD6WUHDPV
6LQFHPRVWDOJRULWKPVSURSRVHGLQUHFHQW\HDUVIRUFOXVWHULQJFDWHJRULFDOGDWD>@UHTXLUH PXOWLSOHSDVVHVRYHUWKHGDWDVHW,WLVFOHDUWKDWZHFDQPRGLI\WKHPDFFRUGLQJWR6VWUDWHJ\DV GLVFXVVHG LQ 6HFWLRQ :H ZLOO WDNH WKH NPRGHV > @ DOJRULWKP DV DQ H[DPSOH IRU LOOXVWUDWLRQ 7KHNPRGHVDOJRULWKPH[WHQGVWKHNPHDQVSDUDGLJPWRFDWHJRULFDOGRPDLQ,QWKLVDOJRULWKP WKHFOXVWHUFHQWHULVUHSODFHGZLWKPRGHVWRKDQGOHFDWHJRULFDOGDWD$FFRUGLQJWR6WUDWHJ\ZH DVVXPH WKDW GDWD REMHFWV DUULYH DV FKXQNV ; ; « ;Q )RU HDFK FKXQN ;L ZH XVH NPRGHV WR FOXVWHU;L WRSURGXFHN PRGHV&RQVHTXHQWO\ZHDSSO\WKHNPRGHVDOJRULWKPWRWKHWKRVHPRGHV IURP; ; «;L WRREWDLQDVHWRIPRGHVIRUWKHHQWLUHVWUHDP; ; « ;L +RZHYHU GHVSLWH WKH VLPLODULW\ LQ WKH FOXVWHULQJ SURFHVV WKH PRGLILHG VWUHDPLQJ NPRGHV PHWKRGQHHGVWREHIXUWKHUH[SORUHGGXHWRVLJQLILFDQWGLIIHUHQFHVLQFDWHJRULFDOGDWDDQGQXPHULF GDWDHVSHFLDOO\LQWKHKLJKVSHHGHYROYLQJGDWDVWUHDPV
&RQFOXVLRQV $ORQJ ZLWK WKH DSSHDUDQFH RI PRUH DQG PRUH FRQWLQXRXV GDWD LQ UHDOOLIH DSSOLFDWLRQV HIILFLHQWPLQLQJRQGDWDVWUHDPVEHFRPHVDFKDOOHQJHWRH[LVWLQJGDWDPLQLQJDOJRULWKPVSDUWLDOO\ EHFDXVHRIWKHKLJKFRVWRQERWKVWRUDJHDQGWLPHRIGLVWULEXWHGFRPSXWDWLRQ>@ $ ZLGH VSHFWUXP RI FOXVWHULQJ PHWKRGV KDV EHHQ GHYHORSHG LQ GDWD PLQLQJ VWDWLVWLFV DQG PDFKLQHOHDUQLQJ$OWKRXJKDIHZKDYHEHHQH[DPLQHGLQWKHFRQWH[WRIVWUHDPGDWDFOXVWHULQJWR RXUNQRZOHGJHZHDUHWKHILUVWWRFRQVLGHUWKHSUREOHPRIFOXVWHULQJFDWHJRULFDOGDWDVWUHDPV:H KDYHSUHVHQWHGWKHHIIHFWLYHFDWHJRULFDOGDWDVWUHDPFOXVWHULQJDOJRULWKP6WUHDP&OX&'6LQFHWKH SURSRVHG DOJRULWKP KDV VPDOO PHPRU\ IRRWSULQWV UHJDUGOHVV RI WKH DPRXQW RI VWUHDP VL]H LW LV VXLWDEOH IRU VWUHDPLQJ GDWD :H KDYH DOVR SURYLGHG HPSLULFDO DQDO\VLV RI WKH DOJRULWKP¶V SHUIRUPDQFH RQ UHDO GDWDVHWV DQG V\QWKHWLF GDWD VWUHDPV $QDO\VLV DQG H[SHULPHQWV KDYH VKRZQ WKDWRXUDOJRULWKPFDQFRSHZLWKWKHGDWDDUULYDOVSHHGDQGRQO\QHHGVRQHVFDQRQWKHGDWDVWUHDP 7KHDFFXUDF\RIWKHUHVXOWLVFRPSDUDEOHWRWKDWRIRWKHUDOJRULWKPV ,QRXUIXWXUHZRUNZHDUHJRLQJWRXVHWKH6WUHDP&OX&'DOJRULWKPWRGHWHFWFOXVWHUEDVHG ORFDORXWOLHUV>@DQGVHPDQWLFRXWOLHUV>@LQWKHGDWDVWUHDPHQYLURQPHQW:HZLOODOVRWU\WR PRGLI\RWKHUFDWHJRULFDOGDWDFOXVWHULQJDOJRULWKPVWRFOXVWHUFDWHJRULFDOGDWDVWUHDPV
$FNQRZOHGJHPHQWV
7KH FRPPHQWV DQG VXJJHVWLRQV IURP WKH DQRQ\PRXV UHYLHZHUV DUH DSSUHFLDWHG 7KLV UHVHDUFK LV VXSSRUWHG E\ 7KH +LJK 7HFKQRORJ\ 5HVHDUFK DQG 'HYHORSPHQW 3URJUDP RI &KLQD *UDQW 1R $$ *UDQW 1R $$= *UDQW 1R $$ DQG WKH ,%0 685 5HVHDUFK)XQG
5HIHUHQFHV
>@ / 2 &KDODJKDQ 1 0LVKUD $ 0H\HUVRQ DQG 6 *XKD 6WUHDPLQJGDWD DOJRULWKPV IRU KLJKTXDOLW\FOXVWHULQJ,Q 3URFRI,&'(¶SS >@ $=KRX=&DL/:HLDQG:4LDQ0.HUQHOPHUJLQJ WRZDUGVGHQVLW\HVWLPDWLRQRYHU GDWDVWUHDPV,Q 3URFRI'$6))$¶SS >@ 3 'RPLQJRV DQG * +XOWRQ &DWFKLQJ XS ZLWK WKH GDWD UHVHDUFK LVVXHV LQ PLQLQJ GDWD VWUHDPV ,Q 6,*02' :RUNVKRS RQ 5HVHDUFK ,VVXHV LQ 'DWD 0LQLQJ DQG .QRZOHGJH 'LVFRYHU\ >@ 3 'RPLQJRV DQG * +XOWRQ 0LQLQJ KLJKVSHHG GDWD VWUHDPV ,Q 3URF RI .''¶ SS >@ * +XOWRQ / 6SHQFHU DQG 3 'RPLQJRV 0LQLQJ WLPHFKDQJLQJ GDWD VWUHDPV ,Q 3URF RI .''¶SS >@ : 1 6WUHHW DQG @ 0/DVW2QOLQHFODVVLILFDWLRQRIQRQVWDWLRQDU\GDWDVWUHDPV,QWHOOLJHQW'DWD$QDO\VLV SS >@ *60DQNXDQG50RWZDQL$SSUR[LPDWHIUHTXHQF\FRXQWVRYHUGDWDVWUHDPV,Q 3URFRI 9/'%¶SS > @ @'/DPEHUWDQG-&3LQKHLUR0LQLQJDVWUHDPRIWUDQVDFWLRQVIRUFXVWRPHUSDWWHUQV,Q 3URF RI .''¶SS >@ & &RUWHV . )LVKHU ' 3UHJLERQ DQG $ 5RJHUV +DQFRFN D ODQJXDJH IRU H[WUDFWLQJ VLJQDWXUHVIURPGDWDVWUHDPV,Q 3URFRI.''¶SS >@%@ 0 &KDULNDU / 2 &DOODJKDQ DQG 5 3DQLJUDK\ %HWWHU VWUHDPLQJ DOJRULWKPV IRU FOXVWHULQJ
SUREOHPV,Q 3URFRI672&¶SS >@%%DEFRFN0'DWDU50RWZDQLDQG/2 &DOODJKDQ0DLQWDLQLQJYDULDQFHDQGNPHGLDQV RYHUGDWDVWUHDPZLQGRZV,Q 3URFRI32'6¶SS >@3'RPLQJRVDQG*+XOWRQ$JHQHUDOPHWKRGIRUVFDOLQJXSPDFKLQHOHDUQLQJDOJRULWKPVDQG LWVDSSOLFDWLRQWRFOXVWHULQJ,Q 3URFRI,&0/¶SS > @ && $JJDUZDO - +DQ - :DQJ DQG 3 6 @ '*LEVRQ- .OHLEHUJ DQG3 5DJKDYDQ&OXVWHULQJ FDWHJRULFDO GDWD DQDSSURDFK EDVHG RQ G\QDPLFV\VWHPV,Q 3URFRI9/'%¶ SS >@ @=+XDQJ([WHQVLRQVWRWKHNPHDQVDOJRULWKPIRUFOXVWHULQJODUJHGDWDVHWVZLWKFDWHJRULFDO YDOXHV'DWD0LQLQJDQG.QRZOHGJH'LVFRYHU\ SS >@ ) -ROORLV DQG 0 1DGLI &OXVWHULQJ ODUJH FDWHJRULFDO GDWD ,Q 3URF RI 3$.''¶ SS >@ = +XDQJ DQG 0 . 1J $ IX]]\ NPRGHV DOJRULWKP IRU FOXVWHULQJ FDWHJRULFDO GDWD ,((( 7UDQVDFWLRQRQ)X]]\6\VWHPV SS >@ 0 . 1J DQG - & :RQJ &OXVWHULQJ FDWHJRULFDO GDWD VHWV XVLQJ WDEX VHDUFK WHFKQLTXHV 3DWWHUQ5HFRJQLWLRQ SS > @@)*LDQQRWWL**R]]LDQG*0DQFR&OXVWHULQJWUDQVDFWLRQDOGDWD,Q 3URFRI3.''¶ SS >@ 9 *DQWL - *HKUNH DQG 5 5DPDNULVKQDQ &$&786FOXVWHULQJ FDWHJRULFDO GDWD XVLQJ VXPPDULHV,Q 3URFRI.''¶ SS >@ 6 *XKD 5 5DVWRJL DQG . 6KLP 52&. D UREXVW FOXVWHULQJ DOJRULWKP IRU FDWHJRULFDO DWWULEXWHV,Q 3URFRI,&'(¶ SS >@.:DQJ&;XDQG%/LX&OXVWHULQJWUDQVDFWLRQVXVLQJODUJHLWHPV,Q 3URFRI&,.0¶ SS >@&+@ & + @=+H;;XDQG6'HQJ6TXHH]HU DQHIILFLHQW DOJRULWKPIRUFOXVWHULQJFDWHJRULFDOGDWD -RXUQDORI&RPSXWHU6FLHQFH 7HFKQRORJ\ SS >@ ' %DUEDUD @ @ * 0HU] DQG 3 0XUSK\ 8FL UHSRVLWRU\ RI PDFKLQH OHDUQLQJ GDWDEDVHV 8QLYHUVLW\ RI &DOLIRUQLD 'HSDUWPHQW RI ,QIRUPDWLRQ DQG &RPSXWHU 6FLHQFH 7HFKQLFDO 5HSRUW KWWS ZZZLFVXFLHGXPOHDUQ0/5HSRVLWRU\KWPO >@ = +H ; ;X DQG 6 'HQJ 'LVFRYHULQJ FOXVWHU EDVHG ORFDO RXWOLHUV 3DWWHUQ 5HFRJQLWLRQ /HWWHUV SS >@ = +H 6 'HQJ DQG ; ;X 2XWOLHU GHWHFWLRQ LQWHJUDWLQJ VHPDQWLF NQRZOHGJH ,Q 3URF RI :$,0¶SS
