circle, rectangle, ellipse, etc. Due to the .... taxonomy in performing cluster analysis. While the ..... (ADL 2000), 22-24 May 2000, Washington, DC, pp. 173-182.
$ /LQN&OXVWHULQJ%DVHG$SSURDFKIRU&OXVWHULQJ &DWHJRULFDO'DWD
=HQJ\RX+H;LDRIHL;X6KHQJFKXQ'HQJ 'HSDUWPHQWRI&RPSXWHU6FLHQFHDQG(QJLQHHULQJ+DUELQ,QVWLWXWHRI7HFKQRORJ\ :HVW'D]KL6WUHHW32%R[+DUELQ35&KLQD ]HQJ\RXKH#\DKRRFRP^[LDRIHLGVF`#KLWHGXFQ
$EVWUDFW &DWHJRULFDO GDWD FOXVWHULQJ &'& DQG OLQN FOXVWHULQJ /& KDYH EHHQ FRQVLGHUHG DV VHSDUDWH UHVHDUFK DQG DSSOLFDWLRQ DUHDV 7KH PDLQ IRFXV RI WKLV SDSHU LV WR LQYHVWLJDWH WKH FRPPRQDOLWLHVEHWZHHQWKHVHWZRSUREOHPVDQGWKHXVHVRIWKHVHFRPPRQDOLWLHVIRUWKHFUHDWLRQ RI QHZ FOXVWHULQJ DOJRULWKPV IRU FDWHJRULFDO GDWD EDVHG RQ FURVVIHUWLOL]DWLRQ EHWZHHQ WKH WZR GLVMRLQW UHVHDUFK ILHOGV 0RUH SUHFLVHO\ ZH IRUPDOO\ WUDQVIRUP WKH &'& SUREOHP LQWR DQ /& SUREOHP DQG DSSO\ /& DSSURDFK IRU FOXVWHULQJ FDWHJRULFDO GDWD ([SHULPHQWDO UHVXOWV RQ UHDO GDWDVHWVVKRZWKDW/&EDVHGFOXVWHULQJPHWKRGLVFRPSHWLWLYHZLWKH[LVWLQJ&'&DOJRULWKPVZLWK UHVSHFWWRFOXVWHULQJDFFXUDF\ .H\ZRUGV&OXVWHULQJ&DWHJRULFDO'DWD/LQN&OXVWHULQJ'DWD0LQLQJ
,QWURGXFWLRQ
&OXVWHULQJ W\SLFDOO\ JURXSV GDWD LQWR VHWV LQ VXFK D ZD\ WKDW WKH LQWUDFOXVWHU VLPLODULW\ LV PD[LPL]HG ZKLOH WKH LQWHUFOXVWHU VLPLODULW\ LV PLQLPL]HG 7KH FOXVWHULQJ WHFKQLTXH KDV EHHQ H[WHQVLYHO\ VWXGLHG LQ PDQ\ ILHOGV VXFK DV SDWWHUQ UHFRJQLWLRQ >@ FXVWRPHU VHJPHQWDWLRQ >@ VLPLODULW\VHDUFK>@DQGWUHQGDQDO\VLV>@ 0RVW SUHYLRXV FOXVWHULQJ DOJRULWKPV IRFXV RQ QXPHULFDO GDWD ZKRVH LQKHUHQW JHRPHWULF SURSHUWLHVFDQEHH[SORLWHGQDWXUDOO\WRGHILQHGLVWDQFHIXQFWLRQVEHWZHHQGDWDSRLQWV+RZHYHU PXFKRIWKHGDWDH[LVWHGLQWKHGDWDEDVHVLVFDWHJRULFDOZKHUHDWWULEXWHYDOXHVFDQ¶WEHQDWXUDOO\ RUGHUHG DV QXPHULFDO YDOXHV $Q H[DPSOH RI FDWHJRULFDO DWWULEXWH LV VKDSH ZKRVH YDOXHV LQFOXGH FLUFOH UHFWDQJOH HOOLSVH HWF'XHWRWKHVSHFLDOSURSHUWLHVRIFDWHJRULFDODWWULEXWHVWKHFOXVWHULQJ RI FDWHJRULFDO GDWD VHHPV PRUH FRPSOLFDWHG WKDQ WKDW RI QXPHULFDO GDWD $ IHZ DOJRULWKPV KDYH EHHQSURSRVHGLQUHFHQW\HDUVIRUFOXVWHULQJFDWHJRULFDOGDWD>@ &RRFFXUUHQFH GDWD LV DQ LQFUHDVLQJO\ LPSRUWDQW DQG DEXQGDQW VRXUFH RI GDWD 7KLV W\SH RI GDWD KDV ORQJ EHHQ LPSRUWDQW LQ WKH VRFLDO VFLHQFHV PDUNHWLQJ DQG WKH JRYHUQPHQW LQWHOOLJHQFH FRPPXQLW\>@,QRQHJHQHUDOIRUPWKHLQSXWFRQVLVWVRIDVHULHVRIOLQNV (DFKOLQNLVDVHWRI HQWLWLHV WKDW KDYH EHHQ MRLQHG E\ VRPH HYHQW RU UHODWLRQ /LQN &OXVWHULQJ /& DWWHPSWV WR ILQG XQGHUO\LQJ JURXSV RI HQWLWLHV JLYHQ OLQN DQG GHPRJUDSKLF GDWD >@ .XELFD HW DO >@ FRQGXFWHGVRPHUHVHDUFKHIIRUWVRQ/& 8QWLOUHFHQWO\&'&DQG/&KDYHEHHQFRQVLGHUHGDVVHSDUDWHUHVHDUFKDQGDSSOLFDWLRQDUHDV
7KLVZRUNZDVVXSSRUWHGE\WKH+LJK7HFKQRORJ\5HVHDUFKDQG'HYHORSPHQW3URJUDPRI&KLQD 1R $$1R$$=1R$$ DQGWKH,%06855HVHDUFK)XQG
7KH VWDUWLQJ SRLQW LQ WKLV SDSHU LV WKH REVHUYDWLRQ RI VRPH NH\ XQGHUO\LQJ VLPLODULWLHV EHWZHHQ WKHVHWZRGLIIHUHQWDUHDV7KLVREVHUYDWLRQPDNHVSRVVLEOHWKHVWXG\RI&'&SUREOHPIURPD/& SHUVSHFWLYH7KLVGLIIHUHQWSHUVSHFWLYHPD\HQDEOHDEHWWHUXQGHUVWDQGLQJRIWKH&'&DOJRULWKPV DQGKHOSLQGHYLVLQJLPSURYHGRUK\EULGYHUVLRQVE\FRPELQLQJHOHPHQWVIURPDUHDVWKDWZRXOG RWKHUZLVH EH FRQVLGHUHG LQFRPSDWLEOH 7KDW LV RXU ILUVW FRQWULEXWLRQ LV WKH H[SORUDWLRQ RI XQGHUO\LQJSURSHUWLHVVLPLODULWLHVDQGGLIIHUHQFHVEHWZHHQ&'&DQG/&ZKLFKFUHDWHVWKHEDVLV IRUWKHSURSRVDORI/&EDVHGFOXVWHULQJDOJRULWKPVIRUFDWHJRULFDOGDWD 2XU VHFRQG FRQWULEXWLRQ LV WKH GLUHFW DGDSWDWLRQ DQG XVH RI /& PHWKRGRORJ\ IRU FOXVWHULQJ FDWHJRULFDOGDWD:HIRUPDOO\GHILQHWKH&'&SUREOHPDVDQ/&SUREOHPDQGDSSO\/&DSSURDFK IRUFOXVWHULQJFDWHJRULFDOGDWD2XUH[SHULPHQWDOUHVXOWVVKRZWKHQHZFDWHJRULFDOGDWDFOXVWHULQJ PHWKRGV WR DFKLHYH EHWWHU FOXVWHULQJ DFFXUDF\ WKDQ SUHYLRXV DOJRULWKPV ZKLFK FRQILUPV RXU LQWXLWLRQ WKDW /& DSSURDFKHV DQG &'& PHWKRGV FDQ EH XVHG LQWHUFKDQJHDEO\ )XUWKHUPRUH WKH LGHDRIOLQNLQJ/&DQG&'&ZLOOHQDEOHDSUREOHPDWKDQGWREHVROYHGWKURXJKHLWKHUZD\7KXV LPSURYHPHQWVFDQEHDFKLHYHGLQERWKGRPDLQV 7KHUHPDLQGHURIWKLVSDSHULVRUJDQL]HGDVIROORZV6HFWLRQSUHVHQWVDFULWLFDOUHYLHZRQ UHODWHGZRUN6HFWLRQFUHDWHVDQLQWHUHVWLQJYLHZRQWKHXQGHUO\LQJSURSHUWLHVVLPLODULWLHVDQG GLIIHUHQFHVEHWZHHQ&'&DQG/&,Q6HFWLRQZHGHILQHWKH&'&SUREOHPDVDQRSWLPL]DWLRQ SUREOHP DQG GHVFULEH WKH /& EDVHG DOJRULWKPV IRU FOXVWHULQJ FDWHJRULFDO GDWD ([SHULPHQWDO UHVXOWVDUHJLYHQLQ6HFWLRQDQG6HFWLRQFRQFOXGHVWKHSDSHU
5HODWHG:RUN
&OXVWHULQJ&DWHJRULFDO'DWD
$ IHZDOJRULWKPVKDYHEHHQSURSRVHGLQUHFHQW\HDUVIRUFOXVWHULQJFDWHJRULFDOGDWD>@,Q >@WKHSUREOHPRIFOXVWHULQJFXVWRPHUWUDQVDFWLRQVLQDPDUNHWGDWDEDVHLVDGGUHVVHG67,55DQ LWHUDWLYHDOJRULWKPEDVHGRQQRQOLQHDUG\QDPLFDOV\VWHPVLVSUHVHQWHGLQ>@7KHDSSURDFKXVHG LQ>@FDQEHPDSSHGWRDFHUWDLQW\SHRIQRQOLQHDUV\VWHPV,IWKHG\QDPLFDOV\VWHPFRQYHUJHV WKH FDWHJRULFDO GDWDEDVHV FDQ EH FOXVWHUHG $QRWKHU UHFHQW UHVHDUFK >@ VKRZV WKDW WKH NQRZQ G\QDPLFDO V\VWHPV FDQQRW JXDUDQWHH FRQYHUJHQFH DQG SURSRVHV D UHYLVHG G\QDPLFDO V\VWHP LQ ZKLFKFRQYHUJHQFHFDQEHJXDUDQWHHG .PRGHVDQDOJRULWKPH[WHQGLQJWKHNPHDQVSDUDGLJPWRFDWHJRULFDOGRPDLQLVLQWURGXFHG LQ> @1HZGLVVLPLODULW\ PHDVXUHVWRGHDOZLWKFDWHJRULFDOGDWDLVFRQGXFWHGWRUHSODFHPHDQV ZLWK PRGHVDQGDIUHTXHQF\EDVHGPHWKRGLVXVHGWRXSGDWHPRGHVLQWKHFOXVWHULQJSURFHVVWR PLQLPL]H WKH FOXVWHULQJ FRVW IXQFWLRQ %DVHG RQ NPRGHV DOJRULWKP >@ SURSRVHV DQ DGDSWHG PL[WXUH PRGHO IRU FDWHJRULFDO GDWD ZKLFK JLYHV D SUREDELOLVWLF LQWHUSUHWDWLRQ RI WKH FULWHULRQ RSWLPL]HG E\ WKH NPRGHV DOJRULWKP $ IX]]\ NPRGHV DOJRULWKP LV SUHVHQWHG LQ >@ DQG WDEX VHDUFKWHFKQLTXHLVDSSOLHGLQ>@WRLPSURYHIX]]\NPRGHVDOJRULWKP$QLWHUDWLYHLQLWLDOSRLQWV UHILQHPHQWDOJRULWKPIRUFDWHJRULFDOGDWDLVSUHVHQWHGLQ>@7KHZRUNLQ>@FDQEHFRQVLGHUHG DVWKHH[WHQVLRQVRINPRGHVDOJRULWKPWRWUDQVDFWLRQGRPDLQ ,Q >@ WKH DXWKRUV LQWURGXFH D QRYHO IRUPDOL]DWLRQ RI D FOXVWHU IRU FDWHJRULFDO GDWD E\ JHQHUDOL]LQJ D GHILQLWLRQ RI FOXVWHU IRU QXPHULFDO GDWD $ IDVW VXPPDUL]DWLRQ EDVHG DOJRULWKP &$&786 LV SUHVHQWHG &$&786 FRQVLVWV RI WKUHH SKDVHV VXPPDUL]DWLRQ FOXVWHULQJ DQG YDOLGDWLRQ
52&.DQDGDSWDWLRQRIDQDJJORPHUDWLYHKLHUDUFKLFDOFOXVWHULQJDOJRULWKPLVLQWURGXFHGLQ >@ 7KLV DOJRULWKP VWDUWV E\ DVVLJQLQJ HDFK WXSOH WR D VHSDUDWHG FOXVWHU DQG WKHQ FOXVWHUV DUH PHUJHGUHSHDWHGO\DFFRUGLQJWRWKHFORVHQHVVEHWZHHQFOXVWHUV7KHFORVHQHVVEHWZHHQFOXVWHUVLV GHILQHG DV WKH VXP RI WKH QXPEHU RI ³OLQNV´ EHWZHHQ DOO SDLUV RI WXSOHV ZKHUH WKH QXPEHU RI ³OLQNV´LVFRPSXWHGDVWKHQXPEHURIFRPPRQQHLJKERUVEHWZHHQWZRWXSOHV ,Q >@ WKH DXWKRUV SURSRVH WKH QRWLRQ RI ODUJH LWHP $Q LWHP LV ODUJH LQ D FOXVWHU RI WUDQVDFWLRQV LI LW LV FRQWDLQHG LQ D XVHU VSHFLILHG IUDFWLRQ RI WUDQVDFWLRQV LQ WKDW FOXVWHU $Q DOORFDWLRQ DQG UHILQHPHQW VWUDWHJ\ ZKLFK KDV EHHQ DGRSWHG LQ SDUWLWLRQLQJ DOJRULWKPV VXFK DV NPHDQVLVXVHGWRFOXVWHUWUDQVDFWLRQVE\PLQLPL]LQJWKHFULWHULDIXQFWLRQGHILQHGZLWKWKHQRWLRQ RIODUJHLWHP)ROORZLQJWKHODUJHLWHPPHWKRGLQ>@DQHZPHDVXUHPHQWFDOOHGWKHVPDOOODUJH UDWLRLVSURSRVHGDQGXWLOL]HGWRSHUIRUPWKHFOXVWHULQJ>@,Q>@WKHDXWKRUVFRQVLGHUWKHLWHP WD[RQRP\ LQ SHUIRUPLQJ FOXVWHU DQDO\VLV :KLOH WKH ZRUN > @ SURSRVHV DQ DOJRULWKP EDVHG RQ ³FDXFXV´ ZKLFK LV ILQHSDUWLWLRQHG GHPRJUDSKLF JURXSV WKDW LV EDVHG WKH SXUFKDVH IHDWXUHV RI FXVWRPHUV 6TXHH]HU D RQHSDVV DOJRULWKP LV SURSRVHG LQ >@ 6TXHH]HU UHSHDWHGO\ UHDG WXSOHV IURP GDWDVHWRQHE\RQH:KHQWKHILUVWWXSOHDUULYHVLWIRUPVDFOXVWHUDORQH7KHFRQVHTXHQWWXSOHVDUH HLWKHUSXWLQWRDQH[LVWLQJFOXVWHURUUHMHFWHGE\DOOH[LVWLQJFOXVWHUVWRIRUPDQHZFOXVWHUE\JLYHQ VLPLODULW\IXQFWLRQ &22/&$7 DQ HQWURS\EDVHG DOJRULWKP IRU FDWHJRULFDO FOXVWHULQJ LV SURSRVHG LQ >@ 6WDUWLQJIURPDKHXULVWLFPHWKRGRILQFUHDVLQJWKHKHLJKWWRZLGWKUDWLRRIWKHFOXVWHUKLVWRJUDP WKH DXWKRUV LQ >@ GHYHORS WKH &/23( DOJRULWKP >@ LQWURGXFH D GLVWDQFH PHDVXUH EHWZHHQ SDUWLWLRQVEDVHGRQWKHQRWLRQRIJHQHUDOL]HGFRQGLWLRQDOHQWURS\DQGDJHQHWLFDOJRULWKPDSSURDFK LVXWLOL]HGIRUGLVFRYHULQJWKHPHGLDQSDUWLWLRQ
/LQN&OXVWHULQJ
.XELFD HW DO SUHVHQWHG WKH JURXS GHWHFWLRQ DOJRULWKP *'$ ± DQ DOJRULWKP IRU ILQGLQJ XQGHUO\LQJ JURXSLQJV RI HQWLWLHV IURP FRRFFXUUHQFH GDWD >@ 7KLV DOJRULWKP LV EDVHG RQ D SUREDELOLVWLF JHQHUDWLYH PRGHO DQG SURGXFHV FRKHUHQW JURXSV WKDW DUH FRQVLVWHQW ZLWK SULRU NQRZOHGJH ,Q>@.XELFDHWDOSUHVHQWNJURXSVDQDOJRULWKPWKDWXVHVDQDSSURDFKVLPLODUWRWKDWRI NPHDQV KDUG FOXVWHULQJ DQG ORFDOL]HG XSGDWHV WR VLJQLILFDQWO\ DFFHOHUDWH WKH GLVFRYHU\ RI WKH XQGHUO\LQJJURXSVZKLOHUHWDLQLQJ*'$¶VSUREDELOLVWLFPRGHO
$8QLILHG9LHZRQ&'&DQG/&
7KHUHVHDUFKHVRQ&'&DQG/&KDYHEHHQFRQGXFWHGLQSDUDOOHO2XUJRDOLQWKLVVHFWLRQLVWR DUJXHWKDWDXQLILHGYLHZFDQEHEXLOWIRUWKH&'&SUREOHPDQG&(SUREOHPKHQFH&'&SUREOHP FDQEHVROYHGZLWKH[LVWLQJ/&DOJRULWKPV &OXVWHULQJ DLPV DW GLVFRYHULQJ JURXSV DQG LGHQWLI\LQJ LQWHUHVWLQJ SDWWHUQV LQ D GDWDVHW :H FDOO D SDUWLFXODU FOXVWHULQJ DOJRULWKP ZLWK D VSHFLILF YLHZ RI WKH GDWD D FOXVWHUHU (DFK FOXVWHUHU RXWSXWV D FOXVWHULQJ RU ODEHOLQJ FRPSULVLQJ WKH JURXS ODEHOV IRU VRPH RU DOO REMHFWV /LQN &OXVWHULQJ /& DWWHPSWV WR ILQG XQGHUO\LQJ JURXSV RI HQWLWLHV JLYHQ OLQN DQG GHPRJUDSKLF GDWD
>@ &RQVLGHUWKHGDWDVHW; ^[ [« [Q` EHDVHWRIREMHFWVGHVFULEHGE\U FDWHJRULFDODWWULEXWHV $ «$U ZLWKGRPDLQV'«'U UHVSHFWLYHO\7ZRURZVW DQGX DUHHTXLYDOHQWZLWKUHVSHFWWRD JLYHQ DWWULEXWH $L LI W >$L@ X >$L@ ,QIRUPDOO\ ZH FDQ VD\ WKDW W DQG X DUH ³OLQNHG´ E\ WKHLU FRPPRQDWWULEXWHYDOXHVRQ$L )XUWKHUPRUHDQ\DWWULEXWH$L SDUWLWLRQVWKHURZVRIWKHUHODWLRQLQWRHTXLYDOHQFHFODVVHV:H GHQRWH WKH HTXLYDOHQFH FODVV RI D URZ W ; ZLWK UHVSHFW WR D JLYHQ DWWULEXWH $L E\ >W@ $ LH L
X> $L @` WKH VHW S $
^X ; _ W> $L @
>W @ $
L
L
^>W @ $ _ W ; ` RI HTXLYDOHQFH FODVVHV LV D L
SDUWLWLRQRI;XQGHU$L 7KDWLV S $ LVDFROOHFWLRQRIGLVMRLQWVHWV HTXLYDOHQFHFODVVHV RIURZV L
VXFKWKDWHDFKVHWKDVDXQLTXHYDOXHIRUWKHDWWULEXWH$L DQGWKHXQLRQRIWKHVHWVHTXDOVWKH;
)URP WKH YLHZSRLQW RI /& HDFK VHW LQ S $ LV D OLQN 7KHUHIRUH ZH FDQ HPSOR\ H[LVWLQJ /& L
DOJRULWKPVIRUVROYLQJWKH&'&SUREOHP 0RUHIRUPDOO\IRUWKH/&SUREOHPWKHLQSXWGDWDLVDVVXPHGWRFRQWDLQ13 XQLTXHHQWLWLHV
:HGHQRWHWKHVHWRIDOOHQWLWLHVDV [ DQGDVLQJOHHQWLW\DV H [ 7KHLQSXWGDWDFRQVLVWVRI1/ L
OLQNVHDFKRIZKLFKLVDVXEVHWRIHQWLWLHV$VLQJOHOLQNLVGHQRWHG / [ DQGFRQWDLQV _ / _ L
L
HQWLWLHV7KHHQWLUHVHWRIOLQNVLVGHQRWHGDV/' )LQDOO\ZHDUHDWWHPSWLQJWRILQG. JURXSV:H
GHQRWH D JURXS DV J [ DQG WKH VHW RI DOO FXUUHQW JURXSV DV * +HQFH ZH FDQ WUDQVIRUP WKH L
&'&SUREOHPLQWRD/&SUREOHPDVIROORZV /HW [
^ Q`
13 _;_ Q
/'
^O S $ _ L U` L
1 / _ /' _
:LWKWKHVHWUDQVIRUPDWLRQVLIZHFDQILQG. JURXSVRQ [ ZHVROYHWKHFRUUHVSRQGLQJ&'&
SUREOHP6LPLODUO\DUHYHUVHSURFHVVIRUWUDQVIRUPLQJWKH/&SUREOHPLQWR&'&SUREOHPFRXOG EH HVWDEOLVKHG7KDWLV&'&SUREOHPDQG/&SUREOHPDUHHTXLYDOHQWDQGDOJRULWKPVGHYHORSHG LQERWKGRPDLQVFDQEHXVHGLQWHUFKDQJHDEO\ ([DPSOH 7DEOH VKRZV D FDWHJRULFDO WDEOH ZLWK UHFRUGV HDFK GHVFULEHG E\ FDWHJRULFDO DWWULEXWHV 2QO\ FRQVLGHULQJ ³$WWULEXWH ´ ZH FDQ JHW WKH SDUWLWLRQ ^ ` 6LPLODUO\ ³$WWULEXWH ´ JLYHV D SDUWLWLRQ DV ^ ` 7KXV FOXVWHULQJ WKLV FDWHJRULFDOGDWDFDQEHWUDQVIRUPHGDVD/&SUREOHPDV
[
^` 13 _;_
/'
^^` ^ ` ^ ` ^` ^`` 1 /
7DEOH6DPSOH&DWHJRULFDO'DWD6HW
5HFRUG1XPEHU
$WWULEXWH
$WWULEXWH
0
%
0 )
$
)
&
0
0
)
%
)
$
)
0
&
& &
$ %
/LQN&OXVWHULQJ%DVHG$SSURDFK
$VVKRZQLQ6HFWLRQWKH&'&SUREOHPFDQEHUHJDUGHGDVDQHTXLYDOHQW/&SUREOHP,Q WKLV VHFWLRQ ZH ERUURZ WKH LGHD RI OLQN FOXVWHULQJ > @ WR VROYH &'& SUREOHP DQG GHVFULEH WKRVH/&EDVHGDOJRULWKPVIRUFOXVWHULQJFDWHJRULFDOGDWD .XELFDHWDO>@SUHVHQWHG*'$DQGNJURXSVDOJRULWKPVERWKRIZKLFKLVEDVHGRQD SUREDELOLVWLF JHQHUDWLYH PRGHO VKRZQ LQ )LJXUH 7KH PRGHO LV D %D\HVLDQ QHWZRUN ZKHUH WKH RYDOVLQGLFDWHSDUDPHWHUVWREHOHDUQHGIURPGDWD7KHILYHSULPDU\FRPSRQHQWVRIWKLVPRGHODUH 7KHGHPRJUDSKLFVGDWDVHW '' ZKLFKFRQWDLQVDOOWKHHQWLWLHVXQGHUFRQVLGHUDWLRQDQG WKHLUGHPRJUDSKLFLQIRUPDWLRQ 7KHOLQNGDWDVHW /' ZKLFKLVMXVWDVHWRIUHFRUGVVSHFLI\LQJREVHUYHGOLQNV 7KHFKDUW &+ ZKLFKLQGLFDWHVZKLFKHQWLWLHVEHORQJWRZKLFKJURXSV7KLVGDWDVWUXFWXUH FDQEHSLFWXUHGDVDVSDUVH 1 3 u . PDWUL[ZKHUHWKHFROXPQVLQGLFDWHWKHJURXSVDQGWKHURZV
LQGLFDWH WKH HQWLWLHV 8QOLNH WUDGLWLRQDO FOXVWHULQJ PRGHOV DQ HQWLW\ FDQ VLPXOWDQHRXVO\ EH D IXOO PHPEHURIVHYHUDOJURXSV KDYHD³RQH´LQVHYHUDOFROXPQV 7KHGHPRJUDSKLFPRGHO '0 ZKLFKGHILQHVDUHFLSHIRUSODFLQJDHQWLW\LQDJURXSEDVHG RQ GHPRJUDSKLFLQIRUPDWLRQ DQG 7KHOLQNPRGHO /0 ZKLFKGHILQHVDUHFLSHIRUOLQNJHQHUDWLRQ7KHOLQNPRGHOFRQWDLQV WZR SDUDPHWHUV IRU HDFK OLQN W\SH WKH SUREDELOLW\ D OLQN RI WKDW W\SH LV FRPSOHWHO\ UDQGRP LQQRFHQW 3, DQGWKHSUREDELOLW\WKDWDQHQWLW\LQDOLQNRIWKDWW\SHLVQRLVH UDQGRP 35 7KHVH SUREDELOLWLHVFDQEHOHDUQHGRUVSHFLILHGE\WKHXVHU 7KH DERYH FRPSRQHQWV SURYLGH D UHFLSH IRU JHQHUDWLQJ WKH GDWD IURP WKH PRGHO 8VLQJ WKH GHFRPSRVLWLRQ SURYLGHG E\ WKH %D\HVLDQ QHWZRUN LQ )LJXUH WKH DFWXDO PD[LPXP OLNHOLKRRG HVWLPDWLRQLVDFFRPSOLVKHGE\XVLQJQRLV\KLOOFOLPELQJDKHXULVWLFRSWLPL]DWLRQPHWKRG7KHJRDO LVWRILQGWKHFKDUWGHPRJUDSKLFVPRGHODQGSRVVLEO\OLQNPRGHOWKDWPD[LPL]HWKHOLNHOLKRRGDV
JLYHQE\WKHHQWLUH%D\HVLDQQHWZRUNLQ)LJXUH7KLVLVGRQHE\WU\LQJGLIIHUHQWPRYHV DGGLQJ DQ HQWLW\ WR D JURXS RU UHPRYLQJ DQ HQWLW\ IURP D JURXS DQG HYDOXDWLQJ WKH FKDQJH LQ WKH ORJOLNHOLKRRG )RUPRUHGHWDLOVWKHUHDGHUVKRXOGUHIHUWR>@ 'HPRJUDSKLFV 0RGHO
'HPRJUDSKLFV 0RGHO
/LQN 0RGHO
&KDUW
/LQN 'DWD )LJ 3UREDELOLVWLFPRGHORIJURXSPHPEHUVKLSDQGOLQNJHQHUDWLRQ>@
([SHULPHQWDO5HVXOWV
$ FRPSUHKHQVLYH SHUIRUPDQFH VWXG\ KDV EHHQ FRQGXFWHG WR HYDOXDWH RXU PHWKRG ,Q WKLV VHFWLRQZHGHVFULEHWKRVHH[SHULPHQWVDQGWKHUHVXOWV:HUDQRXUDOJRULWKPRQUHDOOLIHGDWDVHWV REWDLQHG IURP WKH 8&, 0DFKLQH /HDUQLQJ 5HSRVLWRU\ >@ WR WHVW LWV FOXVWHULQJ SHUIRUPDQFH DJDLQVWRWKHUDOJRULWKPV
5HDO/LIH'DWDVHWVDQG(YDOXDWLRQ0HWKRG
:HH[SHULPHQWHGZLWKIRXUUHDOOLIHGDWDVHWV WKH0XVKURRPGDWDVHWDQGWKH&DQFHUGDWDVHW ZKLFKZHUHREWDLQHGIURPWKH8&,0DFKLQH/HDUQLQJ5HSRVLWRU\>@1RZZHZLOOJLYHDEULHI LQWURGXFWLRQDERXWWKHVHGDWDVHWV
9 7KH 0XVKURRP 'DWDVHW ,W KDV DWWULEXWHV DQG UHFRUGV (DFK UHFRUG UHSUHVHQWV SK\VLFDOFKDUDFWHULVWLFVRIDVLQJOHPXVKURRP$FODVVLILFDWLRQODEHORISRLVRQRXVRUHGLEOHLV SURYLGHGZLWKHDFKUHFRUG7KHQXPEHUVRIHGLEOHDQGSRLVRQRXVPXVKURRPVLQWKHGDWDVHW DUHDQG UHVSHFWLYHO\
9 :LVFRQVLQ %UHDVW &DQFHU 'DWD ,W KDV LQVWDQFHV ZLWK DWWULEXWHV (DFK UHFRUG LV :HXVHDGDWDVHWWKDWLVVOLJKWO\GLIIHUHQWIURPLWVRULJLQDOIRUPDWLQ8&,0DFKLQH/HDUQLQJ5HSRVLWRU\ZKLFKKDV LQVWDQFHVZLWKEHQLJQUHFRUGVDQG PDOLJQDQWUHFRUGV,WLVSXEOLFDYDLODEOHDW
ODEHOHGDVEHQLJQ RU RUPDOLJQDQW RU ,QRXUOLWHUDWXUHDOODWWULEXWHV DUHFRQVLGHUHGFDWHJRULFDOZLWKYDOXHV« 9DOLGDWLQJFOXVWHULQJUHVXOWVLVDQRQWULYLDOWDVN,QWKHSUHVHQFHRIWUXHODEHOVDVLQWKHFDVH RI WKH GDWD VHWV ZH XVHG ZH FDQ IRUP D FRQIXVLRQ PDWUL[ WR PHDVXUH WKH HIIHFWLYHQHVV RI WKH DOJRULWKP (DFK HQWU\ L M LQ WKH FRQIXVLRQ PDWUL[ UHSUHVHQWV WKH QXPEHU RI REMHFWV LQ FOXVWHU L WKDWEHORQJWRWUXHFODVVM )RUDQREMHFWLYHHYDOXDWLRQPHDVXUHZHXVHWKHFOXVWHULQJDFFXUDF\IRU PHDVXULQJWKHFOXVWHULQJUHVXOWVZDVFRPSXWHGDVIROORZV*LYHQWKHILQDOQXPEHURIFOXVWHUVN FOXVWHULQJDFFXUDF\U ZDVGHILQHGDV U
¦
N
Q
L
D
L
ZKHUHQ LVWKHQXPEHURIUHFRUGVLQWKHGDWDVHW
D LVWKHQXPEHURILQVWDQFHVRFFXUULQJLQERWKFOXVWHUL DQGLWVFRUUHVSRQGLQJFODVVZKLFKKDGWKH PD[LPDO YDOXH ,Q RWKHU ZRUGV D LV WKH QXPEHU RI UHFRUGV ZLWK WKH FODVV ODEHO WKDW GRPLQDWHV FOXVWHUL &RQVHTXHQWO\WKHFOXVWHULQJHUURULVGHILQHGDVH U L
L
([SHULPHQW'HVLJQ
:H VWXGLHG WKH FOXVWHULQJ IRXQG E\ WKUHH DOJRULWKPV RXU DOJRULWKP GHQRWHG DV /&%&'& /LQN&OXVWHULQJ%DVHG&DWHJRULFDO'DWD&OXVWHULQJ WKH6TXHH]HUDOJRULWKPLQWURGXFHGLQ>@ DQG WKH NPRGHV DOJRULWKP SURSRVHG LQ > @ ,W KDV EHHQ GHPRQVWUDWHG WKDW WKH 6TXHH]HU DQG NPRGHV DOJRULWKP FDQ SURGXFH EHWWHU FOXVWHULQJ RXWSXW WKDQ RWKHU DOJRULWKPV LQ FDWHJRULFDO GDWDVHW ZLWK UHVSHFW WR FOXVWHULQJ DFFXUDF\ 7KXV WKH WZR DOJRULWKPV DUH VHOHFWHG IRU WKH FRPSHWLWLRQ ,QDOOWKHH[SHULPHQWVH[FHSWIRUWKHQXPEHURIFOXVWHUVDOOWKHSDUDPHWHUVUHTXLUHGE\WKH /&%&'& DOJRULWKP DUH VHW WR EH GHIDXOW 7KH 6TXHH]HU DOJRULWKP UHTXLUHV RQO\ D VLPLODULW\ WKUHVKROGDVLQSXWSDUDPHWHUVRZHVHWWKLVSDUDPHWHUWRDSURSHUYDOXHWRJHWWKHGHVLUHGQXPEHU RI FOXVWHUV )RU WKH 6TXHH]HU DOJRULWKP LI WKH RXWSXW QXPEHU RI FOXVWHUV LV VDPH WKH FOXVWHULQJ DFFXUDF\LVDOPRVWLGHQWLFDO+HQFHZHFDQXVHDQ\VLPLODULW\WKUHVKROGYDOXHWKDWFDQPDNHWKH DOJRULWKP JHW WKH GHVLUHG QXPEHU RI FOXVWHUV )RU WKH NPRGHV DOJRULWKP ZH XVH WKH ILUVW N GLVWLQFWUHFRUGVIURPWKHGDWDVHWWRFRQVWUXFWLQLWLDON PRGHV 0RUHRYHUVLQFHWKHFOXVWHULQJUHVXOWVRINPRGHVDOJRULWKPDQG6TXHH]HUDOJRULWKPDUHIL[HG IRUDSDUWLFXODUGDWDVHWZKHQWKHSDUDPHWHUVDUHIL[HGRQO\RQHUXQLVXVHGLQWKHWZRDOJRULWKPV 7KH /&%&'& DOJRULWKP LV D SUREDELOLVWLF DOJRULWKP VR LWV RXWSXWV ZLOO GLIIHU LQ GLIIHUHQW UXQV +RZHYHUZHREVHUYHGLQWKHH[SHULPHQWVWKDWWKHFOXVWHULQJUHVXOWLVYHU\VWDEOHVRWKHFOXVWHULQJ HUURU RI WKLV DOJRULWKP LV UHSRUWHG ZLWK LWV ILUVW UXQ ,Q VXPPDU\ ZH XVH RQH UXQ WR JHW WKH FOXVWHULQJRXWSXWIRUDOOWKHWKUHHDOJRULWKPV
&OXVWHULQJ5HVXOWVRQ0XVKURRP'DWD
)RUWKLVGDWDVHWZHOHWDOOWKHDOJRULWKPVSURGXFHWZRFOXVWHUV7DEOHVKRZVWKHFOXVWHUVDQG KWWS UHVHDUFKFPLVFVLURDXURKDQERXWOLHUVEUHDVWFDQFHUEUFDQFHUDOOGDW 6LQFH RXU LPSOHPHQWDWLRQ IRU WKH /&%&'& DOJRULWKP LV EDVHG RQ WKH DOJRULWKPV GHYHORSHG E\ .XELFD HW DO >@ 6R WKH UHDGHUV PD\ UHIHU WR .XELFD¶V OLQN FOXVWHULQJ DOJRULWKPV IRU GHWDLOV 7KH H[HFXWDEOH SURJUDP RI .XELFD¶VOLQNFOXVWHULQJDOJRULWKPVLVDYDLODEOHDWKWWS ZZZDXWRQODERUJDXWRQZHEVKRZ6RIWZDUH
FODVV GLVWULEXWLRQ SURGXFHG E\ WKH WKUHH DOJRULWKPV $V 7DEOH VKRZV NPRGHV DOJRULWKP DQG 6TXHH]HU DOJRULWKP KDYH VLPLODU SHUIRUPDQFH ZKLOH RXU DOJRULWKP SHUIRUPV PXFK EHWWHU WKDQ NPRGHVDOJRULWKPDQG6TXHH]HUDOJRULWKP 7DEOH &OXVWHULQJUHVXOWVRQPXVKURRPGDWD
&OXVWHU12 &OXVWHU12 &OXVWHU12
6TXHH]HU &OXVWHULQJ(UURU 1RRI(GLEOH
1RRI3RLVRQRXV
NPRGHV &OXVWHULQJ(UURU
1RRI(GLEOH
1RRI3RLVRQRXV
/&%&'& &OXVWHULQJ(UURU
1RRI(GLEOH
1RRI3RLVRQRXV
&OXVWHULQJ5HVXOWVRQ&DQFHU'DWD 7DEOHFRQWUDVWVWKHFOXVWHULQJUHVXOWVRQFDQFHUGDWDVHW7KHFOXVWHUVSURGXFHGE\/&%&'& DOJRULWKP FRYHUV RQO\ UHFRUGV RXW RI UHFRUGV EHFDXVH WKH UHVW DUH WUHDWHG DV RXWOLHUV RU QRLVHV5HFDOOLQJWKHFODVVGLVWULEXWLRQRQWKHFDQFHUGDWDVHWLWKDVLQVWDQFHVZLWKEHQLJQ UHFRUGVDQG PDOLJQDQWUHFRUGV$VVKRZQLQ7DEOH/&%&'&UHDVRQDEO\GLVFDUGVPRVWRI WKRVHPDOLJQDQWUHFRUGVDVRXWOLHUVDQGUHYHDOVDQDOPRVWSXUHFOXVWHUWKDWLVPDGHXSZLWKEHQLJQ UHFRUGV)URPWKLVSHUVSHFWLYH/&%&'&LVPRUHFDSDEOHWRGLVFRYHUPHDQLQJIXOFOXVWHUV 0RUHRYHU/&%&'&DOJRULWKPSHUIRUPVPXFKEHWWHUWKDQNPRGHVDOJRULWKPDQG6TXHH]HU DOJRULWKPRQWKLVGDWDVHWZKLFKDOPRVWUHDFKWKHFOXVWHULQJDFFXUDF\ 7DEOH &OXVWHULQJUHVXOWVRQFDQFHUGDWD
&OXVWHU12 &OXVWHU12 &OXVWHU12
6TXHH]HU &OXVWHULQJ(UURU 1RRI%HQLJQ
1RRIPDOLJQDQW
1RRI%HQLJQ
1RRIPDOLJQDQW
1RRI%HQLJQ
1RRIPDOLJQDQW
NPRGHV &OXVWHULQJ(UURU
/&%&'& &OXVWHULQJ(UURU
6XPPDU\
2QH PD\ DUJXH WKDW WKH UHVXOWV FDQQRW SUHFLVHO\ UHIOHFW WKDW RXU PHWKRG KDV EHWWHU SHUIRUPDQFHVLQFHQRWDOOUHFRUGVDUHDVVLJQHGWRDFOXVWHULQRXUPHWKRG+RZHYHULWVKRXOGEH QRWHGWKDWLQRXUPHWKRGRQHREMHFWDOVRFRXOGEHDVVLJQHGWRPXOWLSOHFOXVWHUV+HQFHIURPWKRVH UHVXOWVZHDUHFRQILGHQWWRFODLPWKDWRXUPHWKRGFRXOGSURYLGHDWOHDVWWKHVDPHOHYHORIDFFXUDF\ DVRWKHUSRSXODUPHWKRGV
&RQFOXVLRQV
2XU PDLQ FRQWULEXWLRQ LQ WKLV SDSHU LV WR H[SOLFLWO\ VWDWH WKH HTXLYDOHQFH EHWZHHQ WKH &'& SUREOHP DQG /& SUREOHP IRU WKH ILUVW WLPH DQG SRLQW RXW WKDW DOJRULWKPV GHYHORSHG LQ ERWK GRPDLQVFDQEHXVHGLQWHUFKDQJHDEO\0RUHRYHUWRYHULI\RXUVWDWHPHQWZHIRUPDOO\VKRZKRZ WR WUDQVIRUP WKH &'& SUREOHP LQWR D /& SUREOHP DQG DSSO\ /& DSSURDFK IRU FOXVWHULQJ FDWHJRULFDOGDWD(PSLULFDOHYLGHQFHVVKRZWKDWRXULGHDLVSURPLVLQJLQSUDFWLFH ,Q WKH IXWXUH ZH DUH SODQQLQJ WR H[SORUH H[LVWLQJ FDWHJRULFDO GDWD FOXVWHULQJ DOJRULWKPV RU WUDQVDFWLRQVFOXVWHULQJDOJRULWKPVWRFOXVWHUODUJHOLQNGDWDVHW
5HIHUHQFHV >@ $ 6HKJDO 8 % 'HVDL ' REMHFW UHFRJQLWLRQ XVLQJ %D\HVLDQ JHRPHWULF KDVKLQJ DQG SRVH FOXVWHULQJ3DWWHUQ5HFRJQLWLRQ
>@ '6%RRQH05RHKP5HWDLOVHJPHQWDWLRQXVLQJDUWLILFLDOQHXUDOQHWZRUNV,QWHUQDO-RXUQDORI 5HVHDUFKLQ0DUNHWLQJ ±
>@ 9 &DVWHOOL $ 7KRPDVLDQ &6 /L &69' &OXVWHULQJ DQG 6LQJXODU 9DOXH 'HFRPSRVLWLRQ IRU
$SSUR[LPDWH 6LPLODULW\ 6HDUFK LQ +LJK'LPHQVLRQDO 6SDFHV ,((( 7UDQVDFWLRQV RQ .QRZOHGJH DQG'DWD(QJLQHHULQJ
>@ $ 3RSHVFXO * : )ODNH 6 /DZUHQFH / + 8QJDU & / *LOHV &OXVWHULQJ DQG ,GHQWLI\LQJ
7HPSRUDO 7UHQGV LQ 'RFXPHQW 'DWDEDVHV ,Q 3URF RI ,((( $GYDQFHV LQ 'LJLWDO /LEUDULHV $'/ 0D\:DVKLQJWRQ'&SS
>@ (++DQ*.DU\SLV9.XPDU%0REDVKHU &OXVWHULQJEDVHGRQDVVRFLDWLRQUXOHK\SHUJUDSKV
,Q 6,*02':RUNVKRSRQ5HVHDUFK,VVXHVRQ'DWD0LQLQJDQG.QRZOHGJH'LVFRYHU\SS
>@ '*LEVRQ-.OHLEHUJ35DJKDYDQ&OXVWHULQJFDWHJRULFDOGDWD DQDSSURDFKEDVHGRQG\QDPLF V\VWHPV,Q 3URFRI9/'%¶ SS
>@ @ =+XDQJ$IDVWFOXVWHULQJDOJRULWKPWRFOXVWHUYHU\ODUJHFDWHJRULFDOGDWDVHWVLQGDWDPLQLQJ,Q
6,*02' :RUNVKRS RQ 5HVHDUFK ,VVXHV RQ 'DWD 0LQLQJ DQG .QRZOHGJH 'LVFRYHU\ SS
> @ = +XDQJ ([WHQVLRQV WR WKH NPHDQV DOJRULWKP IRU FOXVWHULQJ ODUJH GDWD VHWV ZLWK FDWHJRULFDO YDOXHV'DWD0LQLQJDQG.QRZOHGJH'LVFRYHU\
>@)-ROORLV01DGLI&OXVWHULQJODUJHFDWHJRULFDOGDWD,Q 3URFRI3$.''¶SS
>@=+XDQJ0.1J$IX]]\NPRGHVDOJRULWKPIRUFOXVWHULQJFDWHJRULFDOGDWD,(((7UDQVDFWLRQ RQ)X]]\6\VWHPV
>@ 0 . 1J - & :RQJ &OXVWHULQJ FDWHJRULFDO GDWD VHWV XVLQJ WDEX VHDUFK WHFKQLTXHV 3DWWHUQ 5HFRJQLWLRQ
>@ @9*DQWL-*HKUNH55DPDNULVKQDQ&$&786FOXVWHULQJFDWHJRULFDOGDWDXVLQJVXPPDULHV,Q 3URFRI.''¶ SS
>@6*XKD55DVWRJL.6KLP52&. DUREXVWFOXVWHULQJDOJRULWKPIRUFDWHJRULFDODWWULEXWHV,Q 3URFRI,&'(¶ SS
>@ . :DQJ & ;X % /LX &OXVWHULQJ WUDQVDFWLRQV XVLQJ ODUJH LWHPV ,Q 3URF RI &,.0¶ SS
>@&+@&+@=+H;;X6'HQJ 6TXHH]HU DQHIILFLHQWDOJRULWKPIRUFOXVWHULQJFDWHJRULFDOGDWD-RXUQDORI &RPSXWHU6FLHQFH 7HFKQRORJ\
>@'%DUEDUD@@-.XELFD$0RRUH-6FKQHLGHU7UDFWDEOHJURXSGHWHFWLRQRQODUJHOLQNGDWDVHWV,Q 3URFRI ,&'0¶SS
>@ - .XELFD $ 0RRUH - 6FKQHLGHU
