Web Service Based Feature Selection and

2012 IEEE Sixth International Conference on Semantic Computing

:HE6HUYLFHEDVHG)HDWXUH6HOHFWLRQDQG 'LVFUHWL]DWLRQZLWK(IILFLHQF\ 

-6HQWKLONXPDU6.DUWKLNH\DQ'0DQMXOD5.ULVKQDPRRUWK\

'HSDUWPHQWRI&RPSXWHU VFLHQFH DQG(QJLQHHULQJ $QQD8QLYHUVLW\ &KHQQDL ,QGLD 'HSDUWPHQWRI&RPSXWHU6FLHQFHDQG(QJLQHHULQJ $QQD8QLYHUVLW\RI7HFKQRORJ\7LUXFKLUDSDOOL,QGLD  DGKLW\DUHVHDUFK#\DKRRFRPNDUWKLDFWHFK#JPDLOFRPPDQMX#DQQDXQLYHGXUNULVK#KRWPDLOFRP 

SURYLGH WKH IDFLOLW\ WR LQWHJUDWH GDWD DQG IHDWXUH VHOHFWLRQ DQG GLVFUHWL]DWLRQDSSOLFDWLRQV

$EVWUDFW⎯ :HE VHUYLFH LV DQ HPHUJLQJ WHFKQRORJ\ WKDW HQDEOHV WKH XVHUV WR DFFHVV KHWHURJHQHRXV GLVWULEXWHG UHVRXUFHV SURYLGLQJ HDVLHU LQWHJUDWLRQ DQG LQWHURSHUDELOLW\ EHWZHHQ GDWD DQG LWV DSSOLFDWLRQV %LJ GDWD DQDO\VLV LV WKH RQH RI WKH PDMRU SUREOHPV LQ ZHE EDVHG PDFKLQH OHDUQLQJ DQG GDWD PLQLQJ %LJ GDWD FRQWDLQ KLJK GHJUHH RI LUUHOHYDQW DQG UHGXQGDQW LQIRUPDWLRQ¶V ZKLFK DUH JUHDWO\ GHJUDGHV WKH SHUIRUPDQFH RI OHDUQLQJ DOJRULWKPV 7KHUHIRUH IHDWXUH VHOHFWLRQ EHFRPHV QHFHVVDU\IRUPDFKLQHOHDUQLQJWDVNVIRUIDFLQJKLJKGLPHQVLRQDO GDWD'LVFUHWL]DWLRQWXUQVFRQWLQXRXVDWWULEXWHVLQWRGLVFUHWHRQHV E\ GLYLGLQJ WKH YDOXHV LQWR VPDOO QXPEHU RI LQWHUYDOV ,Q WKLV SDSHU D QHZ ZHE VHUYLFH EDVHG IHDWXUH VHOHFWLRQ DQG GLVFUHWL]DWLRQ PHWKRG FDOOHG 1$12 LV SUHVHQWHG 7KH SURSRVHG ZHE VHUYLFH PHWKRG ZDV WHVWHG ZLWK UHSXWHG GDWDVHWV LW VKRZV KLJK FODVVLILFDWLRQ DFFXUDF\ DQG LPSURYHV WKH FRPSXWDWLRQ HIILFLHQF\ .H\ZRUGV)HDWXUH VHOHFWLRQ IHDWXUH FODVVLILFDWLRQ62$62$38'',:6'/

,

6HUYLFHRULHQWHG FRPSXWLQJ62& LVWKHVRIWZDUH HQJLQHHULQJ SDUDGLJP WKDW XWLOL]HV VHUYLFHV DV IXQGDPHQWDO HOHPHQWV IRU GHYHORSLQJ VRIWZDUH DSSOLFDWLRQV 62& UHOLHV RQ WKH 6HUYLFH 2ULHQWHG$UFKLWHFWXUH62$ DZD\RIUHRUJDQL]LQJDSRUWIROLR RI OHJDF\ DSSOLFDWLRQV LQWR VHUYLFHV 62& DUH SODWIRUP LQGHSHQGHQW DFFHVVLEOH WKURXJK VWDQGDUG LQWHUIDFHV DQG FDQ DVVHPEOHG LQ FRPSOH[ FRPSRVLWLRQV EDVHG RQ VWDQGDUG PHVVDJLQJSURWRFROV

GLVFUHWL]DWLRQ

,1752'8&7,21

:HEVHUYLFHVDUHHPHUJLQJDVDSURPLVLQJWHFKQRORJ\WREXLOG GLVWULEXWHGDSSOLFDWLRQV>@ :HE VHUYLFH LVDQLPSOHPHQWDWLRQ RI 6HUYLFH 2ULHQWHG $UFKLWHFWXUH 62$  LQ )LJXUH  WKDW VXSSRUWV WKH FRQFHSW RI ORRVHO\FRXSOHG RSHQ VWDQGDUG ODQJXDJH DQG SODWIRUPLQGHSHQGHQW V\VWHPV ZKLFK DOORZ EXLOGLQJ WKH FODVVLILFDWLRQ PRGHO LQ DQ HIILFLHQW ZD\ :HE VHUYLFHVDUHDFFHVVHGWKURXJKWKH+773+7736SURWRFROVDQG ;0/ LV XWLOL]HG H[WHQGLEOH 0DUNXS /DQJXDJH  IRU GDWD H[FKDQJH7KHLQWHUDFWLRQDPRQJWKHZHEVHUYLFHVFRPSRQHQWV H[SORLWV WKH 8QLYHUVDO 'HVFULSWLRQ 'LVFRYHU\ DQG ,QWHJUDWLRQ 8'',  UHJLVWU\ DV IROORZV WKH VHUYLFH SURYLGHU GHILQHV D UHIHUHQFH WR LWV ZHE VHUYLFH XVLQJ :HE 6HUYLFH 'HVFULSWLRQ /DQJXDJH:6'/ 7KH:6'/GRFXPHQWLVSXEOLVKHGLQWRWKH 8'', UHJLVWU\ VR WKDW D VHUYLFH FRQVXPHU FDQ VHDUFK WKH UHJLVWU\ DQG UHWULHYH WKH :6'/ UHIHUHQFH WR WKH ZHE VHUYLFH 7KH VHUYLFH FRQVXPHU XVLQJWKHLQIRUPDWLRQ VWRUHGLQVLGHWKH :6'/GRFXPHQWFRQWDFWVWKHZHEVHUYLFHDQGLVVXHVDVHUYLFH UHTXHVW

)LJXUH 6HUYLFH2ULHQWHG$UFKLWHFWXUH

)HDWXUH VHOHFWLRQ FDQ VLJQLILFDQWO\ LPSURYH WKH FRPSUHKHQVLELOLW\ RI WKH UHVXOWLQJ FODVVLILHU PRGHOV DQG RIWHQ EXLOG D PRGHO WKDW JHQHUDOL]HV EHWWHU WR XQVHHQ SRLQWV >@ )XUWKHU LW LV RIWHQ WKH FDVH WKDW ILQGLQJ WKH FRUUHFW VXEVHW RI SUHGLFWLYHIHDWXUHVLVDQLPSRUWDQWSUREOHPLQLWVRZQULJKW)RU H[DPSOHSK\VLFLDQPD\PDNHDGHFLVLRQEDVHGRQWKHVHOHFWHG IHDWXUHVZKHWKHUDGDQJHURXVVXUJHU\LVQHFHVVDU\IRUWUHDWPHQW RUQRW 7KH SULPDU\ JRDO RI D IHDWXUH VHOHFWLRQ LV WR PLQLPL]H WKH QXPEHU RI VHOHFWHG IHDWXUHV WR VLPSOLI\ WKH OHDUQLQJ V\VWHP ZKLOH PD[LPL]LQJ WKH SUHGLFWLYH DFFXUDF\ RI WKH OHDUQLQJ V\VWHP7KHUHIRUHLWLVUHDVRQDEOHWKDWWKHSUHGLFWLYHDFFXUDF\ LV DQ LPSRUWDQW PHDVXUH IRU IHDWXUH HYDOXDWLRQ 0RVW RI WKH FULWHULD IRU VHOHFWLQJD JRRG IHDWXUH VHWKDYH WR PD[LPL]H WKH SUHGLFWLYHDFFXUDF\HLWKHUGLUHFWO\RULQGLUHFWO\

$FHQWUDOSUREOHPRIZHEVHUYLFHEDVHGPLQLQJRIELRPHGLFDO GDWD DQDO\VLV ZLOO EH D FRPSOH[ SURFHGXUH DQG LW UHTXLUHV PXOWLPRGHO LQ WKH PHGLFDO LPDJHGLDJQRVLV DSSOLFDWLRQV VXFK DV IHDWXUH H[WUDFWLRQ IHDWXUH VHOHFWLRQ DQG GLVFUHWL]DWLRQ DQG FODVVLILFDWLRQ PHWKRGV KDYH EHHQ GHVFULEHG LQ >@ $W SUHVHQW H[LVWLQJWRROSURYLGHVHDFKRQHRIWKHVHIXQFWLRQVLQGLYLGXDOO\ KRZHYHU WKH SURSHU LQWHJUDWLRQV DUH UHTXLUHG IRU FRPSOH[ LPDJHDQDO\VLV,QWKLVSDSHUZHSURSRVHDQHZZHEVHUYLFHWR 978-0-7695-4859-3/12 $26.00 © 2012 IEEE DOI 10.1109/ICSC.2012.51

/LX DQG 0RWRGD >@ KDYH VXPPDUL]HG VRPH VHOHFWLRQ FULWHULDIRUDFODVVLILFDWLRQV\VWHPDVIROORZV ‡,QIRUPDWLRQ PHDVXUHV ,QIRUPDWLRQ ZDV ILUVW SURSRVHG DV D PHDVXUHPHQW RI WKH XQFHUWDLQW\ RI WKH UHFHLYHU ZKHQ LW UHFHLYHV DOO PHVVDJHV $Q LQIRUPDWLRQ PHDVXUH LV UHIHUUHG WR DV WKH XQFHUWDLQW\ IXQFWLRQ FRQFHUQLQJ WKH WUXH FODVV 7KH ODUJHUYDOXHRILQIRUPDWLRQPHDVXUHUHSUHVHQWVKLJKHUOHYHOVRI 269

0DQ\ IHDWXUH VHOHFWLRQ DOJRULWKPV UHSRUWHG LQ WKH OLWHUDWXUH >@ ± >@ KDYH VKRZQ WR ZRUN HIIHFWLYHO\ RQ GLVFUHWH GDWD RU HYHQ PRUH VWULFWO\ RQ ELQDU\ GDWD ,Q RUGHU WR GHDO ZLWK QXPHULF DWWULEXWHV D FRPPRQ SUDFWLFH IRU WKRVH DOJRULWKPV LV WRGLVFUHWL]H WKHGDWD EHIRUH FRQGXFWLQJ IHDWXUH VHOHFWLRQ7KLV SDSHU SURYLGHV D ZD\ WR VHOHFW IHDWXUHV GLUHFWO\ IURP QXPHULF DWWULEXWHV ZKLOH GLVFUHWL]LQJ WKHP 1XPHULF GDWD DUH YHU\ FRPPRQLQUHDOZRUOGSUREOHPV+RZHYHUPDQ\FODVVLILFDWLRQ DOJRULWKPV UHTXLUH WKDW WKH WUDLQLQJ GDWD FRQWDLQ RQO\ GLVFUHWH DWWULEXWHV DQG VRPH ZRXOG ZRUN EHWWHU RQ GLVFUHWL]HG RU ELQDULHV GDWD >@ >@ ,I WKRVH QXPHULF GDWD FDQ EH DXWRPDWLFDOO\ WUDQVIRUPHG LQWR GLVFUHWH RQHV WKHVH FODVVLILFDWLRQ DOJRULWKPV ZRXOG EH UHDGLO\ DW RXU GLVSRVDO 1$12LVRXUHIIRUWWRZDUGVWKLVJRDOGLVFUHWL]HGWKHQXPHULF DWWULEXWHV DV ZHOO DV VHOHFW IHDWXUHV DPRQJ WKHP >@ 7KH SUREOHP FDQ EH VWDWHG DV *LYHQ GDWD VHWV ZLWK QXPHULF DWWULEXWHV VRPH RI ZKLFK DUH LUUHOHYDQW DQGRU UHGXQGDQW DQG WKHUDQJHRIHDFKQXPHULFDWWULEXWHFRXOGEHYHU\ZLGH ILQGDQ DOJRULWKP WKDW FDQ DXWRPDWLFDOO\ GLVFUHWL]H WKH QXPHULF DWWULEXWHVDVZHOODVUHPRYHLUUHOHYDQWUHGXQGDQWRQHV

XQFHUWDLQW\ DQG YLFHYHUVD $ IHDWXUH VKRXOG EH VHOHFWHG LI LW FDQ UHGXFH PRUH XQFHUWDLQW\ $ FRPPRQO\ XVHG XQFHUWDLQW\ IXQFWLRQLVWKH6KDQQRQ¶VHQWURS\ ‡ 'LVWDQFH PHDVXUHV 7KLV FDWHJRU\ RI PHDVXUHV LV DOVR NQRZQDVVHSDUDELOLW\GLYHUJHQFHRUGLVFULPLQDWLRQPHDVXUHV $OJRULWKPV XVLQJ WKHVH PHDVXUHV WU\ WR ILQG WKH IHDWXUHV WKDW FDQVHSDUDWHWZRFODVVHVDVIDUDSDUWDVSRVVLEOH ‡'HSHQGHQFHPHDVXUHV7KHGHSHQGHQFHPHDVXUHVDUHDOVR NQRZQDVDVVRFLDWLRQRUFRUUHODWLRQPHDVXUHV,WLVWRTXDQWLI\ KRZ VWURQJO\ WZR YDULDEOHV DUHDVVRFLDWHG ZLWK HDFK RWKHU,Q FODVVLILFDWLRQ WDVN LW PHDVXUHV WKH FRUUHODWLRQ EHWZHHQ HDFK LQGLYLGXDOLQSXWIHDWXUHVDQGRXWSXWFODVVHV ‡ &RQVLVWHQF\ PHDVXUHV &RQVLVWHQF\ PHDVXUHV DWWHPSW WR GHWHUPLQH D PLQLPXP QXPEHU RI IHDWXUHV WKDW VHSDUDWH WKH FODVVHVDVFRQVLVWHQWO\DVWKHFRPSOHWHVHWRIIHDWXUHVLVDEOHWR PHDVXUH7KLVLVPRVWLPSRUWDQWPHDVXUHIRUILOWHUPRGHODQG IRUUHFXUVLYHWDVNDQGLWLVXVHGIRUWKHIHDWXUHVHOHFWLRQ ‡$FFXUDF\PHDVXUHV$FFXUDF\PHDVXUHLVDJRRGPHDVXUH IRU UHJUHVVLYH WDVN 6LQFH WKH JRDO RI WKH IHDWXUH VHOHFWLRQ DOJRULWKP LV WR PD[LPL]H WKH SUHGLFWLYH DFFXUDF\ DFFXUDF\ PHDVXUHVDUHGLUHFWO\DSSOLFDEOHDVDVHOHFWLRQFULWHULRQRIWKH IHDWXUH VHOHFWLRQ 7KLV LV WKH PRVW HIILFLHQW PHDVXUH IRU ZUDSSHU PRGHODQG IRUUHJUHVVLRQWDVNSUREOHPV DV LW LV XVHG IRU OHDUQLQJ RI WKH GHVLUHG V\VWHP DQG WKH VHOHFWLRQ RI WKH IHDWXUHV

)HDWXUH VHOHFWLRQ LV DQ LPSRUWDQW WHFKQLTXH LQ WKH SUH SURFHVVLQJRIGDWDDQGLWKDVEHHQDQDFWLYHDUHDLQ6WDWLVWLFDO 3DWWHUQ5HFRJQLWLRQ0DFKLQH/HDUQLQJ DQG'DWD0LQLQJVLQFH  >@ >@ >@C >@ >@ >@ )HDWXUH VHOHFWLRQ KDV DOVR EHHQDSSOLHGLQWKHILHOGVOLNH0HGLFDO,PDJH'LDJQRVLV>@± >@,PDJH5HVWRUDWLRQDQG*HQH([SUHVVLRQ$QDO\VLV6LQFH VHOHFWLRQ RIDQ RSWLPDO VXEVHWLV DOZD\V GLIILFXOWPDQ\ WRSLFV UHODWHG WR IHDWXUH VHOHFWLRQ KDYH GLIILFXOWLHV WR VHOHFW D EHVW VXEVHW,QIDFWWKHXVDJHRIDODUJHQXPEHURIIHDWXUHVUHPDLQV D FULWLFDO SUREOHP $V WKH QXPEHU RI IHDWXUHV JURZV WKH VLJQLILFDQFH RI HDFK IHDWXUH GHFUHDVHV DQG WKH WLPH VSHQW WR DQDO\]HWKHGDWD LQFUHDVHVOHDGLQJ WRWKH HIIHFWV RI WKH ³FXUVH RI WKH GLPHQVLRQDOLW\´ WR RFFXU ,Q WKH OLWHUDWXUH WKHUH DUH DEXQGDQW IHDWXUH VHOHFWLRQ DOJRULWKPV 6RPH XVH PHWKRGV OLNH SULQFLSOH FRPSRQHQW WR FRPSRVH D VPDOOHU QXPEHU RI QHZ IHDWXUHV    >@ ± >@ VRPH VHOHFW D VXEVHW RI WKH RULJLQDO DWWULEXWHV>@

7KH UHVW RI WKH SDSHU LV VWUXFWXUHG DV IROORZV 6HFWLRQ ,, SUHVHQWVWKHUHODWHGZRUNV6HFWLRQ,,,SUHVHQWVWKHGHVLJQDQG LPSOHPHQWDWLRQ RI WKH SURSRVHG DOJRULWKP 1$12 ZKLFK LV XVHG IRU GLVFUHWL]DWLRQ DQG IHDWXUH VHOHFWLRQ 6HFWLRQ ,9 SUHVHQWVWKH ZHEVHUYLFHEDVHG1$12DOJRULWKPWRSHUIRUPWKH IHDWXUH VHOHFWLRQ DQG GLVFUHWL]DWLRQ LQ FORXG HQYLURQPHQW 6HFWLRQ9GLVFXVVHVWKHH[SHULPHQWVSHUIRUPHGDQGWKHUHVXOWV REWDLQHG )LQDOO\ 6HFWLRQ 9, VXPPDUL]HV WKH FRQFOXVLRQV RI WKLVZRUN ,, 5(/$7(' :25. ,Q >@ &KDUDODPSRV 'RXNV SURSRVHG D 62$ EDVHG PHGLFDO LPDJH GLDJQRVLV VHUYLFH 62$ LPSURYHV PDLQWDLQDELOLW\ RI GLVWULEXWHGV\VWHPV,Q62$WKHPRVWLPSRUWDQWHOHPHQWLVWKH VHUYLFH D UHVRXUFH SURYLGHG WR UHPRWH FOLHQWV YLD D VHUYLFH FRQWUDFW)HDWXUHVHOHFWLRQLQVXSHUYLVHGOHDUQLQJKDVEHHQZHOO VWXGLHG ZKHUH WKH PDLQ JRDO LV WR ILQG D IHDWXUH VXEVHW WKDW SURGXFHV KLJKHU FODVVLILFDWLRQ DFFXUDF\ >@ 7KH PRVW FRPPRQ W\SH RI IHDWXUHV XVHG LQ GDWD PLQLQJ LV QRPLQDO FRQWLQXRXVDQGGLVFUHWHYDOXHV1RPLQDOIHDWXUHVRIWHQDVVXPH DOLPLWHGQXPEHURIYDOXHVWKDWGRQRWKDYHDQ\UHODWLRQVKLSRI RUGHUDPRQJWKHP&RQWLQXRXVIHDWXUHVFDQDVVXPHDQLQILQLWH QXPEHURIRUGLQDOYDOXHV)RUPDQ\GDWDPLQLQJDOJRULWKPVLW LV LPSRUWDQW WKDW IHDWXUHV KDYH ERWK WKH FKDUDFWHULVWLFV D OLPLWHG QXPEHU RI YDOXHV DQG D UHODWLRQ RI RUGHU DPRQJ WKHLU YDOXHV VR DV WR LPSURYH WKH VSHHG DQG TXDOLW\ RI WKH OHDUQLQJ SURFHVV >@ 7KHVH WZR LVVXHV DUH SUHVHQW LQ GLVFUHWH IHDWXUHV ZKRVH YDOXHV SUHVHUYH WKHUHODWLRQ RI RUGHUDPRQJWKHPDOVR WKHQXPEHURIYDOXHVLVRIWHQOLPLWHG+HQFHDQLPSRUWDQWVWHS RI WKH GDWD SUHSURFHVVLQJ IRU D OHDUQLQJ DOJRULWKP LV WKH GLVFUHWL]DWLRQRIFRQWLQXRXVIHDWXUHV

2QH RI WKH PRVW ZHOO NQRZQ IHDWXUH VHOHFWLRQ DOJRULWKP LV 5HOLHI>@ZKLFKPHDVXUHVWKHTXDOLW\RIIHDWXUHVDFFRUGLQJWR WKHLU YDOXHV WKDW GLVWLQJXLVK LQVWDQFHV RI GLIIHUHQW FODVVHV +RZHYHU 5HOLHI FDQ RQO\ EH DSSOLHG LQ WKH SUHSURFHVVLQJ RI FODVVLILHUWRWKHFDVHZKHUHWKHUHVXOWVDUHWZRGLVWLQJXLVKHG\HV RUQRVLWXDWLRQV$OVR5HOLHIKDVGLIILFXOW\RILQSXWVDPSOHVL]H ZKLFKXVHUVVHWUDQGRPO\EHIRUHSURFHVVLQJRIGDWD,Q>@D EUDQFKDQGERXQGDOJRULWKPZDVSURSRVHGIRUIHDWXUHVHOHFWLRQ WKDW UHTXLUHV PRQRWRQH RQ PHDVXUHPHQW WR JHW WKH JOREDO RSWLPDO UHVXOWV +RZHYHU PRVW HYDOXDWLRQ PHWKRGV FDQQRW JXDUDQWHHPRQRWRQH'70>@DSSOLHVWKHGHFLVLRQWUHH & LQWR WKH WUDLQLQJ VHWV DQG DSSOLHV WKH VHW RI 3UXQHG 'HFLVLRQ 7UHH DV WKH IHDWXUH VXEVHW RI VHOHFWLRQ +RZHYHU '70 WDNHV WRR PXFK WLPH ,Q >@ 6KHLQYDOG HWDO SURSRVHV D PRGHOLQJ DSSURDFK IRU IHDWXUH VHOHFWLRQ WKDW XVHV *DXVVLDQ GLVWULEXWLRQ GDWD 0XFFLDUGL HWDO SUHVHQWV VHYHQ WHFKQLTXHV IRU FKRRVLQJ VXEVHWV RI SURSHUWLHV DQG FRPSDUHV WKHLU SHUIRUPDQFH RQ D QLQHFODVV YHFWRU FDUGLRJUDP FODVVLILFDWLRQ SUREOHPKDYH EHHQ GLVFXVVHG LQ >@ 7KH DOJRULWKP FRXOG OLVW DOO IHDWXUHV EXW FRXOG QRW GHFLGH WKH QXPEHU RI HIIHFWLYH IHDWXUHV ,W UHTXLUHV XVHUV WR SURYLGH WKH QXPEHU RI IHDWXUHV WKDW QHHGHG WR EH VHOHFWHG

270

,Q >@ .HUEHU LQWURGXFHV D VFKHPH FDOOHG &KL0HUJH WKDW GLVFUHWL]HV QXPHULF DWWULEXWHV EDVHG RQ WKH χ VWDWLVWLF >@ &KL0HUJH FRQVLVWV RI DQ LQLWLDOL]DWLRQ VWHS DQG D ERWWRPXS PHUJLQJSURFHVVZKHUHLQWHUYDOVDUHFRQWLQXRXVO\PHUJHGXQWLO DWHUPLQDWLRQFRQGLWLRQZKLFKLVGHWHUPLQHGE\DVLJQLILFDQFH WKUHVKROG YDOXH α VHWPDQXDOO\ ,WLVDQLPSURYHPHQW IURP WKH PRVW REYLRXV VLPSOH PHWKRGV VXFK DV HTXDOZLGWK LQWHUYDOVZKLFKGLYLGHVWKHQXPEHUOLQHEHWZHHQWKHPLQLPXP DQG PD[LPXP YDOXHV LQWR1LQWHUYDOV RI HTXDO VL]H RU HTXDO IUHTXHQF\LQWHUYDOV LQ ZKLFK WKH LQWHUYDO ERXQGDULHV DUH FKRVHQ VR WKDW HDFK LQWHUYDO FRQWDLQV DSSUR[LPDWHO\ WKH VDPH QXPEHU RI WUDLQLQJ H[DPSOHV ,QVWHDG RI GHILQLQJ D ZLGWK RU IUHTXHQF\ WKUHVKROG ZKLFK LV QRW HDV\ XQWLO VFUXWLQL]LQJ HDFK DWWULEXWH DQG NQRZLQJ ZKDW LW LV  &KL0HUJH UHTXLUHV α WR EH VSHFLILHG LGHDOO\ RQH α IRU HDFK DWWULEXWH  1HYHUWKHOHVV WRR ELJ RU WRR VPDOO DQ α ZLOO RYHU RU XQGHUGLVFUHWL]H DQ DWWULEXWH $Q H[WUHPH H[DPSOH RI XQGHUGLVFUHWL]DWLRQ LV WKH FRQWLQXRXVDWWULEXWHLWVHOI2YHUGLVFUHWL]DWLRQLQWURGXFHVPDQ\ LQFRQVLVWHQFLHV QRQH[LVWHQW EHIRUH DQG WKXV FKDQJHV WKH FKDUDFWHULVWLFV RI WKH GDWD ,Q VKRUW LW LV QRW HDV\ WR ILQG D SURSHU α IRU &KL0HUJH ,W LV WKHUHE\ LGHDO WR OHW WKH GDWD GHWHUPLQHZKDWYDOXH α VKRXOGWDNH

:HEVHUYLFHEDVHG1$12SURFHVVHVHDFKIHDWXUHVHSDUDWHO\ /HW ' EH WKH VHW RI WUDLQLQJ LQSXW WUDQVDFWLRQV /HW I EH D IHDWXUH RI WKH LQSXW IHDWXUH YHFWRU )  /HW IL EH WKH YDOXH RI WKH IHDWXUH I LQ D WUDQVDFWLRQ L  1$12 XVHV D GDWD VWUXFWXUH WKDW OLQNV IL WR WKH FODVV &L  IRU DOO L ∈'  ZKHUH &L LV WKH FODVV RI WKH WUDQVDFWLRQ L  (DFK OLQH LQ WKH GDWD VWUXFWXUH LV FDOOHGDQLQVWDQFH$QLQVWDQFH ,L EHORQJVWRDQLQWHUYDO 7U LI LWV YDOXH IL LV EHWZHHQ WZR FRQVHFXWLYH FXW SRLQWV KS DQG KS+ DQG7KDWLV IL ∈ 7U = ⎡⎣ K S  KS+⎤⎦7KH1$12DOJRULWKP SHUIRUPVWKHIROORZLQJVWHSVLQVHUYHUVLGH

,QVWHS1$12ILUVWVRUWVWKHFRQWLQXRXVYDOXHV ,QVWHS1$12GHILQHVWKHLQLWLDOFXWSRLQWV7KHFODVVODEHO RIWKHFXUUHQWLQVWDQFH ,LDQG L VKRXOGEHJUHDWHUWKDQRUHTXDO WRRQH7KHFXUUHQWLQVWDQFH ,L LVGLIIHUHQWIURPWKHFODVVODEHO RI WKH SUHYLRXV LQVWDQFH LH & L ≠&L− 7KHLQLWLDO FXW SRLQWV SHUIRUPV E\ WKH PDMRULW\ FODVV 0U RI LQWHUYDO7U  DQG 0U LV WKH QXPEHU RI RFFXUUHQFHV RI 0U LQ WKH LQWHUYDO 7U  7KLV FRQGLWLRQ PD\JHQHUDWH WRR PDQ\ FXW SRLQWV HVSHFLDOO\ ZKHQ ZRUNLQJ ZLWKQRLV\ GDWD 7KHODUJHU WKHQXPEHU RI FXW SRLQWV WKH ODUJHU LV WKHQXPEHU RI LQWHUYDOV (DFKLQWHUYDOUHSUHVHQWV DQLWHPLQWKHSURFHVV RIPLQLQJDVVRFLDWLRQUXOHV7KHXVHRI PDQ\ LWHPV SRWHQWLDOO\ JHQHUDWHV DKXJHQXPEHU RI LUUHOHYDQW UXOHVZLWKORZFRQILGHQFH+HQFHLWLVLPSRUWDQWWRNHHSWKH QXPEHU RI FXW SRLQWV VPDOO DQG FRQVHTXHQWO\ JHQHUDWHV D VPDOO QXPEHU RI LWHPV ,Q WKLV VWHS 1$12 SURGXFHV SXUH ELQVZKLFKDUH WKH ELQV RI ORZHVWSRVVLEOH HQWURS\ ]HUR 7KLV VWHS SURGXFHV LQWHUYDOV WKDW PLQLPL]H WKH LQFRQVLVWHQFLHV SUHVHQWZLWKWKHGLVFUHWL]DWLRQSURFHVV

7R RYHUFRPH WKH DERYH SUREOHP LQ WKLV SDSHU D QHZ DOJRULWKP WKDW SHUIRUPV ZHE EDVHG VXSHUYLVHG GDWD GLVFUHWL]DWLRQ RI FRQWLQXRXV IHDWXUHV DQG IHDWXUH VHOHFWLRQ LV SUHVHQWHG )LUVW 1$12 DOJRULWKP SHUIRUPV IHDWXUH VHOHFWLRQ DQG GLVFUHWL]DWLRQ LV SURSRVHG 1$12 XVHV WKH PHDVXUH RI LQFRQVLVWHQFHWRGHWHUPLQHWKHILQDOQXPEHURILQWHUYDOVDQGWR VHOHFW IHDWXUHV $V WKH QXPEHU RI LQWHUYDOV JHWV VPDOOHU WKH QXPEHU RI LQFRQVLVWHQF\ LQFUHDVHV  6RPH IHDWXUHV PD\ KDYH PD[LPXP QXPEHU RI LQWHUYDOV DQG PLQLPXP QXPEHU RI LQFRQVLVWHQFH 1$12 DLPV WR IRFXV WKH PLQLPDO QXPEHU RI LQWHUYDOV ZLWK PLQLPDO LQFRQVLVWHQF\ 6HFRQG PHWKRG LQWURGXFH ZHE VHUYLFH EDVHG 1$12 DOJRULWKP WR SHUIRUPWKH IHDWXUHVHOHFWLRQDQGGLVFUHWL]DWLRQLVLQWURGXFHG7KHSURSRVHG PHWKRG ZHE VHUYLFH PHWKRG ILUVW ORDGHG WKH DSSOLFDWLRQV LQWR ZHE VHUYLFH DQG WKHQ SHUIRUPV WKH IHDWXUH VHOHFWLRQ DQG GLVFUHWL]DWLRQ ZLWKKLJK VSHHG E\ ZKLFK WKH H[SHUWFDQDFFHVV DQ\ZKHUHDURXQG WKHZRUOG

,Q VWHS 1$12UHVWULFWVWKHPLQLPXP IUHTXHQF\ WKDWD ELQ PXVW SUHVHQW VR DV WR DYRLG D KXJH QXPEHU RI FXW SRLQWV 1$12 DOJRULWKP LQLWLDWHV LQSXW WKUHVKROGV 0LQUDQJH 0LQUDQJHUHVWULFWVWKHPLQLPDOQXPEHU RI RFFXUUHQFHV RI WKH PDMRULW\ FODVV DOORZHG LQ DQ LQWHUYDO 7KH QXPEHU RI RFFXUUHQFHV RI WKH PDMRULW\ FODVV LQ DQ LQWHUYDO 7U PXVW EH JUHDWHU WKDQ RU HTXDO WKH 0LQUDQJH WKUHVKROG LH 0U ≥ 0LQUDQJHWKUHVKROG,IWKH 0LQUDQJHWKUHVKROGFRQGLWLRQLVQRW VDWLVILHG E\ WKH LQWHUYDO 7U = ⎡⎣ K S  KS+⎤⎦  WKH ULJKW FXW SRLQW KS+ RIWKHLQWHUYDO 7U LVUHPRYHG1$12SURGXFHVWKHIHZHU ELQVIRUKLJKHUYDOXHVRI0LQUDQJHWKUHVKROG+RZHYHUVRPH FDXWLRQ VKRXOG EH WDNHQ EHIRUH DGMXVWLQJ WKH0LQUDQJHYDOXH DV KLJKHU WKH 0LQUDQJH WKH KLJKHU LV WKH LQFRQVLVWHQFLHV JHQHUDWHGE\WKHGLVFUHWL]DWLRQSURFHVV

,,, )($785( 6(/(&7,21$1' ',6&5(7,=$7,21 ,Q WKLV SDSHU D QRYHO VXSHUYLVHG DOJRULWKP WKDW SHUIRUPV GLVFUHWL]DWLRQ RI WKH FRQWLQXRXV YDOXHV RI WKH IHDWXUHV LV SUHVHQWHG 7KH SURSRVHG 1$12 DOJRULWKP SHUIRUPV VLPXOWDQHRXVO\ GDWD GLVFUHWL]DWLRQ DQG IHDWXUH VHOHFWLRQ $ PHDVXUH RI LQFRQVLVWHQFH LV HPSOR\HG WR GHWHUPLQH WKH ILQDO QXPEHU RI LQWHUYDOV DQG WR VHOHFW IHDWXUHV $V WKH QXPEHU RI LQWHUYDOV JHWV VPDOOHU WKH QXPEHU RI LQFRQVLVWHQFH LQFUHDVHV 1$12DLPVDWNHHSLQJWKHPLQLPDOQXPEHURILQWHUYDOVZLWK PLQLPDO LQFRQVLVWHQF\ HVWDEOLVKLQJ D WUDGHRII EHWZHHQ WKHVH PHDVXUHV 7KH IROORZLQJ GHVFULSWLRQV DUH QHFHVVDU\ EHIRUH GHWDLOLQJWKH 1$12DOJRULWKP

,Q VWHS 1$12 IXVHV FRQVHFXWLYH LQWHUYDOV XVLQJ WKH PHDVXUH RI LQFRQVLVWHQFH UDWH WR GHWHUPLQH ZKLFK LQWHUYDOV VKRXOG EH PHUJHG /HW 0U EH WKH PDMRULW\ FODVV RI DQ LQWHUYDO7U  1$12 IXVHV FRQVHFXWLYH LQWHUYDOV 7U DQG7U+ 

7KH &ODVV LV WKH PRVW LPSRUWDQW NH\ZRUG RI D GLDJQRVLV JLYHQE\DVSHFLDOLVW&XW3RLQWVDUHWKHOLPLWVRIDQLQWHUYDORI UHDOYDOXHV$QLQWHUYDOLVDOVRFDOOHGELQDQGWKHPRVWIUHTXHQW FODVVLQDELQLVFDOOHG PDMRULW\FODVVRIWKHELQ

WKDW LV WKRVH KDYH WKH VDPH PDMRULW\ FODVV ( 0 U +0U+ )DQG DOVRKDYH LQFRQVLVWHQFHUDWHV ( ς 7U +ς 7U+ ) EHORZ RU HTXDOWR

DQ

271

LQSXW

WKUHVKROG

(

)

ς 7U PLQ =  ≤ ς 7U PLQ ≤



7KH

LQFRQVLVWHQFH UDWH UHODWLRQ

ς 7U =

ς7U RI DQ LQWHUYDO 7U LV JLYHQ E\ WKH

7U − 07U

7KH SURSRVHG QRYHO ILOWHUEDVHG IHDWXUH VHOHFWLRQ PHWKRG LV WHVWHGZLWKUHSXWHGGDWDVHWVDQGUHGXFHVWKHLUUHOHYDQWIHDWXUHV DQG SURGXFHV YHU\ KLJK FODVVLILFDWLRQ DFFXUDF\ 7KH FRPSXWDWLRQDO FRVW RI WKH SURSRVHG PHWKRG FRQGXFWHG ZLWK H[SHULPHQWV IRU WKH N WUDLQLQJ LQSXW VDPSOHV ZLWK 1 IHDWXUHV LV 2 ( N ORJ1)

 

7U

,Q VWHS 1$12 DOJRULWKP FDOFXODWHV JOREDO LQFRQVLVWHQFH YDOXH ζ*, /HW 7 EH WKH Q QXPEHU RI

7KH $OJRULWKP  VXPPDUL]HV WKH SURSRVHG 1$12 DOJRULWKP $V ZH VKRZ LQ WKH VHFWLRQ RI H[SHULPHQWV1$12 LVZHOOVXLWHGWRIHDWXUHVHOHFWLRQDQGGLVFUHWL]DWLRQRIQXPHULF DQGRUGLQDODWWULEXWHV

LQWHUYDOV ( 7U + 7U + + + 7U + Q) LQ ZKLFK WKH IHDWXUHV DUH GLVFUHWL]HG )RU HDFK IHDWXUH I1$12 FRPSXWHV WKH JOREDO LQFRQVLVWHQFH YDOXHζ*, 7KH JOREDO LQFRQVLVWHQFH YDOXH LV JLYHQE\WKHUHODWLRQ

ζ *, =

(

∑7U ∈7 7U − 07U ∑7U∈7 ( 7U )

)

$OJRULWKP1$12$OJRULWKP ,QSXW,PDJH)HDWXUH9HFWRUV ) ,PDJH&ODVVHV & 0LQUDQJH

ς7UPLQ ζ7U DQG ξ7U WKUHVKROGV 2XWSXW3URFHVVHG)HDWXUH9HFWRU 9

 

 IRU HDFKIHDWXUH I ∈) GR

,Q VWHS1$12 DOJRULWKP FDOFXODWHV JOREDO FXW SRLQW YDOXH ξ*& /HW +3U EH WKH Q QXPEHU RI FXW SRLQWV

( KS + K S+ + + KS +Q)

 6RUWYDOXHVDYDLODEOHLQ

LQ D IHDWXUH I )RU HDFK IHDWXUH

F L  IL ZKHUH FL ∈&   7RFUHDWHYHFWRU + RIFXWSRLQWV KS LIWKHFODVVODEHO

I 1$12 FRPSXWHV WKH JOREDO FXW SRLQW YDOXH ξ*& 7KH JOREDOFXWSRLQWYDOXHLVREWDLQHGZLWKWKHUHODWLRQ

(

ξ*& = ∑7U ∈7 +3U

)

RIWKHFXUUHQWLQVWDQFH,L  L ≥ LVGLIIHUHQWIURPWKH FODVVODEHORIWKHSUHYLRXVLQVWDQFHLH FL ≠FL−  HQGIRU  IRU HDFK K S∈+ GR

 

ZKHUH +3U LV WKH WRWDO QXPEHU RI FXW SRLQWV LQ WKH IHDWXUH

 5HPRYH KS DFFRUGLQJWRWKHQXPEHURI RFFXUUHQFHVRI

I IRUDQLQWHUYDO 7U 

WKHPDMRULW\FODVVLQDQ LQWHUYDO 7U PXVWEHHTXDORU JUHDWHUWKDQWKH 0LQUDQJH WKUHVKROGLH 0U ≥ 0LQUDQJH

)LQDOO\ WKH SURSRVHG 1$12 PHWKRG LQWURGXFHV WZR PHDVXUHV WKH DYHUDJH JOREDO LQFRQVLVWHQF\ ζ7U DQG JOREDO FXW

 5HPRYH KS DFFRUGLQJWR1$12IXVHVFRQVHFXWLYH LQWHUYDOV 7U DQG7U+ WKDWKDYHWKHVDPHPDMRULW\&ODVV

SRLQW ξ7U IRU DXWRPDWLF IHDWXUH DQG GLVFUHWL]DWLRQ DV JLYHQ EHORZ  , ζ 7U = ∑ζ 7LU , L=  , ∑ξ7 , L= LU

(0 U

= 0 U+) DQGDOVRKDYHLQFRQVLVWHQFHUDWHV

(ς

ς 7 U+

7U

) EHORZRUHTXDODQLQSXW WKUHVKROG

ς P D[ = (  ≤ ς P D[ ≤ )

 



6DYHWKHUHPDLQLQJFXWSRLQWVLQDYHFWRU +I 

 HQGIRU  &DOFXODWHWKH*OREDOLQFRQVLVWHQFHYDOXH ς * , Q F IRUHDFK

DQGWKHDYHUDJHJOREDOFXWSRLQWDV

ξ7U =

I 

 IRU HDFKWUDQVDFWLRQ L &UHDWHDQLQVWDQFH ,L RIWKHIRUP

IHDWXUH

 

I 

 &DOFXODWHWKH*OREDOFXWSRLQWYDOXH ς*&XW IRUHDFKIHDWXUH

I 

7KHIHDWXUHVHOHFWLRQFULWHULRQHPSOR\HGE\1$12UHPRYHV IURP WKH VHW RI DWWULEXWHV HYHU\ DWWULEXWH ZLWK DYHUDJH JOREDO LQFRQVLVWHQFH YDOXHDQGDYHUDJHJOREDO FXW SRLQW YDOXH LVOHVV WKDQWKH LQSXWWKUHVKROGV ζ7U DQG ξ7  U 

 &DOFXODWHWKHDYHUDJH*OREDOLQFRQVLVWHQFHYDOXH ζ7 IRU U HDFKIHDWXUH

I

DFFRUGLQJWRHTXDWLRQ 

 &DOFXODWHWKHDYHUDJH*OREDOFXWSRLQWYDOXH ξ7 IRUHDFK U IHDWXUH I DFFRUGLQJWRHTXDWLRQ   6HOHFWWKHIHDWXUHVWKDWJHQHUDWHWKHPLQLPXP DYHUDJH *OREDOFXW SRLQWVDQGZLWKPLQLPXPDYHUDJH*OREDO LQFRQVLVWHQFHYDOXH  :ULWHWKHVHOHFWHGIHDWXUHVGLVFUHWL]HGLQ 9   HQGIRU  5HWXUQ 9   6WRS

,W DOVR VROYHV IHDWXUH GLVFUHWL]DWLRQ DQG VHOHFWLRQ $Q LPSRUWDQWUHGXFWLRQRILUUHOHYDQWLWHPVWREHPLQHGLVDFKLHYHG ZLWK WKH SURSRVHG 1$12 DOJRULWKP WR VHOHFW WKH UHOHYDQW IHDWXUHV EDVHG RQ WKH DYHUDJH PHDVXUH RI WKH JOREDO LQFRQVLVWHQF\ DQG JOREDO FXW SRLQW VSHHGLQJ XS WKH ZKROH IUDPHZRUN 6LQFH WKH QXPEHU RI LQFRQVLVWHQFLHV RI WKH IHDWXUHV LV WKH IDFWRU WKDW FRQWULEXWHV PRUH WR GLVWXUE WKH OHDUQLQJDOJRULWKPGLVFDUGLQJWKHPRVWLQFRQVLVWHQWDWWULEXWHV FRQWULEXWH WR LPSURYH DFFXUDF\ DQG VSHHG XS WKH OHDUQLQJ DOJRULWKP

272

VHVVLRQ WRNHQ IRU WKH FXUUHQW UHFLSLHQW LQWHUDFWLRQ DQG WKHQ LGHQWLILHVWKH1$12VHUYLFHSURYLGHUVDFFHVVLEOHE\WKHFOLHQW

,9 7+( 352326('1$12 :(%6(59,&( 0(7+2' :HE VHUYLFHV DUH DSSOLFDWLRQV H[HFXWHG LQ UHPRWH VHUYHU FRPSXWHUV DQG WKH\ PD\ EH DFFHVVHG E\ FOLHQWV IURP DQ\ FRPSXWHU ORFDWHG DQ\ZKHUH LQ WKH ZRUOG >@ 7KH HQG XVHUV FDQDFFHVVWKHZHEVHUYLFHVWKURXJKPLQLPXPVRIWZDUH¶VVLQFH PDQ\ RI WKHVH DSSOLFDWLRQVDUHDFFHVVLEOH XVLQJ DUHJXODU ZHE EURZVHU ,Q>@0DMLGHWDOSURSRVHGD 62$EDVHGSODWIRUP WR VXSSRUWPHGLFDOLPDJHGLDJQRVLVIUDPHZRUN DQGLPSURYHVWKH VSHHG RI WKH GLDJQRVLVLV HPSOR\HG 7KH 62$ EDVHG SODWIRUP PD\ DOVR VXSSRUW XVDELOLW\ DQG PDLQWDLQDELOLW\ RI GLVWULEXWHG V\VWHPV,QJHQHUDO WKHPHGLFDOGDWDVHWVDUHXVXDOO\ODUJHVFDOH DQG GLVWULEXWHG DW GLIIHUHQW KRVSLWDOV >@ 7KH KRVSLWDO GLVSHQVHV WKH PHGLFDO GDWD VHWV ZKLFK DUH DQDO\]HG E\ WKH UDGLRORJLVW DQG SK\VLFLDQV 7KH DQDO\VLV UHVXOWV ZKLFK DUH WLPHFRVWO\ DQG FDQ¶W JHW EHWWHU DQDO\VLV UHVXOW DV WKH DV\QFKURQRXV FROODERUDWLRQ FRXOG QRW JLYH WKH SK\VLFLDQV WKH UHDOWLPH IHHGEDFN >@ 7KH SURSRVHG 1$12 ZHE VHUYLFH PDNHV V\QFKURQRXV FROODERUDWLRQ DPRQJ WKH GDWD VHWV DQG LW HQDEOHV WKH FROODERUDWLYH DQDO\VLV RI PHGLFDO LPDJH GDWD VHW RYHU JHRJUDSKLF GLVWDQFHV 7KH SURSRVHG ZHE VHUYLFH EDVHG PHWKRG SURYLGHV WKH LQWHUDFWLRQV EHWZHHQ WKH WUDLQLQJ VHW DQG WKH 1$12 DOJRULWKP ZLWK ;0/ EDVHG 62$3 UHTXHVW DQG 62$3UHVSRQVH

E  &RQWULEXWLQJ GDWD SURYLGHUV 1H[W WKH VHUYLFH DJHQW TXHULHV WKH GDWD VFKHPD RI WKH DFFHVVLEOH GDWD SURYLGHUV WR LGHQWLI\ WKH 1$12 VHUYLFH SURYLGHUV WKDW FDQ FRQWULEXWH GDWD IRU WKHUHTXHVWHG VHUYLFH 7R IDFLOLWDWHPRUH HIILFLHQWTXHULHV WKH VHUYLFH DJHQW FRXOG SUHIHWFK GDWD VFKHPD IURP WKH GDWD SURYLGHUVLHWKH1$12VHUYLFHSURYLGHU  F  ,QLWLDOL]H VHVVLRQ FRQWH[W 1H[W WKH VHUYLFH DJHQW QRWLILHV 1$12 VHUYLFH SURYLGHUV ZLWK WKH VHVVLRQ LGHQWLILHU 7KH VHUYLFH DJHQW VKDUH D FRPPRQ VHVVLRQ FRQWH[W WKDW UHSUHVHQWV D VWDWHIXO SUHVHQWDWLRQ RI LQIRUPDWLRQ UHODWHG WR D VSHFLILF H[HFXWLRQ RI WKH 1$12 DOJRULWKP 7KLV DOJRULWKP ZLOOEHGLVFXVVHGLQ6HFWLRQ,,,$QHVWDEOLVKHGVHVVLRQFRQWH[W FRQWDLQV VHYHUDO DWWULEXWHV WR LGHQWLI\ D VHUYLFH SURFHVV LQFOXGLQJWKHFOLHQWDGGUHVVWKHGDWDSURYLGHUV¶DGGUHVVHVDQG FHUWLILFDWHV DQ DXWKHQWLFDWLRQ WRNHQ WKDW FRQWDLQV WKH FOLHQW FHUWLILFDWH DQG D XQLTXH VHVVLRQ LGHQWLILHU WKDW XVHV DQ HQG SRLQWUHIHUHQFH(35 FRPSRVHGRIWKHVHUYLFHDGGUHVV 7KHVHUYLFHDJHQWDFWVDVDQSUR[\EHWZHHQWKHFOLHQWDQGWKH 1$12 VHUYLFH SURYLGHU 7KH )LJXUH  GHVFULEHV WKH SLSHOLQH RIWKHVHUYLFHDJHQW

$6HUYLFH'LVFRYHU\ 7KH SURSRVHG 1$12 ZHE VHUYLFH PHWKRG FUHDWHV WKH QHZ VHUYLFH GLUHFWRU\ LQ WKH VHUYLFH DJHQW DQG LW DFWV DV D SUR[\ EHWZHHQ WKH VHUYLFH FRQVXPHU DQG WKH VHUYLFH SURYLGHU 1$12 7KHVHUYLFHDJHQWSURYLGHVWKHOLVWRIVHUYLFHVWRWKH FOLHQWV ZKLFK DUH UHWULHYHG IURP WKH UHSRVLWRU\ RI UHJXODWLQJ DXWKRULW\7KHQWKH H[SHUWVHOHFWVWKH 1$12VHUYLFHZKHQHYHU QHHGHG WR SHUIRUP IHDWXUH VHOHFWLRQ DQG GLVFUHWL]DWLRQ 7KH VHUYLFH DJHQW DFWV DV DQ LQWHUPHGLDU\ EHWZHHQ VHUYLFH SURYLGHUV DQG VHUYLFH UHTXHVWHUV 7KH IROORZLQJ VWHSV DUH QHFHVVDU\WRFUHDWHDVHUYLFHGLUHFWRU\LQWKHFORXG

&OLHQW

,QLWLDOL]H VHVVLRQFRQWH[W

$XWKHQWLFDWLRQ &OLHQW 5HTXHVW

0DSSLQJ :6'/ILOH

1$126HUYLFH 3URYLGHU

9DOLG 8VHU *HQHUDWH 6HVVLRQ 7RNHQ 0DSSLQJ ,QSXW  RXWSXWSRUW 3DUDPHWHUV 0DWFKHV ;0/62$3 5HTXHVW

 7KH VHUYLFH DJHQW DFFHSWV UHTXHVW IURP VHUYLFH SURYLGHUV WR SXEOLVK DQG DGYHUWLVH ZHE VHUYLFH GHVFULSWLRQVLH:6'/ILOH

;0/62$3 5HVSRQVH 5HGXFHG )HDWXUH9HFWRU

 6HUYLFH GLFWLRQDU\ DOORZV WKH QHZ VHUYLFH UHTXHVWRUV WR VHDUFK WKH FROOHFWLRQ RI VHUYLFH GHVFULSWLRQV FRQWDLQHGZLWKLQWKHVHUYLFHUHJLVWU\

)LJXUH 3LSHOLQHRI WKH 6HUYLFH$JHQW

7KH PDLQUROHRIVHUYLFHUHJLVWU\LQWKHSURSRVHG1$12ZHE VHUYLFH PHWKRG KDV WR HQDEOH WKH PDWFKPDNLQJ EHWZHHQ VHUYLFH SURYLGHUV DQG VHUYLFH UHTXHVWRUV 2QFH WKH PDWFK KDV EHHQ IRXQG WKH LQWHUDFWLRQ SURFHVVHV DUH FDUULHG RXW GLUHFWO\ EHWZHHQWKHVHUYLFHUHTXHVWRUDQGWKHVHUYLFHSURYLGHU

% 6HUYLFH3URYLGHU 7KH1$12ZHEVHUYLFHPHWKRGWKHVHUYLFHSURYLGHUGHILQHV WKH UHIHUHQFH LQWR LWV ZHE VHUYLFH XVLQJ :6'/ 2QFH WKH :6'/ GRFXPHQW KDV EHHQ SXEOLVKHG LQWR WKH 8'', UHJLVWU\ WKHVHUYLFH FRQVXPHU FDQ VHDUFKWKHUHJLVWU\ DQGWKHQUHWULHYH WKH:6'/UHIHUHQFH IURPWKH ZHEVHUYLFH 7KHQHFHVVDU\VWHSV DUHUHTXLUHG IRU FUHDWLQJD VHUYLFH GHVFULSWLRQLQWKH FORXGKDV EHHQGHVFULEHGLQEHORZ

  6HUYLFH$JHQW 7KH REMHFWLYH RI WKH ZHE VHUYLFH DJHQW LV WR HVWDEOLVK D FRPPRQ VHVVLRQ FRQWH[W EHWZHHQ WKH FOLHQW DQG WKH IHDWXUH VHOHFWLRQ DQG GLVFUHWL]DWLRQ DOJRULWKP VHUYLFH SURYLGHU  7KH VHUYLFH DJHQW H[HFXWHV WKHVH IROORZLQJ VWHSV FOLHQW DXWKHQWLFDWLRQ FRQWULEXWLQJ 1$12 VHUYLFH SURYLGHU¶V LGHQWLILFDWLRQ VHVVLRQ FRQWH[W LQLWLDOL]DWLRQ DQG FRPPRQ UHTXLUHPHQWVQHJRWLDWLRQ

 6HUYLFHSURYLGHUFUHDWHVDQHZVHUYLFHGHVFULSWLRQIRU 1$12ZHEVHUYLFHPHWKRG  :6'/ ILOH GHSOR\V WKH VHUYLFH LQ D UXQWLPH HQYLURQPHQW WR PDNH LW DFFHVVLEOH WR RWKHU HQWLWLHV RYHUWKHQHWZRUN

D  $XWKHQWLFDWH GDWD FOLHQW 7KH VHUYLFH DJHQW ILUVW DXWKHQWLFDWHV D FOLHQW WR WKH UHTXHVWHG VHUYLFH JHQHUDWHV D

 6HUYLFH SURYLGHU SXEOLVKHV WKH VHUYLFH GHVFULSWLRQ LQWRRQHRUPRUH VHUYLFHVUHJLVWULHV

273

H[SHULPHQWDO GDWD VHW FRQWDLQV WZR PHGLFDO LPDJH PDPPRJUDPV  GDWD VHWV %,5$'6 DQG 0,$6  DQG WZR FOLQLFDO GDWD VHWV :LVFRQVLQ %UHDVW &DQFHU DQG ,ULV  7KH GHWDLOVRIWKH IRXUGDWDVHWVDUHGHVFULEHGEHORZ

 6HUYLFH SURYLGHU UHFHLYHV WKH LQYRNLQJ VHUYLFH PHVVDJHVIURPVHUYLFHUHTXHVWRUV & 6HUYLFH&RQVXPHU 7KHVHUYLFH FRQVXPHUKDV SHUIRUPV WKH IHDWXUH VHOHFWLRQ DQG GLVFUHWL]DWLRQ RSHUDWLRQ EDVHG RQ WKH SURSRVHG ZHE VHUYLFH EDVHG1$12DOJRULWKPGHSOR\HGLQWKHFORXG7KHZHEVHUYLFH SURYLGHVWKH1$12PHWKRGWRVWRUHWKHLQIRUPDWLRQLQVLGHWKH :6'/GRFXPHQWFRQWDFWVWKHZHEVHUYLFHDQGLVVXHVDVHUYLFH UHTXHVW1$12ZHEVHUYLFHKDVEHHQGHSOR\HGLQWRWKHFORXG RQFHWKHFOLHQWJHWVWKH:6'/ILOHDQGKHVKHLVVXHVDQ;0/ UHTXHVWWRSHUIRUPWKHIHDWXUHVHOHFWLRQDQGGLVFUHWL]DWLRQ7KH IROORZLQJ VWHSV DUH LQYROYHG WR FUHDWH D VHUYLFH FRQVXPHU GHWDLOVLQFORXG

  %,5$'6'DWDVHW 7KH GDWDVHW %,5$'6 FRQVLVWV RI  LPDJHV WDNHQ IURP PDPPRJUDPV FROOHFWHG IURP WKH %UHDVW ,PDJLQJ 5HSRUWLQJ DQG'DWD6\VWHP%,5$'6 RIWKH'HSDUWPHQWRI5DGLRORJ\ RI8QLYHUVLW\RIWKH9LHQQDDYDLODEOHDWKWWSZZZELUDGVDW (DFKLPDJHKDVDGLDJQRVLVFRPSRVHGRIWKUHHPDLQSDUWV

 7KHZHEVHUYLFH1$12PHWKRGVHDUFKLQJIRU:6'/ ILOHLQWKH8'',  2QFHWKHVHUYLFHDJHQWILQGWKH:6'/ILOHLVVXHVDQ ;0/ 62$3UHTXHVW WR WKH 1$12PHWKRG  )HDWXUH DWWULEXWHV VHQW DV DQ LQSXW WR WKH VHUYLFH SURYLGHU LH 1$12 PHWKRG GHSOR\HG LQ WKH FORXG VHUYHU  7KH 1$12 PHWKRG SHUIRUPV WKH IHDWXUH VHOHFWLRQ DQGGLVFUHWL]DWLRQSURFHVVLQWKH VHUYHU  )LQDOO\WKHSURSRVHG1$12PHWKRGVHOHFWVWKHPRVW UHOHYDQWIHDWXUHDWWULEXWHVLHGLVFUHWL]HGDWWULEXWHDV D;0/ 62$3 UHVSRQVHWRWKHFOLHQW

0RUSKRORJ\ 0DVV &LUFXPVFULEHG ,QGLVWLQFW 6SHFXODWHG  $UFK 'LVW $V\P'HQV &DOFLILFDWLRQV $PRUSK3OHRPRUSK/LQHDU%HQLJQ 

•

%,5$'66L[OHYHOV 

•

+LVWRORJ\ %HQLJQ /HVLRQV %UHDVW WLVVXH &\VW &DOFLILFDWLRQV 'XFWDO K\SHUSODVLD )LEURVLV )LEURDGHQRPD )DWW\ WLVVXH +DHPDWRPD +DUPDUWRPR /\PSKDQJLRPD /\PSKDWLF QRGH 0DVWLWLV 0DVWRSDWKLD 3DSLOORPD 6FOHURVLQJ DGHQRVLV DQG 6FDU  +LJKULVN /HVLRQV$W\SLFDO GXFWDO K\SHUSODVLD /REXODU FDUFLQRPD LQ VLWX 3K\OORGHVWXPRU DQG 5DGLDO VFDU  DQG 0DOLJQDQW /HVLRQV'XFWDO FDUFLQRPD LQ VLWX ,QYDVLYH GXFWDO FDQFHU,QYDVLYHOREXODUFDQFHU,QYDVLYHWXE&DQFHU DQG0XFFDQFHU 

7KH %,5$'6 FDWHJRUL]DWLRQ ZDV GHYHORSHG E\ WKH $PHULFDQ &ROOHJH RI 5DGLRORJ\ WR VWDQGDUGL]H PDPPRJUDP UHSRUWVDQGSURFHGXUHV

' 7KH1$12:HE6HUYLFH:6'/)LOH 7KH )LJXUH  VKRZ WKH :6'/ ILOH GHVFULEHV WKH LQSXW DQG RXWSXWSDUDPHWHUVFUHDWHGIRU1$12XVLQJWKLV:6'/ILOHWKH HQGXVHUDFFHVVHVRXUPHWKRG

7KHUHDUH%,5$'6LPDJHV%,5$'6LPDJHVDQG %,5$'6LPDJHVZKLFKDUHFRQVLGHUHGDEQRUPDO,QWKH IHDWXUH H[WUDFWLRQ VWHSV ZH WDNH  LPDJHV WR H[WUDFW ORZ OHYHO IHDWXUHV (DFK LPDJH FRQWDLQV  YLVXDO IHDWXUHV DV D FRQWLQXRXV DWWULEXWHV DUH H[WUDFWHG IURP %,5$'6 PDPPRJUDP LPDJHV DQG IHDWXUH H[WUDFWLRQ PHWKRGV LV GLVFXVVHGLQ QH[W VXE VHFWLRQ 7KH GDWDVHW LV GLYLGHG LQWR WZR VHWV WKH WUDLQLQJ VHW LV FRPSRVHG RI  LPDJHV  RI%, 5$'6 GDWDVHW  DQG WKH WHVW VHW LV FRPSRVHG RI  LPDJHV RI %,5$'6 GDWDVHW    0,$6 7KH 0,$6 GDWDVHWV FRQWDLQ  UHDO PDPPRJUDP LPDJHV ZKLFK EHORQJ WR WKUHH EURDG FDWHJRULHV QRUPDO EHQLJQ DQG PDOLJQDQW PDPPRJUDP FROOHFWHG IURP WKH 0DPPRJUDSKLF ,PDJH $QDO\VLV 6RFLHW\ 0,$6  DYDLODEOH DW KWWSZZZZLDXPDQDFXNVHUYLFHV0,$60,$6ZHEKWPO ,W FRQVLVWV RI  LPDJHV ZKLFK EHORQJ WR WKUHH ELJ FDWHJRULHV QRUPDOEHQLJQDQGPDOLJQDQW,QDGGLWLRQWKHDEQRUPDOFDVHV DUH IXUWKHU GLYLGHG LQ VL[ FDWHJRULHV PLFUR FDOFLILFDWLRQ FLUFXPVFULEHG PDVVHV VSHFXODWHG PDVVHV LOOGHILQHG PDVVHV DUFKLWHFWXUDO GLVWRUWLRQ DQG DV\PPHWU\ $OO WKH LPDJHV DOVR LQFOXGHWKHORFDWLRQVRIDQ\DEQRUPDOLWLHVWKDWPD\EHSUHVHQW 7KH H[LVWLQJ GDWD LQ WKH FROOHFWLRQ FRQVLVWV RI WKH ORFDWLRQ RI WKH DEQRUPDOLW\ OLNH WKH FHQWHU RI D FLUFOH VXUURXQGLQJ WKH WXPRU  LWVUDGLXV EUHDVWSRVLWLRQ ULJKW RUOHIW W\SH RI EUHDVW WLVVXHV IDWW\ IDWW\JODQGXODU DQG GHQVH  DQG WXPRU W\SH LI LW H[LVWV EHQLJQ RU PDOLJQ  $OO WKH PDPPRJUDPV DUH PHGLR ODWHUDOREOLTXHYLHZ7KHUHDUHEHQLJQLPDJHVPDOLJQDQW

)LJXUH :6'/ILOH

9

•

(;3(5,0(17$/5(68/76

$ 'DWD6HWV'HVFULSWLRQ ,QWKHH[SHULPHQWDOSDUWZHKDYHWDNHQIRXUUHSXWHGGDWDVHWV WRDQDO\]HWKHHIILFLHQF\RIWKHSURSRVHG1$12PHWKRG2XU

274

LPDJHV DQG  QRUPDO LPDJHV ZKLFK DUH FRQVLGHUHG DEQRUPDO,QWKHIHDWXUHH[WUDFWLRQVWHSVEHQLJQLPDJHVDQG  PDOLJQDQW LPDJHV DQG  QRUPDO LPDJHV WR H[WUDFW ORZ OHYHOIHDWXUHVLVWDNHQ(DFKLPDJHFRQWDLQVYLVXDOIHDWXUHV DV FRQWLQXRXV DWWULEXWH DUH H[WUDFWHG IURP  LPDJHV 7KH YLVXDO IHDWXUH H[WUDFWLRQ PHWKRG LV GLVFXVVHG LQ VHFWLRQ  7KH GDWD VHW LV VSOLW UDQGRPO\ LQWR WZR VHWV  RI WUDLQLQJ GDWDVHWDQGIRUWHVWGDWDVHW

VFKHPHVWKDW FDQ EH FRQVLGHUHG IRUDXWRPDWLFLGHQWLILFDWLRQRI 52, IURP WKH JLYHQ LPDJH EDVHG RQ WKH ORFDO SURSHUWLHV $ ORFDO SRLQW VSUHDG RSHUDWRULV D&DUWHVLDQFRRUGLQDWH VHSDUDEOH DQG GHEOXUULQJ IURP D VHW RI RUWKRJRQDO SRO\QRPLDOV ,Q WKLV SDSHU ZH SURSRVH WR XVH WKH 230 DQG /HYHO 6HW PHWKRGV WR LGHQWLI\ UHJLRQ RI LQWHUHVW 52,  IURP PDPPRJUDP LPDJH )URP WKH 52, LPDJH WKH SURSRVHG IHDWXUH H[WUDFWLRQ PHWKRG ILQGV WH[WXUH GHVFULSWRUV DUH WDNHQ E\ WKH JUD\ OHYHO FR RFFXUUHQFH PDWULFHV WR UHSUHVHQW WKH EUHDVW LPDJHV )URP WKH JUD\ OHYHO FRRFFXUUHQFH PDWULFHV  ORZ OHYHO IHDWXUHV FDQ EH FDOFXODWHG ZLWK 6WHS &RQWUDVW (QHUJ\ (QWURS\ +RPRJHQHLW\ 6NHZQHVV .XUWRVLV 6PRRWKQHVV DQG &RUUHODWLRQWRUHSUHVHQWWKHEUHDVWLPDJHVDUHGLVFXVVHGLQ>@ ± >@ 7KH PDLQ UHDVRQ WKLV IHDWXUH H[WUDFWLRQ PHWKRG LV LWV UHODWLYHO\ VLPSOLFLW\ DQG HIILFLHQF\ WR UHSUHVHQW WKH EUHDVW LPDJHV7KH H[WUDFWHG IHDWXUHV IURP WKH LPDJHV DUH RUJDQL]HG LQWR IHDWXUH YHFWRUV7KH IHDWXUH YHFWRUVDQGWKH FODVVODEHORI WKHWUDLQLQJLPDJHVDUHVXEPLWWHGWRWKHSURSRVHG1$12ZHE VHUYLFHEDVHGIHDWXUHVHOHFWLRQDQGGLVFUHWL]DWLRQDOJRULWKPKDV EHHQGLVFXVVHGLQ6HFWLRQDQG

  :LVFRQVLQ%UHDVW&DQFHU 7KH:LVFRQVLQ%UHDVWGDWDVHWFRQWDLQVVDPSOHVRIEUHDVW ILQHQHHGOHDVSLUDWHVKDYHGLIIHUHQWDWWULEXWHVSXEOLFO\DYDLODEOH LQ WKH 8&, UHSRVLWRU\ >@ 7KHUH DUH QLQH GLVFUHWH DWWULEXWHV &OXPS7KLFNQHVV8QLIRUPLW\RI&HOO6L]H8QLIRUPLW\RI&HOO 6KDSH 0DUJLQDO $GKHVLRQ 6LQJOH (SLWKHOLDO &HOO 6L]H %DUH 1XFOHL %ODQG &KURPDWLQ 1RUPDO 1XFOHROL DQG 0LWRVHV YDOXHGRQDVFDOHIURPWR7KHFODVVYDOXHLVHLWKHUEHQLJQ RUPDOLJQDQW7KHGDWDVHWLVVSOLWUDQGRPO\LQWRWZRVHWV SDWWHUQVIRUWUDLQLQJ DQGIRUWHVWLQJ   ,ULV 7KH ,ULV GDWDVHW FRQWDLQV  SDWWHUQV HDFK RI WKH FODVVHV ,ULV VHWRVD ,ULV YHUVLFRORU DQG ,ULV YLUJLQLFD (DFK SDWWHUQ LV GHVFULEHG XVLQJ IRXU QXPHULF DWWULEXWHV VHSDOOHQJWK VHSDO ZLGWKSHWDOOHQJWKDQGSHWDOZLGWKDUHSXEOLFO\DYDLODEOHLQWKH 8&, UHSRVLWRU\ >@ 7KH RULJLQDOO\ RGGQXPEHUHG GDWD DUH VHOHFWHG IRU WUDLQLQJ  SDWWHUQV  WKH UHVW IRU WHVWLQJ  SDWWHUQV 

& 1$12:HE6HUYLFH(YDOXDWLRQ 7KH SURSRVHG 1$12 ZHE VHUYLFHV UHGXFH WKH LQFRQVLVWHQW DQGLUUHOHYDQWIHDWXUHVDUHLQWKHWUDLQLQJGDWDDQGWKHUHVXOWVRI WKH UHGXFHG DWWULEXWHV LQ WKH GDWDVHWV DUH VKRZQ 7DEOH,,7KH PDMRU DGYDQWDJHV RI 1$12 ZHE VHUYLFH DUHKLJK SURFHVVLQJ VSHHG LH WKH KLJK GLPHQVLRQDO GDWD DUH KDQGOHG LQ WKH FORXG VHUYHU DQG UDGLRORJ\ SK\VLFLDQ DQG UHVHDUFKHUV PD\ XWLOL]H DQ\ZKHUHLQWKHZRUOGWKURXJK:6'/ILOH

% $XWRPDWLF)HDWXUH([WUDFWLRQ :KHQ GHDOLQJ ZLWKPHGLFDOLPDJHVLQWKH ZHE EDVHG IHDWXUH VHOHFWLRQDQGGLVFUHWL]DWLRQWKHHDUOLHVWVWDJHRIDFODVVLILFDWLRQ V\VWHP GHPDQGV WKH H[WUDFWLRQ RI WKH PDLQ LPDJH IHDWXUHV UHJDUGLQJDVSHFLILFFULWHULRQ7KHPRVWUHSUHVHQWDWLYHIHDWXUHV YDU\DFFRUGLQJWRWKHLPDJHW\SHHJPDPPRJUDPEUDLQDQG OXQJ  DQG DFFRUGLQJ WR WKH IRFXV RI WKH DQDO\VLV HJ WR GLVWLQJXLVK QRGXOHV DQG WR LGHQWLI\ EUDLQ ZKLWH PDWWHU  )RU LQVWDQFHZKHQZRUNLQJZLWKPDPPRJUDPVKLVWRJUDPIHDWXUHV JLYH D YHU\ SRRU LGHQWLILFDWLRQ RI EUHDVW OHVLRQV +RZHYHU IHDWXUHV RI VKDSH FDQ ZRUN ZHOO WR GLVWLQJXLVK PDOLJQDQW DQG EHQLJQ EUHDVW OHVLRQV 1HYHUWKHOHVV PRVW VKDSH IHDWXUHV GHPDQG D SUHYLRXV VWHS RI OHVLRQ VHJPHQWDWLRQ DQG WKLV VWHS LQFUHDVHVWKHFRPSXWDWLRQDOHIIRUWWRDJUHDWH[WHQW

7$%/(,

&+$1*(,1 1 80%(52)$775,%87(6:,7+ 1$12 :(% 6(59,&(0(7+2'

2ULJLQDO $WWULEXWHV 5HGXFHG $WWULEXWHV

%,5$'6

0,$6

:LVFRQVLQ

,ULVK

















,QWKLVDFFXUDF\PHDVXUHZHUXQ&>@LVUXQRQERWKWKH UHDO GDWD VHWV DQG WKH GLVFUHWL]HG RQHV & LV UXQ XVLQJ LWV GHIDXOW VHWWLQJ 7KH SURSRVHG 1$12 GLVFUHWL]HV WKH WUDLQLQJ GDWD DQG SURGXFHV D UHFRUG WDEOH EDVHG RQ ZKLFK WKH WHVWLQJ GDWDDUHGLVFUHWL]HG

7KHSURSRVHGPHWKRGFDQEHHPSOR\HGZLWKYDULRXVW\SHVRI PHGLFDO LPDJHV IHDWXUHV DQG ZLWK GLIIHUHQW IRFL RI DQDO\VLV +RZHYHU IRU HDFK W\SH RI LPDJH DQG JRDO DQ DSSURSULDWH IHDWXUH H[WUDFWRU VKRXOG EH HPSOR\HG $ PDPPRJUDP VKRZV WKH GLIIHUHQFHV EHWZHHQ WLVVXH GHQVLW\ DQG VXFK GLIIHUHQFHV DUHWKHNH\IRUDPDPPRJUDPDQDO\VLV*ODQGXODUDQGILEURXV WLVVXHV DUH GHQVHU DQG DSSHDU DV EULJKWHU UHJLRQV LQ D PDPPRJUDP

6KRZQLQ7DEOH,,,DUHSUHGLFWLYHDFFXUDFLHVDQGWUHHVL]HVRI & IRU WKH IRXU GDWD VHWV ,W LV HYLGHQW IURP 7DEOH ,,, WKDW SUHGLFWLYHDFFXUDF\LPSURYHGDQGWUHHVL]HGURSVIRUWKHEUHDVW FDQFHUGDWD$VIRUWKH,ULVGDWDDFFXUDF\DQGWUHHVL]HUHPDLQ WKHVDPHZLWKWZRDWWULEXWHVRQO\ZLWKIRXUYDOXHVHDFK  7$%/(,,

$Q 2UWKRJRQDO 3RO\QRPLDOV 0RGHO 230  >@ >@ DQG /HYHO 6HW >@ >@ EDVHG PHWKRGV WR VXSSRUWV DXWRPDWLF IHDWXUH H[WUDFWLRQ ZLWK OHVVHU FRPSXWDWLRQDO FRPSOH[LW\ DQG UHGXFHG PHPRU\ UHTXLUHPHQW 7KH JHQHUDWLQJ IRUPXOD IRU WKH SURSRVHGSRO\QRPLDOVEDVHGWUDQVIRUPDWLRQLVZHOOHVWDEOLVKHG LQLPDJHDQGRWKHULPDJHSURFHVVLQJWHFKQLTXHV7KHSURSRVHG PHWKRG IRU DQ LPDJH HGJH GHWHFWLRQ DQG LQWHJHU FRGLQJ

2ULJLQDO $WWULEXWHV 5HGXFHG $WWULEXWHV

275

&+$1*(,135(',&7,9($&&85$&@ $ / %OXP DQG 3 /DQJOH\ ³6HOHFWLRQ RI 5HOHYDQW )HDWXUHV DQG ([DPSOHV 0DFKLQH /HDUQLQJ´ $UWLILFLDO ,QWHOO YRO  SS ±  >@ 8 0 )D\\DG DQG . % ,UDQL ³7KH $WWULEXWH 6HOHFWLRQ 3UREOHP LQ 'HFLVLRQ 7UHH *HQHUDWLRQ´ LQ 3URF $$$, 1LQWK ,QW¶O &RQI $UWLILFLDO,QWHOOLJHQFHSS±$$$,3UHVV7KH0,73UHVV >@ + /LX DQG 5 6HWLRQR ³)HDWXUH VHOHFWLRQ YLD GLVFUHWL]DWLRQ´ ,((( 7UDQVDFWLRQV RQ .QRZOHGJH DQG 'DWD (QJLQHHULQJ YRO  QR  SS ± >@ +/LXDQG56HWLRQR³$3UREDELOLVWLF $SSURDFKWR )HDWXUH 6HOHFWLRQ $)LOWHU6ROXWLRQ´LQ3URFWK,QW¶O&RQI0DFKLQH/HDUQLQJSS±   >@ - &DWOHWW ³2Q &KDQJLQJ &RQWLQXRXV $WWULEXWHV LQWR 2UGHUHG 'LVFUHWH $WWULEXWHV´ LQ 3URF RI WKH (XURSHDQ ZRUNLQJ 6HVVLRQ RQ /HDUQLQJ YROSS ±  >@ 5 .HUEHU ³&KL0HUJH 'LVFUHWL]DWLRQ RI 1XPHULF $WWULEXWHV´ LQ 3URF $$$, 1LQWK ,QW¶O &RQI $UWLILFLDO ,QWHOO $$$, 3UHVV7KH 0,7 3UHVVSS±  >@ ..LUDDQG/$5HQGHOO³7KH)HDWXUH6HOHFWLRQ3UREOHP7UDGLWLRQDO 0HWKRGV DQG D 1HZ $OJRULWKP´ LQ 3URF $$$, 1LQWK ,QW¶O &RQI $UWLILFLDO,QWHOO$$$,3UHVV7KH0,73UHVVSS±  >@ 0 'DVK . &KRL 3 6FKHXHUPDQQDQG+ /LX³)HDWXUH6HOHFWLRQ IRU &OXVWHULQJD )LOWHU 6ROXWLRQ´ LQ 3URF RI 6HFRQG ,QW¶O &RQI 'DWD 0LQLQJSS± >@ @ 6)GD6LOYD0;5LEHLUR-GR(6%DWLVWD1HWR&7UDLQD-U$- 07UDLQD³,PSURYLQJWKH5DQNLQJ4XDOLW\RI0HGLFDO,PDJH5HWULHYDO 8VLQJD*HQHWLF)HDWXUH6HOHFWLRQ0HWKRG´ 'HFLVLRQ6XSSRUW6\VWHPV YROSS ±  >@ -6HQWKLONXPDU'0DQMXODDQG5 .ULVKQDPRRUWK\³1$12 $1HZ 6XSHUYLVHG $OJRULWKP IRU )HDWXUH 6HOHFWLRQ ZLWK 'LVFUHWL]DWLRQ´ ,((( ,QW¶O$GYDQFH&RPSXWLQJ&RQI,$&& 3DWLDOD,QGLDSS±  >@ 0'DVKDQG+/LX³)HDWXUH6HOHFWLRQIRU&ODVVLILFDWLRQ´,QWHOO'DWD $QDO\VLVYRO SS± >@ 0 ; 5LEHLUR $ - 0 7UDLQD & 7UDLQD -U DQG 3 0 $]HYHGR 0DUTXHV ³$Q $VVRFLDWLRQ 5XOH%DVHG 0HWKRG WR 6XSSRUW 0HGLFDO

>@ >@

>@

>@ >@ >@ >@ >@

>@ >@ >@

>@ >@

276

,PDJH'LDJQRVLV :LWK(IILFLHQF\´,(((7UDQVDFWLRQVRQ 0XOWLPHGLD YROQRSS± 0;5LEHLUR$-07UDLQD&7UDLQD-U1$5RVDDQG30$ 0DUTXHV ³+RZ 7R ,PSURYH 0HGLFDO ,PDJH 'LDJQRVLV WKURXJK $VVRFLDWLRQ 5XOHV 7KH ,'($ 0HWKRG´ LQ 3URF RI WKH VW ,((( 6\PSRVLXPRQ&RPSXWHU%DVHG0HGLFDO6\VWHPV&%06  SS±   0 / $QWRQLH 2 5 =DLDQH DQG $ &RPDQ ³$SSOLFDWLRQ RI  'DWD 0LQLQJ 7HFKQLTXHV IRU 0HGLFDO ,PDJH &ODVVLILFDWLRQ´ LQ 3URF RI WKH 6HFRQG ,QW¶O :RUNVKRS RQ 0XOWLPHGLD 'DWD 0LQLQJ 0'0.'' C LQFRQMXQFWLRQZLWK6HYHQWK$&06,*.''SS± +/LXDQG+0RWRGD)HDWXUH6HOHFWLRQIRU.QRZOHGJH'LVFRYHU\DQG 'DWD0LQLQJ1RUZHOO0$.OXZHU 3 0 1DUHQGUD DQG . )XNXQDJD ³$ EUDQFK DQG ERXQG DOJRULWKP IRU IHDWXUH VHOHFWLRQ´ ,((( 7UDQVDFWLRQV RQ &RPSXW YRO  QR  SS± , )RURXWDQ DQG - 6NODQVN\ ³)HDWXUH VHOHFWLRQ IRU DXWRPDWLF FODVVLILFDWLRQ RI QRQJDXVVLDQ GDWD´ ,((( 7UDQVDFWLRQV RI 6\VWHPV 0DQDQG&\EHUQDWLFVYROQR SS± & &DUGLH ³8VLQJ GHFLVLRQ WUHHV WR LPSURYH FDVHEDVHG OHDUQLQJ´ ,Q 3URF RI 7HQWK ,QWHUQDWLRQDO &RQIHUHQFH RQ 0DFKLQH /HDUQLQJ SS   - 6KHLQYDOG % 'RP DQG : 1LEODFN ³$ PRGHOOLQJ DSSURDFK WR IHDWXUH VHOHFWLRQ´ ,Q 3URF RI 7HQWK ,QW¶O &RQIHUHQFH RQ 3DWWHUQ 5HFRJQLWLRQSS± $10XFFLDUGLDQG((*RVH³$FRPSDULVRQRIVHYHQWHFKQLTXHVIRU FKRRVLQJ VXEVHWV RI SDWWHUQ UHFRJQLWLRQ SURSHUWLHV´ ,((( 7UDQVDFWLRQV RQ &RPSXWYRO QR  SS ± ' 3 GHO 5H\ - &UHVSR $ $QJXLWD  - / 3 2UGyxH] - 'RUDGR * %XHQR 9 )HOL~ $ (VWUXFK DQG - $ +HUHGLD ³%LRPHGLFDO ,PDJH 3URFHVVLQJ ,QWHJUDWLRQ 7KURXJK ,1%,20(' $ :HE 6HUYLFHV%DVHG 3ODWIRUP´ LQ 3URF WK ,QW &RQI RQ %LRORJLFDO DQG 0HGLFDO 'DWD $QDO\VLVYRO SS±  0 3 0LUL+ 3RRVKIDP 05DMHVZDUL'5DPDFKDQGUDP³$:HE± %DVHG )UDPHZRUN IRU 'LVWULEXWHG 0HGLFDO ,PDJH 3URFHVVLQJ 8VLQJ ,PDJH 0DUNXS /DQJXDJH,0/ ¶¶ LQ 3URF 7KLUG 8.6LP (XURSHDQ 6\PSRVLXPRQ&RPSXW0RGHOLQJDQG6LPXODWLRQSS± 6 $OL DQG 6 .LHIHU ³6HPDQWLF &RRUGLQDWLRQ RI $PELHQW ,QWHOOLJHQW 0HGLFDO'HYLFHV $&DVH6WXG\´'LJLWDO2EMHFW,GHQWLILHU $ $VXQFLRQ DQG ' 1HZPDQ 8&, UHSRVLWRU\ $YDLODEOH DW KWWSZZZLFVXFLHGXPOHDUQPOUHSRVLWRU\KWPO  5 .ULVKQDPRRUWK\ DQG 1 .DQQDQ ³$ QHZ LQWHJHU LPDJH FRGLQJ WHFKQLTXH EDVHG RQ RUWKRJRQDO  SRO\QRPLDOV´ ,PDJH DQG 9LVLRQ &RPSXWLQJYROQRSS± 5 .ULVKQDPRRUWK\ ³$ XQLILHG IUDPHZRUN RUWKRJRQDO SRO\QRPLDOV IRU (GJH GHWHFWLRQ 7H[WXUH $QDO\VLV DQG &RPSUHVVLRQ LQFRORU LPDJHV´ 3K'7KHVLV,,7.KDUDJSXU  & /LX ) 'RQJ 6 =KX ' .RQJ DQG . /LX $ 1HZ 9DULDWLRQDO )RUPXODWLRQV IRU /HYHO 6HW (YROXWLRQ :LWKRXW 5HLQLWLDOL]DWLRQ ZLWK $SSOLFDWWR,PDJH6HJPHQWDWLRQ -0DWK,PDJLQJ9LVYRO SS±