Self-Organizing Data Mining For A Portfolio Trading System



6HOI2UJDQL]LQJ'DWD0LQLQJ)RU$3RUWIROLR7UDGLQJ6\VWHP )UDQN/HPNHDQG-RKDQQ$GROI0XHOOHU 7KLVSDSHUGHVFULEHVWKHDSSOLFDWLRQRIGDWDPLQLQJDOJRULWKPVIRUDSRUWIROLRWUDGLQJV\VWHP7KHJRDORIGDWD PLQLQJLQWKLVFDVHLVWKHSUHGLFWLRQRIDVVHWVRIDSRUWIROLRE\PHDQVRISDUDPHWULFRUQRQSDUDPHWULFPRGHOV 3DUDPHWULFPRGHOVDUHDGDSWLYHO\FUHDWHGIURPGDWDE\WKH*URXS0HWKRGRI'DWD+DQGOLQJ*0'+ LQWKH IRUPRIQHWZRUNVRIRSWLPL]HGWUDQVIHUIXQFWLRQV1RQSDUDPHWULFPRGHOVDUHVHOHFWHGIURPDJLYHQYDULDEOH VHWE\DQDORJXHVFRPSOH[LQJUHSUHVHQWLQJRQHRUPRUHSDWWHUQVRIDWUDMHFWRU\RISDVWEHKDYLRXUZKLFKDUH DQDORJRXVWRDFKRVHQUHIHUHQFHSDWWHUQ$SSURDFKHVWRVHOIRUJDQL]LQJPRGHOOLQJLQFOXGHQRWRQO\FRUHGDWD PLQLQJ DOJRULWKPV EXW DOVR DQ LWHUDWLYH SURFHVV RI JHQHUDWLQJ DOWHUQDWLYH PRGHOV ZLWK JURZLQJ FRPSOH[LW\ DORQJZLWKWKHLUHYDOXDWLRQDQGYDOLGDWLRQDQGWKHVHOHFWLRQRIDPRGHOZLWKRSWLPDOFRPSOH[LW\,QWKLVSDSHU WKHVHDSSURDFKHVDUHGHQRWHGDVVHOIRUJDQL]LQJGDWDPLQLQJ ,QDPRGHOOLQJSUHGLFWLRQPRGXOHVHOIRUJDQL]LQJGDWDPLQLQJLVSHUIRUPHGIRUWKHSXUSRVHRIH[WUDFWLQJ DQGV\QWKHVLVLQJKLGGHQNQRZOHGJHIURPGDWDV\VWHPDWLFDOO\DQGTXLFNO\7KHFRQWUROPRGXOHRIWKHWUDGLQJ V\VWHP LV UHVSRQVLEOH IRU VLJQDO JHQHUDWLRQ EDVHG RQ SUHGLFWLRQV SURYLGHG E\WKHPRGHOOLQJPRGXOH,QLWLDO SHUIRUPDQFHUHVXOWVRIDWUDGLQJV\VWHPDUHSUHVHQWHG7KHWUDGLQJV\VWHPVLPXODWHVWUDGLQJDSRUWIROLRRI GLYHUVHVWRFNVXVLQJGDLO\RXWRIVDPSOHSULFHGDWD

,1752'8&7,21'$7$0,1,1*$1' 6(/) 25*$1,=,1*02'(//,1*

'HFLVLRQPDNLQJLQILQDQFHVXFKDVWUDGLQJDSRUWIROLRRIGLYHUVH DVVHWV UHTXLUHV VXIILFLHQW SUREOHP GHILQLWLRQ DQG PRWLYDWLRQ ,QIRUPDWLRQ WHFKQRORJ\ GHOLYHUV D IORRG RI GDWD WR GHFLVLRQ PDNHUV UHVXOWLQJ LQ TXHVWLRQV RQ KRZ WR OHYHUDJH WKHP 'DWD PLQLQJ WHFKQLTXHV DQG WRROV FDQ DVVLVW KXPDQV LQ DQDO\VLQJ WKH PRXQWDLQVRIGDWDDQGWRWXUQLQIRUPDWLRQORFDWHGLQWKHGDWDLQWR VXFFHVVIXO GHFLVLRQ PDNLQJ 'DWD PLQLQJ LV DQ LQWHUDFWLYH DQG LWHUDWLYHSURFHVVRIQXPHURXVVXEWDVNVDQGGHFLVLRQVVXFKDVGDWD VHOHFWLRQ DQG SUHSURFHVVLQJ WKH DSSOLFDWLRQ RI GDWD PLQLQJ DOJRULWKPVDQGDQDO\VLVRIWKHH[WUDFWHGNQRZOHGJH )RUVRSKLVWLFDWHGGDWDPLQLQJDSSOLFDWLRQVLWLVLPSRUWDQWWR WU\ WR OLPLW WKH LQYROYHPHQW RI XVHUV LQ WKH RYHUDOO GDWD PLQLQJ SURFHVV WR WKH LQFOXVLRQ RI H[LVWLQJ D SULRUL NQRZOHGJH ZKLOH PDNLQJ WKLVSURFHVVPRUHDXWRPDWHGDQGREMHFWLYH7KHSULPDU\ LQWHUHVW RI PRVW XVHUV RIGDWDPLQLQJ DSSOLFDWLRQV WKDWLVWKRVH ZKR PD\ ODFN VXIILFLHQW NQRZOHGJHRIPDWKHPDWLFDO F\EHUQHWLF DQG VWDWLVWLFDO WHFKQLTXHV RU VXIILFLHQW WLPH IRU GLDORJ GULYHQ PRGHOOLQJ WRROV  DUH UHVXOWV 6HOIRUJDQL]LQJ PRGHOOLQJ LV EDVHG RQ WKHVH GHPDQGV DQG LV D SRZHUIXO ZD\ WR JHQHUDWH PRGHOV RI LOOGHILQHG SUREOHPV )LJXUH  LOOXVWUDWHV D VSHFWUXP RI VHOI RUJDQL]LQJPRGHOOLQJ7KHJRDORIVHOIRUJDQL]LQJ

PRGHOOLQJLVWRSHUIRUPGDWDPLQLQJE\JHQHUDWLQJPDWKHPDWLFDO PRGHOV IURP HPSLULFDO GDWD PRUH RU OHVV DXWRPDWLFDOO\ 6XFK SURFHVVLQJ LV GHQRWHG LQ WKLV SDSHU DV VHOIRUJDQL]LQJ GDWD PLQLQJ$VVRFLDWHGPDWKHPDWLFDOPRGHOVLQFOXGHWKHIROORZLQJ

-RXUQDORI&RPSXWDWLRQDO,QWHOOLJHQFHLQ)LQDQFH

0D\-XQHSS

 UHJUHVVLRQIXQFWLRQV &RPPRQO\ VWDWLVWLFDOO\EDVHG SULQFLSOHV DUH XVHG WR VHOHFW SDUDPHWULF PRGHOV ,Q DGGLWLRQ WR VRSKLVWLFDWHG PHWKRGV RI PDWKHPDWLFDO VWDWLVWLFV WKHUH KDV EHHQ PXFK SXEOLFLW\ UHJDUGLQJ WKHDELOLW\RIDUWLILFLDOQHXUDOQHWZRUNVWROHDUQDQGWRJHQHUDOL]H $ VHFRQG UHJUHVVLRQEDVHG PHWKRG IRU PRGHO VHOI RUJDQL]DWLRQ LV WKH *URXS 0HWKRG RI 'DWD +DQGOLQJ *0'+  8VLQJ WKH *0'+ DOJRULWKP SDUDPHWULF PRGHOV VXFK DV WLPH VHULHVPRGHOVLQWKHIRUPRIPXOWLLQSXWVLQJOHRXWSXWDQGPXOWL LQSXWPXOWLRXWSXW V\VWHPV WKDW LV V\VWHPV RI HTXDWLRQV  DUH DGDSWLYHO\FUHDWHGIURPGDWDLQWKHIRUPRIQHWZRUNVRIRSWLPL]HG WUDQVIHU IXQFWLRQV $FWLYH 1HXURQV  ,Q FRQWUDVW WR QHXUDO QHWZRUNVWKH*0'+DOJRULWKPZRUNVRQDQLPSRUWDQWDGGLWLRQDO SULQFLSOH WKDW RI LQGXFWLRQ ,Q WKLV FDVH WUHHOLNH QHWZRUN LV JURZQIURP VHHGLQIRUPDWLRQLQSXWDQGRXWSXWYDULDEOHV IURPD VLPSOHVLQJOHLQGLYLGXDOQHXURQ LQDQHYROXWLRQDU\IDVKLRQXVLQJ SDLUZLVH FRPELQDWLRQ DQG VXUYLYDORIWKHILWWHVW VHOHFWLRQ WR D GHVLUHGILQDOQRWRYHUVSHFLDOLVHGEHKDYLRXUPRGHO 1HLWKHUWKH QXPEHU RI QHXURQV DQG OD\HUV LQ WKH QHWZRUN QRU WKH DFWXDO EHKDYLRXU RI HDFK FUHDWHG QHXURQ WUDQVIHU IXQFWLRQ  DUH SUHGHILQHG,QVWHDGWKHVHDUHDGMXVWHGGXULQJWKHSURFHVVRIVHOI RUJDQL]DWLRQ UXOHEDVHGPRGHOVLQWKHIRUPRIELQDU\RUIX]]\ORJLF 5XOHLQGXFWLRQIURPGDWDXVHVJHQHWLFDOJRULWKPVZKHUHWKH UHSUHVHQWDWLRQRIPRGHOVLVLQWKHIDPLOLDUGLVMXQFWLYHQRUPDOIRUP DVGLVFXVVHGLQ*RRQDWLODNH>@$VHOIRUJDQL]LQJIX]]\ PRGHOXVLQJWKH*0'+DOJRULWKPPD\EHPRUHXVHIXOIRULOO GHILQHGILQDQFLDODSSOLFDWLRQVHJWKHJHQHUDWLRQRIIX]]\WUDGLQJ VLJQDOVIURPDJLYHQSRUWIROLRRIGDWD FRPSOH[VWUXFWXUHGSURFHVVPRGHOV 6HOIRUJDQL]LQJVWUXFWXUHGPRGHOOLQJXVHVDV\PEROLFJHQHUDWLRQ RIDSSURSULDWHPRGHOVWUXFWXUHDOJHEUDLFIRUPXODRUFRPSOH[ SURFHVVPRGHO DQGWKHRSWLPL]DWLRQRULGHQWLILFDWLRQRIDUHODWHG VHWRISDUDPHWHUVE\PHDQVRIJHQHWLFDOJRULWKPV7KLVDSSURDFK DVVXPHVWKDWWKHHOHPHQWDU\FRPSRQHQWVDUHSUHGHILQHGDQG VXLWDEOHIRUJHQHWLFFRGLQJ

 QRQSDUDPHWULF PRGHOV SDWWHUQV  1RQSDUDPHWULF PRGHOV DUH VHOHFWHG IURP D JLYHQ YDULDEOH VHW E\ DQDORJXHV FRPSOH[LQJ UHSUHVHQWLQJRQHRUPRUHSDWWHUQVRIDWUDMHFWRU\RISDVWEHKDYLRXU ZKLFK DUH DQDORJRXV WR D FKRVHQ UHIHUHQFH SDWWHUQ $QDORJXH FRPSOH[LQJ LV EDVHG RQ WKH DVVXPSWLRQ WKDW W\SLFDO VLWXDWLRQV EHKDYLRXUV H[LVWLHHDFKSHULRGRIVWDWHHYROXWLRQIRU DJLYHQ PXOWLGLPHQVLRQDO WLPH SURFHVV PD\ KDYH RQH RU PRUH DQDORJXHV LQKLVWRU\,IWKLVDVVXPSWLRQLVFRUUHFWLWLVOLNHO\WKDWDSUHGLFWLRQ FRXOGEHREWDLQHGE\WUDQVIRUPLQJWKHNQRZQFRQWLQXDWLRQVRIWKH KLVWRULFDO DQDORJXHV ,W LV HVVHQWLDO WKDW WKH VHDUFK IRU DQDORJRXV SDWWHUQVLVQRWUHVWULFWHGWRDVLQJOHVWDWHYDULDEOHWLPHVHULHV EXW LQFOXGHV D VHW RI UHSUHVHQWDWLYH YDULDEOHV VLPXOWDQHRXVO\ DQG REMHFWLYHO\,Q

),*85(3UHGLFWLYHFRQWURORIDSRUWIROLR

IDFWDQDORJXHFRPSOH[LQJDSSOLHGWRILQDQFLDODSSOLFDWLRQVFRXOG EH FRQVLGHUHG DV D NLQG RI PXOWLGLPHQVLRQDO DXWRPDWHG DQG REMHFWLYHFKDUWDQDO\VLV 7KLV SDSHU GHVFULEHV WKH V\QWKHVLV RI SDUDPHWULF PRGHOV DGDSWLYHO\ FUHDWHG XVLQJ *0'+   DQG QRQSDUDPHWULF PRGHOV VHOHFWHG IURP D JLYHQ YDULDEOH VHW XVLQJ DQDORJXH FRPSOH[LQJ DVSDUWRIDGDWDPLQLQJDSSURDFKIRUILQDQFLDO DSSOLFDWLRQV 6(/)25*$1,=,1*'$7$0,1,1*)25$ 3257)2/,275$',1*6@ 7KH *0'+ DOJRULWKP XWLOL]HG KHUH JHQHUDWHV DQRSWLPL]HGWUDQVIHUIXQFWLRQDQGVWUXFWXUHIRUHDFKQHXURQ7KLV UHVXOWV LQ D V\QWKHVL]HG QHWZRUN WKDW LV FRPSRVHG RI GLIIHUHQW QRQSUHGHILQHG QHXURQV DQG WKHLU FRUUHVSRQGLQJ WUDQVIHU IXQFWLRQV VHOHFWHG IURP DOO SRVVLEOH OLQHDU RU QRQOLQHDU SRO\QRPLDOVGHVFULEHGDV

I  [L  [ M

D   D [L  D  [ M  D  [L [ M  D  [L  D  [ M

7KHDOJRULWKPHQVXUHVWKDWHVVHQWLDOLQGHSHQGHQWYDULDEOHV

ZLOOEHVHOHFWHGDQGWKDWGHVFULSWLRQVRIRSWLPDOWUDQVIHUIXQFWLRQV ZLOOEHREWDLQHG:HQRWHWKDWHYHQWKRXJKQRQOLQHDUPRGHOVDUH SHUPLVVLEOHDOLQHDUPRGHOPD\EHVHOHFWHGDVRSWLPDO *0'+ REMHFWLYHO\ VHOHFWV WKH PRGHO RI RSWLPDO FRPSOH[LW\ XVLQJ DQ LQGXFWLYH DSSURDFK 7KLV LQFOXGHV WKH XVH RI WKH FURVV YDOLGDWLRQ PHWKRGV DV DQ DOWHUQDWLYH WR H[SOLFLW GDWD VXEGLYLVLRQ )LJXUHLOOXVWUDWHVWKHFUHDWLRQRIDPRGHORIRSWLPDOFRPSOH[LW\ XVLQJ D PXOWLOD\HUHG *0'+ DOJRULWKP $GGLWLRQDOO\ WKLV LQGXFWLYHDSSURDFKHQDEOHV*0'+WRRYHUFRPHVRPHRIWKHPRVW LPSRUWDQW SUREOHPV FRPPRQO\ FRQQHFWHG ZLWK WKH GHVLJQ GHYHORSPHQW DQG DSSOLFDWLRQ RI QHXUDO QHWZRUNV )RU WUDGLQJ V\VWHPVWKHVHDUH x

x

x

x

0RGHOV REWDLQHG E\ PRVW QHXUDO QHWZRUNV DUH PRGHOV ZLWK LQIRUPDWLRQLPSOLFLWO\GLVWULEXWHGRYHUWKHQHWZRUNHJWKH LQWHUQDOO\FRQQHFWLYH UHSUHVHQWDWLRQ RI NQRZOHGJH  7KLV PHDQVWKDWWKHNQRZOHGJHZKLFKUHVLGHVLQVXFKQHWZRUNVLV LQKHUHQWO\ KLGGHQ 7KXV WKH\ FDQQRW EH XVHG IRU GDWD DQDO\VLV LQWHUSUHWDWLRQ YDOLGDWLRQ RU H[SODQDWLRQ WDVNV XQOHVVRQHXVHVGHGLFDWHGNQRZOHGJHH[WUDFWLRQWRROV :LWKQHXUDOQHWZRUNVGHYHORSHUVHVWLPDWHWKHVWUXFWXUHRID QHWZRUNE\FKRRVLQJWKHQXPEHURIOD\HUVLQWKHQHWZRUNDV ZHOO DV WKH QXPEHU RI QRGHV DQG WKH W\SHV RI WUDQVIHU IXQFWLRQV 7KLV UHTXLUHV VRPH NQRZOHGJH RI WKH WKHRU\ RI QHXUDOQHWZRUNVDQGH[SHULHQFHLQGHYHORSLQJQHWZRUNV7KH LQWHUQDO UHSUHVHQWDWLRQ RI NQRZOHGJH GRHV QRW VXSSRUW WKLV WULDODQGHUURUSURFHVV 1HXUDO QHWZRUNV DUH D NLQG RI VWDWLVWLFDO HVWLPDWLRQ ZKLFK DUHVRPHWLPHVLPSOHPHQWHGXVLQJDOJRULWKPVWKDWDUHVORZHU DQG OHVV HIIHFWLYH WKDQ DOJRULWKPV SURYLGHG ZLWK VWDWLVWLFDO VRIWZDUH ,I QRLVH LV FRQVLGHUDEOH RYHU D VKRUW GDWD VDPSOH WKHVH PRGHOV PD\ EHFRPH RYHUILWWHG PXOWLYDULDWH UHJUHVVLRQ IXQFWLRQV +RZHYHU JLYHQ FRPPRQO\HPSOR\HG VWUDWHJLHV IRU DYRLGLQJ RYHUILWWLQJ VXFK DV YDOLGDWLRQ XVLQJ RXWRI VDPSOH GDWDVHWV  WKLV PD\ QRW EH D SUREOHP 6WLOO VXFK VWUDWHJLHV GR QRW QHFHVVDULO\ OHDG WR DQ RSWLPDOO\ FRPSOH[ PRGHO

$VDQH[DPSOHZHZLOOGHVFULEHWKHSURFHVVIRUSUHGLFWLQJ%0: VWRFNSULFHVRYHURQHF\FOHXVLQJ*0'+PRGHOOLQJDQGDQDORJXH FRPSOH[LQJ $V D UHVXOW RI WKH GDWD VHOHFWLRQ SURFHVV  GDLO\ FORVLQJ SULFHV IRU  YDULDEOHV IURP WKH *HUPDQ VWRFN PDUNHW ZHUH FKRVHQ 7KHVH LQFOXGH WKH GROODU H[FKDQJH UDWH WKH VWRFN SULFHV IRU %0: 9: $8', )RUG DQG 3RUVFKH WKH IROORZLQJ VWRFN LQGH[HV '$; )$= DQG WKH IROORZLQJ ILQDQFLDO FKDUDFWHULVWLFV WKH 'LVFRQW DQG /RPEDUG UDWHV 3ULFHV IRU DOO RI WKHVHFRYHUHGWKHSHULRGRI$XJXVWWKURXJK'HFHPEHU  )URP WKH DERYHGDWD REVHUYDWLRQV FRYHULQJ WKH SHULRGRI $XJXVWWKURXJK1RYHPEHUZHUHXVHGWRJHQHUDWH PRGHOVIRUSUHGLFWLQJYDULDEOHVRYHUWKH

 ,, DIWHUFUHDWLRQRIDOOPRGHOVRIWKH VWOD\HU

, EHIRUHPRGHOOLQJ

  YHFWRURIPHDVXUHGRUV\QWKHVL]HGGDWD I  + DOJRULWKP IRU FUHDWLRQ RI RSWLPL]HG WUDQVIHU IXQFWLRQV DQG RI D QHWZRUNIXQFWLRQ ZLWKLQFUHDVLQJFRPSOLFDWHGQHVV ,,, DIWHUVHOHFWLRQRIDQXPEHURIEHVWPRGHOV

v VHOHFWHGQHXURQ

‘ QRWVHOHFWHGQHXURQ 9 DIWHUVHOHFWLRQRIDQXPEHURIEHVWPRGHOV

‘ FUHDWHGQHXURQZLWKDQRSWLPL]HGWUDQVIHUIXQFWLRQ \N INYLYM $FWLYH1HXURQ RUGHURIUHJUHVVLRQPRGHO \N”QXPEHURIYDULDEOHVYLQPRGHO\ N”

,9 DIWHUFUHDWLRQRIDOOPRGHOVRIWKHQGOD\HU

‡VHOHFWHGQHXURQRIOD\HUZLWKXQFKDQJHGWUDQVIHUIXQFWLRQ ‘ FUHDWHGQHXURQZLWKDQRSWLPL]HGWUDQVIHUIXQFWLRQ \N INYLYM $FWLYH1HXURQ RUGHURIUHJUHVVLRQPRGHO \N”QXPEHURIYDULDEOHVYLQPRGHO\ N” 9, DIWHUVHOILQGXFWHGVWRSRIPRGHOOLQJKHUHDIWHU OD\HUV DQGVHOHFWLRQRIDEHVWPRGHO\

v VHOHFWHGQHXURQ

‘ QRWVHOHFWHGQHXURQ

H[SOLFLWDQDO\WLFDODYDLODEOHRSWLPDOFRPSOH[PRGHORUGHU RIUHJUHVVLRQPRGHO” ),*85(&UHDWLRQRIDQRSWLPDOFRPSOH[PRGHOXVLQJDPXOWLOD\HUHG*0'+DOJRULWKP

 GDWH 1RYHPEHU 1RYHPEHU

1RYHPEHU 'HFHPEHU

'HFHPEHU 'HFHPEHU 'HFHPEHU 'HFHPEHU

'HFHPEHU

'HFHPEHU

REVHUYDWLRQ

SUHGLFWLRQ

HUURU0$'>@













   

 

 

































7$%/(,3UHGLFWLRQHUURUIRU%0:

SHULRG RI 1RYHPEHU   WKURXJK 'HFHPEHU   1RUPDOL]DWLRQDQGGHQRUPDOL]DWLRQRIWKHGDWDDVDQLQWHJUDWHGSDUW RI WKH RYHUDOO PRGHOOLQJ DOJRULWKP ZHUH SHUIRUPHG 7KH LQSXW YDULDEOHVHWFRQVLVWHGRIWKHDERYHYDULDEOHVDQGWKHLUODJJHGVDPSOHV XS WR D ODJ RI   IRU D WRWDO RI  LQSXWV 7KH RXWSXW YDULDEOHV LQFOXGHGHDFK RI WKH  RULJLQDOYDULDEOHV7KHFRPSOHWHPRGHOOLQJ SURFHVV UHVXOWV LQ WKH FUHDWLRQ DQG YDOLGDWLRQ RI WKRXVDQGV RI GLIIHUHQWPRGHOVRILQFUHDVLQJFRPSOH[LW\ 7KHIROORZLQJRSWLPDOPRGHOZDVJHQHUDWHGIRU%0: VWRFNSULFHV %0:  %0:W 'ROODUWL  )RUGW )RUGW 9:W  9:W

ZKHUHWKHUHODWLRQ%0: I^%0:W'ROODUW¨9:W¨)RUGW` ZDV FRQVLGHUHG LPSRUWDQW IRU IXUWKHU DQDO\VLV 7KH SUHGLFWLRQV IRU %0: SULFHV DUH VKRZQ LQ )LJXUH  3UHGLFWLRQ HUURUV EDVHG RQ SHUIRUPDQFH PHDVXUHG XVLQJ PHDQ DEVROXWH GHYLDWLRQ 0$'  DUH VKRZQLQ7DEOH0$'LVGHILQHGDV

ZKHUH YUHSUHVHQWVWKHDFWXDOSULFHV\UHSUHVHQWVWKHSUHGLFWHG SULFHVDQG3UHSUHVHQWVWKHIRUHFDVWKRUL]RQ5HVXOWVIRUWKHRWKHU RXWSXWYDULDEOHVDUHSUHVHQWHGLQ7DEOH 7DEOHVKRZVWKHSUHGLFWLRQHUURUVIRUDOOYDULDEOHVRYHU DQGGD\SHULRGV6LPLODUUHVXOWVZHUHREWDLQHGIRURWKHUGD\V XVLQJXSGDWHGPRGHOV)URPDQDQDO\VLVRIWKHVHPRGHOVZHQRWH WKDW DV H[SHFWHG WKHLU VWUXFWXUH FKDQJHV GXH WR YDU\LQJ UHODWLRQVKLSVEHWZHHQYDULDEOHV

0RGHO$QG2XW2I6DPSOH3UHGLFWLRQ

),*85(*UDSKRIWKHPRGHODQGGD\H[DQWHSUHGLFWLRQVIRU%0:



),*85("5HIHUHQFHSDWWHUQDQGVHOHFWHGDQDORJRXVSDWWHUQVIRUDRQHGLPHQVLRQDOSURFHVV

$1$/2*8(6&203/(;,1*

$QDORJXHV FRPSOH[LQJ ZDV GHYHORSHG E\ /RUHQFH >@ DQG ZDVILUVWVXFFHVVIXOO\DSSOLHGWRPHWHRURORJLFDOIRUHFDVWV:LWKLQ WKH SDVW IHZ \HDUV LW KDV EHHQ HQKDQFHG XVLQJ LQGXFWLYH VHOI RUJDQL]LQJ WHFKQLTXHV DQG DQ DGYDQFHG VHOHFWLRQ SURFHGXUH WR PDNH LW DSSOLFDEOH WR HYROXWLRQDU\ SURFHVVHV ,Q DQDORJXH FRPSOH[LQJ WKH REVHUYHG SURFHVV LWVHOI LV XVHG IRU IRUHFDVWLQJ )RUHFDVWV DUH QRW FDOFXODWHG LQ WKH FODVVLFDO VHQVH EXW VHOHFWHG IURP D WDEOH RI REVHUYHG GDWD 7KLV PHWKRG LV GHQRWHG DV QRQ SDUDPHWULFEHFDXVHWKHUHLVQRQHHGWRHVWLPDWHSDUDPHWHUV7KH PDLQDVVXPSWLRQVDUH

WLRQVKLSE\LWVHOILVRQO\XVHIXOIRUQRQHYROXWLRQDU\SURFHVVHV :H ZLOO QRZ GHVFULEH DQ LQGXFWLYH VHDUFK PHWKRG WKDW LV VXLWDEOHIRUIRUHFDVWLQJPXOWLGLPHQVLRQDOHYROXWLRQDU\SURFHVVHV VXFK DV ILQDQFLDO SURFHVVHV ,Q FRQMXQFWLRQ ZLWK WKLV JRDO D TXHVWLRQ DULVHV UHJDUGLQJ ZKHWKHU RU QRW LW LV HYHQ SRVVLEOH WR VXFFHVVIXOO\ DSSO\ VXFK D PHWKRG WR IRUHFDVWLQJ HYROXWLRQDU\ SURFHVVHV2WKHUWKDQWKHSKLORVRSKLFDOVLGHRIWKHTXHVWLRQWKHUH LV WKH QHHG IRU IRUPDOL]LQJ WKH SUREOHP )RU LQVWDQFH IRU HYROXWLRQDU\SURFHVVHV

‡WKHV\VWHPWREHPRGHOOHGLVGHVFULEHGE\DPXOWLGLPHQVLRQDO SURFHVV ‡PDQ\REVHUYDWLRQVUHSUHVHQWHGE\VDPSOHGGDWDDUHDYDLODEOH ‡WKHPXOWLGLPHQVLRQDOSURFHVVLVVXIILFLHQWO\UHSUHVHQWHGE\WKH VDPSOHRIREVHUYDWLRQVDQG ‡LWLVSRVVLEOHWKDWSDVWEHKDYLRXUZLOOUHSHDWLQIXWXUH

,IZHVXFFHHGLQILQGLQJSDVWSDWWHUQVZKLFKDUHDQDORJRXV WRWKH PRVW UHFHQW UHIHUHQFH  SDWWHUQ SUHGLFWLRQV FDQ EH DFKLHYHG E\ DSSO\LQJWKHNQRZQFRQWLQXDWLRQRIWKHDQDORJRXVSDWWHUQVWRWKH UHIHUHQFHSDWWHUQ+RZHYHUWKLVUHOD

'$@





 +RZHYHU VLQFH WKH WUHQG LV DQ XQNQRZQ IXQFWLRQ RI WLPH WKH VXEMHFWLYH VHOHFWLRQ RI DQ DSSURSULDWH IXQFWLRQ LV D GLIILFXOW SUREOHP2QHREMHFWLYHVROXWLRQLVPDGHDYDLODEOHE\DSSOLFDWLRQ RIWKH*0'+DOJRULWKPWKURXJKLWVH[WUDFWLRQDQGWUDQVIRUPDWLRQ FDSDELOLWLHV%HFDXVHRIWKHGHSHQGHQF\RIDQDORJXHFRPSOH[LQJ RQ WKH VHOHFWHG WUHQG IXQFWLRQ LW ZDV GHFLGHG WR FRQVLGHU DQ DOWHUQDWLYH PHWKRG ZKLFK LV GHVFULEHG LQ WKH IROORZLQJ VWHS SURFHGXUH

 *HQHUDWLRQ RI DOWHUQDWLYH SDWWHUQV )RU D JLYHQ UHDOYDOXHG PGLPHQVLRQDOWLPHVHULHV[W ^[W [PW `W  1 ZLWK1 QXPEHURIREVHUYDWLRQVWKHSDWWHUQLVGHILQHGDVDWDEOH3NL RIN URZV REVHUYDWLRQV  VWDUWLQJ DW WLPH L ZKHUH N LV WKH SDWWHUQ OHQJWK DQG      1N DQG P LV WKH QXPEHURI FROXPQV YDULDEOHV  8VLQJ D VOLGLQJ ZLQGRZ WR JHQHUDWH WKH VHW RI SRVVLEOH SDWWHUQV ^3NL  L  1N` ZH FRPSDUHGDOO SRVVLEOH SDWWHUQV XVLQJ D FHUWDLQ VLPLODULW\PHDVXUHGHILQHGLQVWHS ZKLFKZDVFKRVHQ LQDGYDQFHZLWKUHVSHFWWRWKHPRVWUHFHQWUHIHUHQFHSDWWHUQ3U  3N 1N  )LJXUH  VKRZV WKH %0: WLPH VHULHV D RQH GLPHQVLRQDO SURFHVV  WKH UHIHUHQFH SDWWHUQ DQG ILYH VHOHFWHG DQDORJRXVSDWWHUQVZLWKDSDWWHUQOHQJWKRI

VLPLODU SDWWHUQV UHSUHVHQWLQJ WKRVH SURFHVVHV PD\ KDYH GLIIHUHQW PHDQYDOXHVVWDQGDUGGHYLDWLRQVDQGWUHQGV7KLVGLIIHUHQFHFDQ EHGHVFULEHGE\DWUDQVIRUPDWLRQ77KHUHIRUHZHKDYHWRVHOHFW WKH PRVW VLPLODU SDWWHUQ LQ WKH SDVW ZKLOH VLPLODULW\ PXVW EH PHDVXUHGEHWZHHQWKHUHIHUHQFHSDWWHUQDQG7L >3NL _L-@  7KHUHH[LVWVHYHUDOIXQFWLRQV WRGHVFULEHWKHWUDQVIRUPDWLRQ, )RU D ORFDO DSSUR[LPDWLRQ ZLWK VPDOO N RI WKH XQNQRZQ WUDQVIRUPDWLRQ7LWLVDGYLVDEOHWRFRQVLGHUWUDQVIRUPHGSDWWHUQV 7L >3NL @ DV D OLQHDU IXQFWLRQ RI WKH SDWWHUQ 3NL  7KLV FDQ EH GHVFULEHGDV

7UDQVIRUPDWLRQRIDQDORJXHV

)RUWKHJLYHQUHIHUHQFHSDWWHUQZLWKNREVHUYDWLRQVRQHRUPRUH DQDORJXHV SDWWHUQV PD\ H[LVW LQ KLVWRU\ 3NL _L-ZKHUH-LVWKHVHWRIEHVWDQDORJXHV)LQDQFLDOSURFHVVHV DUHHYROXWLRQDU\SURFHVVHV7KHUHIRUHDQ\

),*85(  3UHGLFWLRQ LQWHUYDOV H[SDQGHG E\ XWLOL]LQJ DOWHUQDWLYH

PRGHOV

7R H[SODLQ VXFK D WUDQVIRUPDWLRQ OHW;L EH WKH 'ROODUH[FKDQJH UDWH OHW WKH UHIHUHQFH SDWWHUQ FRQVLVWRIVDPSOHVLQ'HFHPEHU DQGOHWDQDQDORJRXVSDWWHUQKDYHVDPSOHVLQ6HSWHPEHU,QWKLV FDVH WKH WUDQVIRUPDWLRQ KDV WKH IROORZLQJ LQWHUSUHWDWLRQ WKH UHIHUHQFHSDWWHUQRI'HFHPEHUDUHHTXDOWRD SOXVDSURSRUWLRQDO SDUWD WKDWLVHTXDOWRWKHDQDORJRXVSDWWHUQRI6HSWHPEHU 7KHUHIRUH D RO FDQ EH LQWHUSUHWHG DV WKH GLIIHUHQFH EHWZHHQ WKH VWDWHVKHUHEHWZHHQWKH SULFHVLQ'HFHPEHUDQG6HSWHPEHU  DQG D O FDQ EH LQWHUSUHWHG DV DQ H[WHQVLRQ IDFWRU 7KH XQNQRZQ ZHLJKWVD O DQGD O IRUHDFKSDWWHUQFDQEHHVWLPDWHGE\PHDQV RIWKHOHDVWVTXDUHVPHWKRGZKLFKSURYLGHVQRWRQO\WKHXQNQRZQ ZHLJKWVEXWDOVRWKHWRWDOVXPRIVTXDUHV 7KLVSURYLGHVXVZLWK DVLPLODULW\PHDVXUHDVGHVFULEHGEHORZ  6HOHFWLRQ RI WKH PRVW VLPLODU DQDORJXHV 'LVWDQFHV FDQ EH PHDVXUHG E\ VHYHUDO VLPLODULW\ PHDVXUHV VXFK DV WKH (XFOLGHDQ GLVWDQFHRISRLQWVLQWKHUHIHUHQFHSDWWHUQDQGDQDQDORJXHRUE\ RWKHUPHDVXUHVRIGLVWDQFH,QRXUFDVHLWLVSRVVLEOHWRXVHDVD VLPLODULW\PHDVXUHWKH WRWDOVXPRIWKHVTXDUHV REWDLQHGE\OHDVW VTXDUHV HVWLPDWLRQ RI XQNQRZQ SDUDPHWHUV ZKLFK JLYHV XV LQIRUPDWLRQUHJDUGLQJWKHVLPLODULW\EHWZHHQWKHWZRSDWWHUQV 7KH DOJRULWKP UHTXLUHG IRU VHOHFWLQJ DQDORJRXV SDWWHUQV LV QRZGHVFULEHG)RUWKHJLYHQUHIHUHQFHSDWWHUQLWLVQHFHVVDU\WR VHOHFW WKH PRVW VLPLODU SDWWHUQ 3NL _L- 7KH VHOHFWLRQ WDVN LV D IRXUGLPHQVLRQDOSUREOHPZLWKWKHIROORZLQJGLPHQVLRQV

 0$&',QGLFDWRU 3ULQFLSOH

x x x x

),*85(3ULQFLSOHRIWKH0$&'LQGLFDWRU

WKHVHWRIYDULDEOHVXVHG WKHQXPEHURIDQDORJXHVVHOHFWHG WKHOHQJWKN RIWKHSDWWHUQQXPEHURIOLQHVXVHGIRUHDFK SDWWHUQ DQG WKHYDOXHVRIZHLJKWFRHIILFLHQWVZLWKZKLFKSDWWHUQVDUH FRPSOH[HG

&URVVYDOLGDWLRQ DV ZHOO DV GLIIHUHQW DSSURDFKHV WR GLVFUHWL]LQJ WKH VDPSOHV FDQ EH XVHG DV QHFHVVDU\ WR JHQHUDWH H[WHUQDO LQIRUPDWLRQ &RPELQLQJIRUHFDVWV (DFK VHOHFWHG DQDORJXH LV XVHG WR SURYLGH D IRUHFDVW E\ XVLQJ FRQWLQXDWLRQ PHWKRGV 7KHVH IRUHFDVWV DUH WKHQ FRPELQHG 0HWKRGV IRU FRPELQLQJ IRUHFDVWV KDYHEHHQGHVFULEHGLQ&KHQJ HWDO>@DQG:XDQG5HKIXVV>@ 7KH XQNQRZQ SUHGLFWLRQV [1L  ^[1L [1L [P1L` L 7ZKHUH7 IRUHFDVWKRUL]RQRIWKHP V\VWHPVYDULDEOHV FDQEHDVVXPHGWREHDOLQHDUFRPELQDWLRQRIWKHFRQWLQXDWLRQVRI VHOHFWHGDQDORJRXVSDWWHUQVLH

[ 1 L

J   ¦ J M [ 7M  N  L M-

7

7KH XQNQRZQSDUDPHWHUVJRJMM- FDQEHHVWLPDWHGE\PHDQV RISDUDPHWULFVHOHFWLRQSURFHGXUHVVXFKDVWKH*0'+DOJRULWKP 7KH RQO\SUREOHPLV WKH VPDOOQXPEHURIREVHUYDWLRQVDYDLODEOH IRUHVWLPDWLQJWKHXQNQRZQSDUDPHWHUV 7KHUHIRUHIRUYHU\VPDOOSDWWHUQOHQJWKV^N  LWLVDGYLVDEOH WRXVHWKHZHLJKWHGPHDQRIWKHVHOHFWHGFRQWLQXDWLRQV

7KH ZHLJKWV PXVW EH VHOHFWHG ZLWK UHVSHFW WRWKHWUDQVIRUPDWLRQ 7, KRZHYHU7KHDSSOLFDWLRQRIDQDORJXHFRPSOH[LQJWRDWUDGLQJ V\VWHPLVGHVFULEHGQH[W 75$',1*6@ RIDSUHGLFWRUZKLFKXVHVDQDORJXHFRPSOH[LQJ

%8@*HQHWLF$OJRULWKPVLQ%XVLQHVVLQ *HQHWLF $OJRULWKPVLQ2SWLPL]DWLRQ6LPXODWLR Q0RGHOOLQJ- 6WHQGHUHWDO HGV ,263UHVV$PVWHUGDPSS 

'ROODU'0&ORVH3ULFHV

),*85(3HUIRUPDQFHUHVXOWVIURPWUDGLQJWKH86'ROODUXVLQJGLIIHUHQWVLJQDOJHQHUDWLRQPHWKRGV



,YDNKQHQNR$*DQG-$0XHOOHU>@3DUDPHWULFDQGQRQSDUDPHWULFSURFHGXUHVLQH[SHULPHQWDOV\VWHPDQDO\VLV 6\VWHPV$QDO\VLV0RGHOOLQJ6LPXODWLRQ 9RO1RSS /HPNH)>@6HOI2UJDQL]H $6RIWZDUH7RROIRU0RGHOOLQJDQG3UHGLFWLRQRI&RPSOH[6\VWHPV 6\VWHPV$QDO\VLV0RGHOOLQJ6LPXODWLRQ 9RO1R SS /RUHQFH(1>@$WPRVSKHULFSUHGLFWDELOLW\LVUHYHDOHGE\QDWXUDOO\RFFXUULQJDQDORJXHV -$WPRV6FL 9ROSS 0DGDOD+5DQG$*,YDNKQHQNR>@ ,QGXFWLYH/HDUQLQJ$OJRULWKPVIRU&RPS OH[6\VWHPV0RGHOOLQJ &5&3UHVV%RFD5DWRQ)/ :X/DQG65HKIXVV>@$Q$GDSWLYH&RPPLWWHH %DVHG$SSURDFKWR7UDGLQJLQ1RQOLQHDU)LQDQFLDO)RUHFDVWLQJ 3URFHHGLQJVRIWKH)LUVW,1))& )LQDQFH 7HFKQRORJ\3XEOLVKLQJ+D\PDUNHW9$

 )UDQN/HPNH LVDQLQGHSHQGHQWVRIWZDUHGHYHORSHUVSHFLDOL]HGLQVHOIRUJDQLVLQJPRGHOOLQJEDVHGVROXWLRQVDQGLQIRUPDWLRQV\VWHPVIRURYHU \HDUV +H KDV GHYHORSHG 6HOI2UJDQL]H D WRRO ZKLFK XVHV DQ DGYDQFHG *0'+ DOJRULWKP DV ZHOODVWKH DQDORJXHFRPSOH[LQJPHWKRGIRU WKH PRGHOOLQJDQGSUHGLFWLRQRIFRPSOH[V\VWHPV+HJUDGXDWHGIURPWKH,QVWLWXWHRI(OHFWULFDO(QJLQHHULQJDW+XPEROGW8QLYHUVLW\LQ%HUOLQLQ 6LQFHKHZRUNHGRQVHYHUDOSUREOHPVLQHFRQRPLFVDQGILQDQFHVXFKDVEDODQFHVKHHWSUHGLFWLRQVDOHVSUHGLFWLRQVROYHQF\FKHFNLQJDQG SUHGLFWLYHFRQWUROVROXWLRQVIRUILQDQFLDOPDUNHWV

-RKDQQ$GROI0XHOOHU JUDGXDWHGIURP WKH ,OPHQDX,QVWLWXWHRI(OHFWULFDO (QJLQHHULQJLQ+HREWDLQHGKLV3K'LQ(FRQRPLFVIURPWKH ,QVWLWXWHRI(FRQRPLFVLQ%HUOLQLQZLWKDIRFXVRQG\QDPLFPRGHOOLQJLQHFRQRPLFV6LQFH3URI0XHOOHUKDVEHHQZRUNLQJDWWKH +RFKVFKXOHIXHU7HFKQLNXQG:LUWVFKDIWLQ'UHVGHQLQWKHILHOGRIEXVLQHVVRULHQWHGFRPSXWHUVFLHQFH