Improving Exposure of Intrusion Deception System through ...

 7KH,QWHUQDWLRQDO$UDE-RXUQDORI,QIRUPDWLRQ7HFKQRORJ\9RO1R6HSWHPEHU 

,PSURYLQJ([SRVXUHRI,QWUXVLRQ'HFHSWLRQ6\VWHP WKURXJK,PSOHPHQWDWLRQRI+\EULG+RQH\SRW 0DVRRG0DQVRRUL2PDU=DNDULDDQG$EGXOODK*DQL )DFXOW\RI&RPSXWHU6FLHQFHDQG,QIRUPDWLRQ7HFKQRORJ\8QLYHUVLW\RI0DOD\D0DOD\VLD  )DFXOW\RI'HIHQFH6FLHQFHDQG7HFKQRORJ\1DWLRQDO'HIHQFH8QLYHUVLW\RI0DOD\VLD0DOD\VLD 

$EVWUDFW7KLVSDSHUSUHVHQWVDQHZGHVLJQK\EULGKRQH\SRWWRLPSURYHWKHH[SRVXUHDVSHFWRILQWUXVLRQGHFHSWLRQV\VWHPV DQGLQSDUWLFXODUUHVHDUFK VHUYHUKRQH\SRWV$PDMRUDWWULEXWHLQWKHGHVLJQRID VHUYHUKRQH\SRWLVLWVSDVVLYHQHVVZKLFK DOORZV WKH KRQH\SRW WR H[SRVH LWV VHUYLFHV DQG SDVVLYHO\ ZDLW WR EH DWWDFNHG $OWKRXJK SDVVLYHQHVV RI D VHUYHU KRQH\SRW VLPSOLILHVWKHDQDO\VLVSURFHVVE\FODVVLI\LQJWUDIILFVDVPDOLFLRXVKRZHYHULWDOVROHVVHQVLWVDELOLW\WROXUHDWWDFNHUVWKURXJK H[SRVXUHRIYXOQHUDEOHVHUYLFH$VDUHVXOWLWFDSWXUHVVPDOOHUDPRXQWRIGDWDRQDWWDFNVIRUDQDO\VLV&OLHQWKRQH\SRWGHVLJQV RQWKHRWKHUKDQGFRQWDLQPRGXOHVWKDWDFWLYHO\LQWHUDFWZLWKRXWVLGHQHWZRUNVH[SRVHYXOQHUDELOLWLHVLQFOLHQWVLGHVRIWZDUH DQGLGHQWLI\PDOLFLRXVFRQWHQWKRVWHGRQZHEVHUYHUV7KHSURSRVHGK\EULGV\VWHPLQWHJUDWHVDFWLYHPRGXOHFRQFHSWRIDFOLHQW KRQH\SRW LQWR D VHUYHU KRQH\SRW 7KH DFWLYH PRGXOH LQWHUDFWV ZLWK ZHEVHUYHUV XWLOLVLQJ D FXVWRP FUDZOHU DQG EURZVHU SXEOLFLVHVWKHKRQH\SRW¶V,3DGGUHVVDQGWKHUHIRUHLPSURYHVH[SRVXUHRIVHUYHUKRQH\SRW VYXOQHUDEOHVHUYLFHV7KHILQGLQJV SUHVHQWHGLQWKLVSDSHUVKRZWKDWLQWHUDFWLRQZLWKZHEVHUYHUVLPSURYHVH[SRVXUHDQGUHVXOWVLQVLJQLILFDQWO\KLJKHUQXPEHURI DWWDFNVZKLFKLQWXUQLQFUHDVHVWKHSUREDELOLW\RIGLVFRYHULQJQHZWKUHDWV7KHILQGLQJVDOVRFKDUDFWHULVHPRVWDWWDFNVWREH ZRUPEDVHGDQGGLUHFWHGDWZLQGRZVEDVHGKRVWVDQGVHUYLFHV .H\ZRUGV,'6VHUYHUKRQH\SRWFOLHQWKRQH\SRWK\EULGKRQH\SRW 5HFHLYHG$SULODFFHSWHG2FWREHU 

 ,QWURGXFWLRQ +RQH\SRWVDUHVLPSOHDQGFRVWHIIHFWLYHVROXWLRQVWKDW SURYLGH GLUHFW DQG LQGLUHFW YDOXH WR DQ RUJDQLVDWLRQ¶V LQIRUPDWLRQ VHFXULW\ >@ 7KH GLUHFW YDOXH RI KRQH\SRWV UHVLGHV LQ WKHLU GHWHFWLRQ FDSDELOLWLHV DVLGH IURP WKHLU VLPSOLFLW\ LQ FRQFHSW LQVWDOODWLRQ DQG PDQDJHPHQW,WVLQGLUHFWYDOXHLVWKHUHVXOWVRIDQDO\VLV SHUIRUPHGRQFDSWXUHGGDWDWKURXJKWKHGHSOR\PHQWRI WKRXVDQGV RI KRQH\SRWV DURXQG WKH ZRUOG 7KH UHVXOWV RI WKH DQDO\VLV KDYH LGHQWLILHG VHFXULW\ WKUHDWV WR SURGXFWLRQ VHUYHUV DQG KRVWV RI PDQ\ RUJDQLVDWLRQV WKH WRROV DQG WDFWLFV XVHG E\ DWWDFNHUV 7KLV LQIRUPDWLRQ LQ WXUQ FDQ KHOS LQ WKH GHYHORSPHQW RI SURSHU WRROV DQG WHFKQLTXHV WR FRXQWHU WKH LGHQWLILHG WKUHDWVDQGWKHDWWDFNWRROVXVHG +RQH\SRWV DUH GLIIHUHQWLDWHG EDVHG RQ WKH OHYHO RI LQWHUDFWLRQ ZLWK WKH DWWDFNHUV LH KLJK PHGLXP RU ORZ LQWHUDFWLRQ  DQG WKH SXUSRVH RI GHSOR\PHQW LH SURGXFWLRQ RU UHVHDUFK  5HVHDUFK KRQH\SRWV DUH WKH WRROVXVHGE\UHVHDUFKHUVWRLGHQWLI\DWWDFNSDWWHUQVWKH WRROVDQGWHFKQLTXHVXVHGDQGKDYHEHHQSURYHQWREH HIIHFWLYH LQ VXFK DUHDV >@ +RZHYHU OLNH RWKHU WHFKQRORJLHV WKHUH DUH VKRUWFRPLQJV LQ H[SORLWLQJ WKH IXOOSRWHQWLDOVRIUHVHDUFKKRQH\SRWV &XUUHQW UHVHDUFK RQ VHUYHU KRQH\SRW V\VWHPV LV IRFXVHG RQ LQFUHDVLQJ WKH GHFHSWLRQ FDSDELOLWLHV RI VHUYHUKRQH\SRWVWRDYRLGGHWHFWLRQDQGVXEVHTXHQWO\ WR FDSWXUH H[WHQVLYH GDWD RQ WKH DWWDFNHUV 2WKHU SURSHUWLHV RI VHUYHU KRQH\SRWV VXFK DV H[SRVXUH RI

YXOQHUDEOH VHUYLFHV SOD\ D YLWDO UROH LQ D UHVHDUFK KRQH\SRW¶V REMHFWLYH WR FDSWXUH D ODUJHU QXPEHU RI DWWDFNVIRUDQDO\VLV7KHREMHFWLYHRIWKLVUHVHDUFKLVWR GHWHUPLQH ZKHWKHU DFWLYH LQWHUDFWLRQ ZLWK ZHEVHUYHUV FXUUHQWO\ LPSOHPHQWHG LQ FOLHQW KRQH\SRWV FDQ EH XWLOLVHG DV D PHDQV RI LQFUHDVLQJ H[SRVXUH RI VHUYHU KRQH\SRWV,QWKLVUHVHDUFKDK\EULGKRQH\SRWV\VWHP WR LPSURYH WKH H[SRVXUH DVSHFW RI LQWUXVLRQ GHFHSWLRQ V\VWHPV VSHFLILFDOO\ UHVHDUFK VHUYHU KRQH\SRWV LV SURSRVHG 7KH SURSRVHG V\VWHP LQWHJUDWHV DFWLYH PRGXOHVRIFOLHQWKRQH\SRWVLQWRVHUYHUKRQH\SRWV7KH DFWLYH PRGXOHV LQWHUDFW ZLWK ZHEVHUYHUV SXEOLFLVLQJ WKHKRQH\SRW¶V,3DGGUHVVDQGLQFUHDVLQJH[SRVXUHRI VHUYHU KRQH\SRW V VHUYLFHV $GGLWLRQDO GHWDLOV RQ LQWUXVLRQGHFHSWLRQV\VWHPVDUHJLYHQLQWKHIROORZLQJ VHFWLRQ

 ,QWUXVLRQ'HFHSWLRQ6\VWHP 7UDGLWLRQDOO\ LQIRUPDWLRQ VHFXULW\ KDV EHHQ GHILQHG DQG LPSOHPHQWHG EDVHG RQ WKH FRQFHSW RI SURWHFWLRQ GHWHFWLRQ DQG UHDFWLRQ >@ 3URWHFWLRQ LPSOLHV GHIHQGLQJWKHLQIRUPDWLRQDJDLQVWXQDXWKRULVHGDFFHVV 'HWHFWLRQ LV DQ RQJRLQJ SURFHVV RI PRQLWRULQJ DFWLYLWLHV IRU DQ\ IDLOXUH LQ WKH GHIHQFH VWUXFWXUH DQG GLVFRYHULQJ LQWUXVLRQ XVLQJ LQWUXVLRQ GHWHFWLRQ V\VWHPV5HDFWLRQLQYROYHVWKHDFWLRQVWDNHQWRUHFRYHU IURPDIDLOXUHLQWKHSURWHFWLRQDQGGHWHFWLRQV\VWHPV 0RGHUQ DSSURDFKHV LQ LQIRUPDWLRQ VHFXULW\ HPSOR\ GHFHSWLRQ DV DQ DGGHG OD\HU WR FUHDWH D PRUH UREXVW

,PSURYLQJ([SRVXUHRI,QWUXVLRQ'HFHSWLRQ6\VWHPWKURXJK,PSOHPHQWDWLRQRI+\EULG+RQH\SRW  

GHIHQFH VWUDWHJ\ 'HFHSWLRQ LV IUHTXHQWO\ XVHG E\ KDFNHUV WR FRQFHDO WKHLU LGHQWLWLHV DQG DFWLYLWLHV >@ )RULQVWDQFH,3VSRRILQJXVHVGHFHSWLRQWHFKQLTXHVWR FRQFHDO WKH LGHQWLW\ RI WKH UHDO DWWDFNHU EHKLQG DQ DXWKHQWLF KRVW &RQFHDOPHQW RI LGHQWLW\ DQG DFWLYLWLHV DOORZVDWWDFNHUVWRE\SDVVGHWHFWLRQWRROVDQGLQFUHDVH WKH FKDQFHV RI D VXFFHVVIXO FRPSURPLVH 'HFHSWLRQ WHFKQLTXHVDUHXVHGLQSURWHFWLRQDJDLQVWDWWDFNVLQWKH IRUP RI FRQFHDOPHQW RI YDOXDEOH LQIRUPDWLRQ DQG KRVWVE\SODFLQJGHFR\V\VWHPVZKLFKDUHWDUJHWHGE\ KDFNHUV 7KLV GHFR\ V\VWHP LV DQ LQWUXVLRQ GHFHSWLRQ V\VWHP+RQH\SRWVDQGKRQH\QHWVDUHWKHPDLQWRROVLQ LQWUXVLRQ GHFHSWLRQ V\VWHPV ZKLFK XWLOLVH GHFHSWLRQ WHFKQLTXHVLQWKHIRUPRIGHFR\V\VWHPVVHUYLFHVDQG IDOVHLQIRUPDWLRQ'HFR\V\VWHPVGLYHUWDWWHQWLRQDZD\ IURPUHDOWDUJHWVDQGRIIHUDSSHDOLQJHQYLURQPHQWVIRU DWWDFNHUVWRZRUNZLWKRXWEHLQJDZDUHWKDWWKHLUDFWLRQV DUH EHLQJ UHFRUGHG 3URGXFWLRQ KRQH\SRWV DUH GHFR\ V\VWHPV WKDW DUH UHVSRQVLEOH IRU GLYHUWLQJ DWWHQWLRQ DZD\ IURP KLJKYDOXH SURGXFWLRQ VHUYHUV DQG KRVWV >@ 7KLV LV DFKLHYHG E\ SODFLQJ GHFR\ V\VWHPV WKDW PLUURU SURGXFWLRQ VHUYHUV 'HSOR\PHQW RI D ODUJH QXPEHURIGHFR\V\VWHPVZLWKLQDSURGXFWLRQQHWZRUN FDQ VLJQLILFDQWO\ LQFUHDVH WKH WLPH UHTXLUHG IRU VFDQQLQJWKHWDUJHWVWKXVSURYLGLQJDGGLWLRQDOWLPHIRU DGPLQLVWUDWRUV WR GHWHFW DWWDFNV 3URGXFWLRQ KRQH\SRWV FDQ DOVR EH XVHG WR PLWLJDWH '26 DWWDFNV DQG VORZ GRZQQHWZRUNVFDQQHUVDQGSURSDJDWLRQRIZRUPVE\ SODFLQJVWLFN\KRQH\SRWVVXFKDV/DEUHD7DUSLWDPRQJ SURGXFWLRQKRVWV 'DWD JDWKHULQJ RQ DWWDFNV DQG PRQLWRULQJ DWWDFN EHKDYLRXU SDWWHUQ DQG WRROV LV W\SLFDOO\ DFKLHYHG WKURXJK GHSOR\PHQW RI UHVHDUFK KRQH\SRWV LQ ODUJH QXPEHUV ZLWKLQ WKH QHWZRUNV RI XQLYHUVLWLHV FRUSRUDWLRQVDQGUHVHDUFKRUJDQLVDWLRQV>@'HSOR\LQJ ODUJH QXPEHU RI KRQH\SRWV LQ GLIIHUHQW JHRJUDSKLFDO ORFDWLRQV PD[LPLVHV H[SRVXUH RI KRQH\SRWV WR DWWDFNV DQG LQFUHDVHV WKH SUREDELOLW\ RI GHWHFWLQJ QHZ DWWDFNV E\ FDSWXULQJ ODUJH DPRXQW RI GDWD /DUJH DPRXQW RI GDWD FROOHFWHG IURP GLIIHUHQW KRQH\SRWV ORFDWHG LQ GLIIHUHQW UHJLRQV DOVR SURYLGHV DQ RYHUYLHZ RI WKH W\SHV DQG IUHTXHQF\ RI F\EHU DWWDFNV LQ GLIIHUHQW UHJLRQV DURXQG WKH JOREH /HXUUHFRP +RQH\QHW $OOLDQFHDQG%UD]LOLDQ+RQH\QHWSURMHFWDUHH[DPSOHV RIVXFKUHVHDUFKRUJDQLVDWLRQVGHGLFDWHGWRPRQLWRULQJ LQWHUQHW WKUHDWV 5HVHDUFK VHUYHU KRQH\SRWV LPSOHPHQWHGE\VXFKUHVHDUFKJURXSVLQYROYHWKHXVH RI VLQJOH RU GLVWULEXWHG QHWZRUNV RI VHUYHU KRQH\SRWV 6HUYHUKRQH\SRWVDUHSDVVLYHGHFR\V\VWHPVZDLWLQJWR EH DWWDFNHG 7KH SDVVLYHQHVV RI VXFK KRQH\SRWV LV D PDMRUIDFWRULQWKHVLPSOLFLW\RIKRQH\SRWGHSOR\PHQW DQGDQDO\VLVRIFDSWXUHGGDWDJLYHQWKDWQROHJLWLPDWH WUDIILFH[LVWVDQGKHQFHDQ\WUDIILFDQGDFWLYLW\ZLWKLQ WKH KRQH\SRWLVFRQVLGHUHG WR EH PDOLFLRXV +RZHYHU ODFNRIH[SRVXUHRIKRQH\SRWVHUYLFHVWRDWWDFNHUVLVD GLUHFW RXWFRPH RI WKH SDVVLYHQHVV SURSHUW\ RI VHUYHU KRQH\SRWV$GHWDLOHGH[SODQDWLRQRIVHUYHUDQGFOLHQW



KRQH\SRWV LQFOXGLQJ WKH SURSHUWLHV DGYDQWDJHV DQG GUDZEDFNVLVSURYLGHGLQWKHIROORZLQJVHFWLRQ

 6HUYHUDQG&OLHQW+RQH\SRWV 7UDGLWLRQDO KRQH\SRWV ZHUH GHVLJQHG DQG GHSOR\HG WR SURWHFW SURGXFWLRQ HQYLURQPHQWV E\ PLUURULQJ SURGXFWLRQVHUYHUVDQGVHUYLFHV7KHVHKRQH\SRWVZHUH FRPPRQO\ FDOOHG VHUYHU KRQH\SRWV $ ZLGH UDQJH RI V\VWHPVWRFRPEDWDQGFDSWXUHGLIIHUHQWDWWDFNVVXFKDV ''RV 6SDP DQG ZRUP PLWLJDWLRQ ZHUH GHVLJQHG DQG LQWURGXFHG +RZHYHU WKH QXPEHU RI RQOLQH WKUHDWV WDUJHWHG DW FOLHQW DSSOLFDWLRQV¶ YXOQHUDELOLWLHV KDV LQFUHDVHGVLJQLILFDQWO\LQWKHSDVWIHZ\HDUV7KHVKLIW IURP VHUYHU VLGH WR FOLHQW VLGH DWWDFNV LV GXH WR WKH LQFUHDVHG SRSXODULW\ RI ZHE EURZVHUV IRU DFFHVVLQJ RQOLQH UHVRXUFHV DQG WKH LPSURYHG VHFXULW\ RI VHUYHUV >@$VDWWDFNEHKDYLRXUFKDQJHGDQGVKLIWHGWRFOLHQW VLGHDSSOLFDWLRQVDQHZFODVVLILFDWLRQRIKRQH\SRWVWR LGHQWLI\ DWWDFNV RQ FOLHQW DSSOLFDWLRQV GLVFRYHU YXOQHUDELOLWLHV RI FOLHQW ZHE EURZVHU DQG GHWHFW PDOLFLRXV ZHEVHUYHUV ZDV LQWURGXFHG 7KH QHZ FODVV RIKRQH\SRWVIRFXVHVRQFOLHQWDWWDFNVKHQFHWKHQDPH ³FOLHQW KRQH\SRWV´ RU ³+RQH\FOLHQWV´ ZDV DGRSWHG 7KHVH WZR JHQHUDOLVDWLRQV RI KRQH\SRWV GLIIHU LQ SXUSRVHRIGHSOR\PHQWDVZHOODVWKHDSSURDFKHVXVHG WRLGHQWLI\DQGFDSWXUHDWWDFNV

 6HUYHU+RQH\SRWV 6HUYHU KRQH\SRWV RSHUDWH E\ H[SRVLQJ YXOQHUDEOH VHUYLFHV DQG ZDLWLQJ IRU DWWDFNHUV WR H[SORLW WKH VHUYLFHV>@DVVKRZQLQ)LJXUH,QWKHFDVHRI SURGXFWLRQ KRQH\SRWV DLPHG DW SURWHFWLQJ RWKHU KRVWV E\ HQJDJLQJ DWWDFNHUV ZLWK QRQ SURGXFWLRQ VHUYLFHV DQG UHVRXUFHV SDVVLYHQHVV LV QRW D VHWEDFN DV IHZHU DWWDFNVRQDKRQH\SRWPHDQOHVVULVNWRWKHRSHUDWLRQDO KRVWV+RZHYHUUHVHDUFKKRQH\SRWVPHUHO\GHSHQGRQ WKH FDSWXUHG GDWD WR GLVFRYHU QHZ YXOQHUDELOLWLHV DQG WKUHDWV$SDVVLYHVHUYHUKRQH\SRWZLWKQRPHFKDQLVP WRH[SRVHLWVSUHVHQFHLVOHVVOLNHO\WREHDWWDFNHGWKDQ D KRQH\SRW ZLWK DQ H[SRVHG ,3 DGGUHVV $ VWXG\ E\ %ORRPILHOGHWDO>@VKRZVWKDWKRQH\SRWVGHSOR\HGLQ ODUJH FRUSRUDWLRQV¶ QHWZRUNV ZKRVH ,3 DGGUHVVHV DUH PRUHSXEOLFFDSWXUHGDKLJKHUQXPEHURIDWWDFNVWKDQ KRQH\SRWVLQVPDOOHQWHUSULVHV 





)LJXUH6HUYHUKRQH\SRWSDVVLYHO\ZDLWVWREHDWWDFNHG 

,QFUHDVLQJ H[SRVXUH LV DSSOLHG LQ VSDP KRQH\SRW V\VWHPV ZKHUH VHYHUDO HPDLO DGGUHVVHV UHGLUHFWLQJ VSDP HPDLOV WR D VSDP KRQH\SRW DUH PDQXDOO\ SURSDJDWHG DFURVV WKH LQWHUQHW LQ FKDW URRPV IRUXPV DQGEXOOHWLQV>@7KHSURSDJDWLRQRIHPDLODGGUHVVHV

 7KH,QWHUQDWLRQDO$UDE-RXUQDORI,QIRUPDWLRQ7HFKQRORJ\9RO1R6HSWHPEHU 

LQFUHDVHV WKH SUREDELOLW\ RI HPDLO DGGUHVVHV EHLQJ ORFDWHG E\ VSDP %RWV DQG XVHG DV D WDUJHW IRU VSDP HPDLOV7KHSDVVLYHQHVVRIVHUYHUKRQH\SRWVKRZHYHU UHPDLQV D SURSHUW\ RI VHUYHU KRQH\SRWV EXW LV DGGUHVVHGLQFOLHQWKRQH\SRWV

 &OLHQW+RQH\SRWV &OLHQW KRQH\SRWV WDNH DQ DFWLYH DSSURDFK WR LGHQWLI\ DWWDFNV RQ WKH V\VWHPV &OLHQW KRQH\SRWV H[SRVH WKH FOLHQWVLGHVHUYLFHVDQGDFWLYHO\FUDZOLQWRZHEVHUYHUV YLVLWZHEVLWHVDQGPRQLWRUDFWLYLWLHVWRGHWHUPLQHLID ZHEVHUYHULVPDOLFLRXV>@DVVKRZQLQ)LJXUH7KLV LV GRQH XVLQJ FOLHQW EURZVHUV RU FUDZOHUV WR YLVLW ZHEVLWHV SODFHG RQ GLIIHUHQW ZHEVHUYHUV ZKLOH HYHU\ SURFHVV ILOH UHDGZULWH DQG UHJLVWU\ HQWU\ ZLWKLQ WKH FOLHQW KRQH\SRW LV PRQLWRUHG ,I DQ\ FKDQJHV RFFXU IROORZLQJ HDFK YLVLW WKH ZHEVLWH LV FODVVLILHG DV PDOLFLRXV 0RQLWRULQJ WKH WUDIILF DQG H[DPLQLQJ WKH GDWDIRUSRWHQWLDOPDOZDUHVDFFHVVHGE\DKRQH\FOLHQW LVDFKLHYHGE\XWLOLVLQJDQWLYLUXVVRIWZDUHRULQWUXVLRQ GHWHFWLRQVLJQDWXUHV&DSWXUH+3&LVDQH[DPSOHRID KLJK LQWHUDFWLRQ FOLHQW KRQH\SRW 7DEOH  VXPPDULVHV WKHNH\SURSHUWLHVRIFOLHQWDQGVHUYHUKRQH\SRWV $FWLYH LQWHUDFWLRQ DQG FODVVLILFDWLRQ RI DWWDFNV DUH WKHPDLQSURSHUWLHVRIDOOFOLHQWKRQH\SRWV$V\VWHP ZKLFK WDNHV DGYDQWDJH RI DFWLYH SURSHUW\ RI FOLHQW KRQH\SRWV VWUDLJKWIRUZDUG DWWDFN FODVVLILFDWLRQ DQG H[SRVXUHRIYXOQHUDEOHVHUYLFHVRIVHUYHUKRQH\SRWVLV DEOHWRVLJQLILFDQWO\LPSURYHWKHHIILFLHQF\RIUHVHDUFK VHUYHUKRQH\SRWVLQFDSWXULQJDWWDFNV 



)LJXUH+RQH\FOLHQWVDFWLYHO\LGHQWLI\PDOLFLRXVZHEVHUYHUV  7DEOH&RPSDULVRQEHWZHHQVHUYHUDQGFOLHQWKRQH\SRWV 6HUYHU+RQH\SRWV

&OLHQW+RQH\SRWV

3URYLGHVHUYLFHVIRUFOLHQWVWRXVH 'RQRWSURYLGHDQ\VHUYLFHVWRRWKHUV /XUHDWWDFNHUVLQWRDWWDFNLQJ 'RQRWOXUHDWWDFNHUVDVQRVHUYLFHLV H[SRVHGVHUYLFHV SURYLGHG $FWLYHO\FUDZOWKHZHEWRLGHQWLI\ 3DVVLYHO\ZDLWIRUDQDWWDFNHU PDOLFLRXVZHEVHUYHUV 9HU\ORZRUQRIDOVHDODUPV *HQHUDWHIDOVHDODUPV (YHU\DFFHVVDQGWUDIILFLV +DVWRGHFLGHZKLFKWUDIILFLV FRQVLGHUHGDWKUHDW PDOLFLRXV

 +\EULG+RQH\SRW6\VWHP :H SURSRVH D K\EULG KRQH\SRW GHVLJQ WR RIIVHW WKH ZHDNQHVVHV RI FOLHQW DQG VHUYHU KRQH\SRWV 7KH SURSRVHG K\EULG KRQH\SRW KDV EHHQ GHVLJQHG WR



PDQLSXODWH DQG FRPELQH WKH DGYDQWDJHV RI WKH FOLHQW DQG WKH VHUYHU KRQH\SRWV ZKLFK ZLOO KHOS WR HQKDQFH H[SRVXUHE\DFWLYHLQWHUDFWLRQZLWKSRWHQWLDODWWDFNHUV $FWLYH LQWHUDFWLRQ LV DQ HIIHFWLYH PHFKDQLVP IRU ILQGLQJPDOLFLRXVZHEVHUYHUVDFURVVWKHLQWHUQHWDQGLV XVHG E\ DOO FOLHQW KRQH\SRWV >@ 7KH SURSRVHG KRQH\SRW V\VWHP LQWHJUDWHV WKH DFWLYH LQWHUDFWLRQ RI FOLHQWKRQH\SRWVLQWRVHUYHUKRQH\SRWVWRIRUPDK\EULG KRQH\SRW V\VWHP 7KH SURSRVHG K\EULG KRQH\SRW V\VWHPVKRXOGKDYHWKHIROORZLQJSURSHUWLHV x ([SRVHG 9XOQHUDEOH 6HUYLFHV ([SRVXUH RI YXOQHUDEOH VHUYLFHV HLWKHU VLPXODWHG RU UHDO LV WKH EDVLF IHDWXUH RI VHUYHU KRQH\SRWV WR OXUH DWWDFNHUV WRZDUGWKHKRQH\SRWV\VWHP3URGXFWLRQVHUYHUVDQG KRVWV DUH FRQVWDQWO\ SUREHG IRU RSHQ SRUWV DQG YXOQHUDEOH VHUYLFHV WR EH H[SORLWHG $ KRQH\SRW V\VWHP WKDW GRHV QRW KDYH DQ\ H[SRVHG VHUYLFHV RU RSHQSRUWVZLOOQRWEHDEOHWRDWWUDFWDWWDFNHUVDQG ZLOO VLPSO\ EH E\SDVVHG 2XU SURSRVHG K\EULG KRQH\SRW V\VWHP XWLOLVHV GHFR\ DQG VLPXODWHG YXOQHUDEOHVHUYLFHVWROXUHDWWDFNHUV x ,QWHUDFWLRQ 7KH SURSRVHG V\VWHP VKRXOG WDNH DGYDQWDJHRIWKHDFWLYHSURSHUW\RIFOLHQWKRQH\SRWV WR RYHUFRPH WKH SDVVLYHQHVV RI VHUYHU KRQH\SRWV 7KH DFWLYH FRPSRQHQW ZLWKLQ WKH SURSRVHG V\VWHP LQWHUDFWV ZLWK RXWVLGH QHWZRUNV WR DGYHUWLVH WKH SUHVHQFHRIYXOQHUDEOHVHUYLFHVDQGJHQHUDWHWUDIILF WRLQFUHDVHGHFHSWLRQ x *HQHUDWLQJ 6PDOO 6HW RI 'DWD IRU $QDO\VLV 8QOLNH RWKHU WHFKQRORJLHV VXFK DV ,'6 ZKLFK SURGXFHV IDOVHDODUPVDQGFROOHFWVDYHU\ODUJHDPRXQWRIGDWD IRU DQDO\VLV VHUYHU KRQH\SRWV SURGXFH QR IDOVH DODUPV DQG FDSWXUH FRPSDUDWLYHO\ YHU\ VPDOO DPRXQW RI GDWD 7KLV LV EHFDXVH VHUYHU KRQH\SRWV DUH QRW SDUW RI WKH SURGXFWLRQ QHWZRUN DQG FRQFHSWXDOO\ DUH QRW VXSSRVHG WR KDYH DQ\ WUDIILF DQGDFWLYLW\7KHUHIRUHDQ\DFWLYLW\REVHUYHGLQWKH KRQH\SRWV\VWHPDQGWKHSRUWVFDQEHGHHPHGWREH PDOLFLRXV2XUSURSRVHGK\EULGV\VWHPFDQPRQLWRU DQG ORJ DFWLYLWLHV DQG WUDIILF RQ H[SRVHG VHUYLFHV DQG RSHQ SRUWV RI D VHUYHU KRQH\SRW 7KH DFWLYH PRGXOH ZKLFK LV LQWHJUDWHG LQWR WKH SURSRVHG V\VWHP XWLOLVHV PLQLPDO UHVRXUFHV LQ WHUPV RI SRUW XVDJH WR SHUIRUP LQWHUDFWLRQ WKXV DFWLYLWLHV RQ RWKHUSRUWVFDQHDVLO\EHPRQLWRUHGZLWKRXWFUHDWLQJ XQQHFHVVDU\WUDIILF x 6LPSOLFLW\ 7KH PRGXOH UHVSRQVLEOH IRU LQWHUDFWLRQ ZHUH GHVLJQHG WR EH VLPSOH WR LQVWDOO DQG WR EH FRPSDWLEOH ZLWK GLIIHUHQW W\SHV RI KRQH\SRW DQG GLIIHUHQWRSHUDWLQJV\VWHPV 7KH SURSRVHG K\EULG KRQH\SRW DGGUHVVHV WKH SDVVLYHQHVV RI VHUYHU KRQH\SRWV DQG VSHFLILFDOO\ UHVHDUFK KRQH\SRWV E\ LQWHJUDWLQJ WKH DFWLYH PRGXOHV ZKLFK LQWHUDFW ZLWK RXWVLGH QHWZRUNV DV VKRZQ LQ )LJXUH  7KH DLP LV WR LQFRUSRUDWH WKH FRQFHSW RI SXEOLFLVLQJ D KRQH\SRW¶V SUHVHQFH LQ VSDP KRQH\SRWV

,PSURYLQJ([SRVXUHRI,QWUXVLRQ'HFHSWLRQ6\VWHPWKURXJK,PSOHPHQWDWLRQRI+\EULG+RQH\SRW  

LQWRVHUYHUKRQH\SRWVE\DGYHUWLVLQJWKHKRQH\SRW¶V,3 DGGUHVV WKURXJK LQWHUDFWLRQ ,QWHUDFWLRQ ZLWK ZHEVHUYHUV DQG SXEOLFLVLQJ KRQH\SRW¶V ,3 DGGUHVV KRZHYHU GR QRW H[SRVH WKH H[LVWHQFH RI D GHFR\ V\VWHP EXW LQFUHDVH WKH H[SRVXUH RI LWV VHUYLFHV 0RUHRYHUDQDFWLYHKRQH\SRWLVOHVVOLNHO\WRUHVHPEOH DFRQYHQWLRQDOSDVVLYHKRQH\SRWKHQFHWKHGHFHSWLRQ LVPRUHOLNHO\WRLQFUHDVH 

 )LJXUH+\EULGKRQH\SRWLQWHJUDWHV PRGXOHVRIFOLHQWKRQH\SRWV LQWRVHUYHUKRQH\SRWV 

7KH K\EULG V\VWHP XWLOLVHV D FXVWRPLVHG ZHE EURZVHU DQG D FUDZOHU WR SHUIRUP LQWHUDFWLRQ ZLWK VXVSHFWHG PDOLFLRXV ZHEVHUYHUV 7KH FUDZOHU LQLWLDWHV FRQQHFWLRQ ZLWK D ZHEVHUYHU GRZQORDGV WKH VRXUFH FRGHV RI D ZHEVLWH DQG H[WUDFWV WKH 85/V HPEHGGHG ZLWKLQWKHVRXUFHFRGH([WUDFWHG85/VDUHDGGHGWRD OLVWRIZHEVLWHVWREHYLVLWHGE\WKHEURZVHU7KHOLQNV DUHWKHQEURZVHGE\WKHEURZVHULQDWLPHO\IDVKLRQDV VHWE\DQDWWULEXWHZLWKLQWKHEURZVHUFRGHDVVKRZQLQ )LJXUH  ,W PXVW EH QRWHG WKDW WKH SXUSRVH RI WKLV FUDZOHUEURZVHU PRGXOH LV QRW WR EH H[SORLWHG OLNH FOLHQW KRQH\SRWV EXW WR DFW DV DQ DFWLYH PRGXOH WR LQWHUDFW ZLWK ZHEVHUYHUV 0HDQZKLOH DOO VHUYLFHV DQG SRUWV DUH PRQLWRUHG IRU DQ\ DFWLYLW\ WKURXJK D VHUYHU KRQH\SRW 

 )LJXUH%ORFNGLDJUDPRIWKHIXQFWLRQVRIWKHSURSRVHGV\VWHP 

7UDIILFJHQHUDWLRQLVDGLUHFWRXWFRPHRILQWHUDFWLRQ SHUIRUPHG E\ WKH DFWLYH PRGXOHV RI WKH SURSRVHG V\VWHP /DFN RI OHJLWLPDWH WUDIILF LV RQH RI WKH EDVLF DWWULEXWHV RI KRQH\SRWV ZKLFK GHHP DQ\ WUDIILF DQG DFWLYLW\ LQ DQG RXW RI KRQH\SRW DV PDOLFLRXV /DFN RI WUDIILFRQWKHRWKHUKDQGFRQWULEXWHVWRWKHGHWHFWLRQRI KRQH\SRWV 0XNNDPDOD HW DO >@ VWDWHV WKDW WKH RQO\ WUXH ZD\ WR GHWHFW DQ LGHDO KRQH\SRW DW WKH QHWZRUN OD\HU LV WR PRQLWRU WKH ORFDO WUDIILF 7KH SURSRVHG V\VWHP RYHUFRPHV WKLV GUDZEDFN E\ JHQHUDWLQJ VLPXODWHGWUDIILFZKLFKLVDFKLHYHGE\LQWHUDFWLRQZLWK WKHZHEVHUYHUV,IWKHSURSRVHGV\VWHPLVGHSOR\HGLQD KRQH\SRW WKH EURZVHU JHQHUDWHV WUDIILF E\ LQWHUDFWLQJ ZLWKZHEVHUYHUV7KLVFDXVHVWKHVRXUFH,3DGGUHVVRI



WKH KRQH\SRW WR EH DYDLODEOH LQ WKH +773 SDFNHW KHDGHUV EHLQJ WUDQVPLWWHG WKURXJK WKH QHWZRUN $Q\RQH VQLIILQJ WKH WUDIILF XVLQJ WKH SDFNHW VQLIILQJ XWLOLWLHV ZRXOG QRWLFH WKH LQIRUPDWLRQ H[FKDQJH DQG DFWLYLW\RULJLQDWLQJIURPRUWRZDUGWKHKRQH\SRW7KLV FUHDWHV DQ LOOXVLRQ WKDW WKH KRQH\SRW LV DQ RSHUDWLRQDO KRVWVHUYHU 7UDIILFJHQHUDWLRQLVSDUWLFXODUO\XVHIXOLILWLVGRQH LQFRQMXQFWLRQZLWKKLJKLQWHUDFWLRQKRQH\SRWV:KLOH WKLV V\VWHP FDQ KHOS WR UHGXFH WKH SRVVLELOLW\ RI GHWHFWLRQ RI ORZ DQG PHGLXP LQWHUDFWLRQ KRQH\SRWV VLQFHWKHLULQWHUDFWLRQOHYHOLVDPDMRUGHWHFWLRQIDFWRU GHWHFWLRQWKURXJKDODFNRIWUDIILFLVWKHOHDVWFRQFHUQ RQ VXFK KRQH\SRWV 2Q D KLJK LQWHUDFWLRQ KRQH\SRW KRZHYHU VHUYLFHV DUH QRW VLPXODWHG DQG DQ DFWXDO RSHUDWLQJ V\VWHP LV SURYLGHG 7KHUHIRUH WKH ODFN RI WUDIILF LV RQH RI WKH PDMRU IDFWRUV WKDW FDQ EORZ WKH FRYHU RI D KRQH\SRW 7KLV V\VWHP FDQ LQFUHDVH WKH GHFHSWLRQ FDSDELOLWLHV RI KRQH\SRWV DQG RYHUFRPH D PDMRUGLVDGYDQWDJH 7KHKRQH\SRWV\VWHPXVHGLQRXULPSOHPHQWDWLRQLV +RQH\%RW ZKLFK LV D :LQGRZVEDVHG PHGLXP LQWHUDFWLRQ KRQH\SRW FDSDEOH RI VLPXODWLQJ YXOQHUDEOH VHUYLFHV DQG PRQLWRULQJ SRUWV WKDW DUH XVHG E\ WKRVH VHUYLFHV +RQH\%RW SURYLGHV WKH IXQFWLRQDOLWLHV WR FDSWXUH WKH SD\ORDG RI FRQQHFWLRQV GRZQORDG WKH ELQDULHV RI VHYHUDO PDOZDUHV DQG RIIHU HQKDQFHG LQWHUDFWLRQ IRU VRPH VHUYLFHV VXFK DV 66+ )73 DQG 7HOQHW 7KH ODWWHU VHUYLFHV DOORZ WKH DWWDFNHU WR ORJLQ LQWRIDOVHDFFRXQWVZKLOHHYHU\XVHUQDPHDQGSDVVZRUG LVORJJHG +RQH\%RW LV XVHG LQ WKH LPSOHPHQWDWLRQ RI VHYHUDO KRQH\QHW JURXSV VXFK DV WKH 7DLZDQHVH +RQH\QHW&KDSWHU7KH+RQH\%RWV\VWHPXVHGLQWKLV UHVHDUFK FDQ GLVWLQJXLVK EHWZHHQ FRQQHFWLRQ DWWHPSWV LQLWLDWHG E\ LQWHUDFWLRQ RI DFWLYH PRGXOH DQG FRQQHFWLRQ DWWHPSWV LQLWLDWHG IURP RXWVLGH WRZDUG WKH XVHG SRUWV ,Q WKH IRUPHU FDVH WKH DFWLYLWLHV DUH QRW ORJJHG ZKHUHDV LQ WKH ODWWHU FDVH DOO DFWLYLWLHV DQG FRQQHFWLRQDWWHPSWVDUHORJJHG 7KH FUDZOHUEURZVHU PRGXOH ZDV GHYHORSHG XVLQJ -DYDSURJUDPPLQJODQJXDJHDVLWLVFRPSDWLEOHZLWKD ZLGH UDQJH RI RSHUDWLQJ V\VWHPV %RWK +RQH\%RW DQG FUDZOHUEURZVHU PRGXOHV ZHUH LQVWDOOHG RQ D QHZO\ LQVWDOOHG :LQGRZV;3 3URIHVVLRQDOV\VWHP FRQWDLQLQJ WKH ODWHVW XSGDWHV DQG GHSOR\HG WR SHUIRUP GDWD FDSWXUHSURFHVV

 'DWD&DSWXUH 'DWDFDSWXUHLVWKHSURFHVVRIPRQLWRULQJDQGORJJLQJ HYHU\DFWLYLW\DQGGDWDJRLQJLQDQGRXWRIDKRQH\SRW 7KH GDWD FDSWXUH IXQFWLRQ LV JHQHUDOO\ HPEHGGHG ZLWKLQ WKH KRQH\SRW VRIWZDUH LQ ORZ DQG PHGLXP LQWHUDFWLRQ KRQH\SRWV ZKLOH KLJK LQWHUDFWLRQ KRQH\SRWV XWLOLVH GDWD FDSWXUH WRROV VXFK DV 6HEHN LQWUXVLRQGHWHFWLRQV\VWHPDQGILUHZDOOORJVWRPRQLWRU DFWLYLWLHVLQDKRQH\SRW7KH+RQH\%RWV\VWHPXWLOLVHV DEXLOWLQGDWDFDSWXUHPHFKDQLVPZKLFKLVFDSDEOHRI

 7KH,QWHUQDWLRQDO$UDE-RXUQDORI,QIRUPDWLRQ7HFKQRORJ\9RO1R6HSWHPEHU 

FDSWXULQJ FRQQHFWLRQ DWWHPSWV FRQQHFWLRQ SD\ORDGV ELQDU\ FRGHV RI ZRUPV DQG DWWHPSWHG XVHUQDPHV DQG SDVVZRUGV 7KH PHWULF IRU FRPSDULVRQ RI LQFUHDVHG H[SRVXUHRIDKRQH\SRWV\VWHPLVEDVHGRQWKHQXPEHU RI FDSWXUHG DWWDFNV ,Q RUGHU WR GHWHUPLQH WKH HIIHFWLYHQHVV RI DQ DFWLYH K\EULG KRQH\SRW V\VWHP FRPSDUHG WR D UHJXODU VHUYHU EDVHG KRQH\SRW LQ FDSWXULQJDWWDFNVDFRPSDULVRQZDVPDGHEDVHGRQWKH QXPEHU RI ORJJHG DWWDFNV LQ WZR VHSDUDWH SKDVHV RI GDWDFDSWXUH 

x 3UHGHSOR\PHQWSKDVHSKDVH  x 3RVWGHSOR\PHQWSKDVHSKDVH 

 3UH'HSOR\PHQW3KDVH3KDVH  3KDVH  SUHGHSOR\PHQW SKDVH  LQYROYHV WKH GHSOR\PHQWRI+RQH\%RWZLWKRXWDQ\LQWHUDFWLRQZLWK ZHEVHUYHUVUHSUHVHQWLQJDUHJXODUVHUYHUKRQH\SRW,Q RUGHUWRGHWHUPLQHWKHQXPEHURIDWWDFNVRQDSDVVLYH VHUYHU EDVHG KRQH\SRW V\VWHP +RQH\%RW ZDV GHSOR\HGXVLQJDSXEOLF,3DGGUHVVIRUDSHULRGRIRQH ZHHN GXULQJ ZKLFK WKH KRQH\SRW ZDV QHYHU WDNHQ RIIOLQH ,Q WKLV SKDVH RI GDWD FROOHFWLRQ  VRFNHWV FRUUHVSRQGLQJ WR ZLGHO\XVHG SURWRFROV DQG DSSOLFDWLRQV ZHUH FUHDWHG DQG WKH DFWLYLWLHV RQ HDFK SRUW ZHUH PRQLWRUHG DQG ORJJHG (DFK ORJ ILOH EHORQJLQJWRHDFKGD\ZDVDXWRPDWLFDOO\VDYHGLQWKH ORFDO KDUG GLVN DV &RPPD 6HSDUDWHG 9DOXHV RU FVY ILOHV $ PDLQ FKDUDFWHULVWLF RI VHUYHU KRQH\SRWV LV WKH ODFN RI DQ\ OHJLWLPDWH DFWLYLW\ DQG WUDIILF ZLWKLQ WKH KRQH\SRW V\VWHP 7KHUHIRUH WR PLPLF D UHJXODU SDVVLYH VHUYHU KRQH\SRW QR XVHU DFWLYLWLHV ZHUH SHUIRUPHG QR ZHEVLWHV ZHUH YLVLWHG DQG QR RXWERXQG FRQQHFWLRQV ZHUH LQLWLDWHG RQ WKH KRQH\SRW 7KLV PLPLFV D VWDQGDUG VHUYHU EDVHG KRQH\SRW ZKHUH OHJLWLPDWHXVHUDFWLYLW\DQGWUDIILFPXVWQRWH[LVW

 3RVW'HSOR\PHQW3KDVH3KDVH  7KH VHFRQG SKDVH SRVWGHSOR\PHQW SKDVH  RI GDWD FDSWXUH LQYROYHG LQWHUDFWLRQ ZLWK ZHEVHUYHUV WKURXJK VXUILQJ RI ZHEVLWHV E\ WKH FUDZOHU DQG EURZVHU PRGXOH 8SRQ FRPSOHWLRQ RI WKH ILUVW SKDVH RI GDWD FROOHFWLRQ D QHZ XQILOWHUHG SXEOLF ,3 ZDV REWDLQHG DQG DQ LQLWLDO  85/V RI VXVSLFLRXV ZHEVLWHV PRVWO\FRPSULVLQJRI:DUH]DQGDGXOWZHEVLWHVZHUH ORDGHG LQWR WKH EURZVHU 7KH V\VWHP ZDV WKHQ OHIW UXQQLQJ IRU D SHULRG RI RQH ZHHN DQG DGGLWLRQDO ZHEVLWHVZHUHRFFDVLRQDOO\FUDZOHG6LPLODUWRWKHILUVW SKDVHRIGDWDFROOHFWLRQVRFNHWVZHUHFUHDWHGDQG PRQLWRUHG7KHUHDVRQIRUREWDLQLQJDQHZ,3DGGUHVV LQSKDVHZDVWRORZHUWKHSUREDELOLW\RIKLJKHUDWWDFN UDWHVGXHWRWKHORQJHUGXUDWLRQIRUZKLFKWKHKRQH\SRW KDGEHHQRQOLQHDQGWRREWDLQDPRUHDFFXUDWHUHVXOW

 5HVXOWV 'DWDFDSWXUHGWKURXJKWKHGHSOR\PHQWRIDUHJXODU



VHUYHU KRQH\SRW DQG D K\EULG KRQH\SRW V\VWHP RYHU GLIIHUHQWGXUDWLRQVZHUHUHVSHFWLYHO\DQDO\VHG$WWDFNV ZHUHDQDO\VHGEDVHGRQWKHQXPEHURIDWWDFNVFDSWXUHG HDFKZHHNWRGHWHUPLQHWKHHIIHFWLYHQHVVRIWKHK\EULG KRQH\SRWV\VWHPDVFRPSDUHGWRDUHJXODUVHUYHUEDVHG KRQH\SRW $QDO\VHV ZHUH DOVR PDGH WR GHWHUPLQH WKH RULJLQV RI WKH DWWDFNV DV ZHOO DV WKH EHKDYLRXU RI WKH DWWDFNHUVLQERWKSKDVHV

 $WWDFN6WDWLVWLFV %DVHG RQ WKH DQDO\VLV RI WKH DWWDFNV WKH ILUVW DWWDFNV WRRNSODFHOHVVWKDQPLQXWHVDIWHUJRLQJRQOLQHDQG ZHUH UHSHDWHG DSSUR[LPDWHO\ HYHU\  PLQXWHV DQG  VHFRQGVGXULQJSKDVH2YHUDOOWKHUDWHRIDWWDFNVKDV EHHQ TXLWH FRQVLVWHQW WKURXJKRXW WKH ILUVW SKDVH ZLWK WKH H[FHSWLRQ RI  0D\  ZKLFK ZDV D 6XQGD\ 7KLVFRXOGEHGXHWRWKHIDFWWKDWIHZHULQIHFWHGKRVWV SDUWLFXODUO\ FRUSRUDWH KRVWV ZHUH RQOLQH GXULQJ WKH ZHHNHQG&RPSDUHGWRWKHDYHUDJHQXPEHURIDWWDFNV RQ RWKHU GD\V RI WKH ZHHN 6XQGD\ UHSUHVHQWV D  GURSLQWKHQXPEHURIDWWDFNVJLYHQLQ7DEOH  7DEOH6XPPDU\RIDWWDFNVGXULQJSKDVH 3KDVH 'DWH ±0RQGD\ ±7XHVGD\ ±:HGQHVGD\ ±7KXUVGD\ ±)ULGD\ ±6DWXUGD\ ±6XQGD\ 7RWDO1XPEHURI$WWDFNV $YHUDJH$WWDFNV3HU'D\

1XPEHURI$WWDFNV         

 7KH +RQH\%RW FDSWXUHG D WRWDO RI  DWWDFNV GXULQJSKDVHZKLFKLVDQDYHUDJHRIDWWDFNHYHU\ PLQXWHDQGVHFRQGV7KHWRWDOQXPEHUUHSUHVHQWVD VLJQLILFDQW LQFUHDVH RI  LQ DWWDFN UDWLR $V LQ WKH ILUVW SKDVH DWWDFNV ORJJHG IRU 6XQGD\  0D\  ZDVUHODWLYHO\ORZHUE\JLYHQLQ7DEOH  7DEOH6XPPDU\RIDWWDFNVGXULQJSKDVH 3KDVH 'DWH ±0RQGD\ ±7XHVGD\ ±:HGQHVGD\ ±7KXUVGD\ ±)ULGD\ ±6DWXUGD\ ±6XQGD\ 7RWDO1XPEHURI$WWDFNV $YHUDJH$WWDFNV3HU'D\

1XPEHURI$WWDFNV         

 2ULJLQRI$WWDFNV 7DEOH  VKRZV WKH WRS FRXQWULHV ZKHUH WKH DWWDFNV RULJLQDWHG 7KH ILQGLQJV IURP D VLQJOH GHSOR\HG

,PSURYLQJ([SRVXUHRI,QWUXVLRQ'HFHSWLRQ6\VWHPWKURXJK,PSOHPHQWDWLRQRI+\EULG+RQH\SRW  

KRQH\SRW LQ WKLV LPSOHPHQWDWLRQ VKRZ WKDW &KLQD 5XVVLD -DSDQ DQG WKH 8QLWHG 6WDWHV WRS WKH OLVW RI FRXQWULHV IURP ZKHUH WKH DWWDFNV RULJLQDWHG 7KHVH FRXQWULHVDUHDOVRDPRQJWKHWRSFRXQWULHVZLWKWKH KLJKHVWQXPEHURILQWHUQHWXVHUV  7DEOH7RSDWWDFNLQJFRXQWULHV 

&RXQWU\ 5XVVLDQ)HGHUDWLRQ &KLQD -DSDQ 8QLWHG6WDWHV

&RXQWU\&RGH 58 &1 -3 86

3HUFHQW    

 ,GHQWLI\LQJWKHPRVWSHUVLVWHQW,3DGGUHVVHVFDQKHOS DGPLQLVWUDWRUV WR VHWXS UXOHV DQG VKDUH WKHLU LQIRUPDWLRQZLWKRWKHURUJDQLVDWLRQVVRWKDWSUHYHQWLYH PHDVXUHV FDQ EH WDNHQ WR DYRLG DWWDFNV IURP WKHVH ,3 DGGUHVVHV $QRWKHU PHDVXUH ZRXOG EH WR LQIRUP WKH UHOHYDQW DXWKRULWLHV VXFK DV UHOHYDQW ,63V DERXW WKH PDOLFLRXV DFWLYLWLHV RULJLQDWLQJ IURP WKHLU GRPDLQ VR WKDWDSSURSULDWHDFWLRQVFDQEHWDNHQ$OLVWRIWKHPRVW SHUVLVWHQW ,3 DGGUHVVHV RI WKH DWWDFNHUV RULJLQDWLQJ FRXQWU\ RI WKH DWWDFNV DQG WKH QXPEHU RI DWWDFNV DWWULEXWHGWRHDFK,3DGGUHVVLVVKRZQLQ7DEOH

QXPEHU RI XVDJH LQFOXGH DEF SDVVZRUG SDVVZG QRQHDQGJXHVW 3RUW  ORJJHG VHYHUDO DWWHPSWV DW UHOD\LQJ HPDLO DGGUHVVHV PRVW SUREDEO\ DWWULEXWHG WR %RWV VFDQQLQJ IRU RSHQ UHOD\V 7KLV SRUW LV FRQVWDQWO\ VFDQQHG E\ VSDPPHUV¶ DXWRPDWHG VRIWZDUH WR ILQG RSHQ UHOD\V WR VHQG VSDP %DVHG RQ WKH FDSWXUHG FRQWHQW DQG WKH VXEMHFWRIWKHHPDLOVDWHVWHPDLODGGUHVVLVVHQWWRWKH VSDPPHU¶VHPDLODGGUHVVFRQWDLQLQJWKH,3DGGUHVVRI WKHWDUJHW,ILWVXFFHHGVWKH,3DGGUHVVRIWKHWDUJHWLV DGGHG WR WKH OLVW RI RSHQ UHOD\V )LJXUH  VKRZV DQ H[DPSOH RI UHOD\LQJ DWWHPSW IURP  GLUHFWHGDW WKH KRQH\SRW RQ SRUW  $ WHVW HPDLO IURP FRROER\#PVKLQHWQHW LV VHQW WR ELELR#JPDLOFRPZLWKWKH,3DGGUHVVRIWKHKRQH\SRW DVWKHVXEMHFWRIWKHHPDLO 

 7DEOH0RVWSHUVLVWHQW,3DGGUHVVHV ,3$GGUHVV     

&RXQWU\ &KLQD &KLQD &KLQD &KLQD &KLQD

1XPEHURI$WWDFNV     

 $WWDFN%HKDYLRXU +RQH\%RW LV FRQVLGHUHG D PHGLXP LQWHUDFWLRQ KRQH\SRW DQG DV VXFK LW GRHV QRW SURYLGH IXOO LQWHUDFWLRQIRUHYHU\SURWRFRO7KLVPDNHVLWGLIILFXOWWR GLIIHUHQWLDWHEHWZHHQ:RUPVDQGKXPDQEDVHGDWWDFNV %DVHG RQ WKH VLPLODULW\ RI SD\ORDGV DQG WKH YDVW QXPEHU RI FRQQHFWLRQV KRZHYHU PRVW RI WKH DWWDFNV ZHUH EDVLF VFDQQLQJ DQG ZRUP SURSDJDWLRQ 7KH 6@ $ UHVHDUFK E\ 5DPVEURFNHWDO>@EDVHGRQ66+VHUYHUKRQH\SRW LGHQWLILHG WKHVH SDVVZRUGV DV WKH WRS DWWHPSWHG SDVVZRUGVXVHGLQGLFWLRQDU\DWWDFNVEDVHGRQFRPPRQ SDVVZRUGV*HQHUDOO\DWWDFNHUVZHUHQRWYHU\NHHQWR JDLQDFFHVVDVQRGLFWLRQDU\EDVHGRUEUXWHIRUFHDWWDFN ZDV XVHG DQG HDFK DWWDFNHU XVXDOO\ WHVWHG RQO\ D IHZ SDVVZRUGV 7KH SDVVZRUGV LQ GHVFHQGLQJ RUGHU RI



 )LJXUH$QDWWHPSWWRUHOD\HPDLOFDSWXUHGE\+RQH\%RW 

7KHWHVWHPDLOLVZKDWPDNHVVSDPKRQH\SRWVVXFK DV +RQH\6SDP >@ QRW SUDFWLFDO DV WKH +RQH\6SDP GRHVQRWDOORZIRUZDUGLQJRIVSDPHPDLOVDQGXQOHVV WKHWHVWHPDLOLVQRWGHOLYHUHGQRVSDPLVIRUZDUGHGWR WKH KRQH\SRW -DFNSRW KRQH\SRW DQ 6073 UHOD\ KRQH\SRW ZULWWHQ LQ -DYD SURJUDPPLQJ ODQJXDJH LV FDSDEOH RI IRUZDUGLQJ WKH WHVW HPDLO VHQW E\ DQ DWWDFNHU 7KH UHVW RI WKH VSDP LV QRW GHOLYHUHG EXW VDYHG LQ D VLQJOH GDWDEDVH VKDUHG ZLWK VHYHUDO KRQH\SRWV 2YHUDOO DWWDFNV RQ SRUW  60%  FRQWULEXWHG WR  RI DOO DWWDFNV DJDLQVW WKH +RQH\%RW IROORZHG E\ SRUW  0LFURVRIW 64/ 6HUYHU  FRQWULEXWLQJ  SRUW  '&(53&  FRQWULEXWLQJ  DQG SRUW  1HW%,26  FRQWULEXWLQJ  7DEOH  VKRZV WKH WRS PRVWDWWDFNHGSRUWVDQGWKHWRWDOQXPEHURIDWWDFNVRQ HDFKSRUWGXULQJWKHWZRGDWDFDSWXUHSHULRGV  7DEOH7RSPRVWDWWDFNHGSRUWV 3RUW          



7RWDO$WWDFNV          

3HUFHQWDJH          

 7KH,QWHUQDWLRQDO$UDE-RXUQDORI,QIRUPDWLRQ7HFKQRORJ\9RO1R6HSWHPEHU 

SRUWVWKDWPLJKWKDYHEHHQPLVVHGRXWWREHILOWHUHG E\ ILUHZDOO FDQ EH LGHQWLILHG DQG LOOHJLWLPDWH FRQQHFWLRQDWWHPSWVHLWKHULQWHUQDORUH[WHUQDOFDQ EH GHWHFWHG >@ 2Q WKH RWKHU KDQG D KRQH\SRW GHSOR\HG LQ IURQW RI D ILUHZDOO LV FRQVWDQWO\ EHLQJ SUREHG DQG DWWDFNHG DQG JLYHV XVHUV DQ LQGLFDWLRQ RIWKHVHYHULW\DQGWKHQXPEHURIDWWDFNVDJDLQVWWKH SRUWVDQGVHUYLFHV

'LVFXVVLRQ $QDO\VLV RI WKH FDSWXUHG GDWD SURGXFHG VRPH LQWHUHVWLQJUHVXOWVDVIROORZ x ,PSURYHG ([SRVXUH DQG ,QFUHDVHG 1XPEHU RI $WWDFNV )LQGLQJV GHPRQVWUDWH WKDW EURZVLQJ ZHEVLWHV DQG LQWHUDFWLRQ ZLWK ZHEVHUYHUV FDQ VLJQLILFDQWO\LQFUHDVHH[SRVXUHDQGWKHOLNHOLKRRGRI DWWDFNV RQ VHUYHU EDVHG KRQH\SRW VHUYLFHV 'XULQJ GHSOR\PHQWRIDK\EULGKRQH\SRWV\VWHPLQSKDVH RI GDWD FDSWXUH  PRUH DWWDFNV ZHUH FDSWXUHG ZKHQ FRPSDUHG WR WKH GHSOR\PHQW RI D VLQJOH SDVVLYH VHUYHU KRQH\SRW LQ SKDVH  RI GDWD FDSWXUH DVVKRZQLQ)LJXUH 

 )LJXUH  *UDSK UHSUHVHQWLQJ WKH QXPEHU RI DWWDFNV LQ WKH WZR SKDVHVRIGDWDFDSWXUH 

x ,GHQWLILFDWLRQ RI WKH 2ULJLQV RI $WWDFNV $WWDFN EHKDYLRXU FRQQHFWLRQ SD\ORDGV DQG QXPEHU RI FRQQHFWLRQVIURP D ZLGHUDQJH RI KRVWVDQG D IHZ SHUVLVWHQW,3DGGUHVVHVVKRZWKDWPRVWDWWDFNVZHUH LQLWLDWHG E\ ZRUPV VFDQQLQJ UDQGRP KRVWV DQG DWWHPSWLQJ WR VSUHDG E\ LQIHFWLQJ YXOQHUDEOH VHUYLFHVRIWDUJHWKRVWV x ,GHQWLILFDWLRQRI0RVW7DUJHWHG2SHUDWLQJ6\VWHPV %DVHG RQ WKH FDSWXUHG GDWD LQ ERWK SKDVH  DQG SKDVH  :LQGRZV QDWLYH VHUYLFHV UHFRUGHG WKH KLJKHVW QXPEHU RI FRQQHFWLRQ DWWHPSWV DQG FRQWULEXWHG WR  RI WRWDO DWWDFNV DJDLQVW WKH KRQH\SRW ,W LV WKHUHIRUH DGYLVDEOH IRU RUJDQLVDWLRQV UXQQLQJ :LQGRZV RSHUDWLQJ V\VWHPV WREHYLJLODQWLQPRQLWRULQJWKHVHVHUYLFHVDQGSRUWV IRU LOOHJDO DFWLYLWLHV DQG WR LQVWLWXWH SURWHFWLYH PHDVXUHV IRU WKH VHUYLFHV XVLQJ ILUHZDOOV LQWUXVLRQ SUHYHQWLRQ V\VWHPV RU SDWFKHV RI WKH ODWHVW XSGDWHV IURPYHQGRUV x 3ODFHPHQW RI +RQH\SRWV $QDO\VLV RI WKH FDSWXUHG GDWD E\ KRQH\SRWV KHOSV V\VWHP DGPLQLVWUDWRUV WR JHWDFOHDUXQGHUVWDQGLQJRIWKHULVNDVVRFLDWHGZLWK HYHU\UXQQLQJVHUYLFHDQGRSHQSRUWLQWKHLUV\VWHP +RQH\SRWV GHSOR\HG EHKLQG D ILUHZDOO ZLWKLQ DQ RUJDQLVDWLRQ FDQ GHWHFWLQIHFWHG KRVWV WKDW DUH XVHG WR SURSDJDWH ZRUPV DQG KHOS ZLWK LQVLGHU WKUHDWV :KLOH PRVW DWWDFNV DUH EORFNHG E\ ILUHZDOO RSHQ



 &RQFOXVLRQV 7KLVVWXG\IRFXVHVRQWKHOLPLWDWLRQVRIUHVHDUFKVHUYHU KRQH\SRWV WKDW LQ XVH ,W LV DLPHG DW HQKDQFLQJ WKH GHVLJQRIWKHKRQH\SRWWRDGGUHVVWKHOLPLWDWLRQV7KH PDLQRXWFRPHVRIWKHVWXG\DUH x 7KH FXUUHQW DSSURDFK XVHG E\ VHUYHU KRQH\SRWV WR DWWUDFW DWWDFNHUV LV SDVVLYH LQ QDWXUH EHFDXVH VHUYHU KRQH\SRWV GR QRW LQLWLDWH FRQQHFWLRQ KDYH QR LQWHUDFWLRQ DQG WDNH QR PHDVXUH WR SXEOLFLVH WKHLU YXOQHUDEOHVHUYLFHVWROXUHDWWDFNHUV x &OLHQW KRQH\SRWV FRQWDLQ DFWLYH PRGXOHV LH &UDZOHU %URZVHU  ZKLFK LQWHUDFW DFWLYHO\ ZLWK ZHEVHUYHUV H[DPLQH ZHEVLWHV DQG FODVVLI\ WKHP EDVHGRQWKHPDOLFLRXVQHVVRIWKHFRQWHQW x 7KH VLJQLILFDQFH RI WKLV UHVHDUFK \LHOGV LV HYLGHQW ZLWK WKH LQWURGXFWLRQ RI D K\EULG FOLHQW VHUYHU KRQH\SRW 3UHYLRXV GHILQLWLRQ RI K\EULG KRQH\SRWV LQYROYHG LQWHJUDWLRQ RI KRQH\SRWV ZLWK GLIIHUHQW LQWHUDFWLRQFDSDELOLWLHVLQWKHVDPHGHVLJQXWLOLVLQJ ORZ DQG PHGLXP LQWHUDFWLRQ KRQH\SRWV WR ORJ OHVV VLJQLILFDQWDWWDFNVZKLOHPRUHVRSKLVWLFDWHGDWWDFNV ZHUHGLUHFWHGWRKLJKLQWHUDFWLRQKRQH\SRWV,QWKLV SDSHU D K\EULG KRQH\SRW V\VWHP WKDW EULGJHV WKH JDS EHWZHHQ KRQH\SRWV ZLWK HQWLUHO\ GLIIHUHQW IXQFWLRQDOLWLHV ZDV LQWURGXFHG ,W FRQVLVWV RI DFWLYH FRPSRQHQWV RI WKH KRQH\FOLHQWV DQG WKH H[SRVHG VHUYLFHV RI VHUYHU KRQH\SRWV 7KLV GHVLJQ ZDV LQWHQGHGWRHQKDQFHWKHGDWDFDSWXUHFDSDELOLWLHVRI VHUYHUEDVHGKRQH\SRWV x $QDO\VLVRIWKHFDSWXUHGGDWDIURPDUHJXODUVHUYHU KRQH\SRW DV ZHOO DV WKH SURSRVHGK\EULG KRQH\SRW GHPRQVWUDWHV WKH HIIHFWLYHQHVV RI DFWLYH LQWHUDFWLRQ RIK\EULGKRQH\SRWV\VWHPLQLPSURYLQJH[SRVXUHRI VHUYHUVLGHVHUYLFHV$FRQVLGHUDEO\KLJKHUQXPEHU RI DWWDFNV ZDV QRWLFHG LPPHGLDWHO\ DIWHU WKH GHSOR\PHQWRIWKHK\EULGKRQH\SRWV\VWHP $FWLYH LQWHUDFWLRQ KDV VKRZQ DQ HIIHFWLYH PHFKDQLVP RIFOLHQWKRQH\SRWVWRGHWHFWPDOLFLRXVZHEVHUYHUVDQG DOVR DQ H[FHOOHQW WHFKQLTXH WR DFKLHYH KLJKHU DWWDFN UDWHVRQUHVHDUFKVHUYHUKRQH\SRWV

 $FNQRZOHGJPHQW :HZRXOGOLNHWRH[SUHVVRXUDSSUHFLDWLRQWRDOOWKRVH ZKR KHOSHG XV WR XQGHUVWDQG WKH LPSRUWDQFH RI NQRZOHGJHDQGVKRZHGXVWKHEHVWZD\WRJDLQLW



,PSURYLQJ([SRVXUHRI,QWUXVLRQ'HFHSWLRQ6\VWHPWKURXJK,PSOHPHQWDWLRQRI+\EULG+RQH\SRW  

5HIHUHQFHV >@ $QGHUVRQ3³'HFHSWLRQ$+HDOWK\3DUWRI$Q\ 'HIHQVH LQ'HSWK 6WUDWHJ\´ DYDLODEOH DW KWWSZZZVDQVRUJUHDGLQJBURRPZKLWHSDSHUVS ROLF\LVVXHVODVWYLVLWHG >@ $QGUHROLQL 0 %XOJDUHOOL $ &RODMDQQL 0 DQG 0D]]RQL ) ³+RQH\VSDP +RQH\SRWV )LJKWLQJ 6SDP DW WKH 6RXUFH´ LQ 3URFHHGLQJV RI WKH ,QWHUQDWLRQDO :RUNVKRS RQ 6WHSV WR 5HGXFLQJ 8QZDQWHG 7UDIILF RQ WKH ,QWHUQHW 86$ SS   >@ %ORRPILHOG 5 *DVKL , 3RY\DNDOR $ DQG 6WDQNRYLF 9 ³&RPSDULVRQ RI (PSLULFDO 'DWD IURP7ZR+RQH\QHWVDQGD'LVWULEXWHG+RQH\SRW 1HWZRUN´ LQ 3URFHHGLQJV RI WK ,QWHUQDWLRQDO 6\PSRVLXP RQ 6RIWZDUH 5HOLDELOLW\ (QJLQHHULQJ 86$SS >@ +HFNHU & 1DQFH . DQG +D\ % ³'\QDPLF +RQH\SRW &RQVWUXFWLRQ´ LQ 3URFHHGLQJV RI WKH WK&ROORTXLXPIRU,QIRUPDWLRQ6\VWHPV6HFXULW\ (GXFDWLRQ86SS >@ -LDQJD ; ;XD ' DQG :DQJ @ 0DKHVZDUL 9 DQG 6DQNDUDQDUD\DQDQ 3 ³+RQH\SRWV 'HSOR\PHQW DQG 'DWD )RUHQVLF $QDO\VLV´ LQ 3URFHHGLQJV RI WKH ,QWHUQDWLRQDO &RQIHUHQFH RQ &RPSXWDWLRQDO ,QWHOOLJHQFH DQG 0XOWLPHGLD $SSOLFDWLRQV 86$ YRO  SS   >@ 0F*UHZ 5 DQG 9DXJKQ 5 ³([SHULHQFHV ZLWK +RQH\SRW 6\VWHPV 'HYHORSPHQW 'HSOR\PHQW DQG$QDO\VLV´LQ3URFHHGLQJVRIWKHWK+DZDLL ,QWHUQDWLRQDO &RQIHUHQFH RQ 6\VWHP 6FLHQFHV 86$YROSSD >@ 0RNXEH , DQG $GDPV 0 ³+RQH\SRWV &RQFHSWV $SSURDFKHV DQG &KDOOHQJHV´ LQ 3URFHHGLQJV RI WKH WK $QQXDO 6RXWKHDVW 5HJLRQDO&RQIHUHQFH86$SS >@ 0XNNDPDOD 6 @ 5DPVEURFN ' %HUWKLHU 5 DQG &XNLHU 0 ³3URILOLQJ $WWDFNHU %HKDYLRU )ROORZLQJ 66+



&RPSURPLVHV´LQ3URFHHGLQJVRIWKHWK$QQXDO ,(((,),3 ,QWHUQDWLRQDO &RQIHUHQFH RQ 'HSHQGDEOH 6\VWHPV DQG 1HWZRUNV 86$ SS  >@ 5LGHQ - ³6HUYHU +RQH\SRWV 9V &OLHQW +RQH\SRW´DYDLODEOH DW KWWSZZZ KRQH\QHWRUJQRGHODVWYLVLWHG >@ 6FKU\HQ * ³$Q (PDLO +RQH\SRW $GGUHVVLQJ 6SDPPHUV¶%HKDYLRULQ&ROOHFWLQJDQG$SSO\LQJ $GGUHVVHV´ LQ 3URFHHGLQJV RI WKH WK $QQXDO ,(((IRU,QIRUPDWLRQ$VVXUDQFH:RUNVKRS1@ 6SLW]QHU / ³+RQH\SRWV 'HILQLWLRQV DQG 9DOXH RI +RQH\SRWV´ DYDLODEOH DW  KWWSZZZ WUDFNLQJKDFNHUVFRPSDSHUVKRQH\SRWVKWPOODVW YLVLWHG >@ 6SLW]QHU / ³+RQH\SRWV 6LPSOH &RVW (IIHFWLYH 6ROXWLRQ´ DYDLODEOH DW KWWSZZZ VHFXULW\IRFXVFRPLQIRFXV ODVW YLVLWHG  >@ 6XQ ; :DQJ