pilot evaluation of the StEPPS prototype system

3HUVRQDOL]LQJSDWLHQWHGXFDWLRQXVLQJ,QWHUQHWKHDOWKUHVRXUFHVDQG(35 GDWDSLORWHYDOXDWLRQRIWKH67(336SURWRW\SHV\VWHP



3HUVHSKRQH'RXSL 67$.(68QLWIRUH+HDOWK H:HOIDUH +HOVLQNL)LQODQG SHUVHSKRQHGRXSL#VWDNHVIL  $EVWUDFW

 

0DUN$YDQ:LMN-DFREXV7YDQ:\N -RKDQYDQGHU/HL 'HSDUWPHQWRI0HGLFDO,QIRUPDWLFV (UDVPXV0&5RWWHUGDP7KH1HWKHUODQGV

$ FRUH SUREOHP IRU KHDOWK LQIRUPDWLRQ VHHNHUV LV ORFDWLQJ UHOHYDQW LQIRUPDWLRQ DPRQJ WKH YDVW DPRXQW RI RQOLQH FRQWHQW 3HUVRQDOL]DWLRQ KDVEHHQ VXJJHVWHG DVDVROXWLRQWRHIIHFWLYH:HELQIRUPDWLRQUHWULHYDODQG DOVR H[SORUHG LQ WKH KHDOWKFDUH FRQWH[W EXW WKHQ SULPDULO\ ZLWK SDSHUEDVHG RU ORFDOO\ DYDLODEOH PDWHULDO,QWKLVSDSHUZHUHSRUWRQWKHHYDOXDWLRQRID SURWRW\SH V\VWHP 67(336 ZKLFK XWLOL]HV HOHFWURQLF SDWLHQW UHFRUG GDWD WR SHUVRQDOL]H WKH UHWULHYDO RI KHDOWKLQIRUPDWLRQIURPDYDULHW\RIRQOLQHUHVRXUFHV IRU WKH SXUSRVHV RI SDWLHQW HGXFDWLRQ ,Q D EOLQGHG FOLQLFLDQ DVVHVVPHQW RI :HE SDJHV UHWULHYHG IRU  LQGLYLGXDO SURILOHV RI SDWLHQWV KRVSLWDOL]HG LQ 'XWFK EXUQ FDUH XQLWV 67(336 SHUIRUPHG VLJQLILFDQWO\ EHWWHU WKDQ UDQGRP VHOHFWLRQ RI PDWHULDO S 1   WKHUHE\ SURYLGLQJ HYLGHQFH RI WKH SURRI RI FRQFHSW  67(336 DOVR SHUIRUPHG EHWWHU WKDQ *RRJOH NH\ZRUG VHDUFKHV IRU WKH VSHFLILF SDWLHQW WHVW FDVHV S  1   )XUWKHU UHVHDUFK LV QHFHVVDU\ WR RSWLPL]H V\VWHP SHUIRUPDQFH DV ZHOO DV WR WHVW LWV DSSOLFDELOLW\DQGVXLWDELOLW\IRURWKHUFOLQLFDOGRPDLQV SDUWLFXODUO\ LQ WKH FRQWH[W RI FKURQLF GLVHDVH PDQDJHPHQW 

EURZVLQJ RU LQWHUDFWLQJ ZLWK WKH VLWH > @ 7KLV DSSURDFK KRZHYHU LV QRW SDUWLFXODUO\ VXLWDEOH IRU KHDOWKUHODWHG DSSOLFDWLRQV GXH WR WKH VHQVLWLYLW\ DQG SULYDF\LVVXHVLQYROYHGDVZHEVLWHRZQHUVWKHPVHOYHV DFNQRZOHGJH>@ ,Q WKH KHDOWKFDUH GRPDLQ SHUVRQDOL]DWLRQ KDV EHHQ H[SORUHG LQ WKH FRQWH[W RI SDWLHQW HGXFDWLRQ ZKHUH LW KDV EHHQ PRVW FRPPRQO\UHIHUUHGWR DV WDLORULQJ >@ 7KH DGDSWDWLRQ RI SDWLHQW HGXFDWLRQ PDWHULDO WR WKH FKDUDFWHULVWLFV RI WKH UHFLSLHQW KDV EHHQ VKRZQ WR LPSURYH SDWLHQWV  NQRZOHGJH DQG DELOLW\ WR PDQDJH WKHLU GLVHDVH WKHLU GHFLVLRQ PDNLQJ SURFHVV DQG WKHLU VDWLVIDFWLRQZLWKKHDOWKFDUHVHUYLFHVDQGSURYLGHUV> @&RPSXWHUEDVHGDSSOLFDWLRQVKDYHSOD\HGDFHQWUDO UROH LQ VXSSRUWLQJ WKH SHUVRQDOL]DWLRQ RI SDWLHQW HGXFDWLRQ PDWHULDO >@ (YHQ JUHDWHU EHQHILW FRXOG EH UHDOL]HG E\ WKH DELOLW\ WR XWLOL]H HOHFWURQLF SDWLHQW UHFRUG (35  GDWD DV D GLUHFW VRXUFH RI WKH SDWLHQW  LQIRUPDWLRQ UHFLSLHQW SURILOH KRZHYHU H[SHULHQFH RQ WKLV WRSLF LV OLPLWHG > @ ,Q DGGLWLRQ DOWKRXJK WKH ,QWHUQHW KDV EHHQ XVHG DV DQ LPSRUWDQW GHOLYHU\ RU FRPPXQLFDWLRQ FKDQQHO IRU SDWLHQW HGXFDWLRQ DFWLYLWLHV WKH SRVVLELOLW\ RI XVLQJ KHDOWK LQIRUPDWLRQ DOUHDG\ DYDLODEOH RQOLQH DV SDWLHQW HGXFDWLRQ PDWHULDO KDVQRWEHHQH[SORUHG>@ 







,QWURGXFWLRQ

7KH ,QWHUQHW KRVWV D VXEVWDQWLDO DPRXQW RI KHDOWK UHODWHGLQIRUPDWLRQWKDWLVZLGHO\DFFHVVHGE\SDWLHQWV DQGWKHJHQHUDOSXEOLF$FHQWUDOSUREOHPIRU,QWHUQHW XVHUVLVKRZWREHVWORFDWHDPRQJWKHYDVWDPRXQWVRI RQOLQH FRQWHQW WKH LQIRUPDWLRQ WKDW UHVSRQGV WR WKHLU QHHGV:HEVLWHGHYHORSHUVDQGSURYLGHUVKDYHWULHGWR FDWHU WR WKH QHHG RI HIIHFWLYH LQIRUPDWLRQ UHWULHYDO WKURXJK SHUVRQDOL]DWLRQ >@ :HE VLWH SHUVRQDOL]DWLRQ LV EDVHG RQ WKH FUHDWLRQ RI XVHU SURILOHV WKURXJK D FRPELQDWLRQ RI LQIRUPDWLRQ YROXQWDULO\ HQWHUHG E\ XVHUVDQGLQIRUPDWLRQFDSWXUHGE\WKHLUEHKDYLRUZKLOH

%DFNJURXQG

67(336 LV D SLORW V\VWHP WKDW SHUVRQDOL]HV WKH VHOHFWLRQ RI FRQWHQW FROOHFWHG IURP RQOLQH KHDOWK UHVRXUFHV RQ WKH EDVLV RI VWUXFWXUHG DQG FRGHG (35 GDWD WKDW FRQVWLWXWH D SDWLHQW V SURILOH %\

SHUVRQDOL]DWLRQ  LQ 67(336 ZH PHDQ WKDW JLYHQ VSHFLILFLQIRUPDWLRQRQDSDWLHQWFDVHDVUHSUHVHQWHGLQ (35GDWDWKHV\VWHPLVDEOHWRLGHQWLI\PDWHULDOWKDWLV PRUH VXLWDEOH IRU WKH SDUWLFXODU LQGLYLGXDO DQG WKH SUREOHPVKHVKHZLOOEHGHDOLQJZLWKGXULQJWKHFRXUVH RI D GLVHDVH 7KH SURWRW\SH YHUVLRQ RI WKH V\VWHP LV WDUJHWHG WR WKH GRPDLQ RI EXUQFDUH ZLWK WKH SXUSRVH

RI IDFLOLWDWLQJ WKH SURYLVLRQ RI VXSSRUWLYH LQIRUPDWLRQ WR EXUQ SDWLHQWV DQG WKHLU IDPLOLHV DW WKH SRLQW RI GLVFKDUJHIURPDVSHFLDOL]HGLQWHQVLYHFDUHXQLW 7KH GHVLJQ DQG DUFKLWHFWXUH RI 67(336 DUH H[SODLQHG LQ PRUH GHWDLO HOVHZKHUH >@ +HUH ZH SURYLGH D EULHI RYHUYLHZ RI WKH PDLQ V\VWHP FRPSRQHQWV ZKLFK DUH WKH IROORZLQJ D  D 6WUXFWXUHG 'DWD(QWU\6'( LQWHUIDFHWKDWHQDEOHVWKHFROOHFWLRQ RI VWUXFWXUHG DQG FRGHG (35 GDWD IRU EXUQ FDUH 7KLV PRGXOH DFWV DV WKH VRXUFH RI LQIRUPDWLRQ DERXW WKH SDWLHQWVDQGWKHLUVSHFLILFKHDOWKSUREOHPVLQWKHIRUP RI SDWLHQW SURILOHV UHSUHVHQWHG LQ 8QLILHG 0HGLFDO /DQJXDJH 6\VWHP 80/6  FRGHV E  D FROOHFWLRQ RI RYHU:HESDJHVRUJDQL]HGLQVL[WKHPDWLFVXE FROOHFWLRQV RI WRSLFV RI UHOHYDQFH IRU EXUQ SDWLHQWV 7KLVFROOHFWLRQZKLFKZHFRPSLOHGXVLQJPHWDVHDUFK VRIWZDUH DFWV DV D FURVVVHFWLRQDO VQDSVKRW  RI DYDLODEOH KHDOWKUHODWHG :HE FRQWHQW RQ EXUQ LQMXULHV DQG UHODWHG WUHDWPHQW DQG UHKDELOLWDWLRQ LVVXHV 7KH FROOHFWLRQ LV DOVR WKH WHVW VRXUFH RI FDQGLGDWH SDWLHQW HGXFDWLRQ PDWHULDO F  WKH LQGH[LQJ DQG PDWFKLQJ FRPSRQHQW SURYLGHG E\ &ROOH[LVŠ 7KH &ROOH[LVŠ VRIWZDUH SURYLGHV IRU DXWRPDWHG LQGH[LQJ RIWKH:HE SDJHV LQ WKH 67(336 FROOHFWLRQ RQ WKH EDVLV RI WKH 80/60HWDWKHVDXUXVJHQHUDWLQJSDJHSURILOHVFDOOHG

ILQJHUSULQWV 6XEVHTXHQWO\WKHV\VWHP¶VVHDUFKHQJLQH PDWFKHV WKH SDWLHQW SURILOH DJDLQVW WKRVH RI WKH :HE SDJHV WR VHOHFW WKH PRVW UHOHYDQW GRFXPHQWV DPRQJ WKHWHVWFROOHFWLRQIRUHDFKVSHFLILFLQGLYLGXDO 7KHPDWHULDOVHOHFWHGE\67(336FDQEHSUHVHQWHG HLWKHU LQ HOHFWURQLF RU LQ SULQW IRUP EXW WKHUH LV QR DGDSWDWLRQRIFRQWHQWSUHVHQWDWLRQWRWKHXVHU 

$LPRIWKLVVWXG\ 

7KH DLP RI WKH HYDOXDWLRQ VWXG\ ZDV WR YHULI\ WKDW WKH V\VWHP DFKLHYHV LWV LQWHQGHG WDVN RI SHUVRQDOL]HG VHOHFWLRQ RI RQOLQH KHDOWK LQIRUPDWLRQ FRQWHQW :H DVVXPHGWKDWWKHPLQLPXPUHTXLUHPHQWIRUSURYLQJWKH SHUVRQDOL]LQJ DELOLW\ RI 67(336 ZRXOG EH WR GHPRQVWUDWH WKDW WKH V\VWHP DFKLHYHV EHWWHU SHUVRQDOL]DWLRQ UHVXOWV WKDQ FKDQFH LH D UDQGRP VHOHFWLRQRIGRFXPHQWV)RUWKLVSXUSRVHWKHUHOHYDQFH RI WKH :HE SDJHV UHWULHYHG E\ 67(336 IURP LWV WHVW FROOHFWLRQZDVFRPSDUHGDJDLQVWWKHUHOHYDQFHRISDJHV UHWULHYHG UDQGRPO\ IURP WKH VDPH FROOHFWLRQ )XUWKHU IRU DQ LQGLFDWLYH DVVHVVPHQW RI WKH V\VWHP V DGGHG YDOXH  DJDLQVW WKH FXUUHQWO\ PRVW FRPPRQO\ XVHG PHWKRGIRURQOLQHLQIRUPDWLRQUHWULHYDOLHWKHXVHRI DVHDUFKHQJLQHZLWKNH\ZRUGVHDUFKZHFRPSDUHGWKH SHUIRUPDQFHRI67(336ZLWKWKDWRIDSRSXODUVHDUFK HQJLQH*RRJOH

$V PHDVXUHPHQW RI SHUVRQDOL]DWLRQ ZH XVHG WKH DYHUDJHGUHOHYDQFHVFRUHDVVLJQHGE\EOLQGHGFOLQLFLDQ UHYLHZHUV WR WKH :HE SDJHV UHWULHYHG WKURXJK HDFK PHWKRGDJDLQVWWKHFRUUHVSRQGLQJSDWLHQWSURILOH 

0DWHULDOVDQG0HWKRGV 

3DWLHQWFDVHVDQGSURILOHV 

$WRWDORIFDVHUHFRUGVRISDWLHQWVWUHDWHGLQWZR RIWKHWKUHHVSHFLDOL]HGEXUQFHQWHUVLQWKH1HWKHUODQGV %HYHUZLMNDQG5RWWHUGDP GXULQJWKH\HDUVDQG  ZHUH VHOHFWHG E\ ORFDO SK\VLFLDQV DV UHSUHVHQWDWLYHRIWKHLUFHQWHUV XVXDOFDVHPL[2QHRI WKHDXWKRUV3' H[WUDFWHGGDWDIURPWKHRULJLQDOSDSHU UHFRUGVDQGXVHGWKHGHGLFDWHG67(3366'(LQWHUIDFH IRUEXUQFDUHWRSRSXODWHWKHV\VWHP VSDWLHQWGDWDEDVH 6RPH SDWLHQWV  HLWKHU EHFDXVH RI QHZ EXUQ LQMXU\ LQFLGHQWV RU IROORZXS WUHDWPHQW  KDG PRUH WKDQ RQH DGPLVVLRQDQGWKHUHIRUHPRUHWKDQRQHUHFRUGVRIFDUH +RZHYHU RQO\ WKH ILUVW UHFRUG DYDLODEOH IRU HDFK SDWLHQW ZDV XVHG IRU WKH HYDOXDWLRQ VWXG\ PDNLQJ D WRWDORIHOLJLEOHUHFRUGV ,Q 67(336 WKH SDWLHQW SURILOH LV D 80/6WDJJHG VXEVHWRIWKHGDWDFRQWDLQHGLQWKH(35DWWKHWLPHRI GLVFKDUJHVHH7DEOHILUVWFROXPQ 7KHVHOHFWLRQRI SDWLHQW SURILOH FKDUDFWHULVWLFV LV EDVHG RQ WKH PDLQ HOHPHQWVRIWKH'XWFK%XUQV,QIRUPDWLRQ6\VWHPGDWD VHW H[FOXGLQJ VHFWLRQV WKDW DUH VROHO\ UHODWHG WR LQ KRVSLWDO WUHDWPHQW >@ $ VLPLODU VHOHFWLRQ KDV EHHQ XVHG LQ WKH LQGLFDWRUV RI EXUQ FDVH FRPSOH[LW\ SURSRVHG E\ WKH %ULWLVK 1DWLRQDO %XUQ &DUH 5HYLHZ &RPPLWWHHVHH7DEOHVHFRQGFROXPQ >@ )RUWKHSXUSRVH RIVHDUFKLQJZLWK*RRJOHZHWRRN LQWR DFFRXQW WKH OHIWWR ULJKW DVVHVVPHQW RI HQWHUHG NH\ZRUGWHUPVDQGUHRUGHUHGWKHFKDUDFWHULVWLFVRIWKH SDWLHQWSURILOHLQDQRUGHURILPSRUWDQFHPRUHSHUWLQHQW WR WKH FRQWH[W RI VHDUFKLQJ IRU LQIRUPDWLRQ SRVW GLVFKDUJH DV IROORZV WHUPV GHVFULELQJ WKH (WLRORJ\ ZHUH OLVWHG ILUVW IROORZHG E\ WHUPV GHVFULELQJ WKH 3UREOHPV RQ GLVFKDUJH WKHQ WHUPV GHVFULELQJ SRVVLEOH &RPSOLFDWLRQV DQG VR IRUWKVHHDOVR7DEOH WKLUGFROXPQ  

5HYLHZ0DWHULDO

 )RU HDFK RI WKH  SDWLHQW FDVHV LQ WKH VWXG\ ZH FRPSLOHGDUHYLHZELQGHUZLWKWKHIROORZLQJPDWHULDO D $SDWLHQWFDVHVXPPDU\ E &DQGLGDWHPDWHULDOIRUSDWLHQWHGXFDWLRQWDVNV GHULYHGIURPRQOLQHUHVRXUFHV $WRWDORIILIWHHQ:HESDJHVZHUHDOORFDWHGWR HDFKSDWLHQWSURILOHGLVWULEXWHGDVIROORZV



WKHILUVWILYH:HESDJHVUHWULHYHGE\WKH 67(336V\VWHPUHSUHVHQWLQJWKH SHUVRQDOL]HGVHOHFWLRQRIPDWHULDORQWKHEDVLV RIWKHSDWLHQWSURILOH ILYH:HESDJHVUDQGRPO\VHOHFWHGIURPWKH 67(336FROOHFWLRQV WKHILUVWILYH:HESDJHVLGHQWLILHGWKURXJKD EDVLF*RRJOHVHDUFKXVLQJNH\ZRUGV UHIOHFWLQJWKHSDWLHQW VSURILOH F $UHYLHZIRUPZKHUHUHYLHZHUVHQWHUHGWKHLU UHOHYDQFHVFRUHVIRUHDFKRIWKHILIWHHQ:HE SDJHVXQGHUDVVHVVPHQW

*HQHUDWLRQRIUHYLHZPDWHULDO

 3DWLHQW &DVH 6XPPDU\ 67(336 KDV WKH DELOLW\ WR JHQHUDWHDEDVLFWH[WXDORYHUYLHZRIWKHSDWLHQWUHFRUG FRPSULVHG E\ D OLVW RI WKH SDWLHQW DWWULEXWHV VHOHFWHG GXULQJ GDWD HQWU\ DQG WKHLU FRUUHVSRQGLQJ YDOXHV DV ZHOODVSRWHQWLDODFFRPSDQ\LQJFRPPHQWVLQIUHHWH[W 2Q WKH EDVLV RI WKHVH UHFRUG RYHUYLHZV RQH RI WKH DXWKRUV3' SURGXFHGWKHFDVHVXPPDULHVXVHGLQWKH HYDOXDWLRQVWXG\VRDVWRFRYHUWKHLQIRUPDWLRQUHODWHG WRWKHSDWLHQWSURILOH  67(336 :HE 3DJHV )RU HDFK SDWLHQW FDVH ZH XVHG 67(336 WR PDWFK WKH SDWLHQW SURILOH DJDLQVW WKH :HE SDJHV LQ LWV FROOHFWLRQV DQG H[WUDFWHG WKH ILUVW ILYH SDJHVRIWKHUHVXOWVIRUWKHHYDOXDWLRQ,QFDVHVZKHUH WKH UHVXOWV FRQWDLQHG RYHUODSSLQJ SDJHV EHFDXVH RI D GHJUHH RI UHGXQGDQF\ EHWZHHQ WKH 67(336 VXE FROOHFWLRQV  ZH LJQRUHG WKH GXSOLFDWH SDJHV DQG XVHG WKHQH[WXQLTXHSDJH  5DQGRP :HE 3DJHV $OO WKH :HE SDJHV LQ WKH 67(336 WKHPDWLF FROOHFWLRQV KDYH DQ LGHQWLI\LQJ QXPEHUDVVLJQHGGXULQJWKHGRZQORDGLQJDQGVWRUDJH SURFHVV 8VLQJ WKH 5DQGRP 1XPEHUV *HQHUDWRU 'DWD $QDO\VLV WRRO RI ([FHO ZH SURGXFHG D OLVW RI UDQGRP QXPEHUV WKDW ZH GLVWULEXWHG DFURVV WKH 67(336 VXE FROOHFWLRQV:HWKHQORRNHGLQHDFKVXEFROOHFWLRQIRU WKH :HE SDJH EHDULQJ WKH FRUUHVSRQGLQJ QXPEHU DQG DVVLJQHG LW WR D SDWLHQW FDVH ,I QR SDJH ZDV IRXQG LQ WKHFROOHFWLRQHJSDJHVLQ3RZHU3RLQWRUDVSIRUPDW ZKLFKZHUHQRWVWRUHGGXULQJWKHGRZQORDGLQJSKDVH  ZH SURFHHGHG WR WKH QH[W VXEFROOHFWLRQ XQWLO DOO SDWLHQW FDVHV KDG ILYH XQLTXH :HE SDJHV DOORFDWHG WR WKHP  *RRJOH :HE 3DJHV :H VHDUFKHG WKURXJK WKH EDVLF VHDUFK LQWHUIDFH RI *RRJOH DQG XVHG DV VHDUFK WHUPV NH\ZRUGV FRUUHVSRQGLQJ WR WKH SDWLHQW SURILOH FDWHJRULHV ,I QR UHVXOWV ZHUH UHWXUQHG GXH WR WKH OHQJWK RI WKH TXHU\  ZH GURSSHG WHUPV VHTXHQWLDOO\

IURP WKH VHDUFK VWULQJ LQ UHYHUVH RUGHU RI WKHLU DSSHDUDQFH LH ILUVW WKH WHUPV RQ 'HPRJUDSKLFV WKHQ RQ 3DVW +LVWRU\ HWF (YHU\ WLPH ZH GURSSHG D WHUP ZH UDQ WKH PRGLILHG VKRUWHQHG TXHU\ DQG FKHFNHG WKH UHVXOWV ,I WKHUH ZHUH QR RU OHVV WKDQ  UHVXOWV UHWXUQHG ZH UHSHDWHG WKH DIRUHPHQWLRQHG SURFHGXUH :H KDOWHG WKH VHDUFK DV VRRQ DV D TXHU\ UHWXUQHG D PLQLPXP RI ILYH RU PRUH XQLTXH UHVXOWV ZKLFK ZH FRXOG WKHQ XVH LQ WKH 67(336 HYDOXDWLRQ VWXG\ 

3UHVHQWDWLRQRIUHYLHZPDWHULDO 

7R DFFRXQW IRU WKH HIIHFW RI SUHVHQWDWLRQ RUGHU LQ WKH UHYLHZ SURFHVV ZH XVHG WKH 5DQGRP 1XPEHUV *HQHUDWRU 'DWD $QDO\VLV WRRO RI ([FHO DQG DVVLJQHG UDQGRPQXPEHUVWRDOOILIWHHQ:HESDJHVUHWULHYHGSHU SDWLHQW FDVH 6XEVHTXHQWO\ ZH RUJDQL]HG WKH :HE SDJHV LQ DVFHQGLQJ RUGHU RI WKH UDQGRP QXPEHUV DQG UHQDPHGWKHPDV'RFXPHQW'RFXPHQWHWF :H SUHVHQWHG WKH :HE SDJHV WR WKH UHYLHZHUV LQ SULQW UDWKHU WKDQ RQ VFUHHQ VLQFH RXU SULPDU\ WDUJHW ZDV WR DVVHVV WKH FRQWHQW RI WKH SDJHV DQG QRW WKHLU SUHVHQWDWLRQ RU LQWHUDFWLYLW\ IHDWXUHV ,Q DGGLWLRQ RIIHULQJWKHPDWHULDOLQSDSHUIRUPDOORZHGXVWRHDVLO\ PDVN WKHRULJLQRIWKHSDJHDVZHOODVWRDFFRXQWIRU WKH YDU\LQJ OHQJWK RI :HE SDJHV E\ WUXQFDWLQJ HDFK :HESDJHSULQWRXWWRDOHQJWKRIWHQ$SDJHV 

5HYLHZWDVN 

7KH :HE SDJHV LGHQWLILHG WKURXJK WKH WKUHH GLIIHUHQW UHWULHYDO PHWKRGV ZHUH DVVHVVHG IRU WKHLU UHOHYDQFHE\WZRRIWKHDXWKRUVZKRDFWHGDVUHYLHZHUV 0Y: -Y:  %RWK UHYLHZHUV KDYH D EDFNJURXQG LQ JHQHUDO SUDFWLFH DQG DUH ZRUNLQJ LQ PHGLFDO LQIRUPDWLFV EXW KDYH QRW EHHQ LQYROYHG LQ WKH GHVLJQ DQG GHYHORSPHQW RI 67(336 7KH UHYLHZLQJ SURFHVV ZDV RYHUVHHQ E\ D PRGHUDWRU -YG/  %RWK WKH UHYLHZHUV DQG WKH PRGHUDWRU ZHUH EOLQGHG DV WR WKH VRXUFH RI WKH :HE SDJHV XQGHU UHYLHZ WKH UHWULHYDO PHWKRGE\ZKLFKHDFKSDJHZDVVHOHFWHGDVZHOODVWR WKH UDQNLQJ RUGHU RI WKH SDJHV E\ HDFK PHWKRG 67(336DQG*RRJOH  7KHUHYLHZHUVZHUHDVNHGWRILUVWUHDGFDUHIXOO\WKH VXPPDU\RIHDFKSDWLHQWFDVH7KHQWKH\KDGWRDVVHVV WKH FRUUHVSRQGLQJ ILIWHHQ :HE SDJHV DV WR WKHLU WRSLF DQGFRQWHQWUHOHYDQFHIRUWKHJLYHQSDWLHQWSURILOHDQG DVVLJQ D VFRUH EHWZHHQ  ZKHUH   WRWDOO\ LUUHOHYDQWDQG KLJKO\UHOHYDQW  (DFK UHYLHZHU UDWHG WKH SDJHV LQGHSHQGHQWO\ DQG RQO\LQFDVHWKHVFRUHV GLIIHUHQFHZDVHTXDORUODUJHU WKDQ  SRLQWV WKH WZR UHYLHZHUV GLVFXVVHG DQG

UHFRQFLOHG  WKHLU UDWLQJV E\ RQH RI WKHP FKDQJLQJ KLV  RULJLQDOO\JLYHQVFRUH  7DEOH2YHUYLHZRISDWLHQWSURILOHFKDUDFWHULVWLFV 

67(336SURILOH80/6&RGLQJ

• • • •

• • • • • • • • 

*HQGHU $JH 3DVW+LVWRU\ $FFLGHQW'DWD • $EVHQFHRIEXUQV • ,QWHQWLRQ • $FFLGHQWPHFKDQLVP • 3ODFHRIDFFLGHQW • $OFRKRODQGGUXJVXVH • 9LROHQFH • (WLRORJ\JURXS • (VFKDURWRP\LQFLVLRQV ,QKDODWLRQ,QMXU\LQYHVWLJDWLRQV /RFDWLRQ H[WHQWRIEXUQV &RQVHUYDWLYH:RXQG7UHDWPHQW 6XUJLFDO:RXQG7UHDWPHQW %DFWHULRORJ\ 3V\FKRORJ\DQG3V\FKLDWU\ 0RUWDOLW\ 'LVFKDUJH • $GYLFH • 3UREOHPOLVW

%ULWLVK%XUQ$VVRFLDWLRQ

'HPRJUDSKLFGDWD • JHQGHU • DJHJURXS • 3DVWKLVWRU\ H[LVWLQJ FRQGLWLRQV DW WKH WLPH RI DFFLGHQW  • (WLRORJ\ PHFKDQLVPRILQMXU\RU FRPSOH[QRQEXUQFRQGLWLRQ • 6HYHULW\RILQMXU\ • H[WHQWDQGORFDWLRQRIEXUQV • LQKDODWLRQLQMXU\ • FRPSOH[QRQEXUQ • &RQVHUYDWLYHWUHDWPHQW • 6XUJLFDOSURFHGXUHV • &RPSOLFDWLRQV • 3UREOHPVRQGLVFKDUJH • 3V\FKRVRFLDODVSHFWV • SV\FKLDWULFSUREOHPV • VXLFLGH • YLROHQFH • VRFLDOSUREOHPV 

•

 

'DWD$QDO\VLV 

:HXVHGWKH6366VWDWLVWLFDOSDFNDJHYHUVLRQ  IRUWKHGDWDDQDO\VLV:HILUVWFDOFXODWHGWKHDYHUDJHRI WKH VFRUHV WKH WZR UHYLHZHUV KDG JLYHQ WR HDFK :HE SDJH &RQVHTXHQWO\ ZH FDOFXODWHG WKH PHDQ RI WKH DYHUDJHUHYLHZHUVFRUHVIRUWKHSDJHVVHOHFWHGE\HDFK UHWULHYDO PHWKRG DFURVV WKH SDWLHQW FDVHV LQ WKH VWXG\ 6LQFH WKH DVVXPSWLRQ RI QRUPDO GLVWULEXWLRQ ZDV QRW IXOILOOHG E\ WKH GDWD ZH XVHG WKH QRQSDUDPHWULF 0DQQ:KLWQH\ WHVW WR FKHFN WKH VWDWLVWLF VLJQLILFDQFH RI WKH GLIIHUHQFHV EHWZHHQ WKH PHDQ DYHUDJH VFRUHV WKDWHDFKUHWULHYDOPHWKRGKDGDFKLHYHG 

5HVXOWV 

7KHUHYLHZRIWKHHYDOXDWLRQPDWHULDOWRRNSODFHLQ WZR URXQGV HDFK FRPSOHWHG LQ DSSUR[LPDWHO\ ILYH KRXUV ZLWK DQ LQWHUYDO RI WZR ZHHNV )LIWHHQ FDVHV ZHUH UHYLHZHG LQ WKH ILUVW URXQG DQG WZHOYH FDVHV LQ

3DWLHQWSURILOH*RRJOHVHDUFK

•

• • • • • • • 

(WLRORJ\ PHFKDQLVPRILQMXU\ RUFRPSOH[QRQEXUQFRQGLWLRQ LQFOXGLQJLQWHQWLRQ  3UREOHPVRQGLVFKDUJH &RPSOLFDWLRQV GXULQJKRVSLWDOL]DWLRQ  3V\FKRVRFLDODVSHFWV &RQVHUYDWLYHWUHDWPHQW 6XUJLFDOSURFHGXUHV 3DVWKLVWRU\ 'HPRJUDSKLFV

WKH VHFRQG URXQG ,Q WRWDO  :HE SDJHV ZHUH DVVHVVHG  SDJHV IRU HDFK UHWULHYDO PHWKRG 7KH PHDQ RI WKH DYHUDJH UHOHYDQFH VFRUH IRU 67(336 PDWHULDO ZDV  6'   ZKLOH WKH UDQGRPO\ VHOHFWHG PDWHULDO KDG D PHDQ DYHUDJH UHOHYDQFH VFRUH RI6' 7KHPDWHULDOLGHQWLILHGWKURXJKWKH *RRJOH NH\ZRUG VHDUFKHV KDG D PHDQ DYHUDJH UHOHYDQFHVFRUHRI6' 7KHSHUIRUPDQFHRI ERWK67(336DQG*RRJOHZDVVLJQLILFDQWO\EHWWHUWKDQ WKDW RI UDQGRP VHOHFWLRQ ZLWK ERWK SYDOXHV  67(336 DOVR SHUIRUPHG EHWWHU WKDQ *RRJOH NH\ZRUG VHDUFKHV EXW ZLWK D VPDOOHU VWDWLVWLFDO VLJQLILFDQFH S   

'LVFXVVLRQ 

0HWKRGV DQG DSSOLFDWLRQV WR VXSSRUW XVHUV LQ LQIRUPDWLRQ UHWULHYDO WDVNV KDYH EHHQ D PDLQ UHVHDUFK WKHPH LQ PHGLFDO LQIRUPDWLFV +RZHYHU PXFK RI WKH ZRUN LQ WKLV DUHD KDV FRQFHQWUDWHG RQ DGGUHVVLQJ H[FOXVLYHO\ RU SULPDULO\ WKH QHHGV RI KHDOWKFDUH SURIHVVLRQDOVDQGDVDUHVXOWKDVIRFXVHGRQWKHXVHRI

VFLHQWLILF OLWHUDWXUH RU SURIHVVLRQDOO\ RULHQWHG RQOLQH UHVRXUFHV>@ ,Q 67(336 ZH KDYH DSSURDFKHG WKH SUREOHP IURP WKH YLHZSRLQW RI SDWLHQWV DQG OD\SHUVRQV DQG KDYH WKHUHIRUH ZRUNHG ZLWK JHQHUDO QRQTXDOLW\ FRQWUROOHG KHDOWK LQIRUPDWLRQ UHVRXUFHV DYDLODEOH RQOLQH 2WKHU UHVHDUFKHUV LQ WKH DUHD RI FRQVXPHURULHQWHG ,QWHUQHW KHDOWK LQIRUPDWLRQ UHWULHYDO KDYH H[SORUHG DSSURDFKHV EDVHGRQ1DWXUDO/DQJXDJH3URFHVVLQJWHFKQLTXHV> @ DQG KHDOWK JHRPDWLFV >@ EXW KDYH ZRUNHG RQO\ ZLWKDUHVWULFWHGSUHGHILQHGVHOHFWLRQRI:HEVLWHVDQG DV D UHVXOW KDYH QRW WHVWHG WKH V\VWHPV  DELOLW\ WR SHUVRQDOL]H VHOHFWLRQ DPRQJ D ODUJH YDULHW\ RI UHVRXUFHV 7KH SLORW HYDOXDWLRQ VWXG\ ZH UHSRUW RQ LQ WKLV SDSHU KDV SURYLGHG SUHOLPLQDU\ HYLGHQFH RI WKH IHDVLELOLW\ RIDQRYHO DSSURDFKWR SHUVRQDOL]HGSDWLHQW HGXFDWLRQ XWLOL]LQJ RQOLQH KHDOWK LQIRUPDWLRQ PDWHULDO VHOHFWHGRQWKHEDVLVRIVWUXFWXUHGDQGFRGHG(35GDWD :HKDYHVKRZQWKDW67(336KDVWKHFDSDFLW\WRPDNH WKH UHWULHYDORI RQOLQH FRQWHQW PRUH HIIHFWLYH LQ WHUPV RI LWV WRSLFDO UHOHYDQFH FRPSDUHG WR WKH H[SHULHQFH WKDWLVFXUUHQWO\DYDLODEOHWRKHDOWKUHODWHGLQIRUPDWLRQ VHHNHUV ,Q67(336WKHLQWHJUDWLRQRIWKH(35ZLWKRQOLQH KHDOWKUHODWHG FRQWHQW HQDEOHV WKH SHUVRQDOL]HG VHOHFWLRQ RI HGXFDWLRQ PDWHULDO IRU SDWLHQWV DQG WKHLU IDPLOLHV DV D GLUHFW E\SURGXFW RI FOLQLFLDQ GRFXPHQWDWLRQ DFWLYLWLHV 7KXV 67(336 SURYLGHV D SODXVLEOHVROXWLRQWRRQHRIWKHREVWDFOHVKLQGHULQJWKH VXFFHVV RI SDWLHQW HGXFDWLRQ DFWLYLWLHV WKH ODFN RI VXLWDEOH WRROV DQG PDWHULDOV IRU DYDLODELOLW\ RI LQIRUPDWLRQ DW WKH SRLQW DQG WLPH RI SDWLHQWFOLQLFLDQ LQWHUDFWLRQ (DUO\ ZRUN RQ WDLORUHG SDWLHQW HGXFDWLRQ KDV SULPDULO\ H[SORUHG WKH XVH RI $UWLILFLDO ,QWHOOLJHQFH WHFKQLTXHV7KHUHVXOWLQJV\VWHPVKDYHEHHQEDVHGRQ WKHXVHRINQRZOHGJHEDVHVFRQWDLQLQJSUHGHILQHGWH[W PHVVDJHVIURPZKLFKFRQWHQWZDVVHOHFWHGRQWKHEDVLV RI SURYLGHG UXOHV >@ 7KHUH ZHUH WZR PDLQ SUREOHPVLGHQWLILHGWKHFRPSOH[LW\RIWKHV\VWHPVWKDW PDGH WKHP LQDFFHVVLEOH WR KHDOWKFDUH SURIHVVLRQDOV DQG WKH GLIILFXOW\ RI SURGXFLQJ DQG PDLQWDLQLQJ WKH OLEUDU\ RI PHVVDJHV ,Q DGGLWLRQ DOWKRXJK WKH XVH RI HOHFWURQLFSDWLHQWUHFRUGGDWDKDGEHHQDVVXPHGLWZDV QRWDFWXDOO\LPSOHPHQWHGLQDQDXWRPDWHGIDVKLRQDQG SHUVRQDOL]DWLRQZDVQRWVWXGLHGIURPWKHSHUVSHFWLYHRI V\VWHPSHUIRUPDQFH>@ 67(336 FRPELQHV H[LVWLQJ WRROV HLWKHU IUHHO\ RU FRPPHUFLDOO\ DYDLODEOH LQ RUGHU WR SURGXFH WKH GHVLUDEOH SHUVRQDOL]DWLRQ IXQFWLRQDOLW\ 7KH XVH RI :HEEDVHG KHDOWK LQIRUPDWLRQ FRQWHQW DV D VRXUFH RI SDWLHQW HGXFDWLRQ PDWHULDO FDQ SURYLGH D IHDVLEOH DOWHUQDWLYH WR WKH RSWLRQ RI SUHGHILQHG WH[W IRU

SHUVRQDOL]HG PHVVDJHV WKHUHE\ UHGXFLQJ WKH GHPDQGV RQ V\VWHP PDLQWHQDQFH ,Q VSLWH WKH OLPLWDWLRQV RI TXDOLW\RQOLQHKHDOWKLQIRUPDWLRQPDWHULDOKDVIHDWXUHV WKDW PDNH LW DWWUDFWLYH IRU SHUVRQDOL]HG SDWLHQW HGXFDWLRQ VLQFH LW LV HDVLO\ XSGDWHG DQG VXLWDEOH IRU DGDSWDWLRQ WR WKH HQG UHFLSLHQW ,Q DGGLWLRQ XVLQJ RQOLQH FRQWHQW LQ SDWLHQW HGXFDWLRQ DFWLYLWLHV PHDQV WKDWWKHDSSOLFDWLRQFDQEHPDGHDYDLODEOHWRHQGXVHUV EH\RQG OLPLWDWLRQV RI VSDFH DQG WLPH (QKDQFHG DYDLODELOLW\ LV SDUWLFXODUO\ VLJQLILFDQW IRU FRQGLWLRQV VXFKDVEXUQLQMXULHVZKHUHH[SHUWLQIRUPDWLRQPD\EH DQGRIWHQLVPLVVLQJORFDOO\ZKLOHLWLVFHQWUDOWRWKH SDWLHQW KHDOLQJ UHKDELOLWDWLRQ DQG UHFXSHUDWLRQ SURFHVV $Q LPSRUWDQW OLPLWDWLRQ RI WKLV HYDOXDWLRQ VWXG\ LV WKDW WKH UHOHYDQFH DVVHVVPHQWV RI WKH UHYLHZHG :HE PDWHULDOZHUHQRWSHUIRUPHGE\WKHLQWHQGHGUHFLSLHQWV RI V\VWHP RXWSXW LH SDWLHQWV WKHPVHOYHV +RZHYHU VLQFH ZH KDYH XVHG UHWURVSHFWLYH SDWLHQW UHFRUGV VXFK DQRSWLRQZDVQRWGLUHFWO\DYDLODEOHQRUGLGZHGHHP LW QHFHVVDU\ IRU WKH SXUSRVHV RI SURWRW\SH HYDOXDWLRQ $Q DGGLWLRQDO REVWDFOH IRU WKH LQFOXVLRQ RI SDWLHQW UHYLHZHUV LQ WKH VWXG\ ZDV WKDW RI ODQJXDJH 7KH UHIHUHQFH SDWLHQW SRSXODWLRQ ZDV 'XWFK VSHDNLQJ +RZHYHU ERWK WKH SDWLHQW SURILOHV DQG WKH :HE PDWHULDO XVHG LQ WKH VWXG\ ZHUH DYDLODEOH LQ (QJOLVK GXH WR WKH OLPLWHG DYDLODELOLW\ RI 'XWFK WHUPV LQ WKH 80/6 0HWDWKHVDXUXV DW WKH WLPH RI EXLOGLQJ WKH SURWRW\SH V\VWHP 0RUHRYHU WKH GHVLJQ RI 67(336 KDVDVVXPHGWKDWFOLQLFLDQVQHHGWRUHYLHZWKHPDWHULDO IRULWVVXLWDELOLW\IRUSDWLHQWHGXFDWLRQSXUSRVHVEHIRUH LWLVPDGHDYDLODEOHWRSDWLHQWV7KURXJKWKHHYDOXDWLRQ VWXG\ZHKDYHJDLQHGVRPHLQLWLDOXQGHUVWDQGLQJZLWK UHJDUGWRWKHSUDFWLFDOGHPDQGVRIPDWHULDOUHYLHZDQG ZH KDYH FROOHFWHG GDWD WKDW FDQ EH XWLOL]HG IXUWKHU LQ DVVHVVLQJ WKH GHJUHH RI FRQFRUGDQFH EHWZHHQ SURIHVVLRQDODQGSDWLHQWSHUFHSWLRQVRIUHOHYDQFH 

)XWXUHZRUN 

,Q WKLV VWXG\ ZH KDYH DVVHVVHG WKH SHUIRUPDQFH RI WKH67(336V\VWHPDVDZKROH)XUWKHUVWXGLHVZLOOEH QHHGHG LQ RUGHU WR FODULI\ WKH UROH RI HDFK V\VWHP FRPSRQHQWDQGRSWLPL]HV\VWHPSHUIRUPDQFH,QRUGHU WR DFFRXQW IRU WKH LPSDFW RI SDWLHQW SURILOH YDULDELOLW\ RQ WKH UHOHYDQFH RI WKH VHOHFWHG PDWHULDO H[SHULPHQWDWLRQ ZLWK SURILOHV RI YDU\LQJ OHQJWKV DQG FRQWHQWVVKRXOGEHSHUIRUPHG6XFKWHVWLQJZRXOGDOVR SURYLGH IXUWKHU LQVLJKW ZLWK UHJDUG WR WKH GHVLUHG DV ZHOODVDFKLHYDEOHJUDQXODULW\RIWKHSDWLHQWSURILOHIRU SHUVRQDOL]DWLRQSXUSRVHV>@ 7KHUH LV D QHHG WR FODULI\ IXUWKHU WKH UROH RQOLQH KHDOWK LQIRUPDWLRQ PDWHULDO FDQ SOD\ LQ SDWLHQW

HGXFDWLRQ VWUDWHJLHV $ FRPSDULVRQ ZLWK FXUUHQWO\ DYDLODEOH SDSHUEDVHG SDWLHQW HGXFDWLRQ PDWHULDOV DQG WKHLU UHVSHFWLYH VWUHQJWKV DQG ZHDNQHVVHV LQ WKHLU DELOLW\ WR VDWLVI\ LQGLYLGXDO SDWLHQW QHHGV ZRXOG EH SDUWLFXODUO\ LQIRUPDWLYH ,Q WKH VDPH FRQWH[W D WKRURXJK DQDO\VLV RI WKH FRVWV DQG EHQHILWV FRQQHFWHG ZLWK HDFK PHWKRG RI SDWLHQW HGXFDWLRQ PDWHULDO SURGXFWLRQ VKRXOG EH SHUIRUPHG LQFOXGLQJ WKH FRVWV IRUPDLQWHQDQFHDQGXSGDWH )LQDOO\ 67(336 KDV DGGUHVVHG RQO\ WKH SHUVRQDOL]HG VHOHFWLRQ RI RQOLQH KHDOWK LQIRUPDWLRQ FRQWHQW 3UHVHQWDWLRQ RI WKH PDWHULDO LV DQ HTXDOO\ LPSRUWDQW DVSHFWWKDWVKRXOGEHWKHREMHFWRIIXWXUHUHVHDUFK>@

&RQFOXVLRQV

:H KDYH GHPRQVWUDWHG WKH IHDVLELOLW\ RI WKH 67(336DSSURDFKIRUSDWLHQWHGXFDWLRQLQWKHGRPDLQ RI EXUQ FDUH )XUWKHU UHVHDUFK ZLOO EH QHFHVVDU\ WR RSWLPL]H V\VWHP SHUIRUPDQFH DV ZHOO DV WR WHVW LWV DSSOLFDELOLW\DQGVXLWDELOLW\IRURWKHUFOLQLFDOGRPDLQV 7KH JURZLQJ HPSKDVLV RQ GLVHDVH PDQDJHPHQW SURJUDPV DQG VHOIFDUH LQLWLDWLYHV PDNHV VXFK LQYHVWLJDWLRQVZRUWKZKLOH  $FNQRZOHGJHPHQWV 7KH DXWKRUV ZLVK WR WKDQN - 'LHOHPDQ IRU KHU DVVLVWDQFHLQDQDO\]LQJWKHGDWDDQG%6DQ-RVpDQG. /DPSH IRU WKHLU FRQVWUXFWLYH FRPPHQWDU\ WR HDUOLHU YHUVLRQVRIWKHSDSHU 

5HIHUHQFHV

 >@5LHFNHQ ' 3HUVRQDOL]HG YLHZV RI SHUVRQDOL]DWLRQ &RPPRIWKH$&0

>@0DQEHU 8 3DWHO $ 5RELQVRQ - ([SHULHQFH ZLWK SHUVRQDOL]DWLRQRQ@6FKRQEHUJ ( &RILQR 7 +RFK 5 3RGODVHFN 0

6SUDUDJHQ 6 0HDVXULQJ VXFFHVV &RP $&0   >@%HQWDO '6 &DZVH\ $ -RQHV 5 3DWLHQW LQIRUPDWLRQ V\VWHPVWKDWWDLORUWRWKHLQGLYLGXDO3DW(GX&RXQV  >@7DQJ 3& 1HZFRPE & ,QIRUPLQJ 3DWLHQWV $ JXLGH IRU SURYLGLQJ SDWLHQW KHDOWK LQIRUPDWLRQ -$0,$   >@5HYHUH ' 'XQEDU 3- 5HYLHZ RI FRPSXWHUJHQHUDWHG RXWSDWLHQW KHDOWK EHKDYLRU LQWHUYHQWLRQV &OLQLFDO HQFRXQWHUVLQ$EVHQWLD-$0,$ >@6NLQQHU&66LHJIULHG-&.HJOHU0&6WUHFKHU9-7KH SRWHQWLDORIFRPSXWHUVLQSDWLHQWHGXFDWLRQ3DWLHQW(GXF &RXQV1RY  >@-RQHV53HDUVRQ-0F*UHJRU6&DZVH\$-%DUUHW$HW DO 5DQGRPLVHG WULDO RI SHUVRQDOLVHG FRPSXWHU EDVHG

LQIRUPDWLRQ IRU FDQFHU SDWLHQWV %0-   >@-RQHV 5% 3HDUVRQ - &DZVH\ $- %HQWDO ' %DUUHWW $ :KLWH - :KLWH &$ *LOPRXU :+  (IIHFW RI GLIIHUHQW IRUPV RI LQIRUPDWLRQ SURGXFHG IRU FDQFHU SDWLHQWV RQ WKHLUXVHRIWKHLQIRUPDWLRQVRFLDOVXSSRUWDQGDQ[LHW\ UDQGRPLVHGWULDO%0-$SU  >@5LFKDUGV % &ROPDQ $: +ROOLQJVZRUWK 5$ 7KH FXUUHQW DQG IXWXUH UROH RI WKH LQWHUQHW LQ SDWLHQW HGXFDWLRQ,QW-0HG,QIRUP >@'RXSL 3 YDQ GHU /HL - 7RZDUGV SHUVRQDOL]HG ,QWHUQHW KHDOWK LQIRUPDWLRQ WKH 67(336 DUFKLWHFWXUH 0HG ,QI ,QWHUQHW0HG  >@7DDO / 2HQ ,00+ GHQ 'DDV ) 0XOGHU7ROOHQDDU - %HLUODHQ 3 7KH 'XWFK %XUQV ,QIRUPDWLRQ 6\VWHP =RUJ $GPLQLVWUDWLHHQ,QIRUPDWLHLQ'XWFK  >@1DWLRQDO %XUQ &DUH 5HYLHZ &RPPLWWHH 5HSRUW 6WDQGDUGV DQG 6WUDWHJ\ IRU %XUQ &DUH  $YDLODEOH DWKWWSZZZEDSVFRXNGRFXPHQWVQEFUSGI >@+HUVK :5 +LFNDP '+ +D\QHV % 0F.LEERQ $ $ 3HUIRUPDQFH DQG )DLOXUH $QDO\VLV RI 6$3+,5( ZLWK D 0('/,1(WHVWFROOHFWLRQ-$0,$ >@&LPLQR---RKQVRQ6%$JXLUUH$5RGHUHU1&OD\WRQ 3' 7KH 0('/,1( %XWWRQ 3URF $QQX 6\PS &RPSXW $SSO0HG&DUH >@%DRUWR '0 &LPLQR -- $Q ,QIREXWWRQ IRU (QDEOLQJ 3DWLHQWVWR,QWHUSUHW2QOLQH3DS6PHDU5HSRUWV >@.DWKOHHQ50F.HRZQ6KLK)X&KDQJ-DPHV&LPLQR 6WHYHQ)HLQHU&DURO)ULHGPDQ/XLV*UDYDQR9DVLOHLRV +DW]LYDVVLORJORX 6WHYHQ -RKQVRQ 'HVPRQG $ -RUGDQ -XGLWK / .ODYDQV $QGUp .XVKQLUXN 9LPOD 3DWHO 6LPRQH 7HXIHO 3(56,9$/ D V\VWHP IRU SHUVRQDOL]HG VHDUFK DQG VXPPDUL]DWLRQ RYHU PXOWLPHGLD KHDOWKFDUH LQIRUPDWLRQ 3URFHHGLQJV RI WKH VW $&0,(((&6 MRLQW FRQIHUHQFHRQ'LJLWDOOLEUDULHV >@.DPHO %RXORV 01 /RFDWLRQEDVHG KHDOWK LQIRUPDWLRQ VHUYLFHV D QHZ SDUDGLJP LQ SHUVRQDOLVHG LQIRUPDWLRQ GHOLYHU\ ,QWHUQDWLRQDO -RXUQDO RI +HDOWK *HRJUDSKLFV -DQ >@%LQVWHG . &DZVH\ $ DQG -RQHV 5% *HQHUDWLQJ SHUVRQDOL]HG SDWLHQW LQIRUPDWLRQ XVLQJ WKH PHGLFDO UHFRUG ,Q 3URFHHGLQJV RI $UWLILFLDO ,QWHOOLJHQFH LQ 0HGLFLQH(XURSH3DYLD,WDO\ >@%XFKDQDQ %* 0RRUH -' )RUV\WKH '( &DUHQLQL * 2KOVVRQ6%DQNV*$QLQWHOOLJHQWLQWHUDFWLYHV\VWHPIRU GHOLYHULQJ LQGLYLGXDOL]HG LQIRUPDWLRQ WR SDWLHQWV $UWLILFLDO,QWHOOLJHQFHLQ0HGLFLQH >@GH &DUROLV % GH 5RVLV)*UDVVR) 5RVVLHOR $%HUU\ '&*LOOLH7*HQHUDWLQJUHFLSLHQWFHQWHUHGH[SODQDWLRQV DERXW GUXJ SUHVFULSWLRQ $UWLILFLDO ,QWHOOLJHQFH LQ 0HGLFLQH >@&DZVH\ $- -RQHV 5% 3HDUVRQ - 7KH (YDOXDWLRQ RI D 3HUVRQDOL]HG+HDOWK,QIRUPDWLRQ6\VWHPIRU3DWLHQWVZLWK &DQFHU 8VHU 0RGHOLQJ DQG 8VHU$GDSWHG ,QWHUDFWLRQ >@3HGQDXOW(3'5HSUHVHQWDWLRQLVHYHU\WKLQJ&RP$&0