Cognitive Workload Estimation through Lateral

Cognitive Workload Estimation through Lateral Driving Performance Joonwoo Son and Suwan Park +XPDQ/$%'DHJX*\HRQJEXN,QVWLWXWHRI6FLHQFH 7HFKQRORJ\ 

ABSTRACT 7KLV SDSHU SUHVHQWV DQHPSLUL FDO DSSURDFK IRU HVWLPDWLQJ GULYHU¶V FRJQLWLYH ZRUNORDG XVLQJ GULYLQJ SHUIRUPDQFH HVSHFLDOO\ ODWHUDO FRQWURO DELOLW\WKURXJK  UHDGLO\ DYDLODEOH VHQVRUV VXFKDVOD QH SRVLWLRQ DQG VWHHULQJ ZKHHO DQJOH 7R GHYHORS D UHDOWLPH DSSURDFK IRU GHWHFWLQJ FRJQLWLYH GLVWUDFWLRQ UDGLDOED VLV SUREDELOLVWLF QHXUDO QHWZRUNV 5%311 ZH UH DSSOLHG 'DWD IRUW UDLQLQJ DQG WHVWLQJ WKH 5%311 PRGHOV ZHUH FROOHFWHG LQDVLPXODWR U H[SHULPHQW LQZKLFKILIWH HQ SDUWLFLSDQWVGURYHWKURXJKDKLJKZD\DQGZHUHDVNHGWR FRPSOHWH DXGLWRU\ UHFDOO WDVNV7KH  EHVWSHUIR UPLQJ PRGHO FRXOG GHWHFWFRJ QLWLYH ZRUNORDG DW WKH DFFXUDF\ UDWH RI  7KHUHVXOWVGHPR QVWUDWHG WKDWWKH VWDQGDUG GHYLDWLRQ RIODQH  SRVLWLRQDQ G VWHHULQJ ZKHHO UHYHUVDO UDWH FDQEHXVH G WRGHWHFWGULYHU¶ V FRJQLWLYH GLVWUDFWLRQLQUHDOWLPH

INTRODUCTION 5HFHQW WHFKQRORJLFDO DGYDQFHV KDYH HQDEOHG DZLGH  YDULHW\ RILQIRUPDWLR Q V\VWHPVWREHLQWHJUDWH G LQWRD  YHKLFOH LQ RUGHU WRLQ FUHDVH VDIHW\ SURGXFWLYLW\ DQG FRPIRUW +RZHYHU LPSURSHUO\ GHSOR\HG WHFKQRORJ\ FDQ LQFUHDVH GULYHU V ZRUNORDG DQGFRQ VHTXHQWO\ GHJUDGH VDIHW\ 7KXVLGHQWLILFDWLRQRI  D GULYHU¶VZR UNORDG DQG VSDUH FDSDFLW\ LVFUXFLDO  LQ WKHGHVL JQ RILQWHOOLJHQW YHKLFOHV:LWKWKLVNQRZOHGJHWKHLQYHKLFOHLQIRUPDWLRQ V\VWHPV ,9,6  FDQ SURYLGH WLPHO\DQG DIIRUGDEOH LQIRUPDWLRQ ZKHQ WKHGULYHUKDVWKHVSD UH FDSDFLW\ WR XQGHUVWDQGDQGUHVSRQGLW>@ :RUNORDG UHIHUVWRWKHD PRXQW RIUH VRXUFHV WKDW LV UHTXLUHGWRSHUIRUPDSDUWLFXODUWDVN7ZRPDMRUW\SHVRI GULYLQJZRUNORDGDUHYLVXDODQGFRJQLWLYHZRUNORDG>@ 9LVXDO ZRUNORDG LV VWUDLJKWIRUZDUG RFFXUULQJ ZKHQ GULYHUV ORRN DZD\IUR P WKHURDG ZD\ LWFDQ  EH UHDVRQDEO\ PHDVXUHG E\WKHGX UDWLRQ DQG IUHTXHQF\ RI JODQFHV DZD\ IURPWKHURDG8QOL NHO\ YLVXDOZR UNORDG FRJQLWLYH ZRUNORDG LV GLIILFXOWWR PHDVXUH GLUHFWO\ EHFDXVH LWLVHVVHQWL DOO\ LQWHUQDO WRWKHG ULYHU 1HYHUWKHOHVV WKHUHKDYH  EHHQHIIRUW V WRPHDVX UH FRJQLWLYH ZRUNORDG XVLQJ VXEMHFWLYH PHDVXUHV

SK\VLRORJLFDO PHDVXUHV H\H PRYHPHQW PHDVXUHV DQG GULYLQJ SHUIRUPDQFH PHDVXUHV >@ $PRQJWKRVH  PHDVXUHV GULYLQJ SHUIRUPDQFH PHDVXUHV DUH NQRZQ WR KDYH OLPLWDWLRQVFRPS DUHG WRRWKHUVGXHWRVPDOO FKDQJHV DFFRUGLQJ WRWKHFRJQLWLYHZRUNO RDG DOWKRXJK WKH\ DUHHD V\ DQGOHVVH [SHQVLYH PHDVXUHV WRGH WHFW WKHFRJQLWLYHZRUNORDG>@ 7KLV SDSHU SUHVHQWV DQHPSLUL FDO DSSURDFK IRU HVWLPDWLQJ GULYHU¶V FRJQLWLYH ZRUNORDG XVLQJ GULYLQJ SHUIRUPDQFH HVSHFLDOO\ ODWHUDO FRQWURO DELOLW\WKURXJK  UHDGLO\ DYDLODEOH VHQVRUV VXFKDVOD QH SRVLWLRQ DQG VWHHULQJZKHHODQJOH7KHUHVXOWVVXJJHVWWKDWWKHODWHUDO YHKLFOH FRQWURO PHDVXUHV LQFOXGLQJ WKHVWDQG DUG GHYLDWLRQ RIODQHSR VLWLRQ DQGVWHH ULQJ ZKHHO UHYHUVDO UDWH FDQEHXVH G WRGHWHFWFRJQLWLYHZRUNOR DG LQUHDO  WLPHDVLQSXWVRI5%311PRGHOV '5,9,1* 3(5)250$1&( :25./2$'

$1'

&2*1,7,9(

6RPH VWXGLHV KDYHVKR ZQ WKDW FRJQLWLYH GLVWUDFWLRQ XQGHUPLQHV GULYLQJSH UIRUPDQFH E\ GLVUXSWLQJ WKH DOORFDWLRQRIYLVXDODWWHQWLRQWRWKHGULYLQJVFH QHDQGWKH SURFHVVLQJ RI DWWHQGHG LQIRUPDWLRQ &RQVHTXHQWO\ FRJQLWLYH ZRUNORDG OHDGV WR VLJQLILFDQWO\ UHGXFHG ODQH NHHSLQJ YDULDWLRQ DQGL QFUHDVHG UHVSRQVH WLPHV WR VXGGHQ REVWDFOHV ,QWKLVSDSH U WKHUHIRUH WZRG ULYLQJ SHUIRUPDQFHPHDVXUHVLHODWHUDOSRVLWLRQYDULDWLRQDQG VWHHULQJ ZKHHO DFWLYLW\ZHUHVHO HFWHG WRDVVH VV ODWHUDO FRQWURODELOLW\ /DWHUDO SRVLWLRQ YDULDWLRQ /DWHUDOSR VLWLRQ YDULDWLRQ LV RQHRIWKHPRVWFRPPRQO\XVHGGULYLQJEHKDYLRUVPHWULF 5HGXFHGYDULDWLRQLQODWHUDOSRVLWLRQZKHQHQJDJHGZLWK D FRJQLWLYHWDVNFRXO G EH LQWHUSUHWHG DVDV\PSWR P RI GULYHURYHUORDGDQGLQFUHDVHGULVNRILQFRUUHFWGHFLVLRQV GXH WREHLQ J HQJDJHG LQ DGLVWUD FWLQJ WDVN/DWHUDO  SRVLWLRQ YDULDWLRQLVFR PPRQO\ FDOFXODWHG DVWKH VWDQGDUGGHYLDWLRQRIODWHUDOSR VLWLRQ6'/3 %XW6'/3 EHFRPHVKLJKO\FRUUHODWHGWRGDWDGXUDWLRQEHFDXVHWKH YDULDWLRQV LQ ODQH SRVLWLRQ DUHUDWKH U VORZ7KX V QHZ ODWHUDO SRVLWLRQ YDULDWLRQ PHDVXUH PRGLILHGVWD QGDUG GHYLDWLRQ RIODWHUDOSR VLWLRQ 06'/3 ZD V SURSRVHG LQ

WKH $,'(SURMHFW>@0 6'/3 LVL QGHSHQGHQW RI GDWD OHQJWK EHFDXVH LWLVED VHG RQKLJK SDVV ILOWHULQJO DQH SRVLWLRQ GDWD EHIRUH VWDQGDUG GHYLDWLRQ LVFDO FXODWHG $ KLJK SDVV ILOWHU ZLWK  +] FXWRIIIUHT XHQF\ LVD SSOLHG RQODQHSRVLWLRQGDWD7KLVPDNHVWKHYDULDWLRQFRQVWDQW DIWHU DSSUR[LPDWHO\ VHFR QGV 7KH ILOWHUWKDW ZDV DSSOLHG UHVXOWHG LQ6'/3  EHLQJ XQLQIOXHQFHG E\ GDWD OHQJWKVRYHUWKHILOWHUWLPHSHULRG

WZLFH D ZHHN EHLQVHOIUHSRUWH G JRRG KHDOWKDQGIUHH  IURP PDMRU PHGLFDO FRQGLWLRQV QRW WDNH PHGLFDWLRQVIRU SV\FKLDWULF GLVRUGHUV VFRUH RU JUHDWHU RQWKHP LQL PHQWDO VWDWXV H[DP> @ WRHVWDE OLVK UHDVRQDEOH FRJQLWLYH FDSDFLW\ DQGVLWX DWLRQDO DZDUHQHVV DQGKD YH QRW SUHYLRXVO\ SDUWLFLSDWHG LQDVLPXODW HG GULYLQJ VWXG\ 7KHVDPSOHFRQVLVWHGRIPDOHVZKRDUHLQWKH DJHUDQJH0 6'  

6WHHULQJZKHHODFWLYLW\&RJQLWLYHVHFRQGDU\WDVNV\LHOG LQFUHDVHG VWHHULQJ DFWLYLW\ 7KHLQFUH DVH LV PDLQO\ LQ VPDOOHUVWHHULQJZKHHOPRYHPHQWVWKHPDMRULW\RIZKLFK DUH VPDOOHU WKDQ  GHJUHH 7KLV RIWHQFRPH V ZLWK LQFUHDVHG JD]H FRQFHQWUDWLRQ WRZDUGV WKH URDG FHQWUH DQG UHGXFHG ODWHUDOS RVLWLRQ YDULDQFH >@7KHVWHHU ZKHHO UHYHUVDO UDWH FDQ EH XVHG IRU PHDVXULQJ WKH LQFUHDVH RIVPDOOH U VWHHULQJ ZKHHO PRYHPHQWV ,WLV GHILQHG DV WKH QXPEHU SHUPL QXWH RI VWHHULQJ ZKHHO UHYHUVDOV ODUJHUWKDQDFHUWDLQPLQLP XP DQJXODU YDOXH VRFDOOHGWKHJDSVL]H 

&RJQLWLYH :RUNORDG $Q  DXGLWRU\GHO D\HG GLJLWUH FDOO WDVNZDVXVHGWRFUHDWHS HULRGVRIFRJQLWLYHGHPDQGDW WKUHH GLVWLQFW OHYHOV7KLVIR UP RI QEDFN WDVN UHTXLUHV SDUWLFLSDQWV WRVD\RXWOR XG WKHQWKVW LPXOXV EDFN LQ D VHTXHQFHWKDWLVSUHVHQWHGYLDDXGLRUHFRUGLQJ>@7KH ORZHVW OHYHO QEDFN WDVNLVWKH EDFN ZKHUH WKH SDUWLFLSDQWLVWRLPPHGLDWHO\UHSHDWRXWORXGWKHODVWLWHP SUHVHQWHG $WWKHPRGHUDW H OHYHOED FN  WKHQH[WWR ODVW VWLPXOLLVWREH  UHSHDWHG $WWKHPRVWGLIILFXOWOHYHO EDFN  WKHVH FRQGWRWKHODVW VWLPXOXV LV WREH UHSHDWHG7KHQEDFNZDVDGPLQLVWHUHGDVDVHULHVRI VHFRQGWULDOVFRQVLVWLQJRIVLQJOHGLJLWQXPEHUV  SUHVHQWHG LQ DUDQGRPL ]HG RUGHU DWDQLQWHUVWLP XOXV LQWHUYDORIVHFRQGV(DFKWDVNSHULRGFRQVLVWHGRID VHWRIIRXUWULDOVDWDGHILQHGOH YHORIGLIILFXOW\UHVXOWLQJLQ GHPDQGSHULRGVWKDWZHUHHDFKWZRPLQXWHVORQJ

5$',$/%$6,6352%$%,/,67,&1(85$/1(7:25.6 ,Q WKLVSDSHU  UDGLDOED VLV SUREDELOLVWLF QHXUDOQHWZR UNV DUH DSSOLHG IRU HVWLPDWLQJ GULYHU¶V FRJQLWLYH ZRUNORDG XVLQJ ODWHUFRQWUROPHD VXUHV RIGULYLQ J SHUIRUPDQFH 5DGLDO EDVLV SUREDELOLVWLF QHXUDO QHWZRUNV DUHDNLQ G RI UDGLDOEDVLVQHWZRUNVZKLFKDUHVXLWDEOHIRUFODVVLILFDWLRQ SUREOHPV>@:KHQDQLQSXWLVSUHVHQWHGWKHILUVWOD\HU FRPSXWHVGLVWDQFHVIURPWKHLQSXWYHFW RUWRWKHWUDLQ LQJ LQSXW YHFWRUV DQGS URGXFHV D YHFWRU ZKRVH HOHPHQWV LQGLFDWH KRZFORVHWKHLQSXWLVWRDWUDLQLQJLQS XW 7KH VHFRQGOD\HUVXPVWKHVHFRQWULEXWLRQVIRUHDFKFODVVRI LQSXWV WRSURGX FH DVLW V QHWRXWSX W DYHFWRURI SUREDELOLWLHV)LQDOO\DFRPSHW HWUDQVIHUIXQFWLRQRQWKH RXWSXW RIWKH  VHFRQGOD\H U SLFNVWKHP D[LPXP RIWKHVH  SUREDELOLWLHVDQGSURGXFHVDIRUWKDW FODVVDQGDIRU WKHRWKHUFODVVHV

MODEL CONSTRUCTION '$7$6285&( ([SHULPHQWDO VHWXS 7K H H[SHULPHQW ZDVFRQG XFWHG LQ WKH '*,67IL[HGEDVH G GULYLQJVLPXODWR U ZKLFK LQFRUSRUDWHG 67,6,0'ULYHŒVRIWZD UH DQGDIL[HG  FDU FDE DV VKRZQ LQ)L JXUH *UDS KLFDO XSGDWHV WR WKH YLUWXDO HQYLURQPHQW ZHUH FRPSXWHG XVLQJ67, 6,0 'ULYHŒ EDVHG XSRQ LQSXWV UHFRUGHG IURPWKH2(0 DFFHOHUDWRU EUDNH DQG VWHHULQJ ZKHHO ZKLFKZHUH  DOO DXJPHQWHG ZLWK WDFWLOH IRUFH IHHGEDFN 7KH YLUWXDO URDGZD\ZDVGLVSOD\HGRQDPE\PZDOOPRXQWHG VFUHHQDWD UHVROXWLRQRI[6HQVRU\IHHGEDFN WR WKHGULYH U ZDV DOVR SURYLGHG WKURXJK DXGLWRU\ DQG NLQHWLFFKDQQHOV'LVWDQFHVSHHGVWHHULQJWKURWWOHDQG EUDNLQJLQSXWVZHUHFDSWXUHGDWDQRPLQDOVDPSOL QJUDWH RI +]$ GLVSOD\ ZDV LQVWDOOHG RQW KH VFUHHQ EHVLGH WKH UHDUYLHZ PLUURU WRSURYLGHLQIRUP DWLRQ DERXWWKH  HODSVHGWLPHDQGWKHGLVWDQFHUHPDLQLQJLQWKHGULYH 6XEMHFWV6XEMHFWVZHUHUHTXLUHGWRPHHWWKHIROORZLQJ FULWHULDDJHEHWZHHQGULYHRQDYHUDJHPRUHWKDQ

3URFHGXUH)ROORZLQJLQIRUPHGFRQVHQWDQGFRPSOHWLRQ RI DSUHH[SHULP HQWDO TXHVWLRQQDLUH SDUWLFLSDQWV UHFHLYHG  PLQXWHVRIGULYLQJH[SHULH QFH DQG DGDSWDWLRQ WLPHLQWKHVLPXODWRU7KH  VLPXODWLRQ ZDV WKHQVWRSSHGDQGSDUWLFLSDQWVZHUHWUDLQHGLQWKHQEDFN WDVN ZKLOH UHPDLQLQJ VHDWHG LQWKH  YHKLFOH1EDFN WUDLQLQJ FRQWLQXHG XQWLOSDUWLFLSD QWV PHWPLQLPXP  SHUIRUPDQFH FULWHULD3HUIRUPDQ FH RQ WKHQEDFNZD V VXEVHTXHQWO\ IRUPDOO\DVVH VVHG DWH DFK RI WKHWKUH H GHPDQGOHYHOVZLWKPLQXWHEUHDNVEHWZHHQHDFKOHYHO :KHQWKHVLPXODWLRQZDVUHVXPHGSDUWLFLSDQWVGURYHLQ JRRGZHDWKHUWKURXJKNPRIVWUDLJKWKLJKZD\0LQXWHV WKURXJKZHUHXVHGDVDVLQJOHWDVNGULYLQJUHIHUHQFH EDVHOLQH  7KLUW\ VHFRQGV ODWHU  VHFRQGV RI LQVWUXFWLRQVLQWURGXFHGWKHWDVNR UEDFN (DFKQ EDFN SHULRG ZDV PLQXW HV LQGX UDWLRQ IRXU  VHFRQG WULDOV  7ZR PLQXWH UHVWUHFRYHU\ SHULRGV ZHUH SURYLGHG EHIRUH SUHVHQWLQJLQ VWUXFWLRQV IRU WKHQH[W  WDVN 3UHVHQWDWLRQ RUGHU RIWKHWKU HH OHYHOV RIWDVNGLIILFXOW\ ZDVUDQGRPL]HGDFURVVSDUWLFLSDQWV

 )LJXUH7KH'*,67'ULYLQJ6LPXODWRU

02'(/&+$5$&7(5,67,&6$1'75$,1,1* 'HILQLWLRQ RI &RJQLWLYH :RUNORDG 7KHFRJQL WLYH ZRUNORDG ZDV FODVVLILHG LQWRWZRFDWH JRULHV LHORZ ZRUNORDG DQG KLJK ZRUNORDG E\WKH 5%311 PRGHOV ,Q JHQHUDOWKHPRUHWDVNVDGULYHULV FRQGXFWLQJDWDWL PH WKHPRUHUHVRXUFHVKHVKHLVFRQVXPLQJDQGWKHUHIRUH WKHKLJKHUZRUNORDGKHVKHLVEHDULQJ>@%DVHGRQWKLV DVVXPSWLRQ WKH GULYLQJ SHUIRUPDQFH GDWD LQWKH GXDO WDVN SHULRG ZHUH ODEHOHG DVKLJKZR UNORDG DQGORZ ZRUNORDGIRUVLQJOHWDVNVSHULRG+RZHYHUWKHFRJQLWLYH FDSDFLW\UHTXLUHGWRSHUIRUPWKHVDPHWDVNVYDULHVIURP SHUVRQ WR SHUVRQ ,WPH DQV WKDW WKH ZRUNORDG OHYHOV LQGXFHG E\ QEDFN WDVNV PLJKWEH  GLIIHU IRUGLIIH UHQW GULYHUV7KHUHIRUHWKHORZHVWGLIILFXOW\OHYHOVRFDOOHG EDFN ZDV RPLWWHG LQWKLVSDSHUWRUH GXFHG LQGLYLGXDO YDULDWLRQ&RQVHTXHQWO\VLQJOHWDVNSHULRGGULYLQJR QO\  ZDVFDWHJRUL]HGDVORZZRUNORDGDQGGXDO WDVNSHULRGV EDFNDQGEDFN ZHUHFRQVLGHUHGDVKLJKZRUNORDG ,QSXW)HDWXUHV7ZRGULYLQJSHUIRUPDQFHPHDVXUHVWKH VWDQGDUG GHYLDWLRQ RIODQHSR VLWLRQ 06'/3 DQG  VWHHULQJ ZKHHO UHYHUVDO UDWH 655  ZHUH VHOHFWHG DV ODWHUDO FRQWURO DELOLW\LQGLFHV WR HVWLPDWHWKHGUL YHU¶V FRJQLWLYHZRUNORDGLQWKH5%311PRGHOV 06'/3 ZDV FDOFXODWHG XVLQJ  +]KL JK SDVV ILOWHUHG ODWHUDOSRVLWLRQGDWD,WFDQEHRQO\DSSOLHGIRUGDWDVHWV ORQJHUWKDQVHFRQGVDQGQRWGXULQJODQHFKDQJHV 655ZDVFDOFXODWHGE\FRXQWLQJWKHQXPEHURIVWHHULQJ ZKHHO UHYHUVDO IURPWK H +] ORZ SDVV ILOWHUHG VWHHULQJ ZKHHO DQJOH GDWD)RU FRJQLWLYH ZRUNORDG WKHUHY HUVDO DQJOHV PRUH WKDQG HJUHH RIWKH  JDS VL]H ZHUH FRXQWHG

‫ێۆێڼگ‬

‫ۀ ۉۄۇۀێڼ ڝ‬

‫ڌٻۆێڼگ‬

‫ۏێۀ ڭ‬

‫ڍٻۆێڼگ‬

‫ۏێۀ ڭ‬

‫ێۏ ۉۀ ۈ ۂۀڮ‬ ‫ڄۀەۄڮٻ ے ۊ ڿ ۉۄ ڲڃ‬

‫ڿۀێ ڰٻۏ ۊ ک‬

‫ڿۀێ ڰٻۏ ۊ ک‬

‫ۂ ۉۄ ۉۄڼۍگ‬ ‫ۏێۀگٻ ځ‬ ‫ێۏ ۉۀ ۈ ۂۀڮ‬

‫ڿۀێ ڰٻۏ ۊ ک‬

‫ڿۀێ ڰٻۏ ۊ ک‬

‫ۉۄڼۍگٻ ژٻ‬

‫ڎٻۆێڼگ‬



‫ۏێۀگٻ ژٻ‬

)LJXUH$OORFDWLRQRI6HJPHQWVWR7UDLQLQJDQG7HVWLQJ 6HWV VFKHPH FRUUHFWO\ UHIOHFWV WKHD FWXDO JHQHUDOL]DWLRQ FDSDELOLW\RIWKHGHULYHGHVWLPDWRU 0RGHOSHUIRUPDQFHZDVHYDOXDWHGZLWKWHVWLQJDFFXUDF\ ZKLFK LVWKHUDWLRRIWKHQXP EHU RILQVWDQFH V FRUUHFWO\ LGHQWLILHG E\WKHPRG HO WRWKHWRWDOQXP EHU RILQVWDQFHV LQWKHWHVWLQJVHW

RESULT AND DISCUSSION $FFRUGLQJWRILYHWLPHZLQGRZVL]HVZRUNORDGHVWLPDWLRQ DFFXUDF\ UDWHV DUH GHVFULEHG LQ7 DEOH 7KHKLJ KHVW ZRUNORDG HVWLPDWLRQ DFFXUDF\ UDWH LQ RYHUDOOPR GHO SHUIRUPDQFH ZDV DFKLHYHG ZKHQ WKHWL PH ZLQGRZ VL]H ZDV  VHFRQGV WKHOR QJHVW ZLQGRZ VL]H :LWK  VHFRQGVZLQGRZ WKHDFFXUDF\ UDWHRI VLQJOHWDVNV LH ORZZRUNORDGFULWHULDZDVDQGWKDWRIGXDOWDVNV LHKLJKZRUNORDGFULWHULDZDVDVZHOO )URPWKHRYHUDOOPRGHOSHUIRUPDQFHSHUVSHFWLYHORQJHU ZLQGRZVL]HVJHQHUDWHGPRUHDFFXUDWHPRGHOVZKLFKLV FRQVLVWHQWZLWKDSUHYLRXVVWXG\>@ 7DEOH0RGHO3HUIRUPDQFHZLWK'LIIHUHQW:LQGRZ6L]H

6XPPDUL]LQJ 3DUDPHWHUV RI,QSXWV   ,QWKLV  SDSHU ZLQGRZ VL]H ZDV FRQVLGHUHG DVW KH VXPPDUL]LQJ SDUDPHWHU IRU WKHLQSXWV  :LQGRZ VL]H GHQRWHV WKH SHULRGRYHUZKLFK06'/3DQG655GDWDZHUHDYHUDJHG 7KH FRPSDULVRQV RI ZLQGRZ VL]H FRXOG LGHQWLI\ WKH DSSURSULDWH OHQJWKRIGDWDW KDW FDQEHVXPPD UL]HG WR UHGXFH WKH QRLVH RIWKHLQ SXW GDWDZLWK RXW ORVLQJ XVHIXO LQIRUPDWLRQ7KLVSDSHUFRQVLGHUHGILYHZLQGRZVL]HV DQGVHFRQGV

:LQGRZ VL]H VHF  



0RGHO 7UDLQLQJ DQG7H VWLQJ 5DGLDO EDVLV SUREDELOLVWLF QHXUDO QHWZRUNV 5%311  ZHUHX VHG WR FRQVWUXFW WKH GULYHU¶V FRJQLWLYH ZRUNORDG GHWHFWLRQ PRGHOV ,QWKLV SDSHU WKHPRGHO V ZHUH WUDLQHGX VLQJ WKH1(:311 IXQFWLRQLQ0$7/$% )RU WUDLQLQJ DQG WHVWLQJ 5%311 PRGHOV GDWD RI IRXU WDVNVHJPHQWVZKLFKFRQVLVWRID VLQJOHWDVNDQGWK UHH GXDO WDVNVZHUHX VHG $WDVNZD V GLYLGHG LQWRPXOW LSOH VHJPHQWV EDVHGRQZLQG RZ VL]H)RU  H[DPSOH LI WKH PRGHO XVHV  VHFRQGV ZLQGRZ RQH WDVN KDV IRXU VHJPHQWV DV VKRZQLQ )LJXUH  ,Q HDFKWDVN  WZR VHJPHQWVZHUHXVHGIRUWUDLQLQJDQGWKHRWKHUVHJPHQWV ZHUH XVHG IRU WHVWLQJ 6LQFH WKHHV WLPDWRU LV DOZD\V HYDOXDWHGRQWKH GDWDGLVMRLQWIURPWKHWUDLQLQJGDWDWKH SHUIRUPDQFH HYDOXDWHG WKURXJK WKH FURVV YDOLGDWLRQ









:RUNORDGHVWLPDWLRQ

6LQJOH 7DVN

'XDO 7DVN

7RWDO

+LJKZRUNORDG







/RZZRUNORDG







(VWLPDWLRQDFFXUDF\UDWH 







+LJKZRUNORDG







/RZZRUNORDG







(VWLPDWLRQDFFXUDF\UDWH 







+LJKZRUNORDG







/RZZRUNORDG







(VWLPDWLRQDFFXUDF\UDWH 







+LJKZRUNORDG







/RZZRUNORDG







(VWLPDWLRQDFFXUDF\UDWH 







+LJKZRUNORDG







/RZZRUNORDG







(VWLPDWLRQDFFXUDF\UDWH 







+RZHYHU WKH DFFXUDF\ UDWHVRIVL QJOH DQGGX DO WDVN FRQGLWLRQV VKRZV RSSRVLWH WUHQGVZLWK GLIIHUHQW ZLQGRZ VL]H7KHORQJHUWLPHZLQG RZVL]HSURYLGHVEHWWHUPRGHO SHUIRUPDQFHV LQWKHVLQJO H WDVNG HWHFWLRQ EXWSRR UHU SHUIRUPDQFHLQWKHGXDOWDVNFRQGLWLRQ :KHQ WKHWLPHZLQG RZ VL]H ZDV  VHFRQGV IRU VLQJOH WDVNVWKHDFFXUDF\UDWHWRGHWHFWWKHORZ ZRUNORDGZDV  DQGIRUGXDOWDVNVWKHDFFXUDF\UDWHWRGHWHFW WKH KLJK ZRUNORDG ZDV  :KHQ WKH WLPHZLQ GRZ VL]HZDVVHFRQGVIRUVLQJOHWDVNVWKHDFFXUDF\UDWH WRGHWHFWWKHORZZRUNORDGZDVDQGIRUGXDOWDVNV WKHDFFXUDF\UDWHWRGHWHFWWKHKLJKZRUNORDGZDV 7KH UHVXOWV VKRZ WKDWWK H SURSRVHG 5%311 PRGHOV ZHUHDEOHWRGHWHFWGULYH UGLVWUDFWLRQVXEVWDQWLDOO\EHWWHU WKDQ FKDQFH SHUIRUPDQFH =KDQJHW  DO>@SURSRVH G GULYHU FRJQLWLYH ZRUNORDG HVWLPDWLRQ DQG VKRZHG WKH DFFXUDF\ UDWHRIWKHLUPHWKRGLVR YHU WKURXJK  YDULRXVPHDVXUHVVXFKDVGULYLQJSHUIRUPDQFHDQGH\H DFWLYLWLHV E\ DPDFKLQH OHDUQLQJEDVHG ':('ULYHU :RUNORDG (VWLPDWLRQ  GHYHORSPHQW SURFHVV ZKHQ WKH WLPHZLQGRZVL]HZDVVHFRQGV7KHPDLQFRQWULEXWRU RI WKHKLJKDFFXUDF\UDW H LQWKHLUPRGHO V ZDV H\H PRYHPHQW PHDVXUHV ZKLFK ZHUH REWDLQHGIURPYHU\  H[SHQVLYH JD]H WUDFNLQJ GHYLFH 7KHUR EXVWQHVV RIH\H  PRYHPHQW PHDVXUHV LVVW LOO GRXEWIXOEHFD XVH WKHGDWD ZHUH HDVLO\ LQIOXHQFHG E\ DPELHQWOLJK W +RZHYHU WKH SURSRVHGPHWKRGLQWKLVSDSHULVHDV\WRLPSOHPHQWDQG FRPSXWHGULYHU¶VFRJQLWLYHZRUNORDGEHFDXVHLWXVHVRQO\ ODWHUDO GULYLQJ SHUIRUPDQFH DQGWKHUHLVQRQHHGWR DWWDFK WKHVHQ VRUV WRDKXPDQE RG\ OLNHRWKHU UHVHDUFKHVXVLQJSK\VLRORJLFDOPHDVXUHV

CONCLUSION ,Q WKLVSD SHU ZHS URSRVHG DQ HPSLULFDO DSSURDFK IRU HVWLPDWLQJ GULYHU¶V FRJQLWLYH ZRUNORDG XVLQJ GULYLQJ SHUIRUPDQFH HVSHFLDOO\ ODWHUDO FRQWURO DELOLW\WKURXJK  UHDGLO\ DYDLODEOH VHQVRUV VXFKDVOD QH SRVLWLRQ DQG VWHHULQJ ZKHHO DQJOH,QRUGH U WRFROO HFW GULYLQJG DWD SDUWLFLSDQWVGURYHWKURXJKKLJKZD\LQDGULYLQJVLPXODWRU DQG ZHUHDVNHGWR FRPSOHWH WKUHHGLI IHUHQW OHYHOV RI DXGLWRU\ UHFDOO WDVNV7KH  GULYHU¶V FRJQLWLYH ZRUNORDG HVWLPDWLRQ V\VWHPZD V GHYHORSHG XVLQJ UDGLDO EDVLV SUREDELOLVWLF QHXUDOQHWZR UN WKDW ZDV LPSOHPHQWHG E\ 0$7/$%DQGXVHG1(:311IXQFWLRQ 7KH UHVXOWV GHPRQVWUDWHG WKDWWKHSURSR VHG 5%311 PRGHOV ZHUH DEOH WR GHWHFW GULYHU GLVWUDFWLRQ VXEVWDQWLDOO\ EHWWHU WKDQF KDQFH SHUIRUPDQFH DQG WKH VWDQGDUG GHYLDWLRQ RIODQH  SRVLWLRQDQ G VWHHULQJ ZKHHO UHYHUVDO UDWH FDQEHXVH G WRGHWHFWGULYHU¶ V FRJQLWLYH GLVWUDFWLRQ LQ UHDOWLPH) RU PRGHO SDUDPHWHU VHOHFWLRQ ORQJHU ZLQGRZ VL]HVJH QHUDWHG PRUHDFFXUDWHPR GHOV ZKLFKLVFRQVLVWHQWZLWKDSUHYLRXVVWXG\>@ 7KH PRGHO SHUIRUPDQFH ZDV DVVHVVHG ZLWKWKHFURVV YDOLGDWLRQ VFKHPHZKL FK LV ZLGHO\DGRSWH G E\ WKH PDFKLQH OHDUQLQJ FRPPXQLW\ $VDUH VXOW WKHKL JKHVW ZRUNORDG HVWLPDWLRQ DFFXUDF\ UDWH LQ RYHUDOOPR GHO SHUIRUPDQFHZDV$OWKRXJKRIDFFXUDF\LV

QRW HQRXJK WRXVHLQ  HYHU\GD\PRQLWRUL QJ LWLV FKDOOHQJLQJ EHFDXVH WKH UHVXOW ZDV DFKLHYHG IURPW ZR GULYLQJSHUIRUPDQFHPHDVXUHV06'/3DQG6557 KH\ DUH HDV\ WR FROOHFW WKHGDWDWKURXJK UHDGLO\ DYDLODEOH VHQVRUV DQG QHHGQRWWRDWWDFKDGGLWLRQDOVH QVRUV WR KXPDQ ERG\ $QGLWLVDOVR H[SHFWHG WKDWWKHDFFX UDF\ FDQ EH LPSURYHG E\ DSSO\LQJPR UH VRSKLVWLFDWHG DOJRULWKPV

ACKNOWLEDGMENTS 7KLV UHVHDUFKZDV VXSSRUWHG LQSDUWE\'D HJX *\HRQJEXN ,QVWLWXWH RI 6FLHQFH DQG7HFK QRORJ\ '*,67 5HVHDUFK3URJUDPRIWKH0LQLVWU\RI(GXFDWLRQ 6FLHQFH DQG 7HFKQRORJ\ 0(67 DQG,QGX VWULDO 6WUDWHJLF 7HFKQRORJ\ 3URJUDP RIWKH0LQLVWU\  RI .QRZOHGJH(FRQRP\0.( 

REFERENCES  6RQ -/HH