Liang Zhao+, Yujie Li, Chao Meng, Changqing Gong. Shenyang Aerospace University. 37 Daoyi South Avenue,Shenyang,China. Email:lzhao@sau.edu.cn+.
$690EDVHG5RXWLQJ6FKHPHLQ9$1(7V /LDQJ=KDR@ ,Q *365 QRGHV DSSO\ WKH JUHHG\ UXOH DQG IRUZDUG WKH GDWD WR D QHLJKERU FORVHVW WR WKH GHVWLQDWLRQ QRGH 7KH IRUZDUGLQJ VFKHPHLVVZLWFKHGWRWKHERXQGDU\PRGHZKHQHYHUWKHUHLVQR FORVHUQRGHWKDQWKHFXUUHQWQRGHUHJLRQ7KHQWKHULJKWKDQG UXOH LV DSSOLHG WR IRUZDUG WR VROYH WKH SUREOHPV RI WKH VXUURXQGLQJ ORFDO RSWLPD 7KH ELJJHVW DGYDQWDJH RI *365 LV WKDW JUHHG\ IRUZDUGLQJ UHOLHG VROHO\ RQ QHLJKERULQJ QRGHV UDWKHUWKDQWKHQHWZRUNORFDWLRQLQIRUPDWLRQRIDOOWKHQRGHVWR IRUZDUG GDWD SDFNHWV ,Q WKH FDVH RI PXOWLKRS URXWLQJ VLQFH WKH QHLJKERUKRRG VL]H LV IDU OHVV WKDQ WKH VL]H RI WKH ZKROH QHWZRUN PDLQWHQDQFH FRVW LV YHU\ OLPLWHG ,Q DGGLWLRQ E\ DSSO\LQJ WKH JUHHG\ IRUZDUGLQJ VWUDWHJ\ WKH IORRGLQJ RI GDWD SDFNHWVLVDOVRDYRLGHG *365 RQO\ FRQVLGHUV WKH KRS GLVWDQFH ZKLOH FKRRVLQJ WKH QH[WKRS QHLJKERU $OWKRXJK PDQ\ RWKHU ZRUN LPSURYH WKH URXWLQJ PHWULF IRU FDOFXODWLQJ WKH ORFDO PD[LPXP >@ WKH IDFWRUVRIWKHVHURXWLQJPHWULFVDUHVWLOOOLPLWHGDQGZHLJKWRI HDFK IDFWRU LQ FXUUHQW URXWLQJ PHWULF PRGHOV DUH VWLOO VHW PDQXDOO\7KHUHIRUHWKHVHOHFWLRQRIQH[WKRSIRUZDUGLQJQRGH LQVRPHFDVHVLVQRWRSWLPDO)RUWKHVHUHDVRQVZHSURSRVHD QHZ DOJRULWKP QDPHO\ *UHHG\ 0DFKLQH /HDUQLQJ 5RXWLQJ *0/5 E\ DSSO\LQJ D PDFKLQH OHDUQLQJ DOJRULWKP 6XSSRUW 9HFWRU 0DFKLQHV KHUHLQDIWHU UHIHUUHG WR DV 690 WR LPSURYH WKH URXWLQJ PHWULF PRGHO LQ ORFDWLRQEDVHG URXWLQJ SURWRFROV OLNH*365
)LJ 7KHIORZFKDUWRIRYHUYLHZ*0/5
7KLVSDSHULVRUJDQL]HGDVEHORZ7KH6HFWLRQGHVFULEHV UHODWHGZRUN7KH6HFWLRQGHVFULEHVLQGHWDLOKRZWRLPSURYH WKH 690 DQG KRZ WR XVH DJUHHPHQWV 7KH 6HFWLRQ SUHVHQWV WKH H[SHULPHQWV DQG VLPXODWLRQ UHVXOWV 7KH 6HFWLRQ FRQFOXGHVWKHSDSHU
DQGPRUHSHUVXDVLYH7KHIRUPDWRIIORDWFDUGDWDLVDYDLODEOH LQWKHRULJLQDOGDWDLQ7DEOH :KHUHLQ EHWZHHQ WKH IRUZDUGLQJ QRGH DQG WKH QH[WKRS QRGHGLVWDQFH d =
,, 5(/$7(':25. 2YHU WKH \HDUV PDQ\ UHVHDUFKHV DUH VWXGLHG RQ 9$1(7 URXWLQJDOJRULWKP6LQFHWKLVSDSHULVWRDSSO\PDFKLQHOHDUQLQJ WRLPSURYHWKH*365DQGWKHIHDWXUHVZHVHOHFWHGDUHVLPLODU WR GLVWDQFH YHFWRU RQO\ IROORZLQJ PRVW UHODWHG ZRUN LV GHVFULEHGDQGGLVFXVVHG /DLHWDOSURSRVHDQRYHOURXWLQJLQIRUPDWLRQV\VWHPFDOOHG WKH PDFKLQH OHDUQLQJDVVLVWHG URXWH VHOHFWLRQ 0$56 V\VWHP WRHVWLPDWHQHFHVVDU\LQIRUPDWLRQIRUURXWLQJSURWRFROV>@,Q 0$56 URDG LQIRUPDWLRQ LV PDLQWDLQHG LQ URDGVLGH XQLWV ZLWK WKHKHOSRIPDFKLQHOHDUQLQJ7KHPDFKLQHOHDUQLQJDOJRULWKP LV DSSOLHG WR SUHGLFW WKH PRYHV RI YHKLFOHV DQG WKHQ FKRRVH VRPHVXLWDEOHURXWLQJSDWKVZLWKEHWWHUWUDQVPLVVLRQFDSDFLW\WR WUDQVPLW SDFNHWV )XUWKHU 0$56 FDQ KHOS WR GHFLGH WKH IRUZDUGLQJ GLUHFWLRQ EHWZHHQ WZR 568V DFFRUGLQJ WR WKH SUHGLFWHG ORFDWLRQ RI WKH GHVWLQDWLRQ DQG WKH HVWLPDWHG WUDQVPLVVLRQ GHOD\V LQ ERWK IRUZDUGLQJ GLUHFWLRQV 7KHLU SURSRVHG V\VWHP FDQ SURYLGH LQWLPH URXWLQJ LQIRUPDWLRQ IRU 9$1(7VDQGJUHDWO\HQKDQFHVQHWZRUNSHUIRUPDQFH +DQ HW DO WU\ WR LPSURYH WKH GDWD IRUZDUGLQJ VWUDWHJ\ RI *365 WR UHGXFH WKH *365 SURWRFRO URXWLQJ FRPSOH[LW\ DQG HQHUJ\ FRQVXPSWLRQ >@ 7KH LPSURYHG *365 LV PRUH VXLWDEOH LQ XUEDQ URDG QHWZRUNV 7KLV SURWRFRO PRQLWRUV WKH GDWD SDFNHW $W WKH VDPH WLPH WKH KRS QXPEHU LV LQFOXGHG LQ WKH GDWD SDFNHW WR DYRLG UHGXQGDQW SDWKV ZKLOH UHVXOWLQJ LQ PRUHFRQFLVHDQGUREXVWURXWHV :XHWDOLQWHQGWRLPSURYH*365E\FKDQJLQJWKHURXWLQJ PHWULFRIVHOHFWLQJWKHIRUZDUGHU>@6LQFH*365RQO\ZRUNV ZHOOLQKLJKZD\VFHQDULRVQRGHVPRYHLQDFHUWDLQSDWWHUQ ,I WKH VRXUFH QRGH FDQ GHWHUPLQH WKH GLUHFWLRQ RI PRWLRQ RI WKH GHVWLQDWLRQ QRGH ZKLOH VHQGLQJ RXW WKH GDWD SDFNHW WKHQ WKH SRVLWLRQRIWKHGHVWLQDWLRQQRGHFDQEHSUHGLFWHGDFFRUGLQJWR WKH GLUHFWLRQ RI PRWLRQ $FFRUGLQJ WR WKH SUHYLRXV XSGDWH RI WKH ODWHVW XSGDWH LQIRUPDWLRQ YHFWRUV DUH FDOFXODWHG WR GHWHUPLQHZKHWKHURUQRWWKHVRXUFHDQGGHVWLQDWLRQDUHRQWKH VDPH GLUHFWLRQ DQG WKHLU UHODWLYHO\ SRVLWLRQ 7KHUHIRUH WKH URXWLQJPHWULFLVRSHUDWHGDVDERYH
( X
2 a
− X
) + ( Y a 2 − Y b 2 )
2 b
$FFHOHUDWLRQRIWKHQH[WKRSYHKLFOH
a=
( X 1 2 − X 2 2 ) + ( Y1 2 − Y2 2 ) T1 − T2
$ QXPEHU RI ZHLJKWV RI 690 DUH UHTXLUHG WR VHW LQ WKH IXWXUHVHFWLRQDVVKRZQLQ7DEOH:HXVHIRUPXOD DQG WRFDOFXODWHWKHGLVWDQFHDQGDFFHOHUDWLRQRIQH[WKRSYHKLFOHV QRGHV WR JHW WKH IHDWXUHV +RZHYHU WKHVH SURFHVVHG GDWD DUH RQO\WKHEDVLFIORDWLQJFDUGDWD:HFDQQRWVHHDQ\GDWDSDFNHW WUDQVPLVVLRQV EHWZHHQ YHKLFOHV 7KHUHIRUH KHUH ZH QHHG WR JHQHUDWHWKHSDFNHWWUDQVPLVVLRQVIRUODWHUXVH $ ODUJH QXPEHU RI IORDWLQJ FDU LQIRUPDWLRQ LV VHW DV PRELOLW\ILOHLQWKH16>@:HDOVRUDQGRPO\VHOHFWQRGHV DVWKHVRXUFHQRGHDQGWKHGHVWLQDWLRQQRGHDQGFUHDWHUDQGRP GDWD WUDIILF IORZV *3657 LV XVHG WR WUDYHUVH DOO WKH WUDFNV IURPWKHVRXUFHQRGHWRWKHGHVWLQDWLRQQRGHLQWKHVLPXODWLRQ *3657LVDPRGLILHGYHUVLRQRI*365:HPRGLI\WKHJUHHG\ PRGH DV WUDQVPLWWLQJ GDWD SDFNHWV WR HYHU\ SRVVLEOH QHLJKERU QRGHLQWKHVHOHFWLRQRIWKHQH[WKRSQHLJKERU7KHQHLJKERU QRGH LV VHOHFWHG DV IRUZDUGHU LI LW LV LQ WKH VDPH IRUZDUGLQJ GLUHFWLRQ DQG WKH SDFNHW FDQ UHDFK WKH GHVWLQDWLRQ QRGH $V VKRZQ LQ )LJXUH E\ XVLQJ *3657 SURWRFRO ZH JHW DOO WKH WUDFNVIURPWKHVRXUFHQRGHWRWKHGHVWLQDWLRQQRGH 1H[WZHGLYLGHWKHWUDQVPLVVLRQWUDFHVDERYHWRWZRW\SHV RXWVWDQGLQJ QH[WKRS QRGH DQG RUGLQDU\ QH[WKRS QRGH )ROORZLQJUXOHVDUHDSSOLHGWRGHWHUPLQHDQRGHDVRXWVWDQGLQJ )LUVWO\ WKH QRGH VKRXOGEH DQ LQWHUPHGLDWH QRGHRQ SDWK IURP VRXUFHQRGHWRWKHGHVWLQDWLRQQRGH6HFRQGO\LWVKRXOGVDWLVI\ WKDWWKHSDFNHWORVVUDWHRIWKLVSDWKLVOHVVWKDQ)LQDOO\WKH HQGWRHQGGHOD\RIWKLVSDWKLVOHVVWKDQPVWUDFNPHHW
,,, *5(('@ 7KHUHIRUHRUGLQDU\QH[WKRSQRGHLVRQDVXFFHVVIXOGHOLYHUHG SDWKZLWKSDFNHWORVVUDWHPRUHWKDQDQGWKHGHOD\JUHDWHU WKDQPV 1H[WZHDSSO\WKHIHDWXUHVIURP7DEOHLQ690 WRFODVVLI\WKHVLPXODWLRQGDWD
C. Machine Learning Phase 7KURXJK D QRQOLQHDU PDSSLQJ QRQOLQHDU SUREOHPV FDQ EH FRQYHUWHG LQWR D IHDWXUH VSDFH OLQHDUO\ VHSDUDEOH SUREOHP E\ XVLQJ690,WGRHVQRWLQFUHDVHWKHFRPSXWDWLRQDOFRPSOH[LW\ 0RUHKLJKGLPHQVLRQDOSUREOHPLVDOVRDYRLGHG )RXUW\SHVRI690NHUQHOIXQFWLRQVDUHFRPPRQO\XVHGDV IROORZV /LQHDUNHUQHO k x y = x y d
3RO\QRPLDONHUQHO k x y = > x y + @
5DGLDO%DVLV)XQFWLRQ k x y = H[S − _ x − y _ d
.HUQHO/D\HU1HXUDO1HWZRUN㸸
k x y = WDQKa x y + b
)LUVW ZH VHOHFW WKH OLQHDU NHUQHO IXQFWLRQ DV WKH NHUQHO IXQFWLRQ 7KHQ ZH VHOHFW UDQGRP QRGHV RI WUDQVPLVVLRQV DQG FRUUHVSRQGLQJYHKLFOHIHDWXUHV7DEOH DQGLQSXWWKHPDOOWR 690,ILWLVDQRXWVWDQGLQJQRGHWKHWDJRIWKHGDWDLVVHWWR 2WKHUZLVHLWLVVHWWR7KHIRUPDWRIHDFKVDPSOHLVDVIROORZV >@ >G@ >GDWD@ >D@ >GDWD@ > Da @ >GDWD@ > Db @ >GDWD@ (DFK QRGHRIDOOWUDQVPLVVLRQVLVLQSXWWRWKH690IRUWUDLQLQJ7KH GDWD LV WKHQ DGGHG WR D VLQJOH VFDOLQJ RSHUDWLRQ ZKHUH GDWD LV VFDOHGWRDUDQJHRIKHOSWRSUHGLFW,WLVDFKLHYHGE\UHSHDWHGO\ FURVVYDOLGDWLRQ WLPHV FURVVYDOLGDWLRQ DUH XVHG LQ WKLV SDSHU WRREWDLQWKHEHVWSDUDPHWHUV:LWKWUDLQLQJPRGHOZH FDQ
382
DGMXVWWKHNHUQHOIXQFWLRQDQGLWHUDWLYHWKHWUDLQLQJ/,%690LV XVHGDVDPDFKLQHOHDUQLQJWRRORI690 $FFRUGLQJWRWKHWUDLQLQJPRGHOWKHILQDOIRUPXODLV
k( d ,a,Da ,Db ) = tanh( 0.01a( Da − Db ) + d ) :H DSSO\ IRUPXOD DV WKH URXWLQJ PHWULF LQ *365 WR KDYH*0/5 ,9 3(5)250$1&($1$/@ >@
>@
>@
>@
)LJ 7KHGDWDSDFNHWGHOLYHU\UDWHFRPSDULVRQ*0/5YV*365 >@
>@
>@
>@
>@
>@
>@
)LJ 7KH FRPSDULVRQ ZLWK WKH DYHUDJH HQGWRHQG GHOD\ *365 YV *0/5
>@
9 &21&/86,21
>@
,QWKLVSDSHU7KHSURSRVHGJUHHG\IRUZDUGLQJDOJRULWKPLV EDVHGRQ690%\DSSO\LQJDODUJHDPRXQWRIFODVVLILHGGDWD IHDWXUHV LQFOXGLQJ WKH GLVWDQFH EHWZHHQ IRUZDUGLQJ QRGH DQG WKHQH[WKRSQRGHWKHPRYLQJGLUHFWLRQRIWKHQH[WKRSQRGH WKHDFFHOHUDWLRQRIWKHQH[WKRSQRGHDQGWKHIRUZDUGLQJQRGH WKHPRYLQJGLUHFWLRQRIQH[WKRSQRGH WKHPRGHOLVREWDLQHG E\ WUDLQLQJ VXFK GDWDVHW LQ 690 7KH PRGHO LV VHW DV URXWLQJ PHWULFLQ*/05%\VLPXODWLRQ*/05FDQUHGXFHWKHSDFNHW ORVVDQGQHWZRUNGHOD\FRPSDUHGWR*365
383
>@
>@
>@
%.DUSDQG+.XQJ³*UHHG\3HULPHWHU6WDWHOHVV5RXWLQJIRU:LUHOHVV 1HWZRUNV´LQ3URFHHGLQJVRIWKH0REL&RP %/HRQJ60LWUDDQG%/LVNRY³*HRJUDSKLF5RXWLQJZLWK/RFDO)DFH ,QIRUPDWLRQ´ LQ 3URFHHGLQJV RI WKH ,((( ,QWHUQDWLRQDO &RQIHUHQFH RQ 1HWZRUN3URWRFROV 0 ' 6DXPLWUD 3 +LPDELQGX DQG & +X ³2Q WKH 6FDODELOLW\ RI 5HQGH]YRXVEDVHG /RFDWLRQ 6HUYLFHV IRU *HRJUDSKLF :LUHOHVV $G +RF 5RXWLQJ´&RPSXWHU1HWZRUNV /:.DQJDQG&6/X³'LVWULEXWHG&RPSUHVVLYH9LGHR6HQVLQJ´LQ 3URFHHGLQJVRIWKH,(((,QWHUQDWLRQDO&RQIHUHQFHRQ1HWZRUN3URWRFROV + 6DOHHW 5 /DQJDU . 1DLO 5 %RXWDED $ 1DYDN DQG 1 *RHO ³,QWHUVHFWLRQ%DVHG *HRJUDSKLFDO 5RXWLQJ 3URWRFRO IRU 9$1(7V $ 3URSRVDO DQG DQDO\VLV´ LQ 3URFHHGLQJV RI WKH ,((( 7UDQVDFWLRQV RQ 9HKLFXODU7HFKQRORJ\ )