Comparing Machine Learning Methods in Estimation ... - Google Sites

&RPSDULQJ0DFKLQH/HDUQLQJ0HWKRGV LQ(VWLPDWLRQRI0RGHO8QFHUWDLQW\ 'XUJD/DO6KUHVWKD0HPEHU,((('LPLWUL36RORPDWLQH0HPEHU,(((

  

$EVWUDFW−7KHSDSHUSUHVHQWVDJHQHUDOL]DWLRQRIWKHIUDPHZRUN IRUDVVHVVPHQWRISUHGLFWLYHPRGHOVXQFHUWDLQW\XVLQJPDFKLQH OHDUQLQJ WHFKQLTXHV +LVWRULFDO PRGHO HUURUV ZKLFK DUH PLVPDWFKEHWZHHQREVHUYHGDQGSUHGLFWHGYDOXHVDUHDVVXPHG WREHLQGLFDWRUVRIWRWDOPRGHOXQFHUWDLQW\LWLVPHDVXUHGLQWKH IRUP RI SUHGLFWLRQ LQWHUYDOV DQG FRPSULVHV DOO VRXUFHV RI XQFHUWDLQW\ LQFOXGLQJ PRGHO VWUXFWXUH PRGHO SDUDPHWHUV LQSXW DQG RXWSXW GDWD 6HYHUDO PDFKLQHOHDUQLQJ PHWKRGV DUH FRPSDUHG7KHDSSURDFKLVWHVWHGRQDFRQFHSWXDOK\GURORJLFDO PRGHOVHWXSWRSUHGLFWVWUHDPIORZVRIWKH%UXHFDWFKPHQWLQ WKH8QLWHG.LQJGRP

,

,1752'8&7,21

9DULRXVW\SHVRIVLPXODWLRQSK\VLFDOO\EDVHG PRGHOVDUH ZLGHO\XVHGLQYDULRXVDUHDVRIKXPDQDFWLYLW\)RUH[DPSOH ZDWHU UHVRXUFH PDQDJHPHQW DQG SODQQLQJ LV LPSRVVLEOH ZLWKRXW XVLQJK\GURORJLFDO PRGHOV WKDW VLPXODWH WKH VWUHDP UXQRII ZLWK UHVSRQVH WR D FRPELQDWLRQ RI IRUFLQJ PHWHRURORJLFDO HYHQWV 6XFK PRGHOV DUH RIWHQ IDFHG ZLWK XQFHUWDLQW\ IURP GLIIHUHQW VRXUFHV LQFOXGLQJ QDWXUDO UDQGRPQHVV LQSXW GDWD PRGHO SDUDPHWHUV DQG PRGHO VWUXFWXUH HWF 'XH WR WKLV IDFW LQ IRUHFDVWLQJ K\GURORJLFDO YDULDEOHV VXFK DV IORZV LQ ULYHU WKH GHFLVLRQ PDNHUV RIWHQ UHTXLUH QRW RQO\ SRLQW IRUHFDVWV EXW DOVR WKH DVVRFLDWHG XQFHUWDLQW\HVWLPDWHV,QZHDWKHUSUHGLFWLRQVXFKSUDFWLFHLV FRPPRQ EXW LQ RSHUDWLRQDO K\GURORJ\ WKH UHVHDUFKHV IRFXV SULPDULO\ RQ DFFXUDWH GHWHUPLQLVWLF IRUHFDVWLQJ RI WKH K\GURORJLFDO YDULDEOHV DQG WKH\ XVXDOO\ GR QRW SURYLGH DQ\ LQIRUPDWLRQUHJDUGLQJWKHFRQILGHQFHZLWKZKLFKWKH\PDNH WKHVH IRUHFDVWV ,QFRUSRUDWLQJ XQFHUWDLQW\ HVWLPDWHV LQWR WKH FRQYHQWLRQDO GHWHUPLQLVWLF IRUHFDVWLQJ HQKDQFHV WKH UHOLDELOLW\ DQG FUHGLELOLW\ RI ERWK WKH IRUHFDVWLQJ DQG WKH ZDUQLQJ V\VWHP LQ UHDO WLPH DQG HQDEOHV DXWKRULWLHV WR VHW ULVNEDVHG FULWHULD IRU IORRG ZDUQLQJ ,W DOVR SURYLGHV LQIRUPDWLRQ QHFHVVDU\ IRU PDNLQJ UDWLRQDO GHFLVLRQV DQG RIIHUVSRWHQWLDOIRUDGGLWLRQDOHFRQRPLFEHQHILWVRIIRUHFDVWV WRHYHU\UDWLRQDOGHFLVLRQPDNHU>@ ,Q UHFHQW \HDUV WKHUH KDV EHHQ DQ LQFUHDVLQJ LQWHUHVW LQ GHYHORSLQJ PHWKRGV WR TXDQWLI\ PRGHO XQFHUWDLQW\ RI PRGHOV $ QXPEHU RI DSSURDFKHV KDYH EHHQ SURSRVHG WR HVWLPDWHPRGHOXQFHUWDLQW\,QJHQHUDOWKHVHDSSURDFKHVIDOO LQWRIRXUFDWHJRULHV>@   'XUJD /DO 6KUHVWKD LV ZLWK WKH 81(6&2,+( ,QVWLWXWH IRU :DWHU (GXFDWLRQ32%R['$'HOIW7KH1HWKHUODQGVFRUUHVSRQGLQJ DXWKRUSKRQHHPDLOGVKUHVWKD#XQHVFRLKHRUJ  'LPLWUL 3 6RORPDWLQH LV ZLWK WKH 81(6&2,+( ,QVWLWXWH IRU :DWHU (GXFDWLRQ 32 %R[   '$ 'HOIW 7KH 1HWKHUODQGV HPDLO GVRORPDWLQH#XQHVFRLKHRUJ 

  0RQWH &DUOR DSSURDFK VHH HJ >@  ,W LV VLPXODWLRQ DQGUHVDPSOLQJEDVHGWHFKQLTXHZKLFKLVDZLGHO\XVHG PHWKRGIRUXQFHUWDLQW\DQDO\VLVRIK\GURORJLFDOPRGHOV 2QHRIWKHYHUVLRQVRIVXFKDSSURDFKLQK\GURORJ\LVD JHQHUDOL]HGOLNHOLKRRGXQFHUWDLQW\HVWLPDWRU*/8(>@   %D\HVLDQ DSSURDFK 0RGHO RXWSXWV DUH IRUHFDVWHG SUREDELOLVWLFDOO\EDVHGRQ%D\HVLDQIUDPHZRUN>@   6WDWLVWLFDO DSSURDFK 8QFHUWDLQW\ LV HVWLPDWHG E\ DQDO\]LQJ WKH VWDWLVWLFDO SURSHUWLHV RI WKH PRGHO HUURUV WKDW RFFXUUHG LQ UHSURGXFLQJ WKH REVHUYHG KLVWRULFDO GDWD0RQWDQDULDQG%UDWK>@XVHGWKLVDSSURDFKIRUWKH HVWLPDWLRQ RI UDLQIDOOUXQRII VLPXODWLRQ XQFHUWDLQW\ DSSO\LQJPHWD*DXVVLDQPRGHO   )X]]\WKHRU\EDVHGDSSURDFK7KLVDSSURDFKSURYLGHVD QRQSUREDELOLVWLF DSSURDFK IRU PRGHOLQJ WKH NLQG RI XQFHUWDLQW\ DVVRFLDWHG ZLWK YDJXHQHVV DQGLPSUHFLVLRQ 0DVNH\ HW DO >@ XVH WKLV DSSURDFK WR TXDQWLI\ XQFHUWDLQW\LQUDLQIDOOUXQRIIPRGHOLQJ 7KHILUVWWZRDSSURDFKHVUHTXLUHWKHSULRUGLVWULEXWLRQVRI WKHXQFHUWDLQLQSXWSDUDPHWHUVWREHSURSDJDWHGWKURXJKWKH PRGHO WR WKH RXWSXWV 7KH VWDWLVWLFDO DSSURDFK UHTXLUHV FHUWDLQ DVVXPSWLRQV DERXW WKH GDWD DQG WKH HUURUV DQG REYLRXVO\ WKH UHOHYDQF\ DQG DFFXUDF\ RI VXFK DSSURDFK GHSHQGV RQ WKH YDOLGLW\ RI WKHVH DVVXPSWLRQV 7KH IX]]\ WKHRU\ EDVHG DSSURDFK UHTXLUHV NQRZOHGJH RI WKH PHPEHUVKLS IXQFWLRQ RI WKH TXDQWLW\ VXEMHFW WR WKH XQFHUWDLQW\DQGLWLVYHU\VXEMHFWLYH )XUWKHUPRUH WKH ILUVW DQG WKH ODVW DSSURDFKHV GHDO RQO\ ZLWK D VLQJOH VRXUFH RI XQFHUWDLQW\ W\SLFDOO\ SDUDPHWHU XQFHUWDLQW\ 'XH WR WKH LQWHUDFWLRQ EHWZHHQ YDULRXV VRXUFHV RI XQFHUWDLQW\ HJ PRGHO VWUXFWXUH LQSXWVDQG SDUDPHWHUV  LW LV QRW DOZD\V SRVVLEOH WR GLVDJJUHJDWH WKH LQGLYLGXDO FRQWULEXWLRQV IURP WKH WRWDO PRGHO XQFHUWDLQW\ DQG WKH DXWKRUV GR QRW IXOO\ LQYHVWLJDWH KRZ WKHVH GLIIHUHQW VRXUFHV LQWHUDFW DQG FRQWULEXWH WR WKH WRWDO PRGHO XQFHUWDLQW\ )RU GHFLVLRQPDNLQJLWLVRIWHQHQRXJKWRNQRZWKHWRWDOPRGHO XQFHUWDLQW\ DJJUHJDWH DIIHFW RI DOO VRXUFHV RI XQFHUWDLQW\  DQG QRW WKH LQGLYLGXDO VRXUFHV RI XQFHUWDLQW\ 5HFHQWO\ 6KUHVWKDDQG6RORPDWLQH>@SUHVHQWHGWKHEDVLFVRIDQRYHO PHWKRGWRHVWLPDWHWKHWRWDOPRGHOXQFHUWDLQW\WKDWWDNHVLQWR DFFRXQW DOO VRXUFHV RI XQFHUWDLQW\ ZLWKRXW DWWHPSWLQJ WR VHSDUDWH WKH FRQWULEXWLRQJLYHQ E\ WKH LQGLYLGXDO VRXUFHV RI XQFHUWDLQWLHV 7KH\ PHDVXUH WKH PRGHO XQFHUWDLQW\ E\ HVWLPDWLQJRQO\WZRTXDQWLOHVRIWKHSUREDELOLW\GLVWULEXWLRQ RIWKHPRGHOHUURUWKDWFRQVWLWXWHVWKHSUHGLFWLRQLQWHUYDORI WKH PRGHO RXWSXW 7KLV SDSHU SUHVHQWV D FHUWDLQ JHQHUDOL]DWLRQ RI WKH PHWKRG SDUWLFXODUO\ QRW OLPLWLQJ WKH PHDVXUHPHQW RI XQFHUWDLQW\ RQO\ E\ WZR TXDQWLOHV DQG E\



1411 c 978-1-4244-1821-3/08/$25.002008 IEEE





DVVXPLQJ WKH SRVVLELOLW\ RI XVLQJ D ZLGH FODVV RI PDFKLQH OHDUQLQJ WHFKQLTXHV IURP UHJUHVVLRQ WR LQVWDQFHEDVHG OHDUQLQJ DQG FODVVLILFDWLRQ 7KH DSSURDFK LV UHIHUUHG WR DV 81FHUWDLQW\ (VWLPDWLRQ EDVHG RQ /RFDO (UURUV DQG &OXVWHULQJ81((&  7KH 81((& PHWKRG HVWLPDWHV WRWDO PRGHO XQFHUWDLQW\ VLPLODUWRWKHVWDWLVWLFDODSSURDFKLHE\DQDO\]LQJDQGXVLQJ VWDWLVWLFDO SURSHUWLHV RI WKH KLVWRULFDO PRGHO HUURUV 7KH PHWKRG DVVXPHV WKH PRGHO HUURU PLVPDWFK EHWZHHQ WKH REVHUYHGDQGPRGHOHGYDOXH WREHDQLQGLFDWLRQRIWKHWRWDO PRGHO XQFHUWDLQW\ 7KH PDLQ LGHD KHUH LV WR HVWLPDWH WKH SUREDELOLW\ GLVWULEXWLRQ IXQFWLRQ SGI  RI WKH PRGHO RXWSXW XVLQJ PDFKLQH OHDUQLQJ WHFKQLTXHV ,Q WKLV SDSHU ZH DSSUR[LPDWHWKLVSGIRQO\E\WKHWZRTXDQWLOHVWKDWSHUPLWWR LGHQWLI\ WKH SUHGLFWLRQ LQWHUYDO RI WKH PRGHO RXWSXW FRUUHVSRQGLQJWRVRPHFRQILGHQFHOHYHOVD\HJ  :H DOVR FRPSDUHG WZR FODVVHV RI PDFKLQH OHDUQLQJ PHWKRGV QDPHO\ WKH LQVWDQFH EDVHG DQG UHJUHVVLRQ WR HVWLPDWHWKHWRWDOPRGHOXQFHUWDLQW\7KH+%9K\GURORJLFDO PRGHO >@ RI WKH %UXH FDWFKPHQW ZDWHUVKHG  LQ WKH 8QLWHG .LQJGRPLVXVHGDVDQH[DPSOH ,,

0(7+2'2/2*@ DQG WKH ;LH±%HQL¶V VHSDUDWLRQLQGH[>@+RZHYHUWKHRSWLPDOFOXVWHUVREWDLQHG WKURXJK WKH YDOLGLW\ PHDVXUHV KDYH WR EH FKHFNHG WKURXJK WKHILQDOUHVXOWVRIDSSOLFDWLRQZKHUHWKHFOXVWHULQJWHFKQLTXH ZDVDSSOLHG % (VWLPDWLQJSUREDELOLW\GLVWULEXWLRQRIWKHHUURU 3UREDELOLW\GLVWULEXWLRQRIWKHPRGHOHUURUVIRULQGLYLGXDO FOXVWHUV LV HVWLPDWHG LQGHSHQGHQWO\ EDVHG RQ WKH DYDLODEOH KLVWRULFDO PRGHO UHVLGXDOV )URP WKLV GLVWULEXWLRQ ZH FDQ FRPSXWH VRPH TXDQWLOH HFS RI WKH HUURU GLVWULEXWLRQ FRUUHVSRQGLQJ WR WKH SUREDELOLW\ S ZKHUH S KDV YDOXHV LQ >@ 7KH HVWLPDWLRQ RI TXDQWLOH HFS GHSHQGV RQ WKH FOXVWHULQJ PHWKRGXVHG)RUH[DPSOHLI.PHDQVLVXVHGHDFKLQVWDQFH RI GDWD EHORQJV WR RQO\ RQH FOXVWHU LH ³PDQ\ WR RQH´ UHODWLRQVKLSV DUH HVWDEOLVKHG  DQG WKH TXDQWLOHV DUH GHWHUPLQHG IURP WKH HPSLULFDO HUURU GLVWULEXWLRQ IRU HDFK FOXVWHU LQGHSHQGHQWO\ +RZHYHU LQ WKH FDVH RI IX]]\ FOXVWHULQJ ZKHUH HDFK LQVWDQFH EHORQJV WR PRUH WKDQ RQH FOXVWHU LH ³PDQ\ WR PDQ\´ UHODWLRQVKLSV DUH HVWDEOLVKHG  DQG LV DVVRFLDWHG ZLWK VHYHUDO PHPEHUVKLS IXQFWLRQV WKH FRPSXWDWLRQ RI WKH TXDQWLOHV VKRXOG WDNH WKLV LQWR DFFRXQW 7KHIROORZLQJH[SUHVVLRQLVXVHGWRHVWLPDWHWKHTXDQWLOHRI WKHSUREDELOLW\GLVWULEXWLRQRIWKHPRGHOHUURUIRUFOXVWHUL M

Q

N =

M =

HFLS = ε M M  ¦ μL N < S ¦ μL  M 

 

ZKHUHHFLSLVWKHTXDQWLOHFRUUHVSRQGLQJWRWKHSUREDELOLW\ S IRU FOXVWHU L M LV WKH PD[LPXP LQWHJHU YDOXH UXQQLQJ IURP XQLW\ WKDW VDWLVILHV WKH DERYH LQHTXDOLW\ εM LV WKH UHVLGXDO

DVVRFLDWHGZLWKWKHMWKGDWDGDWDDUHVRUWHGZLWKUHVSHFWWRWKH DVVRFLDWHGUHVLGXDO  μLMLVWKHPHPEHUVKLSIXQFWLRQRIWKHMWK GDWDWRFOXVWHUL  & %XLOGLQJXQFHUWDLQW\SURFHVVRU 7KH XQFHUWDLQW\ SURFHVVRU 8 SUHGLFWV WKH SUREDELOLW\ GLVWULEXWLRQRIWKHPRGHOHUURUVIRUWKHXQVHHQLQSXWYHFWRUV HJLQYDOLGDWLRQGDWD $QDSSURDFKKHUHFRXOGEHWRWUDLQ VHYHUDO PRGHOV 8S WR HVWLPDWH WKH TXDQWLOHV RI SGI RI WKH PRGHOHUURUV HS =8 S; 

 

ZKHUHHSLVWKHTXDQWLOHRISGIRIWKHPRGHOHUURUVUHODWHGWR WKH LQGLYLGXDO LQSXW GDWD 1RWH WKDW HFS ZDV XVHG WR GHQRWH WKHTXDQWLOHRIWKHSGIIRUWKHFOXVWHU8QFHUWDLQW\SURFHVVRU 8 FDQ EH EXLOW XVLQJ D QXPEHU RI DSSURDFKHV DV SUHVHQWHG EHORZ (DJHU FODVVLILFDWLRQ 7KH FODVVLILHULV WUDLQHG RQ WKH GDWD VHW ; WR FODVVLI\ WKH LQSXW VSDFH WR WKH FOXVWHUV ZKLFK ZHUH LGHQWLILHGGXULQJWKHFOXVWHULQJSURFHVVVHH VXEVHFWLRQ$  7KH FKRLFH RI YDULDEOHV ^[L ` WR WUDLQ WKH FODVVLILHU PD\ UHTXLUH VRPH DQDO\VLV HQVXULQJ WKH KLJK DFFXUDF\ RI WKH FODVVLILHU 3UHGLFWLRQ RI WKH TXDQWLOH HS IRU WKH XQVHHQ LQSXW GDWD HJ LQ YDOLGDWLRQ GDWD  FRQVLVWV RI DWWULEXWLQJLWWR WKH RQH RI WKH FOXVWHU ILUVW DQG DVVLJQLQJ WKH FRUUHVSRQGLQJ TXDQWLOH RI WKH FOXVWHU HFS VHH )LJ   7KLV PHWKRG LV RQO\ DSSOLFDEOHWRWKHFULVSFOXVWHULQJ ,QVWDQFHEDVHG OHDUQLQJ ,Q LQVWDQFHEDVHG OHDUQLQJ LQVWHDGRIEXLOGLQJDFODVVLILHUDGLVWDQFHIXQFWLRQLVXVHGWR LGHQWLI\WKHFOXVWHUIRUWKHXQVHHQLQSXWYHFWRUDQGUHSUHVHQW LW E\ WKH SURWRW\SH YHFWRU RU LWV FHQWHU >@ WKH GLVWDQFH IURPWKHQHZYHFWRUWRWKHFOXVWHUSURWRW\SHRUFHQWHUVKRXOG EHPLQLPDO   

)LJ8QFHUWDLQW\SURFHVVRUXVLQJDFODVVLILHU &ODVVLILHULVILUVWWUDLQHG EDVHG RQ WKH UHVXOWV RI FOXVWHULQJ 7KHQ XQVHHQ LQSXW GDWD LH YDOLGDWLRQ GDWD LVFODVVLILHGWRRQHRIWKHFODVVHVDQGWKHTXDQWLOHFRUUHVSRQGLQJWRWKLV FODVVLVXVHGDVWKHTXDQWLOHRIWKHXQVHHQGDWD 

)LJ  SUHVHQWV WKH PRGLILHG PHWKRG WR LQVWDQFH EDVHG OHDUQLQJ IRU WKH HVWLPDWLRQ RI WKH TXDQWLOH HS XVLQJ WKH VR FDOOHG IX]]\ FRPPLWWHH DSSURDFK ,QVWHDG RI DVVLJQLQJ DQ



2008 International Joint Conference on Neural Networks (IJCNN 2008)

1413







LQSXWYHFWRUWRDSDUWLFXODUFOXVWHUIX]]\PHPEHUVKLSZHLJKW μLM LV FRPSXWHG XVLQJ GLVWDQFH IXQFWLRQ EHWZHHQ FOXVWHU FHQWHUVDQGLQSXWGDWDZKLFKUHIOHFWVSUR[LPLWLHVRIWKHLQSXW GDWDWRWKHFOXVWHUFHQWHUV7KHUHDUHPDQ\GLIIHUHQWZD\VRI GHILQLQJ D GLVWDQFH IXQFWLRQ DQG LW LV KDUG WR ILQG UDWLRQDO JURXQGVIRUFKRRVLQJDSDUWLFXODURQH7\SLFDOO\WKHUHODWLRQ EHWZHHQZHLJKWDQGGLVWDQFHIXQFWLRQVWDNHVWKHIRUPRI

μ L M = G 9L  [ M −  P 

 

 

S

S

ZKHUH θ  LV WKH YHFWRU RI SDUDPHWHUV RI WKH PRGHO 8  IRU TXDQWLOH ZLWK SUREDELOLW\ S 7KXV WKH PRGHO 8 DIWHU EHLQJ WUDLQHG HQFDSVXODWHV WKH XQGHUO\LQJ SUREDELOLW\ GLVWULEXWLRQ RI WKH PRGHO HUURU DQG PDSV WKH LQSXWWR WKLV SUREDELOLW\ GLVWULEXWLRQ 1RWH WKDWPRGHO 8 FDQWDNHDQ\ RI IRUP IURP OLQHDU WR QRQOLQHDU IXQFWLRQ VXFK DV DQ DUWLILFLDO QHXUDO QHWZRUN7KHFKRLFHRIWKHPRGHOGHSHQGVRQWKHFRPSOH[LW\ RI WKH SUREOHP WR EH KDQGOHG DQG WKH DYDLODELOLW\ RI GDWD 2QFH WKH PRGHO 8 LV WUDLQHG RQ WKH LQSXW GDWD ; LW FDQ EH HPSOR\HG WR HVWLPDWH WKH TXDQWLOHV RI WKH SGI RI WKH PRGHO HUURU LQ WKH YDOLGDWLRQ GDWD VHW WKH QHZ GDWD VHW ZKLFK DUH QRWXVHGLQDQ\PRGHOEXLOGLQJSURFHVV   

HMS = 8 S ;θ S

ZKHUHPLVWKHVPRRWKLQJH[SRQHQWLDOFRHIILFLHQWG9L [M LV WKH RUGLQDU\ (XFOLGHDQ GLVWDQFH EHWZHHQ FOXVWHU FHQWHUV 9L DQGWKH LQSXW GDWD [M7KH VPDOOHU YDOXH RI P ≈  JLYHV UHODWLYHO\KLJKHUZHLJKWWRWKHOHDVWGLVWDQFHZKLOHWKHKLJKHU YDOXHRILW≈ JLYHVDOPRVWHTXDOZHLJKWV  

H MS = 8 S  ; θ S 

F

¦μ

L M

F

HFLS

H S = ¦ μL HFLS 

L =

L =

 )LJ8QFHUWDLQW\SURFHVVRUXVLQJLQVWDQFHEDVHGOHDUQLQJ)RUHDFKXQVHHQ GDWDWKHZHLJKWμLMLVFRPSXWHGE\WKHGLVWDQFH7KHTXDQWLOHHFSRIWKH XQVHHQGDWDLVWKHFRPSXWHGE\FRPELQLQJWKHHSRIWKHFOXVWHUVXVLQJWKH ZHLJKWμLM

2QFHWKHIX]]\ ZHLJKWVDUHFRPSXWHGWKHTXDQWLOH HSIRU WKH JLYHQ LQSXW GDWD FDQ EH FRPSXWHG XVLQJ WKH IX]]\ FRPPLWWHHDVIROORZV F

H MS =

¦ μ L M HF

S L

L =

F

¦μ

L M



 



L =

ZKHUHHMSLVWKHTXDQWLOHRIWKHSGIRIWKHPRGHOHUURUIRUMWK LQVWDQFHZLWKSUREDELOLW\SDQGHFL SLVWKHTXDQWLOHRIWKHLWK FOXVWHU 5HJUHVVLRQ ,Q WKLV DSSURDFK ILUVW HMS IRU HDFK WUDLQLQJ H[DPSOH KDYH WR EH FRPSXWHG EDVHG RQ WKH HFLS IRU HDFK FOXVWHU 7KH DWWULEXWLRQ RI WKH TXDQWLOHV WR WKH WUDLQLQJ H[DPSOHV GHSHQGV RQ WKH W\SHV RI FOXVWHULQJ WHFKQLTXHV HPSOR\HG )RU H[DPSOH LQ FULVS FOXVWHULQJ D FODVVLILFDWLRQ DSSURDFK DV GHVFULEHG SUHYLRXVO\ FDQ EH XVHG +RZHYHU LQ WKHFDVHRI IX]]\FOXVWHULQJDIX]]\FRPPLWWHHDSSURDFKDV GHVFULEHGLQLQVWDQFHEDVHGPHWKRGLVXVHG 2QFH WKH TXDQWLOHV HMS IRU HDFK H[DPSOH LQ WKH WUDLQLQJ GDWDDUHREWDLQHGUHJUHVVLRQPRGHOVHH)LJ LVEXLOWWKDW HVWLPDWHWKHXQGHUO\LQJIXQFWLRQDOUHODWLRQVKLSVEHWZHHQWKH LQSXWGDWDPDWUL[;DQGWKHTXDQWLOHHMSDV

$VPHQWLRQHGDERYHWKHVHSUHGLFWHGTXDQWLOHVVKRXOGEH WUDQVIHUUHGWRDPRUHPHDQLQJIXODQGXQGHUVWDQGDEOHHQWLW\ SUHGLFWLYH XQFHUWDLQW\ RI WKH PRGHO RXWSXW 7KH TXDQWLOH RI WKH SUHGLFWLYH XQFHUWDLQW\ RI WKH PRGHO RXWSXW FDQ EH HVWLPDWHGDV \ S = \Ö + H S 

 

ZKHUH \ S LVWKHSWK TXDQWLOHRIWKHSGI RIWKHPRGHORXWSXW 2QHFDQVHHWKDWHTXDWLRQ LVDUHIRUPXODWLRQRIHTXDWLRQ   ,Q RUGHU WR HVWLPDWH IRU H[DPSOH  SUHGLFWLRQ LQWHUYDO LW LV UHTXLUHG WR EXLOG WZR PRGHOV 8 DQG 8 WKDW ZLOOSUHGLFWDQGTXDQWLOHVRISGIRIWKHPRGHOHUURU  ,,, $33/,&$7,21+@ - & %H]GHN 3DWWHUQ 5HFRJQLWLRQ ZLWK )X]]\ 2EMHFWLYH )XQFWLRQ $OJRULWKPV 1RUZHOO0$ 86$ .OXZHU $FDGHPLF 3XEOLVKHUV >@ ; / ;LH DQG * %HQL ³$ YDOLGLW\ PHDVXUH IRU IX]]\ FOXVWHULQJ´ ,((( 7UDQV RQ 3DWWHUQ $QDO\VLV DQG 0DFKLQH ,QWHOOLJHQFHYROQRSS± >@: 'XFK DQG . *UXG]LQVNL 3URWRW\SH EDVHG UXOHVD QHZ ZD\ WR XQGHUVWDQG WKH GDWD ,QWHUQDWLRQDO -RLQW &RQIHUHQFH RQ1HXUDO1HWZRUNV:DVKLQJWRQ >@5 * $OOHQ 6 / 3HUHLUD ' 5DHV DQG 0 6PLWK &URS (YDSRWUDQVSLUDWLRQ JXLGHOLQHV IRU FRPSXWLQJ FURS ZDWHU UHTXLUHPHQWV )$2 ,UULJDWLRQ DQG 'UDLQDJH 3DSHU  5RPH  >@'3 6RORPDWLQH 7ZR VWUDWHJLHV RI DGDSWLYH FOXVWHU FRYHULQJ ZLWK GHVFHQW DQG WKHLU FRPSDULVRQ WR RWKHU DOJRULWKPV - RI *OREDO2SWLPL]DWLRQYRO1RSS >@-(1DVKDQG-96XWFOLIIH5LYHUIORZIRUHFDVWLQJWKURXJK FRQFHSWXDO PRGHOV 3DUW  $ 'LVFXVVLRQ 3ULQFLSOHV - RI +\GURORJ\YROSS >@- 5 4XLQODQ ³/HDUQLQJ ZLWK FRQWLQXRXV FODVVHV´ 7KH WK $XVWUDOLDQ-RLQW&RQIHUHQFHRQ$,:RUOG6FLHQWLILF

5()(5(1&(6 >@ 5 .U]\V]WRIRZLF] ³7KH FDVH IRU SUREDELOLVWLF IRUHFDVWLQJ LQ K\GURORJ\´-RI+\GURORJ\YROSS >@ ' / 6KUHVWKD DQG ' 3 6RORPDWLQH ³0DFKLQH OHDUQLQJ DSSURDFKHVIRUHVWLPDWLRQRISUHGLFWLRQLQWHUYDOIRUWKHPRGHO RXWSXW´1HXUDO1HWZRUNVYROQRSS



2008 International Joint Conference on Neural Networks (IJCNN 2008)

1417