Gabriel L. F. B. G. Azevedo, George D. C. Cavalcanti and E. C. B. Carvalho Filho. Center of Informatics ...... [2] S. Cho, C. Han and H. Kim. Web-based keystroke ...
$QDSSURDFKWRIHDWXUHVHOHFWLRQIRUNH\VWURNHG\QDPLFVV\VWHPV EDVHGRQ362DQGIHDWXUHZHLJKWLQJ *DEULHO/)%*$]HYHGR*HRUJH '&&DYDOFDQWLDQG(&%&DUYDOKR)LOKR &HQWHURI,QIRUPDWLFV )HGHUDO8QLYHUVLW\RI3HUQDPEXFR 32%R[&LGDGH8QLYHUVLWDULD 5HFLIH±3(%UD]LO (PDLO ^JOIEJDJGFFHFGEFI`#FLQXISHEU
$EVWUDFW² 7HFKQLTXHV EDVHG RQ ELRPHWULFV KDYH EHHQ VXFFHVVIXOO\ DSSOLHG WR SHUVRQDO LGHQWLILFDWLRQ V\VWHPV 2QH UDWKHU SURPLVLQJ WHFKQLTXH XVHV WKH NH\VWURNH G\QDPLFV RI HDFKXVHULQ RUGHU WR UHFRJQL]H KLPKHU,QWKHSUHVHQW VWXG\ ZH SUHVHQW WKH GHYHORSPHQW RI D K\EULG V\VWHP EDVHG RQ VXSSRUW YHFWRU PDFKLQHV DQG VWRFKDVWLF RSWLPL]DWLRQ WHFKQLTXHV 7KH PDLQ REMHFWLYH LV WKH DQDO\VLV RI WKHVH RSWLPL]DWLRQDOJRULWKPVIRUIHDWXUHVHOHFWLRQ:HHYDOXDWHWZR RSWLPL]DWLRQ WHFKQLTXHV IRU WKLV WDVN JHQHWLF DOJRULWKPV *$ DQG SDUWLFOH VZDUP RSWLPL]DWLRQ 362 :H XVH WKH VWDQGDUG *$ DQG ZH FUHDWHG D 362 YDULDWLRQ ZKHUH HDFK SDUWLFOH LV UHSUHVHQWHG E\ D YHFWRU RI SUREDELOLWLHV WKDW LQGLFDWH WKH SRVVLELOLW\RIVHOHFWLQJDSDUWLFXODUIHDWXUHDQGGLUHFWO\DIIHFWV WKH RULJLQDO YDOXHV RI WKH IHDWXUHV ,Q WKH SUHVHQW VWXG\ 362 RXWSHUIRUPHG *$ ZLWK UHJDUG WR FODVVLILFDWLRQ HUURU SURFHVVLQJWLPHDQGIHDWXUHUHGXFWLRQUDWH
,
, ,1752'8&7,21
QIRUPDWLRQVHFXULW\V\VWHPVEDVHGRQNH\VWURNHG\QDPLFV KDYH EHHQ FXUUHQWO\ DWWUDFWLQJ FRQVLGHUDEOH DWWHQWLRQ DV D FKHDS VROXWLRQ WKDW LV PRUH WUDQVSDUHQW WR WKH XVHU WKDQ ILQJHUSULQW RU LULV UHFRJQLWLRQ >@ ,Q WKLV W\SH RI V\VWHP D XVHULVLGHQWLILHGE\DORJLQSDVVZRUGDQGNH\VWURNHSDWWHUQ WKHODWWHURIZKLFKLVDXQLTXHWUDLWWKDWLVIDUPRUHGLIILFXOW WR FRS\ WKDQ WKH RWKHUV DQGUXQVQRULVN RI HYHU EHLQJ ORVW 7KLV V\VWHP FRXOG EH XVHG LQ DQ\ VHWWLQJ ZKHUH WKH XVHU QHHGV D SDVVZRUG LQ RUGHU WR JDLQ DFFHVV WR SDUWLFXODU LQIRUPDWLRQDQGRU IXQFWLRQDOLWLHVLQFOXGLQJ ,QWHUQHW DFFHVV >@ 3HUVRQDO YHULILFDWLRQ V\VWHPV WKURXJK VRPH W\SH RI EHKDYLRUDO ELRPHWULF FKDUDFWHULVWLF VXFKDV VLJQDWXUH YRLFH RUNH\VWURNHG\QDPLFDUHQRUPDOO\FRQVWUXFWHGIURPDVHWRI H[DPSOHV WKDW GHILQH WKH XVHU ,Q WKH FDVH RI NH\VWURNH G\QDPLF LW ZRXOG EH QHFHVVDU\ IRU WKH XVHU WR W\SH KLVKHU QDPHRUSDVVZRUGDQXPEHURIWLPHVLQRUGHUIRUWKHV\VWHP WR EH DEOH WR H[WUDFW WKH UHOHYDQW IHDWXUHV WKDW XQLTXHO\ UHSUHVHQW WKH XVHU +RZHYHU WKH WDVN RI W\SLQJ RQH V QDPH RYHU DQG RYHU LV ERWK WLULQJ DQG WHGLRXV ZKLFK FRXOG OHDG XVHUVWRDOWHUWKHLUQRUPDOSDWWHUQ7KXVPRVWV\VWHPVEDVHG RQELRPHWULFVDUHUHTXLUHGWRZRUNZLWKDVXPPDUL]HGVHWRI LQIRUPDWLRQ ZLWK OLWWOH LQIRUPDWLRQ IURP ZKLFK WR H[WUDFW NQRZOHGJH ,Q RUGHU WR UHGXFH WKLV SUREOHP ZH FRXOG XVH VXEVHWV RI GDWD WKDW EHWWHU UHSUHVHQW WKH FODVVHV UHVSRQVLEOH IRU LGHQWLI\LQJ WKH GLIIHUHQW XVHUV RI D V\VWHP $ORQJ ZLWK
WKH UHGXFWLRQ LQ WKH QXPEHU RI IHDWXUHV WKDW QHHG WR EH OHDUQHG WKHUHE\LQFUHDVLQJWKHDFFXUDF\ RIWKHV\VWHP ZH DOVRGLPLQLVKWKHSURFHVVLQJWLPH2QHZD\WRUHGXFHWKLVVHW RI LQIRUPDWLRQ ZRXOG EH WR KDYH D VSHFLDOLVW GHOHWH WKH OHVV UHSUHVHQWDWLYHGDWDEXWVXFKDWDVNLVVXEMHFWLYHDQGVXEMHFW WRHUURUV>@,WLVH[SHFWHGWKDWDV\VWHPRIWKLVW\SHVKRXOG EH H[HFXWHGDXWRPDWLFDOO\ZKHUHWKHXVHURQO\KDVWKHWDVN RI W\SLQJ KLVKHU GDWD UHSHDWHGO\ 7KH HQWLUH UHFRJQLWLRQ SURFHVVLVDFFRPSOLVKHGE\WKHV\VWHPDXWRPDWLFDOO\,QWKH SUHVHQW ZRUN ZH XVH D WHFKQLTXH EDVHG RQ JHQHWLF DOJRULWKPV IRU WKH IHDWXUH VHOHFWLRQ UHVHDUFKHG LQ SUHYLRXV LQYHVWLJDWLRQVVXFKDV>@DQGZHSURSRVHDQHZWHFKQLTXH EDVHG RQ 362 3DUWLFOH 6ZDUP 2SWLPL]DWLRQ >@ >@ >@ ZKLFK LV DQ HYROXWLRQDU\ FRPSXWDWLRQ RSWLPL]DWLRQ WHFKQLTXHEDVHGRQWKHIORFNLQJEHKDYLRURIELUGV7KLVQHZ WHFKQLTXHLVDYDULDWLRQRIWKDWSUHVHQWHGLQ>@ ,QWKHQH[W VHFWLRQ WKH 690PRGHO LV LQWURGXFHG DQG LQ WKHVHFWLRQ,,,R362DOJRULWKPLVLQWURGXFHG,Q6HFWLRQ,9 RI WKLV DUWLFOH ZH SUHVHQW WKH PHWKRG XVHG WR H[WUDFW IHDWXUHV 6HFWLRQ 9 SUHVHQWV WKH PHWKRGV XVHG LQ WKH SUH SURFHVVLQJ RI WKH GDWD 6HFWLRQ 9, GHVFULEHV WKH DFTXLVLWLRQ DQGGLYLVLRQRIWKHGDWDEDVH7KHH[SHULPHQWVSHUIRUPHGDQG WKHLU UHVXOWV DUH SUHVHQWHG LQ 6HFWLRQV 9,, DQG 9,,, UHVSHFWLYHO\)LQDOO\LQ6HFWLRQ,;ZHKDYHWKHFRQFOXVLRQV DQGVXJJHVWLRQVIRUIXUWKHUVWXGLHV ,, 68332579(&7250$&+,1( ,QUHFHQW ZRUN VXFK DV >@>@ 690 PRGHOVKDYH EHHQ SURSRVHGWRVROYHQRYHOW\GHWHFWLRQSUREOHPV7KHEDVLFLGHD RIWKLVDSSURDFKLVWKHFUHDWLRQRIDUHJLRQWKDWHQFORVHVWKH PDMRULW\ RI GDWD SHUWDLQLQJ WR D SDUWLFXODU FODVV PDNLQJ LW SRVVLEOH WKDW VRPH DXWKHQWLF SDWWHUQV RI WKH FODVV DUH QRW FRQWDLQHGZLWKLQWKLVUHJLRQ7KHPRGHOZRXOGJHQHUDWHWKH VPDOOHVWSRVVLEOHUHJLRQWKDWFRXOGHQFORVLQJWKHPDMRULW\RI GDWDDQGZRXOGGHILQHDSDUWLFXODUWKUHVKROGWKDWLQGLFDWHGWR ZKDWH[WHQWDSDUWLFXODUSDWWHUQFRXOGEHRXWVLGHWKLVUHJLRQ DQGVWLOOEHFRQVLGHUHGDQDXWKHQWLFSDWWHUQ)XUWKHUGHWDLOLQJ WKHZD\LQZKLFKWKH690ZRXOGSHUIRUPWKLVWDVNWKHLGHD ZRXOG EH WR PDS WKH LQSXW VHW RI GDWD LQ D VSDFH RI KLJK GLPHQVLRQDOLW\IHDWXUHVFRUUHVSRQGLQJWRWKHNHUQHODQGWKHQ VHSDUDWHWKHPIURPWKHRULJLQZLWKDPD[LPXPPDUJLQ7KH DOJRULWKP ZRXOG ILQG D IXQFWLRQ I WKDWUHWXUQHG ³´ LQ WKH UHJLRQLWIRXQGWKDWHQFORVLQJWKHPDMRULW\RIGDWDFRQWDLQHG
3577 c 1-4244-1340-0/07$25.00 2007 IEEE
LQWKHLQSXWVHW QRUPDOGDWD DQG³´IRUGDWDRXWVLGHWKLV UHJLRQ QRYHO GDWD $IWHU ILQGLQJ WKLV IXQFWLRQ DQ\ QHZ SDWWHUQ WKDW ZDV SUHVHQWHG WR WKLV DOJRULWKP ZRXOG KDYH LWV YDOXHI [ GHWHUPLQHGE\WKHLQGLFDWLRQRIZKLFKVLGHRIWKH K\SHUSODQH LW ZDV IRXQG LQ WKH IHDWXUH VSDFH UHWXUQLQJ IRUSDWWHUQVFRQVLGHUHGDXWKHQWLFRUQRUPDODQGIRUQRYHO SDWWHUQV DVVKRZQLQ)LJXUH
YHFWRUV>@YFDQWDNHRQYDOXHVEHWZHHQQDQGZKHUHQ LV WKH QXPEHU RI SDWWHUQV 7KH ĮL YDULDEOHV UHSUHVHQW WKH /DJUDQJHPXOWLSOLHUV WKHUHLVRQHIRUHDFKSDWWHUQFRQWDLQHG LQ WKH RULJLQDO VHW 7KH WDVN RI WKH DOJRULWKP LV WR ILQG WKH YDOXHVRIWKHVHFRHIILFLHQWV,WLVLPSRUWDQWWRVWUHVVWKDWRQO\ WKH /DJUDQJH PXOWLSOLHUV DVVRFLDWHG WR WKH VHW RI VXSSRUW YHFWRUV KDYH YDOXHV GLIIHUHQW IURP ]HUR :KHQ WKHVH PXOWLSOLHUVDUHREWDLQHGWKHGHFLVLRQIXQFWLRQLVGHILQHGDV K( [ ) = ¦ α L N ( [ L [ ) − ρ L ∈ 69
ZKHUHWKHVXPLVRQO\YDOLGIRUWKHPXOWLSOLHUVDVVRFLDWHGWR WKH VXSSRUW YHFWRUV ȡ LV WKH WKUHVKROG ZKLFK LV FDOFXODWHG GXULQJWUDLQLQJ IRUIXUWKHUGHWDLOVVHH>@ ,,, 3$57,&/(6:$50237,0,=$7,21
)LJXUH±690PRGHOIRUQRYHOW\GHWHFWLRQ
7KH PRVW XVHG NHUQHO IXQFWLRQ LQ QRYHOW\ GHWHFWLRQ SUREOHPVLV*DXVVLDQJLYHQE\(TXDWLRQ
(
. ( [ \ ) = H[S − [ − \
)
σ
ZKHUHWKHSDUDPHWHUıLVUHVSRQVLEOHIRUWKHYDULDWLRQLQWKH GLIIHUHQW HVWLPDWHV RI UHJLRQV LQ ZKLFK WKH DXWKHQWLF GDWD ZRXOG EH FRQWDLQHG ,W LV LPSRUWDQW WR SRLQW RXW WKDW WKH *DXVVLDQ NHUQHO HQVXUHV 0HUFHU V FRQGLWLRQ LQ ZKLFK IRU HYHU\YDOXHRIı. [\ FRUUHVSRQGVWRWKHLQWHUQDOSURGXFW EHWZHHQ SDWWHUQV [ DQG \ DIWHU WKHVH SDWWHUQV KDYH EHHQ PDSSHGIRUWKHVHWRIIHDWXUHVDVZHFDQVHHLQ(TXDWLRQ . ( [ \ ) = (Φ ( [ ) ⋅ Φ ( \ )) 7KHUHJLRQVIRXQGE\WKH690DOJRULWKPDUHGHWHUPLQHG E\DVXEVHWRIGDWDWKDWIRUPWKHWUDLQLQJVHWDQGDUHIRXQG RQWKHERXQGDU\EHWZHHQEHLQJZLWKLQWKHUHJLRQVIRUPHGE\ DXWKHQWLF GDWD RU EHLQJ RXWVLGH LW DQG FRQVLGHUHG QRYHOW\ 7KHGDWDWKDWFRPSRVHWKLVVXEVHWDUHFDOOHGVXSSRUWYHFWRUV :LWKRXW JRLQJ LQWR JUHDW GHWDLO LQ RUGHU WR VHSDUDWH DXWKHQWLF GDWD IURP XQDXWKHQWLF GDWD WKH 690 DOJRULWKP DWWHPSWVWRRSWLPL]HWKHIROORZLQJH[SUHVVLRQ PLQ ¦ α L α M N [ L [ M α
(
)
VXEMHFWWRWKHIROORZLQJFRQVWUDLQWV
¦ α L = ∀L ≤ α L ≤ L
νG
ZKHUHGUHSUHVHQWVWKHGLPHQVLRQDOLW\RIWKHGDWDDQGYLVD IUHHSDUDPHWHUWKDWDFWVDVERWKWKHXSSHUERXQGIRUSDWWHUQV FRQVLGHUHG QRYHO DQG WKH ORZHU ERXQG IRU WKH VXSSRUW
3578
362 ZDV LQWURGXFHG LQ WKH PLG V E\ >@ DQG LV D VWRFKDVWLF VHDUFK WHFKQLTXH WKDW DLPV WR RSWLPL]H DQ REMHFWLYH IXQFWLRQ ,W ZDV GHYHORSHG WKURXJK DWWHPSWV WR JUDSKLFDOO\ VLPXODWH WKH PRYHPHQW SDWWHUQV RI ELUGV LQ VHDUFK RI IRRG /DWHU LQ WKH VHDUFK IRU WKHRUHWLFDO IRXQGDWLRQVVWXGLHVZHUHFDUULHGRXWRQWKHPDQQHULQZKLFK LQGLYLGXDOV LQ VRFLHW\ JHQHUDOO\ LQWHUDFW H[FKDQJLQJ LQIRUPDWLRQ DQG UHYLHZLQJ WKHLU FRQFHSWV LQ WKH VHDUFK IRU EHWWHUVROXWLRQVWRWKHLUSUREOHPV>@ ,Q 362 D SRSXODWLRQ VZDUP RI VROXWLRQV SDUWLFOHV LV PDLQWDLQHG /HW V EH WKH VL]H RI WKH VZDUP Q EH WKH GLPHQVLRQRIWKHSUREOHPDQGWEHWKHFXUUHQWLQVWDQWHDFK SDUWLFOH L V KDV D SRVLWLRQ [L W ∈ 5Q LQ WKH VSDFH RI VROXWLRQVDQGDYHORFLW\YL W ∈ 5QWKDWJRYHUQVWKHGLUHFWLRQ DQG UDQJH RI LWV PRYHPHQW 0RUHRYHU HDFK SDUWLFOH KDV D PHPRU\ \L W ∈ 5Q RI WKH EHVW LQGLYLGXDO SRVLWLRQ YLVLWHG XQWLO LQVWDQW W DQG WKH VZDUP KDV D PHPRU\ RI WKH EHVW SRVLWLRQLWKDVYLVLWHGVRIDU $V WKH DOJRULWKP UXQV WKH YHORFLW\ RI HDFK SDUWLFOH LV FDOFXODWHG DFFRUGLQJ WR WZR PDLQ UHIHUHQFHV WKH EHVW LQGLYLGXDO SRVLWLRQ YLVLWHG \L W FRJQLWLYH WHUP RI RSWLPL]DWLRQ DQG WKH EHVW SRVLWLRQ YLVLWHG E\ WKH VZDUP \Ö W VRFLDO WHUP RI RSWLPL]DWLRQ $IWHU FDOFXODWLQJ WKH YHORFLW\E\(T WKHSRVLWLRQRIWKHSDUWLFOHLVXSGDWHGE\ (T υL (W +) = ωυL (W) + FU( \L (W) − [L (W )) + FU ( \(W ) − [L (W))
[L (W + ) = [ L (W ) + υ L (W + )
,WHP Z LV WKH ZHLJKW RI LQHUWLD WHUP RI PRPHQWXP ZKLFK PXOWLSOLHV WKH YHORFLW\ RI WKH SUHYLRXV LQVWDQW W DQG PDNHV WKH VHDUFK PRUH H[SORUDWLYH DW WKH EHJLQQLQJ DQG PRUH H[SORLWLYH DW WKH HQG DV LWV YDOXH JHQHUDOO\ GURSV OLQHDUO\ IURP WR 7KH WHUPV U DQG U DUH UDQGRP YDULDEOHV WDNHQ IURP 8 DQG 8 UHVSHFWLYHO\ %RWK SRVVHVV WKH IXQFWLRQ RI UDQGRPL]LQJ WKH LQIOXHQFHV RI HDFK WHUP RI H[SUHVVLRQ LQGLYLGXDO DQG JOREDO 7KH
2007 IEEE Congress on Evolutionary Computation (CEC 2007)
FRHIILFLHQWVRISHUVRQDODQGJOREDODFFHOHUDWLRQ FF UHVSHFWLYHO\JHQHUDOO\SRVVHVVIL[HGHTXDOYDOXHVDQGDUH UHVSRQVLEOHIRUFRQWUROOLQJKRZIDUDSDUWLFOHZLOOPRYHLQD VLQJOHLWHUDWLRQ 7KH EHVW SRVLWLRQ YLVLWHG \L W RI HDFK SDUWLFOH LV XSGDWHG E\(T ZKHUHDVWKHXSGDWLQJRIWKHEHVWSRVLWLRQYLVLWHG E\WKHVZDUPLVDFFRPSOLVKHGE\(T
&UHDWHDQGLQLWLDOL]HDVZDUPRISDUWLFOHV UHSHDW IRUHDFKSDUWLFOHLRIVZDUPGR LI I ( [L (W )) < I ( \ L (W )) WKHQ \ L (W ) [L (W ) HQGLI LI I \ L W < I \Ö W WKH \Ö W = \ L W HQGLI HQGIRU 3HUIRUP362XSGDWHVRIZKLFKSDUWLFOH XVLQJHTXDWLRQV DQG XQWLOVWRSSLQJFULWHULRQLVPHW
\ (W ) VH I ( [L (W + )) ≥ I ( \L (W )) \L (W + ) = ® L ¯[L (W + ) VH I ([L (W + )) ¢ I ( \L (W ))
\Ö (W + ) = DUJ PLQ I ( \ L (W + )) ≤ L ≤ V
7KHFDOFXODWHGYHORFLW\YL W LQHDFKF\FOHLVJHQHUDOO\ OLPLWHGWRWKHLQWHUYDO>íYPD[YPD[@ZLWKYPD[ N[PD[ NZKLFKGRHVQRWHQVXUHWKDWWKHSDUWLFOHLVDOZD\V ZLWKLQ WKH ERXQGDULHV RI WKH VHDUFK VSDFH EXW OLPLWV WKH PD[LPXP GLVWDQFH WKH SDUWLFOH FDQ PRYH LQ D VLQJOH LWHUDWLRQ )LJXUH GLVSOD\V WKH FRPSOHWH DOJRULWKP RI WKH 362SDWWHUQ7KHFKDUDFWHULVWLFVIUHTXHQWO\DWWULEXWHGWR362 DUHUDSLGFRQYHUJHQFHLQWRXQLPRGDOIXQFWLRQVZLWKDJRRG VXFFHVVUDWHDQGWKHSUHPDWXUHFRQYHUJHQFHLQWRPXOWLPRGDO IXQFWLRQVZLWKDKLJKFRUUHODWLRQEHWZHHQFRPSRQHQWV ,9 )($785((;75$&7,21 7RFDSWXUHNH\VWURNHG\QDPLFLWZRXOG EHQHFHVVDU\ IRU XVHUVWRW\SHWKHLURZQQDPHDQXPEHURIWLPHV7KHV\VWHP ZRXOG VHW DERXW FDSWXULQJ WKHVH GDWD XVLQJ WZR PHWKRGV UHJDUGLQJ WKH WLPH LQ PLOOLVHFRQGV WKDW D SDUWLFXODU XVHU PDLQWDLQV WKH NH\ SUHVVHG DQG WKH WLPH HODSVHG EHWZHHQ UHOHDVLQJ RQH NH\ DQG SUHVVLQJ WKH QH[W ODWHQF\ WLPH +HQFH ZH KDYH IRU H[DPSOH D SDWWHUQ WKDW UHSUHVHQWV WKH XVHU ³$%&'´ LOOXVWUDWHG LQ )LJXUH IRUPHG E\ D VL]H WLPLQJYHFWRU$VZHFDQVHHWKHODWHQF\WLPHLQVRPHFDVHV FDQEHQHJDWLYHLIRQHNH\LVSUHVVHGEHIRUHWKHSUHYLRXVRQH LV UHOHDVHG 7KH ILUVW HOHPHQW RI WKH YHFWRU LV WKH OHQJWK RI WLPH LQ ZKLFK WKH ILUVW NH\ UHPDLQV SUHVVHG WKH VHFRQG HOHPHQWLVWKHODWHQF\WLPHEHWZHHQUHOHDVLQJWKH ILUVW NH\ DQG SUHVVLQJ WKH VHFRQG WKH WKLUG HOHPHQW LV WKH OHQJWKRIWLPHLQZKLFKWKHVHFRQGNH\UHPDLQVSUHVVHGDQG VR RQ ,Q JHQHUDO IRU D ZRUG RI VL]H Q D YHFWRU ZLOO EH IRUPHGPDGHXSRIIHDWXUHVWKHVL]HRIQ,QWKLVFDVHZH KDYH Q IHDWXUHV WKDW UHSUHVHQW WKH OHQJWKV RI WLPH LQ ZKLFK WKHNH\VUHPDLQHGSUHVVHGDQGQIHDWXUHVWKDWUHSUHVHQWWKH WLPHHODSVHGEHWZHHQFRQVHFXWLYHNH\V,QWKHSUHVHQWZRUN HDFKSDWWHUQLVIRUPHGE\DYHFWRUZLWKWKHVHOHQJWKVRIWLPH LQPLOOLVHFRQGV
)LJXUH±362DOJRULWKP
.H\3 UHVVHG
'XUDWLR Q
$
%
&
'
,QWHUYDO
)LJXUH±7LPLQJYHFWRUFRUUHVSRQGLQJWRDSDWWHUQ³$%&'´
9 35(352&(66,1*2)7+('$7$ ,QWKHSUHSURFHVVLQJVWHSRIWKHIHDWXUHVDFOHDQXSRIWKH GDWDLVSHUIRUPHGLQRUGHUWRLPSURYHWKHSHUIRUPDQFHRIWKH V\VWHP ,Q WKH SUHVHQW ZRUN WKLV VWHS LQFOXGHV GDWD QRUPDOL]DWLRQ DQG IHDWXUH VHOHFWLRQ ,WLV LPSRUWDQWWR SRLQW RXW WKDW WKHVH PHWKRGV DUH SHUIRUPHG E\ FODVV LQ RUGHU WR FUHDWHDV\VWHPWKDWLVFXVWRPL]HGWRWKHXVHU $ 'DWD1RUPDOL]DWLRQ ,QWKHSUHVHQWZRUNZHXVHWKHVDPSOHVWDQGDUGGHYLDWLRQ RI WKH IHDWXUHV WR QRUPDOL]H WKH GDWD $V ZH NQRZ WKH VWDQGDUGGHYLDWLRQLVFDOFXODWHGE\WKHIROORZLQJH[SUHVVLRQ
(
)
º ª ¦ LQ− [ L − [ » ¬Q − ¼
σ =«
ZKHUH [ =
Q ¦ L= [ L Q
&DOFXODWLQJ WKLV GHYLDWLRQ IRU HDFK RI WKH IHDWXUHV ZH KDYH ;QL ;Lı ZKHUH ;QL DQG ;L UHSUHVHQW WKH LWK QRUPDOL]HG IHDWXUH DQG WKH RULJLQDO IHDWXUH RI D SDUWLFXODU NH\VWURNHSDWWHUQUHVSHFWLYHO\ % )HDWXUH6HOHFWLRQ $V PHQWLRQHG DERYH PRVW SDWWHUQ UHFRJQLWLRQ V\VWHPV EDVHG RQ EHKDYLRUDO ELRPHWULFV RQOLQH DQG RIIOLQH VLJQDWXUHV NH\VWURNH G\QDPLF HWF KDYH IHZ GDWD ZLWK ZKLFKWRUHSUHVHQWWKHFODVVHVDQGDFRQVLGHUDEOHDPRXQWRI IHDWXUHVWROHDUQ7KHLGHDRIWKHVHOHFWLRQWDVNLVWRREWDLQD VXEVHW RI IHDWXUHV WKDW DOORZV EHWWHU UDWHV RI FRUUHFW LGHQWLILFDWLRQ ZLWKLQFUHDVHGV\VWHPSHUIRUPDQFH WKDQZLWK WKH HQWLUH VHW RI IHDWXUHV 7KLV VXEVHW LV REWDLQHG
2007 IEEE Congress on Evolutionary Computation (CEC 2007)
3579
DXWRPDWLFDOO\7KHXVHURQO\KDVWKHZRUNRISUHVHQWLQJWKH WUDLQLQJ GDWD WR WKH V\VWHP 7KH V\VWHP WKHQ JHQHUDWHV WKH IHDWXUHVHOHFWLRQPRGHO )HDWXUH VHOHFWLRQ LV DQ RSWLPL]DWLRQ SUREOHP VLQFH WKH DLP LV WR REWDLQ DQ\ VXEVHW WKDW PLQLPL]HV D SDUWLFXODU PHDVXUH FODVVLILFDWLRQHUURUIRULQVWDQFH $VZHNQRZDQ RSWLPL]DWLRQ SUREOHP FDQ EH VROYHG WKURXJK VWRFKDVWLF DOJRULWKPV,Q>@ZHFDQVHHWKHXVHRIJHQHWLFDOJRULWKPV *$ DQGWKHSDUWLFOHVZDUPRSWLPL]DWLRQ 362 DOJRULWKP ,Q WKH SUHVHQW ZRUN ZH VXJJHVW D YDULDWLRQ RI WKH 362 DOJRULWKPXVHGLQ>@ ,Q> @LWZDVVKRZQWKDWWKHIHDWXUHVHOHFWLRQWDVNFDQEH FODVVLILHG LQWR WZR FDWHJRULHV ILOWHUDQG ZUDSSHU7KH ILOWHU DSSURDFK GRHV QRW GHSHQG XSRQ WKH DOJRULWKP XVHG IRU YHULILFDWLRQ ZKHUHDV WKH ZUDSSHU DSSURDFK GRHV GHSHQG XSRQ WKLV DOJRULWKP 7KHUHIRUH WKH ILOWHU DSSURDFK LV IDU PRUHHIILFLHQW LQWHUPVRISURFHVVLQJWLPH WKDQWKHZUDSSHU DSSURDFKDVWKHUHLVQRQHHGWRWUDLQDSDUWLFXODUDOJRULWKP QXPHURXV WLPHV ZLWK YDULRXV SRVVLEOH VXEVHWV RI IHDWXUHV 6HOHFWLRQWKURXJKDILOWHUVLPSO\GLVFDUGVLUUHOHYDQWIHDWXUHV WKURXJKD JLYHQ PHDVXUH ,Q >@ IRU LQVWDQFH WKH IHDWXUHV WKDW SUHVHQWHG WKH ODUJHVW FRHIILFLHQWV RI YDULDQFH &9 ı [ ZHUH GLVFDUGHG EHFDXVH WKH\ H[KLELWHG FRQVLGHUDEOH YDULDWLRQ EHWZHHQ SDWWHUQV ZKLFK WHQGV WR KLQGHU WKH UHFRJQLWLRQ WDVN ,Q WKH ZUDSSHU DSSURDFK WKH LGHD LV WR JHQHUDWHVHYHUDOVXEVHWVRIIHDWXUHVHYDOXDWHWKHPWKURXJKD JLYHQ DOJRULWKP DQG FKRRVH WKH VXEVHW WKDW UHSUHVHQWV WKH EHVWVROXWLRQ7KLVDSSURDFKDFKLHYHV EHWWHUUHVXOWVWKDQWKH ILOWHU DSSURDFK EXW LV RQO\ YLDEOH LI WKH DOJRULWKP XVHG WR WUDLQWKHFODVVLILHULVHIILFLHQW ,Q WKH SUHVHQW ZRUN DV ZLWK >@ ZH SUHVHQW D IHDWXUH VHOHFWLRQPRGHOWKDWXVHV362DVWKHRSWLPL]DWLRQDOJRULWKP DQG 690 DV WKH YHULILFDWLRQ DOJRULWKP GXH WR LWV NQRZQ DFFXUDF\LQSDWWHUQUHFRJQLWLRQSUREOHPV>@7KHSURSRVHG PRGHOIROORZVWKHVWUXFWXUHGLVSOD\HGLQ)LJXUH ,Q >@ DQG >@ *$ ZDV XVHG WR RSWLPL]H D YHFWRU ZLWK ELQDU\IHDWXUHVZKHUHLQGLFDWHVWKHSUHVHQFHRIWKHIHDWXUH DQGLQGLFDWHVLWVDEVHQFH(DFKSDUWLFOHRID362LVIRUPHG E\DYHFWRURIUHDOQXPEHUVDQGWKHDOJRULWKPRSWLPL]HVWKLV YHFWRU,Q>@WKHUHIRUHZHGHFLGHGWRXVHWKLVYHFWRURIUHDO QXPEHUV DV WKH OLNHOLKRRG RI D IHDWXUH EHLQJ SUHVHQW LQ WKH VXEVHWEHFDXVHWKHVHQXPEHUVUHSUHVHQWVWKHLQIOXHQFHDERXW WKHIHDWXUHV7KXVZHQRUPDOL]HWKHLUYDOXHVEHWZHHQDQG ,Q>@ZHDOVRGHILQHDOLNHOLKRRGWKUHVKROGWKDWLQGLFDWHV WKDWWKHIHDWXUHLVSUHVHQWLQWKHVXEVHWLILWKDVDYDOXHHTXDO WR RU JUHDWHU WKDQ WKLV WKUHVKROG DQG LV DEVHQW RWKHUZLVH 7KXV WKH ILQDO YHFWRU LV IRUPHG E\ ELQDU\ FKDUDFWHUV DV SUHVHQWHGLQ>@DQG>@ ,Q WKH SUHVHQW ZRUN ZH GR QRW XVH WKH RULJLQDO YDOXH RI WKHIHDWXUHVDVLQ>@,IDSDUWLFXODUIHDWXUHKDVDSUREDELOLW\ UHSUHVHQWHG E\ WKH YDOXH XVHG LV RI LWV RULJLQDO YDOXH ,Q WKH ILUVW PRPHQW ZH GR QRW XVH D WKUHVKROG WR HOLPLQDWH IHDWXUHV $V WKH UHVXOWV ZHUH XQVDWLVIDFWRU\ HVSHFLDOO\ ZLWK UHJDUG WR WLPH ZH HOLPLQDWH WKH SUREDELOLWLHVWKDWZHUHEHORZDFHUWDLQWKUHVKROGDVGRQHLQ >@ 7KH UHVW ZLOO KDYH WKHLU LQIOXHQFHV DIIHFWHG E\ WKH
3580
SUREDELOLW\DVGHVFULEHGDERYH
)LJXUH±+\EULGPRGHOSURSRVHGIRUIHDWXUHVHOHFWLRQWKURXJK690DQG 362
9, '$7$%$6($&48,6,7,21$1'',9,6,21 7KHGDWDEDVHXVHGLQWKHSUHVHQWZRUNZDVWKHVDPHXVHG LQ >@DQG >@ 7KH GDWD ZHUH REWDLQHG WKURXJK D VRIWZDUH SURJUDP GHYHORSHG LQ WKH 9LVXDO %DVLF ODQJXDJH ZKLFK UHWULHYHV WKH QHFHVVDU\ LQIRUPDWLRQ WKDW GHILQHV WKH NH\VWURNH G\QDPLF RI HDFK XVHU 7KH GDWDEDVH XVHG LQ WKLV SURMHFW LV PDGH XS RI LQIRUPDWLRQ IURP GLIIHUHQW XVHUV (DFK XVHU HQWHUHG KLVKHU FRPSOHWH QDPH DSSUR[LPDWHO\ WLPHV 7R REWDLQ WKH GDWD WKDW UHSUHVHQW IUDXGV DJDLQVW WKH V\VWHP VRPH XVHUV HQWHUHG WKH FRPSOHWH QDPHV RI RWKHU XVHUV DSSUR[LPDWHO\ WLPHV 7KH GDWDEDVH JHQHUDWHG KHUH KDVDSSUR[LPDWHO\DXWKHQWLFSDWWHUQVDQGIDOVHSDWWHUQV IRUHDFKRIWKHFODVVHV ,Q WKH SUHVHQW ZRUN HDFK XVHU HQWHUHG KLVKHU FRPSOHWH QDPHZKLFKUHVXOWHGLQODUJHYHFWRUV)RUVRPHFODVVHVWKH LQSXW YHFWRUV KDG VL]HV JUHDWHU WKDQ 7KH GDWDEDVH XVHG KHUH ZDV GLYLGHG LQWR WUDLQLQJ SDWWHUQV YDOLGDWLRQ SDWWHUQVDQGWKHUHPDLQLQJSDWWHUQVZHUHXVHGIRUWHVWLQJ$V WKH GDWDEDVH KDG D IHZ FODVVHV FRQWDLQLQJ OHVV WKDQ SDWWHUQV VRPHZLWKDVOLWWOHDVSDWWHUQVUHVXOWLQJLQMXVW WHVW SDWWHUQV ZKLFK ZRXOG KDYH EHHQ RI OLWWOH VLJQLILFDQFH ZHRSWHGWRGLVFDUGFODVVHVZLWKOHVVWKDQ SDWWHUQVLQWKH GDWD VHW 7KXV IRXU FODVVHV ZHUH GLVFDUGHG UHVXOWLQJ LQ D WRWDORIFODVVHVXVHG 9,, (;3(5,0(176 $V LQ >@ ZH XVHG D EDVLF *$ DQG WHVWHG WZR SRVVLEOH 362FRQILJXUDWLRQV7KHYHULILHUZDVWKH690DVSURSRVHG LQ>@>@$IWHUVSHFLI\LQJWKHSDUDPHWHUVRIWKHYHULILFDWLRQ DQGRSWLPL]DWLRQDOJRULWKPVZHSHUIRUPHGH[HFXWLRQVRI WKH H[SHULPHQW ZKLFK LQFOXGHG WKH SUHVHQWDWLRQ RI WKH WUDLQLQJ GDWD IHDWXUH H[WUDFWLRQ SUHSURFHVVLQJ RI WKH GDWD QRUPDOL]DWLRQ DQG IHDWXUH VHOHFWLRQ DQG WKH YHULILFDWLRQ VWHS WKURXJK WKH WHVW VHW 7KH V\VWHP HYDOXDWLRQ SURSRVHG
2007 IEEE Congress on Evolutionary Computation (CEC 2007)
9,,, 5(68/76 ,Q WKLV VHFWLRQ ZH SUHVHQW WKH UHVXOWV REWDLQHG IURP WKH H[SHULPHQWV )LJXUH GLVSOD\V WKH YDULDWLRQ LQ WKH FODVVLILFDWLRQHUURUDVZHLQFUHDVHGWKHVL]HRIWKHSRSXODWLRQ WR EH WUDLQHG DV ZHOO DV WKH UHVXOWV IURP WKH JHQHWLF DOJRULWKPVDQG362REWDLQHGXVLQJWKHVDPHFRQILJXUDWLRQV DV LQ >@ :H FDQ VHH WKDW IRU WKH JHQHWLF DOJRULWKPV WKH FODVVLILFDWLRQ HUURU GRHV QRW GLPLQLVK ZKHQ WKH SRSXODWLRQ JRHVIURP WRLQGLYLGXDOV WKHUHLVVWDELOL]DWLRQLQWKH HUURU UHGXFWLRQ FXUYH LQGLFDWLQJ WKDW DQ LQFUHDVH LQ SRSXODWLRQ VL]H GRHV QRW QHFHVVDULO\ LPSO\ D UHGXFWLRQ LQ FODVVLILFDWLRQHUURU7KHVDPHRFFXUVIRUWKH362DOJRULWKP ZLWKDWKUHVKROG)RUWKH362DOJRULWKPVZLWKWKUHVKROGV RI DQG ZH FDQ VHH WKDW GHVSLWH VRPH GURSV LQ SHUIRUPDQFH ZLWK WKH LQFUHDVH LQ SRSXODWLRQ VL]H WKH FODVVLILFDWLRQHUURUFRQWLQXHVWRIDOOXQWLOUHDFKLQJSRSXODWLRQ VL]HZKHUHLWDFKLHYHVWKHEHVWUHVXOWVLQERWKFDVHV$V
D SRSXODWLRQ WKDW FRQWDLQV LQGLYLGXDOV LV DOUHDG\ TXLWH ODUJHZHGHFLGHGWRVHWLWDVWKHPD[LPXPOLPLWZKHUHDVWKH PLQLPXP OLPLW ZDV VHW DW LQGLYLGXDOV )LJXUH RQO\ GLVSOD\V WKH 362 SHUIRUPDQFH ZLWK SHUVRQDO DQG JOREDO DFFHOHUDWLRQV VHW DW DV WKLV ZDV WKH FRQILJXUDWLRQ WKDW REWDLQHG WKH EHVW UHVXOWV 0RUHRYHU 362 SHUIRUPDQFH ZLWK SHUVRQDODQGJOREDODFFHOHUDWLRQVVHWDWZDVVLPLODU &ODVVLILFDWLRQ(UURU
ZDV SHUIRUPHG XVLQJ WKUHH PHDVXUHV FODVVLILFDWLRQ HUURU SURFHVVLQJ WLPH LQ VHFRQGV DQGWKHUHGXFWLRQ SHUFHQWDJH RI WKHVHWRIIHDWXUHV 7KH FODVVLILFDWLRQ HUURU LV SUHVHQWHG E\ WZR PHDVXUHV )$5 )DOVH $FFHSWDQFH 5DWH ZKHQ WKH V\VWHP DFFHSWV DQ LPSRVWHU RU IUDXG DV DXWKHQWLF DQG )55 )DOVH 5HMHFWLRQ 5DWH ZKHQWKHV\VWHPUHMHFWVDQDXWKHQWLFXVHU $QRWKHU HYDOXDWLRQ PHDVXUH XVHG LQ WKH SUHVHQW ZRUN UHJDUGV WKH IHDWXUH UHGXFWLRQ FDSDFLW\ RI WKH HQWU\ VHW )RU H[DPSOH LI ZH KDYH D SDWWHUQ WKDW LQLWLDOO\ KDV IHDWXUHV DQG DIWHU FRQFOXGLQJ WKH VHOHFWLRQ VWHS WKLV SDWWHUQ KDV IHDWXUHVZHKDYHDFKLHYHGDUHGXFWLRQRI $VPHQWLRQHGDERYHWKHYHULILHUXVHGLQWKHSUHVHQWZRUN ZDV EDVHG RQVXSSRUWYHFWRUPDFKLQHV7KHNHUQHOIXQFWLRQ XVHGLV*XDVVLDQIXQFWLRQWKHPRVWFRPPRQO\HPSOR\HGIRU SDWWHUQUHFRJQLWLRQZRUN7KHYDOXHRIWKHSDUDPHWHUıXVHG LQWKLVHTXDWLRQZDVREWDLQHGHPSLULFDOO\DQGLV7KH YDOXHRIYZDVDOVRREWDLQHGHPSLULFDOO\DQGLVDOVR ,QWKHSUHVHQWZRUNWKHSRSXODWLRQVL]HWRRNRQYDOXHVRI DQGLQGLYLGXDOV SDUWLFOHV LQ WKH FDVH RI 362 7KLV ZDV GRQH WR GHWHUPLQH DW ZKDW SRSXODWLRQVL]HWKHFODVVLILFDWLRQHUURUVWDELOL]HVLQERWKWKH H[SHULPHQWVSHUIRUPHGZLWK*$DQGZLWK362 )RU WKH *$ DOJRULWKP HDFK LQGLYLGXDO RI WKH SRSXODWLRQ ZDVUHSUHVHQWHGE\ELQDU\YHFWRU7KHFURVVRYHUUDWHZDV DQG WKH IXQFWLRQ XVHG ZDV WKH WZRSRLQW FURVVRYHU 7KH PXWDWLRQUDWHZDVDQGLWVIXQFWLRQZDVXQLIRUP )RU WKH 362 DOJRULWKP ZH XVHG WZR FRQILJXUDWLRQV RQH WKDW FRQVLGHUV WKH SHUVRQDO JOREDO DFFHOHUDWLRQ FRHIILFLHQWV & H & WR EH DQGDQRWKHU WKDW FRQVLGHUV WKHP WR EH 9DOXHV ZHUH REWDLQHG HPSLULFDOO\ )RU WKH LQHUWLD ZHLJKW Z PRPHQWXP WHUP ZH XVHG WKH YDOXHV XVHG LQ PRVW ZRUN ZLWK362ZKLFKGURSOLQHDUO\IURP WR>@$VZLWK *$V WKH 362 DOJRULWKP FDQ EH H[HFXWHG D PD[LPXP RI LWHUDWLRQV 7KH WKUHVKROG YDOXHV ZKLFK LQGLFDWH WKH PLQLPXPOLNHOLKRRG WKDWD IHDWXUH PXVWSRVVHVV LQ RUGHU WR PDNHXSSDUWRIWKHIHDWXUHVXEVHWZHUHDQG
690$*
690362
690362
690362
3RSXODWLRQ6L]H
)LJXUH±9DULDWLRQLQFODVVLILFDWLRQHUURUSHUSRSXODWLRQVL]HZLWK*$DQG 362
$IWHUGHILQLQJWKHOLPLWVIRUWKHSRSXODWLRQVL]HZHEHJLQ WKH DFWXDO H[SHULPHQWV 7DEOH GLVSOD\V WKH UHVXOWV IURP D 690YHULILHUFRPELQHGZLWKJHQHWLFDOJRULWKPVWRFDUU\RXW WKH WDVN RI VHOHFWLQJ IHDWXUHV 7KH EHVW UHVXOW DFKLHYHG ZDV IRU WKH SRSXODWLRQ FRPSRVHG RI LQGLYLGXDOV DV ZH KDG VHHQLQ)LJXUH7KHFODVVLILFDWLRQHUURUZDVZLWKDQ )55RIDQGDQ)$5RI7KHORZHVWSURFHVVLQJ WLPH RI V ZDV DOVR IRU WKH SRSXODWLRQ ZLWK LQGLYLGXDOV7DEOHVKRZVWKDWDVSRSXODWLRQVL]HLQFUHDVHV SURFHVVLQJ WLPH GLPLQLVKHV XQWLO VWDELOL]LQJ DW D SRSXODWLRQ VL]H RI DV RFFXUUHG ZLWK WKH FODVVLILFDWLRQ HUURU 7KHUH ZDV DOVR D FRQVLGHUDEOH LPSURYHPHQW LQ SURFHVVLQJ WLPH JRLQJIURPVWR VDQGUHSUHVHQWLQJDQLPSURYHPHQW RI DURXQG 7KHUH ZDV QRW PXFK YDULDWLRQ UHJDUGLQJ WKH IHDWXUH UHGXFWLRQ UDWH DQG WKH EHVW UHVXOW DFKLHYHG ZDV ZKLFKZDVVOLJKWO\KLJKHUWKDQWKHDFKLHYHG LQWKHEHVW*$FRQILJXUDWLRQ 7$%/(, 5(68/762%7$,1(')5207+(*$3$77(51 3RS
)55 PHDQ VGHY
)$5 FODVVHUURU 7LPH V 5HGXFWLRQ PHDQ VGHY PHDQ VGHY PHDQ VGHY PHDQ VGHY
,Q WKH H[SHULPHQWV XVLQJ 362 IRU WKH IHDWXUH VHOHFWLRQ WDVNZH EHJLQE\ H[HFXWLQJWKHSURSRVHGPRGHODERYHDQ\ WKUHVKROG 7KHUH LV QR HOLPLQDWLRQ RI IHDWXUHV WKH\ DUH DOO ZHLJKHG +RZHYHU WKH UHVXOWV ZHUH UDWKHU ZHDN ZLWK VXEVWDQWLDO LQFUHDVHV LQ WKH FODVVLILFDWLRQ HUURU DQG
2007 IEEE Congress on Evolutionary Computation (CEC 2007)
3581
HVSHFLDOO\ SURFHVVLQJ WLPH 7KXV WKHVH UHVXOWV DUH QRW SUHVHQWHGKHUH 7KH VHFRQG VWDJH RI H[SHULPHQWV ZLWK 362 ZDV FDUULHG RXW WKH VDPH ZD\ DV WKH ILUVW EXW ZLWK WKH HOLPLQDWLRQ RI IHDWXUHV ZKHQ WKHLU LQIOXHQFHV ZHUH EHORZ D FHUWDLQ WKUHVKROG 7KH WKUHVKROGV WHVWHG ZHUH DQG $VZH FDQVHHLQ7DEOHV,,,,,,999,DQG9,,WKH UHVXOWV REWDLQHG IURP WKUHVKROG DQG DUH QRW GLVSOD\HGDVWKH\WRRZHUHTXLWHLQIHULRUWRWKHRWKHUV 7DEOHV,,,,,DQG,9GLVSOD\WKHUHVXOWVREWDLQHGIRU362 ZLWKSHUVRQDODQGJOREDODFFHOHUDWLRQVRI7KHEHVWUHVXOW REWDLQHGIRUWKHWKUHVKROG 7DEOH,, KDG SDUWLFOHVLQ WKHVZDUPDQGDFKLHYHGDFODVVLILFDWLRQHUURURIZLWK DQ )55 RI DQG DQ )$5 RI 3URFHVVLQJ WLPH ZDVVZKLFKZDVWKHVHFRQGZRUVWSHUIRUPDQFH$VZH FDQ VHH SURFHVVLQJ WLPH LQFUHDVHG ZLWK WKH LQFUHDVH LQ VZDUPVL]HZKLFKZDVGLIIHUHQWIURPWKHEHKDYLRUSUHVHQWHG E\WKH*$7KHIHDWXUHUHGXFWLRQUDWHUHPDLQHGVWDEOHDQGLWV EHVWUHVXOWZDVIRUVZDUPVL]H 7DEOH ,,, GLVSOD\V WKH UHVXOWV IURP WKH 362 DQG WKUHVKROGRI7KHEHVWUHVXOWZDVREWDLQHGZLWKDVZDUP RI SDUWLFOHV WKH PD[LPXP OLPLW XVHG LQ WKH SUHVHQW ZRUN 7KH FODVVLILFDWLRQ HUURU ZDV ZLWK DQ )55 RI DQG DQ )$5 3URFHVVLQJ WLPH ZDV V ZKLFK ZDV WKH ZRUVW IRU WKLV FRQILJXUDWLRQ 7KH IHDWXUH UHGXFWLRQUDWH UHPDLQHG VWDEOH ZLWK DQDYHUDJH RI UDQJLQJIURP WR 7$%/(,, 5(68/762%7$,1(':,7+362$1'7+5(6+2/' 7KU3RS
)55 PHDQ VGHY
)$5 FODVVHUURU 7LPH V 5HGXFWLRQ PHDQ VGHY PHDQ VGHY PHDQ VGHY PHDQ VGHY
7$%/(,,, 5(68/762%7$,1(':,7+362$1'7+5(6+2/' 7KU3RS
)55 PHDQ VGHY
)$5 FODVVHUURU 7LPH V 5HGXFWLRQ PHDQ VGHY PHDQ VGHY PHDQ VGHY PHDQ VGHY
7DEOH,9GLVSOD\VWKHUHVXOWVREWDLQHGIURP362DQGD WKUHVKROGRI7KHORZHVWFODVVLILFDWLRQHUURUZDV ZLWKDQ)55RIDQGD)$5RIXVLQJDVZDUP ZLWKSDUWLFOHV3URFHVVLQJWLPHZDVVDQGUHGXFWLRQ UDWHZDV)URP7DEOHV,,,,,DQG,9ZHFDQVHHWKDW WKHFODVVLILFDWLRQHUURUGLPLQLVKHVDVWKHWKUHVKROGLVUDLVHG
3582
7KLV ZDV DOVR REVHUYHG ZLWKUHJDUG WR SURFHVVLQJ WLPH DQG IHDWXUHUHGXFWLRQUDWH+RZHYHUDVPHQWLRQHGHDUOLHUZKHQ WKH WKUHVKROG LV DERYH WKHUHVXOWV ZRUVHQ FRQVLGHUDEO\ 7KH JUHDWHVW IHDWXUH UHGXFWLRQ UDWH DFKLHYHG KHUH ZDV ZKLFKLVDQHQRUPRXVUHGXFWLRQRIWKHRULJLQDOVHW )RU H[DPSOH LI ZH RULJLQDOO\ KDG IHDWXUHV WKHUHVXOWLQJ VHWDIWHUDSSO\LQJWKH362DOJRULWKPZRXOGEHIHDWXUHV 7$%/(,9 5(68/762%7$,1(':,7+362$1'7+5(6+2/' 7KU3RS
)55 PHDQ VGHY
)$5 FODVVHUURU 7LPH V 5HGXFWLRQ PHDQ VGHY PHDQ VGHY PHDQ VGHY PHDQ VGHY
7DEOHV99,DQG9,,GLVSOD\WKHUHVXOWVREWDLQHGIRU362 ZLWK SHUVRQDO DQG JOREDO DFFHOHUDWLRQ RI DQG WKUHVKROGV RI DQG UHVSHFWLYHO\ ,Q 7DEOH 9 WKH ORZHVW FODVVLILFDWLRQ HUURU ZDV ZLWK DQ )55 RI DQG DQ )$5 RI 7KLV YDOXH ZDV DFKLHYHG IRU WKH VZDUP ZLWKSDUWLFOHV7KHWLPHREWDLQHGZDV VZKLFKZDV WKH ZRUVW DPRQJ WKH H[SHULPHQWV ZLWK WKLV FRQILJXUDWLRQ 7KH UHGXFWLRQ UDWH ZDV ZKLFK ZDV WKH EHVW UDWH DFKLHYHGZLWKWKLVFRQILJXUDWLRQ 7$%/(9 5(68/762%7$,1(':,7+362$1'7+5(6+2/' 7KU3RS
)55 PHDQ VGHY
)$5 FODVVHUURU 7LPH V 5HGXFWLRQ PHDQ VGHY PHDQ VGHY PHDQ VGHY PHDQ VGHY
7$%/(9, 5(68/762%7$,1(':,7+362$1'7+5(6+2/' 7KU3RS
)55 PHDQ VGHY
)$5 FODVVHUURU 7LPH V 5HGXFWLRQ PHDQ VGHY PHDQ VGHY PHDQ VGHY PHDQ VGHY
,Q 7DEOH 9, WKH ORZHVW FODVVLILFDWLRQ HUURU ZDV ZLWK DQ )55 RI DQG DQ )$5 RI 7KH IHDWXUH UHGXFWLRQ UDWH ZDV DQG SURFHVVLQJ WLPH ZDV V ZKLFK ZDV RQFH DJDLQ WKH ZRUVW SURFHVVLQJ WLPH IRU WKLV FRQILJXUDWLRQ )LQDOO\7DEOH9,,GLVSOD\VWKHUHVXOWVREWDLQHGZLWK362
2007 IEEE Congress on Evolutionary Computation (CEC 2007)
DQG D WKUHVKROG RI 7KH ORZHVW FODVVLILFDWLRQ HUURU ZDV ZLWK DQ )55 RI DQG DQ )55 RI 3URFHVVLQJ WLPH ZDV DQG WKH UHGXFWLRQ UDWH ZDV 2QFH DJDLQ WKH ORZHVW FODVVLILFDWLRQ HUURU ORZHVW SURFHVVLQJ WLPH DQG JUHDWHVW UHGXFWLRQ UDWH ZHUH REWDLQHG ZLWKWKHWKUHVKROGVHWDW
5HGXFWLRQ5DWH
7$%/(9,, 5(68/762%7$,1(':,7+362$1'7+5(6+2/' 7KU3RS
)55 PHDQ VGHY
)$5 FODVVHUURU 7LPH V 5HGXFWLRQ PHDQ VGHY PHDQ VGHY PHDQ VGHY PHDQ VGHY
&ODVVLILFDWLRQ(UURU
690$*
690362 690362
&ODVV
)LJXUH*UDSKRIIHDWXUHUHGXFWLRQUDWHVREWDLQHGE\WKH*$362 DQG362
)LJXUH LV D FRPSDUDWLYH JUDSK UHJDUGLQJ SURFHVVLQJ WLPH &RQWUDU\ WR ZKDW RFFXUUHG LQ >@ WKH GLIIHUHQFHV EHWZHHQWKHSURFHVVLQJWLPHZLWKWKH*$DQGWKHWZR 362 FRQILJXUDWLRQV ZHUH TXLWH VPDOO 1HYHUWKHOHVV *$ ZDV XQDEOHWRVXUSDVV362RU362LQDQ\RIWKHFODVVHV WHVWHG :H FDQ DOVR VHH WKDW SURFHVVLQJ WLPHV DFKLHYHG E\ 362DQG362DUHSUDFWLFDOO\HTXDO )LQDOO\ )LJXUH LV D FRPSDUDWLYH JUDSK UHJDUGLQJ WKH IHDWXUHUHGXFWLRQUDWH&RQWUDU\WRZKDWRFFXUUHGLQ>@*$ KDGWKHZRUVWSHUIRUPDQFHLQWKLVPHDVXUHZLWKDUHGXFWLRQ UDWH RI DSSUR[LPDWHO\ 362 DQG 362 H[KLELWHG SUDFWLFDOO\ WKH VDPH SHUIRUPDQFH LQ ZKLFK WKH IRUPHU REWDLQHG DUDWH RI DSSUR[LPDWHO\ DQGWKH ODWWHU REWDLQHGDUDWHRI
690362
,; &21&/86,21
&ODVV
)LJXUH*UDSKRIFODVVLILFDWLRQHUURUVREWDLQHGE\*$362DQG362
7LPH V
690$* 690362
)LJXUHV DQG SUHVHQW FRPSDULVRQV RI WKH SHUIRUPDQFHVREWDLQHGZLWKWKHEHVW*$362DQG362 FRQILJXUDWLRQV IRU WKHWKUHH SHUIRUPDQFH PHDVXUHV XVHG LQWKHSUHVHQWZRUN)LJXUHLVDFRPSDUDWLYHJUDSKRIWKH FODVVLILFDWLRQ HUURUV $V ZH FDQ VHH WKH UHVXOWV ZHUH TXLWH VLPLODU 362 ZLWK D WKUHVKROG RI ZDV VOLJKWO\ VXSHULRU WR WKH RWKHUV *$ REWDLQHG WKH ZRUVH UHVXOW SUHVHQWLQJVRPHSRLQWIDUDERYHLWVDYHUDJH
690$* 690362
690362
&ODVV
)LJXUH*UDSKRISURFHVVLQJWLPHVREWDLQHGE\WKH*$362DQG362
)URP WKH SUHYLRXV VHFWLRQ ZH PD\ FRQFOXGH WKDW WKH HYROXWLRQDU\ 362 DOJRULWKP SURGXFHG JRRG UHVXOWV IRU WKH WDVNV RI IHDWXUH VHOHFWLRQ DQG SHUVRQDO LGHQWLILFDWLRQ 7KH DOJRULWKPSUHVHQWHGKHUHREWDLQHGDVLPLODUUHVXOWWRWKDWLQ >@ ZLWK UHJDUG WR FODVVLILFDWLRQ HUURU DQG D VXSHULRU UHVXOW ZLWK UHJDUG WR WKH IHDWXUH UHGXFWLRQ UDWH ,Q >@ WKH ORZHVW FODVVLILFDWLRQ HUURU REWDLQHG ZDV ZLWK DQ )55 RI DQGDQ)$5RI WKHIHDWXUHUHGXFWLRQUDWHZDV DQG WKH SURFHVVLQJ WLPH ZDV V ,Q WKH SUHVHQW ZRUN WKH ORZHVW FODVVLILFDWLRQ HUURU ZDV ZLWK DQ )55 RIDQGDQ)$5RI WKHIHDWXUHUHGXFWLRQ UDWHZDVIDUVXSHULRUDFKLHYLQJDQGWKHSURFHVVLQJ WLPHZDVV$VZHFDQVHHWKHSURFHVVLQJWLPHKHUHZDV SUDFWLFDOO\WZLFHWKDWREWDLQHGLQ>@$QHJDWLYHSRLQWRIWKH SUHVHQW ZRUN ZDV KDYLQJ REWDLQHG D KLJKHU )$5 LQ PRVW LGHQWLILFDWLRQ V\VWHPV LWLV PRUH LPSRUWDQW WRKDYH D ORZHU )$5WKDQDORZHU)55 ,Q WKH SUHVHQW ZRUN WKH WZR 362 FRQILJXUDWLRQV WHVWHG ZHUH VXSHULRU WR WKH VWDQGDUG *$ IRU DOO WKUHVKROG YDOXHV SUHVHQWHG 7KH 362 ZLWK SHUVRQDO DQG JOREDO DFFHOHUDWLRQV RI DQG D WKUHVKROG RI ZDV VXSHULRU WR WKH RWKHU FRQILJXUDWLRQV ZLWK UHJDUG WR FODVVLILFDWLRQ HUURU ZKHUHDV WKH362ZLWKSHUVRQDODQGJOREDODFFHOHUDWLRQVRIDQGD WKUHVKROG RI ZDV VXSHULRU WR *$ ZLWK UHJDUG WR FODVVLILFDWLRQ HUURU 5HJDUGLQJ WKH EHVW *$ 362 DQG
2007 IEEE Congress on Evolutionary Computation (CEC 2007)
3583
362 FRQILJXUDWLRQV WKH ORZHVW SURFHVVLQJ WLPH ZDV VZKLFKZDVDOVRDFKLHYHGE\3627KHEHVWIHDWXUH UHGXFWLRQUDWHZDV ZKLFKZDVREWDLQHGE\362 ,Q IXWXUH ZRUN ZH LQWHQG WR H[SORUH IXUWKHU WKH XVH RI 362DVDIHDWXUHVHOHFWLRQDOJRULWKPZLWKWKHDLPRIEHWWHU VWXG\LQJYDULDWLRQVLQWKHSDUDPHWHUVDQGWKHLULQIOXHQFHRQ WKH UHVXOWV :H DOVR LQWHQG WR WHVW WHFKQLTXHV EDVHG RQ VWDWLVWLFV VXFK DV >@ DQG FRPELQH WKHVH ZLWKWKH PHWKRG SUHVHQWHG KHUH DQG WKDW SUHVHQWHG LQ >@ @ IRXQG WKHVH QHWZRUNV LQ FRQMXQFWLRQ ZLWK 690 WR EH TXLWH VORZ IRU WKH IHDWXUH VHOHFWLRQ WDVN ZH KDYH VHHQ WKDW 362 H[KLELWV D VKRUWHU SURFHVVLQJWLPHWKDQ*$ $&.12:/('*0(17 7KH DXWKRUV ZRXOG OLNH WR DFNQRZOHGJH WKH ILQDQFLDO VXSSRUWSURYLGHGE\WKH%UD]LOLDQ1DWLRQDO5HVHDUFK&RXQFLO &13T 3URF 5()(5(1&(6 >@ ( @ 6&KR&+DQDQG+ .LP:HEEDVHGNH\VWURNH G\QDPLFVLGHQWLW\ YHULILFDWLRQ XVLQJ QHXUDO QHWZRUN - 2UJDQ &RPSXW (OHFWURQ &RPPHUFH ± >@ )9DQ'HQ%HUJKDQG$3(QJHOEUHFKW$&RRSHUDWLYH$SSURDFKWR 3DUWLFOH 6ZDUP 2SWLPL]DWLRQ ,((( 7UDQVDFWLRQV RQ (YROXWLRQDU\ &RPSXWDWLRQ9RO1R-XQH >@ - .HQQHG\ DQG 5 (EHUKDUW 3DUWLFOH 6ZDUP 2SWLPL]DWLRQ LQ 3URF ,(((,QWO&RQIRQ1HXUDO1HWZRUNV 3HUWK$XVWUDOLD ,(((6HUYLFH &HQWHU3LVFDWDZD\1-,9 >@ - .HQQHG\ DQG 5 (EHUKDUW 6ZDUP ,QWHOOLJHQFH 0RUJDQ .DXIPDQQ 3XEOLVKHUV,QF6DQ)UDQFLVFR&$ >@ * / ) % * $]HYHGR * ' & &DYDOFDQWL DQG ( & % &DUYDOKR )LOKR +\EULG 6ROXWLRQ IRU WKH )HDWXUH 6HOHFWLRQ LQ 3HUVRQDO ,GHQWLILFDWLRQ3UREOHPVWKURXJK .H\VWURNH'\QDPLFV DFFHSWDUWLFOH ,(((,QWHUQDWLRQDO-RLQW&RQIHUHQFHRQ1HXUDO1HWZRUNV >@ % 6FK|ONRSI - & 3ODWW - 6KDZH7D\ORU $ - 6PROD DQG 5& :LOOLDPVRQ (VWLPDWLQJ WKH VXSSRUW RI D KLJKGLPHQVLRQDO GLVWULEXWLRQ1HXUDO&RPSXWDWLRQ >@ %6FK|ONRSI5:LOOLDPVRQ$6PROD-6KDZH7D\ORUDQG-3ODWW 6XSSRUW YHFWRU PHWKRG IRU QRYHOW\ GHWHFWLRQ ,Q $GYDQFHV LQ 1HXUDO ,QIRUPDWLRQ3URFHVVLQJ6\VWHPV > @ - @ + %\XQ DQG 6 /HH $SSOLFDWLRQV RI VXSSRUW YHFWRU PDFKLQHV IRU SDWWHUQUHFRJQLWLRQ DVXUYH\/1&6
3584
2007 IEEE Congress on Evolutionary Computation (CEC 2007)
