Solving Multiobjective Clustering Using an Immune-inspired Algorithm

6ROYLQJ0XOWLREMHFWLYH&OXVWHULQJ8VLQJDQ,PPXQHLQVSLUHG $OJRULWKP 0DRJXR*RQJ0HPEHU,(((/LQLQJ=KDQJ/LFKHQJ-LDR6HQLRU0HPEHU,(((DQG6KXLSLQJ*RX 0HPEHU,((( 

$EVWUDFW²,Q WKLV VWXG\ ZH LQWURGXFHG D QRYHO PXOWLREMHFWLYH RSWLPL]DWLRQ DOJRULWKP 1RQGRPLQDWHG 1HLJKERU ,PPXQH $OJRULWKP 11,$  WR VROYH WKH PXOLREMHFWLYHFOXVWHULQJSUREOHPV11,$VROYHVPXOWLREMHFWLYH RSWLPL]DWLRQ SUREOHPV E\ XVLQJ D QRQGRPLQDWHG QHLJKERUEDVHG VHOHFWLRQ WHFKQLTXH DQ LPPXQH LQVSLUHG RSHUDWRUWZRKHXULVWLFVHDUFKRSHUDWRUVDQGHOLWLVP7KHPDLQ QRYHOW\ RI 11,$ LV WKDW WKH VHOHFWLRQ WHFKQLTXH RQO\ VHOHFWV PLQRULW\ LVRODWHG QRQGRPLQDWHG LQGLYLGXDOV LQ FXUUHQW SRSXODWLRQ WR FORQH SURSRUWLRQDOO\ WR WKH FURZGLQJGLVWDQFH YDOXHV UHFRPELQH DQG PXWDWH $V D UHVXOW 11,$ SD\V PRUH DWWHQWLRQ WR WKH OHVVFURZGHG UHJLRQV LQ WKH FXUUHQW WUDGHRII IURQW 7KH H[SHULPHQWDO UHVXOWV RQ VHYHQ DUWLILFLDO GDWD VHWV ZLWKGLIIHUHQWPDQLIROGVWUXFWXUHDQGVL[UHDOZRUOGGDWDVHWV VKRZ WKDW WKH 11,$ LV DQ HIIHFWLYH DOJRULWKP IRU VROYLQJ PXOWLREMHFWLYH FOXVWHULQJ SUREOHPV DQG WKH 11,$ EDVHG PXOWLREMHFWLYH FOXVWHULQJ WHFKQLTXH LV D FRJHQW XQVXSHUYLVHG OHDUQLQJPHWKRG

,

,1752'8&7,21

WKH ODVW IRUW\ \HDUV HYROXWLRQDU\ FRPSXWDWLRQ (&  , 1WHFKQLTXHV LQFOXGLQJ JHQHWLF DOJRULWKPV HYROXWLRQDU\ SURJUDPPLQJ HYROXWLRQDU\ VWUDWHJLHV LPPXQH DOJRULWKPV RUDUWLILFLDOLPPXQHV\VWHPVVZDUPLQWHOOLJHQFHDQGVRRQ KDYHEHHQVXFFHVVIXOO\DSSOLHGWRWKHILHOGVRIRSWLPL]DWLRQ >@>@>@ OHDUQLQJ >@>@>@ DQG PDQ\ HQJLQHHULQJ SUREOHPV >@>@>@ 5HFHQWO\ XQVXSHUYLVHG OHDUQLQJ KDV DWWUDFWHG PXFK LQWHUHVW IURP (& UHVHDUFKHUV >@>@>@ $PRQJFXUUHQW(&EDVHGXQVXSHUYLVHGOHDUQLQJWHFKQLTXHV WKH PXOWLREMHFWLYH FOXVWHULQJWHFKQLTXH 02&. >@ VROYHV GDWDFOXVWHULQJSUREOHPVXQFRQYHQWLRQDOO\DQGVKRZVJRRG SHUIRUPDQFH 02&. XVHV D PXOWLREMHFWLYH HYROXWLRQDU\ DOJRULWKP 02($  WR RSWLPL]H WZR FRPSOHPHQWDU\ FOXVWHULQJREMHFWLYHVRYHUDOOGHYLDWLRQUHZDUGLQJFRPSDFW FOXVWHUV DQGFRQQHFWLYLW\UHJDUGLQJORFDOFRQQHFWHGQHVVRI FOXVWHUV  7KH RXWSXW RI DQ 02($ LV D VHW RI PXWXDOO\  0DQXVFULSWUHFHLYHG0DUFK7KLVZRUNZDVVXSSRUWHGE\WKH 1DWLRQDO +LJK 7HFKQRORJ\ 5HVHDUFK DQG 'HYHORSPHQW 3URJUDP  3URJUDP  RI &KLQD 1R $$=  WKH 1DWLRQDO %DVLF 5HVHDUFK 3URJUDP  3URJUDP  RI &KLQD 1RV &% DQG &%  DQG WKH *UDGXDWH ,QQRYDWLRQ )XQG RI ;LGLDQ 8QLYHUVLW\ *UDQW1R  0DRJXR*RQJLVZLWKWKH,QVWLWXWHRI,QWHOOLJHQW,QIRUPDWLRQ3URFHVVLQJ ;LGLDQ8QLYHUVLW\;L DQ&KLQDSKRQHID[  HPDLO PDRJXRBJRQJ#KRWPDLOFRP KRPHSDJHV KWWSVHH[LGLDQHGXFQJUDGXDWHPJJRQJ  /LQLQJ=KDQJLVZLWKWKH,QVWLWXWHRI,QWHOOLJHQW,QIRUPDWLRQ3URFHVVLQJ ;LGLDQ8QLYHUVLW\;L DQ&KLQD /LFKHQJ-LDRLVZLWKWKH,QVWLWXWHRI,QWHOOLJHQW,QIRUPDWLRQ3URFHVVLQJ ;LGLDQ8QLYHUVLW\;L DQ&KLQD 6KXLSLQJ*RXLVZLWKWKH,QVWLWXWHRI,QWHOOLJHQW,QIRUPDWLRQ3URFHVVLQJ ;LGLDQ8QLYHUVLW\;L DQ&KLQD

QRQGRPLQDWHG FOXVWHULQJ VROXWLRQV ZKLFK FRUUHVSRQG WR GLIIHUHQWWUDGHRIIVEHWZHHQWKHWZRREMHFWLYHVDQGDOVRWR GLIIHUHQW QXPEHUV RI FOXVWHUV 7KHQ 02&. DQDO\]HV WKH VKDSHRIWKHWUDGHRIIFXUYHDQGFRPSDUHGLWWRWKHWUDGHRIIV REWDLQHG IRU DQ DSSURSULDWH QXOO PRGHO %DVHG RQ WKLV DQDO\VLVWKHDOJRULWKPSURYLGHVDQHVWLPDWHRIWKHTXDOLW\RI DOO LQGLYLGXDO FOXVWHULQJ VROXWLRQV DQG GHWHUPLQHG D VHW RI SRWHQWLDOO\SURPLVLQJFOXVWHULQJVROXWLRQV ,QWKLV VWXG\ ZH GHVLJQ DQRYHO PXOWLREMHFWLYH LPPXQH DOJRULWKP 1RQGRPLQDWHG 1HLJKERU ,PPXQH $OJRULWKP 11,$ WRVROYHWKHPXOLREMHFWLYHFOXVWHULQJSUREOHPV7KH H[SHULPHQWDO UHVXOWV RQ VHYHQ DUWLILFLDO GDWD VHWV DQG VL[ UHDOZRUOG GDWD VHWV VKRZ WKDW WKH 11,$ FDQ VROYH WKH 02&.SUREOHPVHIIHFWLYHO\7KHUHPDLQGHURIWKLVSDSHULV RUJDQL]HG DV IROORZV 6HFWLRQ ,, GHVFULEHV UHODWHG EDFNJURXQGLQFOXGLQJWKHPXOWREMHFWLYHFOXVWHULQJWHFKQLTXH DQG LPPXQH V\VWHP LQVSLUHG RSWLPL]DWLRQ DOJRULWKPV 6HFWLRQ,,,GHVFULEHVWKHPDLQORRSRI11,$,Q6HFWLRQ,9 ZHVXPPDU\DQGHYDOXDWHWKHH[SHULPHQWDOUHVXOWV)LQDOO\ FRQFOXGLQJUHPDUNVDUHSUHVHQWHG ,, 5(/$7('%$&.*5281' $ 0XOWLREMHFWLYH&OXVWHULQJ 7KH02&.WHFKQLTXH>@FRQVLGHUVDFOXVWHULQJWDVNDVD PXOWLREMHFWLYH RSWLPL]DWLRQ SUREOHP>@ ZKLFK VHHNV WR PLQLPL]HDYHFWRURIIXQFWLRQV  )  [ =  I  [  I   [ "  I 0  [ 7   VXEMHFWWR [ ∈ ; :KHUH[LVDFOXVWHULQJRIDJLYHQVHWRI GDWD ( ; LV WKH VHW RI IHDVLEOH FOXVWHULQJ DQG IL  L =  "  0 LVDVHWRI0GLIIHUHQWFULWHULRQIXQFWLRQV 8VXDOO\ QR VLQJOH EHVW VROXWLRQ IRU WKLV RSWLPL]DWLRQ WDVN H[LVWV EXW LQVWHDG WKH IUDPHZRUN RI 3DUHWR RSWLPDOLW\ LV HPEUDFHG,WLVVDLGWKDWVROXWLRQ [ $ ∈ ; GRPLQDWHVDQRWKHU VROXWLRQ [% ∈ ; ZULWWHQDV [ $ E [% LIDQGRQO\LI ∀L =  "  0  I L  [ $ ≤ I L  [% ∧   ∃M =  "  0  I M  [ $ < I M  [% ,I WKHUH LV QR VROXWLRQ GRPLQDWHV [$ WKHQ [$ LV D 3DUHWRRSWLPDO VROXWLRQ RU QRQGRPLQDWHG VROXWLRQ 7KH VHW RIDOOIHDVLEOH3DUHWRRSWLPDOVROXWLRQVLVUHIHUUHGWRDVWKH WUXH 3DUHWRRSWLPDO VHW ZKLOH WKH FRUUHVSRQGLQJ LPDJH RI REMHFWLYHYHFWRUVLVFDOOHGWKHWUXH3DUHWRRSWLPDOIURQW 6RWKHPXOWLREMHFWLYHFOXVWHULQJWHFKQLTXH>@UHTXLUHVWR FKRLFH WZR RU PRUH REMHFWLYH IXQFWLRQV D VXLWDEOH PXWLREMHFWLYH RSWLPL]DWLRQ DOJRULWKP DQG DQ HIIHFWLYH

15 c 1-4244-1340-0/07$25.00 2007 IEEE

WHFKQLTXH IRU VROXWLRQ VHOHFWLRQ IURP WKH VHW RI 3DUHWRRSWLPDOVROXWLRQV )ROORZLQJ >@ LQ WKLV VWXG\ WKH WZR FRPSOHPHQWDU\ REMHFWLYHV DUH FRPSDFWQHVV DQG FRQQHFWHGQHVV RI FOXVWHUV UHVSHFWLYHO\7KHFOXVWHUFRPSDFWQHVVLVVLPSO\FRPSXWHGDV WKH RYHUDOO VXPPHG GLVWDQFH EHWZHHQ GDWD LWHPV DQG WKHLU FRUUHVSRQGLQJFOXVWHUFHQWUH 'HY  [ = ¦ ¦ δ L μN   [ N ∈ [ L∈ [ N

ZKHUH [ LV WKH VHW RI DOO FOXVWHUV μ N LV WKH FHQWURLG RI FOXVWHU [N  DQG δ L  μN LVWKH (XFOLGHDQGLVWDQFH EHWZHHQ WKH LWK GDWD LWHP RI FOXVWHU [N DQG μ N  7KLV FULWHULRQ LV VLPLODUWRWKHZHOONQRZQFULWHULRQRILQWUDFOXVWHUYDULDQFH ZKLFK VTXDUHV WKH GLVWDQFH YDOXH δ L μN DQG LV PRUH VWURQJO\ELDVHGWRZDUGVVSKHULFDOO\VKDSHGFOXVWHUV 7KH FOXVWHU FRQQHFWHGQHVV PHWULF HYDOXDWHV GHJUHH WR ZKLFKQHLJKERULQJGDWDSRLQWVKDYHEHHQSODFHGLQWKHVDPH FOXVWHU,WLVFRPSXWHGDV 1 § / · &RQQ [ = ¦ ¨ ¦ [L QLM ¸   L = © M = ¹ ZKHUH ¬ ­°  [U  V = ® M  LI ∃ [N  U ∈ [N ∧ V ∈ [N   °¯  HOVH QLM LVWKHMWKQHDUHVWQHLJKERURIGDWXPL1LVWKHVL]HRIWKH FOXVWHUHG GDWD VHW DQG / LV D SDUDPHWHU GHWHUPLQLQJ WKH QXPEHU RI QHLJKERUV WKDW FRQWULEXWH WR WKH FRQQHFWLYLW\ PHDVXUH 7KLV PHDVXUH LV FRQFHSWXDOO\ VLPLODU WR WKH FULWHULRQRIQHDUHVWQHLJKERUFRQVLVWHQF\LQWURGXFHGE\>@ 7KH PDLQ GLIIHUHQFH LV WKH XVH RI D JUDGXDOO\ GHFUHDVLQJ SHQDOW\ M LQVWHDG RI D FRQVWDQW(TXDWLRQ   JLYHV PRUH HPSKDVLV WR WKH QHDUHVW QHLJKERXUV ,W WKHUHIRUH SHUPLWV D ILQHUGLVWLQFWLRQEHWZHHQWKHTXDOLWLHVRIFOXVWHULQJVROXWLRQV DQG DOORZV IRU WKH LGHQWLILFDWLRQ RI FOXVWHUV RI VL]HV VLJQLILFDQWO\VPDOOHUWKDQ/ $ VXLWDEOH 02($ FDQ RSWLPL]HWKH WZR FRPSOHPHQWDU\ FOXVWHULQJ REMHFWLYHV V\QFKURQRXVO\ DQG UHWXUQ D VHW RI FOXVWHULQJ VROXWLRQV 7KHVH LQGLYLGXDO SDUWLWLRQLQJV FRUUHVSRQG WR GLIIHUHQW WUDGHRIIV EHWZHHQ WKH WZR REMHFWLYHVDQGFRQVLVWRIGLIIHUHQWQXPEHUVRIFOXVWHUV7KH VHOHFWLRQRIDVLQJOHVROXWLRQIURPWKHPWKHQDXWRPDWLFDOO\ GHOLYHUVDQHVWLPDWHRIWKHQXPEHURIFOXVWHUVLQKHUHQWWRWKH GDWDVHWE\XVLQJWKH02&.PRGHOVHOHFWLRQWHFKQLTXH>@

% ,PPXQH6\VWHP,QVSLUHG2SWLPL]DWLRQ$OJRULWKPV 7KH LPPXQH V\VWHP V DELOLW\ WR DGDSW LWV %FHOOV WR QHZ W\SHV RI DQWLJHQ LV SRZHUHG E\ SURFHVVHV NQRZQ DV FORQDO VHOHFWLRQDQGDIILQLW\PDWXUDWLRQE\K\SHUPXWDWLRQ>@7KH PDMRULW\RILPPXQHV\VWHPLQVSLUHGRSWLPL]DWLRQDOJRULWKPV DUH EDVHG RQ WKH DSSOLFDWLRQV RI WKH FORQDO VHOHFWLRQ DQG K\SHUPXWDWLRQ >@ 7KH FORQDO VHOHFWLRQ DOJRULWKP IRU RSWLPL]DWLRQKDVEHHQSRSXODUL]HGPDLQO\E\GH&DVWURDQG 9RQ =XEHQ V &/21$/* >@ &/21$/* VHOHFWV SDUW ILWWHVW DQWLERGLHV WR FORQH SURSRUWLRQDOO\ WR WKHLU DQWLJHQLF DIILQLWLHV7KHK\SHUPXWDWLRQ RSHUDWRU SHUIRUPV DQDIILQLW\

16

PDWXUDWLRQ SURFHVV LQYHUVHO\ SURSRUWLRQDO WR WKH ILWQHVV YDOXHV JHQHUDWLQJ WKH PDWXUHG FORQH SRSXODWLRQ $IWHU FRPSXWLQJ WKH DQWLJHQLF DIILQLW\ RI WKH PDWXUHG FORQH SRSXODWLRQ &/21$/* FUHDWHV UDQGRPO\ SDUW QHZ DQWLERGLHVWRUHSODFHWKHORZHVWILWQHVVDQWLERGLHVLQFXUUHQW SRSXODWLRQ DQG UHWDLQ EHVW DQWLERGLHV WR UHF\FOH GH &DVWUR DQG 7LPPLV SURSRVHG DQ DUWLILFLDO LPPXQH QHWZRUN FDOOHG RSWDL1HW>@ IRU PXOWLPRGDO RSWLPL]DWLRQ ,Q RSWDL1HW DQWLERGLHVDUHSDUWRIDQLPPXQHQHWZRUNDQGWKHGHFLVLRQ DERXW WKH LQGLYLGXDO ZKLFK ZLOO EH FORQHG VXSSUHVVHG RU PDLQWDLQHG GHSHQGV RQ WKH LQWHUDFWLRQ HVWDEOLVKHG E\ WKH LPPXQH QHWZRUN *DUUHWW KDV SUHVHQWHG DQ DWWHPSW WR UHPRYH DOO WKH SDUDPHWHUV IURP FORQDO VHOHFWLRQ DOJRULWKP >@7KLVPHWKRGDWWHPSWVWRVHOIHYROYHYDULRXVSDUDPHWHUV GXULQJ D VLQJOH UXQ &XWHOOR DQG 1LFRVLD SURSRVHG DQ LPPXQHDOJRULWKP IRU RSWLPL]DWLRQ FDOOHG RSW,$ >@>@ 2SW,$VROYHVRSWLPL]DWLRQSUREOHPVE\XVLQJWKUHHLPPXQH RSHUDWRUVFORQLQJK\SHUPXWDWLRQDQGDJLQJDQGDVWDQGDUG HYROXWLRQDU\RSHUDWRU  μ + λ VHOHFWLRQRSHUDWRU$VIDUDV PXOWLREMHFWLYHRSWLPL]DWLRQLVFRQFHUQHGWKHPXOLREMHFWLYH LPPXQHV\VWHPDOJRULWKP0,6$ >@>@PD\EHWKHILUVW DWWHPSW WR VROYH JHQHUDO PXOWLREMHFWLYH RSWLPL]DWLRQ SUREOHPV XVLQJ DUWLILFLDO LPPXQH V\VWHPV 0,6$ HQFRGHV WKHGHFLVLRQYDULDEOHVRIWKHSUREOHPWREHVROYHGE\ELQDU\ VWULQJVFORQHVWKH3DUHWRRSWLPDODQGIHDVLEOHVROXWLRQVDQG DSSOLHV WZR W\SHV RI PXWDWLRQ WR WKH FORQHV DQG RWKHU LQGLYLGXDOV UHVSHFWLYHO\ 0RUH UHFHQWO\ )UHVFKL DQG 5HSHWWR >@ SURSRVHG D YHFWRU DUWLILFLDO LPPXQH V\VWHP 9$,6 IRUVROYLQJPXOWLREMHFWLYHRSWLPL]DWLRQSUREOHPVE\ PRGLI\LQJ WKH RSWDL1HW 9$,6 DGRSWHG WKH IORZFKDUW RI RSWDL1HWDQGWKHILWQHVVDVVLJQPHQWPHWKRGLQ63($>@ ZLWKVRPHVLPSOLILFDWLRQWKDWIRU3DUHWRRSWLPDOLQGLYLGXDOV WKH ILWQHVV LV WKH VWUHQJWK GHILQHG LQ 63($ DQG IRU GRPLQDWHG LQGLYLGXDOV WKH ILWQHVV LV WKH QXPEHU RI LQGLYLGXDOV ZKLFK GRPLQDWH WKHP &XWHOOR 1DU]LVL DQG 1LFRVLD >@ PRGLILHG WKH  3$(6>@ XVLQJ WZR LPPXQH LQVSLUHG RSHUDWRUV FORQLQJDQGK\SHUPXWDWLRQ DQG DSSOLHGWKHLPSURYHG3$(6WRVROYLQJWKHSURWHLQVWUXFWXUH SUHGLFWLRQSUREOHP ,,, 121'20,1$7('1(,*+%25,0081($/*25,7+0 $ 6XPPDU\RI5HODWHG7HUPV ,QWKLVVWXG\ZHIROORZWKHQRPHQFODWXUHRILPPXQRORJ\ DQGGHILQHWKHWHUPVDVIROORZV $QWLJHQ Ψ  ,Q LPPXQRORJ\ DQ DQWLJHQ LV DQ\ VXEVWDQFH WKDW FDXVHV LPPXQH V\VWHP WR SURGXFH DQWLERGLHV DJDLQVW LW ,Q WKLV VWXG\IRUPXOWLREMHFWLYHRSWLPL]DWLRQSUREOHP 7 °­ PD[ )  [ =  I  [  I   [  " I 0  [  3 ®   °¯VXEMHFWWR [ ∈ ; ZKHUH [ =  [  [ [P  ; LV WKH IHDVLEOH UHJLRQ DQG 0 ≥   WKH DQWLJHQ Ψ LV GHILQHG DV WKH VHW RI REMHFWLYH IXQFWLRQV )  [  $QWLERG\DQG$QWLERG\3RSXODWLRQ

2007 IEEE Congress on Evolutionary Computation (CEC 2007)

,Q WKLV VWXG\ DQ DQWLERG\ UHSUHVHQWV D VHDUFK SRLQW LQ GHFLVLRQ VSDFH )RU WKH DQWLJHQ Ψ LQ HTXDWLRQ   DQ DQWLERG\ E  E  E " EO LV WKH FRGLQJ RI YDULDEOH [ GHQRWHG E\ E  H [  DQG [ LV FDOOHG WKH GHFRGLQJ RI DQWLERG\ E H[SUHVVHG DV [  H E  $Q DQWLERG\ SRSXODWLRQ % = E  E "  EQ  H − EN ∈ ;   ≤ N ≤ Q   LVDQQGLPHQVLRQDOJURXSRIDQWLERG\EZKHUHWKHSRVLWLYH LQWHJHUQLVWKHVL]HRIDQWLERG\SRSXODWLRQ% 'RPLQDQW$QWLERG\ )RU WKH DQWLJHQ Ψ LQ HTXDWLRQ   WKH DQWLERG\ EL LV DQ GRPLQDQW DQWLERG\ LQ DQWLERG\ SRSXODWLRQ %  ^E  E "  EQ `  LI DQG RQO\ LI WKHUH LV QR DQWLERG\ E M ∈ %  M =  " Q ∧ M ≠ L WKDW VDWLVILHV (TXDWLRQ   6R

WKH GRPLQDQWDQWLERGLHV DUH WKH 3DUHWRRSWLPDO LQGLYLGXDOV LQSRSXODWLRQ% ∀N =  "  0 ∧∃O =  "  0

( ) I ( H (E )) > I ( H

I N H − ( E M ) ≥ I N ( H − ( EL ) ) −

O

M

O

−

( EL ) )

 

% 7KH0DLQ/RRSRI11,$ ,Q WKLV VHFWLRQ ZH GHVFULEH D QRYHO PXOWLREMHFWLYH RSWLPL]DWLRQDOJRULWKPWHUPHGDV1RQGRPLQDWHG1HLJKERU ,PPXQH $OJRULWKP 11,$  11,$ VWRUHV 3DUHWRRSWLPDO VROXWLRQV IRXQG VR IDU LQ DQ H[WHUQDO SRSXODWLRQ FDOOHG 'RPLQDQW 3RSXODWLRQ 2QO\ SDUWLDO OHVVFURZGHG 3DUHWRRSWLPDO LQGLYLGXDOV FDOOHG DFWLYH DQWLERGLHV DUH VHOHFWHG WR GR SURSRUWLRQDO FORQLQJ UHFRPELQDWLRQ DQG VWDWLF K\SHUPXWDWLRQ )XUWKHUPRUH WKH SRSXODWLRQ VWRULQJ FORQHV LV FDOOHG &ORQH 3RSXODWLRQ 'RPLQDQW 3RSXODWLRQ $FWLYH 3RSXODWLRQ DQG &ORQH 3RSXODWLRQ DW WLPH W DUH UHSUHVHQWHGE\WLPHGHSHQGHQWYDULDEOHPDWULFHV 'W$WDQG &WUHVSHFWLYHO\7KHPDLQORRSRI11,$LVDVIROORZV  Algorithm 1: Nondominated Neighbor Immune Algorithm Input: *PD[ (maximum number of generations) Q' (maximum size of Dominant Population) Q$ (maximum size of Active Population) Q& (size of Clone Population) Output: '*PD[+ (final Approximate Pareto-optimal Sets) Step1: Initialization: Generate an initial antibody population % with the size Q' . Create the initial ' φ $ φ , and & φ . Set W . Step2: Update Dominant Population: Identify dominant antibodies in %W; Copy all the dominant antibodies to form the temporary dominant population '7W; If the size of '7W is no greater

than Q' , let 'W '7W. Otherwise, calculate the crowding-distance values of all individuals in '7W, sort them in descending order of crowding-distance, choose the first Q' individuals to form 'W. Step3: Termination: If W ≥ *PD[ is satisfied, export 'W as the output of the algorithm, Stop; Otherwise, W W. Step4: Nondominated Neighbor-based Selection: If the size of 'W is no greater than Q$ , let $W 'W. Otherwise, calculate the crowding-distance values of all individuals in 'W, sort them in descending order of crowding-distance, choose the first Q$ individuals to form $W. Step5: Proportional Cloning Operator: Get the clone population &W by applying the proportional cloning 7 & to $W. Step6: Recombination and Hypermutation: Perform recombination and ′ hypermutation on &Wand set & W to the resulting population. Step7: Get the antibody population %W by combining the & W′ and 'W; go to Step2.  :KHQWKHQXPEHURIGRPLQDQWDQWLERGLHVLVJUHDWHUWKDQ WKHPD[LPXPOLPLWDWLRQDQGWKHVL]HRIGRPLQDQWSRSXODWLRQ LVJUHDWHUWKDQWKHPD[LPXPVL]HRIDFWLYHSRSXODWLRQERWK WKH UHGXFWLRQ RI GRPLQDQW SRSXODWLRQ DQG WKH VHOHFWLRQ RI DFWLYH DQWLERGLHV XVH WKH FURZGLQJGLVWDQFH >@ EDVHG WUXQFDWLRQVHOHFWLRQ7KHYDOXHRIFURZGLQJGLVWDQFHVHUYHV DVDQHVWLPDWHRIWKHSHULPHWHURIWKHFXERLGIRUPHGE\WKH QHDUHVW QHLJKERUV DV WKH YHUWLFHV LQ REMHFWLYH VSDFH 7KH FURZGLQJGLVWDQFH DVVLJQPHQW LV GHVFULEHG LQ IXOO LQ >@ 7KH SURSRUWLRQDO FORQLQJ RSHUDWLRQ UHFRPELQDWLRQ RSHUDWLRQ DQG K\SHUPXWDWLRQ RSHUDWLRQ DUH GHVFULEHG DV IROORZV & 3URSRUWLRQDO&ORQLQJ ,Q LPPXQRORJ\ &ORQLQJ PHDQV DVH[XDO SURSDJDWLRQ VR WKDWDJURXSRILGHQWLFDOFHOOVFDQEHGHVFHQGHGIURPDVLQJOH FRPPRQ DQFHVWRU VXFK DV D EDFWHULDO FRORQ\ ZKRVH PHPEHUV DULVH IURP D VLQJOH RULJLQDO FHOO DV WKH UHVXOW RI PLWRVLV,QWKLVVWXG\WKHSURSRUWLRQDOFORQLQJ 7 & RQDFWLYH SRSXODWLRQ $ = D  D   D " D_ $_ LVGHILQHGDV 7 & D + D + " + D_ $_ = 7 & D + 7 & D + " + 7 & D_ $_ = ^D + D + " + DT ` + ^D + D + " + DT `

 

T

+" + ^D_$_ + D_$_ + " + D_ $_$__ `

ZKHUH 7 & DL = ^DL + DL +"+ DLTL `  DLM = DL  L ="_ $_ 

2007 IEEE Congress on Evolutionary Computation (CEC 2007)

17

M =  " TL  TL LV D VHOIDGDSWLYH SDUDPHWHU DQG _ $_

¦T L =

L

= Q&  Q& LV D JLYHQ YDOXH RI WKH VL]H RI WKH FORQH

SRSXODWLRQ 7KH UHSUHVHQWDWLRQ  LV QRW WKH DULWKPHWLFDO RSHUDWRU EXW RQO\ VHSDUDWHV WKH DQWLERGLHV KHUH TL =   GHQRWHVWKDWWKHUHLVQRFORQLQJRQDQWLERG\ DL ,QWKLVVWXG\ WKH LQGLYLGXDO ZLWK JUHDWHU FURZGLQJGLVWDQFH YDOXH LV UHSURGXFHG PRUH WLPHV YL] WKH LQGLYLGXDO ZLWK JUHDWHU FURZGLQJGLVWDQFH YDOXH KDV D JUHDWHU TL  %HFDXVH WKH FURZGLQJGLVWDQFHYDOXHVRIERXQGDU\VROXWLRQVDUHSRVLWLYH LQILQLW\ EHIRUH FRPSXWLQJ WKH YDOXH RI TL IRU HDFK DFWLYH DQWLERG\ ZH VHW WKH FURZGLQJGLVWDQFH YDOXHV RI WKH ERXQGDU\ LQGLYLGXDOV EH HTXDO WR WKH GRXEOH YDOXHV RI WKH PD[LPXP YDOXH RI DFWLYH DQWLERGLHV H[FHSW WKH ERXQGDU\ LQGLYLGXDOV7KHQWKHYDOXHVRI TL DUHFDOFXODWHGDV ª º L »   TL = « Q& × QGLVWDQFH $ « » L ¦ GLVWDQFH L  « » ZKHUH LGLVWDQFH GHQRWHV WKH FURZGLQJGLVWDQFH YDOXHV RI WKH LWK DFWLYH DQWLERGLHV $OO WKH DQWLERGLHV LQ VXESRSXODWLRQ ^DL + DL + " + DLTL ` DUH UHVXOWHG IURP WKH FORQLQJ RQ

DQWLERG\ DL  DQG KDYH WKH VDPH SURSHUW\ DV DL  ,Q IDFW FORQLQJRQDQWLERG\ DL LVWRPDNHPXOWLSOHLGHQWLFDOFRSLHV RI DL  7KH DLP LV WKDW WKH JUHDWHU WKH FURZGLQJGLVWDQFH YDOXHRIDQLQGLYLGXDOWKHPRUHWLPHVWKHLQGLYLGXDOZLOOEH UHSURGXFHG 6R WKHUH H[LVWV PRUH FKDQFHV WR GR VHDUFK LQ OHVVFURZGHGUHJLRQVRIWKHWUDGHRIIIURQWV

FKRVH WKH VWDWLF K\SHUPXWDWLRQ LQ RXU DOJRULWKP IRU WKH IROORZLQJUHDVRQV D  7KH K\SHUPXWDWLRQ RSHUDWRU LV LPSOHPHQWHG RQ WKH FORQH SRSXODWLRQ ,I ZH FKRVH WKH SURSRUWLRQDO K\SHUPXWDWLRQRUWKHLQYHUVHO\SURSRUWLRQDOK\SHUPXWDWLRQ ZHKDYHWRFDOFXODWHWKHILWQHVVYDOXHVIRUDOOWKHLQGLYLGXDOV RIWKHFORQHSRSXODWLRQ+RZHYHULQRWKHUSKDVHVRI11,$ H[FHSW K\SHUPXWDWLRQ WKH GRPLQDWHG LQGLYLGXDOV DUH QRW DVVLJQHG ILWQHVV 7KHUHIRUH ZH KDYH WR GHILQH D ILWQHVV DVVLJQPHQW VWUDWHJ\ WR GRPLQDWHG LQGLYLGXDOV RQO\ IRU WKH K\SHUPXDWLRQ RSHUDWRU XQOHVV ZH XVH D PXWDWLRQ RSHUDWRU LQGHSHQGHQWIURPWKHILWQHVVYDOXHV E ,QRUGHUWRUHGXFLQJFRPSOH[LW\WKHILWQHVVHYDOXDWLRQ LVDVOHVVDVSRVVLEOH6XSSRVHZHGHILQHDILWQHVVDVVLJQPHQW VWUDWHJ\ VXLWDEOH IRU WKH SURSRUWLRQDO K\SHUPXWDWLRQ RU WKH LQYHUVHO\SURSRUWLRQDOK\SHUPXWDWLRQZHKDYHWRFDOFXODWH WKHILWQHVVYDOXHVRIDOOUHFRPELQHGFORQHVEHIRUHPXWDWLRQ F  7KH H[SHULPHQWDO VWXG\ LQ >@ VKRZHG WKDW WKH LQYHUVHO\SURSRUWLRQDOGLGRQO\VOLJKWO\EHWWHUWKDQVWDWLFDQG SURSRUWLRQDO K\SHUPXWDWLRQ LQ VROYLQJ WKH 7UDS IXQFWLRQ SUREOHPV%XWLIWKHFRPELQDWLRQRIPXOWLSOHRSHUDWRUVZDV QRW FRQVLGHUHG WKH VWDWLF K\SHUPXWDWLRQ DFKLHYHG WKH EHVW UHVXOWVDPRQJWKHWKUHHK\SHUPXWDWLRQRSHUDWRUVLQVROYLQJ WKHSURWHLQVWUXFWXUHSUHGLFWLRQSUREOHPV 'HSHQGLQJ RQ WKH DERYH UHDVRQV ZH GHVLJQ WKH K\SHUPXWDWLRQRSHUDWRUDVWKHVWDWLFK\SHUPXWDWLRQRSHUDWRU ,I 5 = U  U  U "  UQ& LV WKH FORQH SRSXODWLRQ DIWHU

'5HFRPELQDWLRQDQG+\SHUPXWDWLRQ

UHFRPELQDWLRQ WKHQ WKH VWDWLF K\SHUPXWDWLRQ RSHUDWRU 7 +  RQFORQHSRSXODWLRQ5LVGHILQHGDV 7 + U + U + " + UQ& = 7 + U + 7 + U + " + 7 + UQ&   = PXWDWHU + PXWDWHU +" + PXWDWHUQ&

,I & = F  F   F "  FQ& LVWKHUHVXOWLQJ SRSXODWLRQ IURP

ZKHUH PXWDWHUL  L =   " Q& GHQRWHV FKDQJLQJ HDFK

DSSO\LQJWKHSURSRUWLRQDOFORQLQJWR $ = D  D   D "  D_ $_ 

HOHPHQW RI WKH YDULDEOH YHFWRU UL E\ D JHQHUDO PXWDWLRQ RSHUDWRUZLWKSUREDELOLW\SPVRHDFKLQGLYLGXDOLQWKHFORQH SRSXODWLRQ 5 DW HDFK WLPH VWHS ZLOO XQGHUJR DERXW P × SP  PXWDWLRQVZKHUHPLVWKHGLPHQVLRQRIYDULDEOHYHFWRU

WKHQ WKH UHFRPELQDWLRQ 7 5 RQ FORQH SRSXODWLRQ & LV GHILQHGDV 7 5 F + F + " + FQ& = 7 5 F + 7 5 F + " + 7 5 FQ& = FURVVRYHU F  $ + FURVVRYHU F  $

 

+" + FURVVRYHU FQ&  $

ZKHUH FURVVRYHU FL  $ GHQRWHV VHOHFWLQJ RQH LQGLYLGXDO HTXLSUREDEO\IURPWKHWZRRIIVSULQJVJHQHUDWHGE\DJHQHUDO FURVVRYHU RSHUDWRU RQ FORQH FL DQG DQ DFWLYH DQWLERG\ VHOHFWHGUDQGRPO\IURP $  ,QWKLVVWXG\ZHXVHVWDWLFK\SHUPXWDWLRQRSHUDWRU>@RQ WKH FORQH SRSXODWLRQ DIWHU UHFRPELQDWLRQ 5HIHUHQFH >@ GHVLJQHG WKUHH K\SHUPXWDWLRQ PHWKRGV QDPHO\ VWDWLF K\SHUPXWDWLRQ WKH QXPEHU RI PXWDWLRQV LV LQGHSHQGHQW IURP WKH ILWQHVV YDOXHV  SURSRUWLRQDO K\SHUPXWDWLRQ WKH QXPEHURIPXWDWLRQVLVSURSRUWLRQDOWRWKHILWQHVVYDOXH DQG LQYHUVHO\ SURSRUWLRQDO K\SHUPXWDWLRQ WKH QXPEHU RI PXWDWLRQVLVLQYHUVHO\SURSRUWLRQDOWRWKHILWQHVVYDOXH :H

18

( 7KH&KDUDFWHULVWLFVRI11,$ ,W FDQ EH VHHQ WKDW 11,$ XVHV VRPH ZHOONQRZQ WHFKQLTXHV VXFK DV VWRULQJ WKH QRQGRPLQDWHG LQGLYLGXDOV SUHYLRXVO\ IRXQG H[WHUQDOO\ DQG UHGXFLQJ WKH QXPEHU RI QRQGRPLQDWHG LQGLYLGXDOV VWRUHG ZLWKRXW GHVWUR\LQJ WKH FKDUDFWHULVWLFV RI WKH WUDGHRII IURQW )XUWKHUPRUH 11,$ DGRSWVWKHQRQGRPLQDWHGQHLJKERUEDVHGVHOHFWLRQ,WLVWKH VDPHDV16*$,,>@LQFRPSXWLQJWKHFURZGLQJGLVWDQFH VHOHFWLRQLVWKHUHIRUHELDVHGWRZDUGVLQGLYLGXDOVZLWKDKLJK LVRODWLRQ YDOXH 16*$,, QHHGV WR FODVVLI\ DOO LQGLYLGXDOV LQWR VHYHUDO OD\HUV DQG VHOHFWLRQ LV SHUIRUPHG RQOD\HU E\ OD\HU XQWLO WKH SRSXODWLRQ VL]H LV DFKLHYHG ,Q 11,$ WKH GRPLQDQW SRSXODWLRQ LV VHW DV DQ H[WHUQDO SRSXODWLRQ IRU HOLWLVP 1RQGRPLQDWHG QHLJKERUEDVHG VHOHFWLRQ RQO\ SHUIRUPV RQ WKH H[WHUQDO SRSXODWLRQ EDVHG RQ WKH FURZGLQJGLVWDQFH 2QO\ SDUWLDO QRQGRPLQDWHG LQGLYLGXDOV PXFKOHVVWKDQQRQGRPLQDWHGLQGLYLGXDOVIRXQGVRIDU ZLWK

2007 IEEE Congress on Evolutionary Computation (CEC 2007)

KLJK FURZGLQJGLVWDQFH YDOXHV DUH VHOHFWHG $QG &ORQLQJ UHFRPELQDWLRQ DQG PXWDWLRQ RQO\ DSSO\ WR WKH VHOHFWHG LQGLYLGXDOV DFWLYH DQWLERGLHV  6R LQ D VLQJOH JHQHUDWLRQ RQO\ OHVVFURZGHG LQGLYLGXDOV SHUIRUP KHXULVWLF VHDUFK LQ RUGHUWRREWDLQPRUHVROXWLRQVLQWKHOHVVFURZGHGUHJLRQVRI WKH WUDGHRII IURQWV ,Q FRQWUDVW WR 16*$,, SURSRUWLRQDO FORQLQJ PDNHV WKH OHVVFURZGHG LQGLYLGXDOV KDYH PRUH FKDQFHVWRGRUHFRPELQDWLRQDQGPXWDWLRQ7KHSRSXODWLRQ HYROXWLRQLQDVLQJOHJHQHUDWLRQDWWLPHWLVVKRZQLQ)LJ  W = W +

$W

&ORQLQJ

&W 6HDUFKLQJ

&W′

6HOHFWLRQ

'W+ ,GHQWLI\LQJGRPLQDQW DQWLERGLHVDQG 8SGDWHGRPLQDQW

'W SRSXODWLRQ

)LJ3RSXODWLRQ(YROXWLRQRI11,$



 16*$,,>@ 63($>@ 3(6$,,>@ DQG VRPH RWKHU 02($V FDQ EH FRQVLGHUHG DV GLIIHUHQW 02($V EHFDXVH WKH\ DGRSW GLIIHUHQW ZD\V WR GR VHOHFWLRQ RU ILWQHVV DVVLJQPHQW  DQG SRSXODWLRQ PDLQWHQDQFH LQ VROYLQJ PXOWLREMHFWLYH RSWLPL]DWLRQ SUREOHPV 11,$ DGRSWV 16*$,, V FURZGLQJ GLVWDQFH WR XSGDWH LWV 3DUHWRRSWLPDO VHW GRPLQDQW SRSXODWLRQ  DQG VHOHFW DFWLYH DQWLERGLHV IRU KHXULVWLFVHDUFKLQJ7KHHVVHQWLDOGLIIHUHQFHEHWZHHQ11,$ DQG WKHP LV WKDW WKH VHOHFWLRQ WHFKQLTXH RQO\ SHUIRUPV RQ 3DUHWRRSWLPDOLQGLYLGXDOVDQGRQO\VHOHFWVPLQRULW\LVRODWHG LQGLYLGXDOV WR FORQH SURSRUWLRQDOO\ WR FURZGLQJGLVWDQFH YDOXHV UHFRPELQH DQG PXWDWLRQ ,Q FRQWUDVW WR 16*$,, SURSRUWLRQDO FORQLQJ PDNHV WKH OHVVFURZGHG LQGLYLGXDOV KDYHPRUHFKDQFHVWRGRUHFRPELQDWLRQDQGPXWDWLRQ6RLQ D VLQJOH JHQHUDWLRQ 11,$ SD\V PRUH DWWHQWLRQ WR WKH OHVVFURZGHG UHJLRQV LQ WKH WUDGHRII IURQW 7KH HVVHQWLDO GLIIHUHQFHEHWZHHQ11,$DQG0,6$>@LVLQWKHLUGLIIHUHQW VHOHFWLRQ PHWKRGV DQG SRSXODWLRQ PDLQWHQDQFH VWUDWHJLHV 0,6$ FORQHV DOO WKH 3DUHWRRSWLPDO DQG IHDVLEOH VROXWLRQV IRUFRQVWUDLQWSUREOHPV DSSOLHVWZRW\SHVRIPXWDWLRQWRWKH FORQHVDQGRWKHU QRWVRJRRG LQGLYLGXDOVUHVSHFWLYHO\DQG XSGDWHV LWV H[WHUQDO SRSXODWLRQ E\ XVLQJ WKH JULG EDVHG WHFKQLTXHV XVHG LQ 3$(6>@ ZKLFK QHHG D FUXFLDO SDUDPHWHUWKHQXPEHURIJULGFHOOV ,9 (;3(5,0(17$/678'@ WKH JHQHWLF DOJRULWKPEDVHG FOXVWHULQJ WHFKQLTXH *$&  >@ DQG WKH .0HDQVDOJRULWKP.0 >@ )RUIDLUSOD\ERWK11,&DQG3(6&XVHWKHORFXVEDVHG DGMDFHQF\UHSUHVHQWDWLRQ>@DQG WKHLQLWLDOL]DWLRQ PHWKRG EDVHGRQPLQLPXPVSDQQLQJWUHHV>@$QGWKHSDUDPHWHU VHWWLQJV XVHG IRU 11,& DUH DV IROORZV WKH QXPEHU RI JHQHUDWLRQVLVGRPLQDQWSRSXODWLRQVL]HLVDFWLYH SRSXODWLRQVL]HLVFORQHSRSXODWLRQVL]HLVPD[LPXP QXPEHURIFOXVWHUVLVDQGPXWDWLRQSUREDELOLW\LV  1  ZKHUH1LVWKHVL]HRIWKHGDWDVHW)RU3(6&WKHQXPEHURI JHQHUDWLRQVLVH[WHUQDOSRSXODWLRQVL]HLVLQWHUQDO SRSXODWLRQVL]HLVPD[LPXPQXPEHURIFOXVWHUVLV PXWDWLRQSUREDELOLW\LV  1 DQGUHFRPELQDWLRQSUREDELOLW\ LV  )RU *$& WKH QXPEHU RI JHQHUDWLRQV LV  SRSXODWLRQVL]HLVUHFRPELQDWLRQSUREDELOLW\LVDQG PXWDWLRQSUREDELOLW\LV)RU.0WKHPD[LPXPLWHUDWLYH QXPEHULVVHWWRDQGWKHVWRSWKUHVKROG &OXVWHULQJ TXDOLW\ LV HYDOXDWHG XVLQJ WZR H[WHUQDO PHDVXUHVWKH$GMXVWHG5DQG,QGH[>@DQGWKHFOXVWHULQJ HUURU7KH$GMXVWHG5DQG,QGH[UHWXUQVYDOXHVLQWKHLQWHUYDO >@DQGLVWREHPD[LPL]HG /HW WKH WUXH FOXVWHULQJ EH ΔWUXH = ^&WUXH  &WUXH  "  &NWUXH ` DQG WXUH

WKH

FOXVWHULQJ

SURGXFHG

EH

Δ = ^&  & " &N `



∀L ∈ >"  NWUXH @ M ∈ >"  N @  &RQIXVLRQL M GHQRWHV WKH QXPEHURIVDPHGDWDSRLQWVERWKLQWKHWUXHFOXVWHU &LWUXH DQG LQWKHFOXVWHU & M SURGXFHG7KHQWKHFOXVWHULQJHUURU&(  LVGHILQHGDV &( Δ  Δ WUXH =

 NWUXH N ¦¦ &RQIXVLRQL M   Q L = M = L≠ M

ZKHUH Q LVWKHWRWDOQXPEHURIGDWDSRLQWV1RWHWKDWWKHUH H[LVWVDUHQXPEHULQJSUREOHPVRWKH&(LVFRPSXWHGIRUDOO SRVVLEOH UHQXPEHULQJ RI WKH FOXVWHULQJ SURGXFHG DQG WKH PLQLPXP RI DOO WKRVH LV WDNHQ 7KH FOXVWHULQJ HUURU DOVR UHWXUQVYDOXHVLQWKHLQWHUYDO>@DQGLVWREHPLQLPL]HG :H ILUVW VHOHFW VHYHQ DUWLILFLDO GDWD VHWV QDPHG /LQHEOREV /RQJ 6L]H 6SLUDO 6TXDUH 6WLFNV DQG 7KUHHFLUFOHVWRFRPSDUHWKHSHUIRUPDQFHVRI11,&3(6& *$& DQG .0 RQ GLIIHUHQW LQWHUHVWLQJ GDWD SURSHUWLHV7KH GLVWULEXWLRQRIGDWDSRLQWVLQWKHVHGDWDVHWVFDQEHVHHQLQ )LJ$OODOJRULWKPVDUHUXQWLPHVLQGHSHQGHQWO\DQGWKH DYHUDJH UHVXOW LV ILQDOO\ RXWSXW 7KH DYHUDJH UHVXOWV DUH VKRZQLQ7DEOH )URP7DEOHZHFDQVHHFOHDUO\WKDW11,&GLGEHVWRQ ILYHRXWRIWKHVHYHQSUREOHPVQDPHO\/LQHEOREV/RQJ 6SLUDO 6WLFNV DQG 7KUHHFLUFOHV 3(6& REWDLQHG WKH EHVW FOXVWHULQJ RQ WKH WZR SUREOHPV 6L]H DQG 6SLUDO .0 DQG *$& RQO\ REWDLQHG UHFHLYDEOH FOXVWHULQJ IRU WKH WZR VSKHURLGGDWDVHWVLH6L]HDQG6TXDUHHYHQWKRXJKWKH GHVLUHG FOXVWHUV QXPEHU LV VHW WR EH NQRZQ LQ DGYDQFH IRU *$& DQG .0 7KLVLVGXH WRWKH FRPSOH[ VWUXFWXUH RI WKH RWKHU ILYH GDWD VHWV ZKLFK GRHV QRW VDWLVI\ VXSHUVSKHUH GLVWULEXWLRQ 2Q WKH RWKHU KDQG 11,& DQG 3(6& FDQ

2007 IEEE Congress on Evolutionary Computation (CEC 2007)

19

VXFFHVVIXOO\ UHFRJQL]H WKHVH FRPSOH[ FOXVWHUV :KHQ FRPSDULVRQV DUH PDGH EHWZHHQ 11,& DQG 3(6& WKH DYHUDJHYDOXHRIFOXVWHULQJHUURULQVROYLQJWKH/LQHEOREV /RQJ 6SLUDO DQG 6WLFNV REWDLQHG E\ 11,& DUH ]HUR ,W VKRZVWKDW11,&FDQREWDLQWKHWUXHFOXVWHULQJRQWKHIRXU SUREOHPVLQDOOWKHUXQV7KHUHVXOWVRI3(6&VKRZWKDW 3(6&FDQRQO\REWDLQWKHWUXHFOXVWHULQJRQWKH6SLUDOLQDOO WKHUXQV)XUWKHUPRUHIRUWKH6TXDUHDQG7KUHHFLUFOHV SUREOHPV 11,& GLG D OLWWOH EHWWHU WKDQ 3(6& LQ ERWK WKH FOXVWHULQJ HUURU DQG WKH DGMXVWHG UDQG LQGH[ %XW IRU WKH

6L]H11,&GLGDOLWWOHZRUVHWKDQ3(6& :H DOVR SHUIRUP H[SHULPHQWV RQ WKH 8636 KDQGZULWWHQ GLJLWGDWDVHW>@DQGWKUHHUHDOGDWDVHWVIURP8&,PDFKLQH OHDUQLQJUHSRVLWRU\LH,ULV%UHDVW&DQFHUDQG+HDUW>@ 7KH 8636 GDWDVHW FRQWDLQV   × JUD\ LPDJHV RI KDQGZULWWHQ GLJLWV IRU WUDLQLQJ DQG  IRU WHVWLQJ  7KH WHVW VHW LV WDNHQ DV WKH FOXVWHULQJ GDWD ZH SHUIRUP H[SHULPHQWVUHFRJQL]LQJWKUHHJURXSVRIGLJLWVLHDQG DQG 











 

 

 













 









 











 







D /LQHEOREVE /RQJF 6L]H 























 













 























G 6SLUDOH 6TXDUHI 6WLFNV





     













 * 7KUHHFLUFOHV )LJ7KHGLVWULEXWLRQRIGDWDSRLQWVLQWKHVHYHQDUWLILFLDOGDWDVHWV

 7$%/(3(5)250$1&(&203$5,62162)11,&3(6&*$&$1' .021$57,),&,$/'$7$6(76

3UREOHP OLQHEOREV /RQJ 6L]H 6SLUDO 6TXDUH 6WLFNV 7KUHHFLUFOHV

11,&       

&OXVWHULQJ(UURU 3(6& *$&              

.0       

$GMXVWHG5DQG,QGH[ 11,& 3(6& *$& .0                            

  7KHDYHUDJHYDOXHVRI&OXVWHULQJ(UURUDQG$GMXVWHG5DQG ,QGH[ REWDLQHG E\ 11,& 3(6& *$& DQG .0 RQ WKH VL[ UHDOZRUOGSUREOHPVDUHUHSRUWHGLQ7DEOHIURPZKLFKZH

FDQ VHH WKDW 11,& KDV D GRPLQDQW SHUIRUPDQFH RQ WKHVH UHDOZRUOGGDWDVHWVFRPSDUHGZLWK3(6&*$&DQG.0  

20

2007 IEEE Congress on Evolutionary Computation (CEC 2007)

   7$%/(3(5)250$1&(&203$5,62162)11,&3(6&*$&$1' .0215($/:25/''$7$ 6(76

3UREOHP ,ULV %UHDVW&DQFHU +HDUW    

11,&      

&OXVWHULQJ(UURU 3(6& *$&            

.0      

11,&      

$GMXVWHG5DQG,QGH[ 3(6& *$&            

.0      





)LJ5REXVWQHVVRIWKHFRPSDUHGDOJRULWKPV

 ,QRUGHUWRFRPSDUHWKHUREXVWQHVVRIWKHVHPHWKRGVZH IROORZWKHFULWHULDXVHGE\;*HQJHWDO>@,QGHWDLOWKH UHODWLYHSHUIRUPDQFHRIWKHDOJRULWKPPRQDSDUWLFXODUGDWD VHW LV UHSUHVHQWHG E\ WKH UDWLR EP RI LWV PHDQ YDOXH RI $GMXVWHG 5DQG ,QGH[ 5P DQG WKH KLJKHVW PHDQ YDOXH RI $GMXVWHG5DQG,QGH[DPRQJDOOWKHFRPSDUHGPHWKRGV 5P EP =   PD[ 5N N

7KHEHVWPHWKRGP RQWKDWGDWDVHWKDVEP  DQGDOOWKH RWKHU PHWKRGV KDYH EP”  7KH ODUJHU WKH YDOXH RI EP WKH EHWWHUWKHSHUIRUPDQFHRIWKHPHWKRGPLVLQUHODWLRQWRWKH EHVWSHUIRUPDQFHRQWKDWGDWDVHW7KXVWKHVXPRIEPRYHUDOO GDWDVHWVSURYLGHVDJRRGPHDVXUHPHQWRIWKHUREXVWQHVVRI WKH PHWKRG P $ ODUJH YDOXH RI WKH VXP LQGLFDWHV JRRG UREXVWQHVV )LJVKRZVWKHGLVWULEXWLRQRIEPRIHDFKPHWKRGRYHUWKH GDWDVHWV)RUHDFKPHWKRGWKHYDOXHVRIEPDUHVWDFNHG DQGWKHVXPLVJLYHQRQWRSRIWKHVWDFN)LJUHYHDOVWKDW 11,& KDV WKH KLJKHVW VXP YDOXH ,Q IDFW WKH EP YDOXHV RI 11,&DUHHTXDORUYHU\FORVHWRRQDOOWKHGDWDVHWVZKLFK GHQRWHV 11,& SHUIRUPV YHU\ ZHOO LQ GLIIHUHQW VLWXDWLRQV 7KHUHIRUH 11,& LV WKH PRVW UREXVW PHWKRG DPRQJ WKH FRPSDUHGPHWKRGV 9 &21&/8',1*5(0$5.6 ,QWKLVVWXG\ZHLQWURGXFHGWKH1RQGRPLQDWHG1HLJKERU

,PPXQH $OJRULWKP WR VROYH WKH PXOLREMHFWLYH FOXVWHULQJ SUREOHPV,QRUGHUWRYDOLGDWHWKHFOXVWHULQJSHUIRUPDQFHRI WKH 11,$ EDVHG FOXVWHULQJ PHWKRG ZH PDGH WKH H[SHULPHQWDO VWXG\ RQ VHYHQ DUWLILFLDO GDWDVHWV DQG VL[ UHDOZRUOG SUREOHPV 7KH UHVXOWV ZHUH FRPSDUHG ZLWK WKH 3(6$,, EDVHG FOXVWHULQJ PHWKRG WKH JHQHWLF DOJRULWKPEDVHG FOXVWHULQJ WHFKQLTXH DQG WKH .0HDQV DOJRULWKP7KHH[SHULPHQWDOUHVXOWVRIWZRFOXVWHULQJTXDOLW\ PHWULFVWKH$GMXVWHG5DQG,QGH[DQGWKH&OXVWHULQJ(UURU VKRZHGWKDWWKH11,$ZDVDQHIIHFWLYHDOJRULWKPIRUVROYLQJ PXOWLREMHFWLYH FOXVWHULQJ SUREOHPV DQG WKH 11,$ EDVHG PXOWLREMHFWLYH FOXVWHULQJ WHFKQLTXH ZDV D FRJHQW XQVXSHUYLVHGOHDUQLQJPHWKRG 5()(5(1&(6  >@ >@

>@

>@

7KRPDV %lFN +DQV3DXO 6FKZHIHO $Q RYHUYLHZ RI HYROXWLRQDU\ DOJRULWKPV IRU SDUDPHWHU RSWLPL]DWLRQ (YROXWLRQDU\ &RPSXWDWLRQ 9RO1R 6DQ\RX @

>@

>@

>@ >@ >@ >@ >@

>@ >@

>@ >@

>@ >@

>@

>@

>@ >@

>@

22

8 0DXOLN 6 %DQG\RSDGK\D\ *HQHWLF DOJRULWKPEDVHG FOXVWHULQJ WHFKQLTXH3DWWHUQ5HFRJQLWLRQ9RO1R /LFKHQJ -LDR -LQJ /LX :HLFDL =KRQJ $Q 2UJDQL]DWLRQDO &RHYROXWLRQDU\ $OJRULWKP IRU&ODVVLILFDWLRQ,(((7UDQVDFWLRQV RQ (YROXWLRQDU\&RPSXWDWLRQ9RO1R 6KXGH =KRX =HQJTL 6XQ $ 1HZ $SSURDFK %HORQJLQJ WR ('$V 4XDQWXP,QVSLUHG*HQHWLF$OJRULWKPZLWK2QO\2QH&KURPRVRPH ,Q SURFHHGLQJV RI WKH )LUVW ,QWHUQDWLRQDO &RQIHUHQFH RQ QDWXUDO FRPSXWDWLRQ ,&1&  6SULQJHU9HUODJ /HFWXUH 1RWHV LQ &RPSXWHU6FLHQFH9RO 'RQJ;LDR 1LX %R =KDQJ 0LDQ ;LQJ $SSOLFDWLRQ RI 1HXUDO 1HWZRUN%DVHGRQ3DUWLFOH6ZDUP2SWLPL]DWLRQLQ6KRUW7HUP/RDG )RUHFDVWLQJ ,Q SURFHHGLQJV RI WKH ,QWHUQDWLRQDO 6\PSRVLXP RQ 1HXUDO 1HWZRUNV ,611  6SULQJHU9HUODJ /HFWXUH 1RWHV LQ &RPSXWHU6FLHQFH9RO 0DRJXR*RQJ+DLIHQJ'X/LFKHQJ-LDR2SWLPDODSSUR[LPDWLRQRI OLQHDU V\VWHPV E\ DUWLILFLDO LPPXQH UHVSRQVH 6FLHQFH LQ &KLQD 6HULHV),QIRUPDWLRQ6FLHQFHV6FLHQFHLQ&KLQD3UHVVFRSXEOLVKHG ZLWK6SULQJHU9HUODJ*PE+9RO1R± /2 +DOO ,% 2]\XUW -& %H]GHN &OXVWHULQJ ZLWK D JHQHWLFDOO\ RSWLPL]HG DSSURDFK ,((( 7UDQVDFWLRQV RQ (YROXWLRQDU\ &RPSXWDWLRQ9RO1R - +DQGO - .QRZOHV $Q HYROXWLRQDU\ DSSURDFK WR PXOWLREMHFWLYH FOXVWHULQJ,(((7UDQVDFWLRQVRQ(YROXWLRQDU\&RPSXWDWLRQ9RO 1R -$+DUWLJDQ0$:RQJ$.0HDQVFOXVWHULQJDOJRULWKP$SSOLHG 6WDWLVWLFV9RO .'HE0XOWLREMHFWLYHRSWLPL]DWLRQXVLQJ(YROXWLRQDU\DOJRULWKPV -RKQ:LOH\ 6RQV&KLFKHVWHU8. & 'LQJ ; +H .QHDUHVWQHLJKERU FRQVLVWHQF\ LQ GDWD FOXVWHULQJ LQFRUSRUDWLQJ ORFDO LQIRUPDWLRQ LQWR JOREDO RSWLPL]DWLRQ ,Q SURFHHGLQJV RIWKH$&06\PSRVLXP RQ $SSOLHG&RPSXWLQJ $&03UHVV1HZ@ >@ >@ >@ >@ >@ >@ >@ >@

>@

>@

2SWLPL]DWLRQDQG&RQWUROZLWK$SSOLFDWLRQVWR,QGXVWULDO3UREOHPV $WKHQV*UHHFH &XWHOOR 9 1DU]LVL * 1LFRVLD * $ &ODVV RI 3DUHWR $UFKLYHG (YROXWLRQ6WUDWHJ\$OJRULWKPVXVLQJ,PPXQHLQVSLUHG2SHUDWRUVIRU $E,QLWLR 3URWHLQ 6WUXFWXUH 3UHGLFWLRQ ,Q WKH 7KLUG (XURSHDQ :RUNVKRS RQ (YROXWLRQDU\ &RPSXWDWLRQ DQG %LRLQIRUPDWLFV /DXVDQQH 6ZLW]HUODQG /HFWXUH 1RWHV LQ &RPSXWHU 6FLHQFH 9RO  .QRZOHV-'&RUQH':$SSUR[LPDWLQJWKH1RQGRPLQDWHG)URQW 8VLQJ WKH 3DUHWR $UFKLYHG (YROXWLRQ 6WUDWHJ\ (YROXWLRQDU\ &RPSXWDWLRQ9RO1R 'HE . 3UDWDS $ $JDUZDO 6 0H\DULYDQ 7 $ )DVW DQG (OLWLVW 0XOWLREMHFWLYH*HQHWLF$OJRULWKP16*$,,,(((7UDQVDFWLRQVRQ (YROXWLRQDU\&RPSXWDWLRQ9RO1R +XEHUW $ &RPSDULQJ SDUWLWLRQV -RXUQDO RI &ODVVLILFDWLRQ 9RO   5DQG:2EMHFWLYHFULWHULDIRUWKHHYDOXDWLRQRIFOXVWHULQJPHWKRGV -RXUQDO RI WKH $PHULFDQ 6WDWLVWLFDO $VVRFLDWLRQ 9RO  1R   /LQJ :DQJ /LHIHQJ %R /LFKHQJ -LDR $ PRGLILHG .0HDQV FOXVWHULQJ ZLWK D GHQVLW\VHQVLWLYH GLVWDQFH PHWULF 56.7  /HFWXUH1RWHVLQ&RPSXWHU6FLHQFH9RO +DQGO-.QRZOHV-.HOO'%&RPSXWDWLRQDOFOXVWHUYDOLGDWLRQLQ SRVWJHQRPLFGDWDDQDO\VLV%LRLQIRUPDWLFV 9RO1R  /H&XQ