( )i A Parametric Study on Differential Evolution Based on Benchmark ...

 

$3DUDPHWULF6WXG\RQ'LIIHUHQWLDO(YROXWLRQ%DVHGRQ%HQFKPDUN (OHFWURPDJQHWLF,QYHUVH6FDWWHULQJ3UREOHP $Q\RQJ 4LQJ6HQLRU0HPEHU,((( 

$EVWUDFW²(OHFWURPDJQHWLF LQYHUVH VFDWWHULQJ SUREOHP LV RI JUHDW VFLHQWLILF DQG HQJLQHHULQJ LPSRUWDQFH 'LIIHUHQWLDO HYROXWLRQKDVEHHQVXFFHVVIXOO\DSSOLHGWRVROYHHOHFWURPDJQHWLF LQYHUVH VFDWWHULQJ SUREOHP  +RZHYHU LW LV QRWHG WKDW WKH SHUIRUPDQFH RI GLIIHUHQWLDO HYROXWLRQ VWURQJO\ GHSHQGV RQ LWV LQWULQVLFFRQWUROSDUDPHWHUVQDPHO\SRSXODWLRQVL]HPXWDWLRQ LQWHQVLW\ DQG FURVVRYHU SUREDELOLW\ $ SDUDPHWULF VWXG\ RQ GLIIHUHQWLDO HYROXWLRQ EDVHG RQ EHQFKPDUN HOHFWURPDJQHWLF LQYHUVH VFDWWHULQJ SUREOHP LV WKHUHIRUH FDUULHG RXW 7KH ILQGLQJV SUHVHQWHG KHUH VKRXOG EH KLJKO\ EHQHILFLDO WR IXWXUH DSSOLFDQWV RI GLIIHUHQWLDO HYROXWLRQ LQ WKH FRPPXQLW\ RI HOHFWURPDJQHWLFLQYHUVHVFDWWHULQJSUREOHPV6XFKILQGLQJVPD\ EH GLUHFWO\ RU LQGLUHFWO\ DSSOLFDEOH WR UHVHDUFKHUV LQ RWKHU DUHDV

, ,1752'8&7,21

(

/(&7520$*1(7,&LQYHUVHVFDWWHULQJSUREOHP>@DLPV WRUHFRYHULQIRUPDWLRQRQVRPHLQDFFHVVLEOHUHJLRQIURP WKHVFDWWHUHGHOHFWURPDJQHWLFILHOGVPHDVXUHGLQWKHH[WHULRU UHJLRQ ,W DWWUDFWV PXFK DWWHQWLRQ GXH WR LWV DSSDUHQW DQG VLJQLILFDQW HQJLQHHULQJ YDOXHV ,W KDV EHHQ ZLGHO\ XVHG LQ VFLHQWLILF PLOLWDU\ PHGLFDO LQGXVWULDO DJULFXOWXUDO DQG PDQ\ RWKHU FLYLO DUHDV 7KH SDVW WZR GHFDGHV ZLWQHVVHV DQ H[SORVLRQLQWKHVWXG\ RIHOHFWURPDJQHWLFLQYHUVHVFDWWHULQJ SUREOHPV (OHFWURPDJQHWLF LQYHUVH VFDWWHULQJ SUREOHP LV PDWKHPDWLFDOO\ YHU\ GLIILFXOW WR VROYH GXH WR LWV LOO SRVHGQHVV QRQOLQHDULW\ DQG YDULHW\ ,W LV LQ QDWXUH DQ RSWLPL]DWLRQ SUREOHP ,Q UHFHQW \HDUV DSSOLFDWLRQ RI VWRFKDVWLF RSWLPL]HUV WR HOHFWURPDJQHWLF LQYHUVH VFDWWHULQJ SUREOHP KDV JDLQHG SRSXODULW\ LQ WKLV FRPPXQLW\ >@>@>@>@>@ 'LIIHUHQWLDO HYROXWLRQ >@ LV D YHU\ VLPSOH EXW YHU\ SRZHUIXO VWRFKDVWLF RSWLPL]HU ,W KDV SURYHQ WR EH D YHU\ JRRGWRRO IRUIXQFWLRQRSWLPL]DWLRQDQGKDVEHHQDSSOLHGWR VROYHPDQ\RWKHUVFLHQWLILFDQGHQJLQHHULQJSUREOHPV ,Q  GLIIHUHQWLDO HYROXWLRQ ZDV DSSOLHG WR VROYH D VLPSOH HOHFWURPDJQHWLF LQYHUVH VFDWWHULQJ SUREOHP LH HOHFWURPDJQHWLF LPDJLQJ RI FLUFXODUF\OLQGULFDO FRQGXFWRUV DQG WXQQHOV >@ /DWHU LQ  GLIIHUHQWLDO HYROXWLRQ ZDV DSSOLHG WR VROYH EHQFKPDUN HOHFWURPDJQHWLF LQYHUVH VFDWWHULQJ SUREOHP >@ ,Q  G\QDPLF GLIIHUHQWLDO HYROXWLRQ ZDV GHYHORSHG DQG DSSOLHG WR VROYH EHQFKPDUN HOHFWURPDJQHWLFLQYHUVHVFDWWHULQJSUREOHP>@ 0RVW VWUDWHJLHV RI GLIIHUHQWLDO HYROXWLRQ KDYH WKUHH

 0DQXVFULSWUHFHLYHG0DUFK $ 4LQJ LV ZLWK WKH 7HPDVHN /DERUDWRULHV 1DWLRQDO 8QLYHUVLW\ RI 6LQJDSRUH  6SRUWV 'ULYH  6LQJDSRUH  SKRQH  ID[HPDLOWVOTD\#QXVHGXVJ 

LQWULQVLF FRQWURO SDUDPHWHUV QDPHO\ SRSXODWLRQ VL]H PXWDWLRQLQWHQVLW\DQGFURVVRYHUSUREDELOLW\,WLVQRWHGWKDW WKH SHUIRUPDQFH RI GLIIHUHQWLDO HYROXWLRQ GHSHQGV VWURQJO\ RQ LWV LQWULQVLF FRQWURO SDUDPHWHUV ,QDSSURSULDWH LQWULQVLF FRQWURO SDUDPHWHUV PD\ VLJQLILFDQWO\ LQFUHDVH WKH FRPSXWDWLRQDOWLPHRUHQFRXQWHUIDLOXUH 7RWKHEHVWRIWKLVDXWKRU¶VNQRZOHGJHQRFRPSUHKHQVLYH SDUDPHWULF VWXG\ RQ GLIIHUHQWLDO HYROXWLRQ KDV EHHQ FRQGXFWHG +RZHYHU WKHUH H[LVWHG VRPH FDVH VWXGLHV RQ LQWULQVLF FRQWURO SDUDPHWHUV RI GLIIHUHQWLDO HYROXWLRQ >@>@>@>@ ,Q WKHVH FDVH VWXGLHV RQH WZR RU WKUHH RI WKH WKUHH LQWULQVLF FRQWURO SDUDPHWHUV DUH IL[HG )LQGLQJV UHSRUWHGLQWKHVHFDVHVWXGLHVDUHTXLWHGLYHUVHLQFRQVLVWHQW RUHYHQFRQWUDGLFWRU\ (OHFWURPDJQHWLF LQYHUVH VFDWWHULQJ SUREOHP LV FRPSXWDWLRQDOO\ YHU\H[SHQVLYH $V VXFKRSWLPDOLQWULQVLF FRQWUROSDUDPHWHUV IRU GLIIHUHQWLDO HYROXWLRQDUH GHVSHUDWHO\ QHHGHGLQRUGHUWRUHFRQVWUXFWREMHFWSURILOHVXFFHVVIXOO\DQG VWDEO\LQWKHVKRUWHVWWLPH 7R FRQYHQLHQW IXWXUH DSSOLFDQWV RI GLIIHUHQWLDO HYROXWLRQ LQ WKH VHOHFWLRQ RI DSSURSULDWH LQWULQVLF FRQWURO SDUDPHWHUV IRU WKHLU HOHFWURPDJQHWLF LQYHUVH VFDWWHULQJ SUREOHP D FRPSUHKHQVLYH SDUDPHWULF VWXG\ RQ GLIIHUHQWLDO HYROXWLRQ LV LQLWLDWHGLQ7KHVWXG\LVEDVHGRQDWHVWEHGLQFOXGLQJ EHQFKPDUNHOHFWURPDJQHWLFLQYHUVHVFDWWHULQJSUREOHP'XH WRWKHFRPSOHWHQHVV RIWKHVWXGLHGFDVHV RILQWULQVLFFRQWURO SDUDPHWHUVWKHILQGLQJVSUHVHQWHGDUHUHOLDEOHDQGVKRXOGEH KLJKO\EHQHILFLDOWRIXWXUHGLIIHUHQWLDOHYROXWLRQDSSOLFDQWVLQ WKH FRPPXQLW\ RI HOHFWURPDJQHWLF LQYHUVH VFDWWHULQJ SUREOHP ,, %(1&+0$5.(/(&7520$*1(7,&,19(56(6&$77(5,1* 352%/(0 $ &RQILJXUDWLRQ 7KHJHRPHWU\RIWKHSUREOHPLVGUDZQLQ)LJZKHUH2 LV WKH RULJLQ Ω D FLUFOH RI UDGLXV 5PHDV LV WKH PHDVXULQJ GDWD  GRPDLQ LQ ZKLFK WKH VFDWWHUHG HOHFWULF ILHOGV DUH PHDVXUHG WKH EODFN GRWV RQ Ω DUH UHFHLYHUV ' LV WKH LPDJLQJ REMHFW  GRPDLQ ZKLFK LV XVXDOO\ FKRVHQ WR EH FLUFXODURUUHFWDQJXODU7KHREMHFWVWREHUHFRQVWUXFWHGDUH. SHUIHFWO\ FRQGXFWLQJ F\OLQGHUV ZLWKLQ ' 2LGL ψL  LV WKH ORFDORULJLQRIWKHLWKF\OLQGHUZKLFKFDQEHDQ\SRLQWZLWKLQ WKH F\OLQGHU FRQWRXU &L 7KH FRQWRXU LV UHSUHVHQWHG E\ D ORFDO VKDSH IXQFWLRQ ρL )LθL  LQ WKH ORFDO SRODU FRRUGLQDWH V\VWHP,QRXUSUDFWLFHLWLVDSSUR[LPDWHGE\DFORVHGFXELF %VSOLQHORFDOVKDSHIXQFWLRQ>@ )L

1904 c 1-4244-1340-0/07/$25.00 2007 IEEE

%

(θ L ) ZLWK1FRQWURO

  SRLQWV&LM≤M≤1

RUGHU (

Ω

'

2

θ

ψ2

G

2 θ G

1 I ×1D ×1U



VFDW  ( VFDW PHDV M −  ( VLPXO M

1 I ×1D ×1U

¦

 ( VFDW PHDV M

+



 

¦ ³ ) (θ )8 [) (θ ) − ρ (θ )]Gθ ZKHUH [ = [[ " [ . ]  LV WKH YHFWRU RI RSWLPL]DWLRQ SDUDPHWHUV [L = [GL ψ L &L  " &L1 − ]  LV WKH VXE .

α¦

.

L

L

M

M

LM

M

L

L = M = M ≠ L & L

G. θ 2

VFDW

YHFWRUIRUWKHJHRPHWULFDOSDUDPHWHUVRIF\OLQGHUL ( VLPXO LV

ϕLQF

DQ 1 I × 1 D × 1 U GLPHQVLRQDO YHFWRU IRU WKH VFDWWHUHG 

7UDQVYHUVH0DJQHWLF70 LQFLGHQWILHOGLVDVVXPHGWLPH IDFWRURI H

(

M =

M =

)LJ   *HRPHWU\ RI %HQFKPDUN (OHFWURPDJQHWLF ,QYHUVH 6FDWWHULQJ 3UREOHP

LQF

¦

I [ =

−ψΚ

K ( LQF 

(U ) = ]Ö(]VFDW (U ) LVWKHVFDWWHUHGHOHFWULFILHOG

& 2EMHFWLYH)XQFWLRQ 7KH IROORZLQJ REMHFWLYH IXQFWLRQ LV GHILQHG WR FDVW WKH EHQFKPDUN HOHFWURPDJQHWLF LQYHUVH VFDWWHULQJ SUREOHP LQWR DQRSWLPL]DWLRQSUREOHP

2 ψ1

5PHDV

VFDW

MωW

DVVXPHGDQGVXSSUHVVHG 

(U ) = ]Ö(]LQF (U ) = ]Ö H[S(− MNNÖ ⋅ U )

 

ZKHUH U = [[Ö + \\Ö  N ωF LV WKH ZDYH QXPEHU LQ IUHH

HOHFWULFILHOGVVLPXODWHGZLWKWKHODWHVWUHFRQVWUXFWLRQUHVXOWV RIF\OLQGHUORFDWLRQV2L DQGORFDOVKDSHIXQFWLRQV)L αLVWKH LQWHQVLW\ RI SHQDOW\ LPSRVHG RQ LQIHDVLEOH UHFRQVWUXFWLRQ UHVXOWVZLWKLQWHUVHFWLQJF\OLQGHUVDVVKRZQLQ)LJ

­ W <   8 (W ) = ® ¯ W ≥  

\

VSDFH ω πI LV WKH DQJXODU IUHTXHQF\ F LV WKH YHORFLW\ RI

 

LQF LQF OLJKW NÖ = FRV ϕ [Ö + VLQ ϕ \Ö  LV WKH LQFLGHQW ZDYH XQLW

ρM

YHFWRU DQG ϕLQF LV WKH LQFLGHQW DQJOH [Ö  \Ö  DQG ]  DUH WKH XQLWYHFWRUVLQWKH[\DQG]GLUHFWLRQVUHVSHFWLYHO\

ρLM

% ,QYHUVH3UREOHP 7KH LQYHUVH SUREOHP LV WR ORFDWH WKH XQNQRZQ F\OLQGHUV DQG UHFRQVWUXFW WKH F\OLQGHU FRQWRXUV JLYHQ WKH VFDWWHUHG

ρL θM

VFDW

HOHFWULF ILHOGV PHDVXUHG RQ Ω ( PHDV U ∈ Ω  ,Q SUDFWLFH

( VFDW PHDV LVPHDVXUHGDWDILQLWHQXPEHURIIUHTXHQFLHV1I DQG

2M

θL

ψM

2L

D ILQLWHQXPEHU RI LQFLGHQW SODQH ZDYH GLUHFWLRQV 1D  E\ D VFDW

ILQLWH QXPEHU RI UHFHLYHUV 1U  $FFRUGLQJO\ ( PHDV  EHFRPHVDQ1I×1D×1UGLPHQVLRQDOYHFWRU 7KH REMHFW DQG GDWD HTXDWLRQV RI WKH HOHFWURPDJQHWLF LQYHUVHVFDWWHULQJSUREOHPDUH .

.

(]LQF (U ) = ¦ ωμ  ³ - ]L (U′)+   (N U − U′ )GU′ U ∈ * &L  L =

L =

&L



  .

( ]VFDW (U ) = ¦ − ωμ  ³ - ]L (U′)+   (N U − U ′ )GU′  L =

 

&L

ZKHUH - L (U ) = ]Ö- ]L (U )  ≤L≤. LV WKH LQGXFHG VXUIDFH WK

HOHFWULF FXUUHQW GHQVLW\ RQ WKH VXUIDFH RI WKH L  F\OLQGHU

+ ( ) (⋅)  LV WKH +DQNHO¶V IXQFWLRQ RI VHFRQG NLQG RI ]HURWK

2

ψL

)LJ,QWHUVHFWLRQRI&\OLQGHUV

[



7KH ILUVW WHUP RI WKH REMHFWLYH IXQFWLRQ JLYHV D PHDVXUHPHQW RQ KRZ FORVH WKH UHFRQVWUXFWLRQ UHVXOWV DSSURDFK WKH WUXH SURILOH ZKLOH WKH VHFRQG WHUP LV DQ DUWLILFLDO SHQDOW\ DSSOLHG RQO\ LQ WKH FDVH RI LQWHUVHFWLQJ F\OLQGHUV ,QWKLVVWXG\αLVHPSLULFDOO\FKRVHQWREHDFFRUGLQJ WRWKHDXWKRU¶VH[SHULHQFH ' 6HWWLQJV 7KH VHWWLQJV LQ >@ DUH IROORZHG KHUH XQOHVV VSHFLILHG RWKHUZLVH7KHLQFLGHQWILHOGLVDW0+]RUHTXLYDOHQWO\ λ P,WLOOXPLQDWHVWKHXQNQRZQREMHFWIURPHLJKWDQJOHV

2007 IEEE Congress on Evolutionary Computation (CEC 2007)

1905

  LH ϕLQF Lπ ≤L≤ 5PHDV λ  UHFHLYHUV DUH ORFDWHG XQLIRUPO\ RQ Ω WR UHFRUG WKH VFDWWHUHG ILHOGV GXH WR HDFK LQFLGHQW SODQH ZDYH GLUHFWLRQ 1R QRLVH LV LQFOXGHG LQ WKH V\QWKHWLF GDWD  FRQWURO SRLQWV DUH XVHG IRU HDFK FORVHG FXELF%VSOLQHORFDOVKDSHIXQFWLRQ7KHVHDUFKUDQJHRIWKH FRQWURO SRLQWVLV >@λ7KH ORFDO RULJLQV DUH VHDUFKHG LQ D FLUFOHRIUDGLXVλFHQWHUHGDWWKHRULJLQ,QDGGLWLRQIRUWKH FRQYHQLHQFH RI WKH SDUDPHWULF VWXG\ WKH QXPEHU RI F\OLQGHUVLVDVVXPHGWREHH[DFWO\NQRZQLQDGYDQFH 7KUHHSURILOHVDUHVWXGLHG  $6LQJOH&LUFXODU&\OLQGHUF\OLQGHUUDGLXVλG  ψ  R   'RXEOH&LUFXODU&\OLQGHUF\OLQGHUUDGLLλG λ ψ RG λψ R  7ULSOH&LUFXODU &\OLQGHU F\OLQGHUUDGLL λG λ ψ RG λψ RG λψ R ,,,

3$5$0(75,&678'@ 6 &DRUVL $ 0DVVD 0 3DVWRULQR 0 5DIIHWWR DQG $ 5DQGD]]R ³'HWHFWLRQ RI EXULHG LQKRPRJHQHRXV HOOLSWLF F\OLQGHUV E\ D PHPHWLF DOJRULWKP´ ,((( 7UDQV $QWHQQDV 3URSDJDW YRO  QR  SS 2FW >@ .93ULFH506WRUQDQG-$/DPSLQHQ'LIIHUHQWLDO(YROXWLRQ$ 3UDFWLFDO$SSURDFKWR*OREDO2SWLPL]DWLRQ %HUOLQ6SULQJHU >@ . $ 0LFKDOVNL ³(OHFWURPDJQHWLF LPDJLQJ RI FLUOXODUF\OLQGULFDO FRQGXFWRUV DQG WXQQHOV XVLQJ D GLIIHUHQWLDO HYROXWLRQ DOJRULWKP´ 0LFURZDYH 2SWLFDO 7HFKQRORJ\ /HWWHUV  YRO  QR  SS   >@ $ 4LQJ ³(OHFWURPDJQHWLF LQYHUVH VFDWWHULQJ RI PXOWLSOH WZR GLPHQVLRQDOSHUIHFWO\FRQGXFWLQJREMHFWVE\WKHGLIIHUHQWLDOHYROXWLRQ VWUDWHJ\´ ,((( 7UDQV$QWHQQDV3URSDJDW YRO QR SS  >@ $4LQJ³'\QDPLFGLIIHUHQWLDOHYROXWLRQ VWUDWHJ\DQGDSSOLFDWLRQVLQ HOHFWURPDJQHWLF LQYHUVH VFDWWHULQJ SUREOHPV´,((( 7UDQV *HRVFL 5HPRWH6HQVYROQRSS >@ 5 *lPSHUOH 6 ' 0OOHU DQG 3 .RXPRXWVDNRV ³$ SDUDPHWULF VWXG\ IRU GLIIHUHQWLDO HYROXWLRQ´  UG :6($6 ,QW &RQI 1HXUDO 1HWZRUN$SSOLFDWLRQV,QWHUODNHQ6ZLW]HUODQG)HEUXDU\ SDSHUQR >@ - /LX DQG - /DPSLQHQ ³2Q VHWWLQJ WKH FRQWURO SDUDPHWHU RI WKH GLIIHUHQWLDO HYROXWLRQ PHWKRG´ WK ,QW &RQI 6RIW &RPSXWLQJ 0(1'(/ %UQR&]HFK5HSXEOLF-XQHSS >@ ' =DKDULH ³&ULWLFDO YDOXHV IRU WKH FRQWURO SDUDPHWHUV RI GLIIHUHQWLDO HYROXWLRQ DOJRULWKPV´ WK ,QW &RQI 6RIW &RPSXWLQJ 0(1'(/  %UQR&]HFK5HSXEOLF-XQHSS >@ $ 4LQJ ³0LFURZDYH LPDJLQJ RI SDUDOOHO SHUIHFWO\ FRQGXFWLQJ F\OLQGHUV ZLWK WUDQVYHUVH HOHFWULF VFDWWHULQJ GDWD´ - (OHFWURPDJ :DYHV$SSOLYROQRSS

$&.12:/('*0(17 7KLV DXWKRU ZRXOG OLNH WR WKDQN - $ /DPSLQHQ . 9 3ULFH(3$GRULRDQG.(3DUVRSRXORVIRUWKHLUYDOXDEOH KHOS 7KLVDXWKRUZRXOGDOVROLNHWRWKDQN3URI;