LSTM Recurrent Networks Learn Simple Context Free and ... - Idsia




 

 !"#
%$'& ()* +,-/.%0%1 !"2 +34,5/.%6
-$7-$78 !9;: ;!A@CBEDGF HJIK>MLON PRS Q LUTV>AWXZYO[]\^BC_`[ S?a >ML bVcVdfehgVijeMkjlVeMmonqphr sutfcuv'wxcuyfifeMkjlVeAmznqphr {}|5~'{}#€‚-ƒu„…„‡†OˆŠ‰‡ƒŒ‹V€juŽ7‹u#^ƒu‘x‘x’j€f~'“”‰–•Š—O†˜ˆ™„EƒA‘fš`€V›'›*› nœeMkjl'eAmonqphr

 ž Ÿ˜¡O¢M£x¤u¡ ¹¬†OˆŠ¯º¥oˆ™†˜¦'‰…†˜’7¯K§f’7¨`ˆ™“²G’uˆŠ»¼¶¬©ª~V’7¹”‘#¾„‡†˜½ªƒuˆ™’7‘x§V‰‡‘x•™±‚«ª†Oˆ™ˆ™†˜®C«u’u§xˆŠ¯¿„EƒA¨Àˆ¬„‡•ŠƒuˆŠ‘xƒ7«ušV§f‰–•Šƒu‰…’7«u‘f†­¨?ƒA„ ®CˆŠˆŠ’u†˜¯;´U§f†Uˆ™°VˆŠ†O†O‘*¯Œ•ª±x‘f„EƒA†OˆŠ§x²5ˆqƒA•™„ ˆqƒA‘x‰‡†U‘x•}‰‡“‘x«ª’uˆŠ¨™©V†˜¨#³*§x»¼ÁÀ†˜‘fÂôU†­Âª¨ ¨q¨™½UµxÄ’MÅÀ“†˜†˜ˆ™š5†K•Š“ƵfƒM†Œ•RšV¶`†˜’7¯K‘x’7«5‘f~'¨¸µf•™ˆq’uƒMˆ™•™•¸† · ¶ »¼ÁÀ~VÂù”ªG¨ŠÇ ½U¨€¬¨™ƒu§x‘f±jšAY LULU>AWjéGW?> S LOêV@ŒW?>Mé™ëªìVLUíZNMîŒ@ÔìxW?TNU[?ìVLOéqï}éœ>MLO\ð\>A\ìVLUñVîŒYhìxWjéœ>hD‚éóòÖLU>M>@CêVW?T S ê'TV>ANMîKYhìxWjéœ>hDZé Nœ>AW`NOBÔéUBÔôV>õ@CêVW?T S ê'TV>ANMH S ö ÷`øŒù úRûõü^ýþùRÿUûÈø ç>AY S LULU>AWjé×W`> S LOêV@‚W?>Mé¸ë5ìVLUíZ
N ÊçÈN zê'LU>-LU>A\¾ê'LUí*ê a @ÔñõTV>AW?>MLOêV@ZNœ>  S >AW`Yh > `LOì‚Yh>ANUNOBCW?TŒ_?>Mô‚B Yh>A N }X?BÔ>MTV>A@C\^êVW` W  X‚ìxWjéUê'T?î W `LOB W`YMB ]@Ô>éU[?>Mñõê'LU>5ê  ]@CB YMê @Ô>”éœì#éUêVNUí‚N >MñVìxW`_õéU[`>ÃLU>AêVY˜[ ìVò KBC_`_?>AW ê'LUíVì7ô ì‚_?>A@ N 4N zìVL_`B NUYhLU>Méœ>

 ˜H q NœñZ\ a ìx@CB Y TVLOêV\¾\^ê'Lõ@Ô>Aê'LOW`B W?TM>Vî "$# XZê'í'ê'í‚B a ê'LOêZî &% ˜H=?ìVL BCW`NUéUêVW`Yh>Vî S W`@CBCíV>'ç 'KNMî aYhìxìVWjéUôV[>MñV>A(_ ñNêVéUW`[?_>X`NUBI,M>oFKìVò5Néœê'>ALU\ >5 J@ BCìV\^LOBÔêVéœ@×>A_Œ_?>Aéœ@CìŒêuñ‚_`N BCNUYhLO>M>Mé¸éœë5>ª>MNœ>AéUWê'éœLU>1>AN)@C>M ]ô*êVêVYhWj>AéŒNAH+>M*KôV>AW`Wf@CéUBÔíV-N >5Ö>VçH T?HÔÈîÆBCNAW4îLO[j(ñjéU[`N\¾é¸BCñ$.Y ] ¬BCYMê'êVéœ@éœ@Ô>Mñ¿LOW`BÔTxN W?˜ìVHLUFÈ>5@ÔBCéUW?[`òÖìVì LO\^Tx[,ê'éUéUBÔìx[?W > a a S  _`>ANUBÔTxW?>ML×Yhì S @C_BCW ]LOBCW`YMB ¬@Ô>”_?>AêV@‚ë#BÔéU[ ê'/]W`BCéœ>ÃNœ>Mé×ìVò`éUBC\>5_?>A@Cêuñ‚N a >Mé¸ë5>M>AW  ìxNONUB a @Ô>”ì a Nœ>MLUô'ê'éUBÔìxW`N a ñ _`>MôVìVéUBCW?T ê^Nœ0> ¬ê'LOê'éœ> BCWjéœ>MLOW`êV@RNœéUê'éœ>/ò¼ìVL#>AêVYO[  ìxNONUB a @Ô>Œ_?>A@CêuñVî]BCW9TV>AW?>ML˜êV@RéU[`BCN-ë5ì S @C_ a >õY S \ a >MLONœìx\>õêVW`_BCW?0> 1¾YMBÔ>AWjéM2H *KW`@CBÔíV> çKNMî#X`IoFKN^YMêVW`W`ìVéAêV@1ë5>A@C@1ëÈBÔéU[ W?ìxBCNUñBCW3 S éNœ> S >AW`Yh>AN54ŒN a ìVL˜W?>6875LOBCNOYhìj>Vî &% ˜H çÈNAî5[?ì7ëª>MôV>MLuî J>MLUòÖìVLO\ÍTVL˜êV_`BÔ>AWjéK_?>ANOYh>AWféõBCW ê"ôV>MLUñóTV>AW?>ML˜êV@ îzYhìxWféUB W S ì S NK9N ]êVYh>ìV:ò JìVéœ>AWféUB êV@C@ÔñóW?ìxBCNU>hï}LU>ANUBCNœéUêVWjéŒêV@ÔTVìVLOBÔéU[`\¾NMî S NUBCW?T _`BCNUéœLOB a]S éœ>A_¾BCWféœ>ML˜W`êV@]\>A\^ìVLOBÔ>ANªò¼ìVL-\^ê  ]B W?TõLU>AêV@Eï}ô'êV@ S >A_"BC3W S éÀNœ>  S >AW`Yh>AN5éœìLU>AêV@Eï}ô'êV@ S >A_^ì S )é S éªNU>  S >AW]Yh>AN ÊW`ìxBCNœ> éœ>AW`_`NÀéœì/\^ê'íV>K@Ô>Aê'LOW`BCW`TŒ[]ê'LO_?>MLÀéU[?ì S Tx$[ ; Yhìx\ ]ê'LO>Vîf>VH T?HÔ3î êVêVNUN5êVW`A=W > ˜î 4êVêVNUN5êVW`_Aê'LO@ \ éœéœ>MLuî A 9[`êuôV> >M>ABW ]@Cê'T >A_ ñèê \^Dê CqìVEL `L˜êVYhéUBCYMêV@ `LUì a @Ô>AG \ FRéU[?>ªTVLOêV_`BÔ>AWjéoìVò?éU[?>ªéœìVéUêV@‚ì S )é S éÆ>MLULUìVLoëÈBÔéU[õLU>A9N S  >AYhéÆéœì `LO>Mô‚BÔì S NoBC3W a S éUHN  S BCYUíZ@ÔS ñKô*êVW]a BCNU[?>ANÆêVNoéU[?>ªéUBC\>5@Cê'TxN a >Mé¸XZë5YO>M[]>A\^WBC_`LO>A[ @Ô>Mô*êV>MWjLAîéÈ B W3& % S ˜éULH N1#êVW`>A_W`Yh>M>^LULUNUìVéULOêVN#W`BC_`W`ê'YhLOLU_ >AêVç Nœ>EÈ#NŒìZòÊYOêV[`BCLU@Æ>AéœBÔìGéœ>M@ÔLA>Aî ê' LOW,BC W4# 75éU[?>A> W?Tx ]BCLUì?>AîJNœ>AXZW`BC\¾Yh>ê'LOìV_RòÃîIéUºB \=`>LO@ êVê'NUTxYhNÈìxW`>hD?B î Yh >M>A_`KJ3BCW`# T9#êVìZNKYO[?òÖ>MLOëº>ABÔéœêV>MLN S?a A ï 0M _`BCNUYhLU>Méœ>éUBC\>Nœéœ>0 ¬N a >Mé™ëª>M>AWLO>A@Ô>Mô*êVWjé¿BCW3 S é>MôV>AWféUN êVW`_,éUê'LUTV>MéõNUBÔTxW]êV@CNLÈìZYO[?LU>ABCéœ>MLAî  # X?YO[`\^B _`[ S`a >MLuî

N ˜H é PSRUTVXW-Y3Z$T[!\]^`_0[acbd_aeT[!f`gX O -\^>MéU[?ì‚d_ #ìZYO[?LO>ABÔéœ>ML  XZYO[`\¾BC_`[ S?a >MLAî &% ˜îJ[?ì7ëª>MôV>MLAî BCN O [`>¿LU>AYh>AWfQ W?ìVé Kê hJ>AYhéœ>A_ a ñ,éU[`B iN `LUì a @C>A\GjH X O  YMêVW@Ô>Aê'LOW éœì a LOBC_`TV>^\^BCW`BC\¾êV@ÆéUB \>¾@Cê'TxN/BCW>hD?Yh>ANUN ìVò 0MMM _`BCNUYhLU>Méœ>¾éUBC\> Nœéœ0> ] N Èì‚Y˜[?LU>ABÔéœ>MiL  XZY˜[`\^BC_][ S?a >MLAî &%  a ñG>AW?ò¼ìVL˜YMBCW?T kTV3l!\5mVI\o>MLOLUìVL n`ì7ë éU[`LUì S Txp[ oœYhìxW]NœéUêVWféK>MLULUìVLŒYMê'LUì S NU>A@C9N q 5r s r-tN  ë#BÔéU[`BCW )N J>AYMBCêV@ S W]BÔéUNMî×ë#BÔéU[?ì S é/@ÔìxNUN/ìVò#NU[`ìVLUé/éUB \>^Txê'éœ> S W`BÔéUN/@Ô>Aê'LOWéœì ì J>AWGêVW`_9YM@ÔìxNœ>õêVYMYh>ANUNéœìéU[?>õYhìxW`NœéUêVWjé1>MLULUìVLun`ì7ëõH:ìVLU>MìuôV>MLAîvX O xw N1@Ô>Aê'L˜W`BCW?TêV@ÔTVìVLOBÔéU[]\ B N5\^ìVLU>Œ>01¾YMBÔ>AWjé1éU[`êVW `LU>MôZBÔì S N# ç  êV@CTVìVLOBÔéU[`\^N#N S YO[4êVN#LO>AêV@RéUBC\>õLO>AY S LULU>AWjé#@Ô>Aê'LOW]BCW?6T Êç O ç y; çì a BCW`Nœìx6W º=`êV@C@CNUB _?>Vî >&%X#vz BC@ @CBCêV\^N c{JB| ]Nœ>MLAî N õêVW`_ êVYOí( ]LUì ]ê'Txê'éUBÔìxW éU[?LUì Tx[,éUBC\^>67}@ O
O ; z BC@C@ BCêV\^Ni~@>AW?T?î M#z >ML ìxNAî >> FBÔéõBCN @ÔìZYMêV@zBCWG)N ¬êVYh> êVW`_9éUBC\a >Vî]ë#BÔéU[GYhìx\ S éUê'éUBÔìxW`êV@zS Yhìx\ ¬@Ô>hDZBCé¸=ñ e } J>MLéUBC\^>õNœéœ0> êVW`_Gë5>ABÔTx[jéMH a ç#>AYh>AWfé1LU>ANU>Aê'LOYO[9ìxWEX O  [`êVN-YhìxW`Yh>AWjéœLOê'éœ>A_GìxW9BC\ ]LUìuôZBCW?T/éU[?>¿NœéœL S Yhé S LO>ÈìVòzéU[`>ŒêV_]ê `éUBÔôV>KTxê'éœ>ANN S LULOì S W`_`BCW`T éU[?> r s}r1Nh€H È>MLU>Këª>Kë#BC@ @?ò¼ìZY S NªìxW"ì S Lª\ìxNUéªLU>AYh>AWjué X O  ô*ê'LOB êVWfé }IK>MLOuN  X?YO[`\^B _`[ S`a >MLuî NMMM ˜î`ë#[`BCY˜e[ `LOìuôZBC_?>AN éU[?>Txê'éœ>ANõëÈBÔéU[,_`BÔLU>AYhéŒêVYMYh>ANUN¿éœìGéU[?j> r s r NœéUê'éœ>ANMîoYMêVW@C>Aê'LOW,éœìGNœ>A@Ô>AYhéUBÔôV>A@Ôñ4LU>ANœ>MéõBÔéUNŒì7ë#W\>A\ìVLOñ4YhìxWjéœ>AWféUNMîêVW`_ YMêV=W ]LUì‚_ S Yh>¿NœéUê a @Ô>¿LU>AN S @ÔéUN1BCEW `LO>ANœ>AW`Yh>õìVò×W?>MôV>MLœï}>AW`_]BCW?T^BC3W S é5NUéœLU>AêV\^NMH @ÃLU>Mô‚BCì N1ë5ìVLUíóNU[?ì7ëª>A_4éU[`ê'é'×X O ì é) J>MLUòÖìVLO\^N1éœL˜êV_`BÔéUBÔìxW`êV@oç êV@CTVìVLOBÔéU[`\^N#ìxWW \>MLUì NéUêVNœíZN#BCWjôVìx@ÔôZBCW?T LU>AêV@Eï}ô'êV@ S >A_S ìVL5_`BCNUYhLO>Méœ>BC3W S éUN×êVW`_^éUê'LUTV>MéUN S }IŒ>MLONMîZX?YO[`\^B _`[ S`a >MLuî r S \^\^B W`NMî NMMM# #ìZYOS [?LO>ABÔéœ>MS }L  X?YO[`\^B _`[ S`a >MLuî

&% ˜îJBCW`YM@ S _]BCW?TéUêVNœí‚N#éU[`ê'éLU> S BÔLO>¿éœì¾@Ô>Aê'LOWGéU[`>õL S @Ô>AN-ìVò×LU>MT S @Cê'L#@CêVW?T S ê'TV>ANLÊç'oN-_`>ANUYhLOB a ê a @Ô> a ñG_?>Méœ>MLO\^B W`BCNœéUBCY

y sy ∗ c

cell output output gating

y

out

c

net ϕ

wϕ

forget gate

ϕ

wout

netout

win

netin

output gate

peephole connection

y

out

peephole connections

memorizing

∗

input gating

s

CEC

and forgetting

gy g

cell

c state

in

∗

y

in

input gate

input squashing

wc netc

cell input

×= BÔT S LU> F:X O 3\^>A\ìVLUñ a @ÔìZYUí"ë#BÔéU[9ìxW?>õYh>A@C@}H /]W`BCéœ>"NœéUê'éœ>Gê S éœìx\¾ê'éUêp‚Œ=‚FiE5r-êVNœ>MñVî "$# XZBÔ>MTV>A@C\^êVW]WRî N$# 75@ êVBÔLeƒ@ìx@C@ êVYUí î &%X#
„ êV@CBCW`íV>E…z>A[]\^êVW`WRî

>$# { >AW?T?î#IKì‚ì‚_]\^êVWRî
XZ\/ñ‚éU[Rî KJ q†˜H‡*ÈWjéUBC@W`ìuëõî[?ì7ëª>MôV>MLuîBÔé¾[`êVN¾LU>A\^êVBCW?>A_ W`YM@Ô>Aê'LMéU[?>ML-X O ˆw N N S J>MLOBCìVLOBÔé¸ñ^YMê'LOLOBÔ>AN5ìuôV>MLéœìéUêVNUí‚N1BCWjôVìx@ÔôZBCW?TYhìxWféœ>hDZéòÖLU>M>¿@CêVW?T S ê'TV>AN5r-=€ÆN˜î?N S YO[GêVN-éU[`ìxS Nœ>¿_`BCNUY S NONœ>A_ML˜ê'é S LU>‰}X S WRîÃIŒBC@C>ANMî r-[?>AWR:î …o>M>Vî Š$#uz B @Ô>ALN …sª@C\^êVWRî A q # X‚éœ>AB CqôV>MLON  IKL S Wfë-êV@C_Rî "$#uO ìxW?íV>ANe z BC@Ô>ANMî &%X# çìZ_?LOBÔT S 0> ,Vî z BC@C>ANM2î ƒsª@C\^êVWRî $# çìZ_?LOBCT S 0> ,- z BC@Ô>ANMî > ˜H O [`>ABÔL LU>AYhìVTxW]BÔéUBÔìxW LU> S BÔLU>AN/éU[?> ò S W`YhéUBÔìxW`êV@]> S BÔô*êV@C>AWfé5ìVòoêNœéUêVYUí H2Šé5BCN5YhìxW`Yh>ABÔô'ê a @Ô>KéU[`ê'é X O  [`êVNUC S NUéÃéU[?>KLOBÔTx[jé a BCêVNÃòÖìVL-çoN a]S éª\^BÔTx[jé5òÖêVBC@]ìxW r-=€oNAH È>MLU>%ë5> ë#B @C@Kò¼ìZY S NGìxW éU[?>%\ìxNœé Yhìx\^\ìx‹ W r1+= ÆN a >AW`YO[]\^ê'LUíZNGò¼ì S W`_ BCW éU[?> 'ç '@CBCéœ>MLOê'é S LU> FpŒX$Ž êVW`_ ŒX$Ž'L‘']H z >/Nœé S _?ñE S >ANœéUBÔìxW`N1N S YO[óêVN0F W X O 3@Ô>Aê'L˜W9éU[?>õò S W`YhéUBÔìxW`êV@J>  S BÔô'êV@Ô>AWjé-ìVò×eê S NU[`_`ìuë#W9ê S éœìx\^ê'éœìxvW “ ’ r1êV= > ””î]YMêVWBÔé1TV>AW?>MLOêV@C|B ,M>õéœeì ”AWóéœLOêVB W`BCW?TNœ>  S >AW`Yh>AN S Géœì¾NUB ,Mi ’ Èìuë NœéUê a @Ô>õê'LO>õéU[?> Nœìx@ S éUBÔìxW`N “ N ×X O 3ì S )é J>MLUò¼ìVL˜˜ \ `LU>MôZBÔì S N1ê  `LOìxêVYO[?>AN “ ’ ‚Kì‚>A =×BCW`êV@ @ÔñGëª>ë#B @C@oê  ¬@Ô6ñ X O éœìóê9YhìxWféœ>hDZ é l0_0V3l™\™Sš_Œ@CêVW`T ê'TV=> 5rX +˜H O [?e> rX oNŒBCW]YM@ _?>/éU[?j> r-€= oNMîJë#[`B YO[ BCW`YM@ S _?>KéU[?>õç ÆNMH z >õë#BC@ @¬òÖìZY S N-ìxWGéU[?>õYM@CêVNONUBCYŒ>hD?êV\ ]@Ô> ŒX$ŽX›!S ¬î?ë#[`BCY˜[GBCN1jê rX a¬S éW?ìVéjê S r-€= B}XZ>AYhéUBÔìxW Š ˜:H qW TV>AW?>MLOêV@}Hî r#X LU>AYhìVTxW`BÔéUBÔìxW LU>  S BÔLO>ANÈê"@CBCW?>Aê'LUï a ì S W`_?>A_óê S éœìx\¾ê'éœìxWRîzê9)N J>AYMBCêV@ O S LOB W?T¾\^êVY˜[`BCW?>ë#[?ìxNœ>éUê J>@Ô>AW?TVéU[ BCN5ê'é5\^ìxNœé5@ BCW?>Aê'LªB W¾éU[?>ŒBC3W S éÀNUB ,M>VH O [`> œŒXŽX›!IžŒ@CêVW`T S ê'TV>KB NÃìxW?>KìVòzéU[?>ŒNUBCe\ ]@Ô>ANœé r3X oN # BÔéªYMêVW a >#TV>AW`>MLOê'éœ>A_ a ñ ê"éœLU>M>hï¸êV_KCœìxBCW?>A_ TVLOêV\^\¾ê'LõêVW`_ LU>AYhìVTxW`B,M>A_ S NUB W?TMLAî ê /]W]BÔéœ>NUéUê'éœ>¾ê éœìx\^ê'éœìxWëÈBÔéU[,êVYMYh>ANUN¿éœìGé¸ë5ìYhì Wjéœ>MLONŒéU[`ê'éõYMêVW a >BCW`YhLO>A\>AWféœ>A_,ìVLõ_`>AYhLU>A\>AWjéœ>A_RH O ì

N KìVLõE ì S LíZW?ì7ë#@Ô>A_?TV>õW?ìM>AWê a @Ô>¿éœì¾@Ô>Aê'L˜WGêê'LU> S NUBCW`T'X O  ë#BÔéU[/òÖìVLUTV>Mé×Txê'éœ>ANÀêVW`_éU[?>-LU>AYh>AWjéU@Ôñ BCWjéœLUìZ_ S Yh>A_  >M>0 ¬[?ìx@Ô>ªYhìxW]W?>AYhéUBÔìxW`N
}IK>ML˜N2 X?YO[`\^B _`[ S`a >MLuî NMMM ˜H=?ìVLOTV>MéTxê'éœ>ANë5>MLU>^>ANUNU>AWféUBCêV@Ãò¼ìVLL `LUì a @Ô>A\^NõBCWjôVìx@ÔôZBCW?TóYhìxWjéUBCW S êV@ÀìVL/ôV>MLUñ%@ÔìxW?TB W3 S éõNœéœL˜BCW?TxN }IK>MLON>MéêV@ HÔî NMMM ˜ H}@ >M>0] [?ìx@C>ŒYhìxW]W?>AYhéUBÔìxW`NêV@ @Ôìuë éU[?>¿Txê'éœ>AN#éœì^êVYMYh>ANUN1éU[?>r s rèìVòÆéU[?>¿NUêV\^>õ\>A\ìVLUñ a @ÔìZYUí H O [`BCN `LUì7ôV>A_ éœì a >^>ANUNœ>AWjéUBCêV@ªò¼ìVLW S \>MLUì S N/Nœñ‚\ a ìx@CBCYêVW`_ LU>AêV@Eï}ô'êV@ S >A_Yhì S WféUB W?TéUêVNœíZNE}IK>MLONâ  XZY˜[`\^BC_][ S?a >MLAî NMMM ˜H  ô'ê'LOBCêVWjéÀë#BÔéU[J >M>0] [`ìx@Ô>AN”êVW`_^òÖìVLUTV>MéªTxê'éœ>AN S NU>A_¾BCWéU[`B N] êJ >MLÃBCNÀYM@C>Aê'LO@ÔñN S J >MLOBÔìVL×éœì/éœLOêV_`BÔéUBÔìxW]êV@3X O  î O [?>'X O Í z

êVW`_óB N1W?ìuë ì S L\>MéU[?ìZ_GìVò”YO[?ìxB Yh>VH O [`> a êVNUBCY S W`BCé5ìVò×êVW=×X O W?>Mé¸ë5ìVLUíGBCN-éU[?>aj_aeT[!f=¥¦Tk§9YhìxWféUêVBCW]BCW?TìxW?>¿ìVL#\^ìVLU>eaj_aeT[!f-k!_¦S¦¨l êVW`_óéU[?LU>M> êV_`ê `éUBCôV>Vî \ S @ÔéUB ¬@CBCYMê'éUBÔôV>ŒTxê'éUBCW?T S W`BCéUNNU[`ê'LU>A_ a ñóêV@ @zYh>A@C@CNÈBCWóéU[?> a @ÔìZYUíxÊ=×BÔT S LU> ˜H
sÃêVY˜[ \^>A\ìVLUñGYh>A@C@o[]êVNÈê'éŒBÔéUN N

hY ìVLU> ê^LU>AY S LULU>AWjéU@Ôñ"Nœ>A@Ôò¼ï¸YhìxW`W?>AYhéœ>A_ó@CB W?>Aê'L S W`BÔé1YMêV@C@C>A_9éU[?>=otr5ìxW`NœéUêVWjésÃLULUìVLr-ê'LOì S Nœ>A@|qG5r s r
ªë#[?ìxNœ>õêVYhéUBCô*ê'éUBÔìxW4BCN YMêV@C@Ô>A_%éU[?>¾Yh>A@C@
l!\5m\©_MH O [`>-r s}r1N¿>AW?òÖìVLOYh>ktTV3l!\5mV`\Ã>MLULOìVL.n`ì7ë êVW`_ì7ôV>MLOYhìx\>GêGò S W`_`êV\^>AWféUêV@ ]LUì a @Ô>A\ª ¬@Cê'T S BCW?T `LU>MôZBÔì S N5çKNF×éU[?>Mñ- `LU>MôV>AWjé5>MLOLUìVLNUBÔTxW`êV@ NÃòÖLUìx\ _?>AYMêuñ‚BCW`T  S BCYOí‚@Cñ^êVN1éU[?>Mñdo a êVYUí9BCW¾éUB \>qZH O [?>ŒêV_`ê `éUBCôV>KTxê'éœ>AN YhìxWjéœLUìx@?BC3W S éÆêVW`_ì S )é S éÆéœì¿éU[?>1Yh>A@C@ N «™SV¬`­3\+mV`®LT­3\¯¬`­3\vWXm\©_oêVW]_@C>Aê'LOWéœìKLO>ANœ>Mé”éU[?>-Yh>A@C@°w N”NœéUê'éœ>1ìxW`Yh>1BÔéUN×YhìxWjéœ>AWféUN ê'LU>ì S é#ìVòª_`ê'éœE> ²±0T[°WX_\2W†m\©_˜H O [?> Txê'éœ>ANŒê'LU> S W`BÔéUN#ë#[?ìxNœ>/ì S )é S éUNK\ S @ÔéUB ]@ BCYMê'éUBÔôV>A@Ôñ"BCW3n S >AW]Yh> YhìxW`W?>AYhéUBÔìxW]N#éœì"ìVL òÖLUìx\ éU[`>K@CB W?>Aê'L S W]BÔéÃ[?ìx@C_]BCW?T¿éU[?>ŒYh>A@C@ NœéUê'éœ>VH:@>M>0 ][?ìx@Ô>ŒYhìxW`W?>AYhéUBCìxW`NªYhìxW]W?>AYhé-éU[?>r s réœìéU[?>KTxê'éœ>ANMHÃFK@C@¬>MLULUìVLON5ê'LU> Y S éÈì h ìxW`Yh> éU[`>Mñó@Ô>Aê'íGì S éKìVòÀê¾\>A\ìVLOñóYh>A@C@zìVLKTxê'éœ>VîzêV@ÔéU[?ì S Tx[éU[?>Mñó_?ì"Nœ>MLUôV>éœìéU[?>/BCW]Yhìx\^BCW?Të5>ABÔTx[jéUNMH O [?>K>hJ>AYhéBCNÃéU[]ê'é5éU[`>ir s r-N5ê'LU>ŒéU[?>ÈìxW]@Ôñe ]ê'LUé5ìVòzéU[?>¿NœñZNœéœ>A\ éU[?LUì S Tx[MLuî?ë#[`BC@Ô> Txê'éœ>ANŒ>MéUY'HŒ@Ô>Aê'LOW4éU[?>/W?ìxW]@CBCW?>Aê'LKêV)N J>AYhéUN#ìVòÃNU>  S >AW]Yh> `LOì‚Yh>ANUNOBCW?T?H O []BCN\^ê'íV>AiN ×X O ˆw N S R_`ê'éœ>ANÈ0> 1¾YMBÔ>AWjéÈëÈBÔéU[?ì S é NUBÔTxW]B /]YMêVWjéU@Ôñ"Kê hJ>AYhéUBCW?T"@Ô>Aê'LOW`B W?T Jìuë5>ML F O [?L> r s r-
N J>MLO\^BC é ×X O éœì a LOBC_?TV>õ[ S TV>/éUBC\> @Cê'TxLN 0MMM _`BCNUYhLU>Méœ> éUBC\> Nœéœ0> ]N¿êVW]_\ìVLUD>  a >Mé¸ë5>M>AWLU>A@Ô>Mô'êVWféŒ>MôV>AWjéUNMîoëÈ[`BC@Ô>/éœLOêV_`BÔéUBÔìxW]êV@'ç 'KN¿êV@ÔLU>AêV_`ñòÊêVBC@oéœìó@C>Aê'LOWBCW4éU[?> `LU>ANœ>AW]Yh>ìVò 0M Nœéœ0> ;éUBC\>"@Cê'TxNMîÀ_?>A9N ]BÔéœ>¾LO>  BCLOBCW?Tó\ìVLO>"Yhìx\ ¬@Ô>hD R_`ê'éœ>"êV@ÔTVìVLOBÔéU[`\¾NM(H ìVLU>MìuôV>MLuî X O  BCN@Ôì‚YMêV@5BCW)N ]êVYh>GêVW`_ éUBC\?> }XZYO[]\^BC_`[ S?a >MLAî > ˜î5S êVW`_ BÔéBCN \^ìVLU>¾0> 1¾YMBC>AS WfééU[`êVWìVéU[?>MLç  êV@ÔTVìVLOBÔéU[`\¾N N S Y˜[êVN/LU>AêV@ªéUBC\>AY S LULU>AWjé @Ô>Aê'LOW]BCW?T‰Êç O ç³; çì BCW]NœìxW‰ =`êV@C@CNUB _?>Vî >&%X#+z BC@C@ BCêV\^N'´{RB ]Nœ>MLAî N ˜He×X O ˆw N¿Yhìx\ éUê'éUBÔìxW]êV@”Yhìx\ ]@Ô>hD?BÔé¸ñ òÖìVL/êó\>A\^ìVLUñ a @ÔìZYU=í µa  >ML éUBC\>¾Nœéœ0> êVW`_%ë5>ABÔTx[jé BCN j5¶3·D˜îë#[?>MLO-> ¶3·^B N¿éU[?>ML¿ìVòYhS>A@C@CNõBCW%éU[?> a @ÔìZYUí =H ¶3· BCNé¸ñ$ ]BCYMêV@ @Ôñ êNU\^êV@ @5YhìxW]NœéUêVWféL; B WéU[]BCN ]ê J>MLBÔéBCNBCW òÖêVYhé^êV@Ôë-êAñZN> S êV@5éœììxW?>VîªNUìéU[`ê'ééU[?>GYhìx\ S éUê'éUBCìxW`êV@ Yhìx\ ]@C>hDZBÔé™ñ 7}@ O
O ; z BC@C@ BCêV\^ N ¸@Æ>AW`T?î M#Iz >ML a ìxNMî >> [`êVN-éU[?> NUêV\>"Yhìx\ S éUê'éUBCìxW`êV@ÃYhìx\ ¬@Ô>hDZBCé¸ñ¹Öë#[?>MLU>AêVNç O ç BCN/\ S Y˜[ ë5ìVLONœ>D a]S é B NõW?ìVé/@Cì‚YMêV@ªBCWéUBC\>VHEŠé/W?>M>A_]Nõéœì4NUéœìVLU> êVYhéUBÔô'ê'éUBÔìxW%ô'êV@ S >AN ì a Nœ>MLUôV>A__ S LOB W?T"NU>  S >AW]Yhj> `LUìZYh>ANUNUB W?TGBCW%êóNœéUêVYOí%ë#BÔéU?[ JìVéœ>AWjéUBCêV@ S W`@CBC\^BCéœ>A_ NOB ,M>VAWjéUBCêV@C@ÔñVî X O [`êVNÈéU[?>/Yhìx\ ¬@Ô>hDZBCé¸ñGìV:ò 7 @ OO °º`. z BC@ @CBCêV\^N »{JB ¬Nœ>MLAî N ˜îRëÈ[`BCYO[éœL W`YMê'éœ>ANÈ>MLULUìVL˜NÈê'òÖéœ>ML º,Nœéœ0> ]NMîJêVW`_ ë#[`B YO[9ë5ìVLUí‚N1êVN#ëª>A@ @ êV'N 7 @ O
O î?êVYMYhìVLO_]BCW?Téœì^ì S L1>hD J>MLOBÔ>AW`Yh'> ;BCòoë5>õ_`BC_9W?ìVé#[`S êuôV.> X O  ë5>¿ëªì S @C_GBCW"òÖêVYhé S Nœ> 7 @ O
O Ê[`˜H ¼€½©¾

¿ÀHÁ&Â-óÁ†Ä¸Å ÃyÆÆ O [?>¿Yh>A@C@ ì S é) S éMîÇ$hÈ î?BCN-YMêV@CY S @ ê'éœ>A_ a êVNœ>A_9ìxW9éU[?>¿Y S LULO>AWfé1Yh>A@C@JNœéUê'éœ>É È êVW`_9ò¼ì S L-NUì S LOYh>AN-ìVòÆB W3 S é0F+”UÊ0Ë È BCN-BCW3 S éªéœì éU[?>Yh>A@C@BÔéUNœ>A@Ôò×ë#[`B @Ô>”UÊ0Ë«Ì  îv”UÊ0Ë)ÍêVW]_6”UÊ˫ΫÏÐ5ê'LU>B W3 S éUN1éœì9éU[?>BCW3 S éTxê'éœ>ANMîRòÖìVLUTV>MéKTxê'éœ>ANMîzêVW`_4ì S é) S éKTxê'éœ>ANMH z > YhìxW`NUB _?>MLK_]BCNUYhLU>Méœ>éUBC\>Nœéœ>0] NË Ñ M– –tN$–0—0—0— H¿FºNOBCW?Tx@Ô>Nœéœ>0 BCWfôVìx@CôV>ANÈéU[`> R_`ê'éœ>ìVòÃêV@C@ W`BCéUNÖòÖìVLUë5ê'L˜_ ¬êVNUNÈêVW`_ éU[?>Yhìx\ S éUê'éUBÔìxW,ìVòÃ>MLULOìVLŒNOBÔTxW`êV@CNKòÖìVLõêV@C@oë5>ABÔTx[jéUNj a êVYOíjë-ê'LO_? ]êVNUN!˜H O [?LUS ì S Tx[?ì S éKéU[`BCNS ]ê J>ML
µGBCW`_?>hDZ>ANŒ\>A\ìVLUñ îfN S YO[¾éU[`ê'é:›!·Ó _?>AW`ìVéœ>ANÀéU[?> Ò ï}éU[A@ @?ìVòJéU[?>'µ ï}éU[A\ìVLUñ a @Ô@ÔìZìZYUYUíZí N#U#XÔ
Ò Õ BCW]_?BCNŒ>hD‚éU>A[?NÃ>\ë5>A>A\BÔTxìV[jLUéõñìxYhW,>A@CéU@CNÀ[?>^B W Yha ìx@ÔW`ìZW?YU>AíiYhµAYMB/`>A_  ñóéU[?>W?>Mé¸ë5ìVLUí4éœì  ìx@CìVTVñVîzêVW`_,BCW`_?>hD=Öj·SLOêVW`TV>ANŒìuéœôVì >ML S W`êVBC@Cé@NœŠ× ìHLŠ L˜W`Yh_`> >hDW`Ö BÔéUN#LOêVêVW]W?_ TV>AêVNõ@ Nœìuì9ôV>MéUL/[?>êV@ ru@NUs}ì r-S NKLOYhìV> òÃS éUW`[`BC>éUNMµVîzï}éUêV[ N \>A\ìVLOñ a a @Cì‚YOí¬HÃ=`ìVL#éU[?>¿Txê'éœ>ANMî³Ø Õ îI׀Ù?œÚ5” –9ÛKÜ Ë –Ý ž B N1ê^@ÔìVTxBCNœéUB Y¿NUBÔTx\ìxSBC_9ëÈBÔSéU[9LOêVW?TV>jÞ M– !ß H =?ìVLÈ>AêVYO[ _`BCNUYhLO>Méœ>¿éUBC\>õNœéœ>0ó ë5> S NU>õêé¸ë5ì'ï5] [`êVNœ> S R _`ê'éœ>¿NUYO[`>A\>õéU[`ê'é#Yhìx\e S éœ>ANÊB W9éU[`BCN1ìVLO_`>ML!F

HàÊê†-q W3 S é5Txê'éœ>êVYhéUBÔô'ê'éUBÔìxW=Ç Ì ] î a MéÈTxê'éœ>/êVYhéUBÔô'ê'éUBÔìxWGÇ Í î ÊY9 Yh>A@ @zBCW3 S é5êVW`_Yh>A@C@zNœéUê'éœ>É È î N Hì S é) S é1Txê'éœ>/êVYhéUBCô*ê'éUBÔìxW6Ç Î«ÏÐ êVW]_GYh>A@C@Rì S é) S éuÇ$hÈ H á³â ß$ãäXåyæ°ä†çè O [?>õBCW3 S éªTxê'éœ>êVYhéUBÔô'ê'éUBÔìxW=Ç Ì <  êVW`_GéU[`>¿ò¼ìVLUTV>Mé#Txê'éœ>/êVYhéUBÔô'ê'éUBÔìxW=Ç Í ê'LU> Yhìx\e S éœ>A_óêVN#ò¼ìx@C@Cìuë#N0F

ê Ô Ì 0ê) Ç  SËî H•ðì ï Ô Ì êtÈ5ê ó É È5ê ó SËî  – Ç Ì ê SË92ÑôØKÌ 0ê S”UÊ0Ë«Ì ê SË)) –

  Óñëò ê ”UÊ0Ë)Í ê SË9ëÑíì Ô Í ê9 Ç  SËî H•ðì ï Ô Í ê9È5ê ó É È5ê ó SËKî  – Ç Í ê SË):ÑôØÍ ê S”UÊËõÍ ê SË)) — N  Óñëò O [?>- J>M>0 ][?ìx@Ô>9YhìxW`W?>AYhéUBCìxW`Nò¼ìVLéU[`>9B W3 S é/Txê'éœ>êVW`_ éU[?>9ò¼ìVLOTV>MéTxê'éœ>óê'LU>óBCW`YhìVL9 JìVLOê'éœ>A_;BCW> S ê'éUBÔìxW êVW`_ N a ñ BCW`YM@ S _`BCW?T/éU[?>Lr s r-NÊYhìxWjéUêVBCW`BCW?TéU[`> Yh>A@C@RNœéUê'éœ>AN1 ìVò”\>A\ìVLUñ a @ÔìZYUí¾µ êVNÈNœì S LOYh> S W`BÔéUNMH á³â ß$ã‹äXö3è O [?> NUéUê'éœ>/ìVòÀ\>A\^ìVLUñóYh>A@C@ëÉ SË)  BCN#YMêV@ Y @Cê'éœ>A_ ñóêV_`_`B W?TéU[?>/Nt êVNO[?>A_Rî`Txê'éœ>A_,BCW3 é1ìVò×éU[?>/Yh>A@C@oéœì éU[?> NUéUê'éœ>ê'éÈéU[?>` LU>MôZBÔì S N-éUB \> Nœéœ>0 ?É È SËî È SË
÷ M ˜ î]S ë#[]BCYO[óa B N\ S @ÔéUB] @CBC>A_?ÖTxê'Séœ>A_v a ñ9éU[?>õòÖìVLUTV>Mé#S Txê'éœ>êVYhéUBÔô'ê'éUBÔìxW °É È5ê ó M 2Ñ M F ”UÊ0Ë È ê ó SË)+Ñíì Ô È ê ó  Ç  SËKî  – É È ê ó SË):ÑíÇ Í ê SË)
É È ê ó SËKî U•QÇ Ì 0ê SË9BøvS”UÊ0Ë È ê ó SË)) — Š  ”UÊËéÌ 0ê SË9ëÑíì

Š

á³â $ß ãúùyè O

[?>¿ì S é) S é1Txê'éœ>êVYhéUBÔô'ê'éUBÔìxW=Ç Î«ÏÐ BCN1Yhìx\ S éœ>A_óêVNòÖìx@C@Ôì7ë#N0F

ê Ô «Î ÏÐ 9ê  Ç  SËKî U• ì ï Ô Î«ÏÐ êÈ5ê ó É È5ê ó SË9 – Ç ÎéϝРê SË92ÑôØ Î«ÏÐ ê S”UÊË Î«ÏÐ ê SË)) — J  Óñëò s: S ê'éUBÔìxW J BCW`YM@ S _?>AN”éU[?> J>M>0] [?ìx@Ô>KYhìxW`W?>AYhéUBÔìxW`N5òÖìVL-éU[?>Èì S é) S é5Txê'éœ>KòÖLUìx\ éU[?>r s}r1NÃìVòo\^>A\ìVLUñ a @Cì‚YOíµë#BÔéU[ Yh>A@C@zNUéUê'éœ>AN'É È SË)˜î]êVYhé S êV@CB,M>A_óBCWGNUéœ>0 H O [`>ŒYh>A@ @Rì S é) S éuÇ È BCN1Yhìx\ S éœ>A_óêVNòÖìx@C@Ôì7ë#N0F Ç È ê ó SË)2ÑúÇ Î«ÏÐ ê SË)uÉ È ê ó SË9 — A =×BCW`êV@ @ÔñVîêVNON \^BCW`T4ê @CêAñV>MLU>A_;W?>Mé™ëªìVLOí%éœìJ ìx@ÔìVTVñ%ë#BÔéU[ ê NœéUêVW`_`ê'LO_ BCW3 éõ@CêAñV>MLuîÃê4[]BC_`_?>AW%@ êAñV>MLYhìxW`NUBCNUéUBCW?TìVò \>A\ìVLOñ a @Cì‚YOí‚NMS î`êVW]_óê^NœéUêVW`_]ê'LO_9ì S é) S é@ êAñV>MLAî¬éU[?>¿> S ê'éUBÔìxW`N1òÖìVLéU[?>õì S é) S S é S W`BCéUN
9û ê'LU>F ”UÊ0Ëõü$SË92Ñýì Ô ü  Ç  SËKî  – Ç ü SË92ÑôØüXS”UÊË«üSË9) – "  ë#[?>MLO>iÖ LOêVW?TV>ANì7ôV>MLÈêV@C@ S W`BÔéUN5òÖ>M>A_`BCW?TéU[?>¿ì S é) S é S W`BCéUN1êVW`_6Ø ü B N1éU[?>¿ì S é) S éN9 S êVNU[`BCW?Tò S W`YhéUBÔìxWzH ”UÊË Î«ÏÐ ê SË)+Ñ ì

¼€½þ¼

ÿ‰Á&ÃyÄ
  EÃ³Æ IÄ Eà ëÂEóÁ†Ä¸Å ÃyÆKÆ sÃNONœ>AWféUB êV@C@ÔñVîD×X O ˆw N êVYOíjë-ê'LO_¬ êVNUNoBCNoêVW¿>0¾ 1 YMBÔ>AWjéoò NUBÔìxWŒìVò?NU@ BÔTx[féU@CñÈ\ìZ_`B/`>A_zîAéœL W`YMê'éœ>A_.7}@ O
O êVW]_õêY Nœéœìx\¾B,M>A_ ôV>MLONUBCìxWóìVòÀç O çôÖòÖìVLKa _`>MéUêVBC@CN#NU>M>È ì‚Y˜[?LU>ABÔéœ>MLi X?YOS[`\^B _`[ S`a >MLuî &%X# IŒ>MLON#>MéŒêVS @ HÔî NMMM ˜H z >ê'LU> S NUBCW?T^S BÔéœ>ML˜ê'éUBÔôV> TVLOêV_`BC>AWféK_?>ANUYh>AWjéMîJ\¾BCW`BC\^B|A, BCW?TêVWì a qC >AYhéUBÔôV>ò S W`YhéUBÔìxW^îJ[?>MLU> éU[`> S N S êV@o\>AêVW N9 S ê'LU>A_>MLULUìVLKìuôV>MLõêV@C@oéUBC\>/NUéœ>0 ]N êVW`_%êV@ @ÀNœ> S >AW`Yh>ANMH"F J >AW`_]BED4F @CBCNœéUN¬ Nœ> S _?ìóYhìZ_?>^òÖìVL éU[?>¾>AWféUBÔLO>^êV@ÔTVìVLOBÔéU[`\ # Nœ>M>?}IK>MLON >Mé êV@ HÔî NMMM ŒòÖìVL/êGò S @C@ _?>MLOBCô*ê'éUBÔìxWzH€K* W`@CBCíV>7}@ O
O êVW`_Gç O ç'ÀîI×X O xw N@Ô>Aê'LOW`B W?TêV@ÔTVìVLOBÔéU[`\ÍBCN1@ÔìZYMêV@zBCWGN)] êVYh>/êVW`_9éUBC\>VH

Àúzÿ ÃøKù O [?>KW?>Mé¸ë5ìVLUí"Nœ> S >AWféUBCêV@ @Ôñì a Nœ>MLUôV>AN5>hDZ>A\ ]@Cê'LOñ^Nœñ‚\ a ìx@¬NUéœLOBCW?TxNªìVòoê/TxBÔôV>AW9@CêVW?T S ê'TV>Vî `LU>ANU>AWféœ>A_"ìxW?>ŒBCW3 S éÃNœñZ\ a ìx@ ê'é/êóéUBC\>VH9=?ìx@C@Ôì7ë#BCW?TGéU[?>¾éœLOêV_`BÔéUBÔìxW]êV@Àê  `LUìxêVY˜[ BCW%éU[?>¾ç @CBÔéœ>MLOê'é S LU>^ë5>^ò¼ìVL˜\ S @ ê'éœ>^éU[?>^éUêVNœí%êVN/ê= `LO>A_`BCYhéUBÔìxW éUêVNœí HÃF-é#êVWjñ9TxBÔôV>AWGéUBC\>¿Nœéœ>0 4éU[?>¿éUê'LUTV>Mé#B N1éœì `LU>A_`B Yhé5éU[`> JìxNUNUB a @C>ÈW?>hDZé#NœñZ\ a ìx@CNAîZB W`YM@ S _`B W?TõéU[?>q'>AW`_óìVò×NUéœLOBCW?T&q NœñZ\ a ìx!@ H z [?>AWŒéU[`êVW"ìxW?>KNUñ‚\ a ìx@¬YMêVW"ìZYMY S L1BCW¾éU[`>KW?>hDZé1Nœéœ0> xm¦S¦H JìxNUNUB a @C>Nœñ‚\ a ìx@CN5[`êAôV>Œéœì a >' `LO>A_`BCYhéœ>A_Rî êVW`_óW`ìxW?>¿ìVòÆéU[`>õìVéU[?>MLONMH \ ]@Cê'LOñ^Nœñ‚\ ìx@¬NUéœLOBCW?TxNªìVòoê/TxBÔôV>AW9@CêVW?T ê'TV>Vî `LU>ANU>AWféœ>A_"ìxW?>ŒBC3W éÃNœñZ\ ìx@ O [?>KW?>Mé¸ë5ìVLUí"Nœ>  S >AWféUBCêV@ @Ôñì a Nœ>MLUôV>AN5>hDZ>A ê'é×êéUBC\>VîVêV@CNUì#LU>MòÖ>MLULU>A_ éœìKêVNBC3W S ézNœ>  S >AW`Yh>ANM€H sÀôV>MLUñõa BCW S ézNœ>  S >AW`Yh> a >MTxBCW`NRë#BCS éU[õéU[?>5NœéUê'LUéÆNUñ‚\ a ìx$@ ¶5H O S [?>ª>A\ `a é¸ñ NœéœLOB W?T?îRYhìxW`NUBCNœéUB W?T¾ìVòu¶" ìxW`@ÔñVîRBCNŒYhìxW`NUBC_`>MLU>A_6 ¬ê'LUéÈìVòª>AêVYO[%@ êVW?T S ê'TV>VHõF NUéœLOBCW?T"BCNŒêVYMYh>0 `éœ>A_ë#[?>AW êV@C@+ `LU>A_]BCYhéUBÔìxW`N [`êuôV> a >M>AWGYhìVLULU>AYhéMuH 4KéU[?>MLUë#B Nœ>¿BÔéBCN1LU«> Cœ>AYhéœ>A_RH O [`B N `LU>A_`BCYhéUBCìxW9éUêVNœíGBCN-> S BÔô*êV@C>AWfé1éœì"ê^YM@CêVNUNUB|/]YMê'éUBÔìxW9éUêVNœíGë#BCéU[9é¸ë5ìANeoœêVYMYh>0 `é9q"êVW`_¹oqLU>«Cœ>AYhéMî q a >AYMê S NU>õéU[?> NœñZNœéœ>A\ ë#BC@C@Z\^ê'íV> `LU>A_`B YhéUBÔìxW>MLULUìVLONÃò¼ìVL5êV@C@`NœéœL˜BCW?TxNÀì S éUNUBC_?>1éU[?>K@CêVW?T S ê'TV>VHÀF NœñZNœéœ>A\ [`êVNÃ@C>Aê'LOW?>A_^ê TxBÔôV>AWK>i>A”W]Yhìxì‚W`_?Yh>A> _GBÔé@Cì‚BCYMN1êVê @C@Ca ñ @Ô>¿ñéœì¾%VYhï¸ìV_`LUB \LU>A>AYhW`éU@CNUñ-BÔìx ]W]LUêV>A@ _`BCYhB W`é1ê'êVLU@Cñ^@zNUôVéœ>ALOYhBCW?éœìVTxLON-N#ë#ë#BCéUBÔéU[G["NUìxB,MW`>$@Ôñ¾# ìx””W?>õH W?ìxWZ5ï ,M>MLUì^Yhìxe\  ìxW`>AWféMî?ë#[`>MLU&> % > S êV@CNÀéU[`a >#W S \ a >MLÀìVòz@CêVW`T S ê'TV>#NœñZa \ a ìx@C2N ]@ S N”ìxW`>ò¼ìVaLª>ABÔéU[?>MLªéU[?>#NœéUê'LUé5NœñZ\ a ìx@`BCW^éU[?>ÈBCW S é×ìVLÃéU[?> q'>AW`_^ìVòzNUéœLOBCW?&T q NœñZ\ a ìx@RBCW9éU[`>õì S )é S .é '%"BC3W S é S W`BÔéUNM(î %ANªéU[]ê'é#ê^NœñZ\ a ìx@zB N1Nœ>Mé#êVW`x_ î éU[`ê'é#BÔéB N1W?ìVé # éU[?> _`>AYMBCNUBÔìxW a ì S W`_]ê'LUñ^òÖìVLéU[?> W?>Mé™ëªìVLOí"ì S é) S éBCN M— M H )+*-, Œ†Ž(}X S W">Mé#êV@}HÔî Š$#Iz BC@Ô>A
N ¸sÃ@ \^êVWRî A q #`O ìxW?íV>AN  z BC@Ô>ANAî &%X# çìZ_?LOBÔT S 0> ,È>Mé#êV@}HÔî  ˜H È>MLU> éU[?>õNœéœL˜BCW?TxN-BCW"éU[?>õBCW3 S éªNœ> S >AW`Yh>AN#ê'LU>¿ìVòoéU[?>¿òÖìVLO\~ŒX$Ž # B W3 S é5êVW`_9ì S é) S é-ôV>AYhéœìVLONÈê'LU> Š ï¸_`BC\^>AW`NUBÔìxW`êV@}H+@ÃLOBÔìVL-éœì éU[?> /`LONœéìZYMY S LULO>AW`Yh> ìV2ò ŽŒ>ABÔéU[`>M'L Œ9ìVL Ž7î ìV'L Œ9ìV.L ê'éKNœ>  S >AW`Yh> a >MTxBCW`W]BCW?TxNMî`ê'LU> JìxNUNUB a @C>ŒB WGéU[?>/W`>hD‚éKNœéœ0> zH O [ S NMî >VH T?HÔî]òÖìVL
”'Ñ A F Š3W S 0é F X ê ê ê ê ê a aa a6a O ê'LUTV>Mé0Fê/ O ê/ a ê/ a ê/ a ê/ a ê/ aa aa a O )+*-, Œ  Ž    ‘  Êç#ì‚_?L˜BÔT S 0> , z BC@Ô>ANMî > ˜H O [?>õNœ>AYhìxW`_[`êV@ÔòoìVò”êNœéœL˜BCW?Tò¼LOìx\ éU[`BC

N ]êV@ BCW`_?LUìx\^>ÈìVL#\¾BÔLULUìVL @CêVW?T S ê'TV>^BCNŒYhìx\ ]@Ô>Méœ>A@Ôñ6 `LU>A_`BCYhéUê a @Ô>/òÖLUìx\ éU[?> /`L˜NœéK[]êV@Ôò™H O [?>éUêVNœí4B WfôVìx@ÔôV>AN êVWBCWféœ>ML˜\>A_`BCê'éœ>éUBC\>@Cê'T9ìVò-@Ô>AW?TVéU[ > /`LONUé1ì‚YMY S LOLU>AW`Yh>¿ìVò  é¸ë5ì A ï¸_]BC\>AW`NUBCìxW`êV@ €H @ÀLOBÔìVL1éœì/W?>hS D‚éNUéœ>0 zH S O [ S S NMî?>VH T?HÔî`òÖìVL”'Ñ J3– ÖBÑ Š F q3W S 0é F X ê ê ê ê a a a 7 7 7 F F F F O ê'LUTV>M0é Fê / O ê / a ê / a ê / a ê / aa /K7 a /K7 a /K7 7 7 F F F F O 

 

J

)eá, Œ†Žt$›!Iè
q3W éêVW]_Gì é) é#ôV>AYhéœìVLONÈê'LO> J ï¸_`BC\>AW]NUBÔìxW`êV@ H@ÀLOBÔìVL1éœì/`L˜Nœé1ì‚YMY S LULU>AW`Yh>õìVò2ŽKé™ëªì"Nœñ‚\ a ìx@CN ê'LU> JìxNUNOB a @Ô>ŒBCW9éU[?>õW?>hDZS é#Nœéœ>0 oH SO [ S S NMîZ>VH T?HÔî]òÖìVL
”'Ñ A F q3W S 0é F X ê ê ê ê ê a a aaa Y Y Y Y Y O ê'LOTV>M0é F%ê/ O ê/ a ê/ a ê/ a ê/ a ê/ a a a aa Y Y Y Y Y O 0€½©¾

1Á&Ã23254BÃ:Ä617IÆ892
4

0€½þ¼

NO(ÂEÀHÁ9P1ÀRQuÀS©ÀR4TýÃ:Ä6U+VWQXÁY2Z[!"ÃSÅ ÃvÁ†ÃZ[(JÁXÆ

z>Aê'L˜W`BCW?TêVW`_9éœ>ANœéUBCW`T^êV@Ôéœ>MLOW`ê'éœ>FÃê'òÖéœ>ML>AêVY˜[ó>0 Jì‚Y˜[x5Ñ 0MMM éœLOêVB W`BCW?TNœ> >AW`Yh>ANªë5>¿ò¼LO>M>0,M>õéU[?>¿ë5>ABÔTx[féUN#êVW`_"L WGê éœ>ANœéMHLsÀôV>AW,ë#[?>AW êV@C@×NœéœLOB W?TxNÈê'LO> `LUìZYh>ANUNœ>A_,YhìVLULU>AYhéU@Ôñ _ S LOB W?T^éœLOêVBCW]BCW?T?îJBÔS é¿BCNÈW`>AYh>ANUNUê'LUñ éœì9éœ>ANœéõê'TxêVBCW ë#BÔéU[ òÖLUìS ,M>AW ë5>ABÔTx[féUNìxW`Yh>¿êV@C@Jëª>ABCTx[fé1YO[]êVW?TV>AN[`êuôV> a >M>AWhDZ>AY S éœ>A_RH5F ¬ê'LUé-ò¼LUìx\ >AW]N S LOBCW`T éU[?>¿@Ô>Aê'LOW]BCW?TìVòoéU[?>ŒéœLOêVBCW]BCW?TNœ>Mé1éU[?> éœ>ANœé#êV@ Nœì¾_?>Méœ>MLO\¾BCW?>AN-TV>AW?>MLOêV@ B,Aê'éUBÔìxWG J>MLUòÖìVLO\^êVW`Yh>Vî?ëÈ[`BCYO[9ë5> _`B _"W`ìVéì `éUBC\^B|,M> a ñ S NUBCW`T?îZNOêAñVî¬ê^ô*êV@CB _`ê'éUBÔìxW9Nœ>MéMH O LOêVBCW`B W?TANUéõNœ>MéUNõBCW`YhìVtL  ìVL˜ê'éœ>êV@C@×@Ô>MTxêV@”NUéœLOBCW?TxN S ,éœìóê9TxBÔôV>AW@Ô>AW`TVéUy[ F N ”;òÖìVLŒ  Ž  î Š ”;ò¼ìVLŒ  Ž  ›  êVW`_ L Œ†ŽtL‘¬H O LOêVBCW`BCW`TóNœéœLOBCW?TxN ê'LU ]LU>ANœ>AWjéœ>A_BCW LOêVW`_?ìx\3ìVLO_?>MLAH4¿W`@Ôñ >hD‚>A\ ¬@Cê'LONõòÖLUìx\éU[?> `9é q"ê'LU. > ]LU>ANœ>AWjéœ>A_RH O LOêVBCW`B W?TBCNNœéœì  J>A_GìxW]Yh> êV@C@RéœLOêVB W`BCW?TNœ>  S >AW`Yh>ANK[`êAôV> a >M>AWóêVYMYh0> `éœ>A_Rî ìVL#ê'òÖéœ>MLKê'éK\ìxNœé > WX_0Vv_[)m¦²™õ@Cê'LOTV>ANœé#êVYMYh0> `éœ>A_4éœ>ANœé#Nœ>MéMH

0M9: éœLOêVB W`BCW?TNœ>  S >AW`Yh>ANMH O [?. \ @ª@Cê S éM†î Èìuë#@ êVWR$î ôKBCWjéœìxWRî z >ABÔTx[jéªY˜[`êVW?TV>ANÃê'LO>#\^êV_?>ê'òÖéœ>MLÃ>AêVY˜[  S >AW`Yh>VH z >Kê  ]@Ôñ/éU[?>\ìx\>AWjé S \ êV@CTVìVLOBÔéU[`´ > = BCN 0M@?!A êVW`_\^ìx\>AWfé S \ ]ê'LOêV\>Méœ>ML M H  H FK@C@ªLU>AN S @CéUN/ê'LU>GêuôV>MLOê'TV>AN^ì7ôV>ML 0M BCW`_?>hï

>" ë#BCéU[@Ô>Aê'L˜W`BCW?TóL˜ê'éœ> J>AW`_?>AWjéU@Ôñ^éœLOêVB W?>A_GW?>Mé¸ë5ìVLUíZNë#BCéU[G_`B hJ>MLU>AWfé1ë5>ABÔTx[jéBCW`BÔéUB êV@CB ,Aê'éUBÔìxW` N ÖéU[?>ANœ> 0M BCW`BÔéUB êV@CB ,Aê'éUBÔìxW`N5ê'LU>õBC_`>AWféUBCYMêV@JòÖìVL>AêVY˜[ >hD  >ML˜BC\>AWjé ˜H )+*-, Œ†Žt`è z >,Nœé S _`ñ éœL˜êVBCW`BCW?T%NU>MéUN¾ë#BCéU¹ [ ” ÙQœ –——–CB žxH z >éœ>ANœé9êV@C@#NU>MéUN¾ë#BCéU[ ” وœ –——–ED ž%êVW`_ D Ù œ B–——– 0MMM ž=ÊNU>  S >AW]Yh>ANìVò”@Ô>AW?TVéUF [ # NMMM ˜H )+*-, ŒX$Ž'L‘'Iè z > S Nœ>é¸ë5ìóéœLOêVB W`BCW?T9Nœ>MéUN0Fõê† O [`>^NUêV\>^Nœ>MéõêVN S Nœ>A_ a ñ çìZ_?LOBÔT S >0,êVW]_ z BC@C>ANe   F ”jÙjœ –——–  žx€î Ö Ùeœ –——–  ž"ë#BÔéU? [ ”G•¹ÖG# N ÊNœ>  S >AW`Yh>ANõìVò5@Ô>AW`TVéUH[ # NKJ ˜H a  O [?>Nœ>Mé¿TxBÔôV>AW a (ñ ”jÙœ –——–  žxî ÖýÙœ –——–  ž=ÊNœ> S >AW`Yh>ANìVò×@Ô>AW?TVéU[F# JJ ˜H z >õéœ>ANœéÈêV@C@RNœ>MéUNëÈBÔéU[-”Ùœ –——–ED žxîvÖýÙœ –——–ED žêVW`_ D Ùœ  –——–tAM ž ÊNœ>  S >AW`Yh>AN#ìVò×@C>AW?TVéUF[ # NMM ˜H )eá, Œ  Ž  ›  è z >GNœé S _`ñé¸ë5ì íZBCW`_]NõìVòéœLOêVB W`BCW?TNU>MéU0N F a 5êVNœíZNòÖìVL#ê^\^Dê CœìVLTV>AW?>MLOêV@ B ,Aê'éUBÔìxWóNœéœ0> 4éU[`ê'é#Nœ>M>A\¾N#êV@C\ìxNUéBC \ JìxNUNUB a @Ô>Èê'
é /]LONœé1Tx@CêVW`Yh> F-IŒBÔôV>AWóôV>MLOñ9NOBC\^BC@Cê'L éœLOêVBCW]BCW?T9Nœ> S >AW`Yh>ANõë#[`ìxNœ>^NUB,M>AN¿_`Bh >ML a ñ ê'é/\ìxNœé N îÆ@C>Aê'LOW,éœì= `LUìZYh>ANUNõNU> S >AW]Yh>AN¿ìVò5ê'L a BÔéœLOê'LUñ NUB,M>JI z >^éœ>ANUé êV@C@ Nœ>MéUN#ë#BÔéUE[ ”ÙœLK –——–ED žxMî KjÙœ –——–CB î žêVW`_ D Ùœ B6–——–tAMM ž=ÊNœ>  S >AW`Yh>AN#ìVò×@C>AW?TVéUF[ # AMM ˜H O [?>/BC3W é W]BÔéUNê'LU>/ò @ @ÔñAYhéœ>A_éœì9ê^[`BC_]_?>AWG@CêAñV>MLŒYhìxW`NUB NœéUBCW?T^ìVò”\>A\^ìVLUñ @ÔìZYUíZNë#BÔéU[ Yh>A@C@o>AêVYO[RH O [`> Yh>A@C@ ì S é) S éUNõS ê'LU>^S ò S @C@Ôñ4YhìxW`SW?>AYhéœ>A_%éœìéU[?>¾Yh>A@C@ÀB W3 S éUNMîJéœì êV@C@×Txê'éœ>ANMî×êVW`_éœìóéU[?>¾ì S é) a S é S W]BÔéUNMîRë#[`B YO[êV@CNœì4[`êAôV>¾_]BÔLU>AYhé oœNU[?ìVLOéUY S é9qYhìxW`W?>AYhéUBÔìxW`N-òÖLUìx\ éU[?>¿BCW3 S é S W]BÔéUNÊ=×BÔT S LU> N ˜Hª=?ìVL1>AêVYO[GéUêVNUí¾ë5>õNœ>A@Ô>AYhéœ>A_9éU[?>Kéœì Jìx@ÔìVTVñ¾ë#BCéU["\¾BCW`BC\^êV@ W S \ a >MLìVòÀ\^>A\ìVLUñ a @ÔìZYUíZNéU[]ê'éÈNœìx@ÔôV>A_4éU[?>õéUêVNUíóë#BÔéU[?ì S é1>hD‚éœ>AW`NOBÔôV>. ]ê'L˜êV\>Méœ>MLŒì `éUBC\^B,Aê'éUBCìxWRH}Æê'LUTV>MLKéœì  ìx@CìVTxBÔ>AN W?>MôV>MLK@Ô>A_9éœì¾_`BCNOêV_?ô*êVWjéUê'TV>AN>hD?Yh>0 `éòÖìVLÈêVWBCW`YhLU>AêVNœ>õB WGYhìx\ S éUê'éUBÔìxW]êV@zYhìx\ ]@Ô>hD?BÔé™ñVH FK@C@ÆTxê'éœ>ANMîzéU[?>Yh>A@C@×BÔéUNœ>A@CòÀêVW`_ éU[?>ì é) é W`BÔéKê'LU> BCêVNœ>A_zH O [?> BCêVN#ë5>ABÔTx[jéUNŒéœìGBCW3 éÈTxê'éœ>VîzòÖìVLUTV>MéŒTxê'éœ>¾êVW`_ ì S )é S éKTxê'éœ>AN¿[`êuôV> aNœéU>Mê'>AéœW >ANò¼ì ê'S LUW]>9_BCW`>ABÔ\ éUB êV ¬@CBÔ@ÔLOñ4BCYMYMêV@C@Cìx@Cñ¾éœì9éœì(ë5,MìV>MLULUíì?îÀë5êV>AW`@C@ _R# î×ë5êV> NS éœNœLO>/êVBCéUW`[`B >AW?\âTG `òÖìVLUìVL¿TVêVLU@C>A@ÆNOìNœ>AS NMLŒî×>héU$D [? J> >MLOBCBC\^êVNœ>A>AWfN éUNMH >AYhz ìx\^BÔéU>ABCNUêVNUNKBÔôVBC>AW`@CBÔñ,éUB @CêV>A@CNUB ,AN ê'W?éUBÔ>MìxTxWRê'î éUBCYhôV>A>V@C@î êV@C@Ôì7ë#BCW?T éU[?>GNœ>MLOB êV@ªêVYhéUBÔô'ê'éUBÔìxWìVòKYh>A@C@CNêVNêVYhéUBÔôVG> ]ê'LOéUBCYMB ]êVWjéUNBCW éU[`>9a W`>Mé¸ë5ìVa LUí Yhìxe\ S éUê'éUBÔìxWRH O [?>9ò¼ìVLOTV>MéTxê'éœ>AN NœéUê'LUéÃìhYM@ÔìxNœ>A_Rî‚NœìõéU[`ê'éÀéU[`>#Yh>A@C@CNÀB W`BÔéUBCêV@C@CñõLU>A\>A\ a >MLÀ>MôV>MLUñ‚éU[`BCW?T?H z >ÈêV@ NœìõéœLOBÔ>A_¾_`B hJ>MLU>AWfé a BCêVNÀYhìxW3/`T S LOê'éUBÔìxW`N # éU[?> LU>AN S @ÔéUNë5>MLU >  S êV@ BÔéUê'éUBÔôV>A@Ôñ9éU[?>NUêV\>Vî ë#[`BCY˜[N S I  ìVLOéUN1ì S LŒYM@CêVBC\ éU[]ê''é `LO>AYMBCNœ>/B W`BÔéUBCêV@C|B ,Aê'éUBÔìxWGBCN#W`ìVéÈYhLOBÔéUB YMêV³@ ; Nœ>M> êV@CNœìiÈì‚Y˜[?LU>ABÔéœ>MLÀêVW]_X?YO[`\^B _`[ S`a >ML &% ”êVW`_^IK>ML˜NMî‚XZY˜[`\^BC_`[ S?a >MLAî*êVW`_jr S \^\¾BCW`N NMMM ×ò¼ìVLÀêV_`_]BÔéUBÔìxW`êV@j>Mô‚B _?>AW`Yh> BCWéU[]BCN¿ôV>ABCWRH"FÈ@ @×ìVéU[?>ML ë5>ABÔTx[jéUN/ê'LU>A_ LOêVW`_?ìx\^@Cñ4BCWéU[`>^LOêVW?TV> Þ î M—| –9M—| !ß H O [?>^Yh>A@C5@ w N BC3W é¿9N  êVNU[`BCW?T ò S W`YhéUBÔìx¿BC_?>AWjéUBÔé™ñ¾ò S W`YhéUBÔìxWRH O [`>K9N  S êVNU[]BCW?T ò S W`YhéUBCìxWŒì S )é S é S W]BÔéUNªB N5êNUBCTx\ìxBC_"ò S W`YhéUS BÔìxWM>0 ][?ìx@Ô>Vî  S W]BÔéqï}éœì'ï S W`BÔé1êVW`_ Š a BCêVNYhìxW]W?>AYhéUBÔìxW`N ˜H )eá, Œ†ŽX›!Iè z > S Nœ>éU[?>^éœì Jìx@ÔìVTVñ%êVN ò¼ìVLõéU[`>jŒ†Ž'L‘' @CêVW`T S ê'TV>Vî a¬S é¿ë#BÔéU[ J B W3 S é¿êVW`_ì S é) S é S W`BCéUN1BCW`Nœéœ>AêV_9ìVò A î`LU>AN S @ÔéUBCW?TBCW M êVK_ C S NœéUê a @Ô>Œë5>ABÔTx[féULN " J>M0> ][?ìx@Ô>Vî %N S W`BÔéqï}éœì'ï S W]BÔé1êVW`_ N a B êVN1YhìxW`W?>AYhéUBÔìxW`!N ˜H A

Out

Memory Block with one Cell

Output Gate Forget Gate Input Gate

In

=×BÔT S LU> N F O [`LU>M>hï¸@CêAñV>MLLX O  éœì Jìx@ÔìVTVñ ë#BÔéU[,êGNUBCW?Tx@C>B W3 S éŒêVW`_,ì S é) S éMHç#>AY S LULU>AW]Yh>B N¿@CBC\^BÔéœ>A_ éœìGéU[?>^[]BC_`_?>AW @CêuñV>MLAî?YhìxW`NUBCNœéUB W?Tõ[?>MLU>ÈìVòoê NUB W?Tx@Ô>×X O  \>A\ìVLUñ a @Ôì‚YOíë#BÔéU[^êNUBCW`Tx@Ô>Yh>A@C@ H”FK@C@ 0M o S W`BÔéqï}éœì'ï S W`BÔé9qõYhìxW`W`>AYhéUBÔìxW`N-ê'LU> NU[?ì7ë#Wˆ a]S é a BCêVN1êVW`_G J>M>0 ][`ìx@Ô>¿YhìxW`W?>AYhéUBÔìxW`NÈê'LU>õW?ìVé˜H > r-€= ¸Œ  Ž  îNU[?ì7ë#BCW?TúÖò¼LUìx\@Ô>MòÖé¾éœì LOBÔTx[jééU[`>4W S \ a >MLAW S W`BÔéUN¾ìVL O ê a @Ô> Fx@ÃLU>MôZBÔì S NAN S @ÔéUN¾ò¼ìVL"éU[?x NœéUê'éœ> S W`BÔéUNMîÃéU[?>Gô*êV@ S >ANìVò” S Nœ>A_ _ S LOBCW?T éœLOêVBCW`B W?T?îÀéU[?>óW S \ a >MLìVòŒéœLOêVB W`BCW?T,Nœ> S >AW`Yh>ANMî5éU[?>W S \ a >MLìVòKòÖì S W`_ Nœìx@ S éUBÔìxW`N /7éœLOB êV@CN-êVW`_GéU[?>õ@Cê'LOTV>ANœé#êVYMYh0> `éœ>A_4éœ>ANœé#Nœ>MéMH ç>MòÖ>MLU>AW`Yh> KBC_`_`>AW O LOêVBCWRH X‚ìx@ \H / 75>ANœé O >ANœé O LOêVB WRH *KW`BÔéUN X‚>M é Þ ” ß X‚éœLAH Þ 0MJ]!ß O LOB H ޔ ß }X S W9>MéÈêV@ HÔî Š tò A

–——– "M

Š H A

/

–——– "M Bz @Ô>AN sª@C\^êVWRî A q† N –——–  NMMM J / NM –——– > N  z BC@Ô>ANMî &%  N –——– 0M O ìxW?íV>A

0M

Š / 0MM

–——– N ÊçìZ_?LOBÔT S 0> ,¿>Mé#êV@ HÔî  _^ N –——–  N"&% > / AM

–——– " 0€½`0 j Å Á(a55ÀbÆGÁ9IÆcb
S&Æ )+*d, ŒX$ Ž`è?@

@CB NU[?>A_,LU>AN @ÔéUNõìxWéU[?>"N \^\¾ê'LOB,M>A_ B W O ê @Ô> H4çÈN/éœLOêVBCW?>A_ ë#BÔéU[ˆ ]@CêVBCW œé >AW`_,éœìóS?@Ca >Aê'LOW éœìLC S NUS éÈLU>0 ]LUì‚_ S Yh>/éU[`>B W3 S é S z BC@C>AN»S sª@C\^êVWRî A q #O a ìxW?íV>AN z B @Ô>ANMî &%X# ç#ì‚_`LOBÔT S >0, >MéêV@ HÔî  ˜HX S W >Mé/êV@ Hˆ Š  S Nœ>A_ê[`BCTx[`@Ôñ,N) J>AYMBCêV@CB,M>A_%ê'L˜YO[`BÔéœ>AYhé S LU>Vî×éU[?>doœW?> S LOêV@2 S NU[`_?ì7ë#W%ê S éœìx\^ê'éœìxWIqZî ë#[`B YO[GêV@CNœì^_]BC_GW?ìVéTV>AW?>ML˜êV@CB,M>¿ë5>A@C@2}X S WG>MéÈêV@ HÔî Š$# ‚ŒêVNMîJIŒBC@Ô>ANMî X S WRî N ˜H )+*-, ŒX$ŽL‘'`èGç#ì‚_?L˜BÔT S 0> ,êVW`_ z BC@Ô>ANj >  S Nœ>A_‰7 @ OO ï¸çÈNõë#BÔéU[ A [`B _`_?>AW,W?ìZ_?>ANMHF#òÖéœ>ML éœL˜êVBCW`BCW?T ë#BÔéU[ A fe 0MJ] NœéœLOBCW`TxNŒë#BÔéU([ ”G•pÖg# N ÊNU> S >AW]Yh>AN¿ìVò5@C>AW?TVéU[h# NKJ ˜îÆ\ìxNœéõW`>Mé¸ë5ìVLUí‚N TV>AW?>MLOêV@CB|,M>A_,ìxW%@ÔìxW?TV>ML¿ìh ï éœLOêVBCW]BCW?T^Nœ>MéŒNœéœLOBCW`TxNMH O [?> a >ANœéKW?>Mé¸ë5ìVLUíóTV>AW?>ML˜êV@CB ,M>A_óéœì9Nœ>  S >AW`Yh>AN S éœì"@Ô>AW?TVéU[ Š" S”‰Ñ  î ÖªÑ  ˜H 7 S éKW?ìxW?> ìVò éU[?>A\ @C>Aê'LOW?>A_GéU[?>õYhìxe\ ]@Ô>Méœ>õéœLOêVB W`BCW?TNœ>MéMH )eá, Œ  Ž  ›  è O ì¾ì S LíZW?ìuë#@C>A_?TV>õW?e ì `LO>Mô‚BÔì S N5'ç ' >MôV>MLK@Ô>Aê'LOW?>A_ójê r#X ÀH 7 @ O
O

0€½ji f k lW1nm opIÆcb3Sq&Æ )+*d, Œ  Ž  è 0MMr

UN ìx@ÔôV>A_ òÖìVLMéUN O ê a @Ô> N ˜H XZ\¾êV@C@-éœLOêVBCW`B W?T%Nœ>MéUNS” Ùdœ –——– 0M žKMLO>êV@ÔLU>AêV_?ñ N 1AWféÈò¼ìVL J>MLUòÖ>AYhéÈTV>AW`>MLOêV@CB,Aê'éUBÔìxW éœì"éU[?>éœ>ANœéœ>A_,\^ê*DZB \ \=Fu” ÙLœ –——– 0MMM žxH ÈìVéœ>éU[]ê'éŒ@CìxW?T"NU> >AW]Yh>ANÈìVò éU[`S BCN-íZBCW`_9LO> S BCLU>ŒôV>MLUñGNœéUê a @Ô>Vî3/]W`>A@Ôñ¾Sé S W`>A_óYhìxWféœLOìx@RìVò×éU[?>õW?>Mé¸Së5ìVLUívw NÈB Wféœ>MLOW]êV@RYhì S Wféœ>ML˜N5r-êVNœ>MñVî " ˜H S O [`B Ni J>MLUò¼ìVL˜\^êVW`Yh>Méœéœ>ML/éU[]êVW ë#BCéU[x `LU>MôZBÔì S N/ê  `LUìxêVY˜[?>ANMî”ë#[`>MLU>¾éU[?>"@Cê'LUTV>ANœéNœ>Méë5êVN@Ô>Aê'LOW`>A_ a ñéU[?> N) J>AYMBCêV@C@Cñ _?>ANUBÔTxW`>A_W?> S LOêV@ S NU[Zï¸_?ì7ë#Wê S éœìx\^ê'éœìxW(}X S W>MéÃêV@ HÔî Š$# ‚KêVNÃ>MéÃêV@ HÔî N F”Ùiœ –——– "M žxH O [`>-@ ê'éœéœ>MLAî [?ì7ëª>MôV>MLAî”LO> S BCLU>A_éœLOêVBCW]BCW?TóNœ> S >AW`Yh>AN/ìVò1éU[?>AW`TVéU[ êVN/éU[?>¾éœ>ANœéNœ> S >AW`Yh>ANMHó=`LUìx\3éU[`>¾éœLOêVBCW]BCW?TóNœ>Mé/ë#BÔéU[ s2tvu wx yzq{2|}~w }~w87yq€_z‚|yW|Eu ƒX€„wz€†…fy'z€„‡R}~yq€‰ˆŠ&yq€†‹u €„w8Œ„€„y"ƒX}yqŒ_Ž\|Eyqyq}c€†…+…8u8{}~w8dz€_y'z}w88‘Y|w …’}~w&z“ €5cw |Ž”|EŒ„Œ„€„‡Lz€†…’yq€•zW–|EyW}~w — ˜™~šš~™_›œž €_ŸLŒ„€„‡Lz ¢¡{ ›Eœ {2|wc…L¡£ƒ¤yq€„‹vu8€„w Œ_€„yRu ‡.z¡¥Ž€_w z“7–¦ ˜†§œ.¨ z“ €W€•Ÿ |EŒ_zR£€_w €_{2|EŽ}~©†|Cz}~¡£wª‡J€_{q ¢¡E{ƒd|w8Œ„€‚|Ey"u8w Œ„Ž~€†|C{•«•¬ ­_® ‡ ‡8Ž~ŠL}~w dˆL{u8z€5 ¢¡{Œ_€‰yq€†|E{Œ2“ªz¡-z“8€
M€„}~£“zy‚¡ z“ €
ˆJ€„y'zWw8€_z¯M¡{°f¡E M±¡v…L{}~£u8€„©¥€•z5|ŽMé.Þ ” ß

–——– 0MMM

–——–tA>&%

–——– 0MMM

–——– 0MMM

–——–%"&%

–——–  > 

–——– J†> 

–——–)J&M&> 

–——–t"N> 

–——–)J†ŠM 

O ê @Ô> N F ÁÀ†˜¨™§x„–•q¨×®C’uˆÀ•™µx†Ø'ÙxڜÙ/„‡ƒu‘x«u§jƒA«u†7€V¨¸µx’M“”‰‡‘x«»Ô®CˆŠ’u¯ „…†O®Ô•”•™’¿ˆŠ‰…«7µ*•q½Æ•™µf†1¦hƒu„…§f†˜¨×®C’7Wˆ ·Mé Þ ” ß X‚éœLAH Þ 0MJ]0ß X‚ìx@ H XZ>Mé Þ ” ß

–——– 0M

–——–tNM

–——–tŠM

–——–)J&M

–——–tAM

0M–  NM–tN ŠM–tŠ J&M–)J AM–tA

AKJ N > &Š % A "M NKJ >N J†N >AKJ ŠN

"N  J†Š  †J Š  †J >  KJ  %>  "N"  >AA 

A&%  "N 

0MM

0MM

0MM M

0MM

0MM J&M ŠM J&M "M

–——–tAN

–——– "M

–——–tNN>

–——–tAMM

–——–tAMM $–——– N

0M–——–tN&% N$–——–tŠKJ NM–——–tA&% J†Š$–——–tA&%

–——–tN> 

–——–t"" 

–——–t 

–——– NM 

–——–)J&M& 

0M–——–  

%X–——–tNŠ  N$–——–tŠN  ŠA$–——–)J†A  JX%X–——–tAA 

O ê @Ô> Š F Á”†­¨¸§x„…•Š¨z®C’uˆR•Šµx†ÃØ'ÙxڜÙVÛUÙK„EƒA‘x«7§fƒA«7†u€u¨™µx’M“”‰‡‘x«¿»Ô®CˆŠ’u¯ „…†O®Ô•o•Š’1ˆ™‰‡«uµ*•q½¬•Šµx†Ã¦Mƒu„…§x†­¨J®C’uˆ ·§j¨¸†­š¿šV§xˆŠ‰…‘x«-•ŠˆŠƒu‰…‘f‰…‘x«j€A•Šµx†Ãƒh¦u†˜ˆŠƒu«u† ‘'§x¯#a ̂†Oˆ1’u®Æ•ŠˆŠƒu‰…‘f‰…‘x«¨™†˜³*§x†O‘j´U†˜¨-§f‘7•Š‰…„oÌj†­¨}•«7†O‘x†˜ˆŠƒu„…‰‡—˜ƒA•™‰‡’u‘^“׃u¨1ƒ7´qµx‰…†˜¦u†­š?€Z•™µx†¿±‚†Oˆq´U†˜‘*•ŠƒA«7†È’u®×´O’uˆŠˆ™†­´œ•1¨¸’7„…§x•™‰‡’u‘f¨1ƒu‘fš^•Šµx†¿Ì‚†˜¨¸• «u†˜‘x†OˆqƒA„‡‰‡—˜ƒM•Š‰…’7‘AW`>MLOêV@CB ,M>A_éœ< ì ”LÙœ –——– 0MMM žxîRë#[`>MLU>AêVN#éU[`> >ANœ
é `LO>Mô‚BÔì N1LU>AN @C.é ÊNœ>M> O ê @Ô> -TV>AW?>MLOêV@ B ,M>A_ ìxW`@Ôñ"éœìj”Ùiœ –——– > ž6Ö>MôV>AWëÈBÔéU[óê^NU@ BÔTx[féU@Cñ"@Cê'LOTV>ML#éœLOêVBCW]BCW?TNœ>Mé0F}”.aÙiœ –——–  žK˜S H
qWóYhìxS WjéœLOêVNœéKéœì Oa ìxW?íV>AN#êVW]_ z BC@Ô>AN T `LUìVTVLU>ANONœ>ANMH,XZì S W`@ BÔíV>¾êV@C:@ `LU>MôZBÔì S N

&% ˜îÃë5>9_`BC_%W?ìVéì a Nœ>MLOôV>Mé™ëªìVLUíZNò¼ìVLOTV>MéœéUBCW?T,Nœìx@ S éUBÔìxW]N êVNéœLOêVBCW`B W?G ê  `LOìxêVYO[?>ANM`î X O 3LU>A@CB ê a @Ôe ñ /]W]_`N-Nœìx@ S éUBÔìxW]N-éU[`ê'éTV>AW?>MLOêV@ B ,M>õë5>A@C@ H > n S Yhé S ê'éUBCìxW`NÀBCWTV>AW`>MLOêV@CB ,Aê'éUBÔìxjW J>MLUò¼ìVL˜\^êVW`Yh>1òÖìVLª_`B hJ>MLU>AWjéÀéœLOêVBCW]BCW?T¿Nœ>MéUN5BCW O ê a @Ô> N \¾êAñ a >_ S >éœì/éU[?>òÊêVYhé O [`
éU[`ê'é/ëª>"_`BC_%W?ìVé/ì `éUBC\^B|,M>TV>AW?>MLOêV@CB,Aê'éUBCìxWˆ J>MLUòÖìVLO\^êVW`Yh> a ñ S NUB W?Tóêóô'êV@CBC_`ê'éUBCìxW%Nœ>MéMHEŠW]Nœéœ>AêV_ ë5>A_ >AêVYO[40> Jì‚Y˜ˆ[ 5Ñ 0MMM Nœ>  S >AW`Yh>AN 5ìxW`Yh> éU[?>õéœLOêVBCW]BCW?TNœ>Méë-êVN#@Ô>Aê'LOW`>A_RH )+*-, Œ  Ž    ‘  è O LOêVBCW`BCW`T4Nœ>Méê†F 0MMr Nœìx@ÔôV>A_ # ê'òÖéœ>ML N¸eI 0M ] éœLOêVB W`BCW?T Nœ> S >AW`Yh>ANéU[?> a >ANœéW`>Mé¸ë5ìVLUíìVò é ” – Ö Ù œ –——–tNN ž‰ÊêV@ @NUéœLOBCW?TxN ,éœìGê"@C>AW?TVéU[ ìVò >> NœñZ\ ìx@C'N `LUìZYh>ANUNœ>A_,YhìVLULO>AYhéU@Ô3ñ  # éU[?>

0M TV>AW?>MLOêV@ B ,M>A_ éœì9ê'éõ@C>AêVNœ êAôV>ML˜ê'TV>KTV>AW`>MLOêV@CB,Aê'éUBÔìxWMé5ë5êVNªéU[?>ìxW?>Èë#BÔéU[j” – ÖýÙœ –——S– " žjÊêV@C@]NœéœL˜BCW?TxN S Aa W?TVéU[^ìVò "KJ NœñZ\ a ìx@CN ]LUì‚Yh>ANONœ>A_ YhìVLULU>AYhéU@C3ñ ˜î]@C>Aê'LOW?>A_óê'òÖéœ>ML NAfe& 0MJ] éœLOêVBCW`BCW`TNU>  S >AW]Yh>AN1ìxWóêAôV>ML˜ê'TV>VH O LOêVBCW`B W?TóNœ>Mé a F 0MMr Nœìx@CôV>A_ # ê'òÖéœ>ML N"¹e 0M ] éœLOêVBCW`B W?TóNœ>  S >AW`Yh>AN/éU[?> a >ANœéW?>Mé¸ë5ìVLUí%TV>AW?>ML˜êV@CB ,M>A_%éœì,ê'é@Ô>AêVNœé ” – Ö¸Ù.œ –——–tNŠ žÊêV@ @oNœéœLOB W?TxN S WjéUBC@Æê¾@Ô>AW?TVéU[4ìVò N Nœñ‚\ a ìx@C
N ]LUì‚Yh>ANONœ>A_YhìVLULO>AYhéU@Ô3ñ ˜H O [?>êAôV>MLOê'TV>TV>AW?>ML˜êV@CB ,Aê'éUBÔìxW4Nœ>Mé ë-êVNÈéU[`>/ìxW?>/ë#BÔéU[ ” – Ö ÙLœ –——– % ž=ÊêV@ @ÆNœéœL˜BCW?TxN S WféUBC@ÆêAW?TVéU[ìVò "> NœñZ\ a ìx@
N `LUìZYh>ANUNœ>A_ YhìVLULU>AYhéU@C3ñ ˜îR@Ô>Aê'LOW`>A_ê'òÖéœ>ML H *ÈW`@ BÔíV>õéU[?L> `LU>MôZBÔì S Nê I `LUìxêVYO[ ìVòÃç#ì‚_`LOBÔT S 0> , êVW]_ z BC@Ô>ALN > ˜Uî X O  >N&e$ 0M ] éœL˜êVBCW`BCW?T  S >AW`Yh>AN#ìxW êAôV>ML˜ê'TV>V >AêVNUBC@Cñ"@Ô>Aê'L˜W`N-éU[?>õYhìx\ ]@C>Méœ>õéœLOêVBCW`B W?TNœ>Mé#êVW`_GLO>A@CBCê a @Ôñj/]W`_`N-Nœìx@ S éUBÔìxW`N-éU[`ê'éTV>AW`>MLOêV@CB,M>õë5>A@C@ H )eá, Œ  Ž  ›  è
X O  @Ô>Aê'LOW`N J ìVòoéU[`> A éœL˜êVBCW`BCW?TNœ>MéUNB W 0M ì é5ìVò 0M éœLOBCêV@  N ÖìxW]@Ôñ  ì é1ìVò 0M ò¼ìVL1éU[?>¿éœL˜êVBCW`BCW?T Nœ>Méªë#BÔéU[ ”Ùœ –——–)J&M žKªêVW`_¾TV>AW?>MLOêV@CB,M>ANÃëª>A@ @U O ê a @Ô> Š ˜HªXZ\^êV@ @ZéœLOêVS BCW`BCW`TŒNU>MéUNS”Ùœ –——–)J&M žKS Ãë5>MLU>ÈêV@CLU>AêV_?ñN S 1¾YMBÔ>AWjé òÖìV'L J>MLUòÖ>AYhé#TV>AW?>ML˜êV@CB ,Aê'éUBÔìxW S éœì"éU[?> éœ>ANUéœ>A_ \¾ê*DZBC\ S G\ F”LÙœ –——–tAMM žxîRéU[`ê'éŒBCNMî Nœ>  S >AW`Yh>ANÈìVòÀ@Ô>AW?TVéU[ S éœì AMM H sÀôV>AWAW]Yh>ìVò êVWjñNU[?ìVLUé”éœL˜êVBCW`BCW?T¿Nœ> S >AW`Yh>ANS”Ùœ B î –CB žK2X O Í@Ô>Aê'L˜W?>A_ë5>A@C@HÊNœ>M> a ìVéœéœìx\ []êV@Ôò¬ìVò O ê a @Ô> Š ˜H ñ `LU>ANœ>AWjéUBCW?T>AêVY˜[ >hDZ>A\ ]@ ê'LUñ¿NœéœLOBCW?T1ëÈBÔéU[?ì yé `LOìuôZBC_`BCW?T1êV@C&@  ìxNONUB @Ô> z >-êV@CNœì#\^ì‚_`|B /`>A_ŒéU[?>ÀéœLOêVB W`BCW?uT `LOì‚Yh>A_ LU>Vî  W?>hDZéÀNœñZ\ a ìx@CN”êVN”éUê'LOTV>MéUNMî a¬S é”ìxW`@Ôñ/éU[?>NœñZ\ S a ìx@Za éU[`ê'éÃêVYhé S êV@C@Ôñì‚YMY S L˜NÀBCWéU[?>Y S LOLU>AWfé”>hDZ>A\ ]S @ ê'LAH O [`BCN×@Ô>A_éœì NO@CBÔTx[ja éU@Ôñ @ÔìxW?TV>ML#éœLOêVBCW`BCW`T_ S LOê'éUBÔìxW`NAî a¬S é1_`BC_GW?ìVé#NOBÔTxW`B/]YMêVWjéU@Ôñ¾Y˜[`êVW?TV>/éU[?>¿LU>AN S @CéUNMH %

S a a a a a a a a a a a T b b b b b 1

b b

b b

b b

b b

b T

: input : target

0

a b T

-1 10

sc1 yc 1

0

1.0

0.0

y in 1 y out 1 y ϕ1

0 1 2 3 4 5 6 7 8 9 10 Time =×BÔT S LU> Š F'r-=€ Œ†ŽtxS”xÑ A F O >ANœéKL S Wë#BÔéU[4W?>Mé¸ë5ìVLUíNœìx@ S éUBÔìxW`NMH O ì HFuÈ>Mé¸ë5ìVLUíì S é) S éÇ&üfH'B _`_`@Ô>F
r5>A@C@ÆNœéUê'éœ> É È êVW]_"Yh>A@ @Jì S é) S é Ç È H257 ìVéœéœìx\GFªFKYhéUBÔô'ê'éUBÔìxW`N-ìVòéU[?>ŒTxê'éœ>ANÊBCW3 S éªTxê'éœ>iÇÌ  î?ò¼ìVLUTV>Mé1Txê'éœ>.Ç†Í É È B W`YhLU>AêVNœ>ANKë#[`B @Ô>.ŒóNœñZ\ a ìx@ NÈê'LU>òÖ>A_,BCWféœì"éU[?>W?>Mé¸ë5ìVLUí îRéU[?>AW,_?>AYhLU>AêVNœ>ANeÖëÈBÔéU[ éU[?>NOêV\>Nœéœ>0 O [`>Yh>A@C@NœéUê'éœj NUB,M>D×ë#[`BC@Ô
> Ž-NœñZ\ a ìx@ NÀê'LU>òÖ>A_¾BCWzHF-é5Nœ>  S >AW`Yh> a >MTxBCW`W`B W?Tx
N Öë#[?>AWéU[`
> /`LONœ2é ŒNUñ‚\ a ìx@CN”ê'LU>#ì a Nœ>MLUôV>A_`˜î‚[?ìuë5>MôV>MLAîZéU[?> Nœéœ>0 GNUB ,M>ŒBCN5NU\^êV@C@C>ML5_ >#éœìéU[?>ŒYM@ÔìxNœ>A_9BC3W éÀTxê'éœ>Vî`ë#[`B YO[¾B NÃéœLOBCTVTV>MLU>A_ A@ÔòŠH O [`BCNªLU>AN @ÔéUN5BCdW oqìuôV>MLONU[`ìjìVéUBCW`T&q éU[?>BCW`BÔéUBCêV@Jô'êV@ S > ìVò:É ÈS ê'éÈéU[?> >AW]_óìVòÀê¾NU> S S >AW]Yh>Vî¬ë#[]BCYO[óB Wóé S LOWóéœLOBÔTVTVa >MLONÈéUÈ [?> ì J>AW`B W?TìVò”éU[?S > ì S é) S éTxê'éœ>VîJë#[`B YO[ BCW9é S L˜WG@Ô>AêV_`N1éœì^éU[`> `LU>A_`B YhéUBÔìxW"ìVòéU[`>õNœ>  S >AW`Yh>õéœ>MLO\^B W`ê'éUBÔìxWRH )+*-, ŒX$Ž'L‘'Iè O [?> a >A[`êuô‚BCìVLìVòê^é¸ñ$ ]BCYMêV@zW?>Mé™ëªìVLOí9NUìx@ S éUBÔìxWGBCN#NU[?ìuëÈWGBCWG=×BÔT S LU> J H N Œ¬³î ‘iÈêVW`_ °ŽuHî e#ê'LU> O [`>W?>Mé™ëªìVLOí4@Ô>Aê'LOW`>A_éœì9>ANœéUê @ BCNU[êVW]_ YhìxWjéœLUìx@×é™ëªìGYhì Wjéœ>MLONMH O [`> é¸ë5ìóNœñZ\ ìxë@ ]êVBÔLO éœLU>Aê'éœ>A_Nœ0> ¬ê'LOê'éœ>A@Ôñ a ñ%é™ëªì_`B hJ>MLUa >AWjéYh>A@ @CNM2î › ^ êVW]d_ › ò îÀLU>A9N  S >AYhéUBCôV>A@ÔñVˆH r5>A@C:@ › ^ éœLOêVa YUíZNéU[?>9_`B hJ>MLU>AW`Yh> a >Mé¸ë5>M>AW;éU[?> W S \ a >ML-ìVòoì a Nœ>MLUôV>AG_ Œ¾êVW]G_ ‘ NœñZ\ a ìx@CNA+H Šé-ì J>AW`N-ìxW`@Ôñ¾ê'é1éU[`>K>AW]_9ìVòÆêNœéœLOBCW`T?î‚ëÈ[?>MLU>¿BÔ}é `LU>A_`BCYhéUN5éU[?i> /¬W`êV”@ /Hr5>A@C@ › ò éœLU>Aê'éUNÈéU[?>õ>A\ a >A_`_?>A_6Ž    N S?a NœéœLOB W?TBCWóê^NUB \^BC@Cê'L-ë-êAñVH z []BC@Ô>¿ô'êV@ S >ANê'LU>NœéœìVLU>A_4êVW`_ó\^êVW`B| S @Cê'éœ>A_9ë#BCéU[`BCWGê Yh>A@C@ î¬éU[?> ì S )é S é#Txê'éœ>LU>A\^êVB W`N#YM@ÔìxNU>A_RH O [`BC
N `LU>MôV>AWjéUNÈéU[`>/Yh>A@C@oò¼LUìx\ _`BCNUé S L a BCW`T/éU[?>/LU>ANœéKìVò”éU[?>/W`>Mé¸ë5ìVLUíêVW`_4êV@CNœì `LUìVéœ>AYhéUNÈBÔéUN'r s r ê'TxêVBCW`NœéÈBCW`Yhìx\^BCW`T>MLOLUìVLONMH )eá, Œ†Žt$›!Iè O [?>#W`>Mé¸ë5ìVLUí^Nœìx@ S éUBCìxW`N S Nœ>Èê Yhìx\ a BCW`ê'éUBÔìxW¾ìVòRé¸ë5ìYhì S Wféœ>MLONAî‚BCW]NœéUêVWféUB ê'éœ>A_¾Nœ0> ]ê'L˜ê'éœ>A@Ôñ^BCWéU[?>Èé¸ë5ì \>A\ìVLOñ a @Cì‚YOí‚N.Ê=×BÔT S LU> A ˜H È>MLU>"éU[?>AYhìxW]_Yh>A@C@ªYhì WjéUN zîoTxBÔôV>AW êVQ W ŒBC3W éõNUñ‚\ ìx@ GH ™éYhì WjéUN/_?ì7ë#WRî×TxBÔôV>AW ê Ž7H~ F ›^B W%éU[?>"BC3W é YMê S Nœ>ANŒéU[`>BCW S é#Txê'éœ>éœìGYM@ÔìxS NU>êVW]S _4éU[`>/òÖìVLUTV>MéŒTxê'éœ>éœS ìGLU>ANœ>MéŒa éU[?>Yh>A@C@×NœSéUê'éœj> É È H O [?>NU>AYhìxW`_,\>A\ìVLUñ a @Ôì‚YOí_?ì‚S >AN éU[?>¾NOêV\>¾òÖìVL Ž7+î ›*î×êVW`x_ Œ¬îÆLO>A)N J>AYhéUBÔôV>A@ÔñVH O [?>ì J>AW`BCW?TGìVò-ì S )é S éõTxê'éœ>¾ìVò-éU[?e> /]LONœé a @Cì‚YOí BCW]_`BCYMê'éœ>AN¿éU[?>¾>AW`_ìVòê NœéœLOB W?T=ÊêVW`_GéU[?> ]LU>A_`BCYhéUBÔìxW9ìVòéU[?> @ êVNœé‰˜î`éœLOBCTVTV>MLU>A_GôZBCêBÔéUNu J>M>0 ][?ìx@C>ŒYhìxW]W?>AYhéUBÔìxWRH z [fñ _?ì‚>ANéU[?>GW?>Mé¸ë5ìVLUíW`ìVéTV>AW`>MLOêV@CB ,M>9òÖìVL^NU[?ìVLUéNœéœLOBCW`TxN/ëÈ[?>AW S NUBCW?T ìxW`@Ôñé™ëªì%éœL˜êVBCW`BCW?T NœéœLOBCW`TxN/êVNòÖìVLéU[?> ŒX$ŽX›!@CêVW?T ê'TV>ÊNU>M> O ê @Ô> Š )“ O [?>-Txê'éœ>KêVYhéUBÔô'ê'éUBÔìxW`NÃBCW=×BÔT LU> A NO[?ìuë éU[]ê'éÃêVYhéUBÔô'ê'éUBÔìxW`NÃNO@CBÔTx[jéU@Ôñ/_?L˜BÔò¼é×>MôV>AW¾ë#[?>AW éU[?>^BCW S é¿NœéUS êAñZN YhìxW]NœéUêVWféMa HGX‚ìx@ S éUBCìxW`NKéUê'íV>¾éU[`BCN¿NUéUê'éœ>

S a a a a a b b b b B B B B A A A A A : input a aa a aa b b b b T b b b b b B B B B B B B A A A A A T : target 1 a b A 0 B T -1

sc1 yc 1 sc 2 yc

10 5 0

2

1.0

0.0 0

5

10

15

y in 1 y out 1 y ϕ1 y in 2 y out 2 y ϕ2 Time

×= BÔT S LU> J Fur-=€ˆŒX$ŽL'‘'(S”'Ñ A$– ÖBÑ J F O >ANœé#L S W9ë#BÔéU[GW`>Mé¸ë5ìVLUíóNœìx@ S éUBCìxWRH O ì UF:#>Mé™ëªìVLOíGì S é) S éuÇ&üfHB _`_`@Ô>F r5>A@C@RNUéUê'éœ>LÉ êVW`_óYh>A@C@Rì S é) S é
Ç È H75ìVéœéœìx\GF-FKYhéUBÔô*ê'éUBCìxW`NìVò×éU[?>¿Txê'éœ>ANÊBCW3 S é-Txê'éœ>.ÇÌ  î`òÖìVLUTV>MéTxê'éœ>LdžÍ9êVW`_Gì S é) S é Txê'éœ>.Ç&ΫÏЩ˜H È éœì‚ì/YMêVNU> ë#[?>AWóéU[?>/Nœ> S >AW`Yh>ANÈê'LU>/\ S Y˜[NU[?ìVLOéœ>ML#ìVLÈ@CìxW?TV>ML#éU[`êVWéU[?>õòÖ>Më ì a NU>MLUôV>A_éœL˜êVBCW`BCW?T >hD?êV\ ]@Ô>ANMH O [`BCN1BC\ JìxNœ>AN1ê¾@CBC\^BÔé5ìxWGTV>AW?>ML˜êV@CB,Aê'éUBÔìxWóB Wˆ¥9T\SZ_`BCLU>AYhéUBÔìxW`NÖéœì7ë5ê'LO_]N#@ÔìxW?TV>MLÈêVW`_óNU[?ìVLOéœ>ML#NœéœLOBCW`TxN˜H z > òÖì S W`_GNœìx@ S éUBÔìxW`N-ë#BÔéU[G@C>ANUN_?LOBCò¼é5éœì¾TV>AW?>ML˜êV@CB ,M> a >Méœéœ>MLAH *´¼ ã â8½ ßj¿ 㠾ʈä ã ã ÀYÁ ß‚äßZÝ â å ècsÃôV>AW >Méœéœ>MLGLU>AN @ÔéUN9YMêVW >,ì éUêVBCW`>A_ éU[?LUì Tx[ BCW]YhLU>AêVNœ>A_ éœLOêVBCW]BCW?T éUB \>%êVW`_ Nœéœ0> ‚ë#BCNœ>4LU>A_ S YhéUBCìxWèìVò¿éU[?>,@Ô>Aê'LOW]BCW?T%LOê'éœa >VîÈêVN"_`ìxW?>4S BC‹W ÊçìZ_?a LOBÔT S a0> ,>Mé9êV@ HÔî S  ˜H O [?> _`BCNœéœLOB a]S éUBÔìxW;ìVò @C>AW?TVéU[`N ìVòNœ> S >AW`Yh>ANBCW éU[?>¾éœLOêVB W`BCW?TNU>MéêV@CNUì4êKhJ>AYhéUN@C>Aê'LOW`BCW?T4N) J>M>A_ êVW`_TV>AW?>MLOêV@CB|,Aê'éUBÔìxWRHF Nœ>MéYhìxWjéUêVBCW`BCW?T \ìVLU>"@ÔìxW?T Nœ>  S >AW`Yh>AN"BC\ `LOìuôV>ANAW?>MLOêV@CB ,Aê'éUBCìxWèòÖìVLML"Nœ>  S >AW`Yh>ANA‹H 4Œ\^BÔéœéUB W?TéU[?>4NU>  S >AW]Yh>4ë#BCéU[ ”ˆÑ ÊêVW`B_ ÖàÑ ˜î é¸ñ$ ]BCYMêV@ @Ôñ;éU[?>4@CêVNUé^ìxW?>éœì a >@Ô>Aê'LOW`>A_Rî1[`êVN^éU[?> NUêV\>4>h >AYhéMH O LOêVB W`BCW?TNœ>MéUN"ë#BÔéU[è\^êVWfñ NO[?ìVLUé¾êVW`_ \^êVWjñ @ÔìxW?T Nœ>  S >AW`Yh>ANÈê'LU>õ@Ô>Aê'LOW?>A_\ìVLU>  S ü BCYUíZ@ÔñA_ANMH Â"ß@ÃSå â ßjÞ â å`åLÄRåè O [`>6°ŽŒ é LO>MT S @Cê'L @CêVW`T S ê'TV>¾BCN¿LO>A@Cê'éœ>A_%éœì(Œ†Žt,BCWéU[`>¾Nœ>AW`Nœ>¾éU[`ê'é/BÔé¿LO> S BCLU>AN¿éœì@Ô>Aê'L˜W ê Yhì Wjéœ>MLAî éÀéU[`>ÈYhì Wjéœ>ML1W?>MôV>ML5W`>M>A_`NÃYhì WjéUBCW?T_?ìuëÈWRH O [`BCNÃéUêVNœí^BCNÀ>  BÔô'êV@Ô>AWjéÃéœì/éU[? otr5ìxWjéUBCW êV@R$X ]BÔíV> O BC\^BCW?&T q éUêVNœS Bí }IŒ>MLOa]N S  X?YO[`\^S B _`[ S`a >MLuî NMMM @Ô>Aê'LOW?S >A_ a xñ X O òÖìVL ûQÑ AM ëÈS BÔéUˆ[ ”ÆÅ 0MMM HF [`êVW]_ZS ï¸\^êV_?>VîÀ[`ê'L˜_?ë#BÔLU>A_ Nœìx@ S éUBÔìxxW ÊW?ì¾@Ô>Aê'L˜W`BCW?XT ÃìVò×ê^Nœ>AYhìxW`_GìVL˜_?>ML#ç  ëªìVLOíV>A_óòÖìVLô*êV@ S >AN1ìVò û S WjéUBC@ NM }X‚éœ>AB CœôV>MLON  IKL S Wjë5êV@ _Rî " ˜H =?ìVL/êV@C@éU[?LU>M>éUêVNœíZN  >M0> ¬[?ìx@Ô>YhìxW`W?>AYhéUBÔìxW`N¿ê'LO>\¾êVW`_`ê'éœìVLUñVH O [?>ì )é éŒTxê'éœ>AN¿LU>A\¾êVBCW,YM@ÔìxNœ>A_,òÖìVLŒN NœéUêVWjéUBCêV@ éUBC\> J>MLOBÔìZ_`N5_ S LOB W?T/>AêVY˜[BCW S éªNU>  S >AW]Yhi> `LU>ANœ>AWjéUê'éUBÔìxˆW ÊYhìx\ ¬ê'LU>õ=×BÔT SS LU>ANS Š î J êVW]_ A  # éU[?>¿>AW`_9ìVò×N S YO[GS?a ê J>MLOBCì‚_ BCN1êV@Ôë-êAñZNéœL˜BÔTVTV>MLU>A_óôZBCê J>M>0 ][?ìx@C>ŒYhìxW]W?>AYhéUBÔìxW`NMH



1

S a a a a a a b b bb b b c c c c c c a a a a a a a T bb b bb bb b bb b c c c c c c T

0 -1

: input : target a b c T

sc1 yc 1 sc 2 yc

20 10 0

2

1.0

0.0 0

5

10

15

y in 1 y out 1 y ϕ1 y in 2 y out 2 y ϕ2 Time

×= BÔT S LU> A FrX ŒX$ŽX›!dS”LÑ A F O >ANœéŒL S W4ë#BÔéU[,W?>Mé™ëªìVLOí Nœìx@ S éUBÔìxW ÖéU[?>Nœñ‚NUéœ>A\ NUYMêV@Ô>AN S ,éœìGNœ> S >AW`Yh>AN¿ìVò5@Ô>AW?TVéU[

0MMM êVW`_\^ìVLU>D˜H O ì UF È>Mé¸ë5ìVLUíóì S é) S éÇ&üfHB _`_`@Ô>Fur5>A@C@zNœéUê'éœ>É È êVW`_4Yh>A@C@zì S é) S é
Ç È H
75ìVéœéœìx\GFFKYhéUBÔô*ê'éUBCìxW`N#ìVò éU[?>õTxê'éœ>ANLÊBCW3 S é5Txê'éœ>ÇÌ  î?òÖìVLUTV>Mé#Txê'éœ>džÍ9êVW`_9ì S é) S é1Txê'éœ>Ç&ΫÏЩ˜H Ç È ûÈø5þ ɘ¹ ý  ÿOûÈø é oìxW?T XZ[?ìVLOéqï O >MLO\ ó>A\^ìVLU¹ñ X O ?ŒYM@Ô>Aê'L˜@Ôñ,ì )é J>MLUò¼ìVL˜\^N `LU>MôZBÔì Nõç''KN W`ìVé ìxW`@Ôñ ìxW%LO>MT @Cê'L z >¾òÖì S W`_%éU[`ê' @CêVW?T S ê'TV> a >AW`YO[`\¾ê'LUí‚NÊêVYMYhìVL˜_`BCW?T^éœìj `LU>MôZBÔì S N-LU>ANœ>Aê'L˜YO[` a¬S éêV@CSNœììxWóYhìxWjéœ>hDZéÈòÖLU>M>õS @CêVW?T S ê'TV>AW`Y˜[`\^ê'S LUíZNMH Šé@Ô>Aê'LOW`N1òÊêVNœéœ>MLKêVW`_9TV>AW?>MLOêV@C|B ,M>AN a >Méœéœ>MLA:H ×X O  êV@ Nœì^BCN1éU[?i > /]LONœéç  éœì¾@Ô>Aê'LOWGê¾YhìxWféœ>hDZéÈNœ>AW]NUBÔéUBÔôV>õ@CêVW`T ê'TV>VH FK@ÔéU[?ì S Tx[ r-€= oN@CBÔíV>ªéU[?ìxNœ>-Nœé S _`BC>A_ BCW éU[`BCëN ]ê J>MLÆ\^êuñ/êV@CNœì a >ª@Ô>Aê'LOW]ê a @Ô> a ñõYh>MLUéUêVBCW_`B NUYhLU>Méœ>ªNUñ‚\ a ìx@CBCY”STVLOêV\¾\^ê'L @Ô>Aê'LOW]BCW?T¿êV@ÔTVìVLOBÔéU[]\^N }X`I ÆFÈ!N u}XZê'í'ê'í‚B a ê'LOêZî &%X# z>M>Vî "$# 4ŒN a ìVLOW?
> ý75LOB NUYhìj>Vî &% ˜î‚éU[`>#@Cê'éœéœ>MLÃ>hD?[`B a BÔé”\ S Y˜[ \ìVLU>9éUêVNœíjï¸)N J>AYMB /]Y a B êVNMîÀêVW`_;ê'LU>GW?ìVé^_?>ANUBCTxW?>A_ éœì%NUìx@ÔôV>GW S \^>MLUì S NìVéU[?>ML^Nœ>  S >AW`YhE> `LUìZYh>ANUNUB W?T4éUêVNUí‚NBCWjôVìx@ÔôZBCW?T W?ìxBCNU>VîLU>AêV@Eï}ô'êV@ S >A_ BC3W S éUnN /BCWféœ>ML˜W`êV@#NœéUê'éœ>ANAîKêVW`_ YhìxWjéUBCW S ì S N¾ì S )é S é"éœLODê Cq>AYhéœìVL˜BÔ>ANMî#ëÈ[`BCYOí[ X O  Nœìx@ÔôV>AN">AêVNUBC@Cñ Èì‚Y˜[?LU>ABÔéœ>ML XZYO[]\^BC_`[ S?a >MLAî &%X# IK>MLON>Mé#êV@ HÔî NMMM ˜H 4 SG L /]W`_`BCW`TxN¾LU>AB W?ò¼ìVL˜Yh> éU[`‰>  >ML˜Yh0> `éUBÔìxW éU[`ê'=é ×X O  B NGê;ôV>MLUñ TV>AW`>MLOêV@õêVW`ú_ `LOìx\^BCNUBCW`TêV_`ê `éUBCôV> Nœ>  S >AW`Yh> `LUìZYh>ANUNUB W?T_?>Mô‚B Yh>Vî`ë#BÔéU[Gêë#B _?>MLu/`>A@C_9ìVò€ JìVéœ>AWféUB êV@zê  ]@CB YMê'éUBÔìxW`N5éU[`êVWóêV@Ôéœ>ML˜W`ê'éUBÔôV> ç''KNMH O

»F 9W:ÀIÂS2IÄ54"ZÊ

[`B N-ëªìVLUí"ë-êVN#N S I  ìVLOéœ>A_ a ñ XK=TVL˜êVWfé

N 0MM ï †J  w JJ H  " o)zìxW?T"X?[?ìVLUéqï O

0M

>MLO\c>A\ìVLUñVH q

û

Ì 5
¸Í 7ÉCc¡‰¢£B¤ Ë

ÿœùÍÐÏû#úÑ.×ùÓÒÕÔ5ù5 ÿOø Î

ÃýüûXÖjþ”ûõü¸

Ì 

ÿOøÿœù ø¹”ù@Î û#ú×ÙØ ÁIÆ ((Ú )+Û+) åVæ.É ÑÝÉ Ü Ñ MßÞ ã+å`ã â ¾þåüåxæª%$¶.Ñ MßÞ åIö â ¾`Á3å â ¾¯À¬ÝÆåVæÇ2ÑàÇ€Ü Ñ MßÞ á ûÈú Î[Ô1úRüâ¹ÔXM‚Ø È ê ó È ê ó •5Q¥bWb3
q&Æ@Ú¹ãfä phtVv*vxcuyJå c7g åxc7v*yfm'd e­ycæ'tcåç Á†ÀS2SÀ!aIÁ”Ú åö â ¾èÁ3å â ¾`À ÝoåxæpÇÜ ÑEÇ Þ öxßßïÃ-å â å â ߂åVæéÉ Ü È ê ó ÑGÉ È ê ó Þ d êcêLæHê8ëxcuí v 삞c ìßê7cv îpïf d êfp ð‚!l ñ¾e­yxkVcugxc*ék ò ó l"J”Q~¾3ÂÚn•5Q3b5é4HÃMJIÆOôK¾Mõ9Ú ûpþ úÿ ù ü ·”ö÷ø Ù ù äúû$ü ø Ù ù ûgã ý ø Ù ù ù ý ù ç ã ø Ù ù ä ø Ù ù è» ·”ö£÷ø Ù ù ½ ç l"J”Q~¾ -Ú «ÀUÁ94R(í4HÃMc`Æô¼"õ9Ú ûþ ú ÿ ù ü ý ·”ö÷ ù ä ú û$ü ù ûGã ý ù ù ù ç ã ù ä ù è» ·”ö£÷ ù ½ ç l"J”Q~¾” Ú nU -Æ ‰9½jO 5¤ ß!S2SÆ8ÃJIÆOô£0´õJÚ 8d êcêLæHê8ëxc7v å*rxc ,pAcVd'dxû l e­y ïj d êxp ðòñGe˜yxkVþ c7gxc7k ó ø vÙ ù ?»j·”ö£÷ ½ ç ý ä ã ã ·”ö£÷ ù äHúFû$ü ù û ã ý ç ù ù ù ù l"J”Q ¼‚Ú À ¼Uâ ã ¼Uâ å â ( ß åö â ¾`Á3å â û¾¯À¬þ ÝÃæ uæ ú ÿù ü ù ù ù ç ã ù ä ·”ö÷ ù ä ú ûÙü ù ûgã ý ù j» ·”ö£÷ ù ½ ç öx@ß Ã'ÉÀ ¼Hâ ã ¼Uâ å uæ 8d êcêLæHê8ëxc7v å*rxc pAcVd'dxl e­y ïj d êxp ðòñGe˜yxkVc7gxc7k ó ã ù ä ã ù ù ç 4cuyxk d êcêLæHê8ëVc7v ìZžc ìßê7 v îpïj d êfp ðjl ü 



























 

 

 





 

#





 

 



 

$%'&

()+*



()+*

()+*




 

()+*

 

"!

 

, ()+*

-$/.0&

()+*

 

()+*

 



!

 1!

À"bWJQ3b5b
3q&Æô32"õ9Ú ”UÊ0ËõüÑ54  Ô ü  Ç$ Þ Ç ÑôØüXS”UÊË«ü Þ QóJÁ 95ÃS'
Ä Á avMÃ 9qa`ÆYÚ

d êcêLæHê8ëxcuvíì‚cžìßê7vcîpïfd êfpð‚l!ñ¾e­yxkVcugxc*kéò ó 8d êcêLæOê8ëxcu v å7rfc · pucVd'dxl e­y ïj8d êfp ðòñ9e­yxkVc7gVc*k ó ê ó uæ öx@ß Ã'ÃÖå æ †%¶ È° Ó F¯Ñ êó û ä û ã ù þ ¼è» ·”ö÷ ½ ã ø Ù ù ã ý û ç ù · ê ó æW%$¶ Ì· Ó F¯Ñ ê ó uæ ¾ÖëÝ ã ¼Hâ å â ߂å æ †%$¶ Ì Ó F¯Ñ   ê  È5ê ó ê êó þ û ý ø Ù û ä ø Ù û ã ù Z»è·”ö£÷ ù ½ ø vÙ ù j» ·”ö£÷ø vÙ ù ½ ã ç 8d êcêLæHê8ëxc7F v æfc*Lc æ'r êVd7c Lp êuy'yxþ cfp åZve êAyZlób*9v ê£ìmVd'd pucVd'dxý l!ñòñ  û û ü ä h g f ö ab  ?   S 3 ç !(ç  ù ù ! êcêLæHê8ë ì žìßê îpï ê ð

ÊÝ Aß ¬Ý ‚ß ã7ã ]ãjæ å Ý åVæ d xcuv ‚c 7v fd fp ‚l `



ó

Vc7v Zc 7v jd fp jl

Ý Vå æ d xcuv ‚c 7v fd fp ‚l Aê'LOW`BCW`T @ÔìxW`T'ï}éœ>MLO\_?>0 J>AW`_?>AW`YMBÔ>AN/ë#BÔéU[TVLOêV_`BC>AWfé_?>ANUYh>AWjéBCN _]B 1¾Y S @ÔéMH ^3[)mV3l0m&k\™°TV3leTV _0­[õm¦ _\ :T[t§Dl˜î + N ˜î A&% ï "" H 7-@CêVBÔLAî'F/DH ‚HԆî ¹@ìx@C@CêVYOí¬îfP`DH 7KvH &% ˜H?FKW`êV@ÔñZNUBCNRìVò¬_?ñ‚W]êV\^BCYMêV@VLU>AYhìVTxW]B,M>MLONMH _0­$[)m¦ Ta'¬`­3\5m\™°TV`î + A ˜î  N&% `  J†N H r-êVNœ>MñV î 
H @… H " ˜H O [?>_?ñZW`êV\^BCYMN"ìVò_`BCNUYhLO>Méœ>hï}éUBC\>Yhìx\ éUê'éUBCìxWRîÈëÈBÔéU[ ê  ]@CBCYMê'éUBCìxWèéœìLU>AY LULU>AWjé9W`> S LOêV@ W`>Mé¸ë5ìVLUí‚NÈêVW`_G/]W]BÔéœ>¿NœéUê'éœ>/\^êVY˜[`BCW?>¿>hDZéœLOêVYhéUBÔìxWzH L_­[õm¦ Ta'S ¬`­3\5m\™°TV`î + " ˜î  ŠA `  %> H S ‚ŒêVNMî`X HÔîZIŒB @Ô>ANMî rŒHÔ$î  X S WRî‚I2H N ˜UH o>Aê'LOW`BCW`T YhìxWféœ>hDZéqï}òÖLU>M>ÈTVL˜êV\^\^ê'LO0N F:r-ê ¬ê a BC@CBÔéUBC>ANêVW]_¾@CBC\¾BÔéUê'éUBÔìxW`N×ìVòRêõLO>AY S Lœï LO>AWféW?> S LOêV@jW?>Mé¸ë5ìVLUíõë#BCéU[õêVW >hDZéœ>MLOW`êV@‚NœéUêVYOí \>A\ìVLUñVXH ŠW [)Tk__9®™SVXWl
T)±i^UZ_ HT­[\©_t_0VI\SZ VIV­m¦ TV±0_0[)_0V`k_ T)±.\SZ_ T9W&V™S\™Sš_Yvk0™5_V`k!_YvTk0™5_0\f‰S  zH % %A ˜H#XZêV6 W 4ê'éœ>Mì?Hî r-.F FIìVLUTxêVW „ ê S òÊ\^êVW`GW @ S`a @CBCNU[`>MLONMH IK>MLONAî‚=5HZF HÔ3î  X?YO[`\^B _`[ S`a >MLuîVP`:H NMMM ˜Hç#>AY S LULU>AWjéªW`>MéUNÃéU[`ê'é5éUBC\>ÈêVW`_MLONAî¬=5H]F/HÔîJXZY˜[`\^BC_`[ S?a >MLAî?P?HÔ`î  r S \^\¾BCW`NMî?=5H NMMM ˜
H o>Aê'LOW`BCW?TéœìM0é Fur5ìxWjéUBCW S êVy@ `LO>A_`BCYhéUBÔìxW9ë#BCéUG[ X O  H L_­[)m¦ Ta'¬`­3\5m\™°TV`î  0M ˜î NKJ†A $NKJX%$ H Èì‚Y˜[?LU>ABÔéœ>MLAîGX H  ˜H +VI\©_0[tl!­3k0Z†­VXWX_0V ;0­»®fV`ma ™þlk0Z_V~Vv_0­[õTVvm¦_0V _\è;_0V ™¨¬`¦Taem¸\SZ_!l!™ l V3l!\™\­3\ ± ­[ V±0T[!am&\™ § .Rë_!Z†[l!\­$Z†¦ [)Tõ± [õm­_0[ 6^v_9kZXV™ l0kZ_ ëV™Sš_0[tl!™S\ m&\b ­V`k0Z_V }X‚>M>ë#ëë % H BCW?òÖìVLO\^ê'éUBCí¬H é S ï \ S >AW`Y˜[?>AWRH _?8> / A[`ì‚Y˜[?LU>ABÔé  Èì‚Y˜[?LU>ABÔéœ>MLAîJX HÔIî  XZY˜[`\^BC_`[ S?a >MLAî?P? H &% ˜ H zìxW?T^NO[?ìVLUéqï}éœ>MLO\â\>A\ìVLUñVH L_­[)m¦ Ta'¬`­3\5m\™°TV`î + > ˜î %ŠA ï %>M H H > ˜H r5ìxe\ S éUê'éUBÔìxW,BCW4LU>AY S LULO>AWfé¿W?> S L˜êV@ÆW?>Mé™ëªìVLOí‚0N FŒ=?LUìx\ Yhì S Wféœ>MLONŒéœìóBCéœ>MLOê'éœ>A_ „ êV@CB W?íV>Vî HÔUî  z>A[]\^êVW`WRyî /j ò S W`YhéUBCìxW/NœñZNœéœ>A\^NAH3ŠWIHVFÈWjéœìxW`BÔì S  P?HfXZ@ êVW?>MñjsÃ_`NAH¯˜î ®šmV`k!_9®G^IT!¬`™k0lu™þV [!\™ k™m¦ VI\©_0¦þ¦²™WX_Vvk_ u[õTk_t_t®] ™SVXWlMLO@CBCWRî È>ABC_?>A@ a >MLO3T F X `LOBCW?TV>MLuH z>M>V2î ÃHd " ˜xH RU_9m[V™SVXWdTõ±EkTVI\©_ &\]²±[9_t_G¦ mV$W­mWX_l ƒl­[!š_0f?Tõ±-\SZ_E¦²™\©_[)m\­[)_ˆ O >AY˜[RH”ç0> z+H #ì?H O ç1ï N ï " ˜H r->AWféœ>MLÈò¼ìVL#ç#>ANœ>Aê'LOY˜[BC W r-ìx\ S éUBCW`T O >AYO[`W`ìx@ÔìVTVñV`î Kê'LUô'ê'LO=_ *KW`BÔôV>MLONUBCé¸ñVvî r-êV\ a LOB _?TV>Vî êVNUNOêVYO[ S Nœ>MéœéUNMH 4êVêVNUNMî z HÔ3î 4Œ9L JìxW?>AWR†î @:H > ˜2H 4ŒW^éU[?>È> h >AYhé5ìVòzêVW`êV@ÔìVTW?ìxBCNœ>ÈBCW¾_`B NUYhLU>Méœ>hï}éUBC\>KêVW`êV@ÔìVTYhìx \ S éUê'éUBÔìxW]NMH _0­$[)m¦ Ta¬v­\5m&\™TV]î ë A ˜î 0M†%$ ` 0M&A H 4êVêVNUNMî z HÔUî  XZìxWféUê'T?Uî s#vH ‚j H  ˜HFÈW`êV@CìVT9W`> S LOêV@W?>MéUNKë#BÔéU[%IŒê S NUNOBCêVWìVLŒìVéU[?>MLõYhìx\¾\ìxWW?ìxBCNœ>_`BCNUéœLOB a]S éUBCìxW YMêVW]W?ìVéLU>AYhìVTxW`|B ,M> ê'L a BÔéœL˜ê'LUñMT S @Cê'L@CêVW?T S ê'TV>ANMH L_­[õm¦ Ta'¬`­3\5m\™°TV`î ë Š ˜î %%$ %>N H 4ŒN a ìVLOW`>V}î  HÔuî 87ªL˜BCNUYhì‚>V}î s#‡ H &% ˜úH o>Aê'LOW`BCW`T,NUéœì‚Y˜[`êVNœéUBCYóYMê'éœ>MTVìVL˜BCêV@#TVL˜êV\^\^ê'LONMpH ŠW u[õTk!_t_t®™þV$Wl(Tõ±=\SZ3_ l!] l0Tk ±0T[ Ta¬ LR™þVXW&­™ l\™k0l Ta'¬ m\ RIW RU_tm[VI™þVXW T RUR 6T[§lZ$T¬ªS I zH >M $>&% ˜H êV_`LOBC_RH Ê[jéœ)é HF\/J/*YMBÔéœ>ANU>M>MLAH KW CMH W?>AY'H Yhìxn\ /7ìxN a ìVLOW?> &% @C>Aê'LOW`BCW?T?H [jéU\^þ@  @>Aê'LO@C\ S éœéœ>MLA€î 7KHÆF/( H A ˜H4IKLOêV_]BÔ>AWfé/YMêV@CY S @Cê'éUBÔìxW]N¿ò¼ìVL_?ñZW`êV\^BCYLU>AY S LOLU>AWfé/W?> S LOêV@ÀW`>Mé¸ë5ìVLUí‚N F/F N S LUôV>MñVH ^[)mV3lm†k\™°TV3l TV _0­$[)m¦ L_0\ :T[t§Dl˜î ë A ˜î N N ï NN> H @Ã@ ê S éM`î ‚³H rŒHÔ`î Èìuë#@CêVWzîJX HJP?HÔvî  ÈB WféœìxWRîRI`H s# H >" ˜H ¬3_[!™Sae_0VI\Sl TVx¦_tm[!V™þV$W6¥9m&k0§i¬`[)T¬mWXm\™°TVý O >AY˜[RH ç#0> zH ÈìxNMvH r
6* rX $>" ` N" ˜uH @ÃBCéœéUN a]S LUTx[zî @J F Fvr-ê'LOW`>MTxBÔ> ó>A@ @Ôìx=W *KW`BÔôV>MLONUBCé¸ñVH çì a BCW`NœìxWRîjF H?P?HÔî  =`êV@ @CNUBC_?>Vî‚=5:H >&% ˜iH ^UZ_­\™S¦²™S\fe®[!™þš_V®fKVvma ™k _[![õT[:¬v[õT¬3mW†m\™°TV?Vv_\ :T[t§ O >AYO[zH‚ç#0> zXH Èì?H ru*'s‚&/*=Æ5ï õȀ= sŒª I / O çõH ˜H r-êV\ a LOBC_?TVi> *KW`BÔôV>MLONOBÔé¸Eñ sÃW?TxB W?>M>MLOBCW? T ‚K0> ]ê'LUéU\>AWjéMH çìZ_?LOBCT S 0> ,Vî @HÔî  z BC@Ô>ANAîÈP?ƒ H > ˜H ç>AY LULU>AWjé9W`> LOêV@KW?>Mé¸ë5ìVLUíZNóYMêVW @Ô>Aê'LOW éœìBC\ ]@C>A\>AWfé9NœñZ\ ìx@Eï¸NU>AW`NUBÔéUBÔôV> Yhì S WféUBCW`T?2H ŠW '®šmV`k_l.™SV L_­[)m¦ V±0TS [!am&\™TV S [)Tk_ltl™SVXWEYIfDl\©_aLl-SŸ”ìx@ H 0M Iî zH >&% ï Š ˜H O [?> a6 O @ÀLU>ANUNAH çìZ_?LOBCT S 0> ,Vvî @HÔî z BC@Ô>ANMîRP?HÔyî  sÃ@C\^êVWzî P?H  ˜HõF LU>AY S LULU>AWjéKW?> S LOêV@oW?>Mé™ëªìVLOíéU[`ê'é¿@Ô>Aê'LOW]NéœìGYhì S WjéMH TVVv_9k\™TV Yvk0™5_V`k!_hî + ˜î A ï J&M H XZê'í'ê'í‚B a ê'LOêZî dH &% ˜H,ç>AYh>AWjéêV_?ô*êVW]Yh>AN/ìVò1TVL˜êV\^\^ê'éUBCYMêV@5BCW?òÖ>MLU>AW`Yh>VBH ^UZ_tT[9_0\™°ktm¦ Ta'¬`­3\©_[-Y`k™°_0V`k_Mî ë ˜î

A †J†A H i

 á  

kj

VlmnmVm

-o

0o

p

rq

o

vo

ns

's

xw

zy

s

t

9u

n{

}|

3

o

0s

]u

~y

s

>u

-o

Ro

ns

p

N'€

3

k‡Lƒ

]u

ˆ

' l

90l]€0s'oo-‚ ƒ„„…„D†rl

‰o

D†

Žy

MLAîjP`H} > ˜H O [?>È> S LOêV@³7 S YUíV>Mé
75LOBÔTxêV_`>VîZê@ÔìZYMêV@J@Ô>Aê'LOW`BCW`T êV@ÔTVìVLOBÔéU[]\ òÖìVL1_?ñZW`êV\^BCY#ò¼>M>A_?òÖìVLUë-ê'LO_9êVW`_ LO>AY S LULU>AWjéW?>Mé¸ë5ìVLUíZNMH TVVv_9k\™TV‰Y`k0™5_V`k!_hî + J ˜î J&M&Š ï J N H XZY˜[`\^BC_`[ S?a >MLAîRP?GH N ˜jH z>Aê'L˜W`BCW?TGYhìx\ ]@C>hD îR>hDZéœ>AW`_?>A_%NU>  S >AW]Yh>AN S NUBCW`T ]LOBCW`YMB ¬@Ô>õìVò-[`BCNœéœìVLUñ Yhìx\ `LU>ANONUBÔìxWRH L_­[)m¦ Ta'¬`­3\5m\™°TV`î N ˜î NŠKJ ï NKJ†N H XZBÔ>MTV>A@ \^êVW`WR3î /H N ˜ H ^UZ_tT[)_\™km¦$±T­V`®†m\™TV3lLTõ±i[9_9k­$[![9_VI\}Vv_0­$[)m¦HV³_0\ :T[§l *K3W S`a @CBCNU[`>A_¾_?ìZYhéœìVLOêV@R_`BCNONœ>MLUéUê*ï éUBCìxWRî`ç S éœTV>ML˜NMIî È>Më 75L S W`NUë#BCYUí"ç S éœTV>ML˜NMî O [?>/X‚éUê'éœ> ìV€ò È>Më Px>MLONœ>MñVH XZBÔ>MTV>A@ \^êVW`WR+î  H O HԀî  X‚ìxWjéUê'T?€î s#ëH ‚xH  ˜H O S LOBCW?TóYhìxe\ S éUê a BC@ BÔé¸ñ ë#BÔéU[%W`> S LOêV@ÀW?>MéUNAH ¬&¬`¦²™5_9®6bˆm\SZ_aem\™°kl Rë_0\°\©_0[tl­î " ˜î %% $>M H X‚éœ>AB CœôV>MLONMvî %HÔ³î  IKL S Wfë-êV@C_Rî @iH " ˜HF LO>AY S LULU>AWjé#W?>Mé™ëªìVLUíGéU[]ê'é J>MLUòÖìVLO\^N1ê¾YhìxWjéœ>hDZéUNœ>AW`NUBÔéUBCôV.> `LU>A_]BCYhéUBÔìxW9éUêVNœí H qW u[õTk!_t_t®™þV$Wl T)±\SZ_ &\SZ VV­m¦ TV±_[9_Vvk_ Tõ±.\SZ3_ T9WV™\™Sš_Y`k™°_0V`k_Y`Tk0™5_0\f }sÀLO@ a ê S \GH X S WzîZIIH {HÔî]IŒBC@C>ANMî rKH ÀHÔIî r-[`>AWR$î /3H  HÔî z>M>Vî 3H rŒ}H Š ˜.H ^UZ_Vv_­[)m¦yVv_0\ :T[t§'¬`­$ltZ$®†T Vxm­3\5Taem\5TV bˆT®†_0¦ l\5m&k§mV`®(¦_tm[!V™þV$W(l™Sa ­$¦m\™°TV3l‰ O >AY˜[`W`BCYMêV@ªç0> JìVLU é Èì?€H rXjï O ç1ï Š  > ˜EH *ÈW`BCôV>MLONUBÔé™ñ ìV
ò 4ê'LUñZ@CêVW`_R+î r-ìx@C@Ô>MTV> @×ê'LUí H H &% ˜jH z>Aê'LOW]BCW?TGêGYhìxWféœ>hDZéqï}òÖLU>M>¾éUêVNœí ë#BÔéU[,ê9LU>AY S LULU>AWjéõW?> S LOêV@×W?>Mé™ëªìVLUví FõFKWêVW`êV@ÔñZNUBCN O ìxW?íV>ANMëî 7KHÔëî  z BC@Ô>ANAîÆP?E ìVò¿NœéUê a BC@CBÔé™ñVHQqW [)Tk!_t_9®™þVXWl(Tõ±=\SZ_ UT­[!\SZ ™°_0VV™°m¦ TV±_[9_Vvk_?Tõ±=\SZ_ ­$l\[õm¦mKl!™mV T9W&V™\™þš_=Yvk0™5_V`k!_ YvTk0™5_0\f ŸŒB CœêuñfïŠX?[`êVW?íV>MLAî „ ëH N ˜yH *ÈNUB W?TK_`>ANUYhLOB `éUBCìxW`NìVò¬éœLU>M>ANÃBCWêŒéœLU>M>#êVK_ CœìxBCW`BCW`T#TVLOêV\^\¾ê'LAH Ta'¬`­3\5m\™°TV`m¦3R™þVXW&­™ l\™k0l˜î + J ˜î J†> $A % H H >> ˜HIK>AW?>MLOêV@ BCNUê'éUBÔìxW4ìVò a êVYOXí `LOì ]ê'Txê'éUBÔìxW,ë#BÔéU[ ê  ]@ BCYMê'éUBÔìxWóéœìGêAY S LULO>AWféKTxêVN¿\^ê'LUíV>Mé¿\ìZ_?>A@ H z >ML a ìxNMyî @HzP? L_­[)m¦ L_0\ :T[§l­î 'î ŠŠ $ŠA" H î  sÃ@C\^êVWzîKP?… H A q†˜´ H z>Aê'LOW`B W?Téœì Yhì WféGë#BCéU[?ì é9êYhì Wféœ>ML F;F YMêVNœ>%Nœé _?ñ ìVò_?ñ‚W]êV\^BCYMN9êVW`_ z BC@Ô>ANMîŒP?HÔi êVYhéUBCô*ê'éUBÔìxW9@CêVW]_`NUYMê J>ANªB W^LU>AY S LOLU>AWfé-W?>Mé™ëªìVLUíZNMëH ŠW S V [)Tk!_t_9S ®™þVXWlTõS±\SZ_iY³_š_0VI\©_t_0VI\SZ S VIV­m¦ TV±_[9_V`k!_.Tõ± \SZ3_ T9WV™\™Sš_Y`k™°_0V`k_.Y`Tk™°_\fxS  zH ]ê'TV>AN J†>N &% ˜ H r1êV\ a L˜BC_?TV>VIî 4. F F`6 O @ÀLU>ANONMH H M ˜H FÈW0> 1¾YMBÔ>AWjé TVL˜êV_`BÔ>AWjéqï êVNœ>A_ êV@ÔTVìVLOBÔéU[`\ ò¼ìVLìxWZï¸@CBCW`>éœLOêVBCW`BCW`TGìVò1LU>AY S LULU>AWjé z BC@C@CBCêV\¾NMîoçõH×P?HÔî c@>AW?T?îÀP`‰ W`>Mé¸ë5ìVLUí9éœLODê Cq>AYhéœìVL˜BÔ>ALN Þ o>Méœéœ>ML ß H L_­[)m¦ Ta'¬`­3\5m\™°TV`î  aJ ˜î J†M $AM3 H H N ˜HóIŒLOêV_`BÔ>AWjéqï êVNœ>A_%@C>Aê'LOW`BCW?TGêV@ÔTVìVL˜BÔéU[`\^N¿òÖìVLõLU>AY LULU>AWjéõW?>Mé¸ë5ìVLUíZN/êVW`_%éU[?>ABÔL z BC@C@CBCêV\¾NMîzçõHoP`HԀî c{RB ]Nœ>MLAHî ‚? Yhìx\e S éUê'éUBÔìxW`êV@¿Yhìx\e ]@Ô>hD?BÔé¸ñVH qW Hr-[]ê S ô‚B Wía  ‚HusH1ç S \>A@C[`ê'LUé‰sÃ_]NMH¯˜î S m&k§K]|¬`[)T¬mW†m\™°TV ˜^UZ_9T[f [õk0Z†™S\©_tk\­[9_!lLmVv® ¬&¬`¦²™°ktm\™°TV3lGS  zH J†ŠŠ †J†>" ˜uH ÈB @C@CNU_`êV@C>V$î Œ3P FIsÃLO@ a ê S \GH { >AW?T?`î {×HÔî IKì‚ì‚_`\¾êVWRî`çõHÔIî  X?\ ñ‚éU[RIî @ H KJ q†˜uH ‚ŒBCNUYhLU>Méœ>õLO>AY S LULU>AWjéW?> S LOêV@RW`>Mé¸ë5ìVLUí‚N#ò¼ìVL#TVLOêV\^\^ê'éUBCYMêV@oBCW?òÖ>MLU>AW`Yh>VH ˜^[õmVlm&k\™TVl TV L_­[õm¦ _\ :T[§l˜î ë N ˜H ªs

o

ns

c‡

0«

p

u

¥y

z‡Aw

|

Vs

s



¬j

™y

{

p



es

Lp

|

˜

H†

­s



“s

‡w

]u

o

Ro

p

–‡

9u

šl ~y

s

vo

ns

–ƒ

1j

|

¨s

9u

-o

Ro

Du

®

z|

lmnmVm

z|

zu

p

xq

J

˜

¯†