In the last years, grammatical inference using recurrent neural network has been a .... The network we propose, Figure 1, consists of ] fuzzy recurrent neurons labelled .... seen yet, acting in the following way: if one sequence of this set is not ...
s Ybs m 7BP ]B8}Z $t x wdMD dnnTd;(
3Z99k ps88s ${sj ytPt{ ZR$t WZsj W bB, V jst{B V *jsIB stI ] _sjs`s *} B I ]$t{$sR I js ]B8}Z s{$?Bt yt j$t{$s V $h{$sj e q 7 y ytPB8?s ${s =t$%R$IsI I pstsIs V% I VtIsjZ{?s nM dM(d pstsIs w7}s$tD T8s$jU 8{s8toI{Rs$ Z R
VAR s{
G Ys% RYBbt s 8BIj BP PZ99k tZsj t bB, Ys $R sAj B $tP Y js $BtR sRRB{$s I B Y stR$ $BtR BP s PZ99k sZ B8s Bt PB8 s PZ99k -s8}jR R WZsj t bB, $R s$ttI Ak s As{,}B}ss $Bt BP B AsRI $t s R8BB Y I$%s $% >dH !t{ t bB, YsR At s$ttI Y PZ99k js $BtR sRRB{$s I B Y stR$ $BtR BP Y sZ B8s Bt s PBZtI t{BII $t Y b$Y R kbBIRU3Z99k VZ B8s s 3Z99k i{Zt WZsj W bB, 3Z99k ps88s ${sj ytPt{
d d d
yt BIZ{ $Bt ps88sR ps88s ${sj ytPt{ stI i{Zt WZT sj W bB,R
yt Y jsR ksR s88s ${sj $tPt{ ZR$t {Zt tZsj t bB, YsR At s b$Ijk IsjI b$ Y }BAj8 yt }s ${Zjs $ YsR At RYBbI Ys {Zt tZsj t bB, wiWWD s {s}sAj BP $tP$t Zjs s88sR >1 ; x d(H *Z$t Y s$tt$t Y {Zt t bB, }s $ $BtR $ R R}s{ BP R s R $t bjj IhtI $BtR Ys }Rt Y {BR}BtIt R s R BP I 8$t$R ${ ht sZ B8s Bt w*3VD bY${Y $R $I B jst (, dH k C $R Y Rk8ABj bY${Y ts R Y s88s
3Z99k iZjs ps88s
yt s PZ99k s88s r Y RJZt{R AjBt B Y jstZs ts I Ak Y s88s b$ Y s I BP 88ARY$} qY I BP 88ARY$} t w?D BP s RJZt{ ? ; x $R Y 8s-$8Z8 %sjZ BP sjj Y %sjZR BP Y }BRR$Aj I$%s $BtR BP ? bY Y %sjZ BP s R}{$h{ I$%s $Bt BP ? $R Y 8$t$8Z8 I BP 88ARY$} BP Y }BIZ{ $Bt ZRIU
t
w?D )
t)F?
) 8s- 8$t > t wC d D, t w d 1 D, 333, t w E ?DH C F?
Vt sZ B8s Bt $R ts8I PZ99k bYt Y$ R s R s {Yss{ $9I Ak PZ99k R R stI Y }BIZ{ $BtR BP stRbR stI PBjjBb$t R s R s Ps{$j$ s I Ak Y s}}B}$s I PZ99k js $BtR V PZ99k sZ B8s Bt Z $R s PZ99k js $Btsj RkR 8 IhtI Ak s JZ$t Z}j Z )c , S , ' , o, w k bY $R s tB 8} k ht$ R BP $t}Z R s R w$t}Z sj}YsA D S $R s tB 8} k ht$ R BP BZ }Z R s R wBZ }Z sj}YsA D ' $R s ht$ R $t tsj R s R o $R Y PZ99k js $Bt $t ' S stI w $R s PZ99k js $Bt $t ' ' p$%t s PZ99k s88s r -$R R s PZ99k sZ B8s Bt Z Ys {Bt$9R Y Rs8 jstZs bY${Y ts R Y s88s r Ys $R Uwr D ) UwZD3
3Z99k s88s ${sj $tPt{ >nH $R IhtI sR Y }BAj8 BP $tP$t Y PZ99k s88s ${sj ZjR B PZ99k }BIZ{ $BtR Ys {Yss{ $9 s PZ99k s88s PB8 s R BP PZ99k -s8}jR BP s$tt$t *Z B Y js $Bt A bt PZ99k s88s stI PZ99k sZ B8s Bt Y }BAj8 BP PZ99k s88s ${sj $tPt{ {st A PB{ZRI sR Y BA t $Bt BP s PZ99k sZ B8s Bt Ys {Bt$9R Y R BP jst$t -s8}jR stI PB8 bY${Y b BA s$t Y R BP }BIZ{ $BtR AjBt$t B Y s88s bY${Y ts R RZ{Y -s8}jR !Z }BAj8 b$jj A {t I $t BA s$tt$t Y PZ99k stR$ $BtR sRRB{$s I B Y PZ99k sZ B8s Bt wPZ99k js $BtR Ys Iht Y sZ B8s Bt "8B%8t "D PB8 {BZ}jR BP -s8}jR w # D bY $R s RJZt{ BP {Yss{ R B }B{RR Ak sZT B8s Bt stI # $R s PZ99k R bY${Y }Rt R Y 88ARY$} BP s{Y R s R BP sZ B8s Bt Bt{ $t}Z R $t $R sI
dnx
3Z99k ps88s ${sj ytPt{ ZR$t WZsj W bB,
1
qY 3Z99k i{Zt WZsj W bB, m
m
S1
m
S0
S N-1 Output of Neurons
S0t+1
max
S 1t+1
max
t+1 SN-1
..........
......... max
0
Hidden Layer
W min
S t0
min
S t1
.......
min
.........
S tN-1
Recurrent Neurons
min
min
......
min
t
I0
.........
t I L-1
Input Neurons
3$Z dU s-T$t WZsj W bB, qY t bB, b }B}BR 3$Z d {BtR$R R BP ] PZ99k {Zt tZBtR jsAjjI ?i U $t}Z tZBtR tBT{Zt {> stI ] 1 U b$Y R jsAjI P7i> qY$R t bB, s{{} R st $t}Z RJZt{ BII $t $8 stI $ R Ikts8${ $R }PB8I $t Y PBjjBb$t bskU ?70Ld ) 8s8$twP7i> , Ci0 , {>0 D wdD i,> es{Y Rk8ABj BP Y $t}Z RJZt{ $R t{BII $t $t}Z tZBtR $t s{Y R } BP $8 0 sR PBjjBbRU yD yP $t}Z {Yss{ $R ( Yt {( ) d stI {d ) ( KD yP $t}Z {Yss{ $R d Yt {( ) ( stI {d ) d
eJZs $Bt d $R %sjZs I $t s{Y PZ99k tZBt ?7 B {B8}Z Y %sjZ BP PBjjBb$t R s $t $8 0 L d 7 s $t %sjZ APB stk $t}Z bsR Rt $R C(( ) d stI Ci( ) ( PB sjj i W) (
dnE 1 d
V jst{B V *jsIB m ] _sjs`s qs$tt$t }B{IZ
qY Bsj BP s$tt$t Y t bB, $R B h Y b$Y R $t BI B Y R BP $t}Z -s8}jR }BIZ{ Y R BP b$RYI BZ}Z R qY B PB s{Y PZ99k tZBt $R {B8}Z I Ak 8$t$8$9$t Y RJZs BP Y I$&t{ A bt Y b$RYI BZ }Z x7 stI Y BA s$tI BZ }Z Ak t bB, ?7W PB s{Y }s tR ZRI $t Y jst$t ?7W b$jj A Yt{ Y %sjZ BP s{Y tZBt Bt{ Y }Rt s $Bt BP st -s8}j RJZt{ YsR ht$RYI G b$jj {B8}Z Y B Ak ZR$t Y PBjjBb$t -}RR$BtU d w1D o7 ) wx7 ?7W D1 1 bY
?
W 7
) 8s8$twP7i> , CiW d , {>W d D i,>
wnD
A$t x7 Y I BP 88ARY$} B R s 7 BP sZ B8s Bt Z stI ?7W Y I BP 88ARY$} B R s i Ys t bB, $%R sR RZj qB h b$Y R b ZR s s$tt$t sjB$ Y8 Ys Z}Is R Y b$Y R s Y tI BP Y }Rt s $Bt BP s{Y -s8}jR RJZt{ G b$jj Z}Is Y b$Y R $P B $R s Yst Ys $ b$jj A {YBRt I}tI$t Bt Y s{{Zs{k Ys $R b$RYI $t Y RZj R 7B Z}Is I ZjR BP Y b$Y R b$jj A
nP
(o7 ( ?7 ) (P ) wx7 C7W D3 (P
W
7qE
7qE
7qE
( 8s-i,> 8$twP7i> , ?iW d , {>W d D ( 8$twP7Ez , ?EW d , {zW d D ( ?7W ) 3 (P7Ez (P7Ez ( 8$twP7Ez , ?EW d , {zW d D
w;D wxD
N A h dU
( 8s- 8$ti,> wP7i> , ?iW d , {>W d D ) ( 8$twP7Ez , ?EW d , {zW d D ( 8s-i9)E>9)z >8$twP7Ez , ?EW d , {zW d D, 8$twP7i> , CiW d , {>W d DH 8$twP7Ez , ?EW d , {zW d D
stI _1U
h1 )
( 8$twP7Ez , ?EW d , {zW d D (P7Ez
wED
wD
qY I$%s $% BP PZt{ $BtR E7zwr,D stI Ey?wr,D -$R R PB r c stI r k
AZ $ $R tB IhtI $t
r)
( 8$twr,D ) F d $P r c k ( 8s-wr,D ) F d $P r k k ( $P r k ( $P r c (r (r
wMD
3Z99k ps88s ${sj ytPt{ ZR$t WZsj W bB, VR $ $R ZRZsj >H b b$jj sRR$t $t stk {sR PB jP BP Y {BR}BtIt I$%s $%
dn
r ) Y %sjZ B Y $Y B Y
( 8$twr,D ) F d $P r k ( 8s-wr,D ) F d $P r k ( $P r k ( $P r c (r (r
wD
8$twP ,C @ ,{ @ DH -{] ) 8$twP , ? @,{ @D i
E,>
7i>
z
7Ez
W E
W i
W >
W z
!t{ Y$R $t{8t $R {sj{Zjs I b ZR s 8B8t Z8 8 s,$t $t B s{{BZt $t Y {sj{Zjs $Bt BP {Zt $t{8t Y $t8I$s jk }%$BZR $t{8t U
V jst{B V *jsIB m ] _sjs `s
dnM
nP ) 3nP L wd D3nP LqQ 7i>
7i>
=RZsjjk b Ys% s,t ) (3x3 1 1
wdnD
7i>
7YBb$t BP qs$tt$t e-s8}jR
yt$ $sjjk b$Y R s s8IB8jk {YBRt $t $t %sj >(dH qY s$tt$t Is s sR }%$BZRjk PI {BtR$R BP }s$R w ,# D bY $R st $t}Z RJZt{ ?@ ? 333? ? ; \(, di k # ) w @w?D, w?D,333, w?DD A$t ] Y tZ8A BP sZ B8s Bt R s R stI Y tZ8A BP PZ99k tZBtR BP Y tZsj t bB, 7 s $t %sjZ PB PZ99k tZBtR ? $R 9B -{} PB tZBt ? Ys $ b$jj A JZsj B d W bB, R s R s$tt$t b$ Y Btjk 1( -s8}jRU qY 8s$t$t s$tt$t -s8}jR $R R}ss I $t B Y R Ys t bB, b$jj R ZIk Bt{ $ YsR jstI Y hR 1( -s8}jR B IBt s R}{$h{ tZ8A BP }BJZR ZtIR stI$t Ak }BJZ Y }$BI Ys t bB, R}tIR $t }B{RR$t Btjk Bt $8 sjj BP RJZt{R BP s$tt$t GYt Y t bB, YsR jstI $ R R BP s$tt$t }s t B -{II Y 8s-$8Z8 tZ8A BP }BJZR Yt $ R ZI$R Y 8s$t$t R BP -s8}jR Ys $ YsR tB Rt k s{ $t $t Y PBjjBb$t bskU $P Bt RJZt{ BP Y$R R $R tB {Bt$9I wo k 6D Yt $ $R $t{jZII $t Y s$tt$t R stI $t B Y {sR }B{RRR stB Y Bt qY tZ8A BP RJZt{R B $t BIZ{ $R j$8$ I B d( $t BI B s%B$I Y B%R}{$sj$9s $Bt BP Y t bB, y $R 8I {k{j B Y R BP s{ $BtR BP }B{RR$t Y RJZt{R BP s$tt$t R stI RZARJZt jk R ZIk$t Y R BP RJZt{R Ys $ $R tB Rt stI $t{jZI$t $P $ $R tB {Bt$9I =RZsjjk b ZR 1( {k{jR sR 8s-$8Z8 B s$t Y t bB, bYt% s RJZt{ BP s$tt$t R bsR }B{RRI stI $ R B bsR s Yst 6 b b$jj }sRR B h Y b$Y R Ak ZR$t }%$BZRjk $%t JZs $BtR q
7
]
7
1 n
e- s{ $Bt BP 3Z99k VZ B8s Bt
!t{ t bB, YsR jstI Y s$tt$t -s8}jR Y jstI PZ99k sZ B8s Bt {st A - s{ I Ak R ZIk$t Y b$Y R BP {Bt{ $BtR BP Y PZ99k {Zt tZBtR Ys $R Y b$Y P }Rt R Y I BP 88ARY$} BP Y stR$ $Bt BP R s i B R s 7 BP sZ B8s Bt Ys%$t sI Y $t}Z Rk8ABj > qYPB b {st AZ$jI Y PZ99k js $Bt w >(H k w >dH sR s PZt{ $Bt BP $t}Z > > ; \(, diU 7i>
CP P 3 P @ h P P 3 P @ @@ @ h w >(H ) H 3 3 3 3 ] ]
P
n
]
P@
]
3 P
]]
CP P 3 P I @ @ @ @ h n P P 3 P @@ @@@ @@ h n O w >dH ) H 3 3 3 3 ] ]
P
]@
P@
]@
3 P
I n n O
]]@
7$8Zjs $Bt
G Ys% {YBRt sR -s8}j Y sZ B8s Bt Ys bB,R sR -}RRI Ak Y PBjjBb$t PZ99k js $BtRU
dn
3Z99k ps88s ${sj ytPt{ ZR$t WZsj W bB,
C (3M hh (3n w >(H ) h hH ((3d
I
C
I
(31 (3d (31 (3d (3d (3 (31 (3d (31 h (3d (3 (31 (3d n (3M ( (3d (31 ( n n h n (3d (31 (3Mx (3d n (31 (3d ( (3d (3 n w >dH ) h n h H (3d (3M (3d ( (3d n O ( (3 (31 (3d O (3d (3d (31 (3d (3 (3d (3d ( (31 (3M VR $ {st A BAR%I $t 8s $-R Y sZ B8s Bt YsR x R s R A$t htsj R s R Y ( d stIin yt$ $sj R s b$jj A ( stI $ b$jj A }Rt I Ak { ) D d BtR ( ( ( ( 3 qY t bB, ZRI B jst Y$R sZ B8s Bt YsR At s tZsj t bB, b$ Y x PZ99k {Zt tZBtR stI bB $t}Z tZBtR qY }ss8 R ZRI B jst Ys% At s jst$t s $B ) (31 st stRb$t Bjst{ 6 ) (3(((x stI 8B8t Z8 8 ) (3x yt Y$R R$8Zjs $Bt b tII n {k{jR BP x(( }BJZR B BA s$t s jst$t RZj R BP d((0 BP -s8}jR qY BA s$tI RZj R Bt{ t bB, bsR s$ttI b
2 ) ( M(((
) ( d((( ) ( 1((( (;d ) ( (n1n ddd ) ( (dM dnd ) ( MEx 1(d ) ( 1((( 11d ) ( (((( 1;d ) ( (((( ndd ) ( dEE nnd ) ( 1n; ;(d ) ( d ;1d ) ( M;; ;;d ) ( M1Md
) ( n((( ) ( 1((1 d(( ) ( 1((( d1( ) ( (E( d;( ) ( (MME 1d( ) ( (d; 1n( ) ( 1((( n(( ) ( d1d( n1( ) ( d1d; n;( ) ( d1x ;d( ) ( (((x ;n( ) ( 1xd1
) ( ) ( (d1E d(d ) ( ((( d1d ) ( ( d;d ) ( ( 1dd ) ( (((( 1nd ) ( (((d n(d ) ( d1E( n1d ) ( 1(1E n;d ) ( dM ;dd ) ( (((( ;nd ) ( ((((
!
2 d
!
2(d(
!
2(dd
!
2(1(
!
2(1d
!
2(n(
!
2(nd
!
2
!
2
!
2
!
2
!
2
!
2
!
2
!
2
!
2
!
2
!
2
!
2
!
2
!
2
!
2
!
2
!
2
!
2
!
2
!
2
!
2
!
2
!
2
!
2
!
2
!
2
!
2
!
2
!
2
!
2
!
2
!
2
!
2
!
2
!
2
!
2
!
2
!
2
!
2
!
2
!
2
!
2
!
) ( ((d (;( ) ( ((( dd( ) ( (MM dn( ) ( d(M( 1(( ) ( d((( 11( ) ( 1((( 1;( ) ( d;E; nd( ) ( dd nn( ) ( 1xdE ;(( ) ( (((( ;1( ) ( (((( ;;( ) ( EM1
2
7B PB $tR st{ Y 8st$t BP b$Y 1nd $R Ys Y sZ B8s Bt YsR s stR$ $Bt b$ Y I BP 88ARY$} ( (((d PB8 R s n B R s 1 sI$t Y $t}Z Rk8ABj d qYPB b {st - s{ Y PZ99k sZ B8s Bt sRRB{$s I B Y s$tt$t -s8}jR Ak AZ$jI$t Y PZ99k 8s $-R b$ Y Y R8st ${ BP }%$BZR -s8}jR yt Y$R bsk Y PBjjBb$t PZ99k js $BtR s BA s$tIU
M >(H )
M >dH )
C (!M((( hh (!n((( hh (!((d H (!1((1 C ((!!((( d((( hh (! hh (!1((( H (!(d1E
! ! ! ! ! ! ! ! ! !
( 1((( ( (MM ( (E( ( d(M( ( (MME ( ((( ( (dM ( ( ( MEx ( (n1n ( (
!
! ! ! ! ! ! ! ! ! !
( d((( ( (d; ( 1((( ( 1((( ( d;E; ( 1((( ( (((( ( (((( ( (((d ( ((((
! ! ! ! ! ! ! ! ! !
( d1d( ( dd ( d1d; ( 1xdE ( d1x ( d1E( ( dEE ( 1(1E ( 1n; ( dM
! ! ! ! ! ! ! ! ! !
( (((( ( (((x ( (((( ( 1xd1 ( EM1 ( d ( (((( ( M;; ( (((( ( M1Md
I n n n n O I n n n n O
V jst{B V *jsIB m ] _sjs`s
d;(
;
]Bt{jZR$BtR
G Ys% }B}BRI s PZ99k {Zt tZsj t bB, bY${Y $R {s}sAj BP $tP$t Y sRRB{$s I sZ B8s Bt PB8 RJZt{R BP -s8}jR BP RZ{Y PZ99k jstZs G R$8Zjs Y AYs%$BZ BP Y t bB, $t Y jst$t }YsR PB s R}{$h{ -s8}j RYBb$t Ys Y t bB, jstR B $tP Y sZ B8s Bt sRRB{$s I B Y s$tT $t -s8}jR {B8}Z $t $t Y$ b$Y R Y js $BtR bY${Y {Yss{ $9$t Y AYs%$BZ BP Y sZ B8s Bt B jst
iPt{R >dH
jst{B V *jsIB iJZts y yIt $h{s $Bt BP PZ99k js $Btsj JZs $BtR Ak PZ99k tZsj t bB,R 3Z99k 7 R stI 7kR 8R zBj d } 1dxT11E wdxD
>1H ]j8stR V 7%stT7{Y$A * stI {]jjjstI F dM 3$t$ R s sZ B8s s stI R$8}j {Zt t bB,R WZsj ]B8}Z s $Bt dwnD n1TnMd >nH 3Z 7 7kt s{ ${ _s t i{Bt$ $Bt stI V}}j${s $BtR _t ${ ;H p$jR ] N stI !8j$8 ] G d1 ytR $t ZjR $t B {Zt tZsj t T bB, _B{ d1 yeee GB,RYB} WZsj W bB,R 7$tsj _B{RR }} dnT11 ]B}tYst *t8s, >xH p$jR ] N $jj ] ]Yt * ]Yt d(H t pBBI8st i stI 78k Y _ d; *$R{ {Zt tZsj t T bB,R PB s8s ${sj $tPt{ yeee qstRs{ WZsj W bB,R xw1D n1(Tnn(
