BLIND SEPARATION OF SOURcES WITH SPARSE ... - Research

                         
        !

" # $ % & #' ((#

)*+,-./ *0. 12 31/+4.*- 567*06*8 907:*-;7.< 12 =*> ?*@761 8 ABC4D4*-D4*8 = ? EFGHG /76I,*BJ6;K40/ K*L4 C,+J6;K40/ K*L4 MNOPQMRP STU VWXYZ [\]^_U [U`a^abX\Y `^\VWUc X[ b\ Udb^a_b bTU ]YZU^WeXYf [\]^_U [XfYaW[ g^\c a [Ub \g WXYUa^ cXdh b]^U[i jTU^U bTU cXdXYf cab^Xd X[ ]YkY\jYl mU _\Yh [XZU^ a bj\h[bafU [U`a^abX\Y `^\_U[[l nX^[bi o p qrs t qr [UWU_bX\Y \g a `\[[XVWe \uU^_\c`WUbU [XfYaW ZX_bX\h Ya^e vwxy x jauUWUb g^acUi WUa^YUZ ZX_bX\Ya^ei wz{x| XY jTX_T bTU [\]^_U[ a^U a[[]cUZ b\ VU [`a^[UWe ^U`^Uh [UYbaVWUl }U_\YZi ]YcXdXYf bTU [\]^_U[ Ve Ud`W\XbXYf bTU bTUX^ [`a^[U ^U`^U[UYbaVXWXbel mU _\Y[XZU^ bTU fUYh U^aW _a[U \g c\^U [\]^_U[ bTaY cXdb]^U[i V]b aW[\ ZUh ^XuU a c\^U U~_XUYb aWf\^XbTc XY bTU _a[U \g a Y\Yh \uU^_\c`WUbU ZX_bX\Ya^e aYZ U]aW Y]cVU^[ \g [\]^_U[ aYZ cXdb]^U[l €d`U^XcUYb[ jXbT a^bX_XaW [XfYaW[ aYZ jXbT c][X_aW [\]YZ[ ZUc\Y[b^abU [XfYX_aYbWe VUbbU^ [U`a^abX\Y bTaY \bTU^ kY\jY bU_TYX]U[l

jauUWUbh^UWabUZ ZX_bX\Ya^XU[ vjauUWUb `a_kUb[i [babX\Yh a^e jauUWUb[i wz{xi [UU g\^ Udac`WU ͕i žÎ aYZ ^UgU^h UY_U[ bTU^UXY | i \^ WUa^YUZ ZX_bX\Ya^XU[ ÍÏi Ði ÑÎl }`a^[Xbe cUaY[ bTab \YWe a [caWW Y]cVU^ \g bTU _\U~ _XUYb[  ™ ZXÒU^ [XfYX_aYbWe g^\c ÓU^\l œ mU _\Y[XZU^ a bj\ [bafU [U`a^abX\Y `^\_U[[l nX^[bi o p qr t qr [UWU_bX\Y \g a `\[[XVWe \uU^_\c`WUbU [XfYaW ZX_bX\h Ya^e XY jTX_T bTU [\]^_U[ a^U a[[]cUZ b\ VU [`a^[UWe ^U`^U[UYbaVWUl }U_\YZi ]YcXdXYf bTU [\]^_U[ Ve Udh `W\XbXYf bTUX^ [`a^[U ^U`^U[UYbaVXWXbel ‰Y bTU ZX[_^UbU bXcU _a[U Œ “ •Ô žÔ Õ Õ Õ Ô Ö jU ][U cah b^Xd Y\babX\Yl × X[ aY Š  Ö cab^Xd i jXbT bTU ØhbT _\c`\YUYb ‹  vŒ | \g bTU [UY[\^ [XfYaW XY ^\j Øi Ù X[ aY   Ö cab^Xd jXbT bTU [XfYaW ŽÚ vŒ | XY ^\j Û i aYZ Ü X[ a Ý  Ö cab^Xd jXbT Va[X[ g]Y_bX\Y ™ vŒ | XY ^\j Þ l €]abX\Y[ v• | aYZ vž | bTUY bakU bTU g\WW\jXYf [Xc`WU g\^c × “ ‘Ù ” ’ vÏ | Ù “ Ü vÐ | ß\cVXYXYf bTUc i jU fUb bTUœ g\WW\jXYf jTUY bTU Y\X[U X[ [caWW × à‘ Ü œ á]^ f\aW bTU^Ug\^U _aY VU g\^c]WabUZ a[ g\WW\j[â ãräw¢ zåw   w¢  t q   ry ¢o¡ Ÿ ozqræ × o¢ç zåw çr{zr t ¢oqè Üé ê ¢ç o Ÿ rær¢ y Ÿ ozqræ ‘ o¢ç Ÿ ozqræ të {twì {rw¢z   í {å zåoz × à ‘ Ü o¢ç r  o    poq   w œo   p t   rî¡wx œ œ ïƒ ðQ†NMN„ñ„OP„R òQMó ôõ †Qö ‰Y \^ZU^ b\ ZU^XuU a cadXc]c o p t  zwqr t qr [\W]bX\Yi jU _\Y[XZU^ bTU VWXYZ [\]^_U [U`a^abX\Y `^\VWUc XY a `^\Vh aVXWX[bX_ g^acUj\^k Í÷i øÎl }]``\[U bTab bTU _\U~_XUYb[  ™ XY [\]^_U ZU_\c`\[XbX\Y vÐ | a^U [babX[bX_aWWe XYZUh `UYZUYb ^aYZ\c ua^XaVWU[ jXbT a `^\VaVXWXbe ZUY[Xbe œ g]Y_bX\Y v`Zg | \g aY Ud`\YUYbXaW be`U vÑ | ù  v  ™ | ú Ud` ûüýv  ™ | œ œ

‚ƒ „…PQ†‡ˆ RP„†… ‰Y VWXYZ [\]^_U [U`a^abX\Y aY Š h_TaYYUW [UY[\^ [XfYaW ‹ vŒ | a^X[U[ g^\c  ]YkY\jY [_aWa^ [\]^_U [XfYaW[ Ž vŒ | i WXYUa^We cXdUZ b\fUbTU^ Ve aY ]YkY\jY Š   cab^Xd ‘ i aYZ `\[[XVWe _\^^]`bUZ Ve aZZXbXuU Y\X[U ’ vŒ | v• | ‹ vŒ | “ ‘ŽvŒ| ” ’ vŒ | mU jX[T b\ U[bXcabU bTU cXdXYf cab^Xd ‘ aYZ bTU  h ZXcUY[X\YaW [\]^_U [XfYaW ŽvŒ | l –aYe Yab]^aW [XfYaW[ _aY VU [`a^[UWe ^U`^U[UYbUZ XY a `^\`U^ [XfYaW ZX_bX\h Ya^e —  ™ ™ vŒ | Ž vŒ | “ ˜ vž | ™š› œ STU [_aWa^ g]Y_bX\Y[ ™ vŒ | a^U _aWWUZ oz tŸ  \^ w¡ws Ÿ w¢z   \g bTU ZX_bX\Ya^el STU[U UWUcUYb[ Z\ Y\b TauU b\ VU WXYUa^We XYZU`UYZUYbi aYZ XY[bUaZ cae g\^c aY \uU^_\c`WUbU ZX_bX\Ya^el ‰c`\^baYb Udac`WU[ a^U £¤¥¥¦§¨©ª «¬ ¥­§¨ ®¯ °£± ²³´µµ´ ­¶­§ª ·¸¹º»¹¼½½¾ ¨¿© °­¨«¦¬­À ±¦¤¬ª­¨«¦¬ Á¦§ ±¤¬Â¨«¦¬­À ç­«¬ ÄÅ­Æ«¬Æ¾ ­¬ ©Ç¤«¥¹ Å©¬¨ Ƨ­¬¨ Á§¦Å Ĭ¨©À ¦§¥¦§­¨«¦¬¾ ¨¿© ³À®¤Ç¤©§Ç¤© È«Æ¿ É©§¹ Á¦§Å­¬Â© ²¦Å¥¤¨«¬Æ ²©¬¨©§¾ ­ Æ«Á¨ Á§¦Å Ê©¦§Æ© ²¦¶­¬¾ ­¬ª ­ Æ«Á¨ Á§¦Å ¨¿© °µ² ´©Ë©­§Â¿ Ĭ˨«¨¤¨©Ì 181

áYU _aY _\Y[XZU^ bTX[ \V 6 U_bXuU a[ a fUYU^aWXÓabX\Y \g ÍÑÎ Ve XY_\^`\^abXYf bTU cab^Xd Üi \^ a[ a fUYU^aWh XÓabX\Y \g ͕ΠVe XY_W]ZXYf bTU cab^Xd ‘ l áYU `^\VWUc jXbT []_T a g\^c]WabX\Y X[ bTab Xb _aY WUaZ b\ bTU ZUh fUYU^abU [\W]bX\Y “ aYZ ‘ “ 7 l mU _aY \uU^_\cU bTX[ ZX~ _]Wbe XY ua^X\][ œ jae[l STU ^[b a``^\a_T X[ b\ g\^_U Ua_T ^\j ‘ \g bTU cXdXYf cab^Xd ‘ b\ VU V\]YZUZ XY Y\^c i ‘ • Ø “ •Ô Õ Õ Õ Ô Š Õ v•Ð | ' '8 STU [U_\YZ jae X[ b\ ^U[b^X_b bTU Y\^c \g bTU ^\j[ Ú g^\c VUW\j œ Ú • Û “ •Ô Õ Õ Õ Ô  Õ v•Ñ | ' ' bTX^Z jaeœX[ b\ ^UU[bXcabU bTU `a^acUbU^[ üÚ Va[UZ \Y bTU _]^^UYb uaW]U[ \g Ú l n\^ Udac`WUi bTX[ _aY VU Z\YU ][XYf [ac`WXYf ua^XaY_U œ a[ g\WW\j[â g\^ a fXuUY g]Y_bX\Y ýv 9| XY bTU ZX[b^XV]bX\Y vÑ | i Ud`^U[[ bTU ua^XaY_U \g Ú ™ a[ a g]Y_bX\Y :; vü | l Y U[bXcabU \g ü _aY VU \VbaXYUZ œ Ve a``WeXYf bTU _\^^U[`\YZXYf XYuU^[U g]Y_bX\Y b\ bTU [ac`WXYf ua^XaY_Ui üÚ< “ : ;= › vÝ = › ˜ Ú™ | v•÷ | ™ œ ‰Y `a^bX_]Wa^i jTUY ýv
| “ 
i ua^v
| “ žü =  aYZ ž üÚ< “ v•ø | ) Ý = › * ™ Ú™ œ }]V[bXb]bXYf ýv 9| aYZ ü< XYb\ v•Ï | i jU \VbaXY cXY ž •  '‘ Ü û × '( ” ˜ ž * ™ œ Ú ™  v• | ! Ú ) Ý = › * ™ Ú™ œ œ STX[ \V 6 U_bXuU g]Y_bX\Y X[ XYua^XaYb b\ a ^U[_aWXYf \g bTU ^\j[ \g _\cVXYUZ jXbT a _\^^U[`\YZXYf XYuU^[U ^U[_aWXYf \g bTU œ _\W]cY[ \g ‘ l

STX[ kXYZ \g ZX[b^XV]bX\Y X[ jXZUWe ][UZ g\^ c\ZUWXYf [`a^[Xbe ÍÏi ÑÎl ^Ua[\YaVWU _T\X_U \g ýv
| cae VU • ýv
| “ 
›  v÷ | \^ a [c\\bT a``^\dXcabX\Y bTU^U\gl  U^U jU jXWW ][U a gacXWe \g _\YuUd [c\\bT a``^\dXcabX\Y[ b\ bTU aV[\h W]bU uaW]U ý › v
| “ 
 û W\fv• ” 
| vø | ý  v
| “ ý › v
| v | jXbT a `^\dXcXbe `a^acUbU^â ý  v
| 
 a[  l mU aW[\ []``\[U o pqr t qr bTab bTU cXdXYf cab^Xd ‘ X[ ]YXg\^cWe ZX[b^XV]bUZ \uU^ bTU ^aYfU \g XYbU^U[bi aYZ bTab bTU Y\X[U ’ vŒ | XY vÏ | X[ a [`abXaWWe aYZ bUch `\^aWWe ]Y_\^^UWabUZ  a][[XaY `^\_U[[ › jXbT ÓU^\ cUaY aYZ ua^XaY_U   l ƒ ó      mU jX[T b\ cadXcXÓU bTU `\[bU^X\^ `^\VaVXWXbe cad v‘ Ô  × | ú cad v×  ‘ Ô | v‘ | v | v# | ! " œ ! " œ" " œ jTU^U v×  ‘ Ô | X[ bTU _\YZXbX\YaW `^\VaVXWXbe \g " × fXuUYœ ‘ aYZ l SakXYf XYb\ a__\]Yb vÏ | i \V[U^uXYf vÐ | i aYZ bTU jTXbU  a][[XaYœ Y\X[Ui jU fUb v×  ‘ Ô | ú $ Ud` û v׏% û žv‘ œ Ü | % |  v• | " œ % & e bTU [babX[bX_aW XYZU`UYZUY_U \g bTU _\U~_XUYb[ Ú ™ aYZ vÑ | i bTU `^X\^ `Zg \g X[ œ œ v | ú $ Ud`vûüÚ ýv Ú ™ || v••| " œ ڙ œ ‰g bTU `^X\^ `Zg v‘ | X[ ]YXg\^c i Xb _aY VU Z^\``UZ  g^\c v# | l ‰Y bTX[ "jae jU a^U WUgb jXbT bTU `^\VWUc cad v×  ‘ Ô | v | Õ v•ž | ! " " œ œ & e []V[bXb]bXYf v• | aYZ v•• | XYb\ v•ž | i bakXYf bTU W\fh a^XbTc i aYZ XYuU^bXYf bTU [XfYi jU \VbaXY bTU g\WW\jXYf \`bXcXÓabX\Y `^\VWUc cXY ž •  '‘ Ü û × '( ” ˜ üÚ ýv Ú ™ | v•Ï | ! ڙ œ œ jTU^U ‘ ( “ )*  Ú ‘ Ú X[ bTU n^\VUYX][ cab^Xd Y\^c l ' ' +, ¿© ««ª ¬¦«Ë© ­Ëˤť¨«¦¬ «Ë Á¦§ Ë«Å¥À«Â«¨¯ ¦Á © - ¥¦Ë«¨«¦¬ ­¬ª ­¬ ®© ©­Ë«À¯ §©Å¦. ©ªÌ /0 ¨¿©§¶«Ë©¾ «Á 1 234 «Ë ˦ũ ¦¨¿©§ 5 ¬¦¶¬ Á¤¬Â¨«¦¬¾ ¶© Ë¿¦¤Àª ¤Ë© 2· 4 ª«§©Â¨À¯Ì

ïƒïƒ ô   > ?    >   STX[ Ud`U^XcUYb ZUc\Y[b^abU[ bTab [\]^_U[ jTX_T TauU uU^e [`a^[U ^U`^U[UYbabX\Y[ _aY VU [U`a^abUZ aWc\[b `U^gU_bWei UuUY jTUY bTUe a^U _\^^UWabUZ aYZ bTU Y]ch VU^ \g [ac`WU[ X[ [caWWl mU ][UZ bTU [baYZa^Z jauUWUb `a_kUb ZX_bX\Ya^e jXbT bTU Va[X_ jauUWUb   è ŸŸ ¡wzs @ l m TUY bTU [XfYaW WUYfbT X[ ÷Ð [ac`WU[i bTX[ ZX_bX\Ya^e _\Y[X[b[ \g ÐÐ  ab\c[ rxwx Xb X[ \uU^_\c`WUbU Ve a ga_b\^ \g [UuUYl €dh ac`WU[ \g ab\c[ aYZ bTUX^ XcafU[ XY bTU bXcUhg^U]UY_e `Ta[U `WaYU Í i žÎ a^U [T\jY XY nXf]^U •l mU ][UZ bTU Sᖉ A € B Í# Î aYZ m C € D & ͕ Î – S D & `a_kh afU[ g\^ ga[b c]WbX`WX_abX\Y Ve Ü aYZ Ü E l mU _^UabUZ 182

XY  & – l ‰Y aWW bTU _a[U[ jU ][UZ ý  v 9| ZUYUZ Ve vø | aYZ v | i jXbT bTU `a^acUbU^ “ Õ •l Y\bTU^ `a^acUbU^   “ Õ

•l STU ^U[]WbXYf U^^\^[ \g bTU [\]^_U U[bXh cabU[ jU^U l #  aYZ l ž  Ve bTU ^[b aYZ bTU [U_\YZ cUbT\Z ^U[`U_bXuUWel STU U[bXcabUZ [\]^_U[ a^U [T\jY XY bTU V\bb\c bT^UU b^a_U[ \g nXf]^U žl STUe a^U uX[]h aWWe XYZX[bXYf]X[TaVWU g^\c bTU \^XfXYaW [\]^_U[i [T\jY XY b\` bT^UU b^a_U[ \g nXf]^U žl ‰b X[ Xc`\^baYb b\ Y\bU bTU _\c`]babX\YaW ZX~ _]Wh bXU[ \g bTX[ a``^\a_Tl nX^[bi bTU \V 6 U_bXuU g]Y_bX\Y[ [UUc b\ TauU c]WbX`WU W\_aW cXYXcal n\^ bTX[ ^Ua[\Y i ^Uh WXaVWU _\YuU^fUY_U ja[ a_TXUuUZ \YWe jTUY bTU [Ua^_Th [ba^bUZ ^aYZ\cWe jXbTXY •   ž  ZX[baY_U g^\c a_b]aW [\W]bX\Y vXY \^ZU^ b\ fUb []_T aY XYXbXaW f]U[[i \YU _aY ][U a _W][bU^XYfhbe`U aWf\^XbTc i a[ XY ͕ÏÎ | l }U_\YZi bTU cUbT\Z \g _\Y6 ]fabU f^aZXUYb[ ^U]X^U[ a gUj bT\][aYZ XbU^abX\Y[ b\ _\YuU^fUi jTX_T bakU[ aV\]b Ñ cXY ab  UYbX]c Ï

–  Ó `^\_U[[\^ UuUY g\^ bTX[ uU^e [caWW `^\VWUc  l ‰Y bTU ^UcaYXYf `a^b \g bTU `a`U^ jU `^U[UYb gUj \bTU^ a``^\a_TU[i jTX_T TUW` b\ [baVXWXÓU aYZ a__UWU^abU \`bXcXÓabX\Yl

0.5 0 −0.5 10

20

30

40

50

60

10

20

30

40

50

60

10

20

30

40

50

60

0.5 0 −0.5

0.5 0 −0.5

nXf]^U •â €dac`WU[ \g ab\c[â bXcUhg^U]UY_e `Ta[U `WaYU vWUgb | aYZ bXcU `W\b v^XfTbl|
 0.5

0

−0.5 10

20

30

40

50

60

10

20

30

40

50

60

10

20

30

40

50

60

10

20

30

40

50

60

10

20

30

40

50

60

10

20

30

40

50

60

10

20

30

40

50

60

10

20

30

40

50

60

0.5

0

−0.5

0.5

0

−0.5

   0.6 0.4 0.2 0 −0.2 −0.4 −0.6

0.6 0.4 0.2 0 −0.2 −0.4 −0.6

   


ƒ ô  ˆMñ …ˆó NôQ †ò O†ˆQRôO M…‡ Oô… O†Q O ? ó †Qô Q†Nˆ OP ò†Qó ˆñMP„†… O STU caXY ZX~_]Wbe XY a cadXcXÓabX\Y `^\VWUc WXkU v•Ï | X[ bTU VXWXYUa^ bU^c ‘ Üi jTX_T ZU[b^\e[ bTU _\YuUdXbe \g bTU \V 6 U_bXuU g]Y_bX\Y œ aYZ cakU[ _\YuU^fUY_U ]Y[bah VWU jTUY \`bXcXÓabX\Y [ba^b[ ga^ g^\c bTU [\W]bX\Yl ‰Y bTX[ [U_bX\Y jU _\Y[XZU^ c\^U ^\V][b g\^c]WabX\Y[ g\^ bTU _a[U jTUY bTU Y]cVU^ \g [UY[\^[ X[ U]aW b\ bTU Y]cVU^ \g [\]^_U[i Š “  i aYZ bTU cXdXYf cab^Xd X[ XYuU^bXVWU  “ ‘ = › l m TUY bTU Y\X[U X[ [caWW aYZ bTU cab^Xd ‘ X[ ga^ g^\c [XYf]Wa^i  × fXuU[ a ^Ua[\YaVWU U[bXcabU \g bTU [\]^_U [XfYaW[ Ù l SakXYf XYb\ a__\]Yb vÐ | i jU \VbaXY a WUa[b []a^U bU^c ' Ü û  × '( i [\ bTU [U`a^abX\Y \V 6 U_bXuU cae VU j^XbbUY œ • cXY ž ' Ü û  × '( ”  ˜ üÚ ýv Ú ™ | vž | ! Ú œ ™ œ mU aW[\ YUUZ b\ aZZ a _\Y[b^aXYb jTX_T UYg\^_U[ bTU Y\Yh[XYf]Wa^Xbe \g  l n\^ Udac`WUi jU _aY ^U[b^X_b g^\c VUW\j Xb[ cXYXcaW [XYf]Wa^ uaW]U    v | â     v |  • vž•| ‰b _aY VU [T\jYi bTab XY bTU Y\X[UWU[[ _a[Ui  à i bTU `^\VWUc vž | vž•| X[ U]XuaWUYb b\ bTU cadXc]c a  0 ¤§ ¥§©À«Å«¬­§¯ © - ¥©§«Å©¬¨Ë ¶«¨¿ ¦¨¿©§ ­ÀƦ§«¨¿ÅË 2À« 5 © ¨§¤¬Â­¨©ª °©¶¨¦¬ Å©¨¿¦ª 4 Æ«. © ­ ¿¦¥© ¨¦ §©ª¤Â© ¨¿«Ë ¨«Å«¬Æ ®¯ ­¬ ¦§ª©§ ¦Á ŭƬ«¨¤ª© ¦§ Ŧ§©Ì 

0.5

0

−0.5

0.5

0

−0.5

0.5

0

−0.5

nXf]^U žâ }\]^_U[i cXdb]^U[ aYZ ^U_\Y[b^]_bUZ [\]^_U[i XY V\bT bXcUhg^U]UY_e `Ta[U `WaYU vWUgb | aYZ bXcU Z\h caXY v^XfTb | l bT^UU uU^e [`a^[U [\]^_U[ vnXf]^U ži b\` | i Ua_T _\ch `\[UZ \g \YWe bj\ \^ bT^UU ab\c[l STU ^[b bj\ [\]^_U[ TauU [XfYX_aYb _^\[[h_\^^UWabX\Yi U]aW b\ lÏÐi jTX_T cakU[ [U`a^abX\Y ZX~_]Wb g\^ _\YuUYbX\YaW cUbT\Z[l Sj\ [eYbTUbX_ [UY[\^ [XfYaW[ vnXf]^U ži _UYbU^ | jU^U \VbaXYUZ a[ a WXYUa^ cXdb]^U \g bTU [\]^_U[l ‰Y \^ZU^ b\ cUa[]^U bTU a__]^a_e \g bTU [U`a^abX\Yi jU Y\^caWXÓUZ bTU \^XfXYaW [\]^_U[ jXbT 'ÙÚ ' “ •i aYZ bTU U[bXcabUZ [\]^_U[ jXbT 'ÙÚ ' “ •l STU U^^\^ ja[ bTUY _\c`]bUZ a[  €^^\^ “ 'ÙÚ ÙÚû ÙÚ ' 9 •

 v•# | ' ' mU bU[bUZ bj\ cUbT\Z[ jXbT bTX[ Zabal STU ^[b cUbT\Z ][UZ bTU \V 6 U_bXuU g]Y_bX\Y v•Ï | aYZ bTU _\Yh [b^aXYb[ v•Ñ | i jTXWU bTU [U_\YZ cUbT\Z ][UZ bTU \V 6 U_h bXuU g]Y_bX\Y v• | l [ a b\\W g\^ _\Y[b^aXYUZ \`bXcXÓah bX\Y jU ][UZ bTU  & – cUbT\Z ͕•Îl  Y_\Y[b^aXYUZ \`h bXcXÓabX\Y ja[ `^\Z]_UZ Ve bTU cUbT\Z \g _\Y6 ]fabU f^aZXUYb[ ][XYf bTU SᖠD & `a_kafU ͕žÎl STU [acU b\\W ja[ ][UZ g\^ XYbU^YaW ]Y_\Y[b^aXYUZ \`bXcXÓabX\Y 183

 ƒ òM OP O†ñˆP„†… „… … †…  † ôQR†ó ðñôPô ‡„RP„†…MQ„ôO ‰Y Xc`\^baYb a``WX_abX\Y[i bTU [UY[\^ [XfYaW[ cae TauU T]YZ^UZ[ \g _TaYYUW[ aYZ T]YZ^UZ[ \g bT\][aYZ[ \g [ac`WU[l STX[ cae cakU [U`a^abX\Y _\c`]babX\YaWWe ZX~ _]Wbl  U^U jU `^U[UYb aY a``^\a_T jTX_T _\c`^\h cX[U[ VUbjUUY [babX[bX_aW aYZ _\c`]babX\YaW U~ _XUY_el ‰Y \]^ Ud`U^XUY_U bTX[ a``^\a_T `^\uXZU[ TXfT ]aWXbe \g [U`a^abX\Y XY ^Ua[\YaVWU bXcUl }]``\[U bTab bTU ZX_bX\Ya^e X[ _\c`WUbUi rxwx Xb g\^c[ a Va[X[ XY bTU [`a_U \g ZX[_^UbU [XfYaW[l STX[ cUaY[ bTab bTU cab^Xd Ü X[ []a^U aYZ Y\Yh[XYf]Wa^l [ Udac`WU[ \g []_T a ZX_bX\Ya^e \YU _aY bTXYk \g bTU n\]^XU^ Va[X[i  aV\^ Va[X[i ua^X\][ jauUWUbh^UWabUZ Va[U[i wz{x mU _aY aW[\ \VbaXY aY \`bXcaW  ZX_bX\Ya^e Ve WUa^YXYf g^\c fXuUY gacXWe \g [XfYaW[ ÍÏi Ði ÑÎl D Ub ][ ZUY\bU bTU Z]aW Va[X[ “ Ü =› vžÐ | aYZ []``\[U bTab _\U~ _XUYb[ \g ZU_\c`\[XbX\Y \g bTU [\]^_U[ “ Ù vžÑ | œ a^U [`a^[U aYZ [babX[bX_aWWe XYZU`UYZUYbl STX[ a[[]c`h bX\Y X[ ^Ua[\YaVWU g\^ `^\`U^We _T\[UY ZX_bX\Ya^XU[i aWh bT\]fT \g _\]^[U jU j\]WZ W\[U bTU aZuaYbafU[ \g \uU^h _\c`WUbUYU[[l D Ub VU bTU ZU_\c`\[XbX\Y \g bTU [UY[\^ [XfYaW[

“ × vž÷ | –]WbX`WeXYf V\bT [XZU[ \g vÏ | Ve g^\c bTU ^XfTb aYZ bakXYf XYb\ a__\]Yb vžÑ | aYZ vž÷ | i jU \VbaXY

“ ‘ ” Ô vžø | œ jTU^U  X[ ZU_\c`\[XbX\Y \g bTU Y\X[U  “ ’ Õ vž  |  U^U jU _\Y[XZU^ aY Ua[e  [Xb]abX\Y i jTUY  X[ a jTXbU Y\X[Ui bTab ^U]X^U[ \^bT\f\YaWXbe \g l mU _aY [UU bTab aWW bTU \V 6 U_bXuU g]Y_bX\Y[ g^\c bTU `^UuX\][ [U_bX\Y[ ^UcaXY uaWXZ Xg jU ^Uc\uU g^\c bTUc Ü v[]V[bXb]bXYf XY[bUaZ bTU XZUYbXbe cab^Xd | aYZ ^U`Wa_U bTU [UY[\^ [Xfh YaW × Ve Xb[ ZU_\c`\[XbX\Y l n\^ Udac`WUi cadXc]c o p t  zwqr t qr \V 6 U_bXuU[ v•Ï | aYZ v• | a^U b^aY[g\^cUZ XYb\ cXY ž •  '‘ û '( ” ˜ üÚ ýv Ú ™ | vž # | ! ڙ œ œ aYZ cXY ž •  '‘ û '( ” ˜ ž * ™ œ Ú ™  vÏ | ! Ú ) Ý = › * ™ Ú™ œ œ

(57%)

(29%) (27%)

(0.2%)

Cardoso’s JADE

Fast ICA

BS Infomax

Equation 22

nXf]^U Ïâ  U^_UYb ^UWabXuU U^^\^ \g [U`a^abX\Y \g bTU a^bX_XaW [`a^[U [\]^_U[ ^U_\uU^UZ Ve v•|
€i vž | na[b ‰ß i vÏ | & UWWh}U6 Y\j[kX ‰Yg\cadi vÐ | €]abX\Y žžl `\[bU^X\^X g\^c]WabX\Y v•Ï | jXbT bTU _\Y[b^aXYb '‘ ' 8 •Õ Y\bTU^ `\[[XVXWXbe g\^ UY[]^XYf bTU Y\Yh[XYf]Wa^Xbe \g  X[ b\ []Vb^a_b Ý W\f  ZUb   g^\c bTU \V 6 U_bXuU cXY ûÝ W\f  ZUb   ” ž• ' Ü û  × '( ”  ˜ üÚ ýv Ú ™ | ! ڙ œ œ vžž | m TUY bTU Y\X[U X[ ÓU^\ aYZ Ü X[ bTU XZUYbXbe cab^Xd i jU _aY []V[bXb]bU “  × aYZ \VbaXY bTU & UWWh}U6 Y\j[kX ‰Yg\cad \V 6 U_bXuU œ ͕ÐÎ cXY ûÝ W\f  ZUb   ” ˜ üÚ ývv × |Ú ™ |  ڙ

vžÏ |

ô   > ?     >      >  >  

mU _^UabUZ bj\ [`a^[U [\]^_U[ jXbT [b^\Yf _^\[[h _\^^UWabX\Y \g lўl }U`a^abX\Yi `^\Z]_UZ Ve cXYXh cXÓabX\Y \g bTU \V 6 U_bXuU g]Y_bX\Y vžž | i fauU aY U^^\^ \g lžÏ  l B \V][b _\YuU^fUY[U ja[ a_TXUuUZ jTUY jU [ba^bUZ g^\c ^aYZ\c ]YXg\^cUWe ZX[b^XV]bUZ `\XYb[ XY aYZ  l œ n\^ _\c`a^X[\Y jU bU[bUZ bTU
€ ͕Ñi •÷Îi na[h b‰ß ͕øi • Î aYZ & UWWh}U6 Y\j[kX ‰Yg\cad ͕Ði •# Î aWh f\^XbTc[ \Y bTU [acU [XfYaW[l WW bT^UU _\ZU[ jU^U \Vh baXYUZ g^\c bTU ^UgU^UUZ jUV[XbU[ aYZ jU^U ][UZ jXbT ZUga]Wb [UbbXYf \g aWW `a^acUbU^[l STU ^U[]WbXYf ^UWabXuU U^^\^[ vnXf]^U Ï | _\Y^c bTU [XfYX_aYb []`U^X\^Xbe \g bTU [`a^[U ZU_\c`\[XbX\Y a``^\a_Tl STX[ [bXWW bakU[ a gUj bT\][aYZ[ _\Y6 ]fabU f^aZXh UYb [bU`[ b\ _\YuU^fU vaV\]b Ñ cXY \Y a  UYbX]c Ï

–  Ó | l n\^ _\c`a^X[X\Yi
€i na[b‰ß aYZ ‰Yg\cad bakU \YWe gUj [U_\YZ[l & UW\j jU jXWW _\Y[XZU^ [\cU \`bX\Y[ g\^ a__UWU^abX\Yl 184

STU \V 6 U_bXuU vžž | VU_\cU[ cXY ûÝ W\f  ZUb   ” ž• ' û  '( ”  ˜ üÚ ýv Ú ™ | ! ڙ œ œ vϕ| ‰Y bTX[ _a[U jU _aY g]^bTU^ a[[]cU bTab bTU Y\X[U X[ ÓU^\l []V[bXb]bU “  aYZ \VbaXY bTU & UWWh}U6 Y\j[kX ‰Yh g\cad \V 6 U_bXuU œ ͕ÐÎ cXY ûÝ W\f  ZUb   ” ˜ üÚ ývv |Ú ™ | vϞ |  ڙ W[\ \bTU^ kY\jY cUbT\Z[ vg\^ Udac`WUi ͞ i ÏÎ | i jTX_T Y\^caWWe a[[]cU [`a^[Xbe \g [\]^_U [XfYaW[i cae VU ZX^U_bWe a``WXUZ b\ bTU ZU_\c`\[XbX\Y \g bTU [UYh [\^ [XfYaW[l STX[ cae VU c\^U U~_XUYb bTaY bTU b^ah ZXbX\YaW a``^\a_Ti aYZ bTU ^Ua[\Y X[ \VuX\][â be`Xh _aWWei a `^\`U^We _T\[UY ZU_\c`\[XbX\Y fXuU[ [XfYXh _aYbWe TXfTU^ [`a^[Xbe bTaY bTU ^aj [XfYaW[ TaZ \^Xfh XYaWWel W[\i [babX[bX_aW XYZU`UYZUY_U \g bTU _\U~ _XUYb[ X[ a c\^U ^Ua[\YaVWU a[[]c`bX\Y bTaY [babX[bX_aW XYZUh `UYZUY_U \g bTU ^aj [XfYaW [ac`WU[l

4

4000

8

x 10

3000

6 2000

4 1000

2 0 −6

−4

−2

0

2

4

6

0 −1

−0.8

−0.6

−0.4

−0.2

0

0.2

0.4

0.6

0.8

80

1 4

x 10

300 60

200

40 20 0 −6

100 −4

−2

0

2

4

6

10

0 −1

−0.8

−0.6

−0.4

−0.2

0

0.2

0.4

0.6

0.8

1 4

x 10

15 10

5

5

nXf]^U Ðâ  X[b\f^ac \g [\]YZ [\]^_U uaW]U[ vWUgb | aYZ [`U_b^\f^ac _\U~ _XUYb[ v^XfTb | i [T\jY jXbT WXYUa^ eh [_aWU vb\` | i []a^U ^\\b eh[_aWU v_UYbU^ | aYZ W\fa^XbTcX_ eh[_aWU vV\bb\c | l 0 −6

−4

−2

0

2

4

6

0 −1

−0.8

−0.6

−0.4

−0.2

0

0.2

0.4

0.6

0.8

1

4

x 10

(8.8%)

(8.6%) (7.1%)

Cardoso’s JADE 

Fast ICA

BS Infomax

(0.9%)

(0.67%)

Spect− Infomax

Spect− BFGS

nXf]^U Ñâ U^_UYb ^UWabXuU U^^\^ \g [U`a^abX\Y \g [UuUY c][X_aW [\]^_U[l ^U_\uU^UZ Ve v•|
€ i vž | na[b ‰ß i vÏ | & UWWh}U6 Y\j[kX ‰Yg\cad i vÐ | ‰Yg\cad i a``WXUZ b\ bTU [`U_b^\f^ac _\U~ _XUYb[i vÑ | & n  } cXYXcXÓabX\Y \g bTU \V 6 U_bXuU vϞ | jXbT bTU [`U_b^\f^ac _\U~ _XUYb[l

ô   > ?    >   ‰Y \]^ Ud`U^XcUYb[ jU a^bX_XaWWe cXdUZ [UuUY Ñh[U_\YZ g^afcUYb[ \g c][X_aW [\]YZ ^U_\^ZXYf[ bakUY g^\c _\ch cU^_XaW ZXfXbaW a]ZX\ ß
[l €a_T \g bTUc XY_W]ZUZ Ð k [ac`WU[ agbU^ Z\jYh[ac`WXYf Ve a ga_b\^ \g Ñl STU Ua[XU[b jae b\ `U^g\^c [`a^[U ZU_\c`\[XbX\Y \g []_T [\]^_U[ X[ b\ _\c`]bU a  pw{zq ty qo Ÿ i bTU _\Ugh _XUYb[ \g a bXcUhjXYZ\jUZ ZX[_^UbU n\]^XU^ b^aY[g\^c l vmU ][UZ bTU g]Y_bX\Y }  €ß B – g^\c bTU – Sh D & [XfYaW `^\_U[[XYf b\\WV\d jXbT a bXcU jXYZ\j \g • žÐ [ac`WU[l| STU [`a^[Xbe \g bTU [`U_b^\f^ac _\U~h _XUYb[ vbTU TX[b\f^ac XY nXf]^U Ði ^XfTb | X[ c]_T TXfTU^ bTUY bTU [`a^[Xbe \g bTU \^XfXYaW [XfYaW vnXf]^U Ði WUgb | ‰Y bTX[ _a[U vž÷ | X[ a ^UaW cab^Xdi jXbT [U`ah ^abU UYb^XU[ g\^ bTU ^UaW aYZ XcafXYa^e _\c`\YUYb[ \g Ua_T [`U_b^\f^ac _\U~_XUYb \g bTU [UY[\^ [XfYaW[ × l mU ][UZ bTU \V 6 U_bXuU g]Y_bX\Y vϞ | jXbT üÚ “ • aYZ ý  v 9| ZUYUZ Ve vø | iv | jXbT bTU `a^acUbU^ “ • = l  Y_\Y[b^aXYUZ cXYXcXÓabX\Y ja[ `U^g\^cUZ Ve a & n  }
]a[Xh  Ujb\Y aWf\^XbTc v– S D & g]Y_bX\Y n–‰   l| STX[ aWf\^XbTc [U`a^abUZ bTU [\]^_U[ jXbT a ^UWabXuU U^^\^ \g l÷ø  g\^ bTU WUa[b jUWW [U`a^abUZ [\]^_U vU^^\^ _\c`]bUZ a__\^ZXYf b\ v•# | l| mU aW[\ a``WXUZ bTU & UWWh }U6 Y\j[kX ‰Yg\cad aWf\^XbTc ͕ÐÎ Xc`WUcUYbUZ XY ͕# Î b\ bTU [`U_b^\f^ac _\U~_XUYb[ \g bTU [UY[\^ [XfYaW[l }U`a^abX\Y U^^\^[ jU^U [WXfTbWe Wa^fU^â l#  i V]b bTU _\c`]bXYf bXcU ja[ Xc`^\uUZ vg^\c Ï cXY g\^ & n  } b\ Ñ cXY g\^ ‰Yg\cad | l

n\^ _\c`a^X[\Y jU bU[bUZ
€ ͕Ñi •÷Îi na[b‰_a ͕øi • Î aYZ ‰Yg\cad aWf\^XbTc[ \Y bTU ^aj [UY[\^ [Xfh YaW[l B U[]WbXYf ^UWabXuU U^^\^[ vnXf]^U Ñ | _\Y^c bTU [XfYX_aYb vVe a ga_b\^ \g c\^U bTaY • | []`U^X\^Xbe \g bTU [`a^[U ZU_\c`\[XbX\Y a``^\a_T l STU cUbT\Z ZU[_^XVUZ XY bTX[ [U_bX\Yi bTab _\cVXYU[ [`U_b^\f^ac b^aY[g\^cabX\Y[ jXbT bTU ‰Yg\cad aWf\h ^XbTc i X[ XY_W]ZUZ Ve }_\bb – akUXf XYb\ bTU ‰ß  €€  b\\WV\d ͕# Îl ƒ R†… Rñˆ O„†… O mU [T\jUZ bTab bTU ][U \g [`a^[U ZU_\c`\[XbX\Y XY a `^\`U^ [XfYaW ZX_bX\Ya^e `^\uXZU[ TXfTh]aWXbe VWXYZ [\]^_U [U`a^abX\Yl STU cadXc]c o p t  zwqr t qr g^acUh j\^k fXuU[ bTU c\[b fUYU^aW a``^\a_T i jTX_T XY_W]ZU[ bTU [Xb]abX\Y \g c\^U [\]^_U[ bTaY [UY[\^[l ß\c`]bah bX\YaWWe c\^U ^\V][b [\W]bX\Y[ _aY VU g\]YZ XY bTU _a[U \g aY U]aW Y]cVU^ \g [\]^_U[ aYZ [UY[\^[l mU _aY aW[\ Udb^a_b bTU [\]^_U[ [U]UYbXaWWe ][XYf ]aZ^abX_ `^\h f^accXYf jXbT Y\Yh_\YuUd ]aZ^abX_ _\Y[b^aXYb[l nXh YaWWei c]_T ga[bU^ [\W]bX\Y cae VU \VbaXYUZ ][XYf Y\Yh \uU^_\c`WUbU ZX_bX\Ya^XU[l á]^ Ud`U^XcUYb[ jXbT a^bXh 

185

_XaW [XfYaW[ aYZ ZXfXbaWWe cXdUZ c][X_aW [\]YZ[ ZUc\Yh [b^abU a TXfT ]aWXbe \g [\]^_U [U`a^abX\Yi _\c`a^UZ b\ \bTU^ kY\jY bU_TYX]U[l ͕Π͞ΠÍÏÎ ÍÐÎ ÍÑÎ Í÷Î

ÍøÎ

Í Î Í# Î

͕ Î

}baYg\^Z  YXuU^[Xbei •## Ñl Tbb`â  jjjh [babl[baYg\^ZlUZ] 
Z\Y\T\  B U`\^b[  l ͕•Î l & UYhSaW aYZ – l A XV]WUu[kei  UYaWbe  Va^^XU^ c]WbX`WXU^ cUbT\Z[ g\^ _\YuUd `^\f^accXYf `^\Vh WUc[i   tí q¢o¡ t ¢ p zr Ÿ r ozr t ¢i u\Wl øi Y\l ži ``l ÏÐø Ï÷÷i •## øl ͕žÎ  l  \Wc[b^\c aYZ – l &6 \^kcaYi STU SᖠD &  D  D ‰ & i  çäo¢{wç  t çw¡r¢ y o¢ç p zr Ÿ r  ozr t ¢i u\Wl •i ``l ø   ÷i •### l Tbb`â  jjj lXcalcZTl[U  b\c  l ͕ÏÎ  l & \WW aYZ – l A XV]WUu[kei }`a^[U ]YZU^ZUbU^h cXYUZ ‰ß ⠀[bXcabXYf bTU cXdXYf cab^Xd aYZ bTU [\]^_U[ [U`a^abUWei SU_Tl B U`l   ßh
ßhž

h øi  YXuU^[Xbab  \WXbU_YX_a ZU ßabaW]Yeai ž

l Tbb`â  jjj la_l]`_lU[  T\cU[  `a]  [\]YZ[lTbcWl ͕ÐÎ l l & UWW aYZ S l l }U6 Y\j[kXi Y XYg\^cabX\Yh cadXcXÓabX\Y a``^\a_T b\ VWXYZ [U`a^abX\Y aYZ VWXYZ ZU_\Yu\W]bX\Yi  w í qo¡  tŸ p í zozr t ¢i u\Wl øi Y\l ÷i ``l ••ž #  ••Ñ # i •## Ñl ͕ÑÎ lhn l ßa^Z\[\i  XfTh\^ZU^ _\Yb^a[b[ g\^ XYZU`UYh ZUYb _\c`\YUYb aYaWe[X[i  w í qo¡  tŸ p í zozr t ¢i u\Wl ••i Y\l •i ``l •Ñø •# ži •### l ͕÷Î lhn l ßa^Z\[\i
€ g\^ ^UaWhuaW]UZ Zabai •### l Tbb`â  [XflUY[blg^â  _a^Z\[\  f]XZU[U`[\]lTbcWl ͕øÎ l  eu a^XYUY i na[b aYZ ^\V][b dUZh`\XYb aWh f\^XbTc[ g\^ XYZU`UYZUYb _\c`\YUYb aYaWe[X[i    qo¢   o{zr t ¢   t ¢  w í qo¡  wz  t q    i u\Wl • i Y\l Ïi ``l ÷ž÷  ÷ÏÐi •### l ͕ Î l  eu a^XYUYi STU na[bh‰ß – S D & `a_kh afUi •## l Tbb` â  jjj l_X[lT]bl 
aa`\  l ͕# Î }l –akUXfi ‰ß  €€  b\\WV\dl ß\c`]babX\YaW  U]^\VX\W\fe D aV\^ab\^ei bTU }aWk ‰Y[bXb]bUi • ### l Tbb`â  jjj l_YWl[aWklUZ] 
bUj\Y  X_a _YWlTbcWl ͞ Î S l D UUi – l D UjX_kXi – l  X^\WacXi aYZ S l }Uh 6 Y\j[kXi & WXYZ [\]^_U [U`a^abX\Y \g c\^U [\]^_U[ bTaY cXdb]^U[ ][XYf \uU^_\c`WUbU ^U`^U[UYbah bX\Y[i     ry x  qt{x  wzzxi •## l b\ a``Ua^l

ƒ QôòôQô… RôO }l }l ßTUYi
l D l
\Y\T\i aYZ – l l }a]YZU^[i

b\cX_ ZU_\c`\[XbX\Y Ve Va[X[ `]^[]Xbi •## ÷l Tbb`â  jjjh [babl[baYg\^ZlUZ] 
Z\Y\T\  B U`\^b[  l }l –aWWabi   oäw¡wz tí q të  ry ¢o¡  qt{w    r¢ y l _aZUcX_  ^U[[i •## l – l D UjX_kX aYZ S l }U6 Y\j[kXi D Ua^YXYf \uU^_\ch `WUbU ^U`^U[UYbabX\Y[i  w í qo¡  tŸ p í zozr t ¢i •## l b\ a``Ua^l – l D UjX_kX aYZ & l áW[Ta][UYi `^\VaVXWX[bX_ g^acUj\^k g\^ bTU aZa`babX\Y aYZ _\c`a^X[\Y \g XcafU _\ZU[i tí q¢o¡ të zåw p zr{o¡  t{rwzè të  Ÿ wqr{oi • ### l XY `^U[[l & l áW[Ta][UY aYZ
l nXUWZi }`a^[U _\ZXYf jXbT aY \uU^_\c`WUbU Va[X[ [Ubâ [b^abUfe Uc`W\eUZ Ve u• i r  r t ¢ w   woq{åi u\Wl Ïøi ``l Ïϕ• ÏϞÑi •## øl l & UW\]_T^aYX aYZ lhnl ßa^Z\[\i –adXc]c WXkUWXT\\Z [\]^_U [U`a^abX\Y Ve bTU Ud`U_babX\Yh cadXcXÓabX\Y bU_TYX]Uâ
UbU^cXYX[bX_ aYZ [b\_Ta[bX_ Xc`WUcUYbabX\Yi XY  q t{wwçr¢ y  të   ¢zwq¢ozr t ¢o¡  è Ÿ p t  r íŸ t ¢  t ¢s  r¢woq åw t qè o¢ç  pp ¡r{ozr t ¢   i vD a[ C Ufa[i  C | i ``l Ð #  ÑÏi
U_l •## Ñl ‰Y `^U[[l & l l  Ua^Wc]bbU^ aYZ D l ßl  a^^ai _\YbUdbh [UY[XbXuU fUYU^aWXÓabX\Y \g ‰ß i XY  ¢zwq¢os zr t ¢o¡  t ¢ë wqw¢{w t ¢  w í qo¡  ¢ë t q Ÿ ozr t ¢  q t{w    s r¢ y i v \Yf  \Yf | i ``l •Ñ• •Ñøi }`^XYfU^h CU^Wafi }U`bl žÐ  žø •## ÷l B l ß\XgcaY aYZ – l m X_kU^Ta][U^i €Yb^\`ehVa[UZ aWf\^XbTc[ g\^ VU[bhVa[X[ [UWU_bX\Yi    qo¢   s o{zr t ¢   t ¢  ¢ë t q Ÿ ozr t ¢ åwt qèi u\Wl Ï  i ``l ø•Ï  ø• i •## žl }l }l ßTUYi
l D l
\Y\T\i – l l }a]Yh ZU^[i ‰l \TY[b\YUi aYZ l }_a^fWUi V\]b ab\cXÓU^i bU_Tl ^U`li
U`a^bcUYb \g }babX[h bX_[i }baYg\^Z  YXuU^[Xbei •## Ñl Tbb`â  jjjh [babl[baYg\^ZlUZ] 
Z\Y\T\  B U`\^b[  l l & ]_kTUXbi }l ßTUYi
l
\Y\T\i ‰l \TYh [b\YUi aYZ l }_a^fWUi V\]b jauUh WaVi bU_Tl ^U`li
U`a^bcUYb \g }babX[bX_[i 186