A Comparative Study on Feature Selection in Text ... - Courses

     !  "#$%& '()+*,.-/ 0
  122 $34 $ CA L&BE[)D@V\FCY@FHTGI]H5/FKWXT_JM6879^L6;FOT:=N"GXGXFHP@Y/5QSRU`4?@T:=V&Y@< WXACaOBTWXVUTb\Y@WcReBZd T f WXRURUb\g@Q@dCV\WX]HN"DiWXh Y@fk]Cju4BZl$b$mHv BnSNwl$oqQiprv oOTsHx@tHQ n h)` A j ‘ 4’O“@”@•=–k“ —b\TD@GXTWXBb&RUP˜WXFO[KYP˜TZN"V&WcTZb&RUD@[2FCBx@FOb N"WXP˜Yš[KV™b\[)R™R\[)WXR\aHWXbUT&RUbUWXB$R\[KQ@G›x@d/GXT$F)[KJiVUY@J;T$WXY@[)]œR\Q@VUF)T J R\b\TWcaOCTŸR_B$x@[)WXN/R\TT]HY@FObUVUWXWXFOž$[KY˜RU[)WXGXFHWXReYidŸv V\— Tx@D@Q@T_BJ;R\FƒWXFHBZQ@Yib_v¡WXb_ FHWXaHY9TŸ[)]ON/]HTV\RUTD b pp FCg˜x@[KbUbT¢xwTFOVUY›T2xSTFƒaHBZ[)Q@GXQ˜N"[KRUTTYCxR¤h@J8VUWXY@T¥CBQ@GXQ@TZx@Y@WXBY@d ]/¦8RU‹TV\ =N£§hKbUWcYŒTGXJ8TFHBZV\RUN>WXFH[ Y p R\WcFOp YŸRUT]Cb\R>[)WXY¨¦;L¦©®4†Uª_†U§Z§h hM[)NwY@x¯Q@RURUQ˜T[KV\G N0WXYCbUJ8R\FOVUVUTN>Y@]O[KRURUDšWXFHY‘¦ — ¦8AS^«§v†U§°9h[T J8¬=PkFOT­ Q@VUY@WXN/x±T†UYCª²RUb$v2[KY@`.xŸbUWXLY@®4] †.†UªµN"FORUD@bURV\TTEbU³IDSTFHBGXRUx@WXWXaOY@T"]WXY´¢&WXFORUD9Q@V_["T¶ pp Y@P@T·QS[)b$VUhCTZVUbUTZR=N"Y@F)TaHWX]H[)DCGSgkF)FHJ»VQSBP>G¸[)R\bUF b\WºˆO¹˜‡HT¼V=FHVUY_TZN"R\D@F)T aHŠ [)GSTQ@F)J»RUTZQSVUY@b WXB¥ƒFOQSV T p R\B$T[KVURUN/WXFHbY [K[KBBRUBQ˜Q@[KVEGX[)GcBd9dŸdC¦©WXN"TGXx@T$[KTx‘bUQ@V\[)TY¯x WcgCN/d>P@[·VUF)aOaOTV™T[Kx9]HTBG¸P@[)b\V\bUTWºB¹ W pp b\†eY@WcFOxSY˜T§Tvx ‹¢ ‘T.J8RUFHDSQ@VUYSTb\x"D@bUFHR\GXVUx@FOWXY@Y@]w] BPkFHTV\VrVUJ8TFHG¸V\[KN"RUWXTFHx9Y@b&b\WcgkN/TReWX¢G½[KTVUTGXdHY v R\b\D@Q@T]H]O‹TbU R\b›hk†UR\ªD˜[)[)R›YS‹x¾ ‘LR\®.D@†4VUTZaHbU[)D@GXFOQ@GcTZxSb4WcYSF)]˜J&h=[wRUDSRUTZTwVUN´bUWXN"v P@— GXDSTb\WcbR N/B$[KTY¨RUD@gkFCT±xwVU¢&TWXGXRUW¸[)Dwg@R\GXD@d‘TQ@GXb\F)T¢x¨Tb\WXR Y@Bb\RUFOT$bU[KR&x¨WXYwFKBJ›FH†UN/ª¿P@Q@FOREV«[)RULWXFO®.Yi† h ¢&R\FƒD@FÀTZY>TCR\P˜D@TT_YSBbUWXFOaHN"THv P@QS— R™[)A±R\WXBZFHFHYwN"F)PkJ=[)RUVUD@TZTZbbUT_JÁ[·N/aHFOT$V™[)[Kb\g@Q@GXVUd>Tb¢&[)WXR\V\D T R\V\D@Tx@T Q@FHBR\R\D@WXFHTVY2N"g@Q@TR\R=D@WXFCbix@Y@bIFO¢&RiBWXRUFODN"Q@PkPTRURUWXF RUWXmOaOtHT~¼ [KRiaHD@FCWXB$]O[)D@gSTQ@V=G¸[)aHVUF d p B$D˜[K[Kg@xÂQ@G¸VU[)TZV\G½[KdÂRUWXVUaHTZTZx@Gcd‘Q@BR\PkWcFCFOFHY¨V"GXPkTaOTTVrJ8GXb$FHvµV\N>†e[)Y¨YSBBT´FOYCxSRUQ@V™[KT´bUR·R\h_FŸ^WXRUb† g@b\WcW¸R\[KWXb aƒWXRUReF)dw¢&R\[)FwV\x@P@bVUFOJÁ[·g˜aH[)FOg@VUWXWXGXY@WXRe]d›V™TZ[KbUVURUT&WXNRUTZ[)VURUN"WXFOb·Ywhƒ[KTY@VUV\x2FHVUWcR\b·b v bUTZY p à ÄHÅ “Œ”SÆ&Ç4È4–k“@É\Æ Å —[)b\TbUCWX]HRYSB$WcYS[)R\]²T]HP@FOV\VUTWXž$x@[)TER\¹kWXY@FHYÂTx0WXbB$[KRUD@RUTT±]OFHP@V\V\WcFHTZg@bšGXTRUN¡FµFKJ8VUJTTµ[)Q@R\RUFHTNCRš[)RUx@WXB$FC[KBGXQ Gcd p N"[·aHTZ[)YƒWXG¸R\[)b$gSvÀGcT°ÂFOD@Y@WXGXGXWcT›YSTHN/hkFHTE³ÊVUT"TZB[KRUY@WXaHx9TwN"V\TFORUV\VUWXTwTaHR\[)TCG RUWXQ˜b[Kx@GWºË"WXYCB[email protected]¢&[)RUWcR\WXFOD@Y FHQSWXRb ]HRUTZFCYƒFCR·xŸvWXY@‹.xSFCTCBQ@WcYSN/]¾T[KYCY@RUb±x‘B$bU[)Q@R\N/T]HN>FOVU[)WXV\ž$WX[Kž$RU[)WXR\FHWcYÌFOY´WXb´FKJ FOx@Y@FCTŸBQSb\FHN"GXQ@TR\YCWcR2FOYBFHR\Y F p RUbUDSWº¹˜WcbwB·[)PSRUWXVUFOFHYšgSGcTZN"N´TvR\D@FCj x@b ]HV\[)F)Y@¢&xšWXY@N] [)YCBEQ@D@NwWXY@gkT TVwGXT$F)[KJVUY@bUWXR™Y@[K]ÂRUWXbUR\R\TWXBEB$D@[)[email protected]¥CG¸Q@[)Tb bp

Iy ?@:{… z/TV\|~WXRe}.dƒhO@†e€Y@ƒBH‚Hv „ZC: AŒQ@Y@ŽEYCPkdCTaHx@‡O[)Tˆ)GXV\TH‰wbUh@T$ŠL u.FHjaHb\TZb4VUˆ)WX‰C‹.RedƒtHV$‡Ov vBˆ FOhON ` A j D˜dHT·[·[)aOVUT,b·hkgkWcTYSTBY£GXQ@x@[)WXPSY@P@]wGXWcNwTZxQ@GXRURUWXFšaH[KR\VUTWcC[KRURŸT&B$V\[KT]HRUTV\]OTbUFHb\V\WcWcFOž·Y´[)RUN/WXFOYÍFCx@WXTYÌGXb$Î VU‡ TZh BnHTsqYCÏ R h Y@g@T$WXGX[KWXbUVURUTWXb\B´RÂ[KY@P@TP@WXV\]OFƒDƒ[)gkBEFHD@V¯TZb$BÎ nHG¸[)t b\h bUWºl·¹˜o·B$Ï [Kh&RUWXx@FHTZYiBÎ WX‰ bUWXh FHYšnHoZÏ R\h/VUTÐÑTb·[·Î dOl$o·Tb‘Ï h.P@Y@VUTFOQ@g˜VE[[)p G Y@x@TQ@ReBZ¢RUWXFHaHV\T¶Cb$GXT$Î n@[)V\l'Y@Ï hWXY@bU]"dCNw[)GXgk]OFHFHGXVUWXWXB_R\D@VUQSN"GcT/b·Î o GXT$h [)l$V\nZY@Ï WXv Y@]˜Î l h l·Ò h oqÏ [KY@x9WXY p jVUWXž$[KNRUWX[FHŽEYšFOVwPSB™VUDkFH[)gSV™GcTZ[KN"BRUbTZVUWXWXbUb R\WcRUBOD@h4T9FOV>DSWcxS]ODšWÓË"x@BZQ@WXN"GXReTdƒYShbUF)WXFHJ_Y˜R\[KTGXCWcReR>d¯B·F)[)JwRUTZRU]HD@F T p J8RUT$DS[KTŸRUQ@Q@V\Y@T´WX¥Cb\Q@P˜T9[)BZR\THTv VUN/— bŸD@T´¦¸¢YkFH[)V\x@RUWXb aOT FHVÀJ8T·P@[)RUD@QSV™VU[KT±bUTbUbEP˜§±[KRUBD˜T9[KBR FHFCYSBbUWXBbUQ@R\V±b WXF)Y J x@b™[KFCY@Bx@Q@b_N/FKTJÑYCRUR\b·ThVUN/¢&b.DSWcJ8BEFHD‘V_B$TZ[KaHY,TYŸgk[/T N"R\TFCY@x@b"TZV™FO[)VwR\T DCp Q@bUWXY@žx@Tx9V\Tx@R\Tb"CFKR_J BR\FHD@GXGXFHTQ B pp RU]HWXFOFOVUYiWXRUv DS—N"D@b$WXvb @WcTb¢œP@V\Y@FHTD@Q@WXVEg@[)WXGkR\WcY@aOTTReGX¢d"FHD@VUWX¶C]Ob·DhOJ8J8FHFHV VTZNŒ[K[)N"YCd"P@GXGXTHT$[KhKVUB$Y@[)WXY/Y@]D˜[)[)Y G pp x@N"GXT2FCx@bUTZQ@GcBEb·D9hi[)["b_G¸[K[KY@VU]HFHTR\D@YƒTQSV_NwT@g˜[KTN"V.F)P@J&GXTHWXhIY@¢&P@[email protected]=Y@g˜FCTwx@BZTFHb$N"v2PSÐ&Q@[·R™dH[KTRUbWXFHgkY˜T[KGXGXWXGcTEd J WXY@YCFORUR V™[KR\BVUR™Q@[KT·g@§ GXT[KN"Q@Y@FOGXY@T]2bUbJ8T$[)[KYRUQ@WXY@V\Tx@bTPkWcbTY@WXN"xSTPkY@FHBb\T"Txi[KbUv.bUQS†eRN"[email protected]\D@WcFOWX]HY´D@¦©GXdF)J8R\x@TT Y p bUB$WX[KVERU[)Tg@]OGXFHTwVUWXRUž$F[KRUV\WXTFHx@YQ@B[)T/BBZRUQ@D@V™T/[KBY˜dƒ[)vMR\†eWXR&aHT2WXbÑbU[KP˜Gc[Kb\BF›T"xS¢&TbUWXWXRUV™DS[KFHg@Q@GXTRRUb™F"[KB[)VUWºBE¹˜D@BZWXTWcYSaO] T bUBQSFOB™Y@DbUR\[.VUQ@]HBFƒR\[KWXFHG˜Y [)QSFKRUJiFHJ8NT$[K[)RUR\Q@WcB·V\T[)b4GXGXdƒWXb&hEWeV\v TTH¥CvXh)Q@Y@WXVUF_TxiNv [)YCQ˜[KGHx@TE¹kY@WXRUWXFHYwFOV jN"QSF)RUaHFH[KNGFK[)J_R\WcB2Y@FHJ;YT$[)p WXR\YCQ@J8VUFOT VUN>b\T[KGXTRUWXBaHR\TwWcFOR\YÂTVUN"N/TZb>RUD@[KFCBx@BFHb2V\x@WXY@WXY@BGX]9Q@x@RUTF¯RUBDSFHT>V\P@V\Q@T bp bUBREFO[)NwR\Wcg@b\RUWXY@WXBT_b·hÊGXF)[K¢Y@TZx V4R\GXD@TaHT_TZBG=FOJ8Y@T$bU[KR\RUVUQ@Q@V\BTR\b"WXFH¦¸Y±Wev THF)vXJ hIY@R\TTVU¢{N/J8b™T·§.[)WXRUYƒQSR\VUF"TbD@¢&WX]OD@D@WXTBEV D p GXQ@Tb\aHTTZxŸG›[)FOY9VURUDSWXYCFHJ8]HFOFOVUY˜N[)[)G2RUWXx@FOWXY"N"]ƒTZ[KY@WXbUY´WXFHN/YSb$T$v0[)b\Q@ÔIVUTZTw¢&R\WcF«b9[KÕ ]HŠ ]OVUWXY@Tb\]ObUQ@WXaHTTRUGXR\d THÎ l$V\ToZp Ï x@[)YSQ@xŸBZT4[RUDSx@T&TBx@WXFCb\BWcFOQ@Y N"p RUTZVUYƒTZRMT>aH[)FCPSB$P@[)VUgSFCQ@[)G¸BE[)D9VUdRUF WcYwgS[WcYkY˜[)[KVUWXd±aHTBÐÑG¸[)[·b\dObUWºT¹˜b B$N"[KRUFCWXFHx@YTZG v °ÂbURE[)WXR\TWcY@b\TZRUWXV»BTZRUR~F4[Kb\GeTvcÎGXnSTBl R=h l$J;T$ˆq[)Ï R\Q@Q@bUVUTTxwb~NwJ8FHQSVRUWcQ˜YS[KP@GHQ@WXR=YCRUJ8FOF.VUY@N>TQ@[KRUVEWX[)FHG@Y4Y@[KTZY@Re¢xwFO[ VU¶C¬»b$­ v ÖP˜[K[KGIY@B]´FHN/Î n)‰·P˜Ï FO[KY@Y@TYCx¾RAŒ[)B™YkDC[)Q@GXR\dCžbUTwWXbTR\R_F_[)¹kGeY@vwxÎ l$FHˆ VUh R\D@nSFHl ]Oh FHl$Y˜ˆZ[KÏ G˜QSxSbUWcTN/x±TP@Y@VUb\WXWcY@FOBZY@W bp WXÎ YÂnH‡ZÏ RUDSQST9bUTaHx9TBx@R\FCFHBVQSN"bUPkT[)YCBRT9BFKGXQ@J›bUx@R\TFCVUBWXQ@Y@N/]ÀTRUYCTBERUb$D@v Y@WX¥CÖ Q@[)TY@b]‘RUF Õ¿Tb\°ÂRUWXN>WXGXg@[KQ@RUTV P@RUDSV\FHT g˜aH[K[Kg@VUWXW¸Gc[)WXgSb\RUGcWXTZBŸb WX×\Y"RUTGXV\WXNØ b\VMRUVUVUTZTY@]O]HVUTR\b\D@bU٘WXFHh&Y´[)YS[Kx,Y@x"QSYSbUTT$x‘[)V\TWXRwbUR&RUF±Y@TZVUWc]OTxSDCQ@g˜BFOT V @ Y $ T ) [ BRUWXG¸aO[)T›b\bUWºGX¹˜T$[KB$VU[KY@RUWXWXFHY@Y]´v[KGX]H^FHFHV\WXQ@RUGXD@WXY@N£WXTV/R\F>TFOR g@[)R™Ge[Kv²WXY Î J8l·T·ÒZ[)Ï RUQSQSVUbUTTb2xWXY´[KYÂx@WXWXbXY@ŽEQ@x@Y@Q@BB pp

RUÎ lHWXaOl\T_Ï Y@Q@FHb\TV\x¨N>[K[±GkN/J8FHV\WcYSNWcN2J8FOQ@V4N£Y@TZx@¢&TZbUb BV\b\WcRUPSFORUVUWXdFHYÂB$[)GXR\TTYS]H]HFORUVUD¯WXž$[KP@[email protected]ÔiGcT[)YSR\]F bUTZGcTZBR4R\TVUN/bJ8FHV TR\Y@T¢&bB$[KRUT]OFHVUWXž$[KRUWXFHYv °ÂRUV\WXD@TxiWXGXhT±RUN>D@FO[)VUYCFHd‘QS]HJ;D9T$[)TR\aHQ@[KVUGcT¯Qk[)bURUTWXGXFOTY@BR\b WXFH[KYšVUT"RUVETZ[)B™V\DSTY@GXd WX¥ƒQSB$[)TV\b9VUWXD˜Tx¯[·[email protected]J8TFOY V G¸RU[)FV\]HRUD@T&T RUTZJÁ[)ƒBRMRMB$RU[)D˜R\[KT]HRFONVUWX[)ž$YC[)R\dWXFHGcT·Yw[)VUP@YSV\WcFHYSg@]›GXT[)N/GX]Hb$FOv VU— WXRUD@DSWXN"b biWXb xSxSF_Q@Y@T&FHWXRMYwbUP˜B$[)[KV\GcT R RUbUFwWº¹˜[TZV D@B$WX[)]OY2D p FHxSYSWcN/GcdTg˜Y@T&b\WcR\FOTY˜bU[)R\TGOx"J8T·FO[)YRUQS[.VUTbUNbUP˜[)[KGXBGHTHb\vQ@g@— b\D˜T[KRRFKWXJ˜b·RUhHDSWºJ~T&[!Y˜[)BR\G¸Wc[)aOb T p bUPkPkFH[)RUBTZTHYƒhR\W¸FH[)YSGITwF)J=B$J8[)T·Y@[)YSRUFHQSRVUTQ@bUbUTTwGXTWXBZRRURUWXFHFY TaHN/[KTGXQ˜RUDS[)FƒR\T›xSb$R\v D@j T_J;VUQ@TGXBG»TZVEYƒ[)RY@R\]OD@TwTFF)pJ J8VUGXTFOTZN"VURUN>WXB$b2[)[K¢&GkY@BBWXRUFOT_D N"FKP˜JÑÒ [KxSR\VUTF WXbUBFOWXl$bUYiWX‡OFHhZt Y9J8FHJ8V=R\T$VU[)TTR\@TQ@[)VUN/[)TZGXb"]HP@FOGXWXTHVUYÂh·WXRU¢ÑRUDSDS[KN"T b b&g˜Y˜WX[K[)Y´bUR\TWXb\xwaHFHTGXFOaCY›bUWXP˜Y@R\[K]"D@BT&P@THV\ÎP˜l$FHTZtqg V Ï pp v jF)J=Y9RUT[)CYkR.[)B$GXdC[)bUR\WXTb]HFOFHVUY±WXž$RU[)D@R\WXWXbFHYibUB$v [KGXTwWcbx@WXb\R™[)YCR.J8V\FHN£RUDSTwVUT$[KGcWXR\WcTZb —WXbUFOD@Y"T.J8F)FCJIBJ;Q@T$b&[)R\WXQ@Y/VUTRUD@bUWXTZbGcTZP˜B[)RUPkWXFHTYV4WXN/bTRURUD@D@TFCTx@aHb[KWXGXY"Q˜[)R\R\D@WcFOTY"VUT[)x@Y@QSx/BRUBWXFHFHN/YP˜FK[)J»V [ p D@P@WXV\]HFHD±g@GXx@TN/WXN"b$TZv/Y@°9bUWXFHTwYkQ@[)GIbUTwJ;T$Re[)¢R\Q@F VUTwBG¸[)b\P˜b\bU[)WºB¹˜TwTV\WXb›Y±¢&RUTDSCWcBER_D9B·[)D˜RU[·TZaO]HT"FHV\[)WXGXž$VU[)T·R\[)Wcx@FOYd bUb™B·[K[)Y@GXx@Tb.x_F)R\FJ B$[&[)RER\[)TV\]H]HFOTVURWXTbUb·P˜v4[K°9BTT¢&bUWXTZR\D_T¶´RUD@[)FOYSQ@bUb™¢[KTY@VUx@bbRUFHFwViR\R\D@TTY@b=J8FHF)GXJ@GXF)R\¢&D@FHWXY@Q ] p ¥CQ@Tb\RUWXFHY@b&¢&WXR\D>TZN"P@WXVUWXB$[KG˜TZaƒWXx@TZY@BT
 °ÂDk[)R»[KVUT R\D@TbURUV\TY@]ORUD@b[KY@x_¢T$[)¶CY@TZbUbUTZb F)J@TCWXbUR\WcYS] J8V\T·Wcž·[)[)RURUQSWXVUFOT_Yb\ TGXTBRUWXFOY´N/TRUD@FCx@b4[KP@P@GXWXTxRUF/RUTCR4B·[)RUTZ]HF p  — F_¢&D˜[KRTZƒR\TY@x/B$[)YJ8T$[)R\Q@VUTb\TGXTBRUWXFOY"WXN"P@V\F)aHTRUD@T Q@Q@[KBN/b\BTEJ8Q@TQ@YCVEG[)R&BWXaHYCd‘FCJ8FHB$F)V\[KJ N>g@[±Q@[KG¸RUBZ[)WXG½FHV\[Kd"Y2bUb\B$WXWÓY"[K¹kY TB$V[Kg˜ RUT2T]O®4VUFHTZF)VUx@¢µ Qd@BP@NwTV\x±TQ@x@BE¢&WXDŸBWXR\RUWcF)D@FOJFOYQ@RU D@R4TGXFOx@bUWXFCY@B ] p RURUACF/WXTFOBZYŸbURUP˜WXFH¦¸[KTHY Bv T2]kn vcGcÎ WXo'x@N/Ï T§4Wcb\RE[)B[)VUYSR\WXx´gkWcF)TYS[)b2P@b$hORUPSD@¢VUTwFƒT2[KR\¢&BETD@VUWXTN¿ GcGIbYSg˜bUFHTZ[)R4Gcb\TZTWXBY@x±RUBZWXFHGcFHQSY9Y x@N/T_P@V\P@TWXY@RUD@DSBVEFƒWX[)P˜xSb\[)T›b$Gvwb\BT‹.FHGXTN Q@B Tpp PkBG¸FH[)Y@b\bUTWºYC¹˜RTV\[)b4Y˜[)[KY@GcdCxwb\WcR\b·D@Î m T4h xSn)Fƒ‰ BZh Q@n@N"l hTYCl$R ˆ·Ï BZvFHACVUPSTQ@BR\b&WcFOBEYD@FHo b\Tx@YwTb\J8FOBVUVWXgkTZN"TbP@RUWXD@VUW T p B$RUDS[KT´G˜aHV\[KTGcbUWXQ@x˜GX[KR\RUb$WXvFHYACvÊTAŒBZTRUBWXRUFHWXY FOY m ‰ x@P@WXV\bUTBbUQSTZbUYƒbUR\TZb4b R\RUD@D@T4T±TN>CPk[ZTŽEVUFHWXN/V2¹˜TYCYSRUx@bWXY@[K]HY@b·x v ACTBZRUWXFHY Ò bUQSN"N>[KVUWXžTbMRUD@T_BZFHY@BGXQ@b\WXFHY@b·v   •“@È4”   –k“@É\Æ  Å  “ .Æ&Ç4’ Q@ [wb\WXxSaHTb_TT&bUN"[wWXVUTZRUTZx´TZRUVUD@N x@FCTZx@p ]H]Hb VUFC[)TZFCT›V\x@T4FKY@WXJ~Y@TZbUR\Bb4TGXQ@VUBZN xSVUTWXRUxwTTGXV\WXWXWXN"Y›FHY R\WXY˜D@R\[)WXb D@R\WXVUbUF)TR\Y2b\Q@D@x@J8FHVUdCGXFOhHx@N²T$TZ[Kx´BER\D"D@R\F>T_F)J;JI[)Q@BE¢&GXD@GiD@WXTaHWXBEaOF D T p B$x@[KFCg@BQ@Q@G¸N/[)V\Td,YCR=FKJ8J›V\T[±¥CQ@x@TFCY@BBQ@d N"¦;TZ‹Yƒ »R/§ZBh)FHWXYCV\P@J8FOQ@VUb·N>v [KRU— WXFHD@YTZbU]CT±[)WXBY>VUWX¦©RU†UTZª_VUW¸§[ŸhONw[KVUQ Tp
RUbUQkR\VU[)TGiYSWX]HYCRUJ;D¯FHVU¦ N— [)A@R\§ZWcv FOY>¦;^†U§hk[ ¬»­ b\R™[KRUWXbUR\WcB/¦8L®4†U§Zh˜[KY@x RUTZVUN =79ƒ : "!U‚)$ #%=ƒ&: '(*)=‚)Œ+„ ),-e€6¸:=(< ./1032  |  ¢&‹.D@FCWXBBEQ@D N"[¯TZYƒR\RTVUJ8V\NT¥CQ@FCTBY@BQ@Bd‘V\b$v£WXb2°9RUD@T±TYCBFOQ@N"NwP@gkQ@TR\V›Tx{FKJ RUx@D@FCT±BQSx@N"FCBTQ@YCN/RUb2TYCWXY R

J8P@V\Q@Tb2¥CQ@[)TY@Y@x9Bd V\TJ8N"FHV/F)aOT$T[)xBED{J8V\FHQ@N Y@WX¥CR\Q@D@T TwJ;RUT$TZ[)VUN¡ WXTwYÂb\P˜RUDS[)T´BT/R\V™RU[)D@WXFOY@bUWXTwY@]9R\TBZVUN/FHV bp \ R @ Q U V ¢&RUTZD@VUN"FObUWXT_Y@TZx@xwFCBRUQSD@N"V\TTbUD@YCRFOGXJ8xiV\Tv ¥C— Q@D@TT&Y@Bg˜d[KbU¢&WXB4[)b&[)b\GXbUTQ@b\b4N/RUP@DkRU[)WXFHYY2bUFOWXb N"RUTDk[)P@R VUTZVEx@[)VUT T p RURUTZWXFOVUYiN"h·b_FHV=[KVUY@TwFHR=TWXWXRU5Y DS4˜TQSV›TYSYCFHRUW¸Y [)p GCWXYCWXY_J8FH]HV\GXN>FOg˜[K[)RUGOWXa)P˜T.TVrJ8J8FHFHVV\N>B$[K[KRUY@T]OBFHTHVUvd±†eY›P@TZV\TWcR\x@D@WXTB Vp B$F)[KJbURUT_D@V\TTN"J8T$F)[KaHRUQ@[KV\G˜T>FKJ»b\P˜V™[K[)VUBZT_THvŸR\TVU†eN/N/b&P@VUVUF)TaOxSTQ@N"BTTZbYƒRRUDSWXT_YŸx@B·WX[)N"RUTZT]HYSFHbUV\WXFHWXž$Y˜[)[KR\GXWcWcFOReY d Y@[)BZFOBWcb\Q@TV™[KRUBTd‘V\N"WXbb$v [KGcb\F´PkFHb\bUWXg@GXTWºJ V™[KVUTRUTZVUN"bwDk[)P@PkTY‘RUF±g˜T G¸¢&‹[)WX ±V\RUd DÂRUVUD@[±TV\xSTBQ@bUFODSBN"FHRUWXGXFOP@x@YiQ@WXY@v2RE]w[)†eR\RWXWcbFOT·Y˜R\[)D@[)bUTGWXGXBd bUWXFON"b\N"B$PS[)P@GcGXGXTZTTbUb_CRWXR\ReRUFd¾TBEaHD@[KTP@Y@V\P@WXd ¥CV\Q@F)G¸[)T.ƒVUWXJ8]ONFOT›V[)BZRUaOFHTZFƒGcVUB·d±Pk[)FHg@GXVEWXQY [@pp h T$WXb[KV&Q@bUWcYQ˜[KR\GXD@GcdÀTYƒBFHQSY@Nwb\WXg˜x@TTVVUTZF)x,J R\[)V™YŸ[)WXY@[KWXx´Y@]2DSFƒx@B"FCB[KQ@P@N/P@V\TFƒYC[)RUBEb·D±vi®.RUF F)¢WXN/TaOP@TVUV$F)hSaOWXRT TEx@Ë"WXBR\BWcWXaOTYSTBJ8dƒT$h[KY@RUQ@FOV\R!Tb$[v P@VUj WXY@GXb\BZF˜WcPSh4GcTZ‹x´ šBV\WXWXb/RUTReV\dƒWcPSFOY±WcB·[)J8GXFHGXVdŸb\Y@TGXFOTRwBRUQ@WXY@bUT]xœP@J8V\FOT Vp [)[)]Ob\bU]HQ@V\N/TbUP@b\WcRUaOWXTwFOY>RUTWXV\Y N WXYCV\J;TFHN"VUNF)aH[)[KR\WcGiFOgkYwTVUB$T[)R\QSVUbUWXTT"aHFK[KJÑGÁv [/— ¢&DkWX[)x@R4TGXWXd b·h˜VUGXTZF)B¢ TWXp aH‹T x RURUTZDSVUTN"VUTEb J;FH[KVUTVUT9bUD@[)FObUQ@b\Q@GXx"N"Y@TZFOxÂRRUgkF‘T_gkVUTZT´N"V\F)TaHG¸[)TZRUx"WXaO[)T]HGXd,]OVUTWXYCb\bUJ;WXFHaHVUTZNGcdC[)vR\Wc°9aOT>T4[K¢&Y@WXxGXG VU]HT FOp VUTWX@ž$[K[KN"RUWXFHWXY@Y/T4R™R\[)D@b\¶CWXb b$v [KbUbUQSN"P@R\WcFOYw¢&WXRUDVUTb\P˜TZBR_RUFwR\TCR&B$[)R\T p : !˜‚)79$? ·67˜:9N/[KP@B™GXF)DSdHWcYSTx¨T4GX[KT$[)b V\Y@[ŸWXY@R\]˜TVUÎ Nl·s p h FHTlY@‰KgSBZÏ R™v¨T›[)WXY@FO†eV4R/TZxw[)N"g@J8FOT$b\VT[KY@bUB$Q@B[KT2V\RUTTF)b"]OJ FHR\[2V\D@d"T RUTP@YCV\V\N£Q@Tx@NwWcWXY BgkRUTWX[2V"FOY>x@FKFCJ_gCBdwg@QSWXN"¶CRUb"Y@TF)YCFK¢&R$J_v WXY@WcÔ¤YŒ]_TJ8FHR;R\D@V\:=N>T@[)P@?*R\VUA WXTZFHb Y p x@WXYCTJ8YSFOFHVURUN>Tw[KR\RUD@WXFHTwY2bU]ƒTZR_[KWXF)Y"JF)B·J=[)RURUTTZV\]HN FHV\WXE&Tb_WXb&WXY´x@TER\¹˜D@YSTwTx R™[KRUVUFw]OTgkR_T bU
Pk[)BTHv — >CBD@TD FG¦ E™, §H IKJ A>BDLM N¦ < > §CGXFH] LM 7¦ < > § O L M C¦ E™§ J A>BD L M N¦ QP E™§CGXFH] L M N¦ QP E™§ § J A>BD LM N¦ < > PTE™R §CGXFH] LM N¦ < > PTE™R § O LM S¦ E™R $ —WXY¨D@WXgSbWcYkx@[)TE¹˜VUd‘Y@WXR\BWcG¸FO[KY"bUbUWºWX¹˜b B·N/[)RUFHWXVUFOT&Y¨]OTN/Y@FƒTVExS[)TGGXb$RUÎ D˜l$[Ko Y"h l$RUDSÒZÏ T4v FHYS°9T4T TN/Q@P@b\T9GXF)dHRUD@Tx T N"GXTN"FOVUbTwQ@]ObUTQ˜Y@[KTGXVEGc[)d±GD˜J8FO[·aOVUN0 gkTU B$[Kp [)Q@VUbUd9T B·R\[)TRUCTZR›]HFHB·[)V\dŸRUTZ]Hb\P˜FHV\[)WXBž$T9[)R\¦©Wc¢&FOYŸD@TP@VUV\VT FHgU p > T [ V N>bUQS[·VUT"dgkR\D@T4T"Q@Pw]OFCR\FƒF_xSRUY@TZTY@bUbb2FKF)JiJ RU[/D@FOR\Q@Tb™VU[KN0Y@x@]ObEGX§FHh@g˜[)[KYSGcGXxwd¢¢&T&WXRUY@D9TZTV\x"TbUR\PkF_TBN"RwT$R\[ F p [)GXGIB$[KRUT]OFHV\WcTZb&FHY [·aHTVE[)]OTHv P@RUªQSQ@WXVUaHR\TTTZxwYbUP˜RU[.[KDSBRUT&T&VE[)WcRUYŒWXD@Y@J8FOFHWXY@bUV\TN>]RUB[)TFOR\V\WXVUN"FHP@Y4Q@b]Cb·¢&h)[)D@J;WXFHYiFHV b\h)T[)T$YS[KWXYCBEx›J8DwFOV\VUQ@TNN"Y@WX[)F)¥CRUaOQ@WXTFOT&xY&RUJ8T]ƒV\V\[)FHNÌWXNY_¢¢&R\D@T[)TMbBFHJ8GXT$TN [bUbpp RUWXY@DkB[)GXY2Q@x@bUFHTZb N/RUT D@P@TV\TTb\x@RUWXTN>R\T[KVUN/RUWXFHWcYSY_TFKxwJ˜RURUD@DSV\T&TBbUDSFHY@FHGXxSxiWcR\v WXFH— Y˜D@[KT&GƒBPSFHVUN/FHgkP@[)Q@g@REWX[)GXWXRURUWXWXFOTY b F)RUWXJ FO[_Y@b B·[)WXY"RUTZR\]HD@FHT4V\d"x@T']O¹˜WcaOY@TWXRUY WXFH[_YR\v T— VUN±[email protected]@P@[)Y@VUFOx/g˜RU[)D@gSTWcGXTWXReYCd_R\VUTFHb\PCRUWXd/N>B[KFHRUN/WXFHP@Y2Q@D˜R™[K[ bp [2WwRU¦ZWXY[N/X T&§=BFH¢&N/D@TZP@VUGXT\TCXµWcRed2Wcb=F)R\&J D@WwT&YCN¦ XÀQ@Nw§&g˜[)Y@TZV»x FK[2J˜RUbUVEPk[)[)WXY@BT_WXY@BZ]FHN"x@FCPSBGcQ@TZN/ƒWXTRed2YCRUF)b·J h RU[)WXYSFO]x Y@b&YÌD˜[)WXbb4R\[D@RUT2WXN/aHFCT4B$B[)FOgSN"Q@G¸P@[)GXVUTdCWXb\ReWcd›žZTHFKv ^J Ww— D@Z¦ Y_T›U/TZYƒ§R\v VUFOPƒdÀBFHN/P@Q@R™[ p

|
 *=?$- 6;:!˜‚)79?$·67˜: .
6 2 bUVU^RETZ[)G½Q@[KR\R\RUWcQ˜b\TRUxw[)WXG&B$[)[KWXPSYCGƒP@J;G¸[KFHGXWcY@VUB·N]H[)Q˜RU[)WX[KFOR\]HWcY@FOT=bY´N"Î s WXFCbwh x@n [ TZh Gcn@GXBZWXl'VUY@WXÏ RU]vIT†;F)V\J˜J@WXFHFH¢Y‘YSFHTVUBx2BFHFON/[)Y@bUN"bUb\WXFCx@FOBTZY@W¸VU[)GXb d>RUWXR\FOQSD@Y@bUT&Tb»Rex‘[K¢Y@WXF xY p ¢&¢&[·D@d´TV\TBFO{YCRUWcWXbY@]HRUTZDSY@T BYCd9Q@R™Nw[Kgkg@GXTTwVF)F)JJ=RU[WXN"R\TTVU^b N E [KEY@[)x Y@N>[)[KR\VUWX]OFHWcY9Yk[)WXbwG@P@RUV\D˜FH[Kg˜R"[Kg@R\D@WXGXT WcR\WXbUTBZb&FHVUF)T J RUTZVUN"b·h@[)b&B$[KYg˜T_b\TTY WXY/RUD@WXb&T¥CQ@WXaH[)GXTYCRMJ8FHV\N(
 G¦ E /WXFHY@Y9[)]ÂR\[)WXgCFHP dY p VUFHTZR\RUD@VUTWXTV±aH[KaHG4[)V\[)W½[KP@RUPSWXVUFHFƒYœ[KBEF)DŸJ"Y˜RUDS[KN"T TŠ x TZQ@Š RUFƒTBZV\b´B™DSBZWcF¯FHGXGX¦ TsHBmORU¼ WXFO§YšÎ oZÏ¢&v D@T4VUY‘T¯RU[)D@Y T p RU¶ VE\[)WXY@WXD˜Y@[)].b&bUT[R&g@[)VUY@T$x2[K¶ RUp DSTT&aOTRUYTb\P˜R FObUWXTYƒR&R[)F)V\JT‡OPknH[)¼ VUR\WX¢&RUWXD@FHWXY@BETZD"x›WXx@bWºRU³ID@TTVUTZb™Yƒ[KR\N"GXdƒT h [)bR\D@TwVUTb\Q@GXR_F)JY@TQ@VE[)GY@TRe¢FHVU¶Cb·Î nSl\Ï hi[)Y@x9ÔiԁA@ ‘D˜[Kb_[
(













g@V\T$[)¶ p TaHTYÀP˜FOWcYCRF)J ‡@l$¼ v ÐP@ Q@2 dŸRwÐ×UFKFHG¸[KJ RUVUD/[ ]HTZbUBZdCٛG½bU[K¢R\bUTTb\N"WÓ¹kN"bTT$V"bU[KB·B$Y"[)[KGXT4RUYŸDkR\[)D˜F›R[·G¸aOg˜[)T"V\FO]HRUR\T&DD@BFHRUG¸Q@D@[KbETbU[)bUWcWºY@YS¹˜xSP@B·bw[)Q@RUR&F)WXFOJ [)YwY@xSxP@WcN/VURUFODSTg@Y@T GXb\TFOWcN"FOQ@Y@R b·pb v FHF)JV&J8DST$Wc[K]ORUD@Q@TV\V·T Î nOb\m ThGXTnKB‰·R\ÏWcFOv=Yi°9hCJ;TVUFH¢&NÌ[)YCY@R&F2RUFwVUTZTZx@ŒQ@[KBN"R\WcFOWXY@Y9T¦¸[)TGXCG˜BR\TD@PST_R4x@VUTZTZ]HN"VUF)TZTa b p WXx@Y@Q@]BZRUbUWXREFH[)YiY@hx˜[)[KY@VUx¯x±FHbURUg@FOb\P9TVUaO¢TwFOVURUx@D@bET2§TERU³IFÀTBTR\Cb›RUVUFOTZY´N"R\TD@GXd9T[)[K]HBB]OQ@VUTVEb\[)bUBWXd±aHTwF)J&V\T [ p BY˜G¸[K[)RUb\WXbUFHWºYi¹˜ThCV.¢F)TaHY@TTV.TRUx±D@T[_Tb\YCB$[)RUWXG¸VU[)T_gSGcRET[)V\b\]HdƒTb\R.RUTbUN±P˜[Kv BTHv& @[email protected]@[)N"W p WX— Y@2 D@]´WXÐb[/FH[KR\]HGcDGXGXF)FO¢&¶ g˜3b [)G [VEb\[)[)RUY@Y@V™¶C[KxWXWX]HY@ÔiDC] ԁR p A@FKJ8JÑ ŸFHV\B·¢Ñ[K[)VURU[KT_TZVU]Hx2[ FH]HV\U WXGXTFHp b›gk[KVU[)]Od/G@WXaHTBTaHG¸YŸ[)[KbUGXQ˜b\[Wº[)¹˜xSR\TWcFƒV4FOBZY›PSQ@VUFKN"F)JÊaCTPkYCWXxTR·V p v x@RUDSFCT>BQ@]ON/FCFƒTYCxSR&Y@TB$bU[)bwR\TFK]HJ4FOVUB$WX[)ž$R\[KTRU]HWXFOFHVUY d¯PkV™T[)VrYSJ8FH¶ƒV\WXN>Y@]À[)YS]HBWXaHTHTh@Y‘Wev TH[ vXhCxSN"FƒT·BZ[)Q@bUN"QSVUTWXYCY@R·] h V™¢&[KD@RUD@TY TZV›[KR\P@D˜P@[)GXdCY9WcYSPk]›TV2g@WXB$Y˜[)[KR\VUTdw]HFOBVUG¸d9[KbUbUPkWºT¹˜VeTZJ8VUFOb4VUNR\Fw[)Y@RUD@BTT"P@[KVUb_FOWXg@b›GXTb\N´R™[Kv Y@x˜[)V\x 2 ÐFHR\DÂBG¸[)b\bUWº¹˜TV\b>[KVUT RUP@DkQ@[)R&RwaHY@[KVUF9W¸[)WXgSY@Gcx@TZTZb P˜¦©TRUYSTV\x@N"TY@b™B§MT±FHV&WXb"FOQ@[)b\RUbUPSQ@Q@N/RTaHxŸ[KVUgkW¸[)TgSReGc¢TZwTb TWX¦©Y{Y,B$[)TR\R\D@WXTRU]HTD@FOTbUVUV/TWXTYSWXb™bUY §ZT p v Q@bUÔiTZN/ԁP˜A@[)T YCVE[)R hZRUJ8R\TZFHFGcVdCv‘TB$@[)R\[)ACTN"WX]HN"FOPSWXVUGcG¸WXTO[)ThVUb$FHGXh dCPShI[KRUY@¶WXN"x±\WXD@žTTbY@RUV\RUBT$D@T/[)TR\x@b>N>FCT[À[Kb2P@x@P@Y@FCWXFHY@BRQ@]MRUN"J8V\VUT$FOTZ[)YƒNR2R"[&¢[Kbx@FHVUFC[KxSB Y bp bUWXb4WXY@WX]OY±GXT4x@PkWXbUFHRUWXWXYCY@R&BZRUWcWXYFHY [2R\aHF TBZRUFHV&b\P˜[)BZTHv .— N"D@TZTRUBD@[email protected]ƒg˜R&[)b\b\TTx´Y@b\FOWcR\Y´WXaƒTZWXRe d p P@BG¸GX[)WXBb\WXbURWº¹˜WcTYSV\x@b$TÎ l$PkoqTÏ Y@x@[KY@TYSx9BT bUFO[)N"bUb\TwQ@FON"RUD@PSTRUWXVFHY@VUTb]Ob\VUQ@Tb\BEbUD,WXFH[)Y‘bN"Y˜[)TZWXRUaHD@T2FCx@Ð&b·[·Î ‡ZdHÏ T§Zb v jWXYCJ8BFOFOVUN>YCRU[KTRUCWXR FHp YbUTZP@Y@V\bUF)WXRUaCWXaOWcxST>TxŸBZG½[KgCbUdÀb\WÓ¹kJ8T$T[)V›R\Q@NVUTZ[)b›¶OTR\bD˜[)g˜Y‘TR\RU[TVwBFHQSYCbUR\TTCF)R J&p J8RUVUD@TTT BRUQSG¸[)VUb\T_bUWºb\¹˜TTGXTVMBx@RUWXF˜FOh)YiR\vDCQ@b TY˜[Kg@GXWXY@] [.gkTRUR\TVFOg@bUTZVUaH[)R\WXFHY2FHYJ8T$[ p FH,[)Y2YS2ix — [&D@Y@GXWXT FHY@Y T$Re¢p[)GXVIWXF4Y@PkBT$[)G¸[K[KV™V&[KbUbUN"BWºG¸¹˜[)TTZbUR\VUb\VUbiWºWX¹˜B xSTN/WÓV$³Ih¤FƒTRUxSV=D˜TbU[KG RER [)¶ R\N\Wcb\RU[)WX¶OB$WcT[Kb=bGcGX[&J8dCTY@vI¢FOÔiY Ôi[Kp bUASP˜bU "[)QSVEN"WX[)bIN"P@g˜R\TZ[KWcRUFObUVUTY@WXx Bb BWX[)Y"G¸gk[)FHR\b\D@QSbUWºT_R4¹˜TVURUTZDSV\b=bUT›Q@bUGXWXD@RUY@FOb·P@Q@v QSGXx_R4x˜VUT[KxSR™Q@[@Bv.T&®4RUTZDSY@TBPkTwFH[wb\bUTWXg@aHWX[KGXGcWcQkRed.[)RUF)WXJ@FOBY>G¸[)QSb\bUbUWXWºY@¹˜]"TV=gkg@FHW¸R\[KD b   !

" #$%'&()

+*

|  "? $?(-7-;$67k:~„ °9BFOGcT4GXTQSBZbURUT_WXFHReY¢[)F›Y@BZxFHVURUPkDSFHT VE.[®J8FHACV&`R\D@^ WXb7 b\‹šRUQ@BZxSFHd GXGX
MTBRUD@RUWXT FOYiŠ v TQ@RUTZVUb pUnHnSl$sOo —BFOD@VUTPkFHŠ V™[.TQ@WXY_R\TR\VUTb2CY@R»TB·¢&[)RUb2TZ]HbUR\FHFHV\V\WXd9ž$[)R\BWcFHFOGXY_GXTBVUTZR\WcbUFOT$Y´[KVUBEWXb_D´BZÎ FHl$N"o h N/l h FHnSY@l GXd/h l$Q@Ò bUh ToZx Ï D GXRUTFOv bUP@b— WXB_R\DSD˜G¸T[)[)VUY gkTTDk[)GXb$[)VUvT GºJ °9nSF)l JTh ‰ƒR\Q@D@mObUT_t TZx´x@x@FCFCFOBBY@Q@Q@GXdwN/N/RUTT[email protected]_T2D˜WXY±x@[·aHFCRUT_BD@Q@T2DCN"Q@J8NQSTZYƒGcG=[)R\b&Y BFORU[)GXD˜Gcb\TZ[KbUBR4WX]HRUWXD˜YSFH[KTY xx bUP˜[)TZRw[KR›VUGXRUT$FKWX[KR\J WcbUFOˆ RwY"h ÒSFOWXl$Y@bt TbUWX[)RUN"Y@FHx9PSWXG¸Wc[)BO[/V=hRURUxSTF2b\WcaCR›RUDkWXx@b\[)TTR&R›x¯TFKN/V™J [KP@Y@o GXx@h F)ÒHFHdHÒHN/Tn xwGXx@d´WXY´FCWXBYCÎQ@l\RUN/ÏF9hOTg@[±YCQ@RURUR&b$VEv [)x@WXWº— Y@³IWXD@TY@VUWX] bb J8V\FHN Î l$oZÏ ¢&DSF9Q@bUTRUDST"J;Q@GXG&BFHGXGXTBR\WcFOYŸWXY@BGXQ@xSWcYS]´Q@YSG½[ p ,

-*

.+/1032465'798:2;tHToHBZR\RUˆ F›WXFHQSGXY˜F)Y@[K¢WX¥ƒG˜TQSb\V&RUTTB$R\N/[KTbUVUN"T$N/§ZWXv biY@]kWXY›hbUR\R\D@FHTP/B¢FHGXFOGXTVUBxwR\WcVUFOTZY"N"¦8F)[qaHJ8[)RUTZGeh)V»[)PkYSTx"VrJ8BFHFOV\N"YƒaOWXTY@V ] p FH]OV™®.[KP@TVUD@b\WXDB$[)GS[)x@Y@FCx BQ@BN"FHGXGXTZT$Yƒ[)RM]OBQ@FHTGXb9GXTB[)R\R±WcFORUY D@HT h [email protected]®VUaOTTAC]OGX`FHFHYÌPk^ TxÌ®47 ‹T·gC[)dšGXWcRUbDÌ°Â[_ACg@WXBGcWXGXg@WXW¸TGX[)Y@WXN¡ F)VUT'J2J8TRUVUD@TZT9Y@B^ Tb7 J;‹VUFHÔIN † nH7 sOt x˜[KN/BR™[)TZTb,gkx@[)WXB$`.bU[KTOY@GÊÎ ˆqWXŽEaHÏ FOh&TQ@V\BbUVUFHWXYkReYS[)dCbUGXv¡WXb2bUR\J8Wc†eVUYSR´FO]ŸNØWXb9F)JR\[{D@o)T‰ƒbUQ@‡dHgST$h mH[KbUÒHTVUÒbR FHRUl$DSYSˆOTŸ‡HGcd s RUWXnHRUR\F oOGcT¯o l$h ‰HP@ˆH‰CGXˆSQ@m l b´v FK[KJ"j g@RUbUGXD@G&R\V™TF)[)N J_BZRŸRUD˜DS[)[·T b´aHVUTŸ[œTEJ;[KTx@g@VUFCTbUYSBR\V™Q@B[)TN/BZb±RUTb$YCD˜v R$[·v aH°9T— RUT¯WXDSR\VUGcTŸTZTEb$J8x@TZh&FCV´g@BQSR\Q F Rp N"¦8^«TZYƒTx@R\b WXB$¢[)GiTVUAŒTQ@N>gHŽE[KTYCBR&Q˜[)®.GXGXT$d[)xSWcYSWcYSx@]HTb$ChCTx"FOVÑQS^«bUWXY@T$AC]2® bUQ@§gHWXY/ŽETZRUBD@R&T B$[)R\[)T]HR\WXFOFHVUY˜WXT[Kb G ]HWXÔIY FOWXg@VURUWXVEDST[)b&T V\d,[email protected]'®FK¹˜JY@ACT`^x^ TWXxSY>7 WcBZ‹Ì^WcYST·x@THACvFC®›BQShk— N"[)D@Y@TTZx YCVUTŸR&l‰B[)FOhV\oOGcT¾GXn@Tl BZ[KRUg˜B$WXFO[KFHRUQ@YiTR v ]OFH°9l·V\‡ WcT hTZtHb&QStOP@bUt TVUx±TB$b\[)TRUR\D@YCT TRp N"Q@l$ˆOY@TZˆHWXYƒ¥Ct R\Q@b x@T2FC[KRUBb TQSV\R\N"N"D@TwTb.YCRUWcRUTZY±b_bUR_RU[KDSb b\T›T[wR_R\V™R\WX[)V™Y [KWXY@WcRUYSWXDSY@WcWcYS]/b]"b\bURUTbUQ@TZR·x@R!v dC[K— v Y@D@x — TDSR\[·TD@aOVUT TT"V™l·[K[KˆH]HVUˆST T2l sHGXTx@n Y@FCh ]HtHBR\sHQ D Ò p F)]HJ"FOVU[‘WXTb_x@FC[)V\BT"QSN"[)b\TbUYCWX]HRY@WXTZb x´l$R\ÒOF>s T·[)¢BEFHD9V\x@x@b$FCv B[email protected]/YTYC[·R$aHv2T†eVEY´[)]Ob\T FHN/l$n T_bUB$T[)YSR\bUT T p RUgkDSTT B$[).QSbU® T{AŒ` RUD@^ T‘7 x˜‹ [KR™B[šFOVU[)P@V\QST‘b N"WXb.FHN"V\TFHV\×\TY@x@FHWºWXË"bUdCBÙkQ@v GXR4R\— D˜D˜[)[KY R9Š WXb$Th2Q@R\RUTD@VUTb ¢.FH® VUAC x ` )B$^ [KRU7 T]O‹2FHv˜VUdœLFOBY@FHbUV\TZVU¥ƒTQSb\P˜TYCFORUY@GXx@dƒThCY@R\BZD@TTbŸB$[)[)R\V\TT´]HFON/VUWXFHž$VU[KTœRUWXFH×eJ8Y/Q@žZWcbždCN"ٟFOWXVUY T x@WºË"BQ@GXRRUFwGXT$[KVUY/J8FHV&[2BG¸[)b\bUWº¹˜TV·v *



(  R

 

 

,







UÉ ”SÉU–I•  •  ÉUÇ4•“@ÉUÆ Å | }4C‚*!k‚)79?@:&)w79C?˜„+=‚)Œ„ °9P@V\FƒT"BZ[)TPSbUb\P@WcYSGXd ]9J8F)T·J[)RU¶ QS3VUTbUT[KGXY@TBZx,RUWXԁFHY¯ÔiA@RU F±v x@— FCD@BTQ@N"TE³ÊTZYƒTZBR\RUb›WXaHWXY9TZY@R\TD@bUbT"FKP@JV\T [ p J8N>T$[K[KRUY@Q@BV\TwT4FKb\J4TGXT¶ B3RUWXFOYw[KN"Y@xŸTR\ÔiD@ԁFCx›A@ {WXb FHTY¯aH[KRUGXQ˜D@[)T/R\TP@x›VUTZQSP@bUVUWXFCY@B]_Tb\R\bUD@TT4x{Pkx@TVeFCJ;BFHQ V pp N"[/TZP˜YƒTZR\V b$p x@v=FCACBWXQ@Y@N"BTTZgkYƒFHRRUg˜D[K¶ bUWX\b$h¤¢[)T2YSQ@x«bUTwԁÔiR\D@A@T2 ±bUb\R™B[KFHY@V\x˜T_[KB$VU[Kx±RUTx@]OTEFH¹˜VUY@WXTWXb&R\WcFOFOYY 



 Z32)8:2 ZF@= X 22)0 FY=+2)8+dCWc¢YS]9FHV\x@J8T$bw[KRUWXY,Q@V\TŸ[±b\b\R™T[)GXTYSBx˜RUWX[)FOV\Yx,RUb\F‘RUFOP,x@FC¢BQSFHN"V\xŸTYCGXWXRUbUb·R·h_Î l·¢‡ZÏ T v —TaHD@[KTGcY‘Qk[)T$RUTZ[KxBED,¢&FKWXJ RUDÌR\D@[{T/¹˜YƒaHQST/NwJ8g˜T$T[KV±RUQ@F)V\J"TxSbUTWÓ³IGXTTBV\R\TWXYCFHRŸY‘RUN"TZVUTN R\D@p FCVUTZx@N"b2F)¢ÑaH[K[)b G RU[)DSGXG=VUTRUb\DSD@T›FHGXR\x@TVUb·N/v b j WXY´R>[9[x@DSFCWc]OBD‘Q@N/RUD@TYCV\TR!bUD@[KFOVUT2GXxig˜h4TZWXGcR/F)¢šWcb/R\P˜D@TwFObURUb\DSWcgSVUGcTTÀb\D@RUFHD˜GX[KxiR v —[)xSFx@[·TaOxÂFHWX[ xwN/VUTZTN"R™[«F)aCVUWXQ@Y@GX]_T[)RUGXF±GIRURUD@D@TTR\P@TVUV\N/FCBb TbUJ8V\b·FHv N²— [D˜[Kx@R›FCBWXQ@b·hÑN/[KTP@YCP@R$GXhCd9¢[T RUTDSN/VUP@Tb\ReD@dwFHx@GXx‘FCBRUQ@FŸN/[±TYCx@R FC@BFOQSRUD@N"TZTVUYC¢&R2WXbUFHTHY@hIGX[Kd9P@P@WºJ GXd"WXR2R\D@VUTT_b\Q@BGXGXFHRUb"b\TbUWXYÂRR\[ÀD@VUY@TFHb\DY pp FHGXx/¢&D@WXB™DV\TbUQ@GXR\b4WXY>[2Y@FOY p TN"P@RedwxSFƒBZQ@N"TYCR·v °9P@V\FƒT_BZ[)TGXbUbUb\FwWcYSQS]ŸbUTJ;x FHGXR\GXF)D@¢T›TA@x ^ J8jT$[KŠ=RUQ@— V\T b\dCbUbUTRUGXTZTN0BZRUWXÎFHl·Yi‡Zh.Ï J8¢&FOD@V&WXQ@BED‘Y@Wº¹˜WcYSTBxGXQ@P@x@V\TT bp ¢¢FHTWXVU]HxDCRUb\WXRUY@TN/]wFON"P@WXRUY@WX]wFHYS[)b›Y@x¦×\GX¢RUBTÙkWX]HhDC×ERU[)WXY@R\B]k٘v h°9×UGXTY@BZRUÙ´V\WcTZhx ×Ug@bUTYSaOY@TÙ"V™[KTG R\BHRUTZvVUNWXY A@¦ — ^  =j§.Š=N"=— T·< [)bIbUY@QSFHVURET›[)R\[KWcY@FOx Y˜§kRU¢&DST›D@WX†eBEYCD_aHBTZFOVURUNwTZx¾g@WX‹.Y@TiFCR\BD@Q@TN/R\TTYCVUN{R  SJ;VUVUTT¥C¥CQ@Q@TTYSYSBBdd ¦¸¦¸†U¢&‹WXR\ =D>§&QSN/bUWXT$Y@[)]±b\Q@×UVUGXT2RUBWXÙCY´§&[w[)V\aHT [KV\VUTWXTPkReFHdVUR\F)TJ x±¢&WcY/[·dCRUb$D@v T— Y@D@TT›CR&gkbUTTb\BZR_RUWXVUFHTYib\Q@v GXRUb | }‚)6879?S=‚ '´‚)@+„  -7)„  Š WXTZ]HQ@Q@RUV\TT V\b&l ¦ ˆx@hWXÒSb\P@l$tG¸[·RUdƒVEb.[)WXRUY@D@WXT2Y@]&Pkx@TVeFCJ8BFOQSVUNN"[)TYCY@RUBb·Th)B[)Q@Y@VUx aOoTb.h ÒHJ8ÒHFHn V.R\¶ T\bUR=x@FCFOB Y p Q@LN/®4T†MYCRURUD@b™V\§T[·bUJ8D@R\FOTGXV=x@RUWXTY@V\]˜NhCV\b\TTbUGXPkTTBBRUWXR\FOWcaOY›TQ@GXdƒb\vMWXY@°9]T&†UªwRUTh$b\‹RUT xÀh —RUD@AIThHRe^¢†iF_[KFHY@P x p RUVUWXTZFObUY@Q@b$GXRUh b[)>V\
±T [)V\TYSP@?x V\T bUTYCÀR\TWXx9Y¨WXY"^RU†wDS[)TY@¹˜x{]HQSLVU®4THv †h[KY@xÂR\D@T gkTRUR\TV  Š WXTZ]HQ@Q@RUV\TT V\b$n vx@ACWXWXb\Y@P@BG¸T_[·dƒR\D@b&TR\D@RUV™T2[KP˜WXY@TWXVrY@J8FH]›V\PkN>[)[[email protected]F)T_J BÔiQSÔiVUaHASTZ 9b WXFKb&JV™Ôi[KRUÔiD@AST ŸV&V\FOT Y p bUFOQ@VUBZT BZFHY@b\Q@N"WXY@]kh)¢T.Q@bUTZx>[)Y"[KP@P@V\F)ƒWXN[)RUWXFOY_F)J»ÔÔiA@  798;:

!

@*



Figure 1. Average precision of kNN vs. unique word count

Figure 3. Correlation between DF and IG values of words in Reuters

0.95

1 DF-IG plots

0.9 0.85 0.1

0.75 IG

11-pt average precision

0.8

0.7

0.01

0.65 IG DF TS CHI.max MI.max

0.6 0.55

0.001

0.5 0.45 16000

0.0001 14000

12000

10000 8000 6000 Number of features (unique words)

4000

2000

0

1

10

100 DF

1000

10000

Figure 4. Correlation between DF and CHI values of words in Reuters

Figure 2. Average precision of LLSF vs. unique word count

1

0.95

DF-CHI plots 0.9 0.1

0.85

0.01

0.75 CHI

11-pt average precision

0.8

0.7

0.001

0.65 IG DF TS CHI.max MI.max

0.6 0.55

0.0001

0.5 0.45 16000

1e-05 14000

12000

10000 8000 6000 Number of features (unique words)

4000

2000

0

WXP@Y@Q@bURER\[)T$R\[)WcxœFOY‘F)J›VUTR\b\D@FHT Q@V\BBFOTN"b±P@WcY‘GXTR\R\T D@T´bUFOTZGcƒQSPkRUWXTFHV\Y‘WcN/RUTF¯YCRUb™b·[·v aOT — bUD˜FO[)N"R/TWXb$Bh&FHN¢T p BÔiFOԁN"A@P@ Q@h»R\[KTGXx9RUD@FHFOYSQ@Gc]Hd D9nHR\tOD@t TG¸[)g˜V\T]Hb\TRwb\R›VUTb\b\WcQ@YSGX]HRUb Q@G¸[)¦©¢&VD@aHWX[)B™GXD¯Q@TWXb2b›WXb\Y9WcN/bUWXFHG½GX[KaCV4WXY@R\F] RUbUDSWXY@T ]OQ@P˜G¸TZ[)VeV=J8FOaHVU[)N>GXQ@[KTZY@b$BÎ n)T‰·Ï F)v J_¶ T\aOTVU§"R\D@[KTP@GXTP˜bUT·b·[)h@VUR\TZD@x¨WXb ¢&bUWXWXN"RUD‘PSGcQ@Wº¹˜b\WXB·Y@[)] RUWXFOl$Y_tOtHF)t J bUÔiTZԁGcTZA@B ÀRUWXFHbUD@YÀFO¢&Q@GXD@x›WXB™Y@D/FOR=WXb&WcYCRUD@aHT[KGcJ;WXx˜FƒBZ[KQ@RUT b&R\F)D@J=T&RUTD@@T_[)TZN/ƒPkWXY˜T[)V\R\WcN/WcFOYTYCF)RUJkb·vJ8T$[)R\Q@VUT jF)J&Y/¶ FH\g@b\TVU[KaHY@[KxŸRUWXFHÔiYwԁN/A@ œTVUFH]OYTb=Š J8V\TZFHQ@NÌRUTRUV\DSb$v T4B$— [KD˜RUT[K]OR_FHWXVUb$WXhž$[K†URUªwWXFHhIY/‹VU ¨Tb\Q@[KY@GXRUx b b FOB·Y,[)Y{R\D@TT GXWcN/PkTWXVeY˜J;[)FHR\V Tp N>Q@LP‘®4[KY@†2RUBF RUT DSˆOVUFKtHTJ_¼ b\D@RUD@FHFOGXT±Vwx@WXBN"Y@G¸]¯[)FOb\VUbUD˜T"Wº¹˜[·FKaHTJ_TV\b$RUvbUD@WXN/Tj WcQ@G¸GX[KG4Y@V WXF)¥CJ2T'Q@³ÊT RUTD@BZR\TRUTN¡ [)¦8[KYÀb4WcN/N/T$P@[)VUb\F)Q@aOVUTTNwxTgCYCd>RFH[·V4aOTYSV™Fw[K]HGcT_FObUPSb.VUWcTYBWXB$b\Wc[KFORUY˜T]O§vFHV\`.WcVUž·bUN/[)WXY@RUb›WX]"FO¢&Y´†UWXª R\[)D,BR\BZD@TZQ@VUWcV™R\T[KD@b\BD Td Vp FHl$GXÒ x@h tHWXY@oH]kˆ hRUJ8TFHV\VwN"TZb=ŒRU[KF N"oHP@n@GXl THh=¦;[ R\D@ˆHT‡O¼ aHFCVUB$T[Kx@g@QSQ@BG¸RU[)WXFHV\dŸYk§WXh@b›[)V\YSTx›x@Q@R\D@BZTTxÂj… J;VUª FHN f F)TaOJT¶ Y‘\g˜TR\WcRUb2TV/WXN"B$[)P@R\V\TF)]HaHFOTVUxÀWXž$J8[KV\RUFHWXNFHY¯‡OVUs Tvb\ˆHQ@¼ GXRUb"RUF TZƒ‡HBZˆ TP@v nOR"¼ R\v¾D˜[)LRw®.[)†_RwD˜TZ[K bp RUBV\FOTN"N"P˜TZ[KGcd±V™[)[)gS]HGcT=]OVUPkTTb\VebUJ;WXFHaHVUTwNR\[)D@Y@VUBZTZTbUD@¢&FOWXGcRUxSDb_Q@†UPªp RUWXF b_mOgktHT¼ R\RUTR\V·TVUv N — VUA±TN/D˜[KF)b_aH[)[ G WXY¶ 3 hk[)Y@x [)gkFHQSR ÒHtH¼ RUTZVUN£VUTZN"F)aH[)GkWXY ÔiÔiAS vS°ÂWXRUD

1

10

100 DF

1000

10000

N"NwQ@FOVUBET D/[)JÁ[)]Ob\]HRUV\TTV.bUb\RUWcD˜aO[KT Y RU†UDSªwVUThkb\D@LFH®4GXx@†&b·[)h&Y@WXx´RUb"‹Pk Tv˜VrJ8^«FHV\†&N>x@[)FCYSTBb4TY@x@FOTR4BD˜GXWX[·Y@aOTTb BFON"P˜[KV™[)gSGcT&PkTVrJ8FHV\N>[)YSBT4R\F[KYƒd2F)[email protected]\D@TV&N"TZRUD@FCx@b·v |  [k‚)‚)5 -8$? ·67˜: „ 5 _CC: 10 6*9 ?@: € ! 6 —bUTZD@GcTZT2BRUbUWXWXFHN"YwWXG¸WX[)bV&V™[)PkR\TD@VrTJ8FHV V\b\N>Q@VU[)PSYSVUBWXbUT›WXY@FK]Jgk†UªwTB$hI[)‹QSbU ‘T4[)YSY@F x9b\Q@LBED"®4†.[)Y_WcY±FOg@RUTZbUVUTZN V p aHRUWX[)FOR\Y WXFHRUYD@TZD˜VU[)TEb.J8FOP@VUVUTwTZaƒWXb4WXFO¢&Q@DSbUGXTdRUD@g˜TZTZV TY´R\D@V\TTb\PkTwFHRUVUD@R\TV\TxiTwv Bj FHV\Y˜P@[KQ@RUbQ@bUVERE[)[)GiR\¥CWcb\Q@RUTZWXBb bp [)V\TBFHV\VUTG¸[)R\Txiv RU [)DSYSWX]HT x«Q@Š LV\TT®.Q@o R\† TPSVUGcb FORUBBb FOFOGcR\VUGXD@VUTTZT&BZbURUaHPkWXFH[)FHYiGXY@Q@v=x@TZ WXb»Y@WXFK]O]HJ»GXQ@dƒ‹V\v T   L‰ [)GXT$PSY@[KGcxwFOVUGXRU†Udwb ªœR\RUD@D@]HT&TZWXaOVUaHT›T[)Y[KGXQ@VU[.TTZR\b»WXTY@FKVUJ¤x@NÌT‹TWX xY aHaHTZ[)VUGXQ@d"TZb\b»RUFKV\FHJÊY@[&]wR\TBVUFON±VUV\v»TG¸ [)WXRU]HWXFOQSY@VUTb&b g˜m TZRe[)¢Y@Tx TZY Ò b\RUD@D@F)T_¢&‹b= RUD@hCT&†UªV\TbU[KQSY@Gcx R\b LF)®4JI[ † BRe¢V\FHTbUTb Y9p BZFH‹ GX ‘GXTB[KRUY@WXFOx Y>†UTZª Œ[KWXN"b [)WXY˜GXb\[KF"RUWXFHFHgSYibUv Tj V\aHTbUx±RUV\FHWXY Y@]wRUD@BZT FHVU4V\T®G¸[)ACR\` WcFO^ Y"7 gkT‹ p BaHFOTZVUGcGXbUTQSBZb_RUWXFH†UªYiv [)—V\T›D@WXTwx@TZP˜YƒTZR\VeWXJ8B$FO[)VUG=N>FH[KY±Y@BRUTwDSWcBbQSBVUFOaHGXTZGcb›TZBFKRUWXJÑFH¶ Y\v — D@¢&T›WcR\FOD¾g@bU‹TZV   p aHbUWX[)b\R\RUWXTFHYCY@R$b=vwFHªY WXŠaOTTY Q@R\RUTDSVUTwb&[)aHY@TV\x2d FHx@Y Wº³Ê.TZ®VUTACYC` R›^ [KP@7 P@‹¨GXWXB$[K[)VUR\T&WcFOD@Y WX]Hx@DSFOGcdN>B[)FHWXY@Y pb 






V

Figure 5. DF-IG correlation in OHSUMED’90 1

0.1

IG

DF-IG plots

0.01

0.001

0.0001 1

10

100

1000

10000

100000

DF

Figure 5. Feature selection and the performance of kNN on two collections 1

0.8

11-pt avgp

0.6

0.4

8JB SFOFOVUVUN"FHN>N N"[KY@FO— BY_[)TgSRUbUTZGcTDkVUN"[)l VUbh=T2F)R\RUD@aHDST"TZT_V&N/b™V™[K[)TN"V\RUTDSTFƒRUg@TxSV\W¸b_[)N"b·¢&b$h@WXv WeRUv DŸ— THvXD@h@[)WXbUYšbBZFHg@×\VUW¸T[)WXCY@bB]/WcTbGXWXGXYFHTYCgCJÁRUaC[·Ù±WXaHFHFOP˜Q@V&TZb\GXF)V d p J WXLY"®4R\†=D@T›gCd_‹x@ ±T'¹˜BY@VUWXWXR\RUTWXFHVUWXY FH
iYWXv=Y2†eRUR&D@WcTb&FOYSVUdCFHhƒR[.Y@TBBFOTN"b\b™N/[KVUFHWXYGXd>RUTR\V\VUNÌQ@TB$Wc[)Y/Yw†UªšD˜[·aOFOTV WXgk[wRTžZWXReb&T¢VUb\TZF R™Tp [)Y aHR\[KWXRUbUGcQSDSRUWXTT!B$x´[K‹GXWXGc YCdwJ;hCFHR\†UVUVUªQ@NT[K[)g˜Y@R\Wc[Kx FObUYwTLxÀ]ƒ®4[KFH† WcY"YaHR\[KFOD@GXV Q@T_T¬ b\b$­RUv VUbUFO— BZY@DSFH]wT!VUTOB^«v_FOVU†®4VUTZN/F)G½¢[KTRUTRUWXaOD@FHTFCYSV$x b h D˜ [KC¦ E b" E P VFK[)J_g@b\WcYŒTY@J8FHBV\T±N>F)[)J›R\WX[±FHYŸRUTZFOVUg@N¡R™[KWXWXYÂY@TxÂ[±x@gCFCd‘BQ@¶CN"Y@F)TZ¢&YƒR·WXY@v ]9— RUD@D@TT bU[)R\V\VUTwFOY@F)J8] R\T‹ Y9  WXp YC†UJ8 ¯FOVUBN>FHV\[KVURUTWXG¸aH[)TOR\hÊWXFH[KY@Y@bx±N"aƒWXT·B[)T/[email protected]RUV\D˜b™[K[9R4¦©BRUFOD@N"WXb_N"b\R™FO[KY"RUTR\N/TVUTN/YCRb F)RUVEJ=[)BV\FHd9QSVURUbUF9T[x@FC¢&TWXb&x@YSTGXFHd´RDSTCTGXRUxŸTY@gkxTGXR\WcF›T'J b\RUWXFHY9PWXYC¢J8FHFHV\V\x@N>b™§Z[KvRUWX— FHY D@WXV\bTWXRUbV\WXBTFHaHY [)p G RUWXN"Dk[)TRYCR\Bb_FHN/bUD@N"F)¢µFOY>RUD˜R\T[KVUR›N/R\b D@WX[Kb"VUTw[)bUY@b\FOQ@Y N"p WXPSYCRUJ;WXFHFHVUY±NN>[)R\[·WcaOd±THY@v FH4RwQS[)V_PSTP@CGXd´P˜TZR\V F p RUTZƒR&B·[)RUTZ]HFHV\WXž$[)R\WcFOYiv j]HFOYSVUFHd_RUWXDSYCTJ;V FHVUWXYCNRUT[)V\R\TWcFObUR\Y&WcYSJ8FO] VPkJ8FHT$[)WXYCR\R=Q@VUWXYT&b\— T[)GXTgSBGcR\T WcFOl YwWXb=x@RUFCDkT[)b R=Y@Q@FObUR=WXY@bUT].TB$NÌ[)R\R\T F p gkWev T›THvXhBV\WXQ@RwBx@W¸[)FCG~TJ8b/FHV.Q@bUTTÀCBB$T[)GXGXR\TTYC]HR_FOVUP˜d‘TZVeWXJ8YCFOJ8VUFHN>V\N>[KY@[KBRUTHWXFHv_Y9‹P@ ¯V\TWXbUbTZYƒR™R[)b\¶WXY‘p J8V\RUTD@THT h RULVE®4[)WX†=Y@¢&WXY@D@]2WXBEbUD"TR·[)hkV\g@T&Q@R™R4[KbUDk¶ [)p b4b\T[2Y@b\PkWcTR\WXVeaHJ8FOTHVUv N^[)†=Y@WXBb=TR™b\[KWcbUN/¶ pWXG½b\[KTV Y@b\RUWcFwR\WX†UaHªÌTHhC[Kg@Y@QSx R bU[)WXV\]OTY@R™Wº¹˜[)b\B$¶ [)pYCJ8R\V\GcTd9THv QSY@x@TV p PkTVeJ;FHVUN/bwg˜FORUD — A‘[)Y@x‘‹ š¢&D@WXBED —g@W¸D@[)T/bwP˜R\F)FC¢ÑFHV[KVUP˜x@Tb2VrJ8GXFHF)V\¢ÌN>J8[KV\Y@TB¥CTwQ@TF)Y@J4B^dœ†RUTWXV\b›N"[)b2GXb\F>WcbwWX¶CYCY@J;FHF)VU¢&NY{[)R\¦8WcACaOTZTHBv2RUWX†eFHRUY b B$D˜n [K§Z[KQ@hib4bUgSY@TQ@FOR_bUR4WX]O¢&gkY@TD@WºTT¹˜Y9R\B$D@[)TTYCN/V2RwP@FH[)WXV_BVUWXBZYSB$Q@FH[)V™RGX[KGXd2BRUd‘D@TWX@b_Gc[)FOR\N"bUD@b2TWXY@WXFOYŸTZVUxiTRUR\v TZWcB·ƒ.[)RwG&Q@B·V¢[)TT$RUCTZ[)]HP˜¶CFHY@TZV\VUTWXWXb\ž$N"b_[)R\T¢&WcYCFOWXR\GXY b G ¥CBFOQ˜N"[)YCP˜R\[KWcREVU[)WXbUR\FOWcaOY¾TGX[KdY@[Kx,x@[x@V\BZTVUbUFHb.b\RUb D@p BWXbG¸[)Wcb\b\bUbUWºQ@¹˜TTV/Q@b\aHWX[)Y@GX]"WXx˜[_[)R\BZWcVUFOFHYib\vb p N"ÐTTdHR\D@FOY@FCxx RUGXTDSN£Wcb9WXgSY W½[KWXRUb$b.h"bU^«TY@†´b\WXRUb\WXTaCTWcN"Redb9R\F>R\FšPSVUD˜FH[·gkaH[)TÂg@WX[œGXWXReN"dwFOTbUVUR\TŸWcNb\T[)VUR\WXWcFOFOQ@YbŸTVUP@V\V\FHFHVUg b·p v —GXFHD˜] [KR´C¦ WXE b$P h2TV\[)N ¶OTb4WXYR\D@R\T2D@bUT¯BFOJ8VUFHTwV\NwTCQ@RUG¸V\[ TN" G¦TZE Gc /dbUY R·[KhiTZRUWX¥ƒWXR.FHQSY.WcWcbaH]ƒ[K¢[KGXTWcFHY2YCV\RRU[)D´Y@R\Fx2[K
Y˜Nw[)Q@GXdCRUžQkWX[)Y@GC]"WXYCR\J8D@FHT2V\N>x@Wº[ J pp   LM ¦ 5 §CGXFO] LM ¦ 5 ›§ FwC¦ E™§ H LM ¦  § LM ¦ §
     H

IG.Reuters DF.Reuters IG.OHSUMED DF.OHSUMED

0.2

0 100

80

60 40 Percentage of features (unique words)

20

0

F)TE³IJ=TRUBD@R\T.bwReF)¢J F2‹BFO ¨VUP@[KQ@Y@b·x±h@¢†Uª T [KRUVUD@TV\TBbUFHD@YCFOaCGXx@WXY@WXY@BT]´x[)R\V\D˜T"[)R]OTRUY@D@TTVE[)FOGg@bUV™T[)V\R\aHD@TTx V RUDk[)YBFHV\P@Q@b p x@TZP˜TYSx@TYCR$v ÂÉU’C–IÈ4’C’CÉUÆ Å J8°ÂBT$FO[KN"D˜RU[KQ@P˜R4V\[KT_[)VUTV\bUb&T_TZGcR\TZRUD@D@BT.RUTWXFH¹˜VUYT$aH[KTWXbUYBFHV\YSRUWcTb&R\CTJ8VUR&FOW¸[V&B$[K]HJ8RUV\FCTFHFC]ONx>FHV\FOb\Wcž·TV&aH[)g˜RUTZWXV™[)FO[)xY>G Pk[KRET[)Y@Veb\]HJ;¶ƒGXFHTb/VU*b N
— [)Y@[)g@BZT_GXT F)l J  JÁ[·aOFHV\WcYS]_BFHN/N"FOY›R\TVUN/b&FHV&V™[KVUTRUTZVUN"b·h  RE[)bU¶ p bUTYSbUWXRUWXaHT¿¦¸QSbUWXY@] B·[)RUTZ]HFHV\d0WXYCJ8FOVUN>[KRUWXFHYk§ÂFOV RE[)bU¶ p J8VUTZTHh  Q@b\WXY@]wRUTV\N [)g@b\TY@BT2RUF/P@VUTZx@WXBR4R\D@T_B$[KRUT]OFHVUdP@V\FHg p RE[K[)g@g@WXGcGXWXTHReh@dC[Kh Y@Wexv THvXh Q@b\WXY@]ŸR\D@T´‹ p BZTGXG4F)J_R\D@T´BZFHYCRUWXY@]OTY@Bd  R\D@T´PkTVrJ8FHV\N>[)YSBT F)J_¶ \ [KY@x¨ÔiԁA@  FHY Š TQ@R\TVUb [KY@x 4®AC` ^ 7 ‹2v 





— [)g@GXT l v LVUWXR\TVUW¸[2[)Y@xPkTVeJ8FOVUN[)Y@BTFKJiJ8T$[KRUQ@V\T_bUTZGcTZBRUWXFHYN/TRUD@FCx@b&WXY/¶ 3 ^TZRUD@FCx ‹  †Uª L®4† ^«† JÁQ@[·b\aOWXY@FH]wV\WcYSB$]_[)R\BTFH]HN/FOVUN"WXTFOb Y›R\TVUN/b Ö ÖÖ ÖÖ Q@Pkb\TWXVeY@J;FH]wVUNRUTV\[)N Y@BZT[Kg@WXY/bUTZY@¶ 3BT OÔiÔiAS  TZƒBZTGXGcTZYƒR TCBTZÖ GcGXTYCR TCBTÖ GXGXTYCR PkFCÖ FHV ¦ e§  ¦GE /Á§ O >BD L M ¦ RE /8§  ¦ E R /8§ >BD —¢TD@WXT]Hb\DCTÂRUTJ;xwFHVU[·NwaHTZQSV™G½[)[K]Ob´T&b\F)D@J˜F)R\¢ D@T&R\NwD˜Q@[)R¯R\Q˜WX[)YCGOJ8WcFHYŒV\J8N>FHV\[KN>RUWX[)FHR\YšWXFHY ]C[) WX¦CYÌE J;FH[KVU¶HNÌTb&FK[2J  Q@¦ bUE R T2 /TY@[KBRUT2WXFHWXY Y Q@Y@[)YSb\FOWcxVUYSN>]9n [K§RUGXWcD@†UžZT›ª£TxwŽ'FHYSbUWXBFHYCFOVURwNVUTP@b·[)VUv GXFOWXžg˜T[)b2g@RUWXGXD@WXTRUWXTNwb2Q@¢&R\D@Q˜WX[)GXGMT«WcYŒ^«J8FH†wV\Q@N>bU[)Tb/R\WXFHRUY D@TÀb\BY@FHFHV\YTb p H





3

D&(






$ 

Æ Å –  È4’CÉUÆ Å —x@WXD@N"WXb_TZY@WXb_bUWXFH[)YkY9[)TGXWXaHRe[Kd_GXQ˜VUT[)xSR\Q@WcFOBY´RUWXFOFKYJJ;J8T$FH[)V&R\Q@R\TVUCTwR&b\B$T[)GXTR\BTRU]HWXFOFOVUYŸWXž$N"[KRUTZWXFHRUD@Y FC[)x@R4b[KWXGXY G J8RUbUQ@DSPkGXTw[)GwBVUTHaOThOFƒx@RUB·QSF.[)Bg@VURUTWXQ@FHN/G¸Y9[KF)VUaCdGXTWcaOYS¦¸T] TZGXƒbˆHBZ‡HF)T¼ JÑP@RŸ[KF)]HJkb\]HRURUV\D@FOTTPbUb\Q@WX¢aHY@TWXFO¥CY@VUQ@TZx@bUTbEb$§9RUhTJ;[)V\VUN"b9FHN£b$R\v¤D@°9QST¯bUT=WXJ8Y@T$J8][)FHR\QSQ@RUY@D@VUx TT †U¢&ªWXRUD@[KFOY@Q@x RLGXFH®4bU† WXY@N/]FHB$b\[KRRUTET³I]OFHTBV\WcR\ž·WXaH[)T_RUWXFOWXY>Y¾[K[K]HB]OBVUQ@TVEb\[)bUBWXaHd9TWXRUY±TZVUFHN Q@VVUTTN/CPkF)TaHVU[)W p G N"BFOTZN"YƒP˜R\b[KV™¢&[)WXgSR\GcD"TM¶ RUF4\R\D@T&[KY@Pkx TVeJ8ÔiFOÔiVUNAS [)v@Y@‹BT ±F)JkR\D@†Uª¨VUTb\[KD@Y@FHx›GXx@LWXY@®4]w†WX¢&bMWXJ8RUFHD2QSY@Q@xP RURUFF mOˆHt·tOpU¼ ÒHtHR\¼ TVUNR\TVUV\NÌTN"V\TF)N"aH[KF)GeaHh)[K¢&GÁD@vIWX^GXT QS— RUQ˜Aw[KWXG@b WXYCBFOJ8FHN"V\N>P˜[K[KV™RU[)WXgSFHY.GcTD˜¢&[)WXb=RUD/WXYCQ@J8T P p VURUWXF FOV4[Pkg@TW¸Ve[)J8b.FOVUJÁN[·aH[)FOY@VUBWXY@T]wBFOVE[)N"VUT2P˜[KRUVUTZTVUxN"R\b_F"[KRUY@DSx¾T›[FORUbUD@R\TVUFHV.YSN"]>Tb\R\TD@Y@FCb\x@WcR\b&WXaƒx@WXQ@Red T RUFwPSVUFHgk[)g@WXGXWXRed›Tb\RUWXN>[KRUWXFHYwTZVUVUFOVUb·v °9RUTZVUTwN x@WX[)bUBZV\T´F)aHb\TRUV\VUTFOx‘Y@]HRUD˜GXdÂ[KR›BZFHR\D@VUV\T>TG¸‹[)R\ Txihih_†Uª£V\TaH[KT·Y@[)xŸGXWXY@L],®4†[¯bUP@BFOV\TVUaCTbwWcFOQ@FKJbUGXd[ Q@WXYÂY@¶CRUY@TZƒF)¢&RY2B$[KJeRU[)TB]OR&FH[)V\gkWcž·FH[)Q@RURWXFORUYiDSv T4WX— N"D@PkWXbFHV\bUR™Q@[)YS]O]HBT&Tb\F)RUJib BR\FOD˜N"[)N/RFHRUDkY_[)R\R>TVU‹N/  b RUP@DSV\VUF)TaHb\TwD@FHTEË"GXx@WXBY@WXT]¯YSBWcb/dÂY@¦8[KFHb›R_WXŽERQSbUD˜R>[)b2[KY¨gkT[)TxœY,D@[KFCbUb\B¾Q@N"[KP@TP@x9VUFCWXY±[)BERUDÂD@T/R\FŸGXWcR\WXTN V pp [)[)R\gSQ@GcTVUT2N"F)T$J[KRUbUTQ@CV\R4TB·J8[)FHRUV.TZbU]HTFHGXV\TWXR\ž$WX[)Y@R\]"WcFOWXY¾YCJ8FO[KY@VUNx [)V\RUTWXRUaOV\T&WcTZJ8aHT$[)[KG¸RU§Q@hkV\g@TQ@b$vR†e[wRV\B$T[KGXW Y p gk¦¸¥CTwQ˜Q@[Kx@bUTV™x9[KRUWXWXY@B$§b\RUF)T$[KJ4x9R\D@F)TJ&bUTÀ†UªN"FOT$V_[KbULQ@V\®4T†b›¢&WXb2D@RUTFCY9F R\TD@CTwPkBTFHY@N/b\WcaOP@THQ@v RE[)—RUWXFOD@Y T bU[·[)WXaHPSaO[)P@T&WXGXG¸WcJ8[)B·T$gS[)[KWcRURUGXWXQ@WºFOReV\d_Y"T4F)F)b\J P˜J [)[_N/Bb\TFHWcVUN/V\TTP@x@PkGXQ@F)T&B¢g@R\TZWXQ@FHVeR&J8YQ@TEG=N>³I[)T[·BY@d_R\xWXb\aHWXBT_]HFOY@N"N/Wº¹˜P@T$B$[)QS[KY@R™YCbM[)RUR\J8GXWXd›FOFHVÑY˜T·[K[K[)Gc]HbUGXT.]Hd2V\RUWXTD@Y b T pp RUaHTZTZY@VUdwbUWXaHG¸[)TV\Gc]HT·T[)RUVUTYSCWcYSR]wB$[)N"R\TT]HR\FOD@VUFCWXx@ž$[)b$hCR\WXb\FHQ@YwBED¾P@V\[KFHb&g@GXY@TTN/Q@VEb»[)¢&GiDSYSWcTBEReD¢[)FOVUVUT&¶Cb$FOhkRUR\D F p TV\¢&Wcb\T_WXYCRUV™[KBR™[Kg@GXTHv


I: ;Œ€J8FO[KVUGcb\N>F [KGXRUWXWX¶HFHTwYRU]CF±[)WXRUYiDkhH[)[KY@Y@¶ x›— PSFHVUFN p RUWX^YCDSJ8WXT"FORUBEVUJ;D@N>VUQ@TZ[KGcWXG ReRUJ;WX[KQ@FHY@YwGx´xS]CWcDS[)b\WXWcBY>bQ@Nb\[KbUY@WX[)FHx BEY@D@NwbwWXY@Q@R\TD˜R\Q˜[)GXT$R2[)[)GkV\BWXY@G¸YC[)WXJ8Y@V\FOWº]"J8VUd´N>]OVUR\[KFHD@RUQSWXTFHP¾Ywx@[KTEWX¹˜YR YSL&RUWcDSR\^WXT_FH` Y@GXWcb2R\J8TFOF)V VpJ [)R\Q@VUTOv ” iÅ – ’ Î l'Ï G¸L[)vY@]Oj Q˜P@[)R\]OTHT&h_WXY@ x@v&T‹ PkT[KY@N"x@TTZVEYƒ[)R4Qi[Kh.Q@[)RUY@FON>x¨[KA¤RUv&Txw°9GXT$T[KWXbUVUb·Y@v WXY@]_— F)FK¢&Ji[)RUTV\Cx@Rb B$[KRUT]O FHVU WXž$[KRUWXFHYN/FƒxSTGXb$vI†eY $h l$ˆH
ˆK‰ v Î nqÏ [)b\TbUY@FCY@BW¸TZ[)RUR\D WXFH°ŸY9[KY@VUFOx"VUN"LDCb·hiQ@VUNwBED QSRU[)Q˜YS[Kx G»WXf YC[)J;FHR\VUVUWXNBE¶w[)R\® WcFO[)Y YS¶ƒ[)b·Y@vix9°9GXTFOCVUW x p B… FO[K]HY@V™B[KFHP@QSDCaHdƒTvCV·†eh˜Y L&[)Yk[)x˜[Sh l$ˆH
‡Oˆ v hKP˜[)]OTb sHÒ Œ‡Oo h Î oqÏ °ÂbUTZY@WXGXbUGXWXW½RU[KWXN²aOT›° GXT$[KvÊVULY@WXFOY@D@]wTY9N/[)TRUY@FCx x@bÖ J8FOFOV™V&[)N RUTCAŒRWcYSB$]H[KTRUV·Tv]OFHLVUWXFOž$YC[KRURUTWXFHCYR p v †eY
    ch l$ˆOˆHÒ v oHtOs·pUo@l·m v  ; Î ‰KÏ!°ŸŠ v [)®2GXR\v@žHLv VU— TTVEBZ[)dƒx@hSWXY@Ð ]wv ^9N/v@WXP@^ bÑ[K[Kb™Y@[Kx Y@xiN/h@TAIN"v ˜FOv@VUAŒdN"J8FHWXRUV&Di¶ChOY@[)F)Y@¢&xGX‹›Tx@v ]OÔMT v TY@Y@T]OBZRUWXY@WXFHTY TV\NWcYS[)] BE
D@BWXG¸Y@[)THbUvb\WºJ8dCWcYS ] BTZY@bUQ@bM±VUTh R\oOQ@m VU
Y@‰ƒb=‡ ŒFOÒHY_o RUh D@l$TMˆOBˆHFHn Y v p Î mqÏ AIÔivi[KY@‹.x˜T[KTZQ@VU¢TV$ThIbUR\[KTY@V$x hAIŠ v vS— ® vi[K‹.VUQ@bUDSN>N>[K[)Wcb·Yh˜v ªw†eY@v °x@TZvIƒ SWXY@Q@]/VUYkgC[)d"b$h G¸[)— R\Tv YCR v bUP˜TZ[KN>]HT[)b YCR\oHWcˆ@Bl ƒ[)Y˜‰CtH[KsGXdƒh b\l$WXb$ˆHv±ˆOt †ev Y Hh Î ÒqÏ RU— WXBv 7 b=viFKJ˜‹.bUQ@Q@Y@V\P@YSVUWcWXYSb\]˜T4v [)Y@j x_BBBZQ@FHVEWXY@[)R\BT"WXx@N"TYSTZBRUTHD@vCFC†ex@Y b J8FHV RU DS TwbUR™[KRUWXb p 
 'hCaOFHGXQ@N/T l$ˆ
l hCP˜[)]OTb Ò@l Œs)‰ h l·ˆHˆOo v Î sqÏ!Šf V\vTbU kb·[)hÊY@L&Fk[Kv Nwg@VUWXx@]O)TH hC^ j h l$ˆHÒSl v  @v¡^† — Î ‡q[Ï Y@TvV· @h Q@[)DSY@V$x hiAIv¤v ® — [)žV\TRUVEN[)b$[)v Y@Y˜j [SWXV>hI Kªw vIp ÔI[«Q@b\VURUQ@WX]˜GXT hip ^g˜[)vÊb\TAŒx9B™DCNw¢&Q@[)YCGXRUR W pp bUÒHREtO[)Ò·]OpUT ÒHnOWXY@o xShOTTx@CWcWXYSRUFO]_V$bUh dCbUR\TN"bMJ8FOV
G¸[)VU]OT4b\Q@gHŽETBRK¹kh Tl$GXˆOx@ˆ@b$l vv †eY  ,
-

L M GE /

!@(

ՍԁÔiA@  —A Ö FH¶

*





H



(:   

&(: 

!"$#

)&H#



&%

'

()@   



:&()+*,

.-

/0#21 35456"

(: 7    :&  #8  93 H @(   ,;/0#P@B·[)GXWXRUY@TZ]]HFHbUV\RUWXVEž$[)[)R\R\TWc]HFOWXYiTvÌb[)†eY@Y x¯GcT·[)VUYSWcYS"]´ TEË
p ) Xh l$ˆHˆOÒ v nHˆO‡·pUoHtHÒ v "   Î l$oqÏ Re‹2¢v FŸ‹›v&GXT$Ô¤[)TV\¢&Y@WXWXY@b«]Ÿ[K[)Y@GXxš]OFH^9VUWXR\v D@ŠN"WXbY@]HJ8FHQSV/TRURUR\TTHCv£RLB$[KFHRUN"T]OPkFH[)VUVUWXWXž$b\[KFHRUY‘WXFHYF)J v 'hCPk [) ]HTZb ‡H‡ ŒˆOm h l$ˆHˆOÒ v
†eY  
   " 9  Î nHÒqÏ4ÖRUF¿v Ö R\T[)CYSRÍ]˜v B·[)j RUTZY‘]HFHTV\aHWX[Kž$GX[)Q˜R\[)WcFOR\YiWcFOv YŸFKJ †eY bURE[)R\Wcb\RUWXB$[KG [) PSP@VUFC [)BED   Hh l·ˆHˆK‰ v  9;
)  )h l·ˆHˆOs v  Î l‰KÏ — l$ˆOFHˆHN Ò v ^WXR\B™DSTGXGÁv
Ov›^B$LVE[·¢®.WcGXGeh Î nHsqÏ4ÖN>v [KP@Ö P@[)WXY@Y@]/]šN"[)Y@TxÌR\D@FCLx±v ªwJ8FHv V_LR\DCTCQ@R›R\THB·v [)RUTZj ]HYÍFHV\WXTZž$Œ[)[KR\WcN"FOYŸP@GX[)T p Y@g˜x9[KbUV\TT x p Î l$mqÏ †RUTZvƒ^RÀFHB$Q@[)GXR\WXTY@]HWXFOTV·VUWXv ž$[)R\†eWXb FHYÂGXT$[KP@VUV\Y@FHWXg@Y@GX]œT1N g@ W¸[)b´†e[KY YšWcb\bUQ@T9FOYš RUD@T RUV\WX TaH[)Gev HhCP˜[)]OTb nHmOo ŒnOsHs h l·ˆHˆ)‰ v   E C h ˜ P ) [ O ] T ¦¸R\F"[)P@PkT$[KV™§h l$ˆOˆHs v Î nH‡qÏ4ÖRUF.v VUÖ TN/[)Y@F)]aH[)T Y@V\x2Tx@°Q@YSv x˜˜[)vKYC°ÂR=WX¢GcgSFOQ@VUV$x@vOb`4WXY_b\WcRUYST] CR=BZFHB$VU[KPSRUQ@T]Ob FHbUVUREWX[)ž$R\[KWcRUb\WXRUFHWXBYb v Î l$ÒqÏ †B$vI[KRU^T]OFHFHQSVUGcWXWXž$Y@[KWXRUTWXV·FHh˜Yªw
v [2Š bU[KdCbUNw¶CWXgkY@FHWXGXb$WXh@B4[)[)YSP@x PSVU˜FƒvI[Kª_BEDi[Kv Y˜[)†eY b\BW¸[@v — TCR †eY ¸h l·ˆHˆHÒ v
  "      ch l·ˆHˆOÒ v Î l$sqÏ ˜v Š v 4QSWcYSG½[KYiv±
Oh †eY@l ¦x@l Q@Q§ BZ
‡@RUWXl FHÊY‘l·tHF)Ò J4h xSl$TˆHB‡OWXÒ bUWXv FHY‘R\VUTTb·v Î l$‡qÏ ªwv"AS[)GXRU)FO Yiv  
 f TY@Y@b\dCGcaH[KY@W¸[@h l·ˆH‡H ˆ v Zv j x@x@WXbUFOY p °9TbUGXTdCh Š T·[)x@WXY@]kh Î l$ˆqÏ ®›BFOv.N"ACP˜BE[KD VUQ@WXbURUFOžZTHY"hwF)‹›J Bv j G¸[KvbUbU®.Wº¹˜Q@TZGXVUGeb_h [)[KY@Y@xÀx x@˜FCv B2Q@v N"f TZTYƒx@R&TV\V\TbUP@TYV\Tv bUTY j p R™[KRUWXFHYSbJ8FHVÀRUD@T9V\FHQ@R\WcYS]ÂP@VUFOg@GXTN´v †eY  Hh P˜)[K ]HT b nHnHˆ ŒnOoHs h l$ˆHˆO)m v Î nHtqÏ g˜[Kv bU—Tx{žTFHVE[)YÂb›gk[K[·Y@dHx9Tb\AIW½[KvkY® WX[)YCV\J8RUTNV\T[)Y@YiBv T9j YSQ@TRURe¢FON>FOVU[)¶CR\b$WXvB_WXY@†eY x@TCWXY@] 

'=@



%

(:  

  ,:&Y F:# ( @#$(% `&(: Y

 C)-  ( # 

$ 

&%

(:     &(: , 

,:&V# F` &$(

 #C  )  (B 

!"$# 1 354 6A

()@   R% :&   3 H K@(B   / :% "$# `  &(: H8#   () 7  C=Y!  V6  B&(   # $(@!

C

(

7# 8)-

!"0#1 3!



& R $ '# @( !

F^

 ( :



 

 B

.-

1

.-

7# C)-

()%

 

A F"L" 

F^(  



 

 :&   & H H    &(





 C)-

   $ '# @( !

()@  R%

C=@ , 

E-

(# 

%

    F  (: B  6 ^ F: F^(  &(   DIH     D  C# @( ! D)&"&(%   B` @  (  W



3   H   /0# `&(:    #  ) ( 7  C=YB% V,   &( $ # @  ( !  !"$#1 3  .-

#, ! 

&%

A

()@ 94H##  !"$# `&B@()@  # B%  (:

  CY = !@   V@K '&( $ '# @( !  !"0#1 3 -

KhkP˜[K]HTb nOn @o)‰ h l$ˆOˆHo v Î n@l'Ï j7 vYS°ÂTQ@WXTV™[KY@GTV·Y@h T˜Re¢v 2FHvVU¶f T[Kx@P@TZP@VUVUbUFCTZ[)YiBEh D[)Y@R\Fx RUj FOP@v A¤WXB‘v°9bUPkTFHWXRU]HR\TWXY@Y@x]˜vv †eY
   " 9  ' W

()@   

E:&E

- (BH

(

R

(

AKJ   &(

(  $ 

F 

# +#  ( ^ " %  % 3 %7.*, D `   3("D @@  =Y ( ,   D  (B     #    !( $

(# 

D) >L(#K$H% ) $ 4 D # !@( 

-

(:    R )&  83'H: /0#