A Machine Learning Based Approach for Table ...

17 downloads 1992 Views 296KB Size Report
but also to create any type of multiple-column layout to. Copyright is held by ..... 918 table tags in [2], 75 HTML pages in [10], 175 manually annotated table tags ...
A Machine Learning Based Approach for Table Detection on The Web Yalin Wang

Jianying Hu

Intelligent Systems Laboratory Dept. of Electrical Engineering Univ. of Washington Seattle, WA 98195 US

Avaya Labs Research 233, Mount Airy road Basking Ridge, NJ 07920 US

[email protected] ABSTRACT   !" "$#%&#! ' )("*+" ," -. / 01" !  23!-&#! 4.,  / .!5.#! 76+89:;41? @#%.41 2A!5  B.C,"!"D6BEFG#!(  H,*I:J "?  19#!(K1! L / #%M#!#! N N:;"G1$""$#! "6OEP#! ,.#!"$#! Q. &#!  R "H:;D  21*ST:012B51? .2"T#*J':J"U"$#!"$# 5.! V.#! W.4U" -"T? #> O:J"Q 0"$#!"$#0)(.%)#!!  @#!  9 / #%" >.!B @#! I6 Eh'%) #! /   #%.#!D#!(A#%.  2C'! @# "$#! #!(.# ²9 !" #! O#J )#% W.2! #!(´Z1,! "$#%;  / !5&#! :O. r!.? 1#!;#!(!"R!0 "$1# / .#!1!" ;  ""2.#!(D  #!! O / T ,); / %(4&%#!)! "Ð ê ê å ‰>  @# / .#!1!9  ;   -&;#!3#!(R""I 2#!(5"   @#!" / &? #!!6'‚Q ! @#*J:0 #!( ?—!:˜"$#!"$# #F1,5"   @#!") ð á ð ç  "#!"U. / ê :0 "6jpˆ)#r#!( #5 / ""O#F1,[ / #!( "" / ! !: í;% *,ífæ kl"„„"„l â Ö 2 ˆ*7"  )! 2 D1? 4. 2r"" Ø Ð ê ê k 6O‚Q A#!(3 $#;#F1, *  á * / & 6 ªT60œJ1ê #!A#!([" -&#! #!(4.#R.2=.  @#>#!( / !"T") *íYæ kl"„„ „l  1?î ê ê " Ö > 7 7 Ø  9#!(MTM,R / #! " 5 5 )  Ð @ 1 A : r 3 I * 0 :  ( )  ! B ) å :;.% > *íQæ kl„„„ l  1? *,,.! 0 D2"T 9#%." "î ê ê T ,)H / 1? Ö " > Ø  H#!(M 6 ï 8 5 C 6 ï 8 5 C D Ð E 1 F : r 3 ˆ * 0 :  (   ! å 21 H#%" O:0( )([ "419:;.% > *íæ kl„„ „l  1?î ê ê Ö " > C C Ø R#!(3TM,R / #! " 5 5 )  Ð G 1 A : r 3 4 * 0 :  (   ! H ) å :;.% > *1íYæ kl"„„„l  1I *,".! 0 [?P21 >#%." "6 ê ê :Mê 3r*I:0()!N) 5KJ "Ö > Ø H#!(MT ,> / #! " å ) 5KJ Ð 1L :;.% > * > O 1 ,".! 0 D :q#!" @#0#%6 ˆ  ê  / [#!ê (Bê #%&#!  "*4ê D#!( /  :0 2   "ê   ˆ*4:J ê :0 $  ê ï65 7 *P) 5 7 * ï65 ê C 4Q) 5 C #!;!"! "$# ï65 7 Ö"> Ø *P) 5 7 Ö"> Ø * 6ï 5 C "Ö > Ø R ) 5 C "Ö > Ø *1! ,"#! #F:;r#R1!T)#! "Ð

> [Mæ

W‹‹ Ž 2‘ 7’ X Y‹Ž Œ  ‘ C Œ ’ ‹ kŒ l Œ k"1l

l

:0(" :0(" :0("

†w J †w J †w

 S w y“æ U  xuw y æ w J  xuy æ U

  .4  .4

†w J †w

 Sw y w J S y

æ  æ 

3. CLASSIFICATION SCHEMES ef.!  r"    i4".#! ’ %(" r(41""   #!"R"    ? i4)O  O4.#! " .! .##%)#!  #!(.#R !.#!  @i" R#!( š / š  :0 25" @#%. $#! "Ð ô œ%ž ê e ê >š  ›š k 5 Z⠝ æ k ô œ%Ÿqbô ê e ê bô > › k 5 Z⠝ æ š k :0(  3   V" 2K#!(H! 2? O.#%D2![#!#!( 2r!$""!6;XZB!".#! D):‘‡9$""$#K+, ‡Hi4 #!  Ö ‡B;‡ Ø :0( )(Z  M[ ,)? #O / X m œ8H0oDp m 6 ªK‡B;‡M6$XZH15#!(1!"H&##! #! / . wy=z{=|=}1~ ""T#*f:0( %(’.!¿-h#%  / * -F21 [#%.€ /.4 -h#%. #! #!€ /6r;(r,   #M"S=!"! ñ  &B.4[%1 Y4.   / #!  Ö Œ9³J‚ Ø 6 Œ Ö † Ø ­ Ö †rØ ‚ Ö †rØ

ˆ!" nu 6 ª ƒ n=v 6 ƒ. n=ƒ 6 ……

Š1eHo

Ö  . Ø nm 6 nTk 1n k 6 mn n ª$6 • ƒ

Š1eHo

Ö Œ9³J‚ Ø n=ƒ 6 n… =n ƒ 6 …Tk =n ƒ 6 …n

Ä;ÁÌQÄd¼­ò7¾K¿>À7Ã+¼T»¸aÂC¼1È7Ë"ÁÄJ»&¼1źQÄdËźQŸdȹ'ÉQ¸Šóf¼T».¼1ÈIËrÄd¼TÁ»È7Ê ¸aȹÁ4Äd¹4Æ»¸-ËPY Å ÂÅÍ ‰> ‹ "" / !¬#!(O#% * / f#!(  ;. &#! #!(>Š1eHo˜:0 #!( %1 4   / #! S=!, / !rM%( ,##!‹#!(4.r#!( >:0 #!([ ".0S=!"6YEh#O%( " /n=ƒT„ …n=† * "4.%.J#!9#!( nƒT„ ……† .)( "À7Á,ÂCÃYÄ-¼ÅMÆ4Ç4ÆÆ4»&»&¼ ÆËÄôõÆ=Ä-Á4ÅŸŠïY¼1ɏËÁÌYÄd¼1ÅÍ ÂhÁDÃ&¾3ÁC¹4¼1ȈºQ¸dȼNË"ÁÌQÄd¼8Ç!ÂF̱Ã&¾3Á.ö[Æ,ȈÊ@¹4¼1ȈºQ¸dȼGË"ÁÌYÄ-¼IÍ :J / 4G #3"$#%.  BG#h:; wyÔ1~ #%.2 "65‰R Y#!T#B @#! 2 A>!"#%.2 .0,5&!>:0 #!( A wyÕT~ #%216+Eh#! O.#!(.   \w ÷1~ #%2 K#!D#B#!(" Z1 tI)!"$#K!:0 "6 ;(  K, $#! #!#!(M" / .3!3&! /  1"  2"G "41?—!"! 2 1!$""  "6W‚Q 21! u Ö  Ø (:0 5G1?P2"T A#%.[  "    ? iG >2"T 6B‰ " M 4&#! N!"#!(4&#H #H " ( B2$T"   @#!"C. 2[#!(M!:‘ !"#! ˆ6rEh / #*  Z"3 / #!(  @#O1 Žr"#;%(4. 2 ; 5#%.R41! @#% 21*$4." #!( .  2 Y4&#!!f / 5.$B#%;  @#%" Ö "H” ƒ – / .‹>.! 1#% .41   M#!(4&# Ø 6 ‚Q 2! u Ö  Ø :O K. G  "    ? i[. 0M2"T 9#%.6‹;( 0  0M" H:0()!H =# / .#!1!" .4'#!([ST 4' / (4. : "$#!"$# / .#!1!" r:;D &!D.# 2N ( ñK1"",f "5.T#! 0.41   ‹:J-r,O"1 %1 #!C "$#! / #!([ %S' / 2 R"(!""[:0( %(U5S=" # 1?h2"T >#%6 ‚R".!  7*:J3#! @#! #!(9!"(4&%M  #YM""T 2#!( Y  2?  M#%." "6M‰ / #!K )#! 2A#!(.#H!M#!(K!?P4. G @ @#! .)( "#!r#!("  @1 @#!"D608>:;"! 2 4.ŒRB³;.  u=… 6 k • vƒ 6 v. • k 6 nm

o[T1 i4[ŒR3³;.  n=ƒ 6 … vn 6 u • …=v 6 • m

Ä;ÁÌQÄdn¼ ûˆ¾B¿>À7Ã+¼T»¸aÂC¼1È7Ë"ÁÄY».¼1źQÄ-ËÅKÆÇ;ÁNÃQ»&¼•ì¸dÆ4ºQÅÄôɼ•ì,¼1Ä-Ê Æ4Ã+¼1ɏ».ºQÄd¼GÌQÁÅ"¼ÉWŀôÅ"˼Â'Í !"   GA!".ˆ%.#! >&!3,#!([( 2()6

6. CONCLUSION AND FUTURE WORK Q.[1#!"#! U :;W1$"T#! K  r.U $#!!" @#! 2.4 %(4"2 2A!"˜:0 #!(5.$D. &#!  "6RXZ3! "$#H 5%( J.! 2H 3#%O1#!"#! r2! #!( / ‹8H0oDp $"$#! "6p"$1# / ".#!! "*="T#!T##F1, / .#!1!" +3:J% 2! / ".#!! :;!  #!G" @#!#G& .!2 :;'#%.A2!4Z#!#!('.#%.4  / .r#%  2C.4Z#!" @#! 216 €Y,)! T#! >N#!(  H &!2r.#%.4 M " 1N( 2r.!3 tI!"$#R8H0oDp @#F1" > N "41?—!"! 21*,1#!"#! 2r#%.3#! #!" > / #!(B!")? 2 V"'21 #%  "6IœJ.#!" R[eM61ef SI6ŠT,.#?P2 @# knnƒ 6 ” u –BŒ3689.% %S[.4[p+6,ŠT(4. !± 6 b Q#_1§h*] h £ ^4¦ – b ¤ b§  ` !`—b^ *1#!5&#! 2M#!(H" @#!#! D / $#!!)#0,#% 0:0 #!( 5%( H.! 26EF   ^ Ó b h$ £ §`b^ – ])"§ h%`P*]  £ ¥  b•_ h)^ £¥ *