... to the use of interfaces based on multiple forms. Additionally, we pro-. 1http : //www . amazon . com. 2http : //www . mysimon . com. 3http://www.travelocity.com ...
Searching Web Databases by Structuring Keyword-Based Queries Pavel ´ Calado Altigran S. Silva Rodrigo C. Vieira Alberto H. F. Laender Berthier A. Ribeiro-Neto Department of Computer Science Federal University of Minas Gerais 31270-901 Belo Horizonte MG Brazil rcvieira, pavel, alti, laender, berthier @dcc.ufmg.br ABSTRACT
! !#"$%& '( ! *)+ , - %.,/ " 10/ !'* %)1, !2 !354%)6 ! %7&0/ '*89 : ;9. -( !! .- -9 %.' L?2KY" J--( !, -9-&.H"M)1b, ! BH %,>'E2J \-( !EH.i !89L+)+ L"dm , H'$. !7b'H. 9 !,`)+ "n- .e2 -( d %UA"oB2B !p"$U - !E* L%3q0/ M"9U >.89$,O"$UGsr.rt^uvtw " ; 7&9 ;.i" ;.-*" ! + !89L 9=aB8 8 %,VE8 !P " F- .-( .9 36]98 " %7)+"9 !>" F89 ; ! !A a.x"9 " ! +-DVE89 !PG.1-E! ! 9=7"9 +H.9T %,.9B)P 6- ! !E %& AH.= a- !! >y9=8 +_{z|t}.'(.8 a~%|.|&tD3
Categories and Subject Descriptors
4#3 m3 mI $
.k %G(Oi!$
U9$*J5@!
G 9_xN?.U .d %UA"M.$,DY A L}69AH;!.HI ¡.¢g£.¤¥94#3 m3 v Ae9
@9%G$¦i!$
U9$kD5`!
G 9_1 FN?.U .d ! !?¨§M!©!ª?©¡.«¬J«AA%£g®AA«
General Terms
Z;=. L" !7$¯x\-( !EH °7$EH.9,9H, -9 7: 9! "9 A2XU E !9, %,dc !2.k89 !3JN?X,9, L .R7x L;/ 9 ! aM- , !! !#[, Lhi ae2 -( #+ .`µg g3 375.E2d, B #,9UH.'9. !H¶A7 a E g! "9.89 , '( b189 G.·1-( '9 36Y"9 A)+ .7 8 6)+ R'( ; %VE89 L %, / %Uf"9%)¸X8 d/, Lhi !E E g! M> !.H"f, B 9A ,9UH.'9. 3 C6"9 F.B;!.>8 .M -9 ! =I # A ! !"$UD.!! 0X !'f, H'$. D "9 >89 MF!89B. .L $U & bc" b89 . Ag. !+'$. !,JDI8 L - Y!3WZ, , L $2E7)P b- »BÄ&Å&ÅÆWÇBÈÈÉ&É&ÉWÊ?Ë!Ì$Ë.ÍÎUÏWÊÐÎ!Ì ¾ Ä&Å&ÅÆWÇBÈÈÉ&É&ÉWÊGÌ ÑÒ&ÓÌ9ÎÏWÊÐÎÌ À Ä&Å&ÅÆWÇBÈÈÉ&É&ÉWÊÅ&ÔË.ÕEÖ&×&ÎEÐ&ÓÅÑQÊÐÎ!Ì
-(. FIH. T" b-( ' a =. a8 I'( 6.W. B)6 + 89 %, 'E2*cVE89 A2*!!.H, 9=aIb ! !.. ! YA A _7 .1,9 ; 0/ !' !H"X ! = 9 !!3c8a.- - .H"k8 !FDS6!2E ! .k9 e)6.TXµ. /L~!|G¶1I, !°.9,>, & FB898 %,>VE8 !1G¸M89 B8 8 !,V8 2@. !,/'2@"9 T& A2)P.H,c-( ! y9 %,'E2k" 8 %3WC6"9 +B8 8 %,IV8 !: +"9 !*8 '9 L %,cb" 10/ !' , H'$. a$,"9 ; !& %, !89L; - ! !E %,a"9 b8 YH9T& %,>.9B)P !3;C6"9 ; %. 1"$;"9 F8 Y9 ! %,Y.9L2> y9x = # %H"d'(U\J*I89 U cVE89 A2E3;8 .- - &A" 1"891'9 bI-U , F !6)+ L"/µB~U¶6> E g! "9a a -9 .9,@ E89 L & ID0/ !'k89 a$,Kµ ¶Y"9 I-(B ' L?2J.WVE8 2 =c & H.R"9 A= 9 !.89;,9UH.'$ !;89 9=I = I E g! 3ZY.d, , L 9.Q,EH.= .7(89H"d - E .! D I-$U !89 L28 LH.'9 *-(H.'9 J, ! ! !!7Q8 A" YZYQ.9,I! !89 UP- "9 !!7)+" ;, -9 !2c-$. 1 W !,°3 CRJ& A _2M"9 a !. '9 L?2@.P8 b.- - &A"°7RD -9 #- . e2-( :0/ 'I %UA"cB2 B ¦)1W - !E %,°3RY 89Lx'H. 9 %, 8 9=>" F-.?2-( I./m>, Lhi !E#,9UH.'$ !a $, %U I"$U .8 +-9-&.H"D.%)+Y!!8H !L2B89A8 9=a89 A+VE89 !P.$, A8 O!. 9B)6 AI)+ L"`[ 9 I8 A& !E /G. " Y8 %3Q]91F P. ma899B8 8 !,*VE89 !P.(!. 1 B)P bU F !& %,J)+ L"[I. H.' a E A !9! a:- 8 8 89Lbµm|t R.i. B)6 1U Y- 8 8 H¶A3x0q"9 *"9 +89 P AH.;)+ "M" FB2B !· ! !" aVE89 2D'( a- E! ! !, µ ="9 P.-*mH9T& %,#.L 9 & !H¶A7&BQ! !P.9B)P U 6 !& %,a)+ L"I 9 .E E G !9 bµg !x"9 !D~%|&tn.$" 9B)P U F-98 .89H¶A3 2.
6C " PRELATED 8 :9T& A2)P.H,WORK RWVE89 2Y.c89 .c x6H" x!.* .[ !8! I @ d !..xB2B !IL~!|7W~%m7R T 0X !' %UA" ! = 9 !!3WNe*"9 +!E \:.°B89A8 %,, H.'9. !!7 " %)6 !& A%7x 2k. c !! !EL2X. *- .-( ##" 89 T 2)6.H,'$. !,FV8 !°"$%& Q.- -( % !, z7~.7.rU3xC6" bH&-(. B2B !M7, ! '( %,b z7- -(. !R" Q89 W. ?- _ # 9=89.=. VE8 !Q.9,a9% = Q; \-9 1 E A©¡.«xG.Q-98 '9 "9 9= E !E6.5c, H'$. "9 Y0X !'R3xZY=.H!)6.° +.g3°L~° E. ,89! a*B2B !Â"9Y.%)+bVE89 A2 =*,9UH.'9. !+" .89=">T& 2 )P.H,!3C6"9 a)P.T(7" %)6 !& A%7RGE!89ad ! .$.P,9UH.'$ ! $,/,E !a9c-U , .E2@H.9T 9=Dc" d¡ $B .£¡¢e# B)P !3#C6"9 a)6Td, !A '( !,d O rUW- .-( !Y"9 # \ !9 d ?± 79I)6 T %)+[VE89 2D . =8$= a )+ L"[T& 2 )P.H,M'9. %,> !H"9 9=%-$'9 !!318 Y.- - .H"M , B ! J LI,- IMI8 A"k - *VE8 2X 9=89.=. 3kZYL"9.89=" " ;!.>T& .8 Y.- - .H"> !+ \- ! & .79 LY.*T& !1 L *!! ! '9 * !=8 F0/ 'k8 !3 Ba -(.H%7()P --(. cH. T>"9 #. B)6 YJ%&. ,[" c Ahi !bP- 8 8 , H79)+"9 H"J)+ !! !U L2>'( F- ! !E%3 C6" J !.I-$! >, !P"9.*'( ! /"9 DBI)+ , !L289 %, .8 ¦K"9 /-' .*H9T 9=lVE89 2q !8 L@ o \ , H'$. * U3YC6"9 , ! Y.J -9%2E %,> M"9 F)P.TM, A '( !,l ¦ vU;/, 9 D"9 J Le2l'( A?)6 !`.' ? ! d,9UH.'9. #!-(. %,M.Q ! .9)+" c '98 #..8 ! U MG ! M A\%3f]9.H9T 9=kB898 %,l.' ? ! 8 %,K. 9B)P 6.VE89 !:U& 1FE%i,9H'$ 7"9 1)6T, ! '( %, q .6!c'9 9 !#-9-9 %U . . !E %,! 9=[8 9 !3@ZY A\ 9 k.18 A"k.k _, %J F--( !,k ` mQG.a"9 c%. 0X !'o.! ! '9 , H.'9. !!3 N?f" D% k"9 d! 9=O89 .9+!2J'( '$. !,>M , !9! ; 9=#G{, B +0/ !' , H'$. !3N?K U7x' B !AFH.9T 9=J #'9. %,@XJ %8 * " a- %\ Le2>W" F' B !A!7("$ # ! !d , !!7( M" , H'$. .7("$Y ! kb=.H-9"°3;C6"9 b-9- .H"d !, !,[ a %UA"DB2B ! 6#86 G89 $ e2E7 ! L6.
.%)+YT 2)6.H,'$. !,JVE89 A !79' 8 P"9+ 1'$ %,J.MaH"9 A , B 9A-9-&.H"R3 N?.8 6)P.T(7E"9 +H. T =a.V8 2I 89L6 P-( G. %,8 B 9=c& ! _° A" 9 VE89 !!7' 8 6)+ L"9 JIS6!2E _M9 A?)6T.- - .H"~!|3QS6!2E _c ?)P.T"9%& Q'( ! !Fy9BR89 %,b+, G. .* !9-'9 !x'E2cC8 ;$ , :GY~ .i$,i7 ., !.9BHU %,M KL~.~7i"9 2>%.d'( a89 %,M !- ! !EbE2 .R"9 Y! . b, P D G. .J !..g3WS6!2E ! >9 A )6Tb, : !-( !! .L2#89 G89)+" !F)6 :9 ! %,Y, A 9 "9 b 9! a.Q" a.9B)P M ) .W !& AH. 9, !-( !9, !E ! , ! ! !#L~%m7x~!|3+N?[.8 Y%. .7iS6!2E ! .d ?)P.TU c8 %, I-98 ;" T& ! 9 !1x#B898 %,V8 2* !- ! !E 9= "9 89 ;9 ! %,+.9,J"9 9! F5"9 b 89 %,D. B)6 !3 3. OVERVIEW OF THE APPROACH
0/ + U)`- ! P.U& A )`.°86-9-&.H"R3WCR# - L_2 "9 b, !89 .R79)P FBH;)+ L"> F'9. a, Ay$9 L !3
3.1 Definitions
P , d, H.'9.! w.! ! '9 >"89=."Od0X !'OVE89 2 E g! `µG.[ 9BH9! .7a.o4bC D¶A3 0X X, y$ d" ,9UH.'9. #.;I!. [.;#© "U®¢g« '& %$ » ( & )¾ (* * * ( &)+ ( ,.- ~ ¯W.H"M' B !A &)/ ;I ;+¡.¢g¢gH£©¢eª¡ 9I-9. L & / $ 021 » (43» /65 ( ** * ( 021798 (:3 78 / 5 (; / - ~ )+"9 A > %A" 1=< K '98 >$, %.H" 3 . kU '98 !7Y B %,fI/ = k..8 7+)6 @%2 "$%& Ya B+..89 !3W]9.1 BH.9 7 DJ.' ? !6 !- ! !E 9= >U 7" '98 >?9@ &BA =."a'( M B#.+9. !!3JC !- ! !EP" :89 9=#86 .H .R7)6 Y.%)n# U ' 8 k.-9-( ! !& AH.6 !!7:"9 J%. %,`O¡ 9> £«¢g3lC6"8 !7P L ' 8 1 < 71 f.' ? ! & / 71"9. , , Lhi !ED 8 !!76)P [%. !- ! !E;' B ! &)/ ! 5 021 < 5 & $ 021 < 021 < + 5 ** * ( (:3» ( (:3&¾ (** * ( (43 (* * * 0/ *, y99 k¬&¡.¢¡&©¡.«J«A9® 9A¡da" * #.1.PU '98 "$UF!.-( *E2[.:"9 IB %,d' B !!3IC6"89!7i"9 cA" ! .WI,9H'$C ¸ ;, Ay$9 !,>. '1IHJ1 DFEG$ Y[ ' 8 bQ b.' ? ! &LK * 0/ b, y99 bk¤9«¢gH ®¢g ¬ M9AA! N¦Y# +.5T& 2)6H, bµg ¢eAHI«!¶ NO$ @ » ( @ B¾ (* ** ( @ 7 * ZY6G..J' B !%7$D«¢gH9®¢gP ¬ M9AHR Q ;, y$ %,J;I ;. .H, %,>-9. L! T021 QS$ » (432» U 5 ( * * *( 021WV (X3 V U 5 ( YZ- ~ ( )+"9 A 1 %.H" 1< W.*U '98 6.$,# %.H" 3 < U ; 8 6'( ! = 9= I" F, .. > 1 < 3 C6"9 Q -9 Ly$ %,I, y99 L I°b,9UH.'9. ;.%)+P89xb =.9. "9 @, H. M.c"9%)³ JB898 d D !- !E %,°3 ZY 7;)6 %J !=H,D" b, H.'9. b - 2D+,9UH# !-(. 2JU.. .' " .89=."[ a"9 ="[ ! !8 b E g! 3YC6"9 +0/ !'d, H'$. %f'( M!.-( %,K.#k ! U .$YH.' 7;X F ! 9. H.' !!7( [ !-( L.2E7 3 C6" .89=."98I" D \%7x)P J G. L2O8 D" A ¡ \( £gª ®¡.¢g£.¤K¬.¡.£G¤X1>, H'$. cD G F"9 I d.-9 *B E! !,X)+ "k"9 *.' ? !# k"9 , H.'9. 3>]9a BH. ! 7Q
, H'$. )+ L""9 D.- -9 % K,. B !*.' ? ! )+ L"d G. .[['(ET!3YC6"9 #, H.'9. a'( #V8 %,M'E2 " c8 F b% !,@"9 ¢¡. EA¢b¬&¡¢¡&©¡.«A3IZ;F.d \ -9 7i!. , aD,9H'$ ¨)+ L"@" I-9- %U /, .3#ZY .' ? ! & ·!.89 ,>'( & $ T0
( ?NA7 ;'(.: 5 ( 0 ( eN?..#ZY U 5 3 Z;` \ .- M.#`89 B898 %,`VE8 2 $ ?. U ( e.'(.: 3OZY \ -9 Jb[B8 8 %, VE8 2D Q $ 0 ( ?N?..#ZY U 5 3
"9 6 A8 9 !,c'B : *B - *µG. E* , ¶A7)6 +., .- Q"9 GH )6T[.6S6!2E ! .k'( ! A69 A?)6T* u3*S: ! A69 A?)6T - U , Y3 F9 \ '9 b$,*.L2899,*GH. A)6.T(7)+"9 H"%. '( I& ! L2d.,9- %,[JI' 9 c, B 9F.8 ! F.: !E , ! ! d.J, 9BHU %,l ÃL~!|7a~%m7F ~ .3¦N?q ! 71)6 , !8 ;" aS6!2E ! .[, !°- -(. %,>YH9T 9=*!.$, ,9 VE89 !!3lN?` qvE7P)P M- ! I"9 MSP%2& ! .f, !6 H. T =I"9 Y !& %,D' B !!3
3.2 Querying the Target Database
3.3 The Prototype Web Search System
85--( !,#-9-&.H"a! Bx.85B !- !PµB~%¶° 9- 8 9= " 899B8 8 !,k89 AIVE8 2E76µ.¶a' 89 , 9=[M AIY-(. '9 B8 8 !,DVE8 !1, A %,*G} L%7Rµm¶W ! !A =I.9 7.6-(B ' 2D 7.5" %$, _, YB898 %,JVE8 !1.1'( =c" e'( !B: *.9 !!79.9,kµ E¶P-E! ! 9=c"9 !8 L1.5" ! b ! ! !, VE8 !!3Q0/ b U) , 89+ %.H"M.9 F.x" ! bB !- !3 E !-J~+9 BW -9L2#.( !! 9=b" 689 B898 %,IVE8 2 _¦" :8 Qx; Ax. T& 2)6H, !35C6"9 5%c'( : %. L2#.!* - " %,89 9=#b -9 + %UA"'(%\* E g! 7 *)+"9 H"JVE8 ! U a-( !! Ly$ %,D !E 9=I" bT& 2)P.H, !3 NebB !L - 7%G.56= & !F8 9B89A8 %,bVE8 2 $ @ @ @ + 7 )P P ! %,b, 9 W+ . -( ' PB898 %» ,F( VE¾ 89(* ** !( !3 ³'( IJ, H'$. .7°)+ L"kDH"9 D E 3aZ -9 c)6%2[ C , 9 O'989 ,f -( '9 @!c'9 $U .9D.c. VE8 2J A @ /K ^$,[ 5 '98 ! 1< K D E 3 P %UL2E7i " Y)P.B+% 7"9 1-( HU J)P8 _,'( 5 \-(.9 !E .(!.* - \ e2E3WN?M-H. ! 79"9%)6 & %7$ L; Y-(. '9 F, %H,J.E2 I' $ .9a.6 Aa.$,X '98 !µg 3 37xE2@ '98 ..8 1-$. LH¶x *,9! .3Q]9.W 9BH9! .7E L$"9 +U + L 1.:9 E!8 ! ! !x9"9 W)6H. , ?4. : ; #" y$ ! ,i7.)P 6%. , %H,M-( ' #VE89 A +"9+T& b89H"M[. =.9 !E%3 ! *)6 "9%& , A 9 %,k> ! $ Q Q + 75)P -E! ! %,KXB !-qmd"$U! BD.b ! ! 9=X» )+(* " * * A"(qVE8 ! U *Bb T& 2dJH"d" I8 a9 ! !, !3I]9.a 9BH9! .7R" 8 9B8 8 %,DVE89 " 2 $$#¡.«£.#©H&¢ %A7( ="E1"9U F.6" .B+- .'$.' bB898 %,DV8 R 2 Q $ 0 B. U 5 0 ' ( '(: 5 3 . Y- ! 2E7E" » VE8 2*B8 ( 8 9=a-. ( ( !c9 B# , A 9=J" ,9UH.'$ D '98 !F)+"9 A" U I.Bb T& !L2M!. -($,[ %.H"[ { @ X3a9 " ?'( !B: dU '98 Ae..8 *-$ #"$%& I'( ! !, 9 %,i7R)P ' 89 ,q Mc!.$, ,9 @B89A8 %,fVE8 !>'E2l!c'9 9 9= " ! - ! ! %,D ' 8 ..89 ;-$ !3WC6" '( !B6%.9, ,9U B8 8 !,XVE89 2dU\ % !!7(#B898 %,>VE8 2 Q ;8 '9 L %,*c" H=. , H'$.C ¸$,>c ;.5 89 %,' B + *W-, +.' H. %,°3 C6" I.' ? !b . * , U *.DH.9T %,[.!.H, =JDD-'9 ' Le2J"91"9 A2JU BG2>" b89 A + ! %, ;+)P F , !8 !3 Y. T =b"9 1 89 %,*.' ? !P 6-( ! .L2 -(.H.EW)+"9 ! " #V8 2 Q !.['( F !E;. b"9 M bH= AF,9UH.'9. 7 $,O"9 J 89L = %,=. "9 A%3o]9. BH.9 71 `f- - ! , .. q T0 /132 4 +546 87 6 9: ;9 :@2 : 6 (A CB 87 6 57x" D 89 B898 %,/VE89 2@%'( 89 %,k[ !H" " FZ .$,DNB¯W¯:¯l, = LHR ' HU !'3 DY. ! b"$U1"9 + Y -9 "9 !,@)+ L"9.8 a"9 * ! %,dM, Ay$9 *>89 _2 =>!. , H'$. aH"9 !3 CR#H9Tc" Y!.$, ,9 VE89 !: B !-DmµG. 7 ¶W.$,
S6 %,*#"9 +.- - .H", !A '( +'(U& 7Eb-.?2-( 6 %UA" B2B !¨)6.F -9 ! !,°3bNFH"9 L !A8 I b" %)+k k]5 = 8 *~.3 N?c"9 :B2B !M7&VE89 !: +-( !! Ly9 %,I8 ="b 9=. ; %UA" '(%\i3 G B898 %,*VE89 !W !E %,*'E2#"9 +89 A6U Y-9. %,I "9 :±8 2FE898 9=1, 8 35C6" , 8 x'989 , i"9 Q . -( ' VE89 !:.9,IH.9TW"9 !M35Zf PRH9T& !,IB898 %, VE89 ! 5" !a-$ %,a;"9 :VE89 2F-E! ! 9=, 89 7U)+" H" , - _!21I"9 89 +"9 Y-JH9T& !,JB89A8 %,JV8 !!3WC6"9 89 A ! !AVE89 A2JW"9 +- G !9 #'E2J! AT 9=.M L%31C6"9 ! ! !,IVE89 2 "9 !a8 '9 L %,b;" WHU= x,9H'$ 3QC6"9 89 %, !89L; bH9T& %,J.9,>- ! !,DI" b89 %3
4. RANKING STRUCTURED QUERIES
C6"9 MV8 2OB89A8 9=k- E! !DE! !JB898 >/ = & XVE89 A2HX7°! B =>.9L2[.:T& 2)P.H, !3a !& AH.xB89A 8 !,[V8 !bU c=. !9 AH %,Ma. a89 B898 %,[VE89 2E3 ]9D" * %..R7+)6 [ ! %,`k! B )6%2KbH. T =X"9 VE89 !5.!!H, 9=++"9 ! L5 L?2F1" P, H.'9. 7. c"9 )6H, !7U"9 U e2b1"9 :.- -9 % c, .. F aVE89 !B °3 C6"9 cH.9T 9=D.PB898 %,dVE89 !F a.!- " %,d"8 =" "9 a8 cW" ISP%2& ! .d9 e)6T>, 7$"9%)+d @]5 =8 E3 ZYL" 89=."D" ?)P.T%J'( Y %. L2D \-$.9, %,*#, !iE2 ,9UH.'9. IH"9 7(F -9 ! L?2E7(" a)6 #"9%) L2M?)P>U '98 !!7 1 » .9, 1 ¾ 3 Q2 and
Q1
Q11
a1
a11
A11
a12
A12
Q21
Q3 and
Q31
a21
A1n1
A13
Q32
Q22
a1k1
a13
Q4
a22
A21
Q42
a2k2 a2
a23
A22 A23
Or
A2n2 Or
A1
A2
O
And
I GK J
U LM)Nc@O(=P%G$qR&Q#$
8Rqk°1e$
TSUJ
VOP!!
8J J
RZY
W8X
C6"9 P9 e)6.Ta!.9 BQ.$ Q.99, !!7& %A"# !- !E =b -9 ! ;° *_ "9 +- .'9 ! F'( +& %,i3QCF %A" 9, Y "9 ;9 e)6T* 6.E _U %,MF'9 92*H$, . . .' 3 C6"9 cU _'9 H.T& #" D..8 M~D[ 9, % "9#"9 ! -(9, 9=[ .U /)+ P'( D.!89E %,@.c /"9 *H9T 9= !.-98 HU R3WNeJ"9 +% 79)P F%2D"$U+"9 b G.U .M)1 &©«AH.¬3CD -9 LG2["9 c9H °7°)P , Ay$93 [ / .b" c A
Target Database
Unstructured Query
Query Structuring
Ranked Structured Queries
I _KJ
U Mc°9
8W P OUP!!
:.R + >" a,9H'$ a"9Y!-(. b"9 F..89 Y >" , #.$ '98 1 / 3xN?F"9 5!. 7 %.H"c..8 P 5!.9 , !, cB =.9,D" + F" )6H, + >"9 bB = 3 Ne"9 9 e)6T/.]5 =8 7W"9 D,9UH.'9. > I - ! !E %, 'E2O , I3f¯:A"l9, 1 / !- ! !E.` '98 > l" , H'$. .3W¯:A"9, > / < !- ! !E: [ / 3W¯W.H"9, Q / !- ! !EFDB898 %,dV8 2MD'( cH9T& %,i3#¯:A"k9, Q / < !- ! Y"9 I-( @.W"9 IB8 8 !,@VE8 P 2 Q / "$U . !-(.$, 5+"9 P '98 1 < 3 : !A. > » $
, > ¾ !- ! !E *-(. '9 cBHU a.x"9 F. '9 !Y.E! !,d*" F9, > » / $! , > / 7 !-( ! & !L2E3 0X ¾ %./" 9Td.1" #9 A?)6TXc, ! 9= 7xG.c 9BH. ! 7 D,9UH.'9. I.k'(E.T!7°)+ L"@ ' 8 ! 1 $
( .9, 1 $ ( @3xNe#" %. 79, 1 »» - ! !E5» " : L 6.i+B.¾ !, '(E.T(7Y T&O ?NH71;'(.: 7+)+"9 ["9 [ e6N O D - ! !E %, 'E2d , > »» $,@" c ?;'(.: J a - ! !E %,d'E2d9, > 3 N?nK Jg." R7b9, Q !- ! !EJ" kB8 8»e¾ %,DV8 2 Q ¾ $ 0 ' ( ?NH79;'(: ¾ 5 ( 0 ( ?ZY U 5 7 )+" R Q a"9 -9# =MM"9 ' '98 7 Q ¾¾ " I-9b¾A» G 9=DD" : '98 3 3 D, > ¾¾ " A BZY U 3 C6" + Le2*.RbB8 8 %,VE8 L 2 Q / )+ L"*"9 ;,9UH.'$ %.'( ; ! !D.W"9 ;- .'$.' Le2*.R' 9= Q / 7&= & !"$U " ;,9H'$ o)1P' & %,i7 *2µ Q /:H a¶A3W¯Q\ . ="9 + )P.TD []5 =8 E7 )P a%.>, & b" b %VE8$U .R *2µ Q / H a ¶ $ *2µ Q / H > » ( > ¾ ¶ *µ H > »( > ¾ ¶ *µ > » ( > ¾ ¶
*µ
µ2Q / ¾ H > ¾ ¶ » H > » ¶ * *µ 1 » H > » ¶ *µ 1 ¾ H > ¾ ¶ *µ> » ¶ *µ> ¾ ¶ Bµ ~%¶ )+" ;I9. < ¶°=. !"9 W..89 W."9 ; "a. .' :."9 W& ! > < .$, @ < 7 1"9 "J Â [ < 3:C6"9 + %VE8$U .>=.8$HE ! ! "9 B89BP"9 ;BH !; P)+" +"9 ;9L2D & ; A6 +"9. " aVE89 R 2 Q / bH.T !> E*!.9 , HU R3 C6" - .'$.' Le2X1' =>"9 * '98 1 / 75=. !k" $
2Q
/
Query Processing
Ranked Objects
W5GW.J
UKY Q $, ! %,*'E2%> / 7& :, Ay$9 !,*.:F, #B8 9 ..R.9-' .' L !+ %A">-( '9 a89 b 1 / 7 3 3 *µ 1W/:H > / ¶ $¦'~ & ( < + 8 µB~ & *µ 1W/ / ¶¶ µm&¶ *» ) ) )+"9 A , / R" Q8 I'( i 8 !° F" :, H'$. QxU ' 8 1 / 3NP)P *! , a"$U *µ 1 / < H > / ¶¶ %.8 !b"9 c U e2 '( e)6 ! !d"9 #..89 1W/ < .$,M" # Y $, %U %,['E 2 > / 7(" ! ¯WV(3µm&¶6 !Y8 ;"9%7$ Lx" a A1 + > / y9; \ .L2D"9 a..89 1 / < 75"9 Iy9$W-'9.'9 L?2k ~.3DNe1 .%7" Iy$9.W- .'$.' Le2 )+ 9!!89c89 P."9 P-9 . L !:'( A?)6 !#" : , > / .$,D"9 b..89 1 / < 3 CJ, y99 a"9 c- '9.' L?2dP.'9 9=>D..8 1 / < 7R=. & ! * ;.x A; 9, % !,M' 2 > / K7 *µ 1 / < H > / ¶A7 )6 F89 F" F! 9 %8 7°F, y99 %,MG.b" c& .-$. I, 5 k G.U X A :B2B !L'~ %3>C6" 89 1 / < .cU ' 8 1 / Y !d.Y*& !;. H [ /H !3PC %.H"> @ 7 1W/ < )6 . =.Mb)6 ! =." - / 7 "$UP F9 !P" ; -(H.9 Y"9 + bU '98 1 / 79 >" F,9UH.'9. 79 3 3 848 - / 7 $ /| . . 0*0*112 2 4» »4363 5*+ 7 898 L. " @ 7 E)+! !8 + 1 / < µ E¶ )+"9 A; : 7 / "9 J89I'( A*.E!!8 !9! D @ 7 K"9 ..89 !b"9 M '98 1W/ 7+$, , / "9 >H.;8 I'( I. ..89 !+FU ' 8 1 / 7( M" a,9H'$ 3 D. ! F"9;)6 c, 9x!.9 , x" PH, L .$i£g¬BI9. L'~ %7& ! :" )6.89 ,-( !$ / 7 g3 3 *µ 1 / < H > / ¶ $f!.Uµ 1 / < ( > / ¶ $>=@E ? 7BADC 8 - / 7 # - 7 µ > / ¶ µv¶ = ? 7 ADC 8 /¾ 7 ]5 $ L2E7 ! I)P "$%& I /¡ $H£.H£;- G !9 *.c2d A .; !7:¯WV(36µz&¶I, y$ !c" D-'9.'9 L?2O& . > / . !.9BH.E% *µ > / ¶ $ GF ~C 8 F µz&¶ N?@89U2E7("9 *-'9.'9 L?. 2 *2µ Q /:H a¶b b"9 I!B B89 .(" 6 =. !B6 L !:'( A?)6 !I"9 6 '98 1 8 !Q I"9 ,9UH.'9. 1$,b"9 : 8 !x =.9 %,a;" W -( ! & 6U '98 J" bB898 %,>VE8 2E3QC6"9 + 1H.9 U %,>'E2"9 b !V89 ° *2µ Q /:H a¶ $ HIXL~ & ( < + µB~ &X%µ 1 » < ( > » ¶¶eJ *» ) ) L'~ & ( µB~ &XUµ 1 ¾ < ( > ¾ ¶¶e µr¶ < + »*) )
)+" > » $,,> ¾ a"9 FBH Y)+"9 A c.9L2>" cVE8 2 A 9=[[U '98 1 » .$, 1 ¾ 7x !-( & !L2E7xU J & 7 .$, U #" #H.x89c'( ;.:89 !;.F '98 ! 1 » , » $, 1 ¾ , J¾ " F,9UH.'9. 79.9I , HD.!8 1G.+"9 Y! BH.E' $T , *µ > < ¶A3 0X %. %)}H9Tk.P"9 B8 8 !,/VE89 !#'E2X!.-98 = *2µ Q / H a¶*> %A"qF"9 !M3nC6" d89 D%`"9 !` ! ! .9 FVE8 2*;- E! ! =..9=a"9 Y.-JH9T& %, !!7.1" B2B !·!.M -9L2D- E !1"9 by9B;VE8 2E3 5.
RANKING ! ;FB898 %,RETURNED VE89 2c P ! ! !,°7OBJECTS LP P8 '9 L %,cF" HU= ,9H'$ 3C6" > I.Y'B !c 8 %,/%.O"9 '( H9T& !,`.!.H, =XX" M- .'$.' Le2lF B_2 =/"9 M8 ! %,!3WC#" P hi !A%7E"9 ;B898 %,V8 2$,*"9 + 89 %, .' ? !xU Q, ! %,b8 =6"9 WS6!2E ! # ?)P.TY, !."9%)+ @]5 =8 *m3FZYL"9.89="[" # ?)P.TM!.@'( c % 2d A\ -9.9, %, c, !iE2D,9H'$ bA" !7EG.; -9 ! L?2E7" Y)P b"9%) .9L2d?)P[ '98 !!7 1 $, 1 3CJ -9 LG2d"9 * .HU .R7 )P a, y99 [ / 1"9 AY» Q.i ¾ !7 J" 8 %,' B !!7 "9;!.-( " F 8 !1 >"9 b, >.x" F ' 8 1W/ 3 0f"9 !bH9T 9=6"9 5 A8 9 !,b' B !!7-( ! _ !E F ! %, ;'( P-9!2E %,; 8 : B!7& g3 37 '98 !"$UxU P!.9B L8 %, 'E2*a B1R..8 !!7.6 A\ - . 9 %,* J Dm3~3WCRc \ !- _2 " %)f"9 :e2-( Y5U ' 8 ; P % !,°7 D" Y ?)P.TI)P ; - !EU '98 1 ¾ .;I..8 F BY ' 8 3 Q
And
QA 2
QA 1
a1
a 11
A11
a 12
A12
a 13
A13
a 1k1
a 21
A1n
a 22
A21
a2
a 2k2
a 23
A2k
A22
Or L 21
O1 Avg
I G J
U MNc@O(=P%G$ GZY
O2 Avg
O3
Avg
L 22
On
L 23
L 2n
Avg
(Q#$
8Rok°$
@
=PJ5_M
U$
RKX
NeM"9 a9 A?)6TM @]5 =.8 cm7i , L Q !- ! !EY" #B8 8 %,>VE8 2E789'9 L %,;- E! ! = 3P¯:A"M , [Q 1 / - !EI"9 -$U*Y" JB8 8 %,VE8 2 Q¸ ! & J[" U '98 1W/ 3a¯W.H"d9, L > / < !- ! !Eb ³ H [ / 3#¯:A" , 1 / < !- ! Y"9 a89 #.P" # '98 1 / d.' ? ! < 3Y ! # '98 1 BbU ' 8 79)6 #, ,M9 a ! !:>" 9 e)6Ti3>¾ ¯W.H"9, < !- ! !EF"9 BI ..8 !* =.9 %,/M" JU '98 1 ¾ ¾ ' B / < 3@]5 $ L2E7 !.H"M9, < !- ! !E;c 89 %,D' B !%36ZY1'( G. 79)+ " !.H"l , D " J ?)P.T/ E! %,ldH$, .^. '9 "9bHT& !" c..8 J~#J $, % I"9 @ !=&UH, =k"9 D !-( ! & >9, D)1D.'9 %,° 3 W !. > .$, > - ! !E@-( '9 MBHU >"9 JU .'9 !E! » %,K)+ " ¾ , ! > » / .$, > ¾ / 7 !-( ! & 2E3
ZYK' B % < H. T& %,K.!!H, 9=/@"9 M-'9.'9 L?2l. B_2 =O" [B898 %,fVE89 A2 Q*7+ g3 37Y" [- '9.' L?2`. ' 9= < 7$=. & !>"9 Q )1.;' & %,i7 *µ ».E! !,n)+¾ L"o¾ %.H"n '98 @..8 @G.>" @y9$ - .'$'9 e2E3 0/ #, y$ a BFb, # ?899A .d.W L..89 !!3YC6" 7 "9 - '9.' L?2DY" b BU '98 F += & >'E2i *µ ¾ < H > ¾ ¶ $Ã'~ & ( µB~ & *µ 1 ¾ 7H > ¾ ¶¶ µu&¶
$
2Q
1
7 A
)+"9 A ¦ " I b.: 9, \ !Y.F" c..8 !b @" I Bb !- ! !E %,D'E 2 < 3W¯WV$3µu¶6, A !6"$U%7.YI..8 b B+ '( F' & %,i7 ¾; + !9.89=.">"$U+9 FQ L;..8 !1 Y.'9 & !,°3 ¯WV!32µ &¶.9,¦µu&¶ [" [= ! H.G.c89 k/H. T`X A 8 %,f' B %3ÂC6" k$, L .$F- '9.' L !M%o9%)j'( , Ay$9 !,°3#0/ IBHUa'E2["9 *-'$'9 L?2d.6'9 A =J"9 I-$ .= Q ! & #M.k ' 8 1 / 7=. & !d"$bJ b.P A!7 $, ! %,>'E 2 > / 7 )6.+' & %,i *µ2Q 1 /9H > / ¶$ |~ L." " ! ; ($)+# 7 µ > / ¶ $Ã~b h @ / 7 E!8 + P Q 1W/ µB~%|¶ )+"9 A # 7 µ > / ¶; $, % !Y"9 # 8 cQ"9 ; "[. .' c.W"9 & !A. > / 7Y.9, @ / 7 D" ; "` As [ / 3 C6" > %VE8$U =89H !1"$69L2"9 YBH !6)+" b"9 Y 2D & b" Fx"9 FVE89 A! 2 QÃ)+ '( HT& !J E*9 , H °3 ZYG.[VE8 2KB898 = 71" [- '9.' L?2`' =/"9 ..89 1W/ < = & !b"9R"9 x 9, % !,b'2 > / )6 :' & %,i7 *µ 1 / < H > / ¶A7Q I, y$ %,X8 =M"9 !. J !.8 .3dC6"9 ..89 1W/ < $"9 P ' B ! < µg..89 1E! %,I)+ L"I" 1 ' 8 1 / ¶ 1 ! !>.+a& !1. H [ / H !3QC6" 6 7" %)6 !& A%7)P F E !B %,/ O, A 9 9=M)+" "9 c %A"/ @ 7 E!!8 !7W 9%7$ >" F 8 1W/ < 36C6"9 A. .7$)6 #, Ay$9 b" b Â)6 =."E - / 7 -9L2J.! - / 7 $ |~ L "9@ 7 E)+! !8 + 1 / < µB~~%¶ C6"9 F-'9.'9 L?2J. 1 / < Y, y$ %,>! *µ 1 / / ¶ $f!%µ 1 / < ( > / ¶ $>= E ? 7 ADC 8 - / 7 # - 7 µ > / ¶ µB'~ .¶ = ? 7DADC 8 /¾ 7 ZYR * ! 7. 9! W)6 P"9%& P ;- A !9! :.x.E2a-$U A 89 U6 P.i !7¯WV$3(µB~%m¶:, Ay$9 W" ;-'9.'9 L?2E! %, )+ L">"9 & ! > / .;I!.9BH% *µ > / ¶ $ F ~C 8 F µB~%m¶ N?k! !89 °7" *- .'$.' Le0 2 *µ L !D'( ?)P ! !K"9 MU '98 > 8 ! `' B
= & 89+"9 #VE8$ e2MW" FH.9T %,M Y.:. B)6 !7°Y)6 c, A ! !9,k9=D"9 #H.9T 9=L 3 Q ! .a|t{ a, Ay$9 !,@b"9 - ! .I)+"9 c)6 :y$$,F"9 :y9B5 ! !..EQ.' ? !W c"9 WH. T& %, . B)6 6 %3xN?.8 P \-( !E!7&"9 +- ! .>$,I !!.(L 89 1%.J'( ! !>.+! ! M !.8 1'( ?)P ! !J" Y !8 L ."9 M89.L2OB898 %,`VE8 !.9,K"9 MV8 !B89A 8 !,J'E2D8 ;=. L" M3 C5'9 X~>, H "9 JA"9H B !." J !BD, H'$. .9,FVE89 !!35C6"9 :V8 !R)P WA" !F+"$%& W1.&89c'( .i)P.H, : 9! +0/ !'I89 W !$,ca8 ;" .PVE89 !!3x0X ; . "$Ub"9 #"9 =."k89c'( ;.: ! !Eb' B F-( aVE89 A2>F"9 U *,9H'$ D c, 8 *>"9
6.
6.2 Results
RC *EXPERIMENTAL !..8$U b8;H9T 9=.1.xRESULTS B8 8 %,JVE89 !+$,J. -(.$, =. B)6 !7$)P a89 %,J" F -9 ! !E %,- .?2-( FB2B #8 J A\ -( A !30/ Yy B+, '( "9 b A\ -( A H A89-[$,D" !M, !891"9 Y !89L;.5" ! F \-( !E!3
6.1 Experimental Setup
¯x\-( !E()6 W-( %,b89 =6" ! W, B 9A5, H.'9. ! )+ L"-9-9 %U ., .. 9 57 /57E$,3 53.|bB8 8 %,I !BPVE89 !Q)6 ; %U %,I5P$,"/5W,9UH.'9. 7 $, &mDG.a"9 5F, H.'9. 3CM %A"kB898 %,kVE8 2 Q / µ.*,9UH.'$! )+ L"OA" !P DFE1¶A7x)6 J. = %,O.89 B8 8 !,>VE89 2 N / 7$, y$ %,> < 021 < B8 8 %,@VE89 P 2 Q / )6.a89' L %,>J" cH=. , H'$. .3*C6" * 3 *CN / .P' B !Aa A8 9 !,°7i"9 A I% %,k b A¡¤9¢F#© "U®¢g«H7R)1aHT& !k.b" * a.P!. c.9B)P G." MVE89 G 2 N / 3lC6"9 8 %,O@ !..8$U >" U)Â.E2 b' B !Iµg 3 37R' B !AF d b.:!. !A#.9B)P H¶;" B2B !} 1.' ;F !& Y)+" ! 2" Y8 9B8 8 %,VE8 2 N / ;- E ! %,°3 C6" P.B5!.9L289 %,a %.8 !RY, A 9 Q"9 :V89.L Le2O.FdH. T& %, .' B !A M- !! f$, !% 1y9=. 8 !a U3:C6"9 ! F %8 !+U F, Ay$9 !,>.6G%)+!31]9;I= & ! VE8 2 N / 7( *CN / '( a"9 a Y.W! !F.' ? !.$,M [ D 1 / '( F" aH.5 A:.' ? !; 8 %,>'E2J" aB2 B Áµg g3 37$" B2B !¸9B)P A¶A3 Q ! .[ Y, Ay$9 !,J! $
HD 1
* /
CN /:H
H D 1W/9H
µB~%v¶
)+" A"/ F"9 #GH .P"9 * #1'B !Aa A & %,@"9a . !%3:; !%.° Y, y$ %,>! N / H $ H D 1 H /*C N *C = µB~!z&¶ / H
)+" A"/ F"9 cGH.A ./.+. !#.'? !F"$UF)1.a !& !,°3 GY8$ L2E7E)P U Y E !B %,* "9 +..89 P.°- !! H.T& !U ~.~BH.9,9UH,k !% :-( E!7x|tD7P~!|&tD 7 |&tD75m|tD7 &|tD7Wv|&tD7 z.|&tD7r.|&tT7 |tD7Eu.|&tD7E.$,~%|.|&tD3WC6" x- !! U !%$!8
C6"9 1 !BW)6 ;-( G. %,*'E2c89'9 L 9=Y"9 +89 B898 %, EV 89 !Q" 1B2 B .$,c !8$ = 1µB~%¶5" 1B2B ! W!.-$U '9 L?2a9! !L2aB89A8 9=+"9 :VE89 !!7.9,µ.¶°"9 :VE8$ Le2 µg- ! .(¶6.x" H. T& %,J.9B)P !3 0q" !q.q8 9B8 8 %,`V8 2 N / J89' !,°7+ J. H. T& %,bB8 8 %,V8 ! D Q / ° 8 %,°3C1 !..8$U :-(. µB~U¶A7E" YB2B ! :%.-9.'9 L?2! !L2B89A8 9=F"9 ;89 A VE89 !!7°)6 I %.8 I"9 c8 I'( .6 '98 !F!. L2XB = %,O[" JVE8 !I D Q / 3/C5.' ! ["9%)+I"9 -( !E .=. 5! !+VE89 A 1.9,. !L2D =.9 %,D ' 8 ..89 -$ L+G.;"9 .-JH9T& %,D-( L ; D Q / 7 G.+"9 Y" ! B ,9UH.'9. !!7 5aµ ¶A7 / 5µ 1¶+$, = 5aµS1¶A3 0/ # ! I"9bz|3 v.tD7xzvtD7R.9,Xr|&t¸.P" c" ="9 BbH. T& %, VE89 !R)6 :!. !A2aB8 8 !,°7 g3 .3 7.)6 : %VE8$&;" : = $;B8 8 !,lVE89 A2E7:G."9 57 /5.9, 5, . !7 !-( !A !L2E3xNe()P 1! _, W"9 6-*" ! 1-( L P "9 cH.9T 9=7R" *-( ! H= 6! !L2XB8 8 !,kVE89 A L)1!2b.'(U& #rz&tD7(.$,>.;"9 ="duvt Y" = 5Y, . °3]9F"9 VE89 A bH.9T %,@ @"9 cy Ba-9 . *"9 IB2B ! )1W.'9 6Y!. !A2I, A 9 P" P! !W89 6?7UQ !.B%7 r &t}.R"9 '98 !!3 P _, 9=I" Yy B6" ! VE89 !1 B "9 DH. T = 7 B 3~UtD7;\u 3 vt7;.$,Kuz3 rtw."9 >..8 !*)6 ! !L2M =9 !,>.;"9 Y" ! F, !3 C6"9 Y !8 P 9, %U Y"$U6"9 ;B2B ! 6!.-$'9 7BP. "9 c .71H.9T 9=J ky9Ba- .! *" *!. *VE8 2E3Z; 7 'E2` - 2l"9%)+ 9=/" d89 "9 [y BD" ! @VE89 ! f"9 H. T = 7E rz3 rtÃau&v.tÃ.("9 6 6" 189 Q)+ $'( +.' 1 ! !F" *! !a 3I¯W& @G.F"9 c.Q89I'( A6% ! )+"9 A [9.D;" >..89 !)+" M! !L2f =9 !,°7;, 8 J 8 !89LH. T =/-9- .H"R7+. > ! !..E' B !AJ ="E B Y'( > A8 9 !,°71)6 [, 89'( !%)F3o¯Q\-( !EI)+ L" "9 3 5,9UH.'$ I"9U #" %)+k-(E b !8 . 9L2[,89 "9 !o E ! . '( e)6 ! o" XU '98 k, .. 9!3 ]9 9BH9! 7R"9 #g.A#"9FE2[89 !F /U '98 4 : ./..8 !*D '98 6 @;T& >"9H, A*"9 DH.TO. , B 9=.89 "9 ='( ?)P ! !J" !M3 Cb 89 1"9 : !89L:= ! H %,c'2a" 1B898 %,IVE89 A . I'9 %,D'E2"9 bB2B !M7)6 !- 8 %,DI, # ?89 M5"9 ' 8 !+ M %A"[VE8 2E7 3 37iE2J.' ? !Y!EH 9=U %B YR" + 8 !P "9 YVE89 2c)1P 8 %,°35C6"9 .9B)P 6 A !.H 9!7U"9 A. .7&"9 x ! !..E%7%=. "9 R)+ L"F.E2 ! !..E:' B !!3WC6" P %)+68 WF !..89 1"9 1 hi & !9 .#.8 D !89LDH.9T 9=O=. L" M7Y)+" H"q"9.89 ,f'( @.' [ . =.dI"9 =" !B;!. FI" ! !..E+' B !3 C6"9 Y=.H-9"9 !P J]5 =8 ! 79v7$,Dz#" %)f"9 U H.=. - A ! o>"9 d !B>VE89 !J q" 3 57 / 5D$, 5 ,9UH.'9. 7 !-( ! & 2E3WC6" !8& '( ! %, ?]5 B: I"9%)+6"9 - ! .#G.5" x !89L5.' H. %,b)+"9 !F"9 Qy9B°H. T& %,aVE89 2
D8 I'( Z6 '98 ! DY89c'( F 2)6.H, ; ! !E .Q.'? ! -( AY.'? ! QVE89 ! -( AVE8 2 -( ;VE8 2 SPE.T ~!|&r7 |z m .| E3 mv ~&z3 r.v b ~.~%z7 )u m m .| E3 .v &m3 v.v ~.~%z7~.~%u z &m E3 mr ~%|7~%|z3 .m U xG M
W!
P!% W:PD$+RkR9!5 P!=P-J P!lf[ W
gkiP:Y Y.9T 5. L . ~!B ~B [$, ~!B 9, ÃmH, FUH.'$ S S S P. YV8 !aµt*¶ z.|3 v zv3 | r|3 | z&r3 |3 | &vE3 | r.z3 r &vE3 | u&vE3 | P. Y '98 !aµt*¶ r 3 | ~3 | r3 | r.z3 u3 u&vE3 v )3 ~ u E3 v uz3 r ' xG L M ;
W. i! $[$ W$
U
U W.% O` PP%G( S J
G= P*$5K9!
. J!= P:Y b..
Results for Query Processing 1
User First
0.95 0.9 Precision
D Q / Y89'9 L %,i3Q0/ F ! a"$U%7 G.F% !!7x~%|.|&tÂ.:. . !M. B)6 kµg 3 37#~%|.|&tw !% _¶D d !& %,i3 ]9J" 3 5, °7(" 8 ="[ L2[z|tÂ.Q"9 aVE89 A ;)P c. %71'(8 |&t^b"9 J' B !Al" J.-lb"9 DH.9T 9= U I ! !..E%7°)+"9 !Xv.|t¨.+Q" c ! !..EF.' ? !F)6 A I ! %,°3+] .;"9 /5;.$. , = 5Y, .. M- ! .d .L)1!2 '(U& #r.|tÂ)+" ![v|&t·.9,Mr|&tÂ.5" b ! !..E+' B !A;)P A & %,°7 !-( !A !L2E3 C6" Y8 & 1 .'( !G , G : a"9%)+W"9 1 !89LW)+"9 !"9 +8 c" VE89 2dM'( -E! ! %,9=J"9 *" *"9 =" !B H9T& !,DVE8 !6 D Q / 3QY 89L1 YI8 A" - U& !,°3x] .6" 3 5b,. °7$"9 aB2B !{ Y9%) '9 aD" %) - ! . 1'(8 #z.|&t{)+" !k.x"9 c b' B !F)P I !& !,°3 ] .a"9 /5F, °75- !! #.B~%|.|&t³" .89=."98 Y"9 MH9T& !,`. B)6 D %7;$,lG.D"90 = 5D, .. l" B2B !· Y.' b" %)n" F89 Yu.|&t ! !..E+' B !A!7$)+"9 ! r|&tÂ.x.R" ! !..M.' ? !+)6 b ! %,°3
0.85 0.8 0.75 0.7 0.65 0.6 0
10
20
30
40
50 60 Recall
70
80
90
100
Mb
=W& P%G(
U=W9J$ JRP$
Kn
JR
.R I GK J
U
U=PJ5GP*$
P:Y
Results for Query Processing 0.85
%U 6"$Q" ! 1%.I'( 6"9 =" L2I - U& !,#'E2#89 9= G. >, H'$. *V8 2[=3*C6" ! I !8 L!7" U)P !& F * _ .1G8 8 b)P.T(3
User First
0.8 0.75
Precision
0.7 0.65
7. CONCLUSIONS AND FUTURE WORK
0.6 0.55 0.5 0.45 0.4 0.35 0.3 0
10
20
30
40
50
60
70
80
90
100
Recall
ZMb
U= W& P%G(
UW.$D 9 J=Pe$
Kn
UJ
I G J
U
U=PJ5G P$
¦_P:Y C6" ! [..89 ! 9, % M"9%71 ..9L2K8 89LH.9T 9= BHU !=.2@ %)+F"9 #B2B !¨D"9%)Ã" c8 F2J ! !..E .' ? !!7° !& [ W ..L)1!2"9 a! !bV8 2J YA" !°7i'98 D"9%7$)+ L"@& 2J.589 Ab E H. .R7("9 #VE8$ e2M " 6 !89LQ%*'( 1"9 =" L2c W"9 : !89Lx"$UW)P8 _,c'( .' H %,'2.U)+ =I"9 ;89 Pc' 89 ,DaB89A8 %,DVE89 2E7& c89H"a. 6 .'( 89QH.T(35ZYL"9.89="#"9 P 89L5)6 1-(E G.b" 5Y, R7$. a- ! $2> \-( !E+ 9, L
N?*" W)P.T(7E)6 ;"$%& +- !E %,b9U& !$.-9-&A"*#.%) "9 cVE89 2 9=:0X !'d,9UH.'$ !F89 =D8 9B8 8 %,[VE8 !!7 g3 375VE89 A !.9B L8 %,[.9L2[.PT& 2)6H, !3bC6"9 c.-9-&A"@ '$ %,l.`kS6!2E ! .l9 e)6T, !g7P)+" A"K!c'9 9 * ! L , 9! FH.T !MG.¨.' ? !FU '98 ;- U , aB89A8 F "9 T& A2)P.H,e'9. %,k89 cVE89 2E3[9! *" B898 %,/VE89 2 M, 9 %,i7+ LM >8 '9 L %,KO.9 @.J. @,9UH.'$ !!3 ! b"9 F 89 %,D BY.Q !8 ;%M'( #V8 L F \ !9 & 7)6 .J- -(. *DS6!2E ! .@9 A?)6T[, !RDH9T>" # !8 L .!.H, =Ic" ! L;- '9.' L?2D5 B_2 =*"9 b8 19 ! %,!3 8 ;VE8 2B898 9=$,D 89L+H.9T 9=c, !+- U , [GH. A)6.Tk.V8 2 9=[0/ !'O, H'$. *"$%dµB~%¶I.%)+ "9 1G.I8 .RVE89 A :8 =#a 2I - + E g! Iµg.9 9=. W \5 %UA"a'(%\9¶A7µ ¶R %)+5" :8 :$1 9=. P E .! bVE8 2a.E2a89c'( 5(, hi A !EW,9H'$ !!7E$,µm&¶- U , ! "9 ; !89L+YaH. T& %, %7)+"9 " .' ? !+B1 T& !L2 . B)6 >"9 @89 [VE89 A2q k"9%)+oy9B%3·C6" ! /VE89. L .T D.8 c- .-(.1 , %.PG.VE8 2 =M0/ !'/,9H'$ !*89H" .1" F9 Y%.. .' F_· FB. !+.Y, =. LH. ' HU !!3 CD !Ba8a.- - &A"°7)P * -9 ! !E %,[D- .?2-( c0X !'
1
User First
0.95
Precision
0.9 0.85 0.8 0.75 0.7 0.65 0
10
20
30
40
50 60 Recall
70
L~A
! "$#% & '( FS - . %:ZÃE2B !·]9 F A2)P.H,?SP. %,[ %H" & +; ! 9. bH.'9. !!39N?* )H, ¤ +.-¢ /)H¤ ¢eAA¤$¡.¢g£.¤$¡ 0W.¤%%AA¤(®HI.¤M´a¡.¢2¡ 16@¤ .£G¤iAA£G@¤ @µ./ 3 7 6. L. 7 .|. | .¶A3 %54 678 9!:; =&?@A "B@CEDF6>GH9!I56="cdedeY !. 9=*'(8+C \8$° L?2 #0/ ' eS6. !,JN? >ZY!! ;2B !M39¹;¢.¤(.« E¹ EA¤9¢g«#¡¤(¬I¼d ¢g£gªg¹ EA¤9¢6½ .«¢eAcC« V&7R~*µB~%uu.u&¶A7$z&bv aTz3 zU5 #% f;"