semantics of Approximate Answers in Cooperative Database systems

3 downloads 5262 Views 85KB Size Report
Chair of Control, Robotics and Computer Science, Poznan University of Technology, ... Next generation of database systems is intended to integrate information from .... q, {[Idemp : x,, salary : y,] | z, eMP,(Idemp : x,, salary : y,, Job : z,) Ъ y, 25k},.
6HPDQWLFVRI$SSUR[LPDWH$QVZHUV LQ&RRSHUDWLYH'DWDEDVH6\VWHPV 7DGHXV]3DQNRZVNL &KDLURI&RQWURO5RERWLFVDQG&RPSXWHU6FLHQFH3R]QDQ8QLYHUVLW\RI7HFKQRORJ\ 3R]QDQ3RODQGSDQNRZVN#VROSXWSR]QDQSO $EVWUDFW,Q WKH SDSHU ZH GLVFXVV WKH SUREOHP RI DSSUR[LPDWH DQVZHUV WR TXHULHV LQ FRRSHUDWLYH GDWDEDVH V\VWHPV &'%6  &'%6 JLYH DSSUR[LPDWH DQVZHUV ZKHQ H[DFW DQVZHUVDUHHPSW\RUXQDYDLODEOHDQGSURYLGHVXPPDU\DQVZHUVZKHQDQVZHUVHWVDUH WRRODUJH>@$QDSSUR[LPDWHDQVZHULVDQDQVZHUFRUUHVSRQGLQJWRDUHOD[HGYHUVLRQ RI WKH TXHU\7KHUHOD[DWLRQ LV REWDLQHG E\ PHDQVRI UHSODFHPHQWRI HTXDOLW\UHODWLRQ E\DSDUWLDORUGHULQJUHODWLRQ LQ³FKLOGVHPDQWLFV´ RUE\SDUWLDOSUHRUGHULQJUHODWLRQ LQ³QHLJKERUVHPDQWLFV´ 7KHRWKHUW\SHRIUHOD[DWLRQGLVFXVVHGLQWKHSDSHUFRQVLVWV LQLQWURGXFLQJSDUWLDORUGHULQJLQWRVHWRITXHULHV7KXVLQVWHDGRIHYDOXDWLQJRULJLQDO TXHU\DTXHU\VXEVXPLQJLW PRUHJHQHUDO PD\EHHYDOXDWHG

 ,QWURGXFWLRQ

,Q FRQYHQWLRQDO GDWDEDVH V\VWHPV D TXHU\ ZULWWHQ LQ D IRUPDO TXHU\ ODQJXDJH LV DF FHSWHGHYDOXDWHGDJDLQVWDGDWDEDVHDQGWKHFRPSOHWHVHWRIWXSOHVVDWLVI\LQJ WKHTXHU\ WKH DQVZHU VHW  LV UHWXUQHG ,Q &'%6 WKLV TXHU\DQVZHU SDUDGLJP LV DXJPHQWHG WR DOORZ WKH V\VWHPWR UHOD[ D TXHU\ LQVRPHFDVHV HJZKHQDTXHU\ IDLOV 7KHQDQDSSUR[LPDWHDQ VZHUPD\EHSURYLGHG5HOD[DWLRQRIDTXHU\PD\FRQVLVWLQUHZULWLQJLWLQWRDVHWRIPRUH JHQHUDO³UHODWHG´TXHULHV>@ ,Q WKH SDSHU ZH GLVFXVV DSSUR[LPDWH DQVZHUV WKURXJK UHOD[DWLRQ RI VHPDQWLFV RI WKH XQGHUO\LQJTXHU\ODQJXDJH,QSDUWLFXODUZHSURSRVHD³ZHDNHU´LQWHUSUHWDWLRQRIWKHV\P ERO³ ´LQDWRPLFIRUPXODV,QVWHDGRIHTXDOLW\WKHV\PEROPLJKWEHLQWHUSUHWHGDVDSDUWLDO RUGHULQJ UHODWLRQ LQ ³FKLOG VHPDQWLFV´  RU DV SDUWLDO SUHRUGHULQJ UHODWLRQ LQ ³QHLJKERU VHPDQWLFV´ 1H[WZHLQWURGXFHVXEVXPSWLRQ EHWZHHQUHODWLRQQDPHVDQGDWWULEXWHVDVGD WDEDVH FRQVWUDLQWV 7KLV DOORZV LQWURGXFLQJ VXEVXPSWLRQ RQ GDWDEDVH TXHULHV WKXV LQVWHDG RIHYDOXDWLQJRULJLQDOTXHU\DTXHU\VXEVXPLQJLW PRUHJHQHUDO PD\EHHYDOXDWHGE\WKH V\VWHP 6XFKDSSURDFK LV RIVSHFLDOLPSRUWDQFHZKHQDFFHVVWRUHODWLRQVRFFXUULQJLQWKH RULJLQDOTXHU\LVUHVWULFWHGWRWKHXVHURUZKHQUHODWLRQVUHSUHVHQWVHPDQWLFDOO\DPELJXRXV LQIRUPDWLRQ IURP KHWHURJHQHRXV GDWDEDVHV >@ :H EDVHG RXU FRQVLGHUDWLRQV RQ VROLG PDWKHPDWLFDO IRXQGDWLRQV IURP PDQ\W\SHG ILUVW RUGHU ODQJXDJHV DQG IURP WKH WKHRU\ RI SDUWLDORUGHULQJV>@ 1H[W JHQHUDWLRQRIGDWDEDVHV\VWHPVLVLQWHQGHGWRLQWHJUDWHLQIRUPDWLRQIURPGLIIHUHQW KHWHURJHQHRXVGDWDEDVHVEHORQJLQJWRDFRRSHUDWLYHIHGHUDWHGGDWDEDVHV\VWHP7KHKHWHUR JHQHLW\RIGDWDPD\EHFRQVLGHUHGDWWZROHYHOVRIDEVWUDFWLRQ  GDWDPRGHOKHWHURJHQHLW\ ± GDWDEDVHV\VWHPVPD\XVHGLIIHUHQWGDWDPRGHODQG  VHPDQWLFKHWHURJHQHLW\ ± GDWDEDVH V\VWHPVPD\DJUHHRQDGDWDPRGHOEXWWKH\PD\KDYHLQGHSHQGHQWVSHFLILFDWLRQVRIGDWD 7KLV LV D VRXUFH RI KHWHURJHQHLW\ EHFDXVH PRVW GDWD PRGHOV RIIHU PDQ\ GLIIHUHQW ZD\VWR GHVFULEHWKHVRPHRUVLPLODULQIRUPDWLRQ

,Q RUGHU WR UHVROYH VHPDQWLF KHWHURJHQHLW\ LQ GDWDEDVHV JHQHUDOL]DWLRQ RI GDWD PD\ EH DSSOLHG$VWKHUHVXOWRIWKHJHQHUDOL]DWLRQGDWDKHWHURJHQHRXVDWDORZOHYHORIDEVWUDFWLRQ EHFRPH KRPRJHQRXV DW KLJKHU OHYHO >@ 7KXV LQ WKH SURFHVV RI TXHU\ HYDOXDWLRQ LI WKH H[DFWDQVZHUGRHVQRWH[LVWZHFDQXVHGDWDIURPGLIIHUHQWOHYHOVRIJHQHUDOL]DWLRQ LQRUGHU WRREWDLQDQRQHPSW\ DSSUR[LPDWHDQVZHU 7KHSDSHULVRUJDQL]HGDVIROORZV6HFWLRQIRUPDOL]HVDGDWDPRGHODQGDODQJXDJHLQ ZKLFKTXHULHVFDQEHH[SUHVVHG7KHIRUPDOVHPDQWLFVRIWKHODQJXDJHSURYLGHVWKHZD\IRU REWDLQLQJ H[DFW DQVZHUV WR WKH TXHULHV ,Q 6HFWLRQ  ZH GLVFXVV WKUHH DSSURDFKHV WR DS SUR[LPDWHDQVZHULQJ7ZRRIWKHPDUHEDVHGRQUHOD[HG DSSUR[LPDWH VHPDQWLFVXVLQJWKH IDFWWKDWDWRPLFFRQVWDQWVLQWKHGRPDLQPD\EHSDUWLDOO\RUGHUHG7KHWKLUGPHWKRGDGGL WLRQDOO\DVVXPHVSDUWLDORUGHULQJRQDWWULEXWHVDQGUHODWLRQQDPHV 6HFWLRQFRQFOXGHVWKH SDSHU ([DFWDQVZHUV

/HW' EHDVHWRIDWRPLFFRQVWDQWV DQG$ EHDVHWRIDWWULEXWHV7KHUHODWLRQDOXQLYHUVH RYHU' DQG$ LVWKHOHDVWVHW55 VXFKWKDW  ' Ž 5 

 $Q\WXSOHU >$ D$Q DQ @ 5 DWXSOHLVDVHWRISDLUV $D $  $D  ' $VDTXHU\ODQJXDJHZHDVVXPHWKHPXOWLW\SHGGRPDLQUHODWLRQDOFDOFXOXV '5&  DILUVW RUGHUODQJXDJHRIWKHUHODWLRQXQLYHUVH55 7\SHV RI'5& DUH W  8 _>$ 8$Q 8 @8 ± WKHDWRPLFW\SH>$ 8$Q 8 @± DWXSOHW\SH $OSKDEHWRI'5& FRQVLVWVRI  $WRPLFFRQVWDQWVDDRIW\SH8 DQGDWRPLFYDULDEOHV [[RIW\SH8  5HODWLRQQDPHV55HDFKQDPH5 LVRIDWXSOHW\SHW  (TXDOLW\   /RJLFDOV\PEROV™š›Ÿ :HOOIRUPHGIRUPXODVRI'5& W  D _[ ± DWRPLFWHUPV X  >$ W$Q WQ @± WXSOH WHUPV RIW\SH>$ 8$Q 8 @  D  W W¶ _5 X ± DWRPLFIRUPXODV M  D _M š M¶_[M  FRQMXQFWLYHIRUPXODV T  ^X _M`± FRQMXQFWLYHTXHULHV 6HPDQWLFVRI'5& LVGHWHUPLQHGE\LWVLQWHUSUHWDWLRQ , , D  ' , 5 ± DILQLWHVXEVHWRIWXSOHVRIW\SHWZKHUH5 LVDUHODWLRQQDPHRIW\SHW DQGE\WKHVDWLVIDFWLRQ RIIRUPXODV  ,Z _ [ D œ Z [  , D   ,Z _ [ \ œ Z [  Z \   ,Z _ 5 $ [$Q [Q œ >$ Z [ $Q Z [Q @ , 5   ,Z _ M š \ œ ,Z _ M DQG ,Z _ \  ,Z _ [M œ WKHUHLVD VXFKWKDW ,Z>[D@ _ M ZKHUHZ ; o 'LVDYDOXDWLRQRIYDULDEOHVZ>[D@LVDYDOXDWLRQLGHQWLFDOWRZ VXFKWKDW Z [  D ([DFWDQVZHU WRDTXHU\ E\LQWHUSUHWDWLRQ,  ^X _M` ,  ^Z X _ ,Z _ M`

$SSUR[LPDWHDQVZHUV

0DQ\UHVHDUFKHV KDYH EHHQLQWHUHVWHGLQFRRSHUDWLYHDQGDSSUR[LPDWHDQVZHULQJ>@ :HH[SORUHWZRWHFKQLTXHV³FKLOG´DQG³QHLJKERU´VHPDQWLFVIURPDIRUPDOSRLQWRIYLHZ DQG SURSRVH D QHZDSSURDFK WR GHILQH SDUWLDORUGHULQJ VXEVXPSWLRQ  RQ TXHULHV RQERWK WKH\ V\QWD[DQGDQVZHUV  )XUWKHURQZHDVVXPHWKDW 'd LVDSDUWLDOO\RUGHUHGVHWRIDWRPLFFRQVWDQWVDQGWKHUH DUHKLHUDUFKLHVLQ' IRUPLQJURRWHGGLUHFWHGWUHHV &KLOGVHPDQWLFV

,QWKH³FKLOGVHPDQWLFV´HYHU\DWRPLFIRUPXODRIWKHIRUP[ D LV VDWLVILHGQRWRQO\E\ YDOXDWLRQVPDSSLQJ[ RQDEXWDOVRE\YDOXDWLRQVPDSSLQJ[ RQDQ\³FKLOG´RID LQWKHKL HUDUFK\)RUPDOO\WKHWZRILUVWUXOHVLQWKHGHILQLWLRQRIVDWLVIDFWLRQDUHUHIRUPXODWHG  ,Z _  [ D œ , D d Z [   ,Z _  [ \ œ Z \ d Z [  DQGLQUXOHVWKHV\PERO_ LVUHSODFHGZLWK_  $QVZHU WRDTXHU\ZLWKUHVSHFWWR_  E\LQWHUSUHWDWLRQ,  ^X _M` ,  ^Z X _ ,Z _  M` ([DPSOH $VVXPHWKDWLQWKHVHWRIDWRPLFFRQVWDQWVWKHKLHUDUFK\+ VKRZQLQ)LJ D  KDV EHHQLGHQWLILHG/HW5 EHDUHODWLRQQDPHRIW\SH>$8%8&8@ZKLFKLQVWDQFH , 5 LVGHSLFWHGLQ)LJ E  +

, 5 $   

D E G

H

F I

J D

K M

L

% [ \ ]

& L I N

E

N

)LJ

7KHQWKHH[DFWDQVZHUWRWKHTXHU\ T ^>$[%\@_] 5 $[%\&] š ] F` LVHPSW\%XWDSSO\LQJWKHFKLOGVHPDQWLFVZHREWDLQ^>$%[@>$%]@`„ 1HLJKERUVHPDQWLFV

,QRUGHUWRGHILQHWKH³QHLJKERUVHPDQWLF´IRUHYHU\HOHPHQW YHUWH[ RIWKHKLHUDUFK\+ ZHGHILQHLWVGHSWK GHSWK D  LID LVDURRW GHSWK D  GHSWK D¶ LID¶ LVWKHSDUHQWRID )RU WZR HOHPHQWV D DQG D¶ EHORQJLQJ WR WKH VDPH SDWKV D d D¶ WKH GLVWDQFH EHWZHHQ WKHPLVJLYHQE\WKHIXQFWLRQ GLVW DD¶  GHSWK D¶  GHSWK D 

)RUHYHU\D  +WKHVHWRIDQFHVWRUV RIDRIGHJUHHQRWJUHDWHUWKDQL LVGHILQHGDV DQFL D  ^D¶  + _GLVW D¶D d L` 7KHPHHW … RID D¶  + LVWKHLUSDUHQWLHD … D¶ D´ LID´ LVWKHSDUHQWRID DQGD¶ WKHJUHDWHVWORZHUERXQGRID DQGD¶ LQWKHPHDQVRIWKHODWWLFHWKHRU\ >@ 7KHIROORZLQJELQDU\UHODWLRQZLOOEHXVHGLQGHILQLWLRQRIQHLJKERUVHPDQWLFV D dL D¶ œ GHSWK D d GHSWK D¶ š D … D¶  DQFL D  ,QWXLWLYHO\LID dL D¶ WKHQD¶ LVDQHLJKERURIGHJUHHQRWJUHDWHUWKDQL RID1RWHWKDWIRUL  ZHKDYHWKHFKLOGUHODWLRQVKLS,WFDQEHSURYHQWKDWdL LVDSDUWLDOSUHRUGHULQJUHODWLRQ LHLWLVUHIOH[LYHDQGWUDQVLWLYHEXWQRWDQWV\PPHWULF>@ 7KHRUHP /HW +d EHDSDUWLDOO\RUGHUHGDQGWUHHVWUXFWXUHGVHWRIFRQFHSWV7KHQWKH ELQDU\UHODWLRQdL LVDSDUWLDOSUHRUGHULJUHODWLRQRQ+„ )RUWKHKLHUDUFK\LQ)LJZHKDYHHJHd [ IRU[  ^GHI`DQGHd [ IRUHYHU\[  ^GHIJKLMN` 7KHUXOHIRUHYDOXDWLQJTXHULHVLQWKHQHLJKERUVHPDQWLFVLV ^X _M` ,  ^Z X _ ,Z _ L M` ZKHUH  ,Z _ L [ D œ , D dL Z [   ,Z _ L [ \ œ Z \ dL Z [  DQGUXOHVDUHPRGLILHGDFFRUGLQJO\ 7KHDSSOLFDWLRQRIWKHQHLJKERUVHPDQWLFVWRWKHTXHU\IURPH[DPSOHJLYHV T ,  ^>$%[@>$%]@` QHLJKERUKRRGRIGHJUHHQRWJUHDWHUWKHQ  T ,  ^>$%[@>$%\@>$%]@` QHLJKERUKRRGRIGHJUHHQRWJUHDWHUWKHQ  6XEVXPSWLRQRQTXHULHV

,Q VRPH FDVHV RULJLQDO UHODWLRQV DUH QRW DYDLODEOH WR WKH XVHU RU WKH\ DUH VHPDQWLFDOO\ KHWHURJHQHRXV 6RJHQHUDOL]HG UHODWLRQVGHULYHGIURPRULJLQDORQHVVKRXOGEHXVHG1RZ ZHH[WHQGRXUPRGHODVIROORZV  :HDVVXPHWKDWWKHVHW$ RIDWWULEXWHVLVSDUWLDOO\RUGHUHG6RWKHVHW $d$ LVFRQVLG HUHGLQWKHGHILQLWLRQRIWKHUHODWLRQDOXQLYHUVH55$GGLWLRQDOO\ZHDVVXPHWKDWWKHUHLVD GLVWLQJXLVKHGDWWULEXWH8VXFKWKDW8 d$ $IRUHYHU\$ (J6DODU\&DWHJRU\d$ 6DODU\  7XSOHVLQ55 DUHSDUWLDOO\RUGHUHG,IUDQGU¶ DUHWXSOHVWKHU dN U¶LII  $ D  U $¶ D¶  U¶$ d $¶ š D d D¶ (J >,G(PS6DODU\&DWHJRU\BN@dN >,G(PS6DODU\N-RE&ODUN@  7KHUH DUH LQWHJULW\ FRQVWUDLQWV VWDWLQJ VXEVXPSWLRQV EHWZHHQ UHODWLRQ QDPHV VXFKFRQ VWUDLQWLVDQH[SUHVVLRQRIWKHIRUP5 d5 5¶7KHVDWLVIDFWLRQRIWKHVXEVXPSWLRQ5 d5 5¶ LQWKHGDWDEDVHVWDWH, LVGHILQHGDV , _ 5 d5 5¶ œ U  , 5 U¶  , 5¶ U d N U¶ š U¶  , 5¶ U  , 5 U d N U¶ (J, _ (03d5 (03¶LI, LVGHILQHGLQWKHIROORZLQJWDEOHV , (03 ,G(PS  

6DODU\&DWHJRU\ BN BN

, (03¶ ,G(PS 6DODU\  N  N

-RE &ODUN 'RFWRU

 (YHU\YDULDEOHLQDTXHU\KDVDW\SH LQGXFHGE\LWVRFFXUUHQFHLQWKHTXHU\ WLOOQRZDOO YDULDEOHVZHUHDVVXPHGWREHRIWKHVDPHW\SH8  W\SH [  LI WKHUHLVDWHUPX LQTVXFKWKDW $ [  X WKHQ $ HOVH 8 (J)RUWKHTXHU\ ^>$[%\&]@_ YZ 5 $['Y š \ Y š ] Z š Z D ` W\SH [  $W\SH \  &W\SH ]  &W\SH Y  'W\SH Z  8 :HFDQGHILQHDSDUWLDORUGHULQJd(RQFRQMXQFWLYHTXHULHVRI'5& D d( D¶ œ , D d , D¶  [ d( [¶ œ W\SH [ d$ W\SH [¶  X d( X¶ œ  $ W  X $¶ W¶ $ d$ $¶ š W d( W¶ W W d( W¶ W¶ œ W d( W¶ š W d( W¶ 5 X d( 5¶ X¶ œ 5 d5 5¶ š X d ( X¶ š MMQ d( š \\QN œ Ld L d QML d( \L [ M d( \ \ œ [  [ \  \ [ d( \ š M d( \ ^X _M`d( ^X¶ _M¶`œ X d( X¶ š M d( M¶

7KXVLQDSSUR[LPDWHDQVZHULQJWKHTXHU\ T¶ ^>,G(PS[¶6DODU\\¶@_ ]¶ (03¶ ,G(PS[¶6DODU\\¶-RE]¶ š \¶ N` PLJKWEHUHSODFHGZLWK T ^>,G(PS[6DODU\&DWHJRU\\@_(03 ,G(PS[6DODU\&DWHJRU\\ š \ BN` VLQFH T d( T¶

7KHRUHP /HWT ^X _M`EHDFRQMXQFWLYHTXHU\LQ'5&7KHQE\DQ\LQWHUSUHWDWLRQ, KROG T , Ž T ,  T , L Ž T , LL t  0RUHRYHU T d( T¶ Ÿ T , d6 T¶ ,  ZKHUH 4 d6 4¶ œ U¶  4¶U  4U d N U¶ 3URRI 7KHWKHRUHPIROORZVIURPWKHIDFWWKDWFRQMXQFWLYHTXHULHVDUHPRQRWRQLF &RQFOXVLRQV

$SSUR[LPDWH DQVZHUV WR TXHULHV LQ &'%6 PDNH WKH V\VWHPV HDV\ WR XVH DQG PRUH LQ IRUPDWLYH$SSUR[LPDWHDQVZHULQJLQ&'%6LVXVHIXORUQHFHVVDU\DWOHDVWLQWKHWZRIRO ORZLQJFDVHV  7KH H[DFW DQVZHU WR D TXHU\ LV HPSW\ DQG WKH WD[RQRPLF RUJDQL]DWLRQ RI VRPH EDVLF FRQFHSWVDOORZVXVWRXVHRQHRIWKHUHOD[HGVHPDQWLFV FKLOGRUQHLJKERUVHPDQWLFV   $PXOWLOHYHORUJDQL]DWLRQRIGDWDEDVHLVXVHGLQRUGHUWRUHVROYHVHPDQWLFKHWHURJHQHLW\ LQ &'%6 7KH PXOWLOHYHO GDWDEDVH LV FUHDWHG DFFRUGLQJ WR JHQHUDOL]DWLRQ RI UHODWLRQ QDPHVDWWULEXWHVDQGDWRPLFFRQVWDQWVUHIOHFWLQJWKHVHPDQWLFVRIGDWD ,QWKHSDSHUZHDGGUHVVERWKRIWKHDERYHSUREOHPV7KHUHUHPDLQVPXFKWRGRLQWKH ILHOGRIDSSUR[LPDWHDQGFRRSHUDWLYHDQVZHULQJ6RPHIXUWKHUUHVHDUFKLQFOXGHV

 $SSUR[LPDWH VHPDQWLFV IRU RWKHU GDWD PRGHOV REMHFWRULHQWHG VHPLVWUXFWXUHG GHGXF WLYH  ,QWHJUDWLRQ RI KHWHURJHQHRXV LQIRUPDWLRQ VWRUHG QRW RQO\ LQ FRQYHQWLRQDOGDWDEDVHV EXW DOVRLQILOHV\VWHPVWKH:HEDQGOHJDF\V\VWHPV5HVHDUFKFRQFHUQZUDSSHUV DQGPH GLDWRUV LQVXFKV\VWHPVZKLFKFRQYHUWGDWDIURPHDFKVRXUFHLQWRDFRPPRQPRGHODQG DOVRSURYLGHDFRPPRQTXHU\ODQJXDJH  ([SODQDWLRQRIKRZDQGZK\DSSUR[LPDWHDQVZHUVZHUHGHULYHG:LWKRXWDQH[SODQDWLRQ LWLVKDUGWRHVWLPDWHXVHIXOQHVVRIWKHDQVZHU 5HIHUHQFHV

>@ &KX::&KHQ41HLJKERUKRRGDQG$VVRFLDWLYH4XHU\$QVZHULQJ-RXUQDORI,QWHOOLJHQW6\VWHPV SS >@ *DDVWHUODQG7 *RGIUH\3 0LQNHU - $Q RYHUYLHZ RI FRRSHUDWLYH DQVZHULQJ-RXUQDORI,QWHOOLJHQW,Q IRUPDWLRQ6\VWHPV   SS >@ *RGIUH\ 3 0LQNHU - 1RYLN / $Q $UFKLWHFWXUH IRU D &RRSHUDWLYH 'DWDEDVH 6\VWHP$SSOLFDWLRQV RI 'DWDEDVHV HGV:/LWZLQ75LVFK /HFWXUH1RWHVLQ&RPSXWHU6FLHQFHSS >@ +DQ - HW DO 'HDOLQJ ZLWK 6HPDQWLF +HWHURJHQHLW\ E\ *HQHUDOL]DWLRQ%DVHG 'DWD 0LQLQJ 7HFKQLTXHV &RRSHUDWLYH,QIRUPDWLRQ6\VWHPV7UHQGVDQG'LUHFWLRQV$FDGHPLF3UHVVSS >@ /OR\G-:)RXQGDWLRQVRI/RJLF3URJUDPPLQJ6SULQJHU9HUODJ%HUOLQ >@ 0LQRFN 0- &KX :: ([SODQDWLRQ IRU &RRSHUDWLYH ,QIRUPDWLRQ 6\VWHPV )RXQGDWLRQ RI ,QWHOOLJHQW 6\VWHPV HGV=:5D00LFKDOHZLF] /HFWXUH1RWHVLQ$UWLILFLDO,QWHOOLJHQFHSS  >@ 3DQNRZVNL73RZHUGRPDLQRI3DWKIRU5HSUHVHQWLQJ2EMHFW6WUXFWXUHV)XQGDPHQWD,QIRUPDWLFDH    SS >@ 3DQNRZVNL73RGVWDZ\ED]GDQ\FK )RXQGDWLRQVRI'DWDEDVHV 6FLHQWLILF3XEOLVKLQJ3:1:DUV]DZD  LQ3ROLVK  >@ 3DQNRZVNL 7 3DUWLDO 2UGHULQJV RQ 5HODWLRQV DQG 4XHULHV LQ &RRSHUDWLYH 'DWDEDVH 6\VWHPV 7HFKQLFDO 5HSRUW&KDLURI&RQWURO5RERWLFVDQG&RPSXWHU6FLHQFH387 LQ3ROLVK