As a case study, a Twitter network was visualized, where the .... it is possible to conclude that Lady Gaga is a friend of Messi and Messi is followed by both John ...
Available online at www.sciencedirect.com
ScienceDirect Procedia Computer Science 58 (2015) 113 – 120
6HFRQG,QWHUQDWLRQDO6\PSRVLXPRQ&RPSXWHU9LVLRQDQGWKH,QWHUQHW 9LVLRQ1HW¶
9LVXDOL]LQJVRFLDOQHWZRUNVXVLQJDWUHHPDSRYHUODLGZLWKDJUDSK 0LWKLOH\VK6DWKL\DQDUD\DQDQD 1LNROD\%XUOXWVNL\D D
6FKRRORI&RPSXWLQJ(QJLQHHULQJDQG0DWKHPDWLFV 8QLYHUVLW\RI%ULJKWRQ8.
$EVWUDFW ,Q WKH ODVW IHZ \HDUV VRFLDO QHWZRUNV KDYH UHDFKHG LWV KLJKHVWOHYHO RI FRPSOH[LW\ DQG VFDOH EXW WKHUH LV VWLOO D JDS LQKRZ WR UHSUHVHQWWKHVHQHWZRUNVWRDXVHUIRUH[SORUDWLRQDQGDQDO\VLV $VDUHVXOWLWLVRIWHQ FKDOOHQJLQJIRUDXVHUWRXQGHUVWDQGWKH UHODWLRQVKLSVLQWKHVRFLDOQHWZRUNVDQGPDNHDQLQIRUPHGGHFLVLRQRYHULW*UDSKVKDYHEHFRPHDVWDQGDUGIRUVRFLDOQHWZRUNV YLVXDOL]DWLRQDQGDQDO\VLV+RZHYHULQWKLVSDSHUDIHZYLVXDOL]DWLRQVEDVHGRQDWUHHPDSRYHUODLGE\DJUDSKZLWKDGLIIHUHQW QXPEHURIFXUYHVHGJHVDQGQRGHVZHUHGHVLJQHGDQGHYDOXDWHG$VDFDVHVWXG\D7ZLWWHUQHWZRUNZDVYLVXDOL]HGZKHUHWKH WUHHPDS RYHUODLG ZLWK D JUDSK FRQYH\HG LQIRUPDWLRQ RQ SHRSOH LQ D QHWZRUN WKHLU UHODWLRQVKLSV DQG FRPPRQ LQWHUHVWV 7KH SHUIRUPDQFHRIWKHWUHHPDSYLVXDOL]DWLRQVLQFOXGLQJWKHDFFXUDF\DQGWLPHRIDQVZHULQJTXHVWLRQVZDVHYDOXDWHGE\WZHQW\WKUHH SDUWLFLSDQWVLQFRPSDULVRQWRDQRWKHUZHOONQRZQYLVXDOL]DWLRQEDVHGRQ(XOHUGLDJUDP)LQDOO\WKHUHVXOWVRIWKHSHUIRUPDQFH HYDOXDWLRQOLPLWDWLRQVDQGXVHIXOQHVVRIWKHGHVLJQHGYLVXDOL]DWLRQVZHUHGLVFXVVHG 7KH$XWKRUV3XEOLVKHGE\(OVHYLHU%9 © 2015 The Authors. Published by Elsevier B.V. This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/). 3HHUUHYLHZXQGHUUHVSRQVLELOLW\RIRUJDQL]LQJFRPPLWWHHRIWKH6HFRQG,QWHUQDWLRQDO6\PSRVLXPRQ&RPSXWHU9LVLRQDQGWKH Peer-review under responsibility of organizing committee of the Second International Symposium on Computer Vision and the Internet ,QWHUQHW 9LVLRQ1HW¶ (VisionNet’15)
.H\ZRUGV 6RFLDOQHWZRUNYLVXDOL]DWLRQWUHHPDSV(XOHUGLDJUDPVJUDSKV
,QWURGXFWLRQ 6RFLDOQHWZRUNVKDYHEHHQDQLPSRUWDQWWRROIRUKXPDQFRPPXQLFDWLRQVLQFHWKHILUVWGD\VRIWKH,QWHUQHW7KHVH GD\VSHRSOHXVHVRFLDOQHWZRUNVLQWKHLUFRPPXQLFDWLRQHYHU\GD\)RUH[DPSOH)DFHERRN7ZLWWHU/LQNHG,QDQG ,QVWDJUDP DUH ZLGHO\ XVHG E\ SHRSOH DOO DURXQG WKH ZRUOG +RZHYHU WKH FRPSOH[LW\ DQG VFDOH RI WKHVH QHWZRUNV PRWLYDWHVSHRSOHWRGHVLJQYDULRXVYLVXDOL]DWLRQVIRUWKHH[SORUDWLRQRIGDWD>@)XUWKHUPRUHXVHUVKDYHWULHGWR
&RUUHVSRQGLQJDXWKRU7HO (PDLODGGUHVV 06DWKL\DQDUD\DQDQ#EULJKWRQDFXN
1877-0509 © 2015 The Authors. Published by Elsevier B.V. This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/). Peer-review under responsibility of organizing committee of the Second International Symposium on Computer Vision and the Internet (VisionNet’15) doi:10.1016/j.procs.2015.08.037
114
Mithileysh Sathiyanarayanan and Nikolay Burlutskiy / Procedia Computer Science 58 (2015) 113 – 120
YLVXDOL]HWKHLUGDWDXVLQJGLIIHUHQWYLVXDOL]DWLRQWRROVIRUH[DPSOHVXFKDV*RRJOH)XVLRQ7DEOHV,%00DQ\(\HV 6SRWILUH 9LVXDOL]LQJ VRFLDO QHWZRUNV LQYROYHV VXFK WDVNV DV WR FRQYH\ LQIRUPDWLRQ DERXW SHRSOH LQYROYHG LQ WKH QHWZRUNDQGWKHLUUHODWLRQVKLSV *UDSKVDUHDFRPPRQDQGSRZHUIXOWRROIRUVRFLDOQHWZRUNYLVXDOL]DWLRQ5HVHDUFKHUVKDYHLQYHVWLJDWHGDQGXVHG JUDSKVDVDYLVXDOL]DWLRQWRROIRUORQJWLPH>@$VDUHVXOWVHYHUDOJUDSKEDVHGOD\RXWVIRUGLIIHUHQWVRFLDOQHWZRUNV KDYH EHHQ SURSRVHG DQG GHYHORSHG > @ ,Q WKH VRFLDO QHWZRUN FRQWH[W HDFK QRGH RI D JUDSK FRUUHVSRQGV WR D SHUVRQRIDVRFLDOQHWZRUNDQGHDFKHGJHFRUUHVSRQGVWRDSDUWLFXODUUHODWLRQVKLSEHWZHHQWZRSHUVRQVUHSUHVHQWHG E\WKHQRGHV7KHPDLQDGYDQWDJHRIXVLQJJUDSKVIRUVRFLDOQHWZRUNYLVXDOL]DWLRQLVVFDODELOLW\VLPSOLFLW\DQG DQ H[LVWHQFHRIZHOOGHYHORSHGIRUPDOJUDSKWKHRU\IRUDQDO\VLVRIVRFLDOQHWZRUNV 'HVSLWH WKH SRZHU RI JUDSKV IRU VRFLDO QHWZRUN YLVXDOL]DWLRQ RWKHU YLVXDOL]DWLRQ W\SHV VKRZHG XVHIXOQHVV IRU VRFLDOQHWZRUNYLVXDOL]DWLRQIRUH[DPSOH9HQQRU(XOHUGLDJUDPVDQGWUHHPDSV> @8VLQJ9HQQGLDJUDPVIRU JUDSKLFDO UHSUHVHQWDWLRQ RI KLHUDUFKLFDO ILOH V\VWHPV ZDV SURSRVHG LQ >@ 3ODFHPHQW RI QRGHV RQ WKH SODQH LQVLGH 9HQQ FXUYHV DOORZHG XVHUV WR XVH SUR[LPLW\ EHWZHHQ FDWHJRULHV DQG ILOHV WR UHSUHVHQW FORVHQHVV DQG VLPLODULW\ $QRWKHUYLVXDOL]DWLRQW\SHWUHHPDSDOORZVYLVXDOL]LQJKLHUDUFKLFDOGDWD6HYHUDOYLVXDOL]DWLRQVKDYHEHHQSURSRVHG XVLQJWUHHPDSVIRUGLIIHUHQWFRQWH[WDQGDSSOLFDWLRQV)RULQVWDQFHLQ> @WKHDXWKRUVSURSRVHGXVLQJDWUHHPDSLQ VRFLDO QHWZRUN VHWWLQJV ,Q WKLV YLVXDOL]DWLRQ D UHFWDQJOH FRUUHVSRQGHG WR D SDUWLFXODU PRQWK DQG WKH VL]H RI WKH UHFWDQJOHZDVSURSRUWLRQDOWRWKHQXPEHURIHPDLOVVHQWE\WKHDFWRU +RZHYHU XVLQJ D JUDSK LQ FRPELQDWLRQ ZLWK RWKHU YLVXDOL]DWLRQ WHFKQLTXHV FDQ OHDG WR LPSURYHPHQW LQ XVHUV¶ SHUIRUPDQFHXVLQJWKHVHIXVHGYLVXDOL]DWLRQV,QGHHGVXFKYLVXDOL]DWLRQVDUHFDSDEOHWRYLVXDOL]HERWKVHWVDQGWKHLU HOHPHQWV)RULQVWDQFHWH[WDQDO\VLVPD\LQYROYHYLVXDOL]LQJERWKWKHNH\ZRUGVDQGWKHGRFXPHQWVWKH\EHORQJWR H[SORUDWLRQRISLFWXUHV PD\UHTXLUH YLVXDOL]LQJERWKLPDJHVDQGWKHLUWRSLFV$QRWKHUH[DPSOHLVDQDO\]LQJVRFLDO QHWZRUNV ZKHUH LW LV LPSRUWDQW WR YLVXDOL]H SHRSOH¶V QDPHV DQG WKH FRPPXQLWLHV WKH\ DUH DIILOLDWHG ZLWK )RU H[DPSOH LQ >@ WKH DXWKRUV SURSRVHG D FRPELQDWLRQ RI D JUDSK ZLWK ERXQGLQJ ER[HV LQ RUGHU WR LPSURYH WKH XQGHUVWDQGLQJ RI VRFLDO QHWZRUNV ,Q WKHLU YLVXDOL]DWLRQ HDFK UHFWDQJOH UHSUHVHQWHG DQ DFWRU ZKHUH WKH VL]H RI WKH UHFWDQJOHZDVSURSRUWLRQDOWRWKHQXPEHURIFRQQHFWLRQVRIWKHDFWRUWRRWKHUDFWRUV$YLVXDOL]DWLRQEDVHGRQ(XOHU GLDJUDPVZDVSURSRVHGDQGWKHQHYDOXDWHGLQ>@,QWKHLUSDSHUWKHDXWKRUVXVHGDFRPELQDWLRQRI(XOHUGLDJUDPV ZLWKJUDSKOLNHVWUXFWXUHVWRFRQYH\LQIRUPDWLRQ$VDFDVHVWXG\WKLVW\SHRIYLVXDOL]DWLRQZDVHYDOXDWHGXVLQJD VRFLDOQHWZRUNH[DPSOH7KHPDLQJRDORIWKHSDSHUZDVWRLPSURYHWKHUHDGDELOLW\RI(XOHUGLDJUDPVDQGHYDOXDWH WKHSHUIRUPDQFHRIWKHGHVLJQHGYLVXDOL]DWLRQV7KXVRWKHUUHVHDUFKHUVWULHGWRLGHQWLI\SURSHUWLHVWKDWPD\FRUUHODWH ZLWK HIIHFWLYH OD\RXWV RI (XOHU GLDJUDPV FRPELQHG ZLWK JUDSKV >@ ,Q >@ WKH DXWKRUV SURSRVHG XVLQJ D YLVXDOL]DWLRQ WHFKQLTXH WKDW GLVSOD\V WKH WUHH VWUXFWXUH DV D WUHHPDS DQG WKH FRQQHFWLRQ EHWZHHQ LWV UHFWDQJOHV E\ FXUYHGOLQNVRYHUODLGRQWKHWUHHPDS+RZHYHUWKHVHOLQNVVKRZHGFRQQHFWLRQRQO\EHWZHHQWKHUHFWDQJOHVEXWQRW WKHHOHPHQWVRIWKHUHFWDQJOHV2QFRQWUDU\ZHSURSRVHGXVLQJYLVXDOL]DWLRQZKHUHDWUHHPDSLVRYHUODLGE\DJUDSK DQG WKH HOHPHQWV RI WKH JUDSK EHORQJ WR D SDUWLFXODU UHFWDQJOH RI WKH WUHHPDS +RZHYHU WKH GHVLJQ RI VXFK YLVXDOL]DWLRQ ZDV QRW FRQFHUQHG WKRURXJKO\ DV ZHOO DV RQO\ XVHUV¶ SUHIHUHQFH ZDV HYDOXDWHG >@ $ JXLGHOLQH IRU FUHDWLQJUHFWDQJXODUWUHHPDS ZDV SURSRVHGLQ>@2QHRIWKHLPSRUWDQWVXJJHVWLRQVE\WKHDXWKRUV ZDVWRDYRLG H[WUHPHDVSHFWUDWLRVZKLFKZHXVHGLQGHVLJQLQJRXUWUHHPDSEDVHGYLVXDOL]DWLRQVLQWKLVSDSHU ,QWKLVSDSHUDQRYHOYLVXDOL]DWLRQIRUVRFLDOQHWZRUNVDWUHHPDSRYHUODLGZLWKDJUDSKLVGHVLJQHGDQGWKHQWKH SHUIRUPDQFH RI WKH GHVLJQHG YLVXDOL]DWLRQ LV HYDOXDWHG ,Q RXU GHVLJQ ZH YDU\ WKH QXPEHU RI UHFWDQJOHV LQ WKH WUHHPDSDVZHOODVWKHQXPEHURIQRGHVDQGHGJHVLQWKHJUDSKRYHUODLGZLWKWKHWUHHPDSLQRUGHUWRFRPSDUHWKH SHUIRUPDQFHRIGLIIHUHQW WUHHPDSVRYHUODLG ZLWK JUDSKV7KHSHUIRUPDQFHRIWKHVHWUHHPDSEDVHG YLVXDOL]DWLRQVLV HYDOXDWHGLQDQHPSLULFDO H[SHULPHQW)RUWKLVSXUSRVH ZHFRPSDUHWKH GHVLJQHGYLVXDOL]DWLRQVWR (XOHUGLDJUDP EDVHG YLVXDOL]DWLRQV ZKLFK VKRZHG XVHIXOQHVV DQG HIIHFWLYHQHVV LQ VRFLDO QHWZRUN YLVXDOL]DWLRQ > @ 7KH FRPSDULVRQLVGRQHIRUDGLIIHUHQWQXPEHURIFXUYHVQRGHVDQGHGJHVLQWKH(XOHUEDVHGYLVXDOL]DWLRQV 7KH DGGUHVVHG SUREOHP LQ WKLV SDSHU LV WR HYDOXDWH WKH SHUIRUPDQFH RI WKH QRYHO WUHHPDSEDVHG YLVXDOL]DWLRQ (LJKWHHQWUHHPDSEDVHGDQG(XOHUGLDJUDPEDVHGYLVXDOL]DWLRQVZHUHGHVLJQHGDQGWKHQFRPSDUHGE\WZHQW\ WKUHH SDUWLFLSDQWVLQDQHPSLULFDOHYDOXDWLRQ$WWKHHQGRIWKLVSDSHUWKHUHVXOWVIRUWKHHYDOXDWLRQRI D7ZLWWHUQHWZRUN YLVXDOL]DWLRQDUHGHPRQVWUDWHGDQGGLVFXVVHG
Mithileysh Sathiyanarayanan and Nikolay Burlutskiy / Procedia Computer Science 58 (2015) 113 – 120
115
6RFLDO1HWZRUN9LVXDOL]DWLRQ 3ULRU WR YLVXDOL]LQJ D VRFLDO QHWZRUN WKH PRVW FRPPRQ SUREOHPV SHRSOH HQFRXQWHU ZKHQ H[SORULQJ D VRFLDO QHWZRUNZHUHDQDO\]HG)RUWKLVSXUSRVHWKHOLWHUDWXUHRQYLVXDOL]DWLRQRIVRFLDOQHWZRUNVZDVVWXGLHG> @ $V D UHVXOW WZR JRDOV RI VRFLDO QHWZRUN YLVXDOL]DWLRQV ZHUH IRUPXODWHG ,Q RXU SDSHU ZH DVVXPHG WKDW D YLVXDOL]DWLRQRIVRFLDOQHWZRUNVHUYHVWKHIROORZLQJJRDOV>@ x ,GHQWLI\LQJWKHDFWRUVRIDQHWZRUN DXVHUQHHGVWRXQGHUVWDQGZKRWKHDFWRUVRIWKHQHWZRUNDUH,QRUGHU WRLGHQWLI\WKHDFWRUVRIWKHQHWZRUNWKHDFWRUVPXVWEHHDVLO\GLVWLQJXLVKDEOHDQGFRXQWDEOH8VXDOO\DQ DFWRULVUHSUHVHQWHGDVDQRGHDFLUFOHRUDUHFWDQJOHLQYLVXDOL]DWLRQEXWWKHUHDUHPDQ\RWKHUZD\VWRPDS DFWRUVWRJUDSKLFDOSULPLWLYHVRIYLVXDOL]DWLRQ x 8QGHUVWDQGLQJUHODWLRQVKLSVLQDQHWZRUN DXVHUFDQEHGLUHFWHGWRZDUGDQDQVZHUUHJDUGLQJWKHZD\LQ ZKLFKKHRUDSHUVRQRIKLVLQWHUHVWLVFRQQHFWHGWRSHRSOHLQWKHQHWZRUNE\SURYLGLQJWKHXVHUZLWK YLVXDOL]DWLRQVZKHUHUHODWLRQVKLSVEHWZHHQSHRSOHLQWKHQHWZRUNDUHUHSUHVHQWHGH[SOLFLWO\)RUH[DPSOH DQHGJHRUDQLQWHUVHFWLRQFDQEHDYLVXDOUHSUHVHQWDWLRQRIVXFKUHODWLRQVKLS ,QWKLVSDSHUWKHSHUIRUPDQFHRIYLVXDOL]DWLRQVIRUDVRFLDOQHWZRUNZDVFRQVLGHUHGUHJDUGLQJWRWKHWZR DIRUHPHQWLRQHGJRDOV 7UHHPDSVDQG(XOHUGLDJUDPIRUYLVXDOL]DWLRQRIVRFLDOQHWZRUNV ,QWKLVZRUNDWUHHPDSRYHUODLGE\DJUDSK 70* ZDVGHVLJQHGIRUYLVXDOL]DWLRQRIVRFLDOQHWZRUNVDQGWKHQLW ZDVFRPSDUHGWRDQ(XOHUGLDJUDPRYHUODLGE\DJUDSK ('* $VDFDVHVWXG\IRUYLVXDOL]DWLRQRIVRFLDOQHWZRUNV D 7ZLWWHU QHWZRUN ZDV FKRVHQ $Q (XOHU GLDJUDP DQG D WUHHPDS ZHUH DXJPHQWHG E\ JUDSKV IRU FRQYH\LQJ LQIRUPDWLRQRQSHRSOHLQWHUHVWVLQWKHLUQHWZRUN7KHGHVLJQDQGVHPDQWLFVRIWKHGLDJUDPVDUHGLVFXVVHGEHORZ (XOHUGLDJUDPVUHSUHVHQWUHODWLRQVKLSEHWZHHQFXUYHV$QRYHUODSRIWKHFXUYHVUHSUHVHQWVDUHODWLRQVKLSEHWZHHQ WKHFXUYHVZKLOHQRRYHUODSUHSUHVHQWVDEVHQFHRIDUHODWLRQVKLSEHWZHHQWKHFXUYHV$QH[DPSOHRI(XOHUGLDJUDP LQ D VRFLDO QHWZRUN VHWWLQJ LV VKRZQ LQ )LJXUH D ,Q WKLV FDVH HDFK FXUYH UHSUHVHQWV DQ DFWRU DQG WKH RYHUODSV EHWZHHQWKHFXUYHVUHSUHVHQWIULHQGVKLSUHODWLRQVKLSV 7UHHPDSVYLVXDOL]HKLHUDUFKLFDOWUHHVWUXFWXUHGGDWDDVDVHWRIQHVWHGUHFWDQJOHV VHH)LJXUHE (DFKUHFWDQJOH RQDWUHHPDSFRUUHVSRQGVWRDEUDQFKRIDWUHH$OVRHDFKUHFWDQJOHWLOHGZLWKVPDOOHUUHFWDQJOHVUHSUHVHQWLQJVXE EUDQFKHV RI WKH WUHH ,Q WKLV ZRUN D FRPPRQ ERXQGDU\ EHWZHHQ UHFWDQJOHV LQ D WUHHPDS UHSUHVHQWV D UHODWLRQVKLS EHWZHHQWKHUHFWDQJOHVDQDORJRXVO\WRDQRYHUODSRIWKHFXUYHVLQ(XOHUGLDJUDPV,QWKHFDVHRID7ZLWWHUQHWZRUN HDFKUHFWDQJOHUHSUHVHQWVDQDFWRUDQGWKHH[LVWHQFHRIDFRPPRQERXQGDU\EHWZHHQWZRUHFWDQJOHVFRUUHVSRQGVWR DIULHQGVKLSUHODWLRQVKLSEHWZHHQWKHVHWZRDFWRUVUHSUHVHQWHGDVUHFWDQJOHV 1H[W VWHS LQ WKH GHVLJQ RI WKH SURSRVHG YLVXDOL]DWLRQ D WUHHPDS ZDV RYHUODLG ZLWK QRGHV DV D UHVXOW WKH YLVXDOL]DWLRQZDVH[WHQGHGWRFRPPXQLFDWHPRUHLQIRUPDWLRQ,QFDVHRID7ZLWWHUQHWZRUNWKHQRGHVLQDIRUPRI WH[W FRUUHVSRQG WR LQWHUHVWV RI WKH DFWRUV UHSUHVHQWHG DV UHFWDQJOHV LQ WKH YLVXDOL]DWLRQV )RU H[DPSOH WZR DFWRUV -RKQDQG/XNHDUHIULHQGVVLQFHWKHUHFWDQJOHVUHSUHVHQWLQJWKHPKDYHDFRPPRQHGJH VHH)LJXUHE $OVRLWFDQ EHLQKHULWHGIURPWKHGLDJUDPWKDW-RKQOLNHVPRYLHVDQGFULFNHWZKHWKHU/XNHLVIRQGRIVRFLDOQHWZRUNVFKRFRODWH )RUPXODDQGFULFNHW7KHLQWHUHVWVZULWWHQLQWKHUHFWDQJOHVVKRZFRPPRQLQWHUHVWVIRUERWK-RKQDQG/XNHZKLFK LVFULFNHW$QDORJLFDOO\WRWKHWUHHPDSZLWKQRGHVLQ)LJXUHEDQ(XOHUGLDJUDPZLWKQRGHVFDQEHXVHGWRFRQYH\ SHRSOH VLQWHUHVW )LJXUHD )LQDOO\ WKH WUHHPDS ZDV RYHUODLG E\ D JUDSK 70* IRU YLVXDOL]DWLRQ RI VHWV UHFWDQJOHV HOHPHQWV QRGHV UHODWLRQVKLS EHWZHHQ HOHPHQWV HGJHV DQG UHODWLRQVKLS EHWZHHQ VHWV FRPPRQ ERXQGDULHV $Q DQDORJRXV (XOHU GLDJUDPRYHUODLGE\DJUDSK ('* LVVKRZQLQ)LJXUHDZKHUHWKHFXUYHVUHSUHVHQWDFWRUVDQGWKHLUUHODWLRQVKLSV DQGWKHQRGHVLQVLGHWKHFXUYHVUHSUHVHQWSHUVRQDOLWLHVIROORZHGE\WKHDFWRUV7KHSHUVRQDOLWLHVDUHLQWHUFRQQHFWHG E\OLQNV)RUH[DPSOH-RKQLVDIULHQGRI/XNHZKRIROORZV/DG\*DJD)XUWKHUPRUHIURPWKHDXJPHQWHGGLDJUDP LWLVSRVVLEOHWRFRQFOXGHWKDW/DG\*DJDLVDIULHQGRI0HVVLDQG0HVVLLVIROORZHGE\ERWK-RKQDQG/XNH±WKLV FDQEHDFFRPSOLVKHGE\IROORZLQJWKHHGJHVEHWZHHQWKHSHUVRQDOLWLHV%RWKYLVXDOL]DWLRQVLQ)LJXUHFRPPXQLFDWH WKH VDPH LQIRUPDWLRQ DERXW DFWRUV FHOHEULWLHV WKH\ IROORZ DQG FRQQHFWLRQV EHWZHHQ WKH FHOHEULWLHV +RZHYHU FRPPRQSHUVRQDOLWLHVIRU('*DUHUHSUHVHQWHGLQLQWHUVHFWLRQRIWKHFXUYHVZKHUHDVWKHFRPPRQSHUVRQDOLWLHVIRU
116
Mithileysh Sathiyanarayanan and Nikolay Burlutskiy / Procedia Computer Science 58 (2015) 113 – 120
)LJXUH(XOHUGLDJUDP D DQG7UHHPDS E
)LJXUH(XOHUGLDJUDP D DQG7UHHPDS E ZLWKQRGHV
)LJXUH('* D DQGWKHGHVLJQHG70* E
Mithileysh Sathiyanarayanan and Nikolay Burlutskiy / Procedia Computer Science 58 (2015) 113 – 120
70* DUH GXSOLFDWHG 7KLV IDFW JDYH XV D K\SRWKHVLV WKDW ORRNLQJ IRU FRPPRQ SHUVRQDOLWLHV LQ 70* ZRXOG WDNH ORQJHUWLPHVLQFHLWUHTXLUHVVHDUFKLQJIRUWKHGXSOLFDWLRQV ,QRUGHUWRHYDOXDWHWKH SHUIRUPDQFHRIWKHSURSRVHGWUHHPDSEDVHGGLDJUDP 70* DVZHOODVWRFRPSDUHLWV SHUIRUPDQFHZLWK(XOHUGLDJUDPEDVHGYLVXDOL]DWLRQ ('* DWKUHHOHYHOHYDOXDWLRQZLWKWZHQW\WKUHHSDUWLFLSDQWV ZDVFRQGXFWHG7KHGHVLJQDQGSURFHVVRIWKHHYDOXDWLRQLVLQWKHQH[WVHFWLRQ (YDOXDWLRQ 7KHJRDORIWKHGHVLJQHGHYDOXDWLRQZDV 7RHYDOXDWHDQGFRPSDUHWKHWDVNSHUIRUPDQFHRIWKHSURSRVHG70*ZLWKWKHWDVNSHUIRUPDQFHRI('* DQG 7RHYDOXDWHWKHLPSDFWRIWKHQXPEHURIFXUYHVUHFWDQJOHVSUHVHQFHRIQRGHVHGJHVLQ70*DQG('* YLVXDOL]DWLRQRQWKHLUSHUIRUPDQFH 7RIRUPXODWHDQGXQGHUVWDQGOLPLWDWLRQVRI70*LQYLVXDOL]LQJVRFLDOQHWZRUNVDQHPSLULFDOVWXG\ZDVGHVLJQHG %RWK WUHHPDS DQG (XOHU GLDJUDP YLVXDOL]DWLRQV UHSUHVHQW WKH VDPH LQIRUPDWLRQ 7KH VWXG\ LV D FRQWUROOHG RQH FRQGXFWHGZLWKLQDJURXSWRHYDOXDWHWKHSHUIRUPDQFHRI7UHHPDSZLWKJUDSKDQG(XOHUGLDJUDPVZLWKJUDSKWKHQ WZHQW\ WKUHH SDUWLFLSDQWV ZHUH UDQGRPO\ VHOHFWHG IURP WKH VWXGHQWV RI WKH 8QLYHUVLW\ RI %ULJKWRQ DW &RPSXWLQJ (QJLQHHULQJDQG0DWKHPDWLFVGHSDUWPHQW$OOWKHSDUWLFLSDQWVZHUHFRPSXWHUOLWHUDWHV(LJKWHHQRIWKHSDUWLFLSDQWV ZHUH PDOHILYH IHPDOHDQGWKHLUDJHYDULHGIURPWR \HDUV ZLWK\HDUVDVWKHPHDQYDOXHIRUWKHLUDJH 0RVWRIWKHSDUWLFLSDQWVKDYHQRWVHHQVXFKGLDJUDPVLQWKHILHOGRIVRFLDOQHWZRUNDQDO\VLVWKRXJKWKH\KDYHKHDUG DERXW(XOHUGLDJUDPVDQG9HQQGLDJUDPVEXWQRW7UHHPDSV (DFKSDUWLFLSDQWZDVWDNHQWRWKHXVDELOLW\ODEDQGZDVWUDLQHGZLWKVDPSOHGLDJUDPV ERWK(XOHUDQG7UHHPDS W\SHV PXOWLSOHFKRLFHTXHVWLRQW\SHVRSWLRQVDQGWKHVRIWZDUH,QWKH8QLYHUVLW\RI%ULJKWRQZHKDYHDGHGLFDWHG XVDELOLW\ODEIRUFRQGXFWLQJVWXGLHV7KHURRPKDGDJRRGYHQWLODWLRQXSJUDGHGFRPSXWHUDQGDFRPIRUWDEOHFKDLU VRWKDWDOOSDUWLFLSDQWVXVHWKHVDPHFRPSXWHULQWKHODE:HXVHGDVRIWZDUHGHYHORSHGE\$QGUHZ%ODNHFDOOHGDV 5HVHDUFK9HKLFOH
ZKHUH GLDJUDPVDORQJ ZLWKTXHVWLRQVDQGRSWLRQVFRXOGEH ORDGHGWRFDWFK UHVSRQVH WLPH DQG HUURUVFRPPLWWHGE\SDUWLFLSDQWVGXULQJWKHVWXG\7KHTXHVWLRQVZHUHUDQGRPL]HGZKLFKKDGDPL[RI(XOHUEDVHG GLDJUDPVDQG7UHHPDSEDVHGGLDJUDPVWRDYRLGOHDUQLQJHIIHFW7RIXUWKHUUHGXFHWKLVHIIHFWSDUWLFLSDQWVZHUHJLYHQ DSSURSULDWH WUDLQLQJEHIRUH WKH\VWDUWHG ZLWKWKH PDLQVWXG\ XVLQJWKH VRIWZDUH$OVRWRDYRLGGLDJUDPHIIHFW ZH FRQVLGHUHGFHUWDLQOHYHOVRIFRPSOH[LW\VXFKDVFXUYHVQRGHVDQGHGJHVVRWKDWSDUWLFLSDQWVVSHQG VXIILFLHQWWLPHLQUHDGLQJDQGXQGHUVWDQGLQJWKHGLDJUDPV 'LDJUDP&KDUDFWHULVWLFV )RU(XOHUEDVHGGLDJUDPV ZH XVHG FLUFOHVRI YDULRXVVL]HVDQGIRU7UHHPDSEDVHGGLDJUDPV ZHXVHG UHFWDQJOHVRIYDULRXVVKDSHV &XUYHFRORUVZHUHUDQGRPO\SLFNHGZLWKRXWDQ\SULRULW\RURUGHUVRWKDWHDFKFXUYHZDVGLVWLQFWLQERWK (XOHUGLDJUDPVDQG7UHHPDSV &XUYHODEHOVZHUHSODFHGDVFORVHDVSRVVLEOHWRWKHFXUYHVLQERWK(XOHUGLDJUDPVDQG7UHHPDSV 1RGHVZHUHGLVWULEXWHGUDQGRPO\DQGHGJHVFRQQHFWLQJWKHPZHUHUDQGRPWRR :H HQVXUHG (XOHU GLDJUDP DQG 7UHHPDS FXUYHV UHSUHVHQWHG VHW SURSHUWLHV VXFK DV FRQWDLQPHQW GLVMRLQWQHVVDQGLQWHUVHFWLRQ 4XHVWLRQ7\SHV )RUHYDOXDWLRQRIWKHSURSRVHGWUHHPDSEDVHGYLVXDOL]DWLRQZHVHOHFWHGWKUHHWDVNVIRFXVLQJRQVHWVQRGHVDQG WKHLUUHODWLRQVKLSV)RUHDFKWDVNSDUWLFLSDQWVKDGWRDQVZHUWKHIROORZLQJTXHVWLRQV
117
118
Mithileysh Sathiyanarayanan and Nikolay Burlutskiy / Procedia Computer Science 58 (2015) 113 – 120
&RXQWLQJLQWHUVHFWLRQVFRPPRQERXQGDULHV +RZPDQ\FRQQHFWLRQV$GDPKDV" ,GHQWLI\LQJQRGHV :KDWDUHWKHFRPPRQLQWHUHVWVEHWZHHQ$GDPDQG/XNH" ,GHQWLI\LQJQRGHVE\IROORZLQJHGJHV :KDWDUHWKHFRPPRQSHRSOH$GDPDQG/XNHDUHIROORZLQJ" )RUWKHILUVWW\SHRITXHVWLRQVDSDUWLFLSDQWKDGWRILQGDFXUYHRUDUHFWDQJOHFRUUHVSRQGLQJWRDQDFWRU7KHQD SDUWLFLSDQWLGHQWLILHGKRZPDQ\LQWHUVHFWLRQVWKHFXUYHKDGRUKRZPDQ\FRPPRQERXQGDULHVWKHUHFWDQJOHKDG)RU WKH VHFRQG W\SH RI TXHVWLRQV D SDUWLFLSDQW KDG WR LGHQWLI\ QRGHV LQ LQWHUVHFWLRQV RI FXUYHV RU LQ UHFWDQJOHV FRUUHVSRQGLQJWRSDUWLFXODUDFWRUV)LQDOO\WKHODVWW\SHRITXHVWLRQVUHTXLUHGDSDUWLFLSDQWWRIROORZHGJHVRIQRGHV LQFXUYHVRUUHFWDQJOHV 9DU\LQJFXUYHVQRGHVDQGHGJHV 7KHQXPEHURIUHFWDQJOHVDQGFXUYHVIRUWUHHPDSVDQG(XOHUGLDJUDPVFRUUHVSRQGLQJO\YDULHGIURPIRXUWRVL[ DQGWKHQHLJKWFXUYHVDQGUHFWDQJOHV VHH)LJXUHV $OVRWKHFRPSOH[LW\RIWKHYLVXDOL]DWLRQVKDGWKUHHOHYHOV WKH ILUVW OHYHO LQFOXGHG RQO\ SXUH (XOHU GLDJUDPV DQG WUHHPDSV VHH )LJXUH WKH VHFRQG OHYHO LQFOXGHG (XOHU GLDJUDPVDQGWUHHPDSVZLWKQRGHVLQVLGHWKHFXUYHVDQGUHFWDQJOHV VHH)LJXUH DQGWKHWKLUGOHYHOFRPSULVHGWKH GHVLJQHG70*ZLWK('*IRUFRPSDULVRQ VHH)LJXUH 1LQH WUHHPDS GLDJUDPV LQFOXGLQJ GLDJUDPV ZLWK IRXU VL[ DQG HLJKW UHFWDQJOHV RI WKH WKUHH FRPSOH[LW\ OHYHOV DORQJZLWKWKHQLQHDQDORJRXV(XOHUGLDJUDPVZHUHUDQGRPO\VKRZQWRWKHSDUWLFLSDQWV,QWRWDOGLDJUDPVZHUH SUHVHQWHGWRWKHSDUWLFLSDQWV 7DEOH5HVXOWVIRU7UHHPDSDQG(XOHUYLVXDOL]DWLRQV &RQILJXUDWLRQ
7UHHPDS
(XOHU'LDJUDPV
0 (
6G (
0 7
6G 7
0 (
6G (
0 7
6G 7
)RXUFXUYHV
6L[FXUYHV
(LJKWFXUYHV
)RXUFXUYHVQRGHV
6L[FXUYHVQRGHV
(LJKWFXUYHVQRGHV
)RXUFXUYHVQRGHVHGJHV
6L[FXUYHVQRGHVHGJHV
(LJKWFXUYHVQRGHVHGJHV
$YHUDJHIRUDOOYLVXDOL]DWLRQ
5HVXOWV 7KH UHVXOWV IRU SDUWLFLSDQWV XVLQJ WKH YDULDWLRQV RI WUHHPDSV DORQJ ZLWK WKH YDULDWLRQV RI (XOHU GLDJUDP YLVXDOL]DWLRQVDUHVKRZQLQ7DEOHZKHUH0 ( LVWKHPHDQYDOXHIRUWKHHUURUDQG6G ( LVDVWDQGDUGGHYLDWLRQIRU WKH HUURU )RU DFFXUDF\ SHUIRUPDQFH ZH XVHG WWHVW LQ RUGHU WR GHWHUPLQH ZKHWKHU WKHUH ZDV DQ\ VWDWLVWLFDOO\ VLJQLILFDQW GLIIHUHQFH LQ DFFXUDF\ SHUIRUPDQFH EHWZHHQ XVLQJ WUHHPDSEDVHG YLVXDOL]DWLRQV DQG (XOHUEDVHG YLVXDOL]DWLRQV$VDUHVXOWWWHVWGLGQRWUHYHDODQ\VLJQLILFDQWGLIIHUHQFHEHWZHHQWUHHPDSVDQG(XOHUGLDJUDPV DW DQ\RIWKHWKUHHOHYHOV 7KH DFFXUDF\ IRU (XOHU GLDJUDPV ZDV VOLJKWO\ KLJKHU WKDQ WKH DFFXUDF\ RI WUHHPDSV 1HYHUWKHOHVV RXW RI SDUWLFLSDQWV PDGH PRUH PLVWDNHV XVLQJ ('*V RXW RI SDUWLFLSDQWV PDGH PRUH PLVWDNHV XVLQJ 70*V DQG
Mithileysh Sathiyanarayanan and Nikolay Burlutskiy / Procedia Computer Science 58 (2015) 113 – 120
SDUWLFLSDQWVPDGHWKHVDPHRUQRPLVWDNHVXVLQJWKHYLVXDOL]DWLRQV7KXVWKHSDUWLFLSDQWVSHUIRUPHGZLWKWKHVDPH DFFXUDF\XVLQJ70*VRU('*VLQWHUPVRIWKHQXPEHURIPLVWDNHVSHUYLVXDOL]DWLRQW\SH 7KHUHVXOWVIRUWKHUHVSRQVHWLPHDUHVKRZQLQ7DEOHZKHUH 0 7 LVWKHPHDQYDOXHIRUWKHUHVSRQVHWLPHDQG 6G 7 LV D VWDQGDUG GHYLDWLRQ 7KHUH LV QR PXFK GLIIHUHQFH LQ UHVSRQVH WLPH EHWZHHQ WKH GHVLJQHG YLVXDOL]DWLRQV 7DEOH EXWZHXVHGDQDO\VLVRIYDULDQFH $129$ LQRUGHUWRUHYHDODQ\VWDWLVWLFDOO\VLJQLILFDQWGLIIHUHQFHVLQWKH UHVSRQVH WLPHV XVLQJ WKH GHVLJQHG YLVXDOL]DWLRQV $V ZDV H[SHFWHG $129$ GLG QRW UHYHDO DQ\ VLJQLILFDQW GLIIHUHQFHEHWZHHQWKHWZRYLVXDOL]DWLRQW\SHV1HYHUWKHOHVVZLWKLQFUHDVHLQWKHFRPSOH[LW\RIWKHYLVXDOL]DWLRQV LQWHUPVRIWKHQXPEHURIFXUYHVRUUHFWDQJOHVQRGHVDQGHGJHV WKHUHVSRQVHWLPHLQFUHDVHGDVZHOO2QRYHUDOO WUHHPDSVVKRZHGEHWWHUUHVSRQVHWLPHRI FRPSDUHGWR IRU('*)XUWKHUPRUH RXWRISDUWLFLSDQWV DQVZHUHGIDVWHUXVLQJWUHHPDSVFRPSDUHGWR RXWRISDUWLFLSDQWVZKRSHUIRUPHGIDVWHUXVLQJ(XOHUGLDJUDPV 'LVFXVVLRQDQG)XWXUH:RUN 7RRXUVXUSULVHDQRYHUODLGWUHHPDSVKRZHGDOPRVWWKHVDPHSHUIRUPDQFHDVDQRYHUODLG(XOHUGLDJUDPVLQWHUPV RIERWKDFFXUDF\DQGWLPHSHUIRUPDQFH(YHQPRUHSDUWLFLSDQWVVKRZHGSUHIHUHQFHWR(XOHUGLDJUDPVRYHUWUHHPDS EDVHGYLVXDOL]DWLRQVLQWKLVHYDOXDWLRQGHVSLWHWKHIDFWWKDWWUHHPDSVVKRZHGWKHVDPHDFFXUDF\DQGVOLJKWO\EHWWHU WLPHSHUIRUPDQFH(YHQWKRXJKWKHGLIIHUHQFHLQWLPHSHUIRUPDQFHLVQRWVLJQLILFDQWLQDEVROXWHYDOXHVWKHQXPEHU RISDUWLFLSDQWVZKRDQVZHUHGTXHVWLRQVIDVWHUXVLQJWUHHPDSEDVHGYLVXDOL]DWLRQVRXWRISDUWLFLSDQWVLVPRUH WKDQODUJHUWKDQWKHQXPEHURISDUWLFLSDQWVZKRDQVZHUHGIDVWHUXVLQJ(XOHUEDVHGYLVXDOL]DWLRQVMXVW RXWRI SDUWLFLSDQWV7KLVLVDSURPLVLQJUHVXOWIRUIXUWKHUUHVHDUFK LQFRPELQLQJWUHHPDSVZLWKJUDSKV,QDGGLWLRQWKH GHVLJQHG70*UHTXLUHGVPDOOHUDUHDFRPSDUHGWR('*WKHLQIOXHQFHRIWKLVSDUDPHWHUPXVWEHDGGUHVVHGLQIXUWKHU VWXGLHV )RUWKHIXWXUH ZRUNLWLVSODQQHGWR HODERUDWHRQWKHGHVLJQRIDWUHHPDSRYHUODLGZLWKDJUDSK+RZHYHULWLV UHTXLUHGWRLQFOXGHLQWHUDFWLRQLQWKHYLVXDOL]DWLRQLQRUGHUWRSRSXODUL]HWKHYLVXDOL]DWLRQDVDWRROIRUVRFLDOQHWZRUN DQDO\VLV1HYHUWKHOHVVIXVLRQRIGLIIHUHQWYLVXDOL]DWLRQVW\OHVEDVHGRQWUHHPDSDQGJUDSKLVWKHPDLQUHVHDUFKJRDO IRUWKHIXWXUHVLQFHLWFDQVSDUNHIILFLHQF\RIVRFLDOQHWZRUNYLVXDOL]DWLRQ&XUUHQWVRFLDOQHWZRUNYLVXDOL]DWLRQVDUH PRVWO\ EDVHG RQ VLQJOH JUDSKV VLQFH WKH JUDSKV DUH DEOH WR PDQDJH PLOOLRQV RI QRGHV 7KH PDLQ LVVXH RI IXVLQJ JUDSKV ZLWK WUHHPDSV DQG (XOHU GLDJUDPV LV LQ VFDODELOLW\ WKXV LW LV QHFHVVDU\ WR DGGUHVV WKLV LVVXH LQ IXUWKHU UHVHDUFK 7KLVZRUNFDQEHFRQVLGHUHGDVDSHUIRUPDQFHHYDOXDWLRQIRUWKHQRYHOW\SHRIVRFLDOQHWZRUNYLVXDOL]DWLRQEDVHG RQDFRPELQDWLRQRIDWUHHPDSDQGDJUDSK,QWKHQH[WVWXG\LWLVSODQQHGWRFRQVLGHUGLIIHUHQWOD\RXWVWRSRORJLFDO SURSHUWLHVDQGDHVWKHWLFSURSHUWLHVIRUHYDOXDWLQJWKHVHYLVXDOL]DWLRQV $FNQRZOHGJHPHQWV :HVLQFHUHO\WKDQN$QGUHZ%ODNHRI8QLYHUVLW\RI%ULJKWRQ8.IRUSURYLGLQJXVKLVRZQVRIWZDUH
5HVHDUFK 9HKLFOH
WRFRQGXFWWKLVHPSLULFDOVWXG\ 5HIHUHQFHV ' 9HQROLD DQG & 1HXVWDHGWHU 8QGHUVWDQGLQJ VHTXHQFH DQG UHSO\ UHODWLRQVKLSV ZLWKLQ HPDLO FRQYHUVDWLRQV $ 0L[HGPRGHO YLVXDOL]DWLRQ 0LFURVRIW5HVHDUFK7HFK5HS06575-DQXDU\ 0$6PLWK DQG$7)LRUH9LVXDOL]DWLRQ FRPSRQHQWVIRUSHUVLVWHQWFRQYHUVDWLRQV,Q3URFHHGLQJVRIWKH6,*&+,&RQIHUHQFH RQ+XPDQ )DFWRUVLQ&RPSXWLQJ6\VWHPVSS± 6-RYLFLF5ROHRIPHPRU\LQHPDLOPDQDJHPHQW,Q&+,¶([WHQGHG$EVWUDFWVRQ+XPDQ)DFWRUVLQ&RPSXWLQJ6\VWHPVS± 1%XUOXWVNL\03HWULGLV$)LVKDQG1$OL(QDEOLQJWKHYLVXDOL]DWLRQIRUUHDVRQLQJDERXWWHPSRUDOGDWD,Q,(((6\PSRVLXPRQ9LVXDO /DQJXDJHVDQG+XPDQ&HQWULF&RPSXWLQJ 9/+&& S ± ,+HUPDQ*0HODQoRQDQG06FRWW0DUVKDOO*UDSKYLVXDOL]DWLRQDQGQDYLJDWLRQLQLQIRUPDWLRQYLVXDOL]DWLRQ D6XUYH\,QIRUPDWLRQ 9LVXDOL]DWLRQS
119
120
Mithileysh Sathiyanarayanan and Nikolay Burlutskiy / Procedia Computer Science 58 (2015) 113 – 120 0%DVWLDQ6+H\PDQQDQG0-DFRP\*HSKL $QRSHQVRXUFHVRIWZDUHIRUH[SORULQJDQGPDQLSXODWLQJQHWZRUNV7KLUG,QWHUQDWLRQDO$$$, &RQIHUHQFHRQ:HEORJVDQG6RFLDO0HGLD 0 6PLWK % 6KQHLGHUPDQ 1 0LOLF)UD\OLQJ ( 5RGULJXHV 9 %DUDVK & 'XQQH 7 &DSRQH $ 3HUHU DQG ( *OHDYH $QDO\]LQJ VRFLDO PHGLD QHWZRUNV ZLWK 1RGH;/ ,Q & 7 3URFHHGLQJV RI WKH )RXUWK ,QWHUQDWLRQDO &RQIHUHQFH RQ &RPPXQLWLHV DQG 7HFKQRORJLHV 6SULQJHU 'H&KLDUD5 (UUD8 6FDUDQR99(11)6 D9HQQGLDJUDPILOHPDQDJHU,QIRUPDWLRQ9LVXDOL]DWLRQ S 7/)UDQW]DQG.0&DUOH\7UHHPDSVDVDWRROIRUVRFLDOQHWZRUNDQDO\VLVS 6 &KDWXUYHGL & 'XQQH = $VKNWRUDE 5 =DFKDULDK DQG % 6KQHLGHUPDQ *URXSLQDER[ PHWDOD\RXWV IRU WRSRORJLFDO FOXVWHUV DQG DWWULEXWHEDVHGJURXSV 6SDFHHIILFLHQWYLVXDOL]DWLRQVRIQHWZRUNFRPPXQLWLHVDQGWKHLUWLHV&RPSXWHU*UDSKLFV)RUXP 5LFKH1+ 'Z\HU78QWDQJOLQJ(XOHUGLDJUDPV,(((7UDQVDFWLRQVRQ9LVXDOL]DWLRQDQG&RPSXWHU*UDSKLFVYROQRS 06DWKL\DQDUD\DQDQ*6WDSOHWRQ - %XUWRQ DQG - +RZVH3URSHUWLHVRI(XOHUGLDJUDPVDQGJUDSKVLQFRPELQDWLRQ,Q,(((6\PSRVLXP RQ9LVXDO/DQJXDJHVDQG+XPDQ&HQWULF&RPSXWLQJ 9/+&& S± -' )HNHWH ' :DQJ 1 'DQJ $ $ULV DQG & 3ODLVDQW 2YHUOD\LQJ JUDSK OLQNV RQ 7UHHPDSV ,((( 6\PSRVLXP RQ ,QIRUPDWLRQ 9LVXDOL]DWLRQ ,1)29,6 S± 06DWKL\DQDUD\DQDQ1%XUOXWVNL\'HVLJQDQGHYDOXDWLRQRI(XOHUGLDJUDPDQG7UHHPDSIRUVRFLDOQHWZRUNYLVXDOLVDWLRQWK,QWHUQDWLRQDO &RQIHUHQFHRQ&RPPXQLFDWLRQ6\VWHPV 1HWZRUNVS 1 .RQJ - +HHU 0 $JUDZDOD 3HUFHSWXDO *XLGHOLQHV IRU &UHDWLQJ 5HFWDQJXODU 7UHHPDSV ,((( 7UDQVDFWLRQV RQ 9LVXDOL]DWLRQ DQG &RPSXWHU*UDSKLFVYROQRS
