Equating Translated Verbal Test Forms Using Multiple Channels Avi ...

(TXDWLQJ7UDQVODWHG9HUEDO7HVW)RUPV 8VLQJ0XOWLSOH&KDQQHOV

$YL$OODORXIDQG-RHO5DSS

1DWLRQDO,QVWLWXWHIRU7HVWLQJDQG(YDOXDWLRQ1,7( -HUXVDOHP,VUDHO

3DSHUSUHVHQWHGDWWKHDQQXDOPHHWLQJRIWKH 1DWLRQDO&RXQFLORQ0HDVXUHPHQWLQ(GXFDWLRQ

DV SDUW RI DQ 1&0( V\PSRVLXP RQ WHVW DGDSWDWLRQV 1HZ2UOHDQV/$$SULO

$EVWUDFW )RU D JURZLQJ QXPEHU RI WHVW WUDQVODWLRQV WKHUH LV D QHHG IRU HTXDWLQJ ZKLFK SURYLGHV VFRUHV WKDW FDQ EH XVHG LQWHUFKDQJHDEO\ IRU ERWK VRXUFH DQG WDUJHW ODQJXDJH IRUPV 7KH EDVLF HTXDWLQJ UHTXLUHPHQWV FRPPRQ LWHPV DQGRU FRPPRQ  FDQQRW XVXDOO\ EH PHW LQ WKH FURVVOLQJXDO FDVH DQG HVSHFLDOO\ LQ YHUEDO WHVWV ,Q WKLV VWXG\ WZR HTXDWLQJ FKDQQHOV LQ DGGLWLRQWRWKHSRSXODUFRPPRQLGHQWLFDOLWHPVPHWKRGWKDWXVHVRQO\WKHQRQ',)WUDQVODWHG LWHPV LQ WKH DQFKRU &KDQQHO   ZHUH SURSRVHG XVLQJ QRQYHUEDO WUDQVODWHG LWHPV DV DQ H[WHUQDO  DQFKRU &KDQQHO   DQG XVLQJ DQ LQWHUQDO ZLWKLQODQJXDJH HTXDWLQJ FKDQQHO &KDQQHO $OOWKUHHHTXDWLQJFKDQQHOVZHUHGHVFULEHGLQGHWDLODQGZHHODERUDWHGRQWKH H[SHULHQFHDFTXLUHGDQGWKHVWXGLHVFRQGXFWHGDWWKH,VUDHOL1DWLRQDO,QVWLWXWHIRU7HVWLQJDQG (YDOXDWLRQ 1,7(  7KH WKUHH FKDQQHOV ZHUH HYDOXDWHG E\ D QXPEHU RI FULWHULD WKHRUHWLFDO EDFNJURXQGVWDELOLW\RIWKHHTXDWLQJSURFHVVDFFXUDF\LQPHDVXULQJWKHDELOLW\DQGGULIWRYHU WLPH7ZRSRVVLELOLWLHVIRULPSOHPHQWDWLRQDUHVXJJHVWHGD WRFRQWLQXHWRXVHWKHYHUEDO DQFKRUDVLWKDVDVWURQJHUWKHRUHWLFDOEDVLVDQGWRXVHWKHWZRRWKHUFKDQQHOVIRUPRQLWRULQJ SXUSRVHVDQGE WRZHLJKWWKHRXWFRPHVRIDOOWKUHHPHWKRGVDFFRUGLQJWRDQHVWLPDWLRQRI WKHDSSURSULDWHQHVVRIHDFKRIWKHPHWKRGV



(TXDWLQJ7UDQVODWHG9HUEDO7HVW)RUPV 8VLQJ0XOWLSOH&KDQQHOV

,QWKHJURZLQJILHOGRIWHVWWUDQVODWLRQVWKHUHLVDQLQFUHDVHGQHHGIRUHTXDWLQJZKLFK SURYLGHVVFRUHVWKDWFDQEHXVHGLQWHUFKDQJHDEO\IRUERWKVRXUFHDQGWDUJHWODQJXDJHIRUPV ,QDQ\HTXDWLQJEHWZHHQWZRWHVWIRUPVDWOHDVWRQHRIWZRHOHPHQWVLVUHTXLUHGD FRPPRQ LGHQWLFDOLWHPVDQDQFKRU RQWKHWZRIRUPVWKDWUHSUHVHQWWKHIRUPVDQGE FRPPRQ H[DPLQHHVRQWKHWZRIRUPV+RZHYHULQWKHFURVVOLQJXDOFDVHDQGHVSHFLDOO\LQYHUEDO WHVWVWKHVHUHTXLUHPHQWVXVXDOO\FDQQRWEHPHWGXHWRWKHIROORZLQJD WKHWUDQVODWHGLWHPV DUHQRWLGHQWLFDOWRWKHVRXUFHODQJXDJHLWHPVEHFDXVHWUDQVODWLRQKDVDQLPSDFWRQLWHP FRQWHQWDQGDVDUHVXOWRQWKHSV\FKRPHWULFFKDUDFWHULVWLFVRIWKHWUDQVODWHGLWHPVDQGE QRH[DPLQHHVFDQEHFRQVLGHUHGWRKDYHWKHVDPHDELOLW\LQERWKODQJXDJHVZKLFKPHDQVWKDW WKHUHDUHQR³FRPPRQH[DPLQHHV´ ,QVRPHFDVHVRIWHQEHFDXVHHTXDWLQJLVSUREOHPDWLFWKHOLQNDJHEHWZHHQWKHVRXUFH DQGWUDQVODWHGWHVWIRUPVLVDFFRPSOLVKHGE\UHO\LQJRQDVSHFLILFDVVXPSWLRQZKLFKPD\ EHLQDFFXUDWHUHJDUGLQJWKHUHODWLRQEHWZHHQSRSXODWLRQDELOLWLHVRUIRUPGLIILFXOWLHVIRU H[DPSOHUHO\LQJRQDQDVVXPSWLRQWKDWWZRODQJXDJHJURXSVKDYHWKHVDPHDELOLW\ GLVWULEXWLRQ ,QPDQ\RWKHUFDVHVWKHVROXWLRQVHOHFWHGLVWRFKRRVHIURPWKHFRPPRQ WUDQVODWHGLWHPVWKRVHLWHPVZLWKQR',)DQGWRXVHWKHPDVDQDQFKRUDIWHUDSSO\LQJ VWDWLVWLFDOPHWKRGVIRUGHWHFWLQJWKRVHLWHPVZKLFKGLVSOD\',)EHWZHHQWKHVRXUFHDQG WDUJHWODQJXDJHIRUPV :KLOHWKLVSURFHGXUHODEHOHGKHUHDV&KDQQHO GRHVQRWPDNHWKH DQFKRULWHPVLGHQWLFDOLQFRQWHQWLWPD[LPL]HVWKHSV\FKRPHWULFVLPLODULW\RIWKHFRPPRQ LWHPV7KLVVROXWLRQLVVWLOOIDUIURPSHUIHFWEHFDXVHWKHUHPD\EHDV\VWHPDWLFGULIWLQWKH GLIILFXOW\RIWKHWUDQVODWHGLWHPVIROORZLQJWUDQVODWLRQZKLFKFDQQRWEHUHYHDOHGE\',) PHWKRGV,QDGGLWLRQWKHDQFKRUZKDWUHPDLQVDIWHUWKHUHPRYDORIWKH',)LWHPV PD\QRW UHSUHVHQWWKHWHVWZHOOHQRXJK 5HVXOWVRIVWXGLHVRQWKHDFFXUDF\RI&KDQQHOSURFHGXUHZKLFKZLOOEHGLVFXVVHG IXUWKHUODWHULQWKLVSDSHU VKRZWKDWWKHDFFXUDF\LVIDUOHVVWKDQWKDWREWDLQHGLQ PRQROLQJXDOHTXDWLQJ7KLVLQFRQMXQFWLRQZLWKWKHDVSLUDWLRQWRDFKLHYHDPRUHVDWLVIDFWRU\ HTXDWLQJPHWKRGIRUWKHFURVVOLQJXDOFDVHOHGWRWKHGHYHORSPHQWDQGVWXG\RIWZR DGGLWLRQDOHTXDWLQJFKDQQHOVODEHOHGKHUHDV&KDQQHODQG&KDQQHO &KDQQHO8VLQJFRPPRQQRQYHUEDOWUDQVODWHGLWHPVDVDQDQFKRULQVWHDGRIXVLQJWKH FRPPRQYHUEDOLWHPV  

&KDQQHO8VLQJDQLQWHUQDOZLWKLQODQJXDJHHTXDWLQJFKDQQHOLQZKLFKHYHU\QHZ WUDQVODWHGIRUPLVHTXDWHGWRDQDOUHDG\HTXDWHGWUDQVODWHGIRUP 7KLVSDSHUZLOOHODERUDWHRQWKHH[SHULHQFHDFTXLUHGE\DQGWKHVWXGLHVSHUIRUPHGDWWKH ,VUDHOL1DWLRQDO,QVWLWXWHIRU7HVWLQJDQG(YDOXDWLRQ1,7( UHJDUGLQJDOOWKUHHFKDQQHOVIRU HTXDWLQJWUDQVODWHGYHUEDOWHVWVWRWKHVRXUFHODQJXDJHWHVWV$OVRWKHLVVXHRIDVVLJQLQJZHLJKWV WRHDFKRIWKHWKUHHFKDQQHOVZLOOEHGLVFXVVHG(DFKHTXDWLQJFKDQQHOZLOOEHGHVFULEHGLQGHWDLO DQGWKHQHYDOXDWHGE\WZRPHDQVD DJHQHUDOHYDOXDWLRQRIWKHPHWKRGDQGE UHVXOWVRI VWXGLHVFRQGXFWHGDW1,7(UHJDUGLQJWKHHTXDWLQJPHWKRG $OOWKH1,7(VWXGLHVZHUHFDUULHGRXWRQWKH3V\FKRPHWULF(QWUDQFH7HVW3(7 XVHGLQWKH DGPLVVLRQVWRXQLYHUVLWLHVLQ,VUDHO7KLVLVDKLJKVWDNHVPXOWLSOHFKRLFHWHVWFRPSRVHGRI WKUHHVXEWHVWVRUGRPDLQV YHUEDOUHDVRQLQJ9 TXDQWLWDWLYHUHDVRQLQJ4 DQG(QJOLVKDVD IRUHLJQODQJXDJH( (DFKVXEWHVWKDVWZRSDUDOOHOWHVWVHFWLRQV7KHYHUEDODQGTXDQWLWDWLYH VXEWHVWVDUHVLPLODULQPDQ\DVSHFWVWRWKH6FKRODVWLF$VVHVVPHQW7HVWV6$7, YHUEDODQG PDWKHPDWLFDOVHFWLRQV3(7LVWUDQVODWHGDQGDGDSWHGLQWRILYHODQJXDJHV$UDELF5XVVLDQ 6SDQLVK)UHQFKDQG+HEUHZ (QJOLVKFRPELQHGIRUP7KHWHVWLVDGPLQLVWHUHGWRPRVWRIWKH FDQGLGDWHVDSSO\LQJWRLQVWLWXWLRQVRIKLJKHUHGXFDWLRQLQ,VUDHOVHH%HOOHU*DIQLDQG+DQDQL IRUIXUWKHUGHWDLOV  (TXDWLQJRU/LQNLQJ" 7KHIDFWWKDWJHQHUDOHTXDWLQJDVVXPSWLRQVGRQRWKROGSHUIHFWO\IRUFURVVOLQJXDOHTXDWLQJ KDVOHGVRPHHTXDWLQJVSHFLDOLVWVWRODEHOWKHUHODWLRQVKLSEHWZHHQWZRODQJXDJHIRUPVDV OLQNLQJUDWKHUWKDQHTXDWLQJ$W\SLFDOMXVWLILFDWLRQIRUXVLQJWKHWHUPOLQNLQJDSSHDUVLQ %UHQQDQ  ,XVHWKHZRUG³HTXDWLQJ´WRUHIHUWRDVWDWLVWLFDOUHODWLRQVKLSEHWZHHQVFRUHVRQIRUPVRID WHVW FRQVWUXFWHG DFFRUGLQJ WR WKH VDPH FRQWHQW DQG VWDWLVWLFDO VSHFLILFDWLRQV DQG DGPLQLVWHUHG XQGHUWKHVDPHFRQGLWLRQV%\FRQWUDVWZKHQDQ\RIWKHVHFRQGLWLRQVDUHQRWIXOILOOHG,XVHWKH WHUP³OLQNLQJ´S  +RZHYHUWKLVSDSHUZKLFKH[SUHVVHVWKHQHHGIRUDFKLHYLQJDFRPPRQVFDOHIRUERWK ODQJXDJHWHVWIRUPVXVHVWKHWHUPHTXDWLQJHYHQWKRXJKWKLVXVDJHPD\EHVHHQDVH[SUHVVLQJ DQDVSLUDWLRQUDWKHUWKDQDQHPSLULFDOUHODWLRQVKLS 



(TXDWLQJ7UDQVODWHG9HUEDO7HVWV&KDQQHO (TXDWLQJWKURXJKQRQ',)WUDQVODWHGYHUEDOLWHPV



'HVFULSWLRQRIWKHHTXDWLQJPHWKRG

7KHSRSXODUPHWKRGIRUFURVVOLQJXDOHTXDWLQJDSSOLHVWKHVHSDUDWHPRQROLQJXDOJURXSV GHVLJQ+DPEOHWRQ6LUHFL LQZKLFKVRXUFHODQJXDJH6/ DQGWDUJHWODQJXDJH 7/ YHUVLRQVRIDWHVWDUHVHSDUDWHO\DGPLQLVWHUHGWRVRXUFHDQGWDUJHWODQJXDJHH[DPLQHH JURXSV7KHQDVHWRIWUDQVODWHGLWHPVDQDQFKRU FRQVLGHUHGWREHHTXLYDOHQWDFURVVWKH VRXUFHDQGWDUJHWODQJXDJHYHUVLRQVLVXVHGWROLQNWKHGLIIHUHQWODQJXDJHVWHVWVRQWRD FRPPRQVFRUHVFDOH%DVLFDOO\WKLVHTXDWLQJGHVLJQLVVLPLODUWRWKHIDPLOLDU³FRPPRQLWHP QRQHTXLYDOHQWJURXSV´HTXDWLQJGHVLJQ$QJRII.ROHQ %UHQQDQ H[FHSWWKDW LQWKHSUHVHQWFRQWH[WWKHDQFKRUVHWFRQVLVWVRIWUDQVODWHGLWHPV %HFDXVHWKHWUDQVODWHGLWHPVXVXDOO\DUHQRWFRPSOHWHO\LGHQWLFDOWRWKHVRXUFHODQJXDJH LWHPVD',)DQDO\VLVLVXVXDOO\SHUIRUPHGLQRUGHUWRGLVFDUGWKHPRVWDEHUUDQWLWHPVIURPWKH FRPPRQLWHPVHWVRDVWRUHGXFHWKHLWHPE\ODQJXDJHLQWHUDFWLRQ%HFDXVH',)LQWUDQVODWHG YHUEDOLWHPVLVXVXDOO\ODUJHDQGHDV\WRGHWHFWWKHH[DFW',)GHWHFWLRQPHWKRGXVHGLVQRW FULWLFDO $IWHUWKHDQFKRULVVHWRQHRIWKHFRPPRQLWHPQRQHTXLYDOHQWJURXSVHTXDWLQJPHWKRGV FDQEHDSSOLHG,WFDQEHDQHTXLSHUFHQWLOHPHWKRGRUDOLQHDUHTXDWLQJSURFHGXUHVXFKDVWKH 7XFNHUPHWKRG7XFNHU /HYLQHREVHUYHGVFRUHRU/HYLQHWUXHVFRUH/HYLQH DOO EDVHGRQFODVVLFDOWHVWWKHRU\(TXDWLQJEDVHGRQLWHPUHVSRQVHPHWKRGVLVDOVRIHDVLEOH



*HQHUDOHYDOXDWLRQRIWKHPHWKRG

7KHVHSDUDWHPRQROLQJXDOJURXSVSURFHGXUHVXIIHUVIURPDWKHRUHWLFDOIODZEHFDXVHLWLV SUDFWLFDOO\LPSRVVLEOHWRHQVXUHWKDWWKHGLIIHUHQWODQJXDJHYHUVLRQVDUHIXOO\HTXLYDOHQWDQG WKDWWKH\PHDVXUHWKHVDPHFRQVWUXFWDEDVLFUHTXLUHPHQWIRUDQ\HTXDWLQJV\VWHP2IFRXUVH WKLVSUREOHPFKDUDFWHUL]HVLQSDUWLFXODUWHVWVLQZKLFKWKHYHUEDODVSHFWLVFULWLFDO6SHFLILFDOO\ LWFDQQRWEHDVFHUWDLQHGWKDWWKHFRPPRQWUDQVODWHG LWHPVXVHGIRUWKHHTXDWLQJFRQWLQXHWR PDLQWDLQWKHVDPHFRQWHQWDQGSV\FKRPHWULFFKDUDFWHULVWLFVIROORZLQJWUDQVODWLRQVHH$QJRII &RRN$OODORXI+DPEOHWRQ 6LUHFL ,IWKHUHLVDV\VWHPDWLFGULIWLQWKHDQFKRU LWHPGLIILFXOW\IROORZLQJWUDQVODWLRQWKHHTXDWLQJZLOOUHVXOWLQRYHURUXQGHUHVWLPDWLRQRIWKH WDUJHWODQJXDJHH[DPLQHHV¶DELOLW\GXHWRWKHV\VWHPDWLFLQDFFXUDF\LQHVWLPDWLQJWKHHTXDWLQJ UHODWLRQVKLSWKDWH[LVWVEHWZHHQWKHWHVWIRUPVLQWKHWZRODQJXDJHV 

,QDGGLWLRQWZRDGGLWLRQDOIDFWRUVPD\LQGXFHHTXDWLQJHUURULQWKH&KDQQHOPHWKRG D WKHDQFKRUVXVXDOO\GRQRWUHSUHVHQWWKHWHVWIRUPVLQHDFKODQJXDJHZHOOHQRXJKWKLVLV EHFDXVHWKHUHDUHLWHPVLQWKHWUDQVODWHGIRUPVWKDWDUHFRQVWUXFWHGHVSHFLDOO\IRUWKHVHIRUPV DQGGRQRWDSSHDULQWKHVRXUFHODQJXDJHIRUPV,QDGGLWLRQWKHQRQ',)LWHPVWKDWVHUYHDV WKHDQFKRUDUHQRWUDQGRPVDPSOHVRIWKHZKROHWHVWDQGE LQPDQ\FDVHVDELOLW\GLIIHUHQFHV H[LVWEHWZHHQWKHJURXSVRIH[DPLQHHVWDNLQJWKHDOWHUQDWHWHVWIRUPVLQWKHVRXUFHDQGWDUJHW ODQJXDJHV7KHVHDELOLW\GLIIHUHQFHVLQGXFHPRUHHUURULQWKHHTXDWLQJUHVXOWVDQGWKHVHWRI FRPPRQLWHPVKRZHYHUDSSURSULDWHLVQRWOLNHO\WRRYHUFRPHWKLVSUREOHP$QJRII &RRN .ROHQ %UHQQDQ  5HVXOWVRIVWXGLHVFRQGXFWHGDW1,7(UHJDUGLQJWKHHTXDWLQJPHWKRG 6HYHUDOVWXGLHVZHUHFRQGXFWHGWRHYDOXDWHWKHFRPPRQWUDQVODWHGYHUEDOLWHPVHTXDWLQJ PHWKRGZKLFKLVFXUUHQWO\XVHGLQHTXDWLQJWKHWUDQVODWHGIRUPVRI3(7,QDUHFHQWVWXG\ 5DSSDQG$OODORXI SURSRVHGDFURVVOLQJXDOHYDOXDWLYHWRROWRHVWLPDWHWKHGHJUHHRI LQFRQVLVWHQF\LQWKHSURFHGXUHXVHGWRHTXDWHWKHYHUEDOWHVW$UHVHDUFKSODQWKDWDSSOLHGD GRXEOHOLQNLQJGHVLJQPRGLILHGWRILWWKHVSHFLDOFRQWH[WRIFURVVOLQJXDOWHVWLQJZDV GHYHORSHG$FFRUGLQJWRWKLVSODQWKHHUURULQFURVVOLQJXDOHTXDWLQJRIWKHYHUEDOVXEWHVWRI 3(7ZRXOGEHHVWLPDWHGE\WKHGLIIHUHQFHEHWZHHQWZRHTXDWLQJFRQYHUVLRQIXQFWLRQVHDFK OLQNLQJDVRXUFHODQJXDJHYHUEDOVHFWLRQDQGDSDUDOOHOYHUEDOVHFWLRQLQWKHWDUJHWODQJXDJH 7KHDYHUDJHGLIIHUHQFHIRXQGE\WKLVPHWKRGRYHUDQXPEHURIWHVWIRUPVZRXOGUHIOHFWWKH GHJUHHRIRYHUDOOLQVWDELOLW\WKDWH[LVWHGLQWKHFURVVOLQJXDOHTXDWLQJSURFHVV7KHVDPHVWXG\ GHVLJQZDVWREHFDUULHGRXWRQ+HEUHZVRXUFH WHVWVHFWLRQVDQGWHVWVHFWLRQVLQWZRWDUJHW ODQJXDJHV 7KHILQGLQJVLQGLFDWHGWKDWWKHGLIIHUHQFHVEHWZHHQWKHFRQYHUVLRQIXQFWLRQVLQWKHWZR DOWHUQDWLYHOLQNVZHUHQRWVPDOO2QDYHUDJHWKHGLIIHUHQFHEHWZHHQWKHFRQYHUVLRQVZDVDERXW UDZVFRUHSRLQWVIRUDWHVWWKDWFRQVLVWVRILWHPV LQWKHHTXDWLQJSURFHVVRIRQHRIWKHWDUJHW ODQJXDJHVWRWKHVRXUFHODQJXDJHDQGDERXWUDZVFRUHSRLQWVLQWKHHTXDWLQJSURFHVVRIWKH RWKHUWDUJHWODQJXDJHWRWKHVRXUFHODQJXDJHWKHVHYDOXHVUHSUHVHQWDERXWVWDQGDUGGHYLDWLRQV IRUWKHILUVWODQJXDJHDQGVWDQGDUGGHYLDWLRQVIRUWKHVHFRQGODQJXDJH 7KHVHHUURUV DOWKRXJKQRWODUJHDUHJUHDWHUWKDQWKHVWDQGDUGHUURURIHTXDWLQJHVWLPDWHGIRUWKH+HEUHZ HTXDWLQJSURFHVVZKLFKLVQRPRUHWKDQVWDQGDUGGHYLDWLRQV5DSS $OODORXI  ,QVXPPDU\HTXDWLQJWKURXJKFRPPRQWUDQVODWHGLWHPVLVQRWVXIILFLHQWO\VWDEOH $OWHUQDWLYHHTXDWLQJFKDQQHOVDUHQHHGHGHLWKHUIRUPRQLWRULQJWKHHTXDWLQJUHVXOWVRUIRUXVLQJ LQDGGLWLRQWRWKHFRPPRQWUDQVODWHGLWHPVPHWKRG 

(TXDWLQJ7UDQVODWHG9HUEDO7HVWV&KDQQHO (TXDWLQJWKURXJKQRQYHUEDOWUDQVODWHGLWHPV 

'HVFULSWLRQRIWKHHTXDWLQJPHWKRG

7KHVHFRQGFKDQQHODSSOLHVWKHVDPHHTXDWLQJPHWKRGDV&KDQQHOH[FHSWWKDWKHUHWKH DQFKRULVQRWDVHWRIFRPPRQYHUEDOWUDQVODWHGLWHPV7KHVHFRQGHTXDWLQJFKDQQHOVLJQLILHVDQ DWWHPSWWRDYRLGWKHLPSDFWRIWUDQVODWLRQGLIILFXOWLHVRQHTXDWLQJE\XVLQJDVDQFKRUVRQO\LWHPV LQZKLFKWKHOLQJXLVWLFDVSHFWLVOHVVLPSRUWDQWRUQRWLPSRUWDQWDWDOOVXFKDVPDWKHPDWLFDOLWHPV RUYLVXDOLWHPV7KHVHLWHPVVHUYHWRHTXDWHEHWZHHQWKHVRXUFHDQGWKHWDUJHWYHUEDOWHVWV7KH LWHPVDUHXVHGDVDQH[WHUQDODQFKRULQFRQWUDVWWR&KDQQHOZKHUHWKHYHUEDODQFKRULVDQ LQWHUQDODQFKRULHWKHDQFKRULWHPVDUHSDUWRIWKHLWHPVXVHGLQVFRULQJ  $QJRIIDQG&RRN ZKRGHYHORSHGDQGH[DPLQHGWKHHTXDWLQJSURFHVVHPSOR\HG EHWZHHQWKH6$7DQGWKH6SDQLVK3$$3UXHEDGH$SWLWXG$FDGHPLFD IRXQGWKDWPDWKHPDWLFV LWHPVWHQGWRSUHVHUYHWKHLUSV\FKRPHWULFFKDUDFWHULVWLFVDFURVVODQJXDJHVPRUHWKDQYHUEDOLWHPV GR6LPLODUILQGLQJVZHUHSUHVHQWHGE\*DIQLDQG0HODPHG DQG$OODORXI 7KHVH VWXGLHVVXJJHVWWKDWPDWKHPDWLFVLVDPRUHXQLYHUVDOODQJXDJH+HQFHLWVHHPVWKDWHTXDWLQJ YHUEDOWHVWVDFURVVODQJXDJHYHUVLRQVXVLQJQRQYHUEDOUDWKHUWKDQYHUEDOLWHPVDVDQDQFKRU ZRXOGDFKLHYHPRUHVWDELOLW\WKDQXVLQJWKHYHUEDOWUDQVODWHGLWHPVDVDQDQFKRU,QDGGLWLRQLQWKH FDVHRI3(7WKHUHZRXOGEHPRUHFRPPRQLWHPVDYDLODEOHIRUWKHHTXDWLQJSURFHGXUHDQGLWLV OLNHO\WKDWWKHUHOLDELOLW\RIWKHTXDQWLWDWLYHFRPPRQLWHPVHWZRXOGEHKLJKHUWKDQWKDWRIWKH YHUEDOFRPPRQLWHPVHW *HQHUDOHYDOXDWLRQRIWKHPHWKRG 7KHWKHRUHWLFDOMXVWLILFDWLRQIRUXVLQJTXDQWLWDWLYHLWHPVDVDQFKRULWHPVWRHTXDWHWKHYHUEDO VXEWHVWLVTXHVWLRQDEOHHVSHFLDOO\EHFDXVHTXDQWLWDWLYHLWHPVDUHQRWUHSUHVHQWDWLYHRIWKHYHUEDO GRPDLQ6XFKXVDJHYLRODWHVEDVLFDVVXPSWLRQVQHHGHGIRUDSURSHULPSOHPHQWDWLRQRIDQ\ HTXDWLQJPHWKRG)RUH[DPSOHLQRUGHUWRHTXDWHXVLQJWKH/HYLQHREVHUYHGVFRUHPHWKRGLW PXVWEHDVVXPHGWKDWD WKHWZRWHVWVHTXDWHGDQGWKHFRPPRQLWHPVHWPHDVXUHWKHVDPH SURSHUW\E WKHVFRUHVRIWKHFRPPRQLWHPVHWFRUUHODWHKLJKO\ZLWKWKHVFRUHVLQWKHWZRWHVWV HTXDWHGDQGF WKHOLQHDUUHJUHVVLRQRIWKHVFRUHVLQWKHDQFKRULWHPVHWWKHTXDQWLWDWLYH VHFWLRQV RQWKHWHVWVFRUHVWKHYHUEDOVHFWLRQVFRUHV LVWKHVDPHIRUERWKSRSXODWLRQVWRZKRP WKHWHVWVZHUHDGPLQLVWHUHG2EYLRXVO\WKHILUVWDVVXPSWLRQGRHVQRWKROGEHFDXVHWKHDQFKRULV QRWPHDVXULQJWKHVDPHDELOLW\DVWKHWHVW7KHVHFRQGDVVXPSWLRQPD\KROGDVWKHFRUUHODWLRQ EHWZHHQYHUEDODQGTXDQWLWDWLYHVFRUHVLVDERXW'RQORQIRUWKH6$7%HOOHUIRU 

WKH3(7 DQGWKDWLVDUHDVRQDEOHFRUUHODWLRQEHWZHHQDQH[WHUQDODQFKRUDQGDWHVW$VIRUWKH WKLUGDVVXPSWLRQLQWKHSUHVHQWFDVHRQHKDVWRDVVXPHWKDWWKHUHODWLRQVKLSEHWZHHQYHUEDODQG TXDQWLWDWLYHDELOLWLHVLVLQGHSHQGHQWRIODQJXDJHRUFXOWXUDOEDFNJURXQGWKLVVHHPVWREH LPSRVVLEOHWRSURYH )RUWKHSXUSRVHRIWKHVWXG\ZHZLOODVVXPHWKDWXVLQJWKHTXDQWLWDWLYH VHFWLRQVDVDQFKRUVLVDSSURSULDWHDQGZLOOUHVXOWLQDQDFFXUDWHHTXDWLQJUHODWLRQVKLS 5HVXOWVRIVWXGLHVFRQGXFWHGDW1,7(UHJDUGLQJWKLVHTXDWLQJPHWKRG $VWXG\E\5DSSDQG$OODORXI H[SORUHGWKHHTXDWLQJGHVLJQE\DSSO\LQJLWWRGDWD FROOHFWHGIURPYDULRXV3(7IRUPV7KHVWXG\FRPSDUHGWKHXVHRIDYHUEDODQFKRUWRWKHXVHRI QRQYHUEDODQFKRUDQGZLOOEHGHVFULEHGKHUHLQGHWDLO7KH3(7IRUPVFKRVHQZHUHDOO DGPLQLVWHUHGLQWKHVRXUFHODQJXDJHDQGLQRQHRIWZRWDUJHWODQJXDJHV7/IRUPVDQG 7/IRUPV LQWKH\HDUV,QWKHVWXG\YHUEDOVHFWLRQVLQDJLYHQWDUJHWODQJXDJH ZHUHHTXDWHGWRWKHLUUHVSHFWLYHVRXUFHODQJXDJHLQVHFWLRQVXVLQJDLWHPWUDQVODWHG TXDQWLWDWLYH3(7VHFWLRQDVDQFKRU7KH/HYLQHOLQHDUREVHUYHGVFRUHHTXDWLQJPHWKRGZLWKDQ H[WHUQDODQFKRUZDVXVHGIRUWKHHTXDWLQJSURFHGXUH7KHILUVWYHUEDOVHFWLRQ9 LQDJLYHQ 3(7IRUPLQDWDUJHWODQJXDJHZDVHTXDWHGWRWKHVHFRQGYHUEDOVHFWLRQ9 LQWKHVRXUFH ODQJXDJHYHUVLRQRIWKHVDPHIRUPYLDWZRGLIIHUHQWHTXDWLQJFKDLQVDQGWKHUHVXOWVIURPWKHWZR HTXDWLQJFKDLQVZHUHFRPSDUHG7KHUHVHDUFKSODQLVGLVSOD\HGLQ)LJXUH )LJXUH 

(TXDWLQJEHWZHHQ97/DQG96/YLDWZRHTXDWLQJFKDLQV XVLQJWKHTXDQWLWDWLYHVHFWLRQVDVDQFKRUV

 4

9 9 6/IRUP 6/IRUP

9 7/IRUP

9HUEDO VHFWLRQ 6/ IRUP  7/ IRUP 

9 6/IRUP 9 7/IRUP

4

'

,QWUDODQJXDJH HTXDWLQJ UHVFDOLQJ

4



&URVVOLQJXDO HTXDWLQJ WKURXJK 4

)LJXUHGLVSOD\VWKHUHVXOWVREWDLQHGIRURQHRIWKH3(7IRUPVH[SORUHG7KHWZRKLJKHU IXQFWLRQVLQWKHILJXUHDUHWKHHTXDWLQJFRQYHUVLRQOLQHVEHWZHHQ9LQ7/DQG9LQ6/XVLQJ WKHTXDQWLWDWLYHVHFWLRQVLQWKDWIRUP4RU4 DVDQFKRUVHWV7KHWZRORZHUIXQFWLRQV SORWWHGRQWKHILJXUHVDUHWKHFRQYHUVLRQOLQHVREWDLQHGXVLQJWKHFRPPRQWUDQVODWHGYHUEDO 

LWHPVLQWHUQDODQFKRUDERXWQRQ',)LWHPV DVFDOFXODWHGLQ5DSSDQG$OODORXI 7KLV W\SLFDOFDVHLQGLFDWHVWKDWWKHHTXDWLQJFRQYHUVLRQIXQFWLRQVYLDWKHWZRTXDQWLWDWLYHOLQNVIDOO YHU\FORVHWRHDFKRWKHUZKLOHWKHWZRHTXDWLQJIXQFWLRQVYLDWKHYHUEDODQFKRUVGRQRW7KH RWKHUFHQWUDOILQGLQJLVWKDWWKHWZRTXDQWLWDWLYHFRQYHUVLRQIXQFWLRQVFOHDUO\UHVXOWLQKLJKHU VFRUHVWKDQWKHVFRUHVREWDLQHGXVLQJWKHYHUEDOLWHPDQFKRUV )LJXUH)XQFWLRQVRIHTXDWLQJVHFWLRQV9LQ7/DQG9LQ6/YLDTXDQWLWDWLYH  VHFWLRQVDVDQFKRUVDQGYLDYHUEDODQFKRUVHWVLQDW\SLFDO3(7IRUP

 4XDQFKRU 9HDQFKRU

)LJXUHVXPPDUL]HVWKHGLIIHUHQFHVZKLFKDUHHVWLPDWLRQRIWKHHTXDWLQJHUURU EHWZHHQ WKHWZRFKDLQVRIHTXDWLQJXVLQJTXDQWLWDWLYHVHFWLRQVDVDQFKRUVH[SUHVVLQJWKHGLIIHUHQFH EHWZHHQWKHWZRXSSHUIXQFWLRQVLQ)LJXUH7KHILJXUHVKRZVWKHPHDQDEVROXWHGLIIHUHQFH LQ3(7IRUPVLQ7/LQUDZVFRUHSRLQWV6PDOOHUGLIIHUHQFHVZHUHIRXQGLQWKHVHFRQG ODQJXDJH7KHGLIIHUHQFHVUHSUHVHQWWRVWDQGDUGGHYLDWLRQVRIWKHVFRUHV )LJXUH0HDQRIDEVROXWHGLIIHUHQFHEHWZHHQWZRHTXDWLQJFKDLQVWKDWXVHD  TXDQWLWDWLYHDQFKRUIRU3(7IRUPVLQ7/DQG6/



,QERWK7/DQG7/WKHPHDQGLIIHUHQFHIXQFWLRQEHWZHHQWKHWZRHTXDWLQJFKDLQVLV TXLWHVPDOODOWKRXJKLQ7/WKHGLIIHUHQFHWHQGVWREHVPDOOHU7KHUDQJHRIGLIIHUHQFH EHWZHHQWKHHTXDWLQJUHVXOWVRIWKHWZRTXDQWLWDWLYHDQFKRUFKDLQVLVDERXWKDOIRIWKDW IRXQGEHWZHHQWKHVDPHWZRHTXDWLQJFKDLQVZKHQYHUEDOLQVWHDGRITXDQWLWDWLYHDQFKRUV DUHXVHGVHH5DSS $OODORXI 7KHVPDOOGLIIHUHQFHVFDQDOVREHDWWULEXWHGWRD ORQJHUTXDQWLWDWLYHDQFKRULWHPV LQFRPSDULVRQWRWKHYHUEDODQFKRUDERXWLWHPV  )LJXUHVXPPDUL]HVWKHGLIIHUHQFHVIRXQGEHWZHHQXVLQJDTXDQWLWDWLYHVHFWLRQDVDQ DQFKRUDQGXVLQJDVHWRIWUDQVODWHGYHUEDOLWHPVDVDQDQFKRUIRUVHYHUDO3(7IRUPV7KH ILJXUHVKRZVWKHPHDQGLIIHUHQFHLQ3(7IRUPVLQ7/7KHDYHUDJHGLIIHUHQFHLVDERXW UDZVFRUHSRLQWVDURXQGWKHPLGGOHUDZVFRUHDQGDERXWUDZVFRUHVSRLQWVDWWKH KLJKHUHQG7KHGLIIHUHQFHVZHUHVPDOOHULQ7/ ,QVXPPDU\LWZDVIRXQGWKDWWKHHTXDWLQJUHVXOWVXVLQJWKHQRQYHUEDODQFKRUZHUH PRUHVWDEOHWKDQWKHHTXDWLQJUHVXOWVXVLQJWKHYHUEDODQFKRU+RZHYHUXVLQJWKH QRQYHUEDODQFKRUSURGXFHGKLJKHUVFRUHV )LJXUH0HDQGLIIHUHQFHLQ3(7IRUPVEHWZHHQHTXDWLQJ97/WR96/ E\DTXDQWLWDWLYHDQGE\DYHUEDODQFKRUVHW



(TXDWLQJ7UDQVODWHG9HUEDO7HVWV&KDQQHO ,QWHUQDOZLWKLQODQJXDJHHTXDWLQJ 

'HVFULSWLRQRIWKHHTXDWLQJPHWKRG

7KHLQWHUQDOZLWKLQODQJXDJHHTXDWLQJFKDQQHOLVIRUSUDFWLFDOSXUSRVHVWKHVLQJOHJURXS OLQHDUHTXDWLQJPHWKRGZKHUHWKHVDPHH[DPLQHHVDUHWHVWHGRQERWKWHVWIRUP;DQGWHVWIRUP