Improving Targeting of Weed Biological Control

Download PDF
1 downloads 0 Views 1MB Size Report
Comment
border weed risk m.pdf). ..... evolution of host choice behaviour in insects to make the need for such ... (Futuyma 2000) and this has been vindicated by recent reviews of non target .... biocontrol program was essentially cost free. ...... overseas due to factors that are unlikely to be an issue in Australia (e.g. the presence of.
final report knowledge for managing Australian landscapes

Improving Targeting of Weed Biological Control Projects in Australia Quentin Paynter, Richard Hill, Stanley Bellgard and Murray Dawson Project number: LRN004729 Program: Defeating the Weed Menace R & D

Published by: Land & Water Australia Product Code: PN22434 Postal address: GPO Box 2182, Canberra ACT 2601 Office Location: Level 1, The Phoenix 86-88 Northbourne Ave, Braddon ACT Telephone: 02 6263 6000 Facsimile: 02 6263 6099 Email: [email protected] Internet: lwa.gov.au Land & Water Australia © March 2009 Disclaimer The information contained in this publication is intended for general use, to assist public knowledge and discussion and to help improve the sustainable management of land, water and vegetation. It includes general statements based on scientific research. Readers are advised and need to be aware that this information may be incomplete or unsuitable for use in specific situations. Before taking any action or decision based on the information in this publication, readers should seek expert professional, scientific and technical advice. To the extent permitted by law, the Commonwealth of Australia, Land & Water Australia (including its employees and consultants) the authors, and its partners do not assume liability of any kind whatsoever resulting from any person’s use or reliance upon the content of this publication.

     

,PSURYLQJ7DUJHWLQJRI:HHG%LRORJLFDO&RQWURO3URMHFWVLQ $XVWUDOLD

         4XHQWLQ3D\QWHU5LFKDUG+LOO6WDQOH\%HOOJDUG0XUUD\'DZVRQ  /DQGFDUH5HVHDUFK 3ULYDWH%DJ $XFNODQG 1HZ=HDODQG       /DQGFDUH5HVHDUFK&RQWUDFW5HSRUW/&    35(3$5(')25 /DQGDQG:DWHU$XVWUDOLD        '$7(-DQXDU\



    5HYLHZHGE\ 

$SSURYHGIRUUHOHDVHE\       6FLHQFH7HDP/HDGHU 

 3URJUDPPH/HDGHU /DQGFDUH5HVHDUFK     6FLHQWLVW /DQGFDUH5HVHDUFK          ‹/DQGFDUH5HVHDUFK1HZ=HDODQG/WG 7KLVLQIRUPDWLRQPD\EHFRSLHGDQGGLVWULEXWHGWRRWKHUVZLWKRXWOLPLWDWLRQSURYLGHG /DQGFDUH5HVHDUFK/LPLWHGDQGWKHVRXUFHRIWKHLQIRUPDWLRQDUHDFNQRZOHGJHG8QGHUQR FLUFXPVWDQFHVPD\DFKDUJHEHPDGHWRWKLVLQIRUPDWLRQZLWKRXWWKHZULWWHQSHUPLVVLRQRI /DQGFDUH5HVHDUFK/LPLWHG  'LVFODLPHU 7KHILQGLQJVLQWKLVUHSRUWDUHVSHFLILFWRWKLVSURMHFW/DQGFDUH5HVHDUFKDFFHSWVQR UHVSRQVLELOLW\ZKHUHLQIRUPDWLRQLQWKHUHSRUWLVXVHGIRUDQ\RWKHUSXUSRVHDQGZLOOQRWEH OLDEOHIRUDQ\ORVVRUGDPDJHVXIIHUHGDVDUHVXOWRIVXFKRWKHUXVH





&RQWHQWV  6XPPDU\  L 







,QWURGXFWLRQ 

%DFNJURXQG 

 3UHYLRXVSULRULWLVDWLRQV\VWHPVIRUUDQNLQJZHHGELRFRQWUROWDUJHWV    $VVHVVLQJSRWHQWLDOEHQHILWVIURPELRORJLFDOFRQWURORIDZHHG 

2EMHFWLYHV  

$QDO\VLVRIIDFWRUVDIIHFWLQJWKHIHDVLELOLW\DQGLPSDFWRIELRORJLFDOFRQWUROSURJUDPV

DJDLQVWZHHGV  

 5HYLHZRIIDFWRUVDIIHFWLQJGLIILFXOW\RIELRORJLFDOFRQWURO 

 ,GHQWLILFDWLRQRIIDFWRUVDIIHFWLQJWKHLPSDFWRIELRORJLFDOFRQWUROSURJUDPV  



 0DLQILQGLQJV  

$IUDPHZRUNIRUWKHSULRULWLVDWLRQRIELRORJLFDOFRQWUROSURJUDPVDJDLQVW$XVWUDOLDQ

ZHHGV  

 'HYHORSLQJWKHIUDPHZRUN   :HLJKWLQJRITXHVWLRQVDQGVHQVLWLYLW\DQDO\VLV 

 $SSOLFDWLRQRIWKHIUDPHZRUNWR$XVWUDOLDQZHHGWDUJHWV   

 3ULRULWLHVIRUELRORJLFDOFRQWURORI$XVWUDOLDQZHHGV   &RQFOXVLRQVDQG5HFRPPHQGDWLRQV    (IIRUW

  

 ,PSDFW

  

 ,PSRUWDQFH   

 6WDWXVRIH[LVWLQJELRFRQWUROSURJUDPV±ZKHQWRVWRS"  



  

 )XWXUHUHVHDUFKGHYHORSPHQWVSHFXODWLRQZK\IDFWRUVDUHLPSRUWDQW  

5HFRPPHQGDWLRQV 

$FNQRZOHGJHPHQWV  5HIHUHQFHV 

 $SSHQGL[/LVWRI$XVWUDOLDQZHHGV DWWULEXWHV  

$SSHQGL[/LVWRI6RXWK$IULFDQZHHGV DWWULEXWHV 

$SSHQGL[/LVWRI86ZHHGV DWWULEXWHV   $SSHQGL[$FRPSDULVRQRIDWWULEXWHVDGGUHVVHGLQVFKHPHVWRSULRULWLVHELRORJLFDO

FRQWUROSURJUDPVDJDLQVWZHHGV  

$SSHQGL[5DQNLQJRIWDUJHWZHHGVE\LPSDFWVFRUH  

$SSHQGL[5DQNLQJRIWDUJHWZHHGVE\HIIRUWVFRUH   $SSHQGL[3ULRULW\IRUELRFRQWUROUDQNLQJRIWDUJHWZHHGVE\LPSRUWDQFHîLPSDFW

îHIIRUWVFRUH  

$SSHQGL[)LQDOUDQNLQJH[FOXGLQJFRPSOHWHGSURMHFWV  

$SSHQGL[:HHGVH[FOXGHGIURPILQDOFRQVLGHUDWLRQ 

$SSHQGL[7RSZHHGVE\:R16LPSRUWDQFHVFRUH  $SSHQGL[$WWULEXWHVSUHYLRXVO\XVHGWRUDQNDQGSULRULWLVHZHHGV  

$SSHQGL[&RPPHQWVVROLFLWHGIURPZRUNVKRSSDUWLFLSDQWVRQVXFFHVVRIFRQWURO

FRQIOLFWVRILQWHUHVWDQGZHHGGDPDJHWKUHVKROGV  



L

6XPPDU\  3URMHFWDQG&OLHQW $VSDUWRIWKH'HIHDWLQJWKH:HHG0HQDFH3URJUDP/DQG :DWHU$XVWUDOLDFRPPLVVLRQHG WKHGHYHORSPHQWRIDQDWLRQDOSULRULWLVDWLRQV\VWHPIRULPSURYLQJWKHWDUJHWLQJRIELRORJLFDO FRQWUROSURMHFWVWRWKRVHZHHGVPRVWOLNHO\WR\LHOGVLJQLILFDQWPDQDJHPHQWJDLQV  2EMHFWLYHV • 5HYLHZSUHYLRXVZRUNUHODWHGWRVHOHFWLRQDQGSULRULWLVDWLRQRIZHHGELRFRQWUROWDUJHWV • 'HYHORSDSULRULWLVDWLRQIUDPHZRUNZLWKLQSXWIURPKLJKO\H[SHULHQFHGELRFRQWURO UHVHDUFKHUVHQWRPRORJLVWVSDWKRORJLVWVERWDQLVWVDQGZHHGHFRORJLVWVWRHQVXUHDOO UHOHYDQWDVSHFWVDUHFRQVLGHUHG • 9DOLGDWHDQGUHILQHWKHSULRULWLVDWLRQVFKHPHDQGWHVWWKHIUDPHZRUNXVLQJLQWHUQDWLRQDO H[DPSOHVRIFRPSOHWHGSURMHFWVWRFRPSDUHSUHGLFWLRQVZLWKUHDOOLIHRXWFRPHV • )DFLOLWDWHDZRUNVKRSWRJHWIHHGEDFNIURPVWDNHKROGHUVRQWKHSURSRVHGVFKHPHDQG VHHNIXUWKHULQIRUPDWLRQDERXW$XVWUDOLDQZHHGV • $FTXLUHUHOHYDQWGDWDIRUHDFKVSHFLHVRQWKH:R16DQG$:&OLVWVDQGWKHQDVVHVVWKH SULRULW\RIHDFKVSHFLHVXVLQJWKHIUDPHZRUN • 3URYLGHDILQDOUHSRUWDQGWKHILQDOSULRULWLVDWLRQIUDPHZRUN2XWOLQHWKHUDWLRQDOH PHWKRGRORJ\DQGDVVXPSWLRQVPDGHLQGHYHORSLQJWKHSULRULWLVDWLRQIUDPHZRUNDQGWKH UHVXOWVRIUXQQLQJWKH:R16DQG$:&OLVWVWKURXJKWKHVFKHPH*LYHUHFRPPHQGDWLRQV IRUDQDWLRQDOO\SULRULWLVHGOLVWRIZHHGELRFRQWUROWDUJHWVSOXVUHFRPPHQGDWLRQVIRU IXWXUHDSSOLFDWLRQRIWKHIUDPHZRUN'HOLYHUWKHSULRULWLVDWLRQWRROLQDXVHUIULHQGO\ IRUPDWOLNHWKRVHXVHGIRUZHHGULVNDVVHVVPHQW HJD0LFURVRIW([FHOWRRO  • 3UHVHQWWKHILQDOSULRULWLVDWLRQIUDPHZRUNWRVWDNHKROGHUVLQ&DQEHUUD  0DLQ)LQGLQJV • :HUHYLHZHGSUHYLRXVZRUNUHODWHGWRVHOHFWLRQDQGSULRULWLVDWLRQRIZHHGELRORJLFDO FRQWUROWDUJHWV3UHYLRXVDXWKRUVKDYHXVHGEURDGO\VLPLODUDSSURDFKHVUDQNLQJZHHGV DFFRUGLQJWRERWKWKHLULPSDFWRUHFRQRPLFFRVW LHH[WHQWRISUREOHP DQGWKH IHDVLELOLW\ LHSUHGLFWHGLPSDFW RIELRORJLFDOFRQWUROEDVHGRQDQXPEHURIFULWHULD$ FULWLFLVPRIWKHVHDSSURDFKHVLVWKDWWKH\KDYHUHOLHGXSRQVXEMHFWLYHMXGJHPHQWVDQG RSLQLRQVZLWKRXWMXVWLI\LQJDVVXPSWLRQVUHJDUGLQJIHDVLELOLW\RIELRORJLFDOFRQWURO • :HGHYHORSHGDQGWHVWHGDQLQLWLDOIUDPHZRUNWKDWLQFRUSRUDWHVWKHWZRPDLQIHDWXUHVRI SUHYLRXVUDQNLQJSURWRFROV ZHHGLPSRUWDQFHEDVHGODUJHO\RQWKH$XVWUDOLDQ:HHGVRI 1DWLRQDO6LJQLILFDQFHUDQNLQJDQGSUHGLFWHGLPSDFWRIELRORJLFDOFRQWURO EXWEXLOWRQ WKHVHE\WHVWLQJK\SRWKHVHVUHJDUGLQJLPSDFWRIELRORJLFDOFRQWURO$OLWHUDWXUHVHDUFK DOORZHGFKHFNOLVWVRIZHHGELRFRQWUROWDUJHWVLQ6RXWK$IULFDDQGFRQWLQHQWDO86$WREH FRPSLOHG)RUHDFKZHHGZHOLVWHGWUDLWVLGHQWLILHGGXULQJRXUOLWHUDWXUHUHYLHZDV K\SRWKHWLFDOO\LPSRUWDQWGHWHUPLQDQWVRIELRORJLFDOFRQWUROVXFFHVV$IWHUFRPSLOLQJ ZHHGWUDLWVZHVHDUFKHG&$%$EVWUDFWVDQG*RRJOHIRUTXDQWLWDWLYHLQIRUPDWLRQ UHJDUGLQJVXFFHVVRIELRORJLFDOFRQWURODJDLQVWWKHVHZHHGV'DWDRQWKHLPSDFWRI ELRORJLFDOFRQWUROZHUHFROOHFWHGLQDYDULHW\RIZD\V HJSHUFHQWDJHFRYHUVWHPVP ZHHGELRPDVV 7RDOORZFRPSDULVRQEHWZHHQZHHGVWKHVHGDWDZHUHFRQYHUWHGLQWRDQ µLPSDFWLQGH[¶ , GHILQHGDVWKHSURSRUWLRQDOUHGXFWLRQLQZHHGGHQVLW\GXHWR ELRORJLFDOFRQWURO7KLVDQDO\VLVUHYHDOHGWKDWELRFRQWUROLPSDFWVKDYHRQDYHUDJHEHHQ /DQGFDUH5HVHDUFK

LL

• • •

• •

JUHDWHUDJDLQVWELHQQLDODQGSHUHQQLDOYHUVXVDQQXDOZHHGVSODQWVFDSDEOHRIYHJHWDWLYH UHSURGXFWLRQYHUVXVSODQWWKDWUHSURGXFHVROHO\E\VHHGRUVSRUHVDTXDWLFDQGZHWODQG ZHHGVYHUVXVWHUUHVWULDOZHHGVDQGSODQWVWKDWDUHQRWUHSRUWHGWREHZHHG\LQWKHQDWLYH UDQJHYHUVXVWKRVHZKLFKDUHNQRZQWREHZHHG\LQWKHQDWLYHUDQJH:HLQFRUSRUDWHG WKHVHFULWHULDDIIHFWLQJELRFRQWUROVXFFHVVLQWRDIHDVLELOLW\VFRULQJIUDPHZRUN 7RYDOLGDWHWKLVIUDPHZRUNZHFRUUHODWHGIHDVLELOLW\VFRUHDJDLQVWLPSDFWLQGH[IRU LQGLYLGXDO6RXWK$IULFDQDQG86$GDWDVHWV 7KLVSUHOLPLQDU\IUDPHZRUNZDVSUHVHQWHGWRVWDNHKROGHUVDWDZRUNVKRSWKDWZDVKHOG RQ±2FWREHULQ&DQEHUUDWRREWDLQIHHGEDFNRQWKHSURSRVHGVFKHPHDQG VHHNIXUWKHULQIRUPDWLRQDERXWWKH$XVWUDOLDQZHHGVWREHSULRULWLVHG )ROORZLQJWKHZRUNVKRSWKHVFRULQJV\VWHPZDVIXUWKHUUHILQHGE\LQFRUSRUDWLQJ TXDQWLWDWLYHGDWDIURP$XVWUDOLDQZHHGELRFRQWUROSURJUDPVDQGUHILQLQJWKHVFRULQJ V\VWHPXVLQJVHQVLWLYLW\DQDO\VLV8VLQJWKHILQDOVFRULQJV\VWHPELRFRQWUROLPSDFWV ZHUHLQYDULDEO\PDMRUDJDLQVWZHHGVWKDWVFRUHGPRUHWKDQF RXWRI )RUZHHGV WKDWVFRUHGEHWZHHQDQGLPSDFWZDVYDULDEOH DSSUR[LPDWHO\VXFFHVVHVDQG IDLOXUHV ZKLOHELRFRQWUROPRVWRIWHQKDGQRLPSDFWDJDLQVWZHHGVWKDWVFRUHGOHVVWKDQ  7KHUHYLVHGIUDPHZRUNZDVWKHQDSSOLHGWR$XVWUDOLDQZHHGVRQWKH:R16DQG$:& OLVWVDQGXVHGWRSUHSDUHDOLVWRIZHHGVLQSULRULW\RUGHU 7KHIUDPHZRUNUDWLRQDOHPHWKRGRORJ\DQGDVVXPSWLRQVPDGHLQGHYHORSLQJWKH SULRULWLVDWLRQVFKHPHDQGWKHUHVXOWVRIUXQQLQJWKH:R16DQG$:&OLVWVWKURXJKWKH VFKHPHDUHSUHVHQWHGZLWKLQWKLVUHSRUWZKLFKDOVRSURYLGHVUHFRPPHQGDWLRQVIRUD QDWLRQDOO\SULRULWLVHGOLVWRI$XVWUDOLDQZHHGELRFRQWUROWDUJHWVSOXVUHFRPPHQGDWLRQV IRUIXWXUHDSSOLFDWLRQRIWKHIUDPHZRUN

 5HFRPPHQGDWLRQV • :HUHFRPPHQGWKDWWKHIUDPHZRUNLVUHYLHZHGUHJXODUO\DQGUHYLVHGDVPRUHZHHG ELRFRQWUROLPSDFWGDWDEHFRPHDYDLODEOH7KHPHWKRGVIRUUDQNLQJZHHGLPSRUWDQFH LH :R16YHUVXV:503URWRFRO $QRQ FXUUHQWYHUVXVLQFLSLHQWZHHGV VKRXOGEH GHEDWHGDQGDJUHHG • 7KHUHQHHGVWREHFRQVLGHUDEO\PRUHGLDORJXHDQGHQJDJHPHQWZLWKWKRVHOLNHO\WREH DIIHFWHGE\WKHDGRSWLRQRIVXFKDIUDPHZRUNWRHQVXUHVXFFHVVIXOLPSOHPHQWDWLRQ,W ZDVFOHDUIURPWKHZRUNVKRSIHHGEDFNWKDWPDQ\SDUWLFLSDQWVKDUERXUHGDOHYHORI DQ[LHW\DERXWZKDWWKHVFRULQJV\VWHPPLJKWPHDQIRUELRORJLFDOFRQWURORIZHHGVLQ $XVWUDOLD:HUHFRPPHQGWKDWDSUDJPDWLFGHFLVLRQPDNLQJSURFHVVVKRXOGDOZD\V DFFRPSDQ\WKHIUDPHZRUNZKHQGHFLGLQJDSRUWIROLRRIWDUJHWVIRUELRORJLFDOFRQWURO • 5HVHDUFKTXHVWLRQVVKRXOGEHGHYHORSHGDQGDGGUHVVHGWRLPSURYHSUHGLFWLYHSRZHUDQG UHGXFHOHYHORIXQFHUWDLQW\LQWKHIUDPHZRUN)RUH[DPSOHWKHUHOHYDQFHRIFULWHULDWKDW DXWKRUVKDYHVXJJHVWHGDUHLPSRUWDQWVXFKDVOHDIQLWURJHQDQGZHHGLPSDFWWKUHVKROG EXWZKLFKZHZHUHXQDEOHWRLQFOXGHLQWKHIUDPHZRUNGXHWRDODFNRIGDWDVKRXOGEH LQYHVWLJDWHG • 5HYLHZRIWKHIUDPHZRUNVKRXOGEHVLPSOLILHGE\GHYHORSLQJDGDWDEDVHWRFDSWXUH LQIRUPDWLRQDERXWZHHGVDQGWKHDVVXPSWLRQVEHKLQGWKHIUDPHZRUN  

/DQGFDUH5HVHDUFK





,QWURGXFWLRQ

 2QHSULRULW\WKHPHRIWKH$XVWUDOLDQJRYHUQPHQWSURJUDPHQWLWOHGµ'HIHDWLQJWKH:HHG 0HQDFH¶LVWRVXSSRUWWKHGHYHORSPHQWRIELRFRQWURODJHQWVIRUDJUHHGQDWLRQDOSULRULW\ ZHHGV$JUHDWGHDORIZRUNKDVEHHQGLUHFWHGWRZDUGVLPSURYLQJWKHVHOHFWLRQWHVWLQJDQG HYDOXDWLRQRIELRFRQWURODJHQWVIRUZHHGFRQWUROEXWRXUXQGHUVWDQGLQJRIKRZWRVHOHFW WDUJHWZHHGVDJDLQVWZKLFKELRORJLFDOFRQWUROPLJKWEHFRPHDQLPSRUWDQWSDUWRI PDQDJHPHQWUHPDLQVOLPLWHG'HVSLWHWKHIDFWWKDWWKH$XVWUDOLDQ:HHGV&RPPLWWHH $:&  ZHEVLWHOLVWVDSSUR[LPDWHO\µWDUJHWZHHGVSHFLHVDSSURYHGIRUELRORJLFDOFRQWURO¶WRJHWKHU ZLWKDIXUWKHUOLVWRIELRFRQWUROSURJUDPVLQRSHUDWLRQSULRUWRWKHUHLVQRQDWLRQDOO\ DJUHHGV\VWHPE\ZKLFKWRGHWHUPLQHWKHµEHVW¶RUSULRULW\WDUJHWVIRUELRORJLFDOFRQWURORI ZHHGV/DQGDQG:DWHU$XVWUDOLD /:$ FRPPLVVLRQHGWKHGHYHORSPHQWRIDQDWLRQDO SULRULWLVDWLRQV\VWHPIRULPSURYLQJWKHWDUJHWLQJRIELRORJLFDOFRQWUROSURMHFWVLQ$XVWUDOLDWR WKRVHZHHGVWKDWDUHPRVWOLNHO\WRSURGXFHVLJQLILFDQWPDQDJHPHQWLPSDFWV7KLVLVDUHSRUW RQWKHRXWFRPHRIWKDWVWXG\  /:$UHTXHVWHGWKHSURMHFWWHDPWR • 6FRSHDQGGHYHORSDIUDPHZRUNIRULGHQWLI\LQJSULRULW\WDUJHWZHHGVIRU ELRORJLFDOFRQWUROLQ$XVWUDOLDWKDWWDNHVLQWRDFFRXQWIHDVLELOLW\LPSDFWDQG RWKHUUHOHYDQWIDFWRUV • &RQGXFWDZRUNVKRSWRREWDLQIHHGEDFNIURPNH\VWDNHKROGHUVRQWKHIUDPHZRUN GHYHORSHG • $SSO\WKHQDWLRQDOSULRULW\VHWWLQJIUDPHZRUNWRH[LVWLQJZHHGOLVWV  7KHWHDPZDVDOVRDVNHGWRSURYLGHWKLVUHSRUWZKLFKFRQWDLQV • $VFKHPHIRUSULRULWLVLQJZHHGVDVWDUJHWVIRUELRORJLFDOFRQWUROZLWKLQ$XVWUDOLD WRJHWKHUZLWKWKHUDWLRQDOHPHWKRGRORJ\DQGDVVXPSWLRQVPDGHLQGHYHORSLQJ WKHSULRULWLVDWLRQVFKHPH • 5HFRPPHQGDWLRQVIRUDQDWLRQDOO\SULRULWLVHGOLVWUHVXOWLQJIURPDSSOLFDWLRQRI WKHVFKHPHWRWKH:R16FDQGLGDWHOLVWDQGWKHH[LVWLQJ$:&OLVWRIZHHGV DSSURYHGIRUELRORJLFDOFRQWURO • 5HFRPPHQGDWLRQVIRUIXWXUHDSSOLFDWLRQRIWKHVFKHPH  7KHSURMHFWWHDPZDVDOVRDVNHGWRSURYLGHWKHSULRULWLVDWLRQIUDPHZRUNLQDXVHUIULHQGO\ IRUPDW VXFKDV0LFURVRIW([FHO VLPLODUWRWKDWXVHGIRUZHHGULVNDVVHVVPHQWDQGWRSUHVHQW WKHILQDORXWFRPHRIWKHSURMHFWWRWKH$XVWUDOLDQ:HHGV&RPPLWWHHDQGRWKHUVWDNHKROGHUVLQ   7KHUHTXLUHGVWDNHKROGHUZRUNVKRSZDVKHOGLQ&DQEHUUDRQ±2FWREHU7KH REMHFWLYHVRIWKLVGD\ZRUNVKRSZHUHWR • ,QWURGXFHDQDQDO\WLFDOIUDPHZRUNIRUEHWWHUSULRULWLVLQJWDUJHWZHHGVSUHSDUHG E\/DQGFDUH5HVHDUFK • 2EWDLQIHHGEDFNIURPVWDNHKROGHUVRQWKHGUDIWIUDPHZRUN • 6HHNH[SHUWDGYLFHDERXWERWK:R16DQGRWKHUZHHGVOLVWHGE\WKH$:&WKDW ZHUHWREHWKHVXEMHFWRIWHVWLQJRIWKHIUDPHZRUN  /DQGFDUH5HVHDUFK

 1RWDOOWKHVXJJHVWLRQVPDGHDWWKLVZRUNVKRSFRXOGEHDGGUHVVHGH[SOLFLWO\LQWKLVUHSRUW +RZHYHUWKHFRPPRQµFRUH¶LVVXHVUDLVHGE\DWWHQGHHVIRUPHGWKHVWDUWLQJSRLQWIRU VHQVLWLYLWL\DQDO\VHV$QDFFRXQWRIWKHPHHWLQJUHFRUGLQJWKHPDMRURXWFRPHVLVDWWDFKHGDV $SSHQGL[ 



%DFNJURXQG

  3UHYLRXVSULRULWLVDWLRQV\VWHPVIRUUDQNLQJZHHGELRFRQWUROWDUJHWV

0RVWFODVVLFDOELRORJLFDOFRQWUROSURMHFWVDJDLQVWZHHGWDUJHWVKDYHEHHQFRQGXFWHGLQ6RXWK $IULFD$XVWUDOLD1HZ=HDODQGWKH86$DQG&DQDGD&ODVVLFDOELRORJLFDOFRQWUROWHQGVWREH DSXEOLFFRPPXQLW\OHYHODFWLYLW\FDUULHGRXWE\LQVWLWXWLRQVDQGSXEOLFGHSDUWPHQWVUDWKHU WKDQSULYDWHHQWHUSULVH 9DQ'ULHVFKH +RGGOH 7KHQHHGWRDFFRXQWIRUWKLVSXEOLF LQYHVWPHQWVKRXOGHQVXUHUREXVWGHFLVLRQPDNLQJSURFHVVHVZLWKWKHLQWHQWLRQRIVHOHFWLQJ ELRFRQWUROWDUJHWVWKDWDUHLPSRUWDQWDUHELRORJLFDOO\DQGHFRORJLFDOO\IHDVLEOHDQGKDYH EURDGVRFLDOVXSSRUW,QSUDFWLFHWKHPHDQVE\ZKLFKWDUJHWVDUHVHOHFWHGYDU\JUHDWO\ EHWZHHQMXULVGLFWLRQVDQGWKHUHKDYHEHHQIHZDWWHPSWVWRGHYHORSV\VWHPVWKDWFDQDFKLHYH WKLVHQGLQDWUDQVSDUHQWDQGUHSHDWDEOHIDVKLRQ7KHUHKDVDOVREHHQVXUSULVLQJO\OLWWOH XQGHUSLQQLQJUHVHDUFKWRHQVXUHWKDWWKHPRVWLPSRUWDQWFULWHULDDUHXVHG  ,QDQLQWHUQDOUHSRUW0F&OD\  FRQGXFWHGDUHYLHZRIWKHZHHGVFRQVLGHUHGWREHRI DJULFXOWXUDOLPSRUWDQFHLQ$OEHUWD&DQDGDZLWKWKHDLPRIVHOHFWLQJWDUJHWZHHGVWKDWZHUH VXLWDEOHIRUFODVVLFDOELRORJLFDOFRQWURO6L[WHHQZHHGFKDUDFWHULVWLFVZHUHVFRUHGZHLJKWHG DFFRUGLQJWRKLVSHUFHSWLRQRIWKHLPSRUWDQFHRIHDFKFKDUDFWHULVWLF0F&OD\   FRQFOXGHGWKDWWKHNH\FKDUDFWHUVWKRXJKWWRGHWHUPLQHWKHIHDVLELOLW\RIELRORJLFDOFRQWURO ZHUH • *HRJUDSKLFGLVWULEXWLRQ±VWULFWO\H[RWLFZHHGVKDYHDJUHDWHUUDQJHRIFRQWURO DJHQWVDYDLODEOHDQGQDWLYHZHHGVDUHJHQHUDOO\XQDFFHSWDEOHWDUJHWV • 5HODWLYHDEXQGDQFH±JUHDWHUDEXQGDQFHLQWKHH[RWLFUDWKHUWKDQWKHQDWLYHUDQJH RIDZHHGLQGLFDWHVµQDWXUDOHQHP\UHOHDVH¶DQGKHQFHSRWHQWLDOIRUVXSSUHVVLRQ E\LQWURGXFHGHQHPLHV,WLVPRUHGLIILFXOWWRHVWDEOLVKDQGPDLQWDLQFRQWURO DJHQWVRQZHHGVWKDWDUHUDUHRUVSRUDGLFWKDQRQZLGHVSUHDGDQGSHUVLVWHQW ZHHGV • /LIHF\FOH±ELHQQLDODQGSHUHQQLDOZHHGVDUHHDVLHUWRFRQWUROWKDQDQQXDOZHHGV • +DELWDWVWDELOLW\±ELRORJLFDOFRQWUROLVPRUHGLIILFXOWLQHSKHPHUDOKDELWDWVVXFK DVFXOWLYDWHGODQGWKDQLQVWDEOHDQGSUHGLFWDEOHKDELWDWV LQFOXGLQJFURSPDUJLQV DQGZDVWHODQG  • ,QWUDVSHFLILFYDULDWLRQ±FRQWUROLVPRUHGLIILFXOWZKHUHWKHUHLVDKLJKOHYHORI YDULDWLRQWRDWWDFNZLWKLQVSHFLHVDQGELRW\SHPDQDJHPHQWPD\PDNHSURJUDPV PRUHH[SHQVLYH • %UHHGLQJV\VWHP±DVH[XDOVHOILQJYHJHWDWLYHSODQWVZHUHFRQVLGHUHGWREHEHWWHU WDUJHWVWKDQVH[XDORXWFURVVLQJSODQWV • 6XFFHVVHOVHZKHUH±UHSHDWELRFRQWUROSURJUDPVDUHHDVLHUWKDQQRYHORQHV • 3UHYLRXVVWXG\±VRXQGH[LVWLQJNQRZOHGJHRISRWHQWLDODJHQWVLPSURYHV SRWHQWLDOVXFFHVVRIUHVHDUFK • &RQIOLFWVRILQWHUHVW±SURJUDPGHYHORSPHQWLVPRUHGLIILFXOWLIWKHWDUJHWZHHG KDVVRPHHFRQRPLFRUHQYLURQPHQWDOYDOXH /DQGFDUH5HVHDUFK

 • 7D[RQRPLFLVRODWLRQ±WKHFRVWRIVDIHW\WHVWLQJLQFUHDVHVDQGWKHUDQJHRI SRWHQWLDOFRQWURODJHQWVDYDLODEOHGHFUHDVHVDVUHODWHGQHVVEHWZHHQWKHWDUJHW ZHHGDQGQDWLYHDQGRWKHUYDOXHGSODQWVLQWKHWDUJHWUDQJHLQFUHDVHV

 7KHUHYLHZDVVLJQHGVFRUHVIRURIWKRVHZHHGVDQGSURYLGHGUHDVRQVZK\WKHRWKHU ZHUHH[FOXGHGIURPWKHDVVHVVPHQW 0F&OD\ ,WGLGQRWDGGUHVVWKHUHODWLYHHFRQRPLF RUHQYLURQPHQWDOLPSRUWDQFHRIWKHZHHGVLQ$OEHUWDDQGUHSRUWHGRQO\RQWKHIHDVLELOLW\RI ELRORJLFDOFRQWURO 7KHDWWULEXWHVXVHGE\0F&OD\DUHOLVWHGLQ$SSHQGLFHVDQG   7KHV\VWHPZDVPRGLILHGDQGILUVWSXEOLVKHGE\3HVFKNHQ 0F&OD\LQ7KHUHYLVHG V\VWHPDVFULEHGVFRUHVWROHYHOVRIELRORJLFDODWWULEXWHVUHODWLQJWRWKHEUHHGLQJV\VWHPRI WKHZHHGLWVRULJLQLPSRUWDQFHLQLWVKRPHUDQJHWKHKDELWDWV\VWHPDQGUHODWHGQHVVRIWKH ZHHGWRYDOXHGVSHFLHVLQWKHWDUJHWUDQJH,QDGGLWLRQWKHUHYLVHGV\VWHPVFRUHGWKHTXDOLW\ RIELRFRQWURODJHQWVDYDLODEOHDQGHVWLPDWHGWKHLPSRUWDQFHRIWKHZHHGE\DVFULELQJVFRUHV WRVL[HFRQRPLFDWWULEXWHVLQFOXGLQJHFRQRPLFORVVHVWRWKHZHHGDUHDLQIHVWHGH[SHFWHG VSUHDGWR[LFLW\FXUUHQWVXVFHSWLELOLW\WRRWKHUFRQWUROVWUDWHJLHVDQGWKHYDOXHRIFRQIOLFWVRI LQWHUHVW  7KHVFRUHVDSSOLHGWRDWWULEXWHVZHUHQRWHYHQO\ZHLJKWHG,QSDUWLFXODUKHDY\SRVLWLYH ZHLJKWLQJZDVJLYHQWRVFRUHVIRUZHHGVWKDWFDXVHGVHYHUHHFRQRPLFORVVHVZHUHQRWQDWLYH DQGRFFXSLHGVWDEOHKDELWDWV+HDY\QHJDWLYHZHLJKWLQJZDVJLYHQWRZHHGVZKHUHVLJQLILFDQW FRQIOLFWVRILQWHUHVWZHUHDSSDUHQW/RZHVWZHLJKWLQJZDVJLYHQWRFRQVLGHUDWLRQRI UHODWHGQHVVWRYDOXHGSODQWV6XPPLQJWKHVFRUHVSURYLGHGDUDQNLQJRISRWHQWLDOWDUJHWVIRU VXLWDELOLW\DVWDUJHWV$FRPSDULVRQEHWZHHQWKHDWWULEXWHVRULJLQDOO\XVHGE\0F&OD\   DQGWKHPRGLILHGVFKHPHRI3HVFKNHQ 0F&OD\  FDQEHIRXQGLQ$SSHQGL[ 6LJQLILFDQWO\WKHUHYLVHGVFKHPHPDGHQRSURYLVLRQIRUDVVHVVLQJWKHHQYLURQPHQWDOGDPDJH FDXVHGE\WDUJHWZHHGV  ,QGHYHORSLQJDV\VWHPGHVLJQHGVSHFLILFDOO\IRUSULRULWLVLQJHQYLURQPHQWDOZHHGVIRU ELRORJLFDOFRQWUROUHVHDUFKLQ1HZ=HDODQG6\UHWW  XVHGWKH2ZHQ  VFRULQJ UHJLPHWRGHVFULEHWKHHQYLURQPHQWDOLPSDFWRIWKHZHHGVPRGLILHGWRLQFOXGHDGGLWLRQDO ZHLJKWHGDWWULEXWHVVXFKDVGHJUHHRIILUHKD]DUGOLNHOLKRRGRIUHSODFHPHQWE\DQRWKHUZHHG FRPSHWLWLYHDELOLW\DQGUHVLVWDQFHWRRWKHUPDQDJHPHQWWRROV 2ZHQ)URXGH  7KHSRWHQWLDOIRUELRORJLFDOFRQWURORIHDFKRIWKHVHZHHGVZDVHVWLPDWHGE\VXPPLQJVFRUHV IRUVL[IXUWKHUDWWULEXWHV • /LNHOLKRRGRIFRQIOLFWVRILQWHUHVW PD[VFRUH  • .QRZOHGJHRIHIIHFWLYHFRQWURODJHQWVRUSURJUDPV   • 5HODWHGQHVVWRYDOXHGSODQWV   • 7KHDFFHVVLELOLW\DQGFRVWVDVVRFLDWHGZLWKWKHQDWLYHUDQJHRIWKHZHHG   • 7KHH[LVWHQFHRIORFDODQGLQWHUQDWLRQDOIXQGLQJSDUWQHUV     7KHVXLWDELOLW\IRUFRQWUROZDVWKHQSORWWHGDJDLQVWWKHLPSRUWDQFHRIWKHZHHGWRGHSLFW ZKLFKHQYLURQPHQWDOZHHGVPLJKWEHVWUHSD\LQYHVWPHQWLQELRORJLFDOFRQWURO7KH FRPSRQHQWVRIWKLVV\VWHPDUHOLVWHGLQ$SSHQGL[  ,Q±86'$$3+,6334HYDOXDWHGSHVWVWKDWZHUHSRWHQWLDOWDUJHWVIRUELRORJLFDO FRQWURORQWKHEDVLVRISHUFHLYHGLPSRUWDQFHDQGIHDVLELOLW\ +DQVHQ %ORHP $ZLGH UDQJHRIHQWLWLHVZLWKLQHDFKVWDWHVXUYH\HGVFRUHGSHVWVXVLQJDVWDQGDUGVXUYH\VKHHW6FRUHV ZHUHEDVHGRQWKHRULJLQRIWKHSHVWWKHDYDLODELOLW\RIRWKHUPDQDJHPHQWWRROVWKHOHYHORI ILQDQFLDODQGSHUVRQQHOVXSSRUWDQGWKHGLVWULEXWLRQVSUHDGDQGLPSDFWVRIWKHSHVWLQWKDW /DQGFDUH5HVHDUFK

 6WDWH,QVRPHVWDWHVWKHIUDPHZRUNZDVPRGLILHG 'U(&RRPEV2UHJRQ'HSDUWPHQWRI $JULFXOWXUHSHUVFRPP$SSHQGL[ 7KHWKUHHKLJKHVWSULRULW\WDUJHWVLGHQWLILHGE\HDFK VWDWHZHUHDJJUHJDWHGUHJLRQDOO\5HJLRQDOUDQNLQJVZHUHEDVHGRQWKHUDQNLQJVFRUHVIURP HDFKVWDWHDQGWKHQXPEHURIVWDWHVUHSRUWLQJHDFKSHVWRQLWVUDQNHGOLVW  µ7RSWHQ¶OLVWVRISRWHQWLDOLQVHFWDQGZHHGWDUJHWVIRUELRORJLFDOFRQWUROZHUHWKHQIRUZDUGHG IURPHDFK5HJLRQ :HVWHUQDQG(DVWHUQ IRUVXEVHTXHQWIHDVLELOLW\DQDO\VLV6L[WHHQZHHG VSHFLHVZHUHLGHQWLILHGE\WKLVSURFHVVDQGDVWDQGDUGL]HGVFRULQJV\VWHPZDVXVHGWRDVVHVV HDFKZHHGRQWKHEDVLVRI  SRWHQWLDOYDOXHRIELRORJLFDOFRQWUROIRUZHHGPDQDJHPHQW   SRWHQWLDOFRQIOLFWVRIELRFRQWURODJHQWVZLWKQRQWDUJHWSODQWVDQGDQLPDOV  UHODWLYHVWDWXV RIELRORJLFDOFRQWUROHIIRUWVDQG  SRWHQWLDOIRUVXFFHVVIXOELRORJLFDOFRQWURO LPSOHPHQWDWLRQ7KLVDVVHVVPHQWZDVFRQGXFWHGE\DZLGHUDQJHRISUDFWLWLRQHUVDQG RIILFLDOVDQGZKLOHZHOOLQIRUPHGPD\QRWEHREMHFWLYH  7KLVV\VWHPUHVHPEOHVEXWGLIIHUVIURPWKDWSURSRVHGE\3HVFKNHQ 0F&OD\  ,W LGHQWLILHVWKHQDWXUHRIWKHZHHGSUREOHPUDWKHUWKDQLWVLPSRUWDQFHGRHVQRWDWWHPSWWR TXDQWLI\RUFDWHJRULVHWKHYDOXHRIHFRQRPLFLPSDFWVDQGUHOLHVKHDYLO\RQWKHSHUFHSWLRQRI WKHVWDNHKROGHUV,WGRHVQRWWDNHFRQIOLFWVRILQWHUHVWLQWRDFFRXQWDQGQRVLQJOHDWWULEXWHLV KHDYLO\ZHLJKWHGFRPSDUHGWRDQRWKHU7KHHVWLPDWHRIWKHIHDVLELOLW\RIELRORJLFDOFRQWUROLV VLPSOLVWLFDQGGRHVQRWDGGUHVVWKHLQGLYLGXDOFRPSRQHQWVRIIHDVLELOLW\LQDQ\GHSWK,WDOVR IDLOVWRDGHTXDWHO\FRQVLGHUZHHGELRORJ\WKDWPLJKWDIIHFWFRQWUROVXFFHVV  3DOPHUDQG0LOOHU  VXJJHVWHGDSULRULWLVDWLRQPRGHOWRSURPRWHHIILFLHQF\DQGHTXLW\LQ WKHDOORFDWLRQRIUHVHDUFKUHVRXUFHV7KH\SURSRVHGWKDWSRWHQWLDOSURMHFWVVKRXOGEHUDQNHG RQDµELRFRQWUROUHVHDUFKVFRUH¶WKHSURGXFWRIWKHIHDVLELOLW\RIWKHSURMHFWDQGWKHH[WHQWRI WKHSUREOHP7KH\GHILQHGIHDVLELOLW\DVWKHSUREDELOLW\RIILQGLQJILYHVXLWDEOHFRQWURODJHQWV WLPHVWKHSUREDELOLW\RIDFKLHYLQJUHDVRQDEOHFRQWUROXVLQJWKRVHDJHQWV7KH\GHILQHG µH[WHQW¶DVWKHVXPRISURGXFWLRQLPSDFWVRIWKHZHHGHQYLURQPHQWDOLPSDFWRIWKHZHHG DQGWKHDYDLODELOLW\RIRWKHUFRQWUROPHWKRGV(DFKDWWULEXWHZDVVFRUHGIURPWR7KH DVVLJQPHQWRIVFRUHVDQGZHLJKWVZDVEDVHGRQH[SHUWRSLQLRQUDWKHUWKDQREMHFWLYH PHDVXUHVDQGWKHPHWKRGZDVFRQVLGHUHGWRKDYHYDOXHDVRQHGHFLVLRQPDNLQJWRRODPRQJVW RWKHUV 3DOPHU 0LOOHU 7KHV\VWHPDVVXPHGWKDWDQDUELWUDU\QXPEHURIILYHDJHQWV ZRXOGSURYLGHVXIILFLHQWELRWLFSUHVVXUHWRUHDVRQDEO\H[SHFWFRQWUROLUUHVSHFWLYHRIWKH ELRORJ\DQGWUDFWDELOLW\RIWKHWDUJHW7KLVLVDVLPSOLILFDWLRQWKDWFDQEHLPSURYHGXSRQ  7KHFULWHULDXVHGLQWKHVHILYHPRGHOVDUHOLVWHGDQGFRPSDUHGLQ$SSHQGLFHVDQGDORQJ ZLWKWKHHTXLYDOHQWFULWHULDXVHGLQWKHQHZIUDPHZRUN6RPHRIWKHVHFULWHULDDUHVXEVXPHG LQWKHVFRUHDSSOLHGWRHDFKZHHGDVDUHVXOWRILWV:R16RU$:&VWDWXVEXWTXHVWLRQV UHPDLQDERXWKRZZHOOWKHVHDUHFDSWXUHGE\WKLVVWDWXV   $VVHVVLQJSRWHQWLDOEHQHILWVIURPELRORJLFDOFRQWURORIDZHHG

&RQVLGHUDEOHUHVRXUFHVDUHUHTXLUHGLIDELRORJLFDOFRQWUROSURMHFWLVWREHFRPSOHWHGZHOO )RZOHU DQGVRLWLVFULWLFDOWKDWZHHGVVHOHFWHGIRUPDQDJHPHQWE\WKLVWHFKQLTXH MXVWLI\WKHLQYHVWPHQW:KHWKHUELRORJLFDOFRQWUROLVWKHEHVWUHVSRQVHWRDZHHGSUREOHP GHSHQGVQRWRQO\RQWKHHFRORJLFDODQGRUHQYLURQPHQWDOLPSRUWDQFHRIWKHZHHG WKH SRWHQWLDOEHQHILWVRILWVFRQWURO EXWDOVRZKHWKHURWKHUFRQWUROPHWKRGVDUHPRUHDSSURSULDWH DQGWKHOLNHOLKRRGRIDFKLHYLQJVXIILFLHQWFRQWUROWRRYHUFRPHZHHGLQHVV OLNHOLKRRGRI VXFFHVV +LHEHUW  KDVGHVFULEHGWKHHFRORJLFDOHFRQRPLFDQGPDQDJHULDOUDWLRQDOHVIRU WKHSULRULWLVDWLRQRIZHHGV+HDGYRFDWHGWKHGHYHORSPHQWRIVFRUHEDVHGGHFLVLRQPDNLQJ /DQGFDUH5HVHDUFK

 WRROVWRUDQNZHHGVRQWKHEDVLVRISUHVHQWOHYHORILPSDFWVIXWXUHWKUHDWDQGWKHIHDVLELOLW\ DQGFRVWRIFRQYHQWLRQDOFRQWURO6\VWHPVRIYDU\LQJFRPSOH[LW\H[LVWIRUDVVHVVLQJWKH UHODWLYHULVN DQGKHQFHWKHHFRQRPLFDQGHQYLURQPHQWDOLPSRUWDQFH RILQYDVLYHSODQW VSHFLHVLQ1HZ=HDODQG 2ZHQ3KHORXQJHWDO:LOOLDPV 1HZILHOG :LOOLDPVHWDO $XVWUDOLD 7KRUS /\QFK &DQDGDDQG86$  ,Q$XVWUDOLDWKH:HHGVRI1DWLRQDO6LJQLILFDQFH :R16 KDYHEHHQLGHQWLILHGE\DQ REMHFWLYHVFRULQJV\VWHPWRLGHQWLI\WKRVHLQYDVLYHSODQWVWKDWKDYHQDWLRQDOO\VLJQLILFDQW HFRQRPLFDQGHFRORJLFDOLPSDFWV 7KRUS /\QFK 0RUHUHFHQWO\WKH1DWLRQDO3RVW %RUGHU:HHG5LVN0DQDJHPHQW :50 3URWRFRO $QRQ ZDVIRUPXODWHGWRIXUWKHU GHYHORSDULVNEDVHGGHFLVLRQVXSSRUWV\VWHPIRUSULRULWLVLQJZHHGVSHFLHVPDQDJHPHQWDWWKH UHJLRQDOVWDWHWHUULWRU\DQGQDWLRQDOOHYHOV7KLV3URWRFROSURYLGHVDJHQHULFJXLGHWRWKH GHYHORSPHQWRIDSRVWERUGHU:50GHFLVLRQIUDPHZRUNLQFOXGLQJWKHNH\FULWHULDWKDW VKRXOGEHFRQVLGHUHGLQDVVHVVLQJDQGFRPSDULQJ • :HHGULVNVSRVHGE\GLIIHUHQWSODQWVSHFLHVDQG • 7KHIHDVLELOLW\RIPDQDJLQJWKHVHVSHFLHVWKURXJKFRRUGLQDWHGFRQWURO  7KLV3URWRFROUHODWHVWRGHFLVLRQVXSSRUWV\VWHPVIRUGHWHUPLQLQJ • 6SHFLHVIRULQFOXVLRQLQ RUUHPRYDOIURP QR[LRXVZHHGOLVWV • 3ULRULWLHVIRUHUDGLFDWLRQRUFRQWDLQPHQWSURJUDPV • 3ULRULWLHVIRUSUHYHQWLRQRIDQGHDUO\LQWHUYHQWLRQDJDLQVWQHZZHHGLQFXUVLRQV • 3ODQWVSHFLHVZLWKH[LVWLQJRUSRWHQWLDOFRPPHUFLDOXVHVZKLFKSRVHDZHHGULVN DQGUHTXLUHDFWLYHPDQDJHPHQWWROLPLWWKHLUVSUHDGIURPSODQWLQJV • 3ULRULWLHVIRULQYHVWPHQWLQWRUHVHDUFKDQGH[WHQVLRQOHDGLQJWRLPSURYHGZHHG PDQDJHPHQW HJELRFRQWUROSULRULWLHV   7KLV3URWRFROLVDQDGDSWDWLRQRIWKHDSSURDFKHVDQGFRQWHQWRIWKHWZR$XVWUDOLD1HZ =HDODQG6WDQGDUGV • $61=65LVN0DQDJHPHQWDQG • +%(QYLURQPHQWDOULVNPDQDJHPHQW3ULQFLSOHVDQGSURFHVV  KWWSZZZIDRRUJDJ$*3DJSS,30:HHGVGRF)$2SURFHGXUHIRUSRVW ERUGHUZHHGULVNPSGI   2WKHUDSSURDFKHVWRWKHDVVHVVPHQWRIZHHGLPSRUWDQFHH[LVW5REHUWVRQHWDO   SURSRVHGDVFRULQJV\VWHPIRU6RXWK$IULFDQZHHGVWKDWDOORZVSULRULWLVDWLRQRIZHHGULVN DFFRUGLQJWRSRWHQWLDOLQYDVLYHQHVVGLVWULEXWLRQDQGGHQVLW\SRWHQWLDOHQYLURQPHQWDO HFRQRPLFDQGVRFLDOLPSDFWVSRWHQWLDOZHHGLPSDFWVSRWHQWLDOIRUFRQWURODQGFRQIOLFWVRI LQWHUHVW WKHV\VWHPGLGQRWH[DPLQHWKHIHDVLELOLW\RIELRORJLFDOFRQWUROLQDQ\GHSWK 7KH\ QRWHGWKDWLWZDVGHVLUDEOHIRUDUDQJHRIDVVHVVRUVWRVFRUHHDFKZHHGWROLPLWELDV7KH\ LQWURGXFHGDVHSDUDWHµFRQILGHQFHVFRUH¶VRWKDWDVVHVVRUVFRXOGLQGLFDWHWKHUHOLDELOLW\RIGDWD DVVRFLDWHGZLWKHDFKDWWULEXWHRUWKHDEVHQFHRIVXFKLQIRUPDWLRQ7KHRYHUDOOFRQILGHQFH VFRUHWKHQLQIRUPHGWKHUHOLDELOLW\RIWKHFULWHULRQVFRUHV  0RVWQDWLRQDOVFKHPHVIRUVHWWLQJSULRULWLHVIRUZHHGPDQDJHPHQWDUHEDVHGRQWKHFXUUHQWRU IXWXUHHFRQRPLFRUHQYLURQPHQWDOLPSDFWRIWKHZHHG HJ0RUDQHWDO :HHGULVN DVVHVVPHQWV\VWHPVPD\QRWDGHTXDWHO\GLVWLQJXLVKWKHUHODWLYHLPSRUWDQFHRIDEXQGDQW ZHHGVWKDWDUHDSUREOHPFXUUHQWO\DQGWKRVHWKDWDUHRIOLPLWHGGLVWULEXWLRQEXWKLJK SRWHQWLDO1HOHWDO  FRQFOXGHGWKDWYDOXHRIVFRULQJV\VWHPVLVOLPLWHGLIWKHUHLVQR REMHFWLYHWKUHVKROGDWZKLFKDZHHGTXDOLILHVIRUPDQDJHPHQWDFWLRQDQGWKHFRPSDULVRQRI ZHHGVSHFLHVZLWKGLIIHUHQWVXLWHVRILPSRUWDQWDWWULEXWHVLVGLIILFXOW7KH\GHYLVHGDV\VWHP /DQGFDUH5HVHDUFK

 WRµFOXVWHU¶ZHHGVSHFLHVLQWRWKRVHZLWKHVWDEOLVKHGGLVWULEXWLRQVDQGOHYHOVRIFXUUHQWLPSDFW PDMRULQYDGHUV DQGWKRVHZLWKKLJKSRWHQWLDOIRULQYDVLRQDQGLPSDFW HPHUJLQJLQYDGHUV  %LRORJLFDOFRQWURODJDLQVWSODQWVLQDQHDUO\VWDJHRILQYDVLRQKDVQRWEHHQZLGHO\SUDFWLVHG +RZHYHUWKHSULQFLSOHRIIRUPDOO\UHFRJQL]LQJDQGIXQGLQJUHVHDUFKRQELRORJLFDOFRQWURORI HPHUJLQJZHHGVZDVHVWDEOLVKHGLQ6RXWK$IULFDLQZKHQWKH:RUNLQJIRU:DWHU SURJUDPGHFLGHGWRVXSSRUWVWXGLHVRQILYHVSHFLHVRILQFLSLHQWZHHGV 2OFNHUV  6LPLODUO\*URHQWHPDQHWDO  LQWURGXFHGWKHFRQFHSWRIPXOWLWDUJHWLQJVHOHFWLQJ DJHQWVWKDWFRXOGVLPXOWDQHRXVO\DIIHFWPDMRUZHHGVDQGUHODWHGOHVVDEXQGDQWSODQWVZLWK SRWHQWLDOWREHFRPHZHHGVLQWKHIXWXUH  ,QWKHV\VWHPRXWOLQHGIRUSULRULWLVLQJELRORJLFDOFRQWURORIZHHGVSURMHFWV LQ6HFWLRQ WKH SRWHQWLDOEHQHILWVWKDWPLJKWDFFUXHIURPDFRQWUROSURMHFWDUHEDVHGRQWKHZHHGLQHVV FKDUDFWHULVWLFVGHILQHGE\HDFKZHHG¶V:R16VFRUH,WLVDVVXPHGWKDWWKLVVFRUHDGHTXDWHO\ UHIOHFWVWKHLPSRUWDQFHRIHDFKZHHGEXWDV1HOHWDO  SRLQWRXWWKHLPSRUWDQFHRI HPHUJLQJZHHGVPD\EHXQGHUHVWLPDWHGE\WKLVDSSURDFK2WKHUV\VWHPVKDYHXVHGPRUH H[SOLFLWTXHVWLRQVWRDVVHVVZHHGLPSRUWDQFHDQGLWLVXQFHUWDLQKRZZHOOWKHVHDUHFDSWXUHG LQWKH:R16DSSURDFK7KHDWWULEXWHVXVHGLQRWKHUVFRULQJV\VWHPV $SSHQGL[ WKDWPD\ QRWEHDGHTXDWHO\FDSWXUHGLQWKH:R16VFRUHLQFOXGH  3URSDJXOHSUHVVXUH 3UREDELOLW\RIFRQWUROOLQJZHHGVZLWKORZSRSXODWLRQGHQVLW\DQGORZVHHGUDPHWSURGXFWLRQ DQGKHQFHORZQXPEHURISURSDJXOHVFRQWULEXWLQJWRWKHPDLQWHQDQFHDQGVSUHDGRIWKH ZHHG LVJUHDWHUWKDQIRUDEXQGDQWVSHFLHVZLWKKLJKVHHGSURGXFWLRQ 1HOHWDO+DQVHQ %ORHP 7KH2UHJRQ'HSDUWPHQWRI$JULFXOWXUHDOVRXVHVWKLVFULWHULRQLQLWVZHHG UDWLQJV\VWHP (ULF&RRPEVSHUVFRP $OWKRXJKWKHQXPEHURISURSDJXOHVLVQRWFDSWXUHG RUWUHDWHGH[SOLFLWO\LQWKHµ,QYDVLYHQHVV,QGH[¶:R16GRHVFRQVLGHUW\SHVRISURSDJXOHVLQ UHODWLRQWRSUREDELOLW\RIORQJGLVWDQFHGLVSHUVDO'DWDRQQXPEHUVRISURSDJXOHVPD\EHKDUG WRFRPHE\DQGWKH:R16DSSURDFKKDVEHHQDFFHSWHG  'LVSHUVDO 3UREDELOLW\RIFRQWUROOLQJZHHGVWKDWVSUHDGVORZO\ZLWKSRRUORQJGLVWDQFHGLVSHUVDOLV JUHDWHUWKDQIRUIDVWVSUHDGLQJVSHFLHV 5REHUWVRQHWDO+DQVHQ %ORHP   ([WHQWRILQIHVWDWLRQ /LNHOLKRRGRIFRQWUROLVLQIOXHQFHGE\ZKHWKHULQIHVWDWLRQVDUHSHUVLVWHQWRUWHPSRUDOO\ VSRUDGLFDQGZKHWKHULQIHVWDWLRQVDUHVFDUFHRUZLGHVSUHDG 0F&OD\3HVFKNHQ  0F&OD\5REHUWVRQHWDO+DQVHQ %ORHP 7KLVLVFDSWXUHGLQµ&XUUHQW 'LVWULEXWLRQ¶ FXUGLVW 7KLVDOVRVFRUHVZHHGVKLJKHULIWKH\SHUVLVWIRUDORQJWLPHVHOI UHSODFHHWF  ([SHFWHGVSUHDG ,WLVXQFHUWDLQZKHWKHUWKH:R16FULWHULRQµ3RWHQWLDO'LVWULEXWLRQ¶ GLVWLQW FDSWXUHVWKLV 0RUHRYHUWKHSRWHQWLDOGLVWULEXWLRQVSUHGLFWHGGXULQJWKH:R16UDQNLQJSURFHVVDUHOLNHO\WR FKDQJHLQPDQ\FDVHVGXHWRFOLPDWHFKDQJH  +DELWDWVXLWDELOLW\ ,QGHWHUPLQLQJWKHLPSRUWDQFHRIDWDUJHWZHHG+DQVHQ %ORHP  XVHG  DPHDVXUH RIWKUHDWWRSRWHQWLDOKDELWDWDQG  DPHDVXUHRIWKHSURSRUWLRQRIWRWDOKDELWDWWKDWZDV FOLPDWLFDOO\DFFHVVLEOHWRWKHZHHG DOVRVHH&XOOHQ'D\ 8UEDQ 3DWFKLQHVV ZLWKLQDYDLODEOHKDELWDWPD\RUPD\QRWEHFDSWXUHGDGHTXDWHO\LQWKH:R16DVVHVVPHQW /DQGFDUH5HVHDUFK

 7KLVLVSDUWLDOO\FDSWXUHGLQµ3RWHQWLDO'LVWULEXWLRQ¶ GLVWLQW KRZHYHUWKLVFRQVLGHUVFOLPDWH EXWQRWKDELWDW HJVRLOW\SH 7KLVLVDQDFNQRZOHGJHGJDSDQGRQHWKDWZRXOGQRWEHHDVLO\ ILOOHG  (FRORJLFDOLPSDFW ,PSRUWDQFHRIWKHZHHGGLIIHUVZLWKWKHKDELWDWLWLQYDGHV,PSDFWLVJUHDWHULQVHQVLWLYHDQG IUDJLOHKDELWDWVDQGOHDVWLQGLVWXUEHGKDELWDWVZKHUHWKHUHLVRWKHUFRPSHWLWLRQ7KH SURSRUWLRQRIWKHGLVWULEXWLRQDWWULEXWDEOHWRVXFKFDWHJRULHVPD\QRWEHFDSWXUHGE\:R16 +DQVHQ %ORHP +RZHFRORJLFDOO\LPSRUWDQWDUHWKHKDELWDWVDWULVN":KDWLVWKH QDWXUHRIWKHHIIHFW"+RZPDQ\VXFKKDELWDWVDUHWKHUH"+HDY\GDPDJHWRDIHZKDELWDWV PLJKWVXJJHVWLQWHQVLYHFRQYHQWLRQDOFRQWUROZKHUHDVLIWKHKDELWDWVFDQ¶WEHWUHDWHGWKHQ PD\EHELRORJLFDOFRQWUROEHFRPHVPRUHLPSRUWDQW7KLVLVFDSWXUHGLQDSSHQGLFHV RI :R16HJµGRHVWKHZHHGUHGXFHGHVLUHGYHJHWDWLRQFDXVHHFRV\VWHPFKDQJHVQXPEHURI VSHFLHVWKUHDWHQHGE\ZHHGHWF¶  &OLPDWLFOLPLWVLQYDVLYHHOVHZKHUHRXWVLGHLWVQDWLYHUDQJH 7KHLPSRUWDQFHRIWKHZHHGZLOOEHJUHDWHULILWLVNQRZQWREHDZHHGHOVHZKHUHRXWVLGHLWV QDWLYHUDQJHLILWRFFXUVDFURVVDZLGHUDQJHRIFOLPDWH]RQHVLQLWVWDUJHWUDQJHDQGLILWLV NQRZQWREHFOLPDWLFDOO\SODVWLF HJ'D\ 8UEDQ 7KLVLVDOVRLPSRUWDQWIRUGHILQLQJ WKHFHQWUHRIRULJLQDQGHDVHRIFOLPDWHPDWFKLQJSRWHQWLDOFRQWURODJHQWV,VWKHFOLPDWLFDQG JHRJUDSKLFDOH[WHQWRIWKHZHHGLQLWVQDWLYHUDQJHFDSWXUHGDGHTXDWHO\LQ:R16",VLWV DGDSWDELOLW\LQRWKHUMXULVGLFWLRQVFDSWXUHGLQ:R16" 1HOHWDO 7KLVLVFDSWXUHG LQµ3RWHQWLDO'LVWULEXWLRQ¶ GLVWLQW EXWVLQFHDOOQRPLQDWHG:R16VSHFLHVKDYHDOUHDG\EHHQ DFNQRZOHGJHGSHUKDSVWKLVLVQRWUHOHYDQW7KLVDWWULEXWHZLOOEHFRPHLQFUHDVLQJO\LPSRUWDQW ZLWKLQDQ\DVVHVVPHQWSURFHVVZLWKWKHRQVHWRIFOLPDWHFKDQJH  $OWHUQDWLYHFRQWURODQGQRQWDUJHWLPSDFWVRIVXFKFRQWURO 7KHVHWZRDWWULEXWHVDUHSDUWLDOO\FDSWXUHGE\WKH:R16SURFHVVLQµ(FRQRPLF'DWD¶ HFR  7KHYLDELOLW\RIDOWHUQDWLYHFRQWUROPHDVXUHVLVFDSWXUHGE\WKHTXHVWLRQµZKDWLVWKHWROHUDQFH RIVHHGOLQJVMXYHQLOHVRIWKHZHHGWRURXWLQHZHHGFRQWUROSUDFWLFHV"¶ZLWKKLJKO\WROHUDQW VSHFLHVVFRULQJKLJKHUWKDQORZWROHUDQFHVSHFLHV7KHFRQWUROSUDFWLFHVFRYHUHGE\WKLV TXHVWLRQLQFOXGHKHUELFLGHVFXOWLYDWLRQFXWWLQJVODVKLQJJUD]LQJILUHDQGPDLQWDLQLQJWKH FRPSHWLWLYHQHVVRIGHVLUDEOHYHJHWDWLRQ HJIHUWLOL]LQJDQGSHVWGLVHDVHFRQWURO 7KHUH DSSHDUVWREHOLWWOHNQRZQDERXWWKHQRQWDUJHWLPSDFWVRIURXWLQHFRQWURODQGKRZWKHVH PLJKWPRGLI\WKLVDVVHVVPHQW 

(FRQRPLFLPSDFWRIWKH:HHG &DSWXUHGLQµ(FRQRPLFGDWD¶ HFR DQG:R16DSSHQGL[  ,PSDFWRQHFRV\VWHPSURFHVVHV 3DUWLDOO\FDSWXUHGLQµ&RPPXQLWLHV¶ UHVHUYLQG   ,PSDFWRQELRGLYHUVLW\ 3DUWLDOO\FDSWXUHGLQµ&RPPXQLWLHV¶ UHVHUYLQG   ,PSDFWRQFRPPXQLW\VWUXFWXUH 3DUWLDOO\FDSWXUHGLQµ&RPPXQLWLHV¶ UHVHUYLQG   ,PSDFWRQ+XPDQ+HDOWK 3DUWLDOO\FDSWXUHGLQµVRFLDOLQGH[¶ VRFLDO  /DQGFDUH5HVHDUFK

 

,PSDFWRQUHFUHDWLRQDODQGRWKHUQRQPRQHWDU\YDOXHV &DSWXUHGLQHFR  7R[LFLW\WRVWRFN &DSWXUHGLQ:R16DSSHQGL[  $OWKRXJKWKHEULHIIURP/:$UHTXLUHGWKDWWKH:R16VFRUHVVKRXOGEHXVHGWRHVWLPDWH ZHHGLPSRUWDQFHLQWKHGHYHORSPHQWRIWKLVQHZIUDPHZRUNWKHRXWSXWVIURPWKHPRUH UHFHQW:50SURWRFRO $QRQ RUDQDGDSWDWLRQRIWKHV\VWHPVSURSRVHGE\5REHUWVRQ HWDO  RU1HOHWDO  FRXOGDOVREHXVHGDVSUHGLFWRURIZHHGLPSRUWDQFH 

 

• • • • • •

•

2EMHFWLYHV 5HYLHZSUHYLRXVZRUNUHODWHGWRWKHVHOHFWLRQDQGSULRULWLVDWLRQRIZHHGELRFRQWURO WDUJHWV 'HYHORSDSULRULWLVDWLRQIUDPHZRUNZLWKLQSXWIURPKLJKO\H[SHULHQFHGELRFRQWURO UHVHDUFKHUVHQWRPRORJLVWVSDWKRORJLVWVERWDQLVWVDQGZHHGHFRORJLVWVWRHQVXUHDOO UHOHYDQWDVSHFWVDUHFRQVLGHUHG 9DOLGDWHDQGUHILQHWKHSULRULWLVDWLRQVFKHPHDQGWHVWWKHIUDPHZRUNXVLQJLQWHUQDWLRQDO H[DPSOHVRIFRPSOHWHGSURMHFWVWRFRPSDUHSUHGLFWLRQVZLWKUHDOOLIHRXWFRPHV )DFLOLWDWHDZRUNVKRSWRJHWIHHGEDFNIURPVWDNHKROGHUVRQWKHSURSRVHGVFKHPHDQG VHHNIXUWKHULQIRUPDWLRQDERXW$XVWUDOLDQZHHGV $FTXLUHUHOHYDQWGDWDIRUHDFKVSHFLHVRQWKH:R16DQG$:&OLVWVDQGWKHQDVVHVVWKH SULRULW\RIHDFKVSHFLHVXVLQJWKHIUDPHZRUN 3URYLGHDILQDOUHSRUWDQGWKHILQDOSULRULWLVDWLRQIUDPHZRUN2XWOLQHWKHUDWLRQDOH PHWKRGRORJ\DQGDVVXPSWLRQVPDGHLQGHYHORSLQJWKHSULRULWLVDWLRQIUDPHZRUNDQGWKH UHVXOWVRIUXQQLQJWKH:R16DQG$:&OLVWVWKURXJKWKHVFKHPH*LYHUHFRPPHQGDWLRQV IRUDQDWLRQDOO\SULRULWLVHGOLVWRIZHHGELRFRQWUROWDUJHWVSOXVUHFRPPHQGDWLRQVIRU IXWXUHDSSOLFDWLRQRIWKHIUDPHZRUN'HOLYHUWKHSULRULWLVDWLRQWRROLQDXVHUIULHQGO\ IRUPDWOLNHWKRVHXVHGIRUZHHGULVNDVVHVVPHQW HJD0LFURVRIW([FHOWRRO  3UHVHQWWKHILQDOSULRULWLVDWLRQIUDPHZRUNWRVWDNHKROGHUVLQ&DQEHUUD

/DQGFDUH5HVHDUFK





$QDO\VLVRIIDFWRUVDIIHFWLQJWKHIHDVLELOLW\DQGLPSDFWRIELRORJLFDO FRQWUROSURJUDPVDJDLQVWZHHGV

:HUHYLHZHGIDFWRUVWKDWLQIOXHQFHWKHGLIILFXOW\RIREWDLQLQJDQGKRVWUDQJHWHVWLQJ ELRFRQWURODJHQWVDQGIDFWRUVWKDWLQIOXHQFHWKHLPSDFWRIELRORJLFDOFRQWURORQWKHWDUJHW ZHHG$VXPPDU\RIWKHNH\IDFWRUVLVSUHVHQWHGEHORZ$QDQDO\VLVRIWKHVHUHYLHZVZDV XVHGWRGHYHORSDIUDPHZRUNZKLFKVFRUHGWKHOLNHO\GLIILFXOW\DQGSRWHQWLDOLPSDFWRI ELRORJLFDOFRQWURODFFRUGLQJWRTXDQWLWDWLYHGDWDDVIROORZV   5HYLHZRIIDFWRUVDIIHFWLQJGLIILFXOW\RIELRORJLFDOFRQWURO )DFWRUVDIIHFWLQJWKHVXLWDELOLW\RIDZHHGIRUELRORJLFDOFRQWURO  1DWLYHZHHGV&ODVVLFDOELRORJLFDOFRQWUROSURJUDPVKDYHLQWKHSDVWEHHQFRQGXFWHG DJDLQVWQDWLYHZHHGV+RZHYHUZKHWKHURUQRWQDWLYHZHHGVVKRXOGEHWDUJHWHGIRUELRORJLFDO FRQWUROKDVEHHQWKHVXEMHFWRIGLVDJUHHPHQWDQGGHEDWH:HDVVXPHWKDWELRORJLFDOFRQWURORI DQDWLYHSODQWLQLWVQDWXUDOUDQJHLVXQDFFHSWDEOH6RPHQDWLYHSODQWVKDYHEHFRPHLQYDVLYH ZKHQLQWURGXFHGEH\RQGWKHLUQRUPDOUDQJHIRUH[DPSOHDQXPEHURIHDVWHUQ$XVWUDOLDQ SODQWVVXFKDV3LWWRVSRUXPXQGXODWXPDQG%UDFK\FKLWRQSRSXOQHXVKDYHEHFRPHLQYDVLYHLQ SDUWVRI:HVWHUQ$XVWUDOLD$OWKRXJKWKHUHVKRXOGEHQRREMHFWLRQWRELRORJLFDOFRQWURORI WKHVHVSHFLHVLQWKHLULQWURGXFHGUDQJHZHDVVXPHWKHVHSODQWVVKRXOGEHJLYHQDORZQDWLRQDO UDQNLQJDVXQOLNHH[RWLFZHHGVWKH\FDQQRWEHFRPHLQYDVLYHQDWLRQDOO\%RWKWKHVH DVVXPSWLRQVDUHRIOLWWOHUHOHYDQFHWRWKHSUHVHQWSURMHFWDVQRQHRIWKHµWDUJHWZHHGVSHFLHV DSSURYHGIRUELRORJLFDOFRQWURO¶OLVWHGRQWKH$XVWUDOLDQ:HHGV&RPPLWWHH $:& ZHEVLWHLV QDWLYHDQGQHLWKHUDUHDQ\RIWKHFDQGLGDWH:R16ZHHGV   &RQIOLFWVRILQWHUHVW:HHGVFDQKDYHYDOXHLQPDQ\ZD\VLQFOXGLQJDVIRRGFURSV SDVWXUHSODQWVIRUIRUHVWU\DVJDUGHQSODQWVRUDVDUHVRXUFHIRUKRQH\EHHVRURWKHUGHVLUDEOH IDXQD:KHQWKHUHDUHREMHFWLRQVWRELRORJLFDOFRQWURORIDSDUWLFXODUZHHGDFRVWEHQHILW DQDO\VLVLVUHTXLUHGWRGHWHUPLQHZKHWKHUDSURJUDPVKRXOGSURFHHG)RUWKHµWDUJHWZHHG VSHFLHVDSSURYHGIRUELRORJLFDOFRQWURO¶OLVWHGRQWKH$XVWUDOLDQ:HHGV&RPPLWWHH $:&  ZHEVLWHWKHUHLVXQOLNHO\WREHDQ\VLJQLILFDQWRSSRVLWLRQWKDWFRXOGSUHYHQWDELRORJLFDO FRQWUROSURJUDPIURPSURFHHGLQJDVWKHSRWHQWLDOIRUFRQIOLFWVZLOOKDYHDOUHDG\EHHQ FRQVLGHUHGIRUWKHVHVSHFLHVSULRUWRWKHLUQRPLQDWLRQDVELRFRQWUROWDUJHWV+RZHYHUPDQ\ RIWKHFDQGLGDWH:R16ZHHGVXQGHUFRQVLGHUDWLRQKDYHQRWEHHQQRPLQDWHGDVWDUJHWVIRU ELRORJLFDOFRQWURODQGWKHUHLVWKHUHIRUHSRWHQWLDOIRUVLJQLILFDQWFRQIOLFWVRILQWHUHVWEHWZHHQ GLIIHUHQWVHFWRUV  )DFWRUVDIIHFWLQJWKHGLIILFXOW\RIDFTXLULQJELRFRQWURODJHQWV 7KHVWDJHVRIDELRORJLFDOFRQWUROSURJUDPDUHOLVWHGLQ$SSHQGL[2QHRIWKHILUVWVWHSVRI DQRYHOSURJUDPLVWRVXUYH\WKHQDWLYHUDQJHIRUFDQGLGDWHELRFRQWURODJHQWV(YHQIRUQRYHO SURJUDPVNQRZOHGJHRIWKHDUWKURSRGVDQGSDWKRJHQVDWWDFNLQJDWDUJHWZHHGFDQKHOS SULRULWLVHDJHQWVHOHFWLRQEHIRUHQDWLYHUDQJHVXUYH\VKDYHEHHQSHUIRUPHG)RUH[DPSOH /RFKPDHDVXWXUDOLVLVFRQVLGHUHGDSHVWRIKHDWKHULQ(XURSHZKHUHKHDWKHULVQDWLYHDQG PDQDJHGIRUJURXVHSURGXFWLRQVRWKLVEHHWOHZDVWKHREYLRXVFKRLFHIRUWKHQHZELRFRQWURO SURJUDPDJDLQVWWKLVZHHGVWDUWHGLQ1HZ=HDODQGLQWKHV 6\UHWWHWDO )RUWKH ELRORJLFDOFRQWUROSURJUDPDJDLQVW6FRWFKEURRPH[LVWLQJHFRORJLFDOVWXGLHV :DORII  5LFKDUGV FRQVLGHUHGDSKLGVSV\OOLGV/HXFRSWHUDVSDUWLIROLHOODDQG3K\WRGHFWD *RQLRFWHQD ROLYDFHDWREHWKHPRVWGDPDJLQJLQVHFWVDWWDFNLQJWKHSODQWLQWKH8.7KH /DQGFDUH5HVHDUFK

 RSSRVLWHH[WUHPHLVZKHQWKHOLWHUDWXUHUHJDUGLQJWKHQDWXUDOHQHPLHVRIDZHHGLVH[WUHPHO\ REVFXUHDQGKDUGWRORFDWHRUZRUVHVWLOOQRQH[LVWHQWVRWKDWQDWXUDOHQHPLHVDUHQRWUHDGLO\ LGHQWLILDEOHRUPD\HYHQEHXQGHVFULEHGVSHFLHV:KLOHQRWDQLQVXUPRXQWDEOHSUREOHP IRUPDOO\LGHQWLI\LQJFDQGLGDWHDJHQWVFDQVLJQLILFDQWO\GHOD\WKHLPSRUWDWLRQDQGUHOHDVHRID ELRFRQWURODJHQW  7KHHDVHRIVXUYH\LQJLQWKHQDWLYHUDQJHDOVRYDULHVIRUDQXPEHURIUHDVRQV)RUH[DPSOH FRQFHUQVUHJDUGLQJELRSLUDF\KDYHUHFHQWO\PDGHWKHDFTXLVLWLRQRISHUPLWVWRH[SRUW FDQGLGDWHELRFRQWURODJHQWVIURP6RXWK$PHULFDQFRXQWULHVPRUHGLIILFXOW6RPHFRXQWULHV KDYHSRRULQIUDVWUXFWXUHPDNLQJVXUYH\VH[SHQVLYHDQGWLPHFRQVXPLQJDQGVRPHQDWLRQVDUH GDQJHURXVWRYLVLW6XUYH\LQJLQWKHQDWLYHUDQJHXVXDOO\UHTXLUHVORFDOFROODERUDWRUVDQGLV HDVLHULQFRXQWULHVZLWKH[WHQVLYHZHHGELRORJLFDOFRQWUROH[SHUWLVH  5HSHDWSURJUDPV ZKHUHDWDUJHWZHHGKDVEHHQWKHVXEMHFWRIDVXFFHVVIXOSURJUDPLQ DQRWKHUFRXQWU\ DYRLGWKHH[SHQVHRIRYHUVHDVVXUYH\VDJHQWLGHQWLILFDWLRQDQGKDYHJUHDWO\ UHGXFHGFRVWVDVVRFLDWHGZLWKKRVWVSHFLILFLW\WHVWLQJ VHHEHORZ   )DFWRUVDIIHFWLQJWKHGLIILFXOW\DQGGXUDWLRQRIKRVWVSHFLILFLW\WHVWLQJ +RVWVSHFLILFLW\WHVWLQJLVXVHGWRGLVFDUGSRWHQWLDOZHHGELRFRQWURODJHQWVWKDWDUHOLNHO\WR FDXVHVLJQLILFDQWXQGHVLUDEOHGDPDJHWRQRQWDUJHWSODQWV,QWKHSDVWQRQWDUJHWDWWDFNRQ QDWLYHSODQWVSHFLHVZDVQRWDPDMRUFRQVLGHUDWLRQDQGWHVWSODQWOLVWVZHUHRIWHQPDGHXSRI SODQWVRIHFRQRPLFLPSRUWDQFHZKLFKZHUHQRWQHFHVVDULO\FORVHO\UHODWHGWRWKHWDUJHWZHHG 6XEVHTXHQWO\DFHQWULIXJDOSK\ORJHQHWLFPHWKRG :DSVKHUH ZDVDGRSWHGWRGHWHUPLQH WKHKRVWUDQJHRIDSRWHQWLDOELRORJLFDOFRQWURODJHQWE\VHTXHQWLDOO\WHVWLQJWKRVHSODQWWD[D PRVWFORVHO\UHODWHGWRWKHWDUJHWZHHGIROORZHGE\LQFUHDVLQJO\PRUHGLVWDQWO\UHODWHGWD[D XQWLOWKHKRVWUDQJHKDVEHHQFLUFXPVFULEHG+RZHYHU:DSVKHUH  DOVRGHILQHGVHYHUDO FULWHULDWREHXVHGµDVDVDIHJXDUGDJDLQVWIDLOXUHRIWKHFHQWULIXJDOPHWKRG¶LQFOXGLQJWHVWLQJ FXOWLYDWHGSODQWVZKLFKKDYHQRWEHHQH[SRVHGWRWKHRUJDQLVPVXQGHUVWXG\RUZKLFKDUH NQRZQWREHDWWDFNHGE\FORVHO\UHODWHGRUJDQLVPV$VPRVWFDQGLGDWHELRFRQWURODJHQWVDUH SRRUO\NQRZQDQGDUHGHVWLQHGIRUSRVVLEOHUHOHDVHLQDFRPSOHWHO\QRYHOHQYLURQPHQWWKHVH FULWHULDKDYHSURYLGHGDUDWLRQDOHLQPRVWFDVHVIRUWKHH[SDQVLRQRISK\ORJHQHWLFDOO\EDVHG WHVWOLVWVZLWKDZLGHUDQJHRIHFRQRPLFSODQWVSHFLHV  %ULHVHHWDO  DUJXHGWKDWWKHUHZDVVXIILFLHQWNQRZOHGJHDERXWSODQWSK\ORJHQ\DQGWKH HYROXWLRQRIKRVWFKRLFHEHKDYLRXULQLQVHFWVWRPDNHWKHQHHGIRUVXFKVDIHJXDUGVSHFLHV REVROHWH:LWKWKHUHFHQWDGYDQFHVLQPROHFXODUWHFKQLTXHVWKHUHKDVEHHQDQHQRUPRXV SUROLIHUDWLRQRISXEOLFDWLRQVRQWKHSK\ORJHQ\RISODQWWD[D5HFHQWHYLGHQFHLQGLFDWHVWKDW KRVWVKLIWVLQOLQHDJHVRIVSHFLDOLVWSK\WRSKDJRXVLQVHFWVDUHVWURQJO\OLQNHGWR WKRXJKQRW QHFHVVDULO\FRHYROYHGZLWK WKHHYROXWLRQRIKRVWSODQWOLQHDJHVDQGSODQWFKHPLVWU\DQG WKDWVXFKLQVHFWVVKRZDVWURQJSK\ORJHQHWLFFRQVHUYDWLVPRIKRVWDVVRFLDWLRQV %ULHVH %ULHVH :DONHUDQGUHIHUHQFHV 7KLVSDWWHUQRIVWURQJSK\ORJHQHWLFFRQVHUYDWLVPLQ GLHWVXJJHVWVQRQWDUJHWSODQWVRIJUHDWHVWULVNDUHWKRVHFORVHO\UHODWHGWRNQRZQKRVWV )XWX\PD DQGWKLVKDVEHHQYLQGLFDWHGE\UHFHQWUHYLHZVRIQRQWDUJHWDWWDFNE\ZHHG ELRFRQWURODJHQWV 3HPEHUWRQ%ULHVH :DONHU/RXGDHWDO   7HVWVEDVHGVROHO\RQWKHSK\ORJHQHWLFUHODWLRQVKLSRIWHVWSODQWVWRWKHWDUJHWZHHG HJ %ULHVH :DONHU%ULHVHHWDO:RRGEXUQ DUHQRZURXWLQHO\DSSOLHG +RZHYHUIRUVRPHJURXSVVXFKDVWKH/DPLDOHVWKHSK\ORJHQHWLFUHODWLRQVKLSVEHWZHHQ IDPLOLHVDUHQRWZHOOGHILQHG)RUH[DPSOHWKH9HUEHQDFHDHVVWUWRZKLFK/DQWDQD EHORQJVPD\EHSDUWRI/DPLDOHVRUPD\EHVLVWHUWRWKH/DPLDFHDH HJ:DJVWDII  /DQGFDUH5HVHDUFK

 2OPVWHDG2OPVWHDGHWDODQG&DQWLQRFLWHGLQWKHDQJLRVSHUPSK\ORJHQ\ ZHEVLWHKWWSZZZPRERWRUJPRERWUHVHDUFK$3ZHEDFFHVVHG'HF :KHUHWKHUH LVXQFHUWDLQW\UHJDUGLQJSK\ORJHQHWLFDIILOLDWLRQVRIDZHHGWKHQDODUJHUWHVWSODQWOLVWPD\ EHUHTXLUHGWRHQVXUHDOOVSHFLHVWKDWDUHSRWHQWLDOO\FORVHO\UHODWHGWRWKHWDUJHWZHHGKDYH EHHQLQFOXGHG  7KHDGRSWLRQRISK\ORJHQHWLFKRVWWHVWLQJKDVLQJHQHUDOUHVXOWHGLQDGHFUHDVHLQWKH QXPEHURIWHVWSODQWVSHFLHVUHTXLUHGE\ELRORJLFDOFRQWUROSURJUDPVRYHUWLPHPDNLQJLW GLIILFXOWWRFRPSDUHWKHFRVWRIUHFHQWSURJUDPVZLWKSDVWSURJUDPV1HYHUWKHOHVVD FRQVHTXHQFHRIPRGHUQSK\ORJHQHWLFKRVWUDQJHWHVWLQJLVWKDWIRUZHHGVWKDWDUHPRUH GLVWDQWO\UHODWHGWRQDWLYHRUYDOXHGH[RWLFSODQWVIHZHUWHVWSODQWVDQGVLPSOHUNLQGVRIWHVWV DUHXVXDOO\UHTXLUHGWRGHPRQVWUDWHDGHTXDWHKRVWVSHFLILFLW\RIDJHQWVFRPSDUHGWRZHHGV WKDWDUHFORVHUHODWLYHVRIYDOXHGSODQWV7KHVLPSOHVWKRVWUDQJHWHVWVDUHµQRFKRLFH¶ZKHUH DUWKURSRGVDUHFRQILQHGRQDSDUWLFXODUWHVWSODQWDQGHLWKHUIHHGRUGLHRUIRUSDWKRJHQV LQRFXODWLRQLVDWWHPSWHGWRVHHZKHWKHULQIHFWLRQFDQUHVXOW5HVXOWVDUHH[WUHPHO\UREXVWDQG GHILQHWKHIXQGDPHQWDOKRVWUDQJH LHDOOWKHSODQWVSHFLHVDQDJHQWFDQFRPSOHWH GHYHORSPHQWRQYDQ.OLQNHQ +HDUG RIDSDUWLFXODUVSHFLHV$OWKRXJKLWLVXQXVXDO IRUZHHGELRFRQWURODJHQWVWRKDYHDIXQGDPHQWDOKRVWUDQJHWKDWHQFRPSDVVHVPRUHWKDQRQH SODQWIDPLO\IRUPDQ\KHUELYRURXVLQVHFWVWKHLUIXQGDPHQWDOKRVWUDQJHLVEURDGHUWKDQWKH UHDOLVHGKRVWUDQJHXQGHUQDWXUDOILHOGFRQGLWLRQV7KHUHIRUHWKHPRUHFORVHO\UHODWHGWR YDOXHGVSHFLHVDZHHGLVWKHJUHDWHUWKHOLNHOLKRRGWKDWPRUHFRPSOH[DQGFRVWO\WHVWVVXFK DVILHOGFDJHRYLSRVLWLRQDQGRSHQILHOGWHVWVPD\EHUHTXLUHG  6RPHH[DPSOHVRIUHFHQWKRVWWHVWLQJLQ1HZ=HDODQGDUHJLYHQWRLOOXVWUDWHWKHPDMRUIDFWRUV WKDWDIIHFWWKHFRVWRIKRVWUDQJHWHVWLQJ 7DEOH 2QO\WHVWSODQWVSHFLHVDQGVLPSOHQR FKRLFHKRVWUDQJHWHVWVZHUHUHTXLUHGWRGHWHUPLQHWKHKRVWUDQJHRI1HROHPDRJOREOLQLD ELRORJLFDOFRQWURODJHQWIRU7UDGHVFDQWLDIOXPLQHQVLVLQ1HZ=HDODQGDZHHGZKLFKKDVQR QDWLYHRUYDOXHGH[RWLFVSHFLHVLQWKHVDPHIDPLO\ RUHYHQWKHVDPHRUGHU &RQWUDVWWKLVZLWK WKHH[DPSOHRIWKHOHDIPLQLQJIO\3K\WRP\]DYLWDOEDHDELRORJLFDOFRQWURODJHQWRI&OHPDWLV YLWDOEDDZHHGZKLFKKDVQLQHQDWLYHDQGDQXPEHURIRUQDPHQWDOFRQJHQHUVLQ1HZ =HDODQG$QH[WHQVLYHDUUD\RIWHVWVLQFOXGLQJFKRLFHQRFKRLFHDGXOWRRJHQHVLV UHTXLUHPHQWVDQGILHOGWHVWVZHUHFRQGXFWHGRQWKUHHWLPHVDVPDQ\WHVWSODQWVEHIRUH SHUPLVVLRQIRUWKHUHOHDVHRI3K\WRP\]DYLWDOEDHZDVJUDQWHG 7DEOH   ,IDZHHGKDVEHHQDWDUJHWLQDQRWKHUFRXQWU\WKHQWKLVFDQFRQVLGHUDEO\UHGXFHWKHQXPEHU RIWHVWSODQWVUHTXLUHG GHILQHGLQ7DEOHDVµUHSHDW¶YHUVXVµQRYHO¶SURJUDPV )RUH[DPSOH WKHUDJZRUWIHHGLQJPRWK3ODW\SWLOLDLVRVGDFW\ODZDVUHFHQWO\UHOHDVHGDVDELRORJLFDOFRQWURO DJHQWRIUDJZRUW-DFREDHDYXOJDULV ZKLFKZDVNQRZQDV6HQHFLRMDFREDHDZKHQWHVWLQJ ZDVSHUIRUPHG LQ1HZ=HDODQGZKHUHDODUJHQXPEHURIUHODWHGVSHFLHVZLWKLQWKH7ULEH 6HQHFLRQHDHLVSUHVHQW 7DEOH 3ODW\SWLOLDLVRVGDFW\ODKDGSUHYLRXVO\EHHQKRVWUDQJH WHVWHGE\&6,52DQG'15(SULRUWRLQWURGXFWLRQLQWR$XVWUDOLD)RUW\RQHVSHFLHVRXWVLGH WKHWULEH6HQHFLRQHDHDQGVSHFLHVZLWKLQWKH6HQHFLRQHDH LQFOXGLQJIRXU6HQHFLRVSHFLHV WKDWRFFXULQERWK$XVWUDOLDDQG1HZ=HDODQG ZHUHWHVWHGE\&6,52DQG'15( FRQFOXVLYHO\GHPRQVWUDWLQJWKDW3LVRVGDFW\ODFRXOGQRWGHYHORSRQSODQWVRXWVLGHWKH7ULEH 6HQHFLRQHDH2QO\DGGLWLRQDOVSHFLHVZHUHUHTXLUHGWREHWHVWHGIRUSHUPLVVLRQIRU 3ODW\SWLOLDLVRVGDFW\ODWREHUHOHDVHGLQ1HZ=HDODQG 7DEOH 6LPLODUVDYLQJVZHUH DFKLHYHGGXULQJWKHKRVWUDQJHWHVWLQJRI3URFHFLGRFKDUHVDODQLIRU1HZ=HDODQGDVWKLV DJHQWKDGSUHYLRXVO\EHHQWHVWHGDQGLQWURGXFHGLQWRERWK$XVWUDOLDDQG+DZDL¶L 7DEOH    /DQGFDUH5HVHDUFK

 7DEOH([DPSOHVIURPUHFHQWELRFRQWUROSURJUDPVLQ1HZ=HDODQG 1= GHPRQVWUDWLQJKRZ SODQWSK\ORJHQ\DQGµUHSHDWLQJ¶RQRYHUVHDVSURJUDPVFDQDIIHFWKRVWUDQJHWHVWLQJ UHTXLUHPHQWV7\SHRISURJUDP1 QRYHO3 µUHSHDW¶7\SHRIWHVWV1& QRFKRLFH&  FKRLFH) IHHGLQJ' GHYHORSPHQW2 RYLSRVLWLRQ)LHOG ILHOGWHVWV $JHQW

7DUJHWZHHG

7\SHRI SURJUDP







1RSODQW VSHFLHV WHVWHGE\ RYHUVHDV1= SURJUDPV

7\SHRIWHVWV

1R1=QDWLYHSODQW VSHFLHVLQVDPH





*HQXV

)DPLO\



1&)'2





















7UDGHVFDQWLD IOXPLQHQVLV

1

/RFKPDHD VXWXUDOLV

&DOOXQDYXOJDULV

1



3URFHFLGRFKDUHV DODQL

$JHUDWLQDULSDULD

5



1HROHPDRJOREOLQL

1&)'

&)

)LHOG

1&2'

&2

1&)2

3K\WRP\]DYLWDOEDH &OHPDWLVYLWDOED

1



&)2

2RJHQHVLV

)LHOG

3ODW\SWLOLD LVRVGDFW\OD

6HQHFLRMDFREDHD

5



1&)'

&)'2

 0RUDQHWDO  DQDO\VHGWKHWLPHLWWRRNWRVFUHHQDELRORJLFDOFRQWURODJHQWLQUHODWLRQWR WKHSHUFHLYHGULVNRIQRQWDUJHWDWWDFN DFFRUGLQJWRIRXUHTXDOO\ZHLJKWHGFULWHULDHDFKRI ZKLFKZDVVFRUHGRQDVFDOHIURPWR LPSO\LQJWKHKLJKHVWGHJUHHRIULVN DVIROORZV D SUHFHGHQWVDQGH[SHULHQFHZLWKWKHWDUJHWZHHGDQGZLWKWKHSURVSHFWLYHDJHQWLQWHQGHG IRUUHOHDVHLQ6RXWK$IULFD E WKHSK\ORJHQHWLFSRVLWLRQRIWKHWDUJHWSODQWVSHFLHVUHODWLYHWR FRPPHUFLDOO\LPSRUWDQWVSHFLHVRISODQWVLQ6RXWK$IULFD F WKHSK\ORJHQHWLFSRVLWLRQRIWKH WDUJHWSODQWVSHFLHVUHODWLYHWRFRPSRQHQWVRIQDWLYH6RXWK$IULFDQIORUD G NQRZOHGJH DERXWWKHGHJUHHRIKRVWVSHFLILFLW\RIWKHSURVSHFWLYHDJHQWLQLWVQDWLYHODQGDQGDV GHWHUPLQHGGXULQJVFUHHQLQJWHVWVLQRWKHUFRXQWULHVRULQTXDUDQWLQHLQ6RXWK$IULFD )LJ  7KLVDQDO\VLVDJDLQVKRZHGWKHDGYDQWDJHRIXWLOL]LQJDJHQWVWKDWKDGDOUHDG\EHHQUHVHDUFKHG DQGLPSOHPHQWHGHOVHZKHUHDVWKHVHDJHQWVZHUHUHOHDVHGDIWHUDPHDQRI\HDUVWHVWLQJ FRPSDUHGWRDQDYHUDJHRI\HDUVIRUQRYHODJHQWV 

/DQGFDUH5HVHDUFK

 

                 

 )LJ5HODWLYHULVNVRILQWURGXFLQJELRFRQWURODJHQWVLQWR6RXWK$IULFDYHUVXVWKHPHDQ QXPEHURI\HDUVVSHQWRQWHVWLQJDJHQWVDIHW\SULRUWRWKHLUUHOHDVH UHSULQWHGIURP0RUDQ HWDO    0XOWLWDUJHWLQJZHHGV 0XOWLWDUJHWLQJ LHLQWURGXFLQJDJHQWVWKDWFDQDWWDFNPXOWLSOHUHODWHGVSHFLHV RIIHUVDQ RSSRUWXQLW\WRLQFUHDVHWKHEHQHILWVRIDELRFRQWUROSURJUDP2SSRUWXQLWLHVDUULYHZKHQ PXOWLSOHFORVHO\UHODWHGZHHGVSHFLHVDUHSUHVHQW7ZRPDLQJURXSVRIZHHGVKDYHEHHQ WDFNOHGLQWKLVZD\LQWKH86$.QDSZHHGVDQGWKLVWOHV 7DEOH $JHQWVKDYHDOVREHHQ UHOHDVHGRQERWKOHDI\VSXUJHDQGF\SUHVVVSXUJHEXWGDWDUHJDUGLQJWKHLULPSDFWVRQF\SUHVV VSXUJHDUHODFNLQJ0XOWLWDUJHWLQJKDVKDGPL[HGVXFFHVVPDQ\&HQWDXUHDGLIIXVDDQG &VWRHEHDJHQWVIDLOHGWRHVWDEOLVKDJDLQVWVHFRQGDU\WDUJHWZHHGV1HYHUWKHOHVVWKH\ EURXJKWDERXWGUDPDWLFGHFOLQHLQVTXDUURVHNQDSZHHG&HQWDXUHDYLUJDWDSRSXODWLRQVDWWZR ILHOGVLWHVLQ/DVVHQ&RXQW\&DOLIRUQLD :RRGV 9LOOHJDV 6XUYH\VLQWKHQDWLYH UDQJHRI&YLUJDWDKDGQRWEHHQFRQGXFWHG :RRGV 9LOOHJDV VRWKLVVXFFHVVIXO ELRFRQWUROSURJUDPZDVHVVHQWLDOO\FRVWIUHH7KHELRORJLFDOFRQWUROSURJUDPVDJDLQVWWKLVWOHV LQWKH86$DOVRSURYLGHGRSSRUWXQLWLHVIRUFRVWVDYLQJWKURXJKPXOWLWDUJHWLQJDJDLQZLWK PL[HGUHVXOWV 7DEOH    

/DQGFDUH5HVHDUFK

 7DEOH([DPSOHVRIPXOWLWDUJHWLQJLQWKH86$ 7DUJHWZHHGV

&HQWDXUHDGLIIXVD

,PSDFWRIELRORJLFDOFRQWURO

6LJQLILFDQWLPSDFW 

&HQWDXUHDVWRHEH

6LJQLILFDQWLPSDFW 

&HQWDXUHDMDFHDîQLJUD

&GLIIXVDDJHQWVIDLOHGWRHVWDEOLVKRURQO\PLQRULPSDFW

&HQWDXUHDMDFHD



&HQWDXUHDYLUJDWD VTXDUURVD 

&HQWDXUHDLEHULFD

&HQWDXUHDFDOFLWUDSD

&HQWDXUHDVROVWLWLDOLV

&HQWDXUHDF\DQHXV

/LPLWHGHVWDEOLVKPHQWRI8URSKRUDTXDGULIDVFLDWD

&GLIIXVDDQG&VWRHEHDJHQWVKDYHPDMRULPSDFW

&GLIIXVDDJHQWVIDLOHGWRHVWDEOLVK

&GLIIXVDDJHQWVIDLOHGWRHVWDEOLVK

1HJOLJLEOHLPSDFW 

1HJOLJLEOHLPSDFW 

&DUGXXVDFDQWKRLGHV

6XEVWDQWLDO 

&DUGXXVS\FQRFHSKDOXV

1HJOLJLEOH

&DUGXXVQXWDQV

&DUGXXVWHQXLIORUXV

&LUVLXPDUYHQVH

&LUVLXPYXOJDUH

2QRSRUGXPDFDQWKLXP

6LO\EXPPDULDQXP

6HH$SSHQGL[



1RGDWD

,QHIIHFWLYH 

,QHIIHFWLYH 

,QHIIHFWLYH 

,QHIIHFWLYH 

&RRPEVHWDO

:RRGV 9LOOHJDV



6XEVWDQWLDO 

  ,Q6RXWK$IULFDFRQWUROSURJUDPVDJDLQVWWZRFDFWL&HUHXVMDPDFDUXDQG+DUULVLDPDUWLQL XVHGWKHVDPHDJHQWV $OFLGLRQFHUHLFRODDQG+\SRJHRFRFFXVIHVWHULDQXV DQGSURJUDPV DJDLQVWILYH2SXQWLDFDFWL 2DXUDQWLDFD2ILFXVLQGLFD2LPEULFDWD2VWULFWD 2YXOJDULV DOVRUHVXOWHGLQDJHQWVRUFRPELQDWLRQVRIDJHQWV PDLQO\&DFWREODVWLVFDFWRUXP DQG'DFW\ORSLXVRSXQWLDH DWWDFNLQJVHYHUDOSULPDU\DQGVHFRQGDU\WDUJHWZHHGV 7DEOH   ,QWKH86$RQHDJHQWUHOHDVHGDJDLQVWWKLVWOHVWKHUHFHSWDFOHZHHYLO5KLQRF\OOXVFRQLFXV DWWDFNVDOOWKHLQYDVLYHWKLVWOHVOLVWHGLQ7DEOHEXWLVDOVRUHVSRQVLEOHIRUVHULRXVQRQWDUJHW GDPDJHWRQDWLYH&LUVLXPWKLVWOHV /RXGDHWDO 7KLVLOOXVWUDWHVWKHKHLJKWHQHGULVNRI VHULRXVQRQWDUJHWDWWDFNZKHQUHOHDVLQJROLJRSKDJRXVLQVHFWVWRFRQWUROPXOWLSOHZHHG VSHFLHVWKDWDUHFORVHO\UHODWHGWRQDWLYHSODQWV 

/DQGFDUH5HVHDUFK

   7DEOH([DPSOHVRIPXOWLWDUJHWLQJLQ6RXWK$IULFD 7DUJHWZHHG

,PSDFWRIELRORJLFDOFRQWURO

+DUULVLDPDUWLQL

6XEVWDQWLDO 

&HUHXVMDPDFDUX

6XEVWDQWLDO 

2SXQWLDDXUDQWLDFD

6XEVWDQWLDO 

2SXQWLDH[DOWDWD

"

2SXQWLDGLOOHQLL

2SXQWLDILFXVLQGLFD

2SXQWLDLPEULFDWD

2SXQWLDOHSWRFDXOLV

2SXQWLDOLQGKHLPHUL

2SXQWLDURVHD

2SXQWLDVDOPLDQD

2SXQWLDVSLQXOLIHUD

2SXQWLDVWULFWD

2SXQWLDYXOJDULV

6HH$SSHQGL[





"

6XEVWDQWLDO 

6XEVWDQWLDO 

6XEVWDQWLDO 

6XEVWDQWLDO 

6XEVWDQWLDO 

6XEVWDQWLDO 

"

6XEVWDQWLDO

6XEVWDQWLDO

KWWSIUHGFVLUFR]DSODQWVJOREDOFRQWLQHQDIULFDVDIULFDELRFRQWUDJHQWWEOKWP

6XPPDU\RIIDFWRUVDIIHFWLQJWKHGLIILFXOW\RIELRORJLFDOFRQWURO 7ZRIDFWRUVXQGHQLDEO\DIIHFWWKHGXUDWLRQDQGHIIRUWUHTXLUHGWRORFDWHUHDUDQGKRVWUDQJH WHVWFDQGLGDWHELRFRQWURODJHQWV • 5HSHDWYHUVXVQRYHOSURJUDPV7KHVLPSOHVWWDUJHWZHHGVDUHUHSHDWSURJUDPV ZKHUHWKHQHHGIRUQDWLYHUDQJHVXUYH\VLVDYRLGHGDQGKRVWUDQJHWHVWLQJZLOO KDYHEHHQDWOHDVWSDUWLDOO\SHUIRUPHGRYHUVHDV8VXDOO\LQIRUPDWLRQDERXWKRZ WRUHDUDWOHDVWVRPHSRWHQWLDODJHQWVZLOODOVREHDYDLODEOHDQGPD\UHGXFHWKH DPRXQWRIH[SHULPHQWDWLRQUHTXLUHGWRGHYHORSPDVVUHDULQJWHFKQLTXHV • 7KHSK\ORJHQHWLFSUR[LPLW\RIWKHZHHGWRQDWLYHRUYDOXHGH[RWLFSODQWVSHFLHV ZKLFKLQIOXHQFHVWKHVL]HRIWKHWHVWSODQWOLVWDQGWKHFRPSOH[LW\RIKRVWUDQJH WHVWLQJUHTXLUHG  2WKHUIDFWRUVWKDWDUHOHVVHDV\WRTXDQWLI\DUH  WKHHDVHRIZRUNLQJLQWKHQDWLYHUDQJHRI WKHZHHG  WKHHDVHRIIRUPDOO\LGHQWLI\LQJFDQGLGDWHDJHQWVDQGOLWHUDWXUHLQIRUPDWLRQ UHJDUGLQJWKHELRORJ\HFRORJ\RIFDQGLGDWHDJHQWV  WKHVWDWHRIFXUUHQWNQRZOHGJHRIWKH SK\ORJHQHWLFVRIWKHWDUJHWZHHGDQG  WKHSRWHQWLDOIRUPXOWLWDUJHWLQJ  :HDVVXPHWKDWZHHGVWKDWDUHQDWLYHWR1RUWK$PHULFDDQG:HVWHUQ(XURSHDUHUHODWLYHO\ HDV\WRVXUYH\IRUQDWXUDOHQHPLHVZHHGVQDWLYHWR0DGDJDVFDUDQGVXE6DKDUDQ$IULFD H[FOXGLQJ6RXWK$IULFD 3DNLVWDQDQG,QGLDDUHUHODWLYHO\GLIILFXOWWRVXUYH\DQGZHHGV QDWLYHWR&HQWUDODQG6RXWK$PHULFDDQGWKHUHVWRI$VLDDUHRIPHGLXPGLIILFXOW\:HDOVR DVVLJQDPHGLXPUDQNLQJIRU6RXWK$IULFDEHFDXVHPDQ\ZHHGFRQWUROSUDFWLWLRQHUVDUH EDVHGWKHUH  /DQGFDUH5HVHDUFK

 :HDVVXPHWKDWJHQHUDOO\WKHQDWXUDOHQHPLHVRISODQWVQDWLYHWR(XURSHDQGWKH 0HGLWHUUDQHDQUHJLRQ-DSDQDQG1RUWK$PHULFDZLOOEHUHODWLYHO\ZHOONQRZQZKLOHWKH QDWXUDOHQHPLHVRISODQWVQDWLYHWRWURSLFDODQGWHPSHUDWH6RXWK$PHULFDVXE6DKDUDQ$IULFD DQGPXFKRI$VLDZLOOEHOHVVZHOOFRYHUHGE\WKHOLWHUDWXUH  :HDVVXPHWKDWEHFDXVHRIWKHSRWHQWLDOIRUQRQWDUJHWHIIHFWVRSSRUWXQLWLHVIRUPXOWL WDUJHWLQJDUHOLNHO\WREHUDWKHUOLPLWHGIRUPRVWZHHGFRPSOH[HVLQ$XVWUDOLD HJ$VSDUDJXV VSS/LJXVWUXPVSS5XEXVVSS5XPH[VSS6HQQDVSS6LGDVSSDQG6SRUREROXVVSSDOO KDYHQDWLYHFRQJHQHUV 7KHUHIRUHZHKDYHQRWFRQVLGHUHGWKHSRWHQWLDOIRUPXOWLWDUJHWLQJ ZKHQUDQNLQJ$XVWUDOLDQFDQGLGDWHWDUJHWVIRUELRORJLFDOFRQWURO   ,GHQWLILFDWLRQRIIDFWRUVDIIHFWLQJWKHLPSDFWRIELRORJLFDOFRQWUROSURJUDPV 'DWDFROOHFWLRQGHULYDWLRQ :HVHOHFWHGWKUHHQDWLRQV$XVWUDOLD6RXWK$IULFDDQGFRQWLQHQWDO86$ZKLFKKDYHDORQJ KLVWRU\RIZHHGELRFRQWUROSURJUDPVDQGGUHZXSFKHFNOLVWVRIZHHGVWKDWKDGEHHQWDUJHWHG IRUELRORJLFDOFRQWUROLQHDFKQDWLRQ:HVHDUFKHG&$%$EVWUDFWVDQG*RRJOHIRUTXDQWLWDWLYH GDWDUHJDUGLQJVXFFHVVRIELRORJLFDOFRQWURODJDLQVWWKHVHZHHGV%HFDXVHLPSDFWGDWDKDG EHHQFROOHFWHGLQDYDULHW\RIZD\V HJSHUFHQWDJHFRYHUVWHPVPELRPDVVP ZH VWDQGDUGLVHGGDWDE\FUHDWLQJDQµLPSDFWLQGH[¶ , WRDOORZFRPSDULVRQEHWZHHQZHHGV ,PSDFWLQGH[LVGHILQHGDVWKHSURSRUWLRQDOUHGXFWLRQLQZHHGGHQVLW\GXHWRELRORJLFDO FRQWURO)RUH[DPSOHLIWKHGHQVLW\RIDZHHGZDVUHSRUWHGWREHUHGXFHGIURPWR VWHPVPIROORZLQJELRORJLFDOFRQWUROWKHQWKHUHGXFWLRQLQVWHPGHQVLW\ ± í DQG, í í:KHUHVHYHUDOSXEOLVKHGUHSRUWVZHUHDYDLODEOHIRUDSDUWLFXODU ZHHGVSHFLHVZHXVHGWKHPRVWUHFHQWHVWLPDWHLIWKHODWHVWVWXG\XSGDWHGSUHYLRXVVWXGLHV HJDIWHUWKHUHOHDVHRIDQHZDJHQW RUZHFDOFXODWHGDQDYHUDJHLPSDFWZKHUHWKHLPSDFWRI WKHVDPHELRFRQWURODJHQW V ZDVGHWHUPLQHGDWGLIIHUHQWORFDOLWLHV,IQRELRFRQWURODJHQWV ZHUHUHSRUWHGWRKDYHHVWDEOLVKHGZHDVVXPHGWKDWWKHLPSDFWRIELRORJLFDOFRQWUROZDV]HUR :KHUHDQHFGRWDOUHSRUWVLQGLFDWHGWKDWDJHQWVKDYHDµQHJOLJLEOH¶RUµWULYLDO¶LPSDFWRQWKH WDUJHWZHHGZHDVVXPHGWKDWWKHUHGXFWLRQLQZHHGGHQVLW\ZDV]HURHYHQLITXDQWLWDWLYH GDWDZHUHODFNLQJ:KHUHDQHFGRWDOUHSRUWVLQGLFDWHGDJHQWVGLGKDYHDQLPSDFWRQZHHG SRSXODWLRQVEXWODFNHGTXDQWLWDWLYHGDWDZHH[FOXGHGWKHVHZHHGVSHFLHVLQWKHDQDO\VLVZLWK WKHH[FHSWLRQRIWZRZHHGVLQWKH6RXWK$IULFDQDQDO\VLVZKHUHLWZDVFOHDUWKHLPSDFWZDV VXEVWDQWLDO .OHLQ  VWDWHGWKDWWKHEHHWOH$OFLGLRQFHUHLFRODDQGWKHPHDO\EXJ +\SRJHRFRFFXVIHVWHULDQXVµNLOOHGRII¶ODUJHLQIHVWDWLRQVRI&MDPDFDUXDQG+PDUWLQL UHVSHFWLYHO\LQ6RXWK$IULFD   $QDO\WLFDODSSURDFK ,Q$XVWUDOLDELRFRQWURODJHQWVKDYHEHHQGHOLEHUDWHO\UHOHDVHGDJDLQVWZHHGVSHFLHVWR GDWH2IWKHVHTXDQWLWDWLYHLPSDFWGDWDZHUHDYDLODEOHIRUVSHFLHV  ,Q6RXWK$IULFDZHHGVSHFLHVKDYHEHHQOLVWHGDVELRFRQWUROWDUJHWV+RZHYHUVRPHRI WKHVHSURJUDPVZHUHOLPLWHGWRWKHXVHRIVHHGIHHGHUVLQDQDWWHPSWWRUHGXFHWKH LQYDVLYHQHVVRIVSHFLHVWKDWDUHQHYHUWKHOHVVYDOXHGIRUH[DPSOHIRUZRRGRUWDQQLQ SURGXFWLRQ:HRPLWWHGWKHVHµUHVWULFWHG¶SURJUDPVIURPRXUDQDO\VLVDVWKHDJHQWVUHOHDVHG ZHUHQHYHULQWHQGHGWRGLUHFWO\UHGXFHZHHGGHQVLW\ZKLFKUHVXOWHGLQDGDWDVHWRIZHHG VSHFLHV  ,Q&RQWLQHQWDO86$ZHHGVSHFLHVZHUHOLVWHGDVELRFRQWUROWDUJHWVE\&RRPEVHWDO  6RPHRIWKHVHKRZHYHUDUHµUHDVVRFLDWLRQ¶WDUJHWVZKHUHDJHQWVWKDWKDGEHHQ /DQGFDUH5HVHDUFK

 UHOHDVHGRQUHODWHGZHHGVZHUHIRXQGDWWDFNLQJRUZHUHGHOLEHUDWHO\UHOHDVHGRQUHODWHG ZHHGVZLWKJHQHUDOO\OLWWOHVXFFHVV HJ\HOORZVWDUWKLVWOHDJHQWVIDLOHGWRHVWDEOLVKRQ ,EHULDQDQGSXUSOHVWDUWKLVWOH&RRPEVHWDO 7KHVHZHUHRSSRUWXQLVWLFDWWHPSWVDW ELRORJLFDOFRQWURODQGWKHVHZHHGVSHFLHVKDGQRWEHHQVXUYH\HGIRUHQHPLHVLQWKHLUQDWLYH UDQJHWKHUHIRUHZHRPLWWHGWKHPIURPWKHDQDO\VLV:HFRPSLOHGTXDQWLWDWLYHLPSDFWGDWD IRUZHHGVSHFLHVLQFRQWLQHQWDO86$  ,QHDFKFRXQWU\FHUWDLQJHQHUDZHUHUHSUHVHQWHGE\VHYHUDOWDUJHWZHHGV HJ&HQWDXUHDLQ WKH86$$FDFLDDQG2SXQWLDLQ6RXWK$IULFD %HFDXVHFRQJHQHULFSODQWVDUHOLNHO\WRVKDUH WUDLWVWKDWPD\QRWQHFHVVDULO\EHUHODWHGWRVXVFHSWLELOLW\WRELRORJLFDOFRQWUROSRWHQWLDOO\ ELDVLQJWKHDQDO\VLVZHDYHUDJHGWKHLPSDFWVIRUVSHFLHVLQWKHVDPHJHQXVWKDWVKDUHGWKH VDPHWUDLWV)RUH[DPSOHUDWKHUWKDQLQFOXGHDOOVL[2SXQWLDVSHFLHVIRUZKLFKZHIRXQG TXDQWLWDWLYHGDWDZHFDOFXODWHGWZRLPSDFWLQGLFHVRQHIRU2DXUDQWLDFDZKLFKLVVWHULOH DQGFDQRQO\UHSURGXFHYHJHWDWLYHO\DQGRQHIRUDOOWKHUHPDLQLQJ2SXQWLDVSHFLHVZKLFKDUH FDSDEOHRIERWKVH[XDODQGYHJHWDWLYHUHSURGXFWLRQ VHHEHORZIRUDOLVWRIDOOWUDLWVLQFOXGHG LQWKHDQDO\VLV   :HSHUIRUPHGVHSDUDWHDQDO\VHVIRUHDFKFRXQWU\DQGWKHQXVLQJDFRPELQHGGDWDVHWXVLQJ WKHJHQHUDOLVHGOLQHDUPRGHOVRSWLRQLQ*HQVWDWZLWKWKHLPSDFWLQGH[,DVWKH\YDULDEOHDQG WKHIROORZLQJIDFWRUVWKDWKDYHEHHQK\SRWKHVLVHGWREHLPSRUWDQWGHWHUPLQDQWVRIELRFRQWURO VXFFHVV   )DFWRUVWHVWHGDVGHWHUPLQDQWVRIELRORJLFDOFRQWUROVXFFHVV  :HHGLQQDWLYHUDQJHZLWKWZROHYHOV