Quantitative Software Reliability Modeling from Testing ... - CUHK CSE







 4XDQWLWDWLYH6RIWZDUH5HOLDELOLW\0RGHOLQJIURP7HVWLQJWR2SHUDWLRQ     &KLQ@  )URP RXU SUHYLRXV VWXGLHV LQ >@ VHYHUDO H[LVWLQJ 65*0V FDQ EH XQLILHG XQGHU D JHQHUDO IRUPXODWLRQ $ XQLILHG WKHRU\ LV YHU\ XVHIXO IRU WKH VWXG\ RI JHQHUDO PRGHOV ZLWKRXW PDNLQJ PDQ\DVVXPSWLRQV>@,QWKLV SDSHUZHILUVWUHYLHZWKHXQLILFDWLRQRI65*0VEDVHGRQ 1RQ+RPRJHQHRXV3RLVVRQ3URFHVVHV1+33V 7KHQZH VKRZ KRZ WKHVH H[LVWLQJ 65*0V FRXOG EH GHULYHG E\ DSSO\LQJWKHFRQFHSWRIWKUHHZHOONQRZQPHDQVZHLJKWHG DULWKPHWLFPHDQZHLJKWHGJHRPHWULFPHDQDQGZHLJKWHG KDUPRQLFPHDQ>@6RPHUHFHQWO\SURSRVHG65*0VFDQ DOVREHGHULYHGE\WKHVDPHZD\%DVHGRQWKLVIUDPHZRUN ZH IXUWKHU SUHVHQW D QHZ JHQHUDO 1+33 PRGHO LQFRUSRUDWLQJWKHFRQFHSWRISRZHUWUDQVIRUPDWLRQLQWRWKH PRGHO XQLILFDWLRQ  )URP WKH XQLILHG DSSURDFK ZH FDQ GHULYHQRWRQO\H[LVWLQJ1+33PRGHOVEXWDOVRQHZ1+33 PRGHOV )XUWKHUPRUH ZH GLVFXVV VRPH LPSRUWDQW PDWKHPDWLFDO UHODWLRQVKLSV DQG XVH WKHP WR HVWLPDWH VRIWZDUHUHOLDELOLW\IURPWHVWLQJWRRSHUDWLRQ:HSURSRVH DQLQQRYDWLYHDSSURDFKWRGHVFULEHWKHWUDQVLWLRQVIURPWKH WHVWLQJ SKDVH WR WKH RSHUDWLRQDO SKDVH  7KLV DSSURDFK DOORZV XV WR XQGHUVWDQG WKH VRIWZDUH IDLOXUH EHKDYLRU GXULQJ RSHUDWLRQ  7KDW LV WKH PHWKRG FDQ RIIHU D TXDQWLWDWLYHDQDO\VLVRIIDLOXUHGLVWULEXWLRQLQWKHILHOG     





RSHUDWLRQDQGFDQDOVRIHHGEDFNVRPHLQIRUPDWLRQWRWKH GHYHORSPHQW SURFHVV  &RQVHTXHQWO\ LW KDV D VLJQLILFDQW SRWHQWLDOLQSUHGLFWLQJDQGFRQWUROOLQJVRIWZDUHUHOLDELOLW\ GXULQJRSHUDWLRQ  ,Q 6HFWLRQ  ZH GLVFXVV WKH XQLILFDWLRQ RI 65*0V EDVHGRQ1+33V)XUWKHUPRUHZHSUHVHQWDQHZJHQHUDO 1+33 PRGHO ZLWK WKH SRZHU WUDQVIRUPDWLRQ  6HFWLRQ  GLVFXVVHV WKH SDUDPHWHU HVWLPDWLRQ DQG PDWKHPDWLFDO SURSHUWLHV  ,Q 6HFWLRQ  ZH HVWLPDWH DQG FRPSXWH WKH VRIWZDUH RSHUDWLRQDO UHOLDELOLW\ XVLQJ WKH XQLILHG WKHRU\ )LQDOO\WKHFRQFOXVLRQVDUHJLYHQLQ6HFWLRQ

!

$JHQHUDOGLVFUHWH1+33PRGHO

  )RUWKHGLVFUHWH*RHO2NXPRWRPRGHO>@VXSSRVHWKDW WKH H[SHFWHG QXPEHU RI HUURUV GHWHFWHG SHU WHVW UXQ LV SURSRUWLRQDO WR WKH FXUUHQW HUURU FRQWHQW RI D VRIWZDUH V\VWHPWKDWLV 

PL −PL  ED−PL  

5HYLHZVRIZHLJKWHGDULWKPHWLFZHLJKWHG JHRPHWULFDQGZHLJKWHGKDUPRQLFPHDQV

  +HUH ZH ILUVW UHYLHZ WKUHH ZHOONQRZQ PHDQV DULWKPHWLF JHRPHWULF DQG KDUPRQLF PHDQV > @ /HW [ ≥  DQG \ ≥  WKHDULWKPHWLFPHDQ]RI[DQG\LV GHILQHGDV 







]= [+

\ 

 0RUHJHQHUDOO\WKHZHLJKWHGDULWKPHWLFPHDQ]RI[DQG\ ZLWKZHLJKWVZDQG 1−ZLVGHILQHGDV 

] Z[1−Z \Z



7KHJHRPHWULFPHDQ]RI[DQG\LVGHILQHGDV 

]=

[\ 

7KDWLV  OQ ] =

 

OQ [ +

 

OQ \ 



6LPLODUO\WKHZHLJKWHGJHRPHWULFPHDQ]RI[DQG\ZLWK ZHLJKWVZDQG−ZLVGHILQHGDV 

 OQ ] = Z OQ [ +  − Z OQ \ Z

)LQDOO\WKHKDUPRQLFPHDQ]RI[DQG\LVGHILQHGDV 

 ]

=

 [

+

 \





DQGWKHZHLJKWHGKDUPRQLFPHDQ]RI[DQG\ZLWKZHLJKWV ZDQG−ZLVGHILQHGDV    = Z +  − Z Z ] [ \ %DVHGRQWKHFRQFHSWRIZHLJKWHGPHDQZHZLOOGHULYHD JHQHUDOGLVFUHWH1+33PRGHOLQWKHQH[WVXEVHFWLRQ



 



ZKHUHD P ∞ LVWKHH[SHFWHGQXPEHURIVRIWZDUHHUURUV WREHHYHQWXDOO\GHWHFWHGDQGELVWKHHUURUGHWHFWLRQUDWH SHUHUURUZKLFKLVDFRQVWDQW7DNLQJZ=1−EZHKDYH 

1RQKRPRJHQHRXVSRLVVRQSURFHVVPRGHOV !





PL  ZPL 1−Z D



 



7KLV VKRZV WKDW PL  LV H[SUHVVHG E\ WKH ZHLJKWHG DULWKPHWLFPHDQRIPL DQGD1RZFRQVLGHUWKHFDVHWKDW PL LVHTXDOWRWKHZHLJKWHGJHRPHWULFPHDQRIPL DQG DZLWKZHLJKWVZDQG1−ZWKHQ 



 P L + 

=Z

 P L

+  − Z

 D

 

  

ZKHUHZDQGD!  1H[WFRQVLGHUWKHFDVHWKDWPL LVHTXDOWRWKHZHLJKWHG KDUPRQLFPHDQRIPL DQGDZLWKZHLJKWVZDQG1−ZWKHQ 

 OQ P L +  = Z OQ P L +  − Z OQ D   

ZKHUHZDQGD!

 0RUH JHQHUDOO\ OHW J EH D UHDOYDOXHG DQG VWULFWO\ PRQRWRQLF IXQFWLRQ DQG PL  EH HTXDO WR WKH TXDVLDULWKPHWLF PHDQ RI PL  DQG D ZLWK ZHLJKWV Z DQG ZUHVSHFWLYHO\WKHQ 

 J  P L +  = ZJ  P L +  − Z J  D   

ZKHUHZDQGD!  ,IZLQ(T LVQRWDFRQVWDQWIRUDOOLDQGOHWPL EH HTXDO WR WKH TXDVLDULWKPHWLF PHDQ RI PL  DQG D ZLWK ZHLJKWVZL DQG−ZL UHVSHFWLYHO\WKHQ(T FDQEH JHQHUDOL]HGDV 

 J  P L +  = ZL J  P L +  − ZL J  D    

ZKHUHZL DQGD!





 6ROYLQJ(T ZH\LHOG L L  J  P L = ∏ Z M J  P  +  − ∏ Z M J  D  M

=

M

=





 = X J  P   +  − X J  D   L



L

 

 P L = J

=



X J  P   +  − X J  D   L

L

 

 P W = D  − N H[S> − % W @ D!  < N ≤    λW  DNEW H[S[−%W @



LVWKHJHQHUDOGLVFUHWH1+33PRGHO

 5WV  H[S[−DNH[S[−%V ]−H[S[−%WV @@



$JHQHUDOFRQWLQXRXVVRIWZDUHUHOLDELOLW\ JURZWKPRGHO

  ,QWKLVVXEVHFWLRQZHZLOOGLVFXVVDJHQHUDOFRQWLQXRXV 1+33 PRGHO  6LPLODU WR WKH DERYH GLVFXVVLRQ LQ WKH GLVFUHWHFDVHOHWPW ∆W EHHTXDOWRWKHTXDVLDULWKPHWLF PHDQRIPW DQGDZLWKZHLJKWVZW ∆W DQG 1−ZW ∆W  WKHQ !

JPW ∆W ZW ∆W JPW 1−ZW ∆W JD   

ZKHUH ZW ∆W  DQG J LV D UHDOYDOXHG VWULFWO\ PRQRWRQLFDQGGLIIHUHQWLDEOHIXQFWLRQ 

7KDWLV 

 J  D + ^J  P  − J  D ` H[S> − % W @   W

7KHUHIRUH −

−

DQG %  W = ∫ E X GX   &RUROODU\%DVHGRQWKHZHLJKWHGDULWKPHWLFPHDQWDNH J[  [LQ(T DQGOHWN 1−P DWKHQ

L



P W = J 

L ZKHUH X DQG X = ∏ Z M IRUL ≥  M



J  P W + ∆W − J  P  W

 =

∆W  − Z  W  ∆W

∆W ZKHUHZW ∆W  

 GW  EW   &RUROODU\%DVHGRQWKHZHLJKWHGJHRPHWULFPHDQWDNH J[  OQ[LQ(T DQGOHWN P DWKHQ 

 P W = DN

H[S> − %  W @

 λW  −DOQN EW H[π[−%W @NH[S>−% @ W

 5WV  H[S[−DNH[S>−%

WV

−NH[S>−% @@ V

 GW  EW PW OQα−OQPW α−PW   ,IEW LVQRQGHFUHDVLQJLQWWKHQGW LVQRQGHFUHDVLQJ

 &RUROODU\%DVHGRQWKHZHLJKWHGKDUPRQLFPHDQWDNH J[  [LQ(T DQGOHWN DP) −1WKHQ  J  D − J  P  W   D D!  < N ≤    P W =   + N H[S> − %  W @ 



 λW  

DNE W H[S> − %  W @  + N H[S> − % W @

 5WV  H[S> − D × 



)RU J[   [ LQ (T   LH FRQVLGHULQJ WKH ZHLJKWHG DULWKPHWLFPHDQFRQVLGHUHG WKHQ ∂  J  P  W = E W  D − P  W    ∂W   

+HUHEW LVWKHHUURUGHWHFWLRQUDWHSHUHUURU)XUWKHUPRUH LIEW  EWKHQWKH*RHO2NXPRWRPRGHOFDQEHGHULYHG IURP(T 7KHGLIIHUHQWLDOHTXDWLRQVIRUJ[  OQ[DQG J[  [FDQDOVREHGHULYHGIURP(T UHVSHFWLYHO\  ∂ 7KHRUHP/HW J  P  W = E W  J  D − J  P  W  ∂W ZKHUH J LV D UHDOYDOXHG VWULFWO\ PRQRWRQLF DQG GLIIHUHQWLDEOHIXQFWLRQ:HKDYH>@



]

LQW

6XSSRVH (1−ZW ∆W  ∆W → EW  DV ∆W →  ZH JHW WKH GLIIHUHQWLDOHTXDWLRQ ∂  J  P  W = E W  J  D − J  P  W     ∂W



D!N





  + N H[S> − % W + V @ 

− 

@   + N H[S> − %  V @  GW  EW PW D   ! :HKDYHDOUHDG\VKRZQWKDW VHYHUDOFODVVLFDO65*0V EDVHGRQ1+33VFDQEHGLUHFWO\GHULYHGIURP&RUROODU\ RULQ>@7KH\DUH*RHO2NXPRWRPRGHO*RPSHUW] JURZWK FXUYH /RJLVWLF JURZWK FXUYH *RHO JHQHUDOL]HG 1+33PRGHO'HOD\HG6VKDSHGPRGHO,QIOHFWHG6VKDSHG PRGHO 0RGLILHG 'XDQH PRGHO 7ZR W\SHV RI VRIWZDUH HUURUV PRGHO DQG :HLEXOOW\SH WHVWLQJHIIRUW IXQFWLRQ PRGHO>@,QWKHIROORZLQJZHZLOOVKRZWKDWRWKHUQHZ 65*0VZKLFKDUHSURSRVHGUHFHQWO\FDQDOVREHGHULYHG IURPWKHVHFRUROODULHV  





„/RJORJLVWLFVRIWZDUHUHOLDELOLW\JURZWKPRGHO 

7KLV PRGHO ZDV SURSRVHG E\ *RNKDOH DQG 7ULYHGL >@ 7KH\ WULHG WR RIIHU D GHFRPSRVLWLRQ RI WKH PHDQ YDOXH IXQFWLRQRIDILQLWHIDLOXUH1+33PRGHOZKLFKFDQFDSWXUH WKH LQFUHDVLQJGHFUHDVLQJ QDWXUH RI WKH KD]DUG IXQFWLRQ 7KDW LV WKH LQFUHDVLQJGHFUHDVLQJ EHKDYLRU RI WKH IDLOXUH RFFXUUHQFH UDWH SHU IDXOW FDQ EH FDSWXUHG E\ WKH KD]DUG IXQFWLRQRIWKHORJORJLVWLFGLVWULEXWLRQ  7DNHJ[  [DQGEW  NWWKHQIURP&RUROODU\





 @    + $ H[S> −αW @  + $  1

 P W = D  − N H[S> −E 

1

−



)XUWKHUPRUHLIN WKHQ 



 @   + $ H[S> −αW @  + $  1

 P W = D  − H[S> −E 

1

−



,Q DGGLWLRQ WR WKH SUHYLRXVO\ PHQWLRQHG WKUHH NQRZQ PHDQV ZH SURSRVH D PRUH JHQHUDO WUDQVIRUPDWLRQ ZKLFK LQFOXGHVDSDUDPHWULFIDPLO\RISRZHUWUDQVIRUPDWLRQV 

 PW = D ×

FW

N

 D >  F >  G >  N >    N  + G FW /HWF λNDQGG ZHJHWWKHORJORJLVWLFIRUP 

N N

 P W = D

λ W

=D

N N

+ λ W

 λW N   N  +  λW



„65*0ZLWKORJLVWLFWHVWLQJHIIRUWIXQFWLRQ 

,Q WKH ILHOG RI VRIWZDUH UHOLDELOLW\ PRGHOLQJ 0XVD ILUVW GLVFXVVHGWKHYDOLGLW\RIH[HFXWLRQWLPHWKHRU\E\WDNLQJ GDWDVHWVIURPUHDOVRIWZDUHV\VWHPVDVWHVWLQJHIIRUWFDQ EHIDLWKIXOO\UHSUHVHQWHGE\H[HFXWLRQWLPH>@+RZHYHU PRVW H[LVWLQJ VRIWZDUH UHOLDELOLW\ PRGHOV GR QRW WDNH WHVWLQJHIIRUWLQWRFRQVLGHUDWLRQ5HFHQWO\ZHSURSRVHGD VLPSOH DQG QHZ VRIWZDUH UHOLDELOLW\ JURZWK PRGHO ZLWK ORJLVWLF WHVWLQJHIIRUW IXQFWLRQ >@  7KLV PRGHO DWWHPSWVWRDFFRXQWIRUWKHUHODWLRQVKLSDPRQJWKHFDOHQGDU WHVWLQJ WKH DPRXQW RI WHVWLQJHIIRUW DQG WKH QXPEHU RI VRIWZDUHIDXOWVGHWHFWHGGXULQJWHVWLQJ7KHWHVWLQJHIIRUW FDQEHPHDVXUHGDVWKHKXPDQSRZHUWKHQXPEHURIWHVW FDVHVWKHQXPEHURI&38KRXUVHWF7KHPHDQYDOXH IXQFWLRQPW FDQEHGHVFULEHGDVIROORZ 

 P W = D  − H[S> − E: W − :   @ 





 @    + $ H[S> −αW @  + $ 

 = D  − H[S> −E 

1

−

1



ZKHUHD LV WKH H[SHFWHG QXPEHU RI LQLWLDO IDXOWV E LV WKH HUURUGHWHFWLRQUDWHSHUXQLWWHVWLQJHIIRUWDWWHVWLQJWLPHW WKDWVDWLVILHVE!1LVWKHWRWDODPRXQWRIWHVWLQJHIIRUWWR EH HYHQWXDOO\ FRQVXPHG α LV WKH FRQVXPSWLRQ UDWH RI WHVWLQJHIIRUWH[SHQGLWXUHVDQG$LVDFRQVWDQW ,I ZH WDNH J[   [ DQG EW = &RUROODU\ZHKDYH



E1$αH

 [α −    α ≠    J  [ =  α  OQ [  α = 

( + $H )



 



1RWH J[  LV RQO\ RQH RI PDQ\ SDUDPHWULF IDPLOLHV RI WUDQVIRUPDWLRQVWKDWFDQEHDSSOLHGIRUGDGDDQDO\VLV  &RUROODU\  %DVHG RQ WKH SRZHU WUDQVIRUPDWLRQ LI ZH

 [α −    α ≠  LQWR(T DQG WDNH J  [ =  α  OQ [  α =  α

 P    N   −   WKHQ  D   P W = D  − NH

−%W





α

α ≠   −α

−% W −% W  λ  W =  DN%  W H  − NH

α − %  V  α −   5  W _ V = H[S^D> − N   − NH

−

% W

+

V





α

α

α ≠  

@` α ≠   −α



 N%  W H − %  W  − NH − %  W α α   G  W = − %  W α  −  − N



α

 P       D 

ZKHUH N =  − 

 ,I α =  WKHQWKHUHVXOWLVWKHVDPHDV&RUROODU\  3URRI

−αW

 IURP −αW 



L 6LQFH J  [ =

[

α

−

α

 α ≠  WKDWLV



 

−

 J  \ = α\ +  α   )URP(T ZHNQRZ



 P W = D  − NH LLL  ,I E W =

−

 J  D + ^J  P  − J  D ` H[S> − % W @ 

α

α

H[S> − %  W @ 

α

LY  ,I E W =

α α

P   − D

ZKHUHN¶

+ N × H[S> − % W @ 

α

α D −

 &RQVHTXHQWO\ 

P W = J

−

P   − 

α



Y ,I E W =

 =  D

α

α



+ N × H[S> − %  W @

α

 α + 

 D

α

 α ≠   

− EW





α

 α ≠   

E

 LH % W = EW + OQ −EW

 + FH

− EW



 α

α

× D

α

 α −  P  × H[S> − % W @ 

α



α



 D ×  − N × H[S> − %  W @ α  α

 P    ZKHUH N =  −     D 











7KHSURRIVIRULL WRY DUHVWUDLJKWIRUZDUGDQGRPLWWHG KHUH  $OWRJHWKHU EDVHG RQ WKH &RUROODU\  ZH FDQ JHQHUDWH VRPHQHZPRGHOVZLWKYDULRXVEW 



L  ,I EW   E LH %W   EW WKHQ WKH QHZ PHDQ YDOXH IXQFWLRQ09) LV  P W = D  − H  

− EW





α

  α ≠   

LL ,I EW = EFW  LH % W = EW PHDQYDOXHIXQFWLRQ09) LV

F

− EW

N  + F H  + FH



− EW



α

 α ≠   





 =  D ×  − N × H[S> − %  W @ α 

F−

α

3DUDPHWHUHVWLPDWLRQDQGPRGHOSURSHUWLHV

+  P  − D × H[S> − %  W @ 

 =  D ×  −









α

α

E

F



+ F  + FH WKHQWKHQHZPHDQYDOXHIXQFWLRQ09) LV  

 J  D + ^J  P  − J  D ` H[S> − % W @ 

 α × 

WKHQWKHQHZ

E W

 P  W = D  −

D −

E





α

E+W

 P W = D  −  + EW NH

α

DQG J  D =

E+W



α

 J  P  =

 α ≠   

 LH %  W = EW − OQ + EW  WKHQ  + EW WKHQHZPHDQYDOXHIXQFWLRQ09) LV

α

D −

 =

α



7KHUHIRUHWKURXJKVRPHVLPSOHFDOFXODWLRQVZHREWDLQ  P W = D  − N 

P   − D



 LH %  W = F OQ



 J  D + 



E+W PHDQYDOXHIXQFWLRQ09) LV



P W = J

F

−EW F

 WKHQ WKH QHZ

 0D[LPXP OLNHOLKRRG HVWLPDWLRQ DQG OHDVW VTXDUHVHVWLPDWLRQ 

 )LWWLQJDSURSRVHGPRGHOWRDFWXDOIDLOXUHGDWDLQYROYHV HVWLPDWLQJ WKH PRGHO V SDUDPHWHUV IURP WKH UHDO WHVW GDWD VHWV  0D[LPXP OLNHOLKRRG HVWLPDWLRQ LV RQH RI WKH PRVW SRSXODUHVWLPDWLRQWHFKQLTXHV7KHPD[LPXPOLNHOLKRRG WHFKQLTXH HVWLPDWHV SDUDPHWHUV E\ VROYLQJ D VHW RI VLPXOWDQHRXVHTXDWLRQVDQGLWLVHDV\WRGHULYHFRQILGHQFH LQWHUYDOV>@  /HW ^WN N   «` GHQRWH WKH VHTXHQFH RI WLPHV EHWZHHQVXFFHVVLYHVRIWZDUHIDLOXUHV7KHQWNLVWKHWLPH EHWZHHQN DQGNWKIDLOXUH/HWTN GHQRWHWKHWLPHWR IDLOXUHNWKHQ WK



N

6 N = ∑ W N  L

=



)RU D JLYHQ VHTXHQFH RI VRIWZDUH IDLOXUH WLPHV 6 6 66Q WKHMRLQWGHQVLW\RUWKHOLNHOLKRRGIXQFWLRQRI6 66QFDQEHZULWWHQDV  I 66 6Q  6 6  6Q = H

−P  VQ

Q

∏ λV  L =

L

7KXVWKHORJOLNHOLKRRGLQWKHFDVHRISRZHUWUDQVIRUPDWLRQ RI1+33PRGHOFDQEHZULWWHQDV 

/ D  α  N V = − D  − NH

− %  VQ





α

+ Q ORJ DN + 



 Q



−α Q

 ∑ ORJ %  VL + ∑ ORJ − NH L = α L =

− %  VL

 



0D[LPL]LQJWKHDERYHHTXDWLRQZLWKUHVSHFWWRDNDQG α  ZHKDYH ∂/ z =  WKDWLV   ∂D Q − %  VQ   α  =  − NH   D ∂/ =  WKDWLV z ∂α  Dα  − NH z 

∂/ ∂N

− %  VQ

−α

IXQFWLRQVLHWKHFXPXODWLYHQXPEHURIGLVFRYHUHGIDXOWV +HUHZHGLVFXVVVRPHLPSRUWDQWPDWKHPDWLFDOSURSHUWLHV DERXWWKHSURSRVHGPHDQYDOXHIXQFWLRQPW   $FRQWLQXRXVIXQFWLRQI[ LVFDOOHGDFRQFDYHFXUYHLI 

G I G[



WKDWLV

 OLP

G[

LVGHFUHDVLQJLQ[DQGWKHQZHKDYH

I  [ − I  [ − K

! OLP

I  [ + K − I  [

K→ K ZKHUH − ∞ < [ < ∞ DQGK! K→

K

L

[ L + − [ L

[ L − [ L −

L

L

L

Q N

=

−α Q H   ∑ α L = − NH − %  VL

6ROYLQJ WKHVH WKUHH QRQOLQHDU HTXDWLRQV VLPXOWDQHRXVO\ ZHFDQREWDLQWKHSRLQWHVWLPDWHVRIDNDQGα,QDGGLWLRQ IRU /HDVW 6TXDUHV (VWLPDWLRQ JHQHUDOO\ WKH GDWD VHW LV JLYHQLQWKHIRUP 

ZKHUHPMLVWKHWRWDOQXPEHURIIDXOWVGHWHFWHGE\WLPHWM  )RUWKLVPHWKRGWKHHYDOXDWLRQIRUPXOD6DU LV Q



 6  D  U = ∑ > PN − P W N @  N =





ZKHUHPNLVWKHFXPXODWLYHQXPEHURIGHWHFWHGIDXOWVLQD JLYHQ WLPH LQWHUYDO  WN@ DQG PWN  LV WKH HVWLPDWHG FXPXODWLYH QXPEHU RI GHWHFWHG IDXOWV LQ WKH PHDQ YDOXH IXQFWLRQ 

 'LIIHUHQWLDWLQJ 6 ZLWK UHVSHFW WR D DQG U VHWWLQJ WKH SDUWLDOGHULYDWLYHVWR]HURDQGUHDUUDQJLQJWKHVHWHUPVZH FDQVROYHWKHQRQOLQHDUOHDVWVTXDUHSUREOHP



0DWKHPDWLFDOSURSHUWLHV    )URP WKH GLVFXVVLRQV LQ 6HFWLRQ  ZH NQRZ WKDW 65*0V FDQ EH XVHG WR HVWLPDWH WKH QXPEHU RI UHVLGXDO IDXOWVDQGGLIIHUHQWPRGHOVFDQREWDLQGLIIHUHQWPHDQYDOXH

L

,

KDYH

G I G[

!!!!!! OLP



GI

!WKDWLV

G[

I  [ − I  [ − K K

K→

L

L



FXUYHLI



WP WP WP WP WP WQPQ 

 



ZKHUH[ [ [  )XUWKHUPRUHDVVXPLQJ[ [  [  −[ IRUL ≥ WKHQ(T  FDQEHUHGXFHGWR  I[  I[  −I[  L     6LPLODUO\ D FRQWLQXRXV IXQFWLRQ I[  LV FDOOHG D FRQYH[ L

− %  VL

 

  ,IZHFRQVLGHUWKDWDGLVFUHWHIXQFWLRQI[ LVFRQFDYHWKHQ (T FDQEHPRGLILHGDV

L =



 

GI

Q − %  VL I  [ L − I  [ L − I  [ L + − I  [ L α + ∑ ORJ − NH =    !!!!!!!!! ?

=  WKDWLV









L

L

LVLQFUHDVLQJLQ[DQGWKHQZH

= OLP

I  [ + K − I  [ K

K→

!!!!) 

 ,IZHFRQVLGHUWKDWDGLVFUHWHIXQFWLRQI[ LVFRQYH[WKHQ (T FDQEHPRGLILHGWREH L





I  [ L − I  [ L − [ L − [ L −



I  [ L + − I  [ L [ L + − [ L

   

)XUWKHUPRUHDVVXPLQJ[ −[  [  −[ IRUL ≥ WKHQ(T  FDQEHUHGXFHGWR L

L

L



L



 I  [ L + + I  [ L − −  I  [ L >  L 

 

!

,Q DGGLWLRQ D FRQWLQXRXV IXQFWLRQ I[  LV FDOOHG DQ 

6VKDSHGFXUYHLIWKHUHH[LVWVDQ;VXFKWKDW 

DOO[;DQG

G I G[



G I G[



≥ IRU

IRUDOO[ ≥ ;$VVXPLQJWKDW[ι−[ >!

[  −[ IRUL ≥ DQGE\WKHVDPHDUJXPHQWDERYHDGLVFUHWH IXQFWLRQ I[  FDQ UHSUHVHQW DQ 6VKDSHG FXUYH LI WKHUH H[LVWVDILQLWHLQWHJHU,!VXFKWKDW L



L

L



*HQHUDOO\WKH'1&21)VXEURXWLQHRI,06/0$7+/LEUDU\FDQEH XVHGWRREWDLQWKHSDUDPHWHUHVWLPDWHV+RZHYHUWKHUHDUHVWLOOPDQ\ PDWKHPDWLFDOVRIWZDUHSDFNDJHVDYDLODEOHLQZRUNVWDWLRQVRU3&VZKLFK DUHHDVLHUWRXVHWRKHOSXVLQHVWLPDWLQJWKHVHSDUDPHWHUV



1



L

DQG

I  [ L + + I  [ L − −  I  [ L ≥  IRUDOOL,



 I  [ L + + I  [ L − −  I  [ L <  IRUDOOL ≥ , 

7KHSRLQWZKHUH

G I





GZ W

 = DU H[S> − U:  W @ ×  − U  Z W !!! GW

GW    DQG 

GW



 H[S>

αW 

αW 

@ − $ H[S>

@ + $ H[S> − αW 

− αW

@



−

×

@  

ZKHUH: W  :W −: DQG :  W =

1  + $H

−αW



7KH VHFRQG GHULYDWLYHV RI :W  DQG PW  FDQ GHWHUPLQH ZKHQWKHLQIOHFWLRQSRLQWZLOORFFXU! 

'HILQLWLRQ  /HW φ W =

G



ZW − U  Z W DQG ZH FDOO GW φW WKHLQIOHFWLRQDOIDFWRURIWKHPHDQYDOXHIXQFWLRQPW  DWWLPHW!! ! ! ! ! ! ! ! 7KDW LV E\ FDOFXODWLQJ φ W  ZH FDQ NQRZ ZKHWKHU WKH PHDQYDOXHIXQFWLRQPW RI(T LVDFRQFDYHRUFRQYH[ FXUYH LQ FHUWDLQ LQWHUYDO  7KHUHIRUH WKURXJK VRPH FDOFXODWLRQV LW LV QRWHG WKDW :W  KDV RQO\ RQH LQIOHFWLRQ SRLQWDW W

=

 W P =

OQ

α



α

$

PW KDVRQO\RQHLQIOHFWLRQSRLQWDW

OQ

 

DQG W P < W 



$       E 1 +  − E1   











6LPLODUO\ EDVHG RQ &RUROODU\  ZH FDQ JHQHUDWH D QHZ PHDQYDOXHIXQFWLRQLQ(T LH 

 P W = D  − NH

−%W





α

 α ≠  



DQGXVHLWWRHVWLPDWHVRIWZDUHUHOLDELOLW\  ,IZHOHW



GW



 >

G % W GW



−

G% W GW

−×

 @ − NH − %  ×  W

G%  W GW



@ 



WKHUHZLOOH[LVWDQ η VXFKWKDW ' η =  7KDWLVZHFDQ WUHDW η DVWKHLQIOHFWLRQSRLQWIRUWKLVPHDQYDOXHIXQFWLRQ ,QIDFWWKHLQIOHFWLRQSRLQWFDQEHHDVLO\GHULYHGE\XVLQJ 



G PW GW



= DNH − %  W  − NH − %  W

 α

× ' W 



= −α 1$ × H[S>



G % W 





G : W



'W   >

LVFDOOHGWKHLQIOHFWLRQSRLQWRI



G[ WKH FXUYH  )RU H[DPSOH XVLQJ WKH PHDQ YDOXH IXQFWLRQ 09) ZHSURSRVHGLQ(T ZHNQRZWKLVPHDQYDOXH IXQFWLRQ LV SRVLWLYH DQG PRQRWRQLFDOO\ LQFUHDVLQJ 7KHUHIRUHZHREWDLQ G P W



)RUH[DPSOHLI%W  EWDQG α LHWKH*2PRGHO  OQ N  WKHQWKHLQIOHFWLRQSRLQWRFFXUVZKHQ W = E



6RIWZDUHRSHUDWLRQDOUHOLDELOLW\HVWLPDWLRQ

  ,Q JHQHUDO WKH SHUIRUPDQFH RI D VRIWZDUH V\VWHP VWURQJO\ GHSHQGV RQ LWV H[HFXWLRQ HQYLURQPHQW  7KDW LV WKH UHOLDELOLW\ RI D VRIWZDUH V\VWHP GHSHQGV RQ KRZ LW LV H[HFXWHG  ,Q JHQHUDO WKH VRIWZDUH H[HFXWLRQ HQYLURQPHQW LQFOXGHVWKHRSHUDWLQJV\VWHP26 WKHKDUGZDUHSODWIRUP WKHZRUNORDGDQGWKHRSHUDWLRQDOSURILOH>@,QSUDFWLFH WKHIDXOWGHWHFWLRQSKHQRPHQRQLQWKHRSHUDWLRQDOSKDVHLV GLIIHUHQWIURPWKDWLQWKHWHVWLQJSKDVH>@+RZHYHU WKLV IDFW LV QRW GLVWLQFWO\ LQFRUSRUDWHG LQ PDQ\ VRIWZDUH UHOLDELOLW\PRGHOLQJHIIRUWV+HUHZHDWWHPSWWRGHVFULEH !WKH IDXOW GHWHFWLRQ EHKDYLRU XVLQJ WKH XQLILHG WKHRU\ RI 1+33 PRGHOV GXULQJ WKH RSHUDWLRQDO SKDVH  7KDW LV VLPLODUWRWKHIDXOWGHWHFWLRQSURFHVVLQWKHVRIWZDUHWHVWLQJ SKDVH ZH FDQ IRUPXODWH DQG VLPXODWH WKH IDXOW GHWHFWLRQ SURFHVV LQ WKH RSHUDWLRQDO SKDVH  )RU H[DPSOH E\ UHDUUDQJLQJ(T WKHGHWHFWLRQUDWHSHUUHPDLQLQJIDXOW DW WHVWLQJ WLPH W FDQ EH GHVFULEHG  7KLV UHSUHVHQWV WKH GHWHFWDELOLW\ RI D IDXOW IRU WKH FXUUHQW IDXOW FRQWHQW > @ 



G W =



GP  W  GW D − PW

= E × ZW 

 



ZKHUHZW LVFXUUHQWWHVWLQJHIIRUWFRQVXPSWLRQDWWLPHW ELVWKHIDXOWGHWHFWLRQUDWH)'5 SHUXQLWWHVWLQJHIIRUW  %\ XVLQJ (T   )LJ  GHVFULEHV WKH UHODWLRQVKLS EHWZHHQ WKH IDXOW GHWHFWLRQ DQG WKH WHVWLQJHIIRUW H[SHQGLWXUHVIRU2KED¶VGDWDVHW>@,WLVQRWHGWKDWWKH VRIWZDUHGHYHORSPHQWSURFHVVLVLQWKHWHVWLQJSKDVHEHIRUH WKH ZHHN+RZHYHUDIWHUWKH ZHHNDQ\WLPHFDQ EH WKH RSWLPDO UHOHDVH WLPH GHSHQGLQJ RQ WKH FRVW UHOLDELOLW\ DQGRU FRVWUHOLDELOLW\ UHTXLUHPHQWV 7KXV WKH GHWHFWDELOLW\ RI IDXOWV GXULQJ VRIWZDUH WHVWLQJ DQG WK

WK







RSHUDWLRQDOSKDVHPD\EHDVVXPHGDV>@ 

 E × Z W ≥ ERS × ZRS  V  



  

ZKHUHERS LVWKHIDXOWGHWHFWLRQUDWHSHUXQLWRSHUDWLRQHIIRUW ZRS V  LV WKH RSHUDWLRQHIIRUW H[SHQGLWXUHV FRQVXPHG DW WLPHVDQGVLVWKHWLPHLQWHUYDOLQWKHRSHUDWLRQDOSKDVH  1RWHWKHYDOXHVRIERS DQGZRS V FDQEHHVWLPDWHGDQG FRPSXWHGIURPWKHSDVWH[SHULHQFHEHIRUHWKHRSHUDWLRQDO SKDVH EHJLQV  6XSSRVH WKDW LI ERS LV KDOI RI E LH ERS  × E WKHQ ZH ILQG WKDW WKH VORSH RI IDXOW GHWHFWDELOLW\GW GHFUHDVHVYHU\VORZO\7KHUHDVRQLVWKDW WKH UHPDLQLQJ IDXOWV RI D VRIWZDUH V\VWHP DUH UHODWLYHO\ GLIILFXOWWRILQG2QWKHRWKHUKDQGLIWKLVVRIWZDUHLVYHU\ SRSXODU LQ WKH PDUNHW WKHUH PD\ EH PDQ\ ³H[FHOOHQW WHVWHUV´WRWHVWDQGGHEXJLW+HQFHWKHGW ZLOOGHFUHDVH PRUHUDSLGO\+RZHYHUZRS V LVXVXDOO\DVVXPHGWREHD FRQVWDQW>@+HQFHIDXOWGHWHFWDELOLW\LQWKHRSHUDWLRQDO SKDVHLVGRPLQDWHGE\ERS DQGERS LVVLJQLILFDQWO\DIIHFWHG E\E&RQVHTXHQWO\ZHFDQFRQFOXGHWKDWERS DQGEDUHWKH NH\ SDUDPHWHUV LQ PRGHOLQJ VRIWZDUH UHOLDELOLW\ GXULQJ VRIWZDUHGHYHORSPHQWSURFHVV   















GW 

   GW

E ZW GW  E ZW GW  E ZW GW  E ZW

  



 P  V = D  − N H[S − EV   < W < V < ∞  







ZKHUHWLVWKHWLPHWRHQGWKHWHVWLQJ  7KHIDLOXUHLQWHQVLW\GXULQJRSHUDWLRQLV

 









7LPH:HHNV 

!

)LJXUH7KHGHWHFWDELOLW\RIIDXOWVGXULQJ VRIWZDUHWHVWLQJDQGRSHUDWLRQDOSKDVH IRU2KED¶VGDWDVHW    ,WKDVEHHQZLGHO\FRQFHLYHGWKDWWKHRSHUDWLRQDOSURILOH RIDVRIWZDUHV\VWHPPD\EHHVVHQWLDOO\GLIIHUHQWIURPWKH SURILOHXVHGGXULQJWHVWLQJ>@,QDQ\FDVHZHZLVK WRHVWDEOLVKDVLPSOHOLQNEHWZHHQWHVWLQJDQGRSHUDWLRQWR PRGHOVRIWZDUHUHOLDELOLW\$PRQJYDULRXV1+3365*0V WKHWZRPRVWLPSRUWDQWSDUDPHWHUVDUHWKHQXPEHURILQLWLDO IDXOWVDQGWKHIDXOWGHWHFWLRQUDWH7KHQXPEHURILQLWLDO IDXOWV LV WKH QXPEHU RI IDXOWV LQ WKH VRIWZDUH DW WKH EHJLQQLQJ RI WHVW DQG WKLV YDOXH ZLOO QRW QRUPDOO\ EH FKDQJHG H[FHSW IRU LPSHUIHFW GHEXJJLQJ ZKHQ VZLWFKLQJ IURP VRIWZDUH WHVWLQJ WR RSHUDWLRQ  :H GR QRW QHHG WR DVVXPHSHUIHFWGHEXJJLQJKHUHVLQFHLWLVEH\RQGWKHVFRSH



RIWKLVSDSHU,QFRQWUDVWWKHIDXOWGHWHFWLRQUDWHLVXVHGWR PHDVXUH WKH HIIHFWLYHQHVV RI GHWHFWLQJ IDXOWV E\ WHVW WHFKQLTXHVDQGWHVWFDVHVZKLFKLVPRUHOLNHO\WRFKDQJH 7KHUHIRUHZHFRQFHQWUDWHRQWKH)'5WUDQVIRUPDWLRQIURP WKHWHVWLQJSKDVHLQWRWKHRSHUDWLRQDOSKDVH  ,QRUGHUWRGHVFULEHWKHSRVVLEOHIDXOWGHWHFWLRQSURFHVV WR GHULYH WKH EHVWILWWHG PHDQ YDOXH IXQFWLRQ DQG WR SURYLGH DFFXUDWH HVWLPDWHV RI QHHGHG SDUDPHWHUV GXULQJ RSHUDWLRQ ZH QRZ LQWURGXFH D QHZ DSSURDFK WR HVWLPDWH VRIWZDUHUHOLDELOLW\GXULQJWKHRSHUDWLRQDOSKDVH  'HILQLWLRQ  /HW 7  5 → 5 EH D SURMHFWLRQ ZKLFK LQGLFDWHVWKHWUDQVIRUPDWLRQRIIDXOWGHWHFWLRQUDWHIXQFWLRQ IURPVRIWZDUHWHVWLQJWRRSHUDWLRQ  ! %DVHG RQ WKH XQLILHG WKHRU\ RI JHQHUDO FRQWLQXRXV 1+33 PRGHOV LQ WKH SUHYLRXV VHFWLRQ ZH FDQ REWDLQ VHYHUDO XVHIXO WUDQVIRUPDWLRQV RI )'5 IXQFWLRQ IURP VRIWZDUH WHVWLQJ WR RSHUDWLRQ  8QGHU WKH DVVXPSWLRQ RI XVLQJWKHVDPHJ[ LIWKHRULJLQDO)'5LVDFRQVWDQW WKHQ ZH FDQ FRPSXWH WKH EHVWILWWHG )'5 IXQFWLRQ LQ RUGHU WR UHIOHFW WKH XVHU¶V RSHUDWLRQDO HQYLURQPHQW  %DVHG RQ 7KHRUHPDQG'HILQLWLRQOHWVGHQRWHWKHLQWHUYDODQGE GHQRWH WKH )'5 ZH REWDLQ WKH IROORZLQJ VFHQDULRV IRU GHVFULELQJ WKH VRIWZDUH RSHUDWLRQDO UHOLDELOLW\ WUDQVIRUPDWLRQIURPWHVWLQJWRRSHUDWLRQ  &DVH  ,I 7  V _ E = E  WKDW LV WKH )'5 LV XQFKDQJHG ZKHQVRIWZDUHOLIHF\FOHSURFHHGVWRWKHRSHUDWLRQDOSKDVH WKHQZHFDQJHWWKHHVWLPDWHGPHDQYDOXHIXQFWLRQGXULQJ VRIWZDUHH[HFXWLRQDV



 λ  V = DEN H[S −EV 





  

F −

&DVH  ,I 7  V _ E = EFV  WKHQ ZH FDQ JHW WKH HVWLPDWHGPHDQYDOXHIXQFWLRQGXULQJRSHUDWLRQDV 

F

 P  V = D  − N H[S − EV   < W < V < ∞   

7KHIDLOXUHLQWHQVLW\IXQFWLRQGXULQJRSHUDWLRQLV λV  DEFNV

F −

F

H[S −EV 

  

7KURXJK(T DQG(T ZHNQRZ 



 



λ  V λ  V

FV

=

F −

 

F



H[SEV − EV    (T   LV DQ LQGH[ WKDW VKRZV ZKHWKHU WKH )'5 WUDQVIRUPDWLRQLVUHDVRQDEOHRUQRW&KRRVLQJF!ZHFDQ JHWDSURSHUWUDQVIRUPDWLRQRI)'5IXQFWLRQIURPWHVWLQJ WR RSHUDWLRQDO SKDVH ZKHUH λV  GHFUHDVHV PRUH UDSLGO\ WKDQ λV  PHDQLQJ WKDW D WUDQVIRUPDWLRQ IURP λV  LQ WHVWLQJ WRλV LQRSHUDWLRQ   E WKHQZHFDQJHWWKH &DVH,I 7  V _ E =  + F H[S −EV HVWLPDWHGPHDQYDOXHIXQFWLRQGXULQJRSHUDWLRQDV 

 P  V = D  − N

 + F H[S − EV  + F H[S − EV

  < W < V < ∞  



7KHIDLOXUHLQWHQVLW\IXQFWLRQGXULQJRSHUDWLRQLV 

 λ  V = DEN H[S − EV

+ F  + F H[S −EV





  

7KURXJK(T DQG(T ZHNQRZ 



λ  V λ  V

=

+ F  + F H[S −EV

 



 





&DVH,I 7  V _ E =

E V

WKHQZHFDQJHWWKHHVWLPDWHG  + EV PHDQYDOXHIXQFWLRQGXULQJRSHUDWLRQDV 

P  V = D  − N  + EV H[S − EV   < W < V < ∞   

7KHUHIRUHWKHIDLOXUHLQWHQVLW\IXQFWLRQGXULQJRSHUDWLRQLV  

 λ  V = DE NV H[S − EV  



  





λ  V

=

λ  V

  +  H[S − × V

 



DQG 



λ  V λ  V

=   × V  

  7KURXJKWKHVHWZRILJXUHVDQG(T DQG(T LW LV REYLRXV WKDW WKHVH WZR WUDQVIRUPDWLRQV DUH QRW UHDVRQDEOH IRU JHQHUDO FDVH  )LQDOO\ VR IDU ZH KDYH LOOXVWUDWHGRXUDSSURDFKIRUJ[ [DQGIRXUSRVVLEOH)'5 WUDQVIRUPDWLRQV  z 7  V _ E = E  z 7  V _ E = EFV z 7  V _ E =



z 7  V _ E =





$JDLQZHQRWHWKDWWKHDERYHWUDQVIRUPDWLRQPD\QRWEH UHDVRQDEOHIRUJHQHUDOFDVH   )LJXUHGHSLFWVWKHUDWLRRIIDLOXUHLQWHQVLW\IXQFWLRQV IURPVRIWZDUHWHVWLQJWRRSHUDWLRQDOSKDVHIRUWKH2KED¶V GDWDVHW>@)URP)LJD ZHILQGWKDWWKHWUDQVLWLRQV IURP FDVH  WR FDVH  DUH UHDVRQDEOH DV WKH UDWLR RI λV λV  VKRZ D GHFUHDVLQJ WUHQG  1RWH WKDW RXU QHZ PRGHOV GXULQJ RSHUDWLRQDO SKDVH DUH LVRPRUSKLF WR WKHLU RULJLQDO PRGHOV GXULQJ WHVWLQJ  0RVW SXEOLVKHG SDSHUV DVVXPHGWKDWWKHRSHUDWLRQDOPHDQYDOXHIXQFWLRQKDVWKH VDPH VWUXFWXUH FRPSDUHG ZLWK WKH PHDQ YDOXH IXQFWLRQ GXULQJWHVWLQJ>@7KHPDLQGLIIHUHQFHVDPRQJWKHVH VFKHPHVDUHLQWKHHVWLPDWHVRINH\SDUDPHWHUV%DVLFDOO\ H[LVWLQJ PRGHOV ILUVW FRPSXWH WKH QXPEHU RI UHPDLQLQJ IDXOWVDWWKHHQGRIVRIWZDUHWHVWLQJSKDVHDQGWKHQDGMXVW WKHQRWDWLRQVDQGUHFRPSXWHWKHYDOXHVRIWKHSDUDPHWHUV >@  2XU DSSURDFKHV RQ WKH RWKHU KDQG GR QRW UHTXLUH WKHVHFRPSXWDWLRQV:HRQO\QHHGWRJHWWKHSRVVLEOH)'5 WUDQVLWLRQSURMHFWLRQ IXQFWLRQDQGXQGHUVWDQGWKHQDWXUH DWWULEXWH RI WKH VRIWZDUH SURGXFW GXULQJ WHVWLQJ DQG RSHUDWLRQ DFFRUGLQJ WR SUHYLRXV VRIWZDUH GHYHORSPHQW H[SHULHQFHVRUVRIWZDUHUHOHDVHV  ,Q DGGLWLRQ )LJ E  DQG )LJ F  GHSLFW WKH UDWLR RI IDLOXUHLQWHQVLW\IXQFWLRQWUDQVLWLRQVIURPVRIWZDUHWHVWLQJ WRRSHUDWLRQDOSKDVHZKHQ

F −



6LPLODUO\WKURXJK(T DQG(T ZHNQRZ

= EV  

 





λ  V





6LQFH  ≤ H[S − EV ≤   (T   LV ELJJHU WKDQ  LQGLFDWLQJDWUDQVIRUPDWLRQIURPλ0V WRλV FRXOGQRWEH UHDVRQDEOH 

λ  V



E  + F H[S −EV 

E V  + EV











  +RZHYHU IROORZLQJ WKH VLPLODU SURFHGXUHV DQG VWHSV GLIIHUHQWJ[ ZLWKGLIIHUHQW)'5WUDQVIRUPDWLRQVFDQDOVR EHGHULYHG8VLQJWKHVHPHWKRGVVRIWZDUHGHYHORSHUVFDQ REWDLQ DQ HDUO\ HVWLPDWH RI VRIWZDUH IDLOXUH EHKDYLRU GLVWULEXWLRQ  %HVLGHV ZH FDQ SUHGLFW WKH )'5 RI GLVFRYHULQJ UHPDLQLQJ IDXOW FRQWHQWV LQ VRIWZDUH GXULQJ RSHUDWLRQ  0DLQWHQDQFH DFWLYLWLHV FDQ WKXV EH SODQQHG DFFRUGLQJO\  5DWLR       

!

D



λ  V



 × V

=

λ  V

7LPH:HHNV 



H[S × V





−  × V

!



 5DWLR         



E





λ  V λ  V



=



7LPH:HHNV 

  +  H[S −V





F

λ  W λ  W

=  × V 



)LJXUH5DWLRRIIDLOXUHLQWHQVLW\IXQFWLRQVIURP VRIWZDUHWHVWLQJWRRSHUDWLRQDOSKDVH IRUWKH2KED¶VGDWDVHW   &RQFOXVLRQV   ,Q WKLV SDSHU ZH ILUVW UHYLHZHG KRZ VHYHUDO H[LVWLQJ VRIWZDUH UHOLDELOLW\ JURZWK PRGHOV EDVHG RQ 1RQKRPRJHQHRXV3RLVVRQ3URFHVVHVFRXOGEHGHULYHGE\ DGRSWLQJ WKH FRQFHSW RI ZHLJKWHG DULWKPHWLF ZHLJKWHG JHRPHWULF DQG ZHLJKWHG KDUPRQLF PHDQV  7KHQ ZH SURSRVHG D PRUH JHQHUDO 1+33 PRGHO XVLQJ WKH SRZHU WUDQVIRUPDWLRQ  :LWK WKH SURSRVHG XQLILHG WKHRU\ PDQ\ H[LVWLQJ1+3365*0VFDQEHGHULYHG2XUJRDOLVQRWWR DGG RQH PRUH PRGHO WR WKH DOUHDG\ ODUJH FROOHFWLRQ RI 65*06 EXW WR HPSKDVL]H QHZ DSSURDFKHV IRU PRGHO GHYHORSPHQW DQG FODVVLILFDWLRQ  :H VKRZHG WKDW PRVW H[LVWLQJ1+3365*0VFRXOGEHWUHDWHGDVVSHFLDOFDVHVRI RXU JHQHUDO 1+33 PRGHO  :H GLVFXVVHG SDUDPHWHU HVWLPDWLRQDQGUHODWHGPDWKHPDWLFDOSURSHUWLHVRIRXUQHZ PRGHO%HVLGHVZHDOVRSURSRVHGDPHWKRGRIFRPSXWLQJ WKH RSHUDWLRQDO PHDQ YDOXH IXQFWLRQ DQG WKH VRIWZDUH RSHUDWLRQDO UHOLDELOLW\  2QH PDMRU FRQWULEXWLRQ RI WKLV SDSHU LV DQ LQWHJUDWHG DSSURDFK IRU D FRPSUHKHQVLYH UHOLDELOLW\JURZWKPRGHOLQJHIIRUWGXULQJWKHWHVWLQJSKDVH DQG WKH RSHUDWLRQDO SKDVH  :H HVWDEOLVKHG DQ HDV\ DQG VLPSOH OLQN WR PRGHO SRVVLEOH )'5 WUDQVIRUPDWLRQV EHWZHHQ WKHVH SKDVHV  2XU DSSURDFKHV RI GHVFULELQJ WKH ZRUNLQJ VWDWXV RI YDULRXV VRIWZDUH RSHUDWLRQDO HQYLURQPHQWV DUH IOH[LEOH DV ZH FDQ PRGHO YDULRXV HQYLURQPHQWV UDQJLQJ IURP DQ H[SRQHQWLDO 1+33 WR DQ 6VKDSHG 65*0 FXUYH  %DVHG RQ WKH LQWHJUDWHG WKHRUHWLFDO IRXQGDWLRQ WKH WHFKQRORJLHV DQG DSSURDFKHV SUHVHQWHG LQ WKLV SDSHU RIIHU D XQLILHG DQG FRQVLVWHQW VRIWZDUH UHOLDELOLW\ HYDOXDWLRQ VFKHPH IURP WHVWLQJ WR RSHUDWLRQ



$FNQRZOHGJPHQWV

5DWLR



      







7LPH:HHNV 









:HZRXOGOLNHWRH[SUHVVRXUJUDWLWXGHIRUWKHVXSSRUW RI WKH 1DWLRQDO 6FLHQFH &RXQFLO 7DLZDQ 52& XQGHU *UDQW16&73&(7KHZRUNGHVFULEHGLQWKLV SDSHUZDVSDUWLDOO\VXSSRUWHGE\DJUDQWIURPWKH5HVHDUFK *UDQW &RXQFLO RI WKH +RQJ .RQJ 6SHFLDO $GPLQLVWUDWLYH 5HJLRQ3URMHFW1R&8+.( DQGE\DJUDQWIURP )UDQFH+RQJ .RQJ -RLQW 5HVHDUFK 6FKHPH  %HVLGHVWKHDXWKRUVDOVRWKDQNVHYHUDODQRQ\PRXVUHIHUHHV IRUWKHLUFRQVWUXFWLYHUHYLHZVDQGFRPPHQWV







5HIHUHQFHV >@

0 5 /\X   +DQGERRN RI 6RIWZDUH 5HOLDELOLW\ (QJLQHHULQJ0F*UDZ+LOO

>@

-'0XVD$,DQQLQRDQG.2NXPRWR 6RIWZDUH 5HOLDELOLW\ 0HDVXUHPHQW 3UHGLFWLRQ DQG $SSOLFDWLRQ 0F*UDZ+LOO

>@

-'0XVD 6RIWZDUH5HOLDELOLW\(QJLQHHULQJ0RUH 5HOLDEOH 6RIWZDUH )DVWHU 'HYHORSPHQW DQG 7HVWLQJ 0F*UDZ+LOO

>@

5 + +RX 6 @ - ' 0XVD 6HQVLWLYLW\ RI )LHOG )DLOXUH ,QWHQVLW\ WR 2SHUDWLRQDO 3URILOH (UURUV 3URFHHGLQJV RI WKH WK    ,QWHUQDWLRQDO 6\PSRVLXP RQ 6RIWZDUH 5HOLDELOLW\ (QJLQHHULQJSS1RY >@ - ' 0XVD $GMXVWLQJ 0HDVXUHG )LHOG )DLOXUH ,QWHQVLW\ IRU2SHUDWLRQDO3URILOH9DULDWLRQ3URFHHGLQJVRIWKHWK ,QWHUQDWLRQDO 6\PSRVLXP RQ 6RIWZDUH 5HOLDELOLW\ (QJLQHHULQJSS1RY >@ 6 .HHQH DQG & /DQH 5HOLDELOLW\ *URZWK RI )LHOGHG 6RIWZDUH 3URFHHGLQJV $QQXDO 5HOLDELOLW\ DQG 0DLQWDLQDELOLW\6\PSRVLXPSS3LVFDWDZD\1- 

>@

1 /DQJEHUJ DQG 1 ' 6LQJSXUZDOOD

$ 8QLILFDWLRQ RI 6RPH 6RIWZDUH 5HOLDELOLW\ 0RGHOV

 6,$0 - 6FL 6WDW &RPSXW9RO1RSS

>@ * 4 .HQQH\ (VWLPDWLQJ 'HIHFWV LQ &RPPHUFLDO 6RIWZDUH 'XULQJ 2SHUDWLRQDO 8VH ,((( 7UDQV RQ 5HOLDELOLW\9RO1RSS

>@

' 5 0LOOHU

([SRQHQWLDO 2UGHU 6WDWLVWLF 0RGHOV RI 6RIWZDUH 5HOLDELOLW\ *URZWK

 ,((( 7UDQV 6RIWZDUH (QJLQHHULQJ9RO1RSS

>@

0 7UDFKWHQEHUJ

$ *HQHUDO 7KHRU\ RI 6RIWZDUH5HOLDELOLW\ 0RGHOLQJ

 ,((( 7UDQV 5HOLDELOLW\ 9RO1RSS

>@ 73KLOLS310DULQRVDQG.67ULYHGL$0XOWLSKDVH 6RIWZDUH 5HOLDELOLW\ 0RGHO)URP 7HVWLQJ WR 2SHUDWLRQDO 3KDVH7HFKQLFDO5HSRUW75&HQWHUIRU$GYDQFHG &RPSXWLQJDQG&RPPXQLFDWLRQ'XNH8QLYHUVLW\-DQXDU\ 

>@

36%XOOHQ'60LWULQRYLFDQG309DVLF0HDQVDQG 7KHLU ,QHTXDOLWLHV ' 5HLGHO 3XEOLVKLQJ &RPSDQ\ 'RUGUHFKW+ROODQG

>@

6 6 *RNKDOH DQG . 6 7ULYHGL /RJ/RJLVWLF 6RIWZDUH 5HOLDELOLW\ *URZWK0RGHO3URFHHGLQJVRIWKHUG,((( ,QWHUQDWLRQDO +LJK$VVXUDQFH 6\VWHPV (QJLQHHULQJ 6\PSRVLXP SS   1RY   :DVKLQJWRQ '&

>@ + 2KWHUD DQG 6 @ & @ 02KED6RIWZDUH5HOLDELOLW\$QDO\VLV0RGHOV

,%0- 5HV'HYHORS9RO1RSS-XO\ >@ @ 5 &KLOODUHJH 5 . ,\HU - & /DSULH DQG - ' 0XVD )LHOG)DLOXUHVDQG5HOLDELOLW\LQ2SHUDWLRQ3URFHHGLQJV RIWKHWK,QWHUQDWLRQDO6\PSRVLXPRQ6RIWZDUH5HOLDELOLW\ (QJLQHHULQJ,665(  SS >@ $/*RHO5HODWLQJ2SHUDWLRQDO6RIWZDUH5HOLDELOLW\DQG :RUNORDG 5HVXOWV IURP DQ ([SHULPHQWDO 6WXG\ 3URFHHGLQJV $QQXDO 5HOLDELOLW\ DQG 0DLQWDLQDELOLW\ 6\PSRVLXP SS  /DV 9HJDV 1HYDGD 86$ -DQXDU\! >@ $ / *RHO DQG - 6MRJUHQ 6RIWZDUH 5HOLDELOLW\ $VVHVVPHQW'XULQJWKH2SHUDWLRQDO3KDVH3URFRIWKHVW ,QWHUQDWLRQDO 6\PSRVLXP RQ 6RIWZDUH 5HOLDELOLW\





 (QJLQHHULQJ$SULO:DVKLQJWRQ'&86$!

>@ . 7RNXQR DQG 6