Practical Applications of Posterior Predictive Model ... - ETS.org

81 downloads 2678 Views 506KB Size Report
Practical Applications of Posterior Predictive Model Checking for. Assessing Fit of Common Item Response Theory Models. Sandip Sinharay. ETS, Princeton, NJ.
Research Report

Practical Applications of Posterior Predictive Model Checking for Assessing Fit of Common Item Response Theory Models Sandip Sinharay

Research & Development

November 2003 RR-03-33

Practical Applications of Posterior Predictive Model Checking for Assessing Fit of Common Item Response Theory Models

Sandip Sinharay ETS, Princeton, NJ

November 2003

Research Reports provide preliminary and limited dissemination of ETS research prior to publication. They are available without charge from: Research Publications Office Mail Stop 7-R ETS Princeton, NJ 08541

 @!

 ^&KM\[ QM\[&L J LOJ L ]S\d R_\ _N^ J _\f]_QM\7^RZT   V L IJMJKM\7RZKM\c\O^N=\K3I R_\6I a^MJIJLOd ^ d ^0KM\  [ QM\[& L J ]_^0^ \0L ] LOJD]_QML \ OK \c\7J ^ R]SQM\! ZLOd NO\fd ^&KM\" 7X+JM^]:]_^# ZN=\7I ^ ]SQ\ R_\[7\J"]$ T $ \Z ]_\7K [7^ d N LO[6I#]S\7KPd ^&KM\"  V QM\&%('*)+-,.0/1'2.3%4.,$5/16+7/98,;: ` @, X`]_QM\ T I6T \ _ LOIJ [^M J ]S\R_NI RZ]-^ ]_QM\ [O I $Z LO[6IW` N4k c I"M \ L_ [R_\NIJM[@T5d \7I $  R_\ X]SQM\ T I6T \ _ LOIJ [^M J ]S\R_NI RZ]^ ]_QM\ [O I $Z LO[6IW ]S\ Z ]Z ]SI ]SL"Z ]SL [ XMN I6T IJ LOd N=^ R ] IJ ] RZ^O \:L J)]_QM\fYWY  d \]SQ^0Kl J IJPINMN LO[7I ]SL ^ J5^ ]_QM\YWY  d \]_QM^0K X]_QM\  \T #

]S^! ZM[7[\ $ -^ ]S\J L" I_ _\]^KML" _[7RZ\7NI JM[T d \6I ZMR_\ 9]SQI ]I R_\ QMLQ T OL"\ T ]_^$KM\]_\7[]]SQ\EIW _N\7[]$ ^ B]_QM\fKI ]SI ]_QI ] ]_QM\fd ^0K\[6IJMJ^]\0NR IL Jc SI ]_L g I[]_^ R_L" TO 4]:L" -N^ Z _LOeRO\E]_QI ]I d ^&KM\ KM^&\ JM^]:IKM \ VI#]S\  T \0NR IL JDIKI ]SI _\]7X+e] Z^ d \KML Z[7R_\NIJM[@TDd \6I ZMR_\ [ LKM\@]S\7[@]:]SQM\ d L gM] [ QM"L OE\ _^d \ [^ J I]  H0LOJMQMIRSI6T3IJMK b^QMJ _^J gii j  INMN  LO\ ]SQ\ N^ Z]_\7R_L ^ RNMR_\KMLO[@]SL c\ d ^0K\W[ QM\7["L J d \]SQ^0KD]S^)I Z _ \ $ ]SQM_ \ M]^  ]SQM\$N^ N OIR  V d ^&KM \  ! F k Xg kSX/IJMK j Y d ^0K\   ]SQMRZ^  Q3I _\R_L \ ^ P _LO;d  I ]_LO^ h J ] MKML \  V QML -NIN\7R INMN  LO\ ]SQ\ YWY  *d \]_QM^&K`4X [ L ]SQP]_QM\KL _[R_\NIJM[@T d \6I ZMR_ \ O^ MJMK  Z \ a+L J]SQME\ ZLO& d OI ]SL ^ < J ] MKLO\ XM]S^f]_QMR_\\RZ\6I =KI ]SI$0\ Id RN O\ JME\  ^ I =QM\7RZ\ L ]S^5KM\d ^J Z]_RSI ]_\]SQM;\  _\ aOJM \ $ ^ B]_QM\ KML Z[7RZ\7NIJ[T d \6WI $MRZ\ L JDKM\]_\]SL J d ^0K\  d L gM]-LOJ R_\7I +KI ]SI$INMN  LO[6I#]SLO^J 

d N^ RZ]SIJ ] INMRN OLO[7I ]SL ^ J -^ W]SQM\$YWY  d \]_QM^&KDLOJD\7RK M[6I ]_LO^ JMI BI Z _\ Z _d \7J ]LOJM [ MK\ OMeMLOJ I JMK3H&]S\R_J gF*HHS  X+H0[ QM\7L JM\ X -^ L  ]SLORJ X IJMK T ^&^ dd _d I gF*HHH  X+b IJ $ Z\7J`X V M\7ZR OL JM[  X  \ OKM\$R X IJK !\ T ^&\7[  gi i i  X ^ L  ]_LOJ  IJMK  ^  \7JI I dR gF*HHK  X ^ L  ]_LOJ  giRi F  X  IR_"L IJMK  IRZL d gi i g  X *^ DIJM K D OI d g i i j  X+IJMK c I J JMJMI gi i j   -*^ [\c\7R7X\6I[ Q3^  ]SQM \ _\ INMRN OLO[7I ]SL ^ J 9"L  ZN=\[7LOI O L 7\7K IJMK)JM^ J\^ ]SQM^ Z\ ^&[ R _\ -^  J  V d ^&KM \   V QM"L -RZ\ _\7IR_[ Q ] I  \ I d ^ R_& \ \7JM\RSI BI NMNMR_^ I[ QDLOJ I ]Z]S\d N]_LOJ  ]S^5NMRZ^c&L KM\ R_ \ _\6I R_[ QM\$R E[ L ]_Q I d ^ RZ\[7^d NMRZ\7QM\J _L c \ ]S^&^ "&L ] ^ R WI $ _ \ $ ZLOJ dM]^ G  V d ^0KM \   H0\7[@]SLO^J gPKM\ Z[7R_L e= \ f]SQM< \ Z] I#]SL ]SL [6I  d ^&KM \  L J  V ]SQI#] IRZ\^ LOJ ]S\R_ \ Z] L J