Validation referring to the criterion: Concurrent or. Predictive. What are these validation techniques? When performing a validation of the test referred to the ...
Validation referring to the criterion: Concurrent or Predictive. What are these validation techniques? When performing a validation of the test referred to the criteria, this means that we validate the results obtained in our test, with the results in another test measuring similar characteristics. Suppose that you want to validate the EPQ-RA test. In this case, and the examples that shown below, has been used the test ZKPQ-50-CC to carry out this validation criteria, because the test ZKPQ-50-CC is a reduced version of the test of five factors of Zuckerman, and their scales are: -
Scale N-Anx: Neuroticism and Anxiety Scale Sy: Sociability Scale ImpSS: Impulsiveness Scale Agg-Host: Aggression-Hostility Scale Act: Activity
The difference between concurrent validation and predictive validation is as follows: -
Concurrent validation, is to compare the results obtained in a test with the results obtained with the other test. Taking into account that, when we compare the two tests, we refer to study, if the results of one and another, measuring a same feature, are strongly related in a manner consistent. To find out whether or not correlated the two test scores, is calculated the Pearson correlation coefficient, so if this coefficient takes a value close to - 1 or 1, it means that they are correlated inversely or directly proportional way, respectively. While, if the value of this coefficient is close to zero, this will indicate us that the two test scores, are not correlated. Predictive validation, is to build a linear regression model that will allow us to predict the scores of a test from the other test scores. And this will only make sense to do so if
the scores are strongly correlated, information that can be accessed through the Pearson correlation coefficient. Concurrent validation example The following example shows the matrix of correlations between the scales of the EPQ-RA and ZKPQ-50-CC tests. And you will see the scales of both test measuring a similar feature, are more correlated among which those that measure different characteristics. The matrix obtained is as follows:
Scale E
Scale N
Scale P
Scale
Scale
Scale
Scale
Scale
N-Anx
ImpSS
Act
Sy
AggHost
Scale L
Scale E
1
Scale N
-0,055
1
Scale P
0,178
0,318
1
Scale L
-0,123
-0,079
-0,097
1
Scale N-Anx
-0,042
0,714
0,275
-0,089
1
Scale ImpSS
0,349
0,17
0,423
-0,099
0,107
1
Scale Act
0,182
-0,073
0,017
0,097
-0,079
0,159
1
Scale Sy
0,551
-0,093
-0,045
-0,096
-0,111
0,182
0,09
1
Scale Agg-Host
0,078
0,326
0,329
-0,238
0,295
0,255
0,076
-0,077
1
Analyzing these coefficients, is observed that: The measure of the scale E (Extroversion) is fairly and directly related to the scale Sy (sociability), since we get a correlation of 0,551, is very low and directly related to the scale ImpSS already that we get a correlation of 0,349 and it is even less, and directly related to the scale Act since we get a correlation of 0,182. The measure of the scale N (neuroticism) is strongly and directly related with scale N-Anx (neuroticism and anxiety), since we get a correlation of 0,714, is very low and directly related with the scale Agg-Host, since we get a correlation of 0.329, and it is even less and directly related to the scale ImpSS since we get a correlation of 0,170.
The measure of the scale P (Psychoticism) is moderately and directly related to the scale ImpSS (impulsivity), since we get a correlation of 0,423, is very low and directly connected with the scale N-Anx, since we get a correlation of 0,275 and it is very little and directly related with the scale Agg-Host, since we get a correlation of 0.329. Therefore, we can say, that the EPQ-RA test presents a moderately good concurrent validity, since the best convergences that have their scales are: scale N by comparing it with the scale N-Anx (coefficient 0,714, quite good), and the scale E by comparing it with the scale Sy (coefficient 0,551, moderate). Predictive validation example Taking into account as a criterion in the ZKPQ-50_CC scale N-Anx scores, and assuming that our goal is to predict the scores on this criterion from the EPQ-RA scale N, we consider: What score on the ZKPQ-50_CC scale N-Anx we predict to a subject that has 3 points on the scale N of the EPQ-RA? To predict this score, we must build the linear regression model, that allows us to predict the value of the score on the scale N-Anx of ZKPQ-58_CC test, using the score obtained in the scale N of the test EPQ-RA. Calculating the regression model is obtained: Regression statistics Multiple correlation coefficient
0,69
Coefficient of determination R2
0,48
2
R Adjusted
0,48
Error
1,92
Observations
268,00
ANALYSIS OF VARIANCE Degrees freedom Regression
Sum of squares
Mean Squares
1
917,91
917,91
Residual
266
984,65
3,70
Total
267
1902,57
F
F Test
247,97
0,00
Coefficients Error
t Test Probability
Intercept
1,28
0,17
7,32
0,00
Scale N
0,73
0,06
15,75
0,00
Therefore the linear regression model is: Score Scale N-Anx = 1,28 + 0,73 ·Score Scale N This means that if a subject has obtained "n" points on the scale N of the EPQ-RA, in the scale N-Anx score would be: Score Scale N-Anx = 1,28 + 0,73 · n
