Statistical Discovery. From SAS. TM
D-optimal Split-split-plot Designs Bradley Jones SAS Institute Inc. Peter Goos University of Antwerp
Copyright © 2005, SAS Institute Inc. All rights reserved.
1
Statistical Discovery. From SAS. TM
Outline
Motivation Model Algorithm Advice concerning minimizing the number of whole plots Counterintuitive Example Effect of Changing Variance Ratios Cheese Processing Example
Copyright © 2005, SAS Institute Inc. All rights reserved.
2
Statistical Discovery. From SAS. TM
Motivation – Why would you want to compute optimal SSPDs? Experiments on multi-step processes Processes having factors with varying degrees of difficulty to change
Copyright © 2005, SAS Institute Inc. All rights reserved.
3
Statistical Discovery. From SAS. TM
Example Application Cheese Production has 3 stages 1. Store milk in large tanks 2. Divide milk from tanks among curds processors and make curds. 3. Further process the curds to make individual cheeses.
Copyright © 2005, SAS Institute Inc. All rights reserved.
4
Statistical Discovery. From SAS. TM
Outline
Motivation Model Algorithm Advice concerning minimizing the number of whole plots Counterintuitive Example Effect of Changing Variance Ratios Cheese Processing Example
Copyright © 2005, SAS Institute Inc. All rights reserved.
5
Statistical Discovery. From SAS. TM
Model
Where X is the design matrix for the fixed effects, Z1 is an indicator matrix for the whole plots, Z2 is an indicator matrix for the subplots, β is a vector of fixed effects, γ1 is a vector of the whole plot random effects, γ2 is a vector of the subplot random effects, ε is the vector random errors, b1 is the number of whole plots, b2 is the number of subplots per whole plot and k is the number of runs per subplot. Copyright © 2005, SAS Institute Inc. All rights reserved.
6
Statistical Discovery. From SAS. TM
Variance of Y
Copyright © 2005, SAS Institute Inc. All rights reserved.
7
Statistical Discovery. From SAS. TM
Information Matrix
the D-optimal design maximizes the determinant of M
Copyright © 2005, SAS Institute Inc. All rights reserved.
8
Statistical Discovery. From SAS. TM
Determinant depends on unknown variance ratios. η1= σγ /σε 1
η2= σγ /σε 2
Copyright © 2005, SAS Institute Inc. All rights reserved.
9
Statistical Discovery. From SAS. TM
You don’t have to calculate the inverse of V!
Copyright © 2005, SAS Institute Inc. All rights reserved.
10
Statistical Discovery. From SAS. TM
Algorithm Inspired by coordinate exchange Meyer & Nachtsheim Technometrics 1995
Copyright © 2005, SAS Institute Inc. All rights reserved.
11
Statistical Discovery. From SAS. TM
Starting Design WP
SP
1 1 1 1 2 2 2 2
1 1 2 2 3 3 4 4
X1
X2 0.25 0.25 0.25 0.25 0.57 0.57 0.57 0.57
X3 0.37 0.37 -0.69 -0.69 0.44 0.44 -0.87 -0.87
-0.66 0.05 -0.87 -0.72 -0.59 0.49 -0.74 -0.74
Determinant = 0.026 Copyright © 2005, SAS Institute Inc. All rights reserved.
12
Statistical Discovery. From SAS. TM
After First Row WP
SP
1 1 1 1 2 2 2 2
1 1 2 2 3 3 4 4
X1
X2 -1.00 -1.00 -1.00 -1.00 0.57 0.57 0.57 0.57
X3 1.00 1.00 -0.69 -0.69 0.44 0.44 -0.87 -0.87
-1.00 0.05 -0.87 -0.72 -0.59 0.49 -0.74 -0.74
Determinant = 1.456 Copyright © 2005, SAS Institute Inc. All rights reserved.
13
Statistical Discovery. From SAS. TM
After 2nd Row WP
SP
1 1 1 1 2 2 2 2
1 1 2 2 3 3 4 4
X1
X2 -1.00 -1.00 -1.00 -1.00 0.57 0.57 0.57 0.57
X3 1.00 1.00 -0.69 -0.69 0.44 0.44 -0.87 -0.87
-1.00 1.00 -0.87 -0.72 -0.59 0.49 -0.74 -0.74
Determinant = 3.182 Copyright © 2005, SAS Institute Inc. All rights reserved.
14
Statistical Discovery. From SAS. TM
After 3rd Row WP
SP
1 1 1 1 2 2 2 2
1 1 2 2 3 3 4 4
X1
X2 -1.00 -1.00 -1.00 -1.00 0.57 0.57 0.57 0.57
X3 1.00 1.00 -1.00 -1.00 0.44 0.44 -0.87 -0.87
-1.00 1.00 1.00 -0.72 -0.59 0.49 -0.74 -0.74
Determinant = 6.46 Copyright © 2005, SAS Institute Inc. All rights reserved.
15
Statistical Discovery. From SAS. TM
After 4th Row WP
SP
1 1 1 1 2 2 2 2
1 1 2 2 3 3 4 4
X1
X2 -1.00 -1.00 -1.00 -1.00 0.57 0.57 0.57 0.57
X3 1.00 1.00 -1.00 -1.00 0.44 0.44 -0.87 -0.87
-1.00 1.00 1.00 -1.00 -0.59 0.49 -0.74 -0.74
Determinant = 7.20 Copyright © 2005, SAS Institute Inc. All rights reserved.
16
Statistical Discovery. From SAS. TM
After 5th Row WP
SP
1 1 1 1 2 2 2 2
1 1 2 2 3 3 4 4
X1
X2 -1.00 -1.00 -1.00 -1.00 1.00 1.00 1.00 1.00
X3 1.00 1.00 -1.00 -1.00 1.00 1.00 -0.87 -0.87
-1.00 1.00 1.00 -1.00 -1.00 0.49 -0.74 -0.74
Determinant = 16.777 Copyright © 2005, SAS Institute Inc. All rights reserved.
17
Statistical Discovery. From SAS. TM
After 6th Row WP
SP
1 1 1 1 2 2 2 2
1 1 2 2 3 3 4 4
X1
X2 -1.00 -1.00 -1.00 -1.00 1.00 1.00 1.00 1.00
X3 1.00 1.00 -1.00 -1.00 1.00 1.00 -0.87 -0.87
-1.00 1.00 1.00 -1.00 -1.00 1.00 -0.74 -0.74
Determinant = 19.86 Copyright © 2005, SAS Institute Inc. All rights reserved.
18
Statistical Discovery. From SAS. TM
After 7th Row WP
SP
1 1 1 1 2 2 2 2
1 1 2 2 3 3 4 4
X1
X2 -1 -1 -1 -1 1 1 1 1
X3 1 1 -1 -1 1 1 -1 -1
-1 1 1 -1 -1 1 1 -0.74
Determinant = 26.19 Copyright © 2005, SAS Institute Inc. All rights reserved.
19
Statistical Discovery. From SAS. TM
Optimal Design WP
SP
1 1 1 1 2 2 2 2
1 1 2 2 3 3 4 4
X1
X2 -1 -1 -1 -1 1 1 1 1
X3 1 1 -1 -1 1 1 -1 -1
-1 1 1 -1 -1 1 1 -1
Determinant = 27.86 Copyright © 2005, SAS Institute Inc. All rights reserved.
20
Statistical Discovery. From SAS. TM
Graphical Kinetic View Bubble Plot Demonstration
Copyright © 2005, SAS Institute Inc. All rights reserved.
21
Statistical Discovery. From SAS. TM
Outline
Motivation Model Algorithm Advice concerning minimizing the number of whole plots Counterintuitive Example Effect of Changing Variance Ratios Cheese Processing Example
Copyright © 2005, SAS Institute Inc. All rights reserved.
22
Statistical Discovery. From SAS. TM
What if you can only do 2 whole plots? i.e. the whole plot factor is really hard to change
Copyright © 2005, SAS Institute Inc. All rights reserved.
23
Statistical Discovery. From SAS. TM
Recommendation Make sure that you include two-factor interactions involving the whole plot factor in the model
Copyright © 2005, SAS Institute Inc. All rights reserved.
24
Statistical Discovery. From SAS. TM
Example One whole plot factor – 2 whole plots One subplot factor – 4 subplots Three sub-subplot factors – 24 runs
Copyright © 2005, SAS Institute Inc. All rights reserved.
25
Statistical Discovery. From SAS. TM
Optimal Design
Copyright © 2005, SAS Institute Inc. All rights reserved.
26
Statistical Discovery. From SAS. TM
Coefficient Variances
Copyright © 2005, SAS Institute Inc. All rights reserved.
27
Statistical Discovery. From SAS. TM
Outline
Motivation Model Algorithm Advice concerning minimizing the number of whole plots Counterintuitive Example Effect of Changing Variance Ratios Cheese Processing Example
Copyright © 2005, SAS Institute Inc. All rights reserved.
28
Statistical Discovery. From SAS. TM
Diagonal information matrix = Optimal Design? For 2-level completely randomized designs orthogonality equates to optimality. e.g. all 2-level orthogonal designs are also globally optimal. But, this may not be true for split-split-plot designs!
Copyright © 2005, SAS Institute Inc. All rights reserved.
29
Statistical Discovery. From SAS. TM
Example: Two whole plot factors with eight whole plots One subplot factor with 16 subplots Three sub-subplot factors with 32 runs.
Copyright © 2005, SAS Institute Inc. All rights reserved.
30
Statistical Discovery. From SAS. TM
Design
Copyright © 2005, SAS Institute Inc. All rights reserved.
31
Statistical Discovery. From SAS. TM
Features of Design The information matrix is not diagonal. There are three off-diagonal elemennts.
Copyright © 2005, SAS Institute Inc. All rights reserved.
32
Statistical Discovery. From SAS. TM
Fractional Factorial Alternatives There are very many designs with diagonal information matrices.
Construction method of the best we could find. 1. t2 = w1w2st1 2. Use contrast columns w1, w2 and w2t1t3 to partition the 8 whole plots.
Copyright © 2005, SAS Institute Inc. All rights reserved.
33
Statistical Discovery. From SAS. TM
Coefficient Variances
Copyright © 2005, SAS Institute Inc. All rights reserved.
34
Statistical Discovery. From SAS. TM
Outline
Motivation Model Algorithm Advice concerning minimizing the number of whole plots Counterintuitive Example Effect of Changing Variance Ratios Cheese Processing Example
Copyright © 2005, SAS Institute Inc. All rights reserved.
35
Statistical Discovery. From SAS. TM
Determinant depends on variance ratios How much difference does this make?
Copyright © 2005, SAS Institute Inc. All rights reserved.
36
Statistical Discovery. From SAS. TM
Example
One whole plot factor – six whole plots One subplot factor – 12 subplots Three easy-to-change factors – 24 runs Model with main effects and all two-factor interactions
Consider all combinations of log10(η1) and
log10(η2) each with three levels -1, 0 and 1.
Copyright © 2005, SAS Institute Inc. All rights reserved.
37
Statistical Discovery. From SAS. TM
There were six different designs, but…
Assuming that the true variance ratios were both 1, here are the relative efficiencies of the designs. There is little practical difference. Copyright © 2005, SAS Institute Inc. All rights reserved.
38
Statistical Discovery. From SAS. TM
Outline
Motivation Model Algorithm Advice concerning minimizing the number of whole plots Counterintuitive Example Effect of Changing Variance Ratios Cheese Processing Example
Copyright © 2005, SAS Institute Inc. All rights reserved.
39
Statistical Discovery. From SAS. TM
Cheese Processing Experiment Two milk storage factors (8 whole plots) Five curds production factors (32 subplots) Three cheese making factors – one at 4 levels with 128 total runs
Copyright © 2005, SAS Institute Inc. All rights reserved.
40
Statistical Discovery. From SAS. TM
Study Design - Resolution IV But, using our algorithm, we found a design that could estimate all the two-factor interactions and was orthogonal for the main effects. We also found a design with only one quarter of the runs that was orthogonal for all the main effects.
Copyright © 2005, SAS Institute Inc. All rights reserved.
41
Statistical Discovery. From SAS. TM
Design – 32 runs
Copyright © 2005, SAS Institute Inc. All rights reserved.
42
Statistical Discovery. From SAS. TM
Coefficient Variances
Copyright © 2005, SAS Institute Inc. All rights reserved.
43
Statistical Discovery. From SAS. TM
Summary 1. We have supplied an algorithmic approach for computing SSPDs.
2. The approach is useful for either screening or RSM.
3. We discussed the problem of confounding of whole plot fixed effects and variances and proposed a practical way of proceeding.
4. We introduced a case where diagonal
information matrices appear not to be optimal.
5. We considered the effect of unknown variance ratios on the design – more work to do here.
6. We applied our method to a previously run experiment with useful results.
Copyright © 2005, SAS Institute Inc. All rights reserved.
44
Statistical Discovery. From SAS. TM
Contact Information
[email protected]
Copyright © 2005, SAS Institute Inc. All rights reserved.
45