Models and Designs for Three-Treatment
Two-Period Crossover Studies
Lucio Jose Vivaldi
,
I
.'!.~.E,:_.~!..~~~~.~.!,~E!__tI~~,2.. §~~XJ:~S._j!.J2u..,_j .
iv
TABLE OF CONTENTS
Page
NOTATION AND ABBREVIATION .
v
1.
INTRODUCTION . . .
1
2.
LITERATURE REVIEW.
5
3. MODELS FOR TWO-TREATMENT, TWO-PERIOD CROSSOVER DESIGN.
3.1
3.2
3.3
3.4
4.
5.
Introduction...................
ANOVA Mode1. . . . . . . . . . . . . .
. . ..
Some Difficulties of the ANOVA Model . . . . . . . .
The Helms-Shen Models. . . . . . . . .
19
19
20
22
24
SOME THEORY ON DEFINITION OF PARAMETERS AND MODELS. .
30
4.1 Equivalence Between Definitions . . . . . . •
4.2 Methods of Defining Parameters
.
4.3 Estimability of Secondary Parameters in Two
Different Models . . . . . . . . . . . • . .
30
32
SPECIFICATION OF MODELS FOR THE COMPLETE THREE-TREATMENT,
TWO-PERIOD CROSSOVER DESIGN . . . . .
. . . .
5. 1 Introducti on . . . . . . . . . . . . . . . .
5.2 Orthogonal Polynomials Models . . . . . . . •
5.3 Average Distance Between Lines (ADBL) Models
5.4 Deviations From Mean (DFM) Models..
....
5.5 Reference Cell (RC) Models
5.6 Omitting Sequence Effects . .
5.7 Equality of the Models . . . . .
6. SUBDESIGNS
6.1
6.2
6.3
6.4
6.5
....
. ....•..
.
Introduction
.
Definition of the Parameters
.
Singular Subdesigns and "Robust" Subdesigns.
Optimal Suodesigns
.
Power of the Tests in Subdesigns .
42
45
45
48
52
58
61
66
72
75
75
76
80
83
95
7. SUMMARY AND CONCLUSIONS.
105
8.
LIST OF REFERENCES.
111
9.
APPENDICES . . . . .
115
v
NOTATION AND ABBREVIATION
a(qxl)
is a (qxl) column vector.
A(pxq)
is a (pxq) matrix with a ij the element in the i-th row
and j-th column.
is the transpose of A.
is the unique inverse of a square matrix A of full
rank.
DET(A)
is the determinant of the matrix A.
ch.A
is the i-th largest characteristic root of A.
~p
is the identity matrix of order p.
'-
O(pxq)
is the (pxq) matrix of zeros.
R(A)
is the vector space generated by the columns of A.
Var(a(nxl))
is the nxn matrix Cov(axa).
E(Y(nxp))
is the (nxp) matrix of expectations of the elements
of Y.
means that the random variable X has a p-variate
multinomial distribution with mean vector
variance covariance matrix E.
~
and
1.
INTRODUCTION
The main purpose of this study is to investigate one period at a
Ii
time," full rank models for the three-treatment two-period crossover
designs and, using those models, investigate the properties of the
"complete" design, a 3x3x2 factorial involving all nine possible
sequences, and of all those subdesigns of 5, 6, 7 and 8 sequences, in
which the definition of the parameters are equivalent to the definition
of the parameters in the complete design.
Chapter 2 contains a review of the literature on crossover designs,
including papers on the topics of construction of designs for specific
situations, balancing designs for estimating a particular set of parameters, applications of crossover designs in several fields of research,
experimental techniques to improve the estimation of parameters, criticisms with respect to the assumptions usually made to carry out the
analysis of variance, and current problems dealing with the various
mathematical models that have been used.
Chapter 3 considers general problems of modeling for the twotreatment two-period crossover design.
A general mathematical model is
given for this design, involving all parameters commonly used in the
literature.
The usual assumption on the distribution of the random
variables involved leads to recognition that the two observations from
an experimental unit are correlated, which invalidates the t-test for
testing important hypotheses in some unbalanced designs.
The defini-
tions of the main effects of treatments and their consequences in
2
comparing designs are discussed, including the point that comparisons
must be made when the definitions of the main effects are equivalent in
both designs.
The total number of parameters often specificed for the
two-treatment, two-period crossover design is often more than can be
estimated separately, which leads to confounding; as a consequence,
different authors leave out different parameters and include others;
i.e., different authors use different models.
Eliminating one or more
parameters from the model has a great influence on the definitions of
the remaining parameters in the model:
In less than full-rank models
this practice may cause the definitions of the remaining parameters not
to be equivalent to corresponding definitions in the complete model.
All these aspects are discussed in connection with the usual analysis
of variance and its difficulties. A by-period linear full-rank model,
proposed by Helms and Shen (1980), is described for the 4-sequence,
two-treatment, two-period crossover design, in which it is assumed that
the effects of the treatments in the first period and in the second
period are different.
The parameters involved in this modeling approach
are well defined, easily interpreted and the confounding patterns are
readily observed.
This approach permits the analysis of all information
available, even if there are missing data in the second period, but does
not take advantage of the longitudinal nature of the design.
Chapter 4 presents some theory about definition of parameters in
linear models and methods of defining parameters.
Concepts related with
two definitions of a parameter and their equivalence are discussed and
some results from Helms (1980) on equivalence between definitions are
stated without proofs.
The use of lIessence models ,II models with one
replicate for each cell, in defining parameters is emphasized as
3
sufficient since the definition of a parameter in the essence model is
equivalent to its definition in the model with all observations.
methods of defining parameters are reviewed:
Four
Orthogonal Polynomials
(OP), Average Distance Between lines (ADBl), Deviations From Means (DFM)
and Reference Cell (RC).
An example is worked out to illustrate the
methods and their differences.
In Chapter 5, parameters for the 9-sequence three-treatment twoperiod crossover design are defined according to four methods of
definition, using the by period modeling approach of Helms and Shen
(1980).
From the definitions of the parameters, full rank "essence"
linear models are specified for each method of definition.
Since the
ADBl, DFM and RC methods can yield more than one version of the definition, the versions presented here are called "basic definitions" and
the models derived from them, the "basic models." A study is presented
in Section 5.6 on the consequences of omitting sequence effects on the
definition of the remaining parameters.
The study involves two aspects:
Eliminating sequence effects under the assumption that the sequence
effects (1) are, or (2) are not zero.
In Section 5.7 an investigation
is carried out for comparing all possible ADBl, DFM and RC models when
an estimable parameter is under consideration.
In Chapter 6, by using the basic models for the complete design
found in Chapter 5, parameters for a subdesign are defined and their
equivalence to the parameters of the complete model are investigated
under the theory of Chapter 4.
The existence of singular subdesigns
(subdesignswhere some effects cannot be estimated) is discussed and
"robust" subclasses of subdesigns with respect to the loss of one or
more cells are shown to exist in some classes of subdesigns.
Three
4
criteria of optimality, 0-, A-, and E-criterion, for estimating three
sets of parameters (the first period treatment effects, second period
treatment effects,
and :carryover effects) are studied in Section 6.4,
under the assumption that the number of replicates, r, is one for. each
cell.
For each method of definition, each class of subdesigns of 5-,
6-, 7-, and a-sequence, and for each set of parameters, the values of
the three criteria attained by a particular subdesign were computed
using the basic models.
In Section 6.5, the relative power of each of
the F-tests of the three more important hypotheses in the three-treatment
two-period crossover subdesigns, compared to the power achieved in the
complete 9-sequence design for testing the same hypotheses, is shown to
depend on a Ilnoncentrality ratio,1l NR.
Under the assumption that both
the subdesign and the complete design have the same number of observations and are balanced, the noncentrality ratio was computed for each
hypothesis and each subdesign.
It is verified numerically that the
range of NR is invariant to the methods of defining parameters used
here. The noncentrality ratios are used to compare subdesigns to the
complete design to determine, for each hypothesis and criterion, whether
the subdesign is uniformly better than, about the same as, or uniformly
worst than the complete design.
Finally, a study is performed to
evaluate the number of replicates necessary for a subdesign such that
the noncentrality ratio of the three tests is greater than or equal to
1, i.e., such that the subdesign produces a test that is at least as
powerful as the complete-design test.
5
2.
REVIEW OF LITERATURE
Crossover designs have been used in experiments for many years,
but it seems that Cochran et a1. (1941) were the first who paid attention to the problem of residual effects.
To eliminate residual
effects, different sequences of treatments were used so that comparis.ons between treatment means were free from these effects.
Their
design was based on orthogonal Latin squares, a practice that was
followed very often by many authors in the years to come.
Examples and
discussions about analysis of such designs were shown.
In those days (around 1940), most of the papers on crossover
designs were linked to experiments with diets for animals.
Thus, Loos1i
and Lucas (1943) reported an experiment with cows in lactation, where
the effect of thiamin in the production of milk and fat in the milk were
studied.
The design they described was a double reversal trial with
three periods, a special kind of crossover design.
The search for better experimental conditions to counterbalance
some prQb1ems in crossover designs led Lucas (1943) to introduce a new
technique he called "equa lized feeding," which consists of dividing the
time of experimental observation into three parts:
period, a
standardiz~tion
a preliminary
period and a comparison period.
The treatment
applied in each period depends on the kind of experimental design used.
The implications of this technique in getting more precise comparisons
and in the elimination of the bias of the main effects are discussed.
This technique has been widely used since then in animal nutrition
experiments.
6
Je11inek (1946) described what seems to be one of the first uses
of crossover designs in clinical trials, in an experiment to test the
efficacy of three drugs for headache. A placebo was added and a
four~
treatment four-period crossover design was set up to carry out the
experiment. The implications of using a placebo were not discussed and
the experiment was carried out in such a way that there were no residual
effects.
Later, Cochran and Cox (1950) made an account on the uses of
crossover designs and their peculiarities in dairy husbandry and biological assay experiments when residual effects are not to be expected.
Guides for the analysis of such designs are also given.
Patterson (1950) also studied the analysis of crossover designs
based on Latin squares.
It was shown that several difficulties are
encountered when e·stimates .of resi dua 1 effects are requi red.
1ar there may be biased error variances.
j
In particu-
A way to estimate the bias by
using orthogonal polynomials is shown and he proposed that this estimate
may be used in further experiments. Working independently, Lucas (1951)
examined the same problem and arrived at basically the same conclusion
as Patterson (1950).
Lucas (1951) also proposed the use of orthogonal
polynomials for each experimental unit to overcome distributional
assumptions problems.
Furthermore, by analyzing 15 sets of experimental
data, he concluded that the bias in error variances in the 3x3 designs
is very small and possibly has no practical importance, but might be
serious in the case of the 4x4 designs.
Patterson (1951) made a detailed study of the design and analysis
of changeover trials for 3 and 4 periods.
A set of orthogonal Latin
squares was the basic principle used in the construction of such designs,
although he used factorial arrangements and incomplete blocks in order
7
to obtain some other designs.
All designs shown there allow the esti-
mation of direct and first residual effects.
In discussing the analysis,
two methods of analysis of variance are studied:
(1) a method described
by Cochran et al. (1941), that is, the ordinary least squares; and
(2) a method proposed by himself, a minimization of a weighted sum of
squares which includes the orthogonal polynomials coefficients, already
mentioned in Patterson (1950) and Lucas (1951).· The merits of the two
analyses were compared taking account of the relative efficiency of the
estimates of the residual and direct effects.
Still facing the problem
of getting better designs, Patterson (1952) made a theoretical study
related to the construction of changeover designs.
Conditions for
balancing are laid down for both cases when there are no residual
effects and when there are.
Two methods of construction are presented;
although both make use of Latin squares, he introduced the application
of finite fields in the construction of such designs.
Properties of
some designs and the nonexistence of others are also displayed.
An interesting study based on experimental data was carried out
by Cimenera and Wolfe (1953).
They described an application of the
double switchback design in an experiment with rabbits to test two
kinds of insulin.
They compared the three possible analyses and came
to the conclusion that the analysis of the extended crossover design
yielded practically the same results as the simple crossover.
Even though an efficient statistical analysis for switchback
trials was devised earlier by Brandt '(1938), its use remained restricted
to only two treatments for many years.
Taylor and Armstrong (1953)
pointed out that switchback designs could be extended to any number of
treatments by using the basic switchback pattern for each possible pair
8
of treatments.
Lucas (1956) developed switchback designs for 3 t 4 t 5 t
6 t 7 and 9 treatments t that provide equal sensitivity for all treatment
contrasts.
Furthennore t a detailed analysis of variance is givent
including cases with missing values.
Lucas (1957) criticized the use of Latin squares when estimating
residual effects since the precision of the estimate is very poor.
He
proposed a modified Latin square by adding an extra period of observations.
During this extra periodt the treatment pattern is identical
with that in the last period of the Latin square design. This modification reduces somewhat the infonnation per observation about treatments
if residual effects do not existt but increases the infonnation on
residual effects.
Examples are shown and the statistical analysis is
outlined symbolically and illustrated numerically.
Patterson and Lucas
(1959) considered a general class of crossover designs when an extra
period is added.
The basic designs are derived from Latin squares or
incomplete Latin squarest and satisfy certain conditions of balance
which facilitate the estimation of direct and first residual effects.
The construction and the analysis of the extra period designs are
described. The efficiencies and uses of extra period designs are discussed in general tenns.
The designs are likely to be most useful when
increased accuracy is required in the estimates of residual and
pennanent effects.
Also, Patterson and Lucas (1962) present a catalogue
containing a comprehensive set of crossover designs which particularly
take into account first residuals.
categories:
The patterns shown fall in four
(1) "balanced" crossover designs; (2) "partially balanced"
crossover designs; (3) extra period balanced designs and (4) extra
9
period partially balanced designs.
Methods of statistical analysis and
pointers on the use of the designs are also presented.
Repeated measurement designs are frequently used in psychological.
experiments.
Gaito (1961) studied six cases often used in such experi-
ments: (1) all subjects receive the treatment in the same order; (2) the
order of the treatments is randomized for each subject; (3) the order
is balanced (assumption that all interactions containing order are
zero); (4) the order is balanced and analyzed as a single Latin square
(no assumption about interaction); (5) the order is balanced without
interactions assumptions but analyzed by a modified Latin square design
and (6) the order is balanced without assumptions but analyzed as a
simple treatments versus subjects design.
In fact, six different models
were examined, since for each assumption, a new model is built.
Aspects
of confounding, tests of hypothesis and bias on the main effects are
discussed in each case, having as a base the concept of the expected
value of the mean square.
One of the rare works on analysis of covariance in crossover
designs is presented by Curnow and Sharpe (1962).
They show an analysis
of 2-treatment, 2-period crossover design where the data from period 1
are used as covariab1es.
They argue that this practice may result in
smaller standard errors for the second period treatments and their
interaction with the treatments given iri the first period.
For an
application worked out they concluded that the analysis of the differences between periods might be as informative as the proposed analysis.
Wi1k (1963) describes an experiment where the interest was to
study the behavior of teachers in the high school classroom.
The author
says that was one of the first applications of crossover design to this
10
sort of study. The nature of the problem in question is shown to lead to
~
this kind of design with no residual effects in the mathematical model.
The analysis of variance of a simple crossover design requires an
equal number of subjects in each group, as can be seen in Federer (1955)
and Cochran and Cox (1950).
Chassan (1964) says that in reviewing the
statistical analysis in such cases, "either the data from the second
period was not used at all, or gross averages were used in comparing
treatment effects in a manner which confounded effects with the effect
of treatment period.
1I
The same author presented a t-test for unbalanced
conditions.
Federer and Atkinson (1964) worked on the construction and
analysis for a class of experimental designs denoted as tie-doub1ecrossover designs.
These designs are constructed utilizing 1,2,3,
... ,
t-1 orthogonal Latin squares for t treatments. They also allow estimation of direct and residual effects.
Explicit solutions are obtained
for the situations where the first period results are omitted from the
analysis and where they are included. A numerical example is used to
illustrate the applications. Also, Atkinson (1966) presents designs in
which the effect of a sequence of treatments is the quantity to be estimated.
Designs are presented for treatments in incomplete blocks, of
size two, within experimental units and for treatments in complete
In the same line, Ba1aam (1968)
shows a method of constructing designs in which there are t 2 experi-
blocks within experimental units.
mental units for t treatments; these designs are suitable when estimates
of the treatment versus period interaction are required.
Grizzle (1965) investigated some properties of the two-treatment
two-period crossover design.
Assumptions with respect to the
~
11
mathematical model are discussed and a few examples with clinical trials
are worked out.
It is shown that if the effect of subject is assumed
to be random, the direct treatment effects and the residual effects of
treatments are estimable, but the difference between periods is not.
The analysis of crossover designs was also discussed by Namboodiri
(1972), who made an extensive review of the writings on crossover
designs, specially those employed in psychological experiments.
It can
be noted that the main emphasis of the author was with the existence of
different models, difficulties in the interpretation of the parameters
and a variety of analysis.
Cole and Grizzle (1966) argue that in the analysis of repeated
measurements designs usually the univariate analysis of variance is
valid if the matrix of variances and covariances
where
p
~
is of the form
is the coefficient of correlations between two observations
taken on the same experimental unit.
However, the authors pointed out
that this is not always the case and that a test should be carried out
to check this assumption.
When
~
is not of the form (2.1), they pro-
posed multivariate analysis of variance.
The main points about relevant
hypotheses to be tested and how to perform the tests are discussed and
illustrated with a numerical example.
It is worthwhile to note that
there was no consideration given to possible residual effects.
12
Taylor (1967) says that the usual analysis of variance of a Latin
square is based on , the assumption that, if the n-th unit receives the
k-th treatment in the j-th period, the corresponding observation will. be
(2.2)
where the Yh'
~j
and Lk are parameters which represent the effects of
the unit, period and treatment respectively; the error terms ehj are
assumed normally distributed, with mean zero and standard deviation cr.
He criticized two points:
(1) the expression (2.2) is inadequate since
it does not have residual effects in it, and (2) the error term specification is inadequate since in general errors are not independently
distributed, nor do they have common variance. The latter criticism
was noted earlier by Patterson (1950, 1951) and Lucas (1951).
To over-
come these pitfalls, Taylor (1967) made a study of the validity of the
use of orthogonal polynomials in the analysis of changeover trials with
dairy cows [already used by Patterson (1950, 1951) and Lucas (1951)].
Using this approach, he verified the performance of three different
methods of analysis:
(1) standard least squares; (2) weighted least
squares, suggested by Patterson (1951); and (3) a method proposed by
C. P. Cox (1958), that consists of fitting a regression equation of
appropriate degree to the results for each cow.
Comparisons were made
for designs of 4 periods with no residual effects and for a specific
case the author advised the use of method 2.
Berenb1ut (1968, 1970) developed a method of constructing crossover designs for testing a treatment factor at equally spaced levels.
The designs are such that the degree of freedom for the linear component
of first order residual effects and the degree of freedom for the linear
~
13
treatment by linear residual interaction are both orthogonal to the
degree of freedom for linear, quadratic, etc., components of the treatment effects.
Patterson (1970) extended the study of a certain class.
of crossover designs introduced by Berenb1ut (1968).
The latter pro-
posed changeover designs in which first residual effects are orthogonal
to direct effects and direct effects are orthogonal to subject differences; the designs required 2t periods, t 2 subjects and t treatments.
Patterson (1970), working in a case where t
= 4 and
the treatments are
four equally spaced levels of a single factor, showed that, although
the designs proposed by Berenb1ut (1968) are appropriate for the
estimation of direct effects and residual effects, other designs may
be preferable for the estimation of linear direct versus linear residual
interaction. Also, the author describes two methods of analysis suitable to this kind of design and carried out studies of efficiency.
The construction of changeover using Latin squares was also a
subject for Rees (1969).
In his remarks he says that sets of orthogonal
Latin squares, of whatever method of construction, can serve to the
construction of changeover designs.
If t is the number of treatments,
general rules that must be followed for obtaining crossover designs
with t and t-l periods are given.
As has been seen, there eXist'many options for a balanced changeover design with more than two periods [see, for example, Patterson and
Lucas (1962)J; however, the same is not true for balanced two-period
changeover designs for several treatments.
Gill and Magee (1976),
working on this subject, developed the construction of balanced twoperiod changeover designs for t treatments as well as methods of
analysis, without considering residual effects on the model.
14
Berenblut and Webb (1974) considered the class of four-treatment,
four-period, four-sequence crossover designs constructed from 4x4 Latin
squares. Two covariance-matrix patterns were assumed for measurements
from the same subject:
(a)
From a nonstationary first-order autocorrelated error process
1
p
p
1+p2
p
p
(b)
2
p
p-l
p+p 3
p-l
(2.3)
. •• 1+p 2+.•• +p 2(p-l)
From a stationary first-order process
~2(P) =
1
p
p2
p
p2
1
p
pp-l
pp-2
p
1
pp-3
(2.4)
.........................
pp-l pp-2 pp-3
1
They showed that for each of these classes of covariances matrices, for
p
= -1, -.5, .5, and 1.0 the class of 4x4 Latin square designs proposed
by Williams (1949) (in which each treatment follows every other treatment exactly once) minimizes the generalized variance, det(X'y(p)X)-l,
over the class of all 4x4 Latin square designs.
evaluated numerically for the values of
p
The results were
shown above.
They state that
preliminary results indicate that similar results hold for the 6x6
Latin square.
~
15
When the
b~sic
assumptions of parametric analysis such as homo-
geneity of variances and normality in data cannot be accepted, Koch
(1972) applied the Wilcoxon two-sample rank statistic to test the
hypothesis concerning direct and residual treatment effects and period
effects.
However, the test for the direct treatment effect and period
effect were shown only when the hypothesis of equality between residual
effects has been accepted.
In a similar situation Layard (1978)
developed a test for direct treatment effects when the data are assumed
to be approximately distributed as a Poisson.
Wallenstein and Fisher (1977) present a unified approach for the
statistical analysis of the two-period repeated measurements crossover
designs.
Discussions are made on testing procedures and assumptions
employed under different conditions.
Transformations of the data by
using within-subject sums· (over periods) and within-subject differences
(between periods) are used to eliminate the mixed-model problem.
sums and differences are analyzed in separate ANOVA's.
The
Kershner and
Federer (1979) compare a variety of two-treatment crossover designs
with respect to their ability to provide efficient estimation of contrasts among direct treatment effects when residual effects might be
present.
The designs are also compared on the basis of their ability
to provide additional information on the nature of treatment effects
such as estimating second order residual effects and treatment by period
and treatment by first-order residual effect interactions.
Hills and Armitage (1979), in a survey of crossover designs
applied to clinical trials, make an account of the models currently used
for analyzing a two-period crossover design.
They say, lithe published
results of crossover trials suggest that the appropriate statistical
16
methods are less well known, or less well understood, than those for
parallel group trials.
1I
In their work some models are described and
methods for analyzing quantitative data, ordinal data, and binary data
are proposed. They stressed the importance of the assumption that the
treatment effect is the same in both periods. That assumption can
naturally be false and in that case, there is said to be an interaction
between treatment effect and period. They pointed out some of the
reasons for an interaction:
(1) inadequate washout period; (2) physio-
logical or psychological state induced by the first treatment; and
(3) the treatment effect may vary according to the general level of
response.
However, they add, that possibly there are many other reasons
for an interaction to exist. Tests for detecting interaction between
treatments and periods are discussed. The use of additional information
is also noted in the same paper. They say that, mainly in clinical
trials, the decision on the time and number of additional observations
is not a trivial one and requires a careful examination of the whole
problem. Some guidelines about the use of baselines and washout
periods are given. Armitage (1979), discussing design in clinical
trials, made several remarks on the problems of randomization, size of
trials, planning and execution. Specifically, on two-period crossover
the implications of the presence of carryover effect and interaction
treatment effect versus period effect are again examined, but most of
the material had already been discussed in the latter paper.
Patel and Hearn (1980) extended the results obtained by Cole and
Grizzle (1966) in the application of multivariate techniques to the
repeated measurements experiments. They found that if the residual
17
effects are equal, there is a test for detecting treatment versus period
interaction.
However, if this is not the case, only data from the first
period should be used in the analysis [reinforcing the findings of
Hills and Armitage (1979)J.
Whenever possible, tests of significance
are developed using the Wilks' A criterion.
The problems concerning the analysis of two-treatment, two-period
crossover designs have also been studied recently.
Brown (1980) dis-
cusses some aspects with respect to the use of crossover designs and
strongly criticizes the use of such designs in clinical trials.
Helms,
Kempthorne and Shen (1980) describe a number of difficulties related to
the classical crossover analysis for two-period, two-treatment designs.
They review a variety of models used by many authors and note that the
nature of the "effects" (i.e., treatment and residual effects) being
estimated or tested. differ from author to author and from model to
model. They also describe problems that arise from the correlations
between observations taken on the same subject.
The problem of defini-
tion of the parameters, in the sense of Helms (1980), has revealed some
confusion in the analysis of two-treatment, two-period crossover designs.
For example, Kershner and Federer (1979), who compare different designs
for estimating treatment effects, make inappropriate design .comparisons
because the "treatment effect in one design may not be equivalent to
ll
the "treatment effect in another.
II
Problems with the use of less than full rank (LTFR) models in the
analysis of the two-period crossover designs have been emphasized by
Helms and Shen (1980).
They point out that LTFR models in crossover
designs can bring what is called "model confounding," in addition to
the confounding which comes from the nature of the design.
They discuss
18
the use of full rank multivariate models for the analysis
Df
data from
crossover design with no missing data. They also propose a new type of
full rank model analysis for handling problems with incomplete data.
~
19
3. MODELS FOR TWO-TREATMENT, TWO-PERIOD
CROSSOVER DESIGNS
3.1
Introduction
Before beginning the study of three-treatment, two-period crossover
designs, it is convenient to introduce notation, definitions, and concepts for two-treatment, two-period crossovers.
In a two-treatment, two-period crossover design, it is common to
accept that observations taken on the same subject or experimental unit
are correlated, so that we have a departure of the distributional
assumptions required in the usual analysis of variance. To overcome
this barrier, researchers have proposed several types of analyses where,
basically, one analyzes sums and differences of the observations from
the same experimental unit, as in Wallenstein and Fisher (1977), which
could lead to a loss of information if missing
v~ues
occurred.
Addi-
tional assumptions must be made in order to obtain tests for some
effects.
For example, one has to assume that the residual effects from
all treatments are equal to get a test for period effect.
may be considered in two categories:
and (2) mathematical models.
The problems
(1) distributional assumptions
The general problem relating mathematical
models, estimation and test of hypothesis has been discussed by Helms
(1980), where necessary and sufficient conditions are given for two
different models to be equivalent.
20
3.2 ANOVA Model
In this section we discuss a general mathematical model for the
two-treatment, two-period crossover design, which, possibly, includes.
all models seen in the literature for this design.
From it, considera-
tions will be made with respect to particular models employed by various authors and their possible implications in the analysis of variance.
The complexity of a mathematical model can cause difficulties in the
understanding of its structure. To partially avoid this circumstance,
we have decided to display on model for each period.
However, some
authors, such as Kershner and Federer (1979) and Wallenstein and
Fisher (1977), have made use of more complicated models which represent
data from both periods by one model. A mathematical model for the
first period can be written as:
YABjl
=
u + ~AB + ~ABj + ~l + ~A + e ABjl
YBAjl
=
u.+ ~BA + ~BAj + ~l + ~B + e BAjl
and for the second period:
YABj2
=
u + AA + ~AB + ~ABj + ~2 + ~B + eABj2
YBAj2
=
u + AB + ~BA + ~BAj + ~2 + ~A + e SAj2
where:
is the observation from the j-th subject in the AS
sequence during period p, p
YSAjp
= 1,
2;
is the observation from the j-th subject in the sequence
SA during period p, p
is a general mean;
= 1, 2;
21
~AB
~
and
~BA
ABj and
are effects due to sequences AB and BA respectively;
~BAj
are random effects due to the j-th subject in the
respective sequence (AB or BA); it is assumed that.
~ABj ~ NID{O,a~)
independently of
~BAj ~ NID{O,a~),
all independent of eABjp and eBAjp ' for all allowable values of j and p;
is the effect of the p-th period, p
=
1, 2;
are direct treatment effects of treatments A and B
respectively;
are carryover effects, in period two, from the
indicated treatment in period 1;
eABjp and eBAjp are random errors, assumed to be distributed
NID{O,a~), for all allowable values of j and p.
As a consequence of the assumptions on the parameters of the
model, we have that
=
cov{YABjl' YABj2)
Cov{YBAjl' YBAj2)
=
2
as
as2 + ae2
2
as
= a2
2 + a2
e
as
~ ~
(3.2.1)
where:
a2
= as2 + ae2
p
2 + a2)
= a2S /(a. s
e
(3.2.2)
>
0
22
3.3 Some Difficulties of the ANOVA Model
(1) Many different special cases of the model above, depending
on which terms are omitted in the model, have appeared in the literature.
For example:
Grizzle (1965) omits sequence effects, but includes
subject-within-sequence effects.
Gill and Magee (1976) omit carryover effects.
Wallenstein and Fisher (1977) define three models:
Model I. Omit period effect and sequence effects but include
subject-within-sequence effects.
Model IIa.
Omit carryover effects.
Model lIb. Omit carryover and sequence effects but include
subject-within-sequence effects.
(2)
Some authors [e.g., Wallenstein and Fisher (1977) and
Kershner and Federer (1979)] include standard constraints on the
parameters, that is, main effects sum to zero on the nonrandom parameters except carryover effects; others [e.g., Grizzle (1965)] constrain
the least square estimates to get a solution to the normal equations.
Due to the presence of the unconstrained subjects-in-sequence effects,
the models remain less than full rank, with undefined parameters [Helms
(1980)] .
(3) The meaning (interpretation) of a particular effect depends
critically upon the other effects in the model.
For example, Helms,
Kempthorne and Shen (l980) showed a wide variety of meanings of "treatment" effect" depending on the model used.
(4) Authors have not been careful about the meaning (definition)
of an "effect.
1I
For example, Kershner and Federer (1979) compare
23
different designs for estimating "treatment effects" or testing the null
hypothesis of no treatment effects, when in fact the parameter called
"treatment effect" in one design is different from the "treatment
effect" parameter in the other.
(5) The ANOVA models are "mixed models" with both fixed and
random effects.
In many cases a hypothesis about interesting effects
cannot be tested because the t-test statistics does not follow a
Student's t-distribution [see, e.g., Grizzle (1965)]. This problem
arises from the correlation between two observations from the same
subject.
(6)
In the two-sequence design (AB, BA) many of the effects in
the full model are confounded, which is one of the reasons authors omit
some terms. This is partially due to the design and partially due to
the model.
(7) This model assumes the treatment effect in period 1 is the
same as the treatment effect in period 2, an assumption which does not
hold in some cases, as was discussed by Hills and Armitage (1979).
(8)
In many of the analyses described in the literature [see,
e.g., Grizzle (1965) and Wallenstein and Fisher (1977)] sums and differences of the results of periods 1 and 2 are used.
If one observation is
missing in period 2, for example, to carry out this kind of analysis,
the corresponding period 1 observation is deleted and information will
be lost.
Hills and Armitage (1979) have made many comments about the
use of the two-period crossover designs in clinical trials and Brown
(1980) has also criticized the two-period, two-sequence crossover
design for clinical trials, including some of the criticisms above.
r
24
3.4 The He1ms-Shen Models
Helms and Shen (1980) considered models for the Icomp1ete"
crossover design.
For the two-treatment, two-period design there are
four sequences, AA, AB, BA, BB, and Helms and Shen considered this
design as a 23 factorial. One factor is "Period with levels 1 and 2,
ll
one factor is "First Period treatment with levels A and B, and the
ll
third factor is "Second Period treatment with levels A and B. They
ll
introduced the following notation:
Yptuk
= the p-th period observation from the k-th subject who
received treatment t in period 1 and treatment
period 2; t, u
~ptu
~
in
= A, B, k = 1, 2, ..• , ntu .
= E(Yptuk) for all valid combinations of p, t, u, k.
They examined the 2x2x2 factorial layout of all means.
Period 1
Second Period
treatment
A
,A
First Period
treatment
:8
~lAA
B
25
e
Period 2
Second Period
treatment
First Period
treatment
A
B
A
ll2AA
ll2AB
B
ll2BA
ll2BB
They defined the following parameters:
III
=
Ll
= (lllB. - lllA.)t the treatment effect (B versus A) in the
lll .• t the first period overall mean;
first period;
ll2
=
ll2 •• t the second period overall mean;
A
=
(u2B. - ll2A.)t the carryover effect;
L2
=
(ll2.B - ll2.A)t the period 2 treatment effect (B vs A);
~
=
ll2 - III t the period effect.
In addition t they defined sequence effects t which represent differences
among the four sequences within each period as:
(p)
= llpB. 51
(p)
= IIp.B S2
(p)
512 = llpAA -
llpA. t
II p. At
llpAB - llpBA + llpBBt P = 1t2
(3.4.1)
26
Note that
(1)
'(1
(3.4.2)
- Sl
(2)
A
-
Sl
(2)
'(2 - S2
i.e., these effects are totally confounded. To obtain unique defini(1) (2)
(2)
tions of '(1' A and '(2' one must assume Sl ' Sl ' and S2 are zero.
Helms and Shen justify this assumption when subjects are randomly
assigned to sequences; in such a case one may reasonably assume all
sequence effects are zero.
Helms and Shen defined two models for this setting, a multivariate
model for the case in which there are no missing data and a univariate
model for the case in which some subjects have incomplete data.
With the definitions above
1
-1/2
-1/2
1/4
1
-1/2
1/2
-1/4
Y1BAk
1
1/2
-1/2
-1/4
Y1 BBk
1
1/2
1/2
1/4
Y1AAk
E
Y1ABk
*
E{~l)
111
(3.4.3)
=
*
=
~1
~1
and
E
Y2AAk.
1
-1/2
-1/2
1/4
Y2ABk
1
-1/2
1/2
-1/4
1
1/2
-1/2
-1/4
1
1/2
1/2
1/4
Y2BAk
=
Y2BBk
*
E{~2)
=
*
~2
(3.4.4)
27
If one assumes. sequence effects are zero, s~l), S~~) and si~) and the
corresponding columns of ~1* and ~2* are omitted.
The He1ms-Shen multivariate model for the four sequence design
is shown in terms of the model for the first observation from each
sequence [Helms (1980)], as:
E=
Y1AA1 Y2AA1
1
-1/2
-1/2
1/4
Y1AB1
1
-1/2
1/2
-1/4
1/2
-1/2
-1/4
1/2
1/2
1/4
Y2AB1
=
Y1BA1
Y2BA1
1
Y1BB1
Y2BB2
1
(3.4.5)
i . e. ,
*
E{~l* ~2)
= ~ * (~1 ~2)
(3.4.6)
The multivariate model may not be used for the case in which some
subjects have incomplete data; the procedure proposed by Helms and Shen
for this situation is to analyze the first period data via the univariate model
(3.4.7)
and analyze the second period data separately via the corresponding
univariate model
(3.4.8)
where:
:1 and: 2 are the vectors of observations from periods 1 and 2
respectively;
28
~l
and
~2
are the design matrices for the first and second
periods respectively;
~l
and
~2
are defined in (3.4.3) and {3.4.4} respectively.
To combine results from the two models, one can use the Bonferoni
procedure.
For example, to test the null hypothesis of no treatment
effect in either period, i.e.,
(or both)
one would compute the t-test statistic for each marginal hypothesis and
reject if either Itil, i
= 1,2
exceeds the critical value of a/2.
Estimates of parameters and test of hypothesis are generally obtained
from general linear model methods.
Helms and Shen point out that crossover design confounding
patterns are readily observed in the model.
ing has already been discussed.
Sequence effects confound-
However, if one omits sequences AA and
* ~2'
* ~1* and
BB from the design, and omits the corresponding rows of ~1'
X*2 above [(3.4.3), (3.4.4)], it is clear, from observing the second and
third columns of X*2 that the following effects are totally confounded:
A and '2' '1 and
s~l}, ~p and si~}. While the confounding with sequence
effects is not bothersome, one can easily see that in this popular
design the carryover and period-two treatment effects are not separable.
Helms and Shen claim that two of the advantages of their full rank
model are:
29
(1) All effects are well defined and easily interpretable;
(2)
Confounding patterns are readily discernible, both for the
full four-sequence design and for subdesigns, such as AB,
BA.
30
4.
SOME THEORY ON DEFINITION OF
PARAMETERS AND MODELS
4.1
Equivalence Between Definitions
Helms (1980) defined some concepts and developed some theory
which will be applied extensively in succeeding chapters.
Part of this
material, which has not yet appeared in referenced literature, is
briefly summarized below.
Essence model.
In the following material it is often sufficient
to consider a model for only one observation from each cell in an
experimental design.
Let Y denote the vector of observations, with an
assumed model
=
E(Y)
Let
~E
X/3
(4.1.1)
be the vector consisting of the first observation of each cell;
obviously
~E
is a subset of
~
and the model
(4.1.2)
is implied by the full model, where
~E
contains the rows of X corres-
ponding to "first observations."
is called the "essence" model by Helms (1980).
Specifications and definitions.
Helms (1980) defines a specifica-
tion of 13 as one or more matrix equations involving /3, E(Y) and known,
31
constant matrices as X. A definition of
-
-e is a specification of -e
which, for any allowable value of E(Y), has a unique solution for
e.
Helms (1980) shows that the general linear model
E(Y)
=
Xe
(4.1.3)
which is a specification for
e, is a definition of e if and only if
X
has full rank.
Helms (1980) notes that two different parameter definitions may
or may not define the same parameter.
He declares two definitions to be
eguiva1ent if and only if they define the same parameter, i.e., for any
given allowable value of E(Y), i.e., a value which satisfies the model,
both definitions produce the same value of
e. Helms proves the follow-
ing theorem which gives necessary and sufficient conditions for two
definitions of e (within the context of one model) to be equivalent.
Theorem 4.1.1.
E(Y)
Let
= Xe
specify a full rank linear model and consider two alternative definitions
of the primary parameter e of this model:
0.1 : _e(i)
where
~1 ~ ~2·
= A.E(Y),
_1
_
i
= 1,2,
(4.1.4)
Then 01 and 02 are equivalent if and only if
(4.1.5)
32
The following can be stated as a corollary of this theorem:
Let 01 be the "canonica1 definition of 13," i.e.,
~1 = (~~~)-1 ~'E{~) [Helms (1980)]. Then O2 is equivalent to 01 if and
only if ~2~ = ~.
Corollary.
An important theorem which links the equivalence in essence model
to the full model was also proved by Helms (1980).
Theorem 4.1.2.
tion of
Let in Theorem 4.1.1 01 be the canonical definiin the essence model and O2 be the definition extended to the
~
full model; then 01 and O2 are equivalent.
4.2 Methods of Defining Parameters
This section considers methods of defining parameters as a linear
function of the basic cell means
13
=
~
= E{Y) of the form
(4.2.1)
A~
Four of the most common methods will be considered in the discussion.
Let
E{Y)
=
(4.2.2)
~
be an essence linear model, where Y ;s the vector of first observation
and
~
the vector of cell means.
The scope of the definition of a
parameter 13 is to specify a model, say,
E{Y)
= X 13
(4.2.3)
where X is a known full rank matrix and 13 a vector of known linear
functions
of~.
It is clear that from the equation (4.2.2) a large
33
number of defi.nitions can be generated and there is not a clearcut way
of expressing all possible definitions.
Besides, the selection of a
particular definition can be related to the type of treatment to be
applied, or for example, by practical considerations that imply certain
relationships among the expected values of the observations.
However
chosen, a definition of a may be given in the form
a
(4.2.4)
AE(Y)
=
In a case where the treatments are qualitative (not different
levels of a single factor), in almost all methods of defining parameters
one wishes to define main effects and interactions, two important concepts in experimental statistics.
In general, definitions from differ-
ent methods are not equivalent. Three methods that will be studied are:
(1) Average Distance Between Lines (IIADBL II ), (2) Deviations From Means
e'DFM"), and (3) Reference Cell Model (IIRC II ). An example will be used
to describe the methods.
Consider a 2x4 factorial (factor A at two levels and factor B at
4 levels) treatment design run as a completely random design, with the
following notation:
Yab
=
the observation of a-th level of factor A and b-th level
of factor B, a
~ab
=
E(Yab}
a
= 1,2, b = 1,2,3,4;
= 1,2,
b
= 1,2,3,4.
To illustrate what is going to be developed, some graphics will
be constructed, in which values and lines are made up to serve the
purpose of helping to understand the process.
and 4.2.2 values of
~ab
Thus, in Figures 4.2.1
shown in Table 4.2.1 are plotted.
34
8
• P14
Al
1124
A2
7
6
5
E{Yab)
4
1112
3
112l
2
llll
e
1
a
2
1
3
4
Levels of factor B
Figure 4.2.1
Plots of the 2x4 factorial
(Population means)
35
8
E(Y
ab )
lJ14
7
lJ23
83
6
lJ24
84
lJ21
81
lJ22
82
5
lJ13
4
lJ12
3
e
2
lJll
1
0
1
2
Levels of factor A
Figure 4.2.2 Plots of the 2x4 factorial
(Population means)
36
Table 4.2.1
Values assumed for the
~ab
to
construct Figures 4.2.1 and 4.2.2
a
b
1
2
2
3
4
1
5
7
8
6
37
Average Distance Between Lines.
~2i
-
~li'
Consider the differences
i = 1,2,3,4, that may be evaluated in Figure 4.2.1.
A
natural measure of the difference between the levels 1 and 2 of factor
A is the average of a11 four di fferences, that is, an "average di stance
between the lines for Al and A2 ."
If one defines
4
= 41 i=l
I (~2i -
~l
then
~l
~li
)
(4.2.5)
is called an ADBL main effect of factor A. A similar argument
can be used with respect to factor B.
In this case, however, many sets
of differences may be used to define the main effects of factor B. As
one can see in Figure 4.2.2, there are at least twelve possible "average
difference" ways of comparing the lines Bl , B2 , B3 , and B4 and consequently at least twelve different ADBL main effects definitions. Two of
these definitions would be:
{~12 - ~11)/2 + {~22 - ~21)/2
~11
=
(4.2.6)
{~13 - ~11)/2 + {~23 - ~21)/2
{~14 - ~11)/2 + {~24 - ~21)/2
-1
1
0
1
-1
1
0
0
- 2" -1
0
1
0
-1
0
1
0
-1
0
0
1
-1
0
0
1
_1
for comparing line Bl with lines Bj
, j
~
(4.2.7)
= 2,3,4, and
{~13 - ~12)/2 + {~23 - ~22)/2
{~11 - ~12)/2 + {~21 - ~22)/2
{~14 - ~12)/2 + {~24 - ~22)/2
(4.2.8)
38
=
0
-1
1
0
0
-1
1
0
'2 1
-1
0
0
1
-1
0
0
0
-1
1
~
1
0
0
for comparing line B2 with lines Bj
The parameters
~ll
(4.2.9)
~
and
1
0
-1
= 1,3,4,
, j
where
are defined to be the main effects of factor
~12
B, even though they are different.
However, if one is interested in
testing the null hypothesis, certainly,
~ll
by the very definitions of
= ~ if and only if
~ll
~12
= ~,
~12.
and
By looking at Figure 4.2.1, one can see that the lines Al and A2
are not parallel. The lines could be parallel if
-
~21
~ll
=
~22
-
=
~12
~23
-
=
~13
~24
-
~14
(4.2.10)
Define
r-
=
Yll
(~21 - ~ll) - (J.!22 - ~12)
(~21 - J.!ll)
(4.2.11 )
(J.!23 - ~13)
(~21 - ~ll) - (~24 - J.!14)
=
-1
1
0
0
1
-1
0
0
-1
0
1
0
1
0
-1
0
~
(4.2.12)
~
-1
0
0
1
1
0
0
-1
and
(J.!12 - J.!22) - (J.!ll - J.!21)
I
~12
=
(J.!12 - ~22)
(J.!13 - J.!23)
(~12 - J.!22) - (J.!14 - J.!24)
(4.2.13)
e
39
-1
1
a
a
=
1
1
a 1
-1
a a
a -1 a
a
-1
-1
-1
a a
1 a
a 1
(4.2.14)
Then !11 and !12 are two possible ADBL definitions of the interaction
between factors A and B.
Clearly, !11 ; !12' but as was in the case of
main effects definitions of factor B, !11 =
~
if and only if !12 =
~.
Thus, one can have many different ADBL main effects and interactions definitions, although, for the purpose of testing the null
hypothesis, the results are the same in any case.
Deviations from means.
The DFM method of defining main effects
and interactions has some historical importance as was noted by Helms
(1977).
It has been confused with other methods that yield less than
full rank models,
well defined.
obtained.
cons~quently
However, by this method, well-defined parameters are
Furthermore, for certain particular cases, the interpretation
of the parameters is easy.
lJ··
leading to parameters which are not
For the example in question, define
1 24
= 8 I .I lJab
a=l b=l
(4.2.15)
1 4
lJ a . =
t b~l lJab
(4.2.16)
1 2
= -2
I
a=l
(4.2.17)
lJab
then DFM definitions of main effects and interactions are:
lJ a . - lJ··
a
= 1,2
(4.2.18)
= lJ.b- lJ ..
b
= 1,2,3,4
(4.2.19)
=
40
(4.2.20)
~ab - ~a. + ~.b - ; .. ]
=
(4.2.21)
Note that these parameters are linearly dependent in the sense that
2
a~l ljIab = 0, for any b
4
L
b=l
0, for any a
=
ljIab
As a consequence of the method of definition, we select the following
linearly independent subsets:
II
y
~
=
=
-
~l.
=
..
(main effect of factor A)
(main effects of factor B)
~
•1
~
.2
- ..
- ..
~
.3
- ..
~22
ljI
~
~
~
~
-
~2. -~.2+~··
1123 - 112. -~.3+~··
1124 -
~2.
(interaction effects)
-1l.4+~··
Many other linearly independent subsets of the DFM definitions of
main effects and interactions may be selected, being different of each
other and different of those obtained by the ADBL method.
Reference cell model.
II
reference cell
ll
In the RC method one specifies the
used as a basis for definitions of all main effects and
41
interactions.
Which cell is to be selected is a subject beyond the
.
scope of the current study.
For the same example, consider cell (1,1)
as the reference cell. Then the definition of main effects and
inter~
actions would be:
~11
= E(Y11)
a
= ~21 -
y
=
(reference cell mean)
~11
~12
-
~11
~13
-
~11
~14
-
~11
(RC main effect of factor A)
(RC main effects of factor B)
~22 - ~21 - ~12 + ~11
=
~13
- ~21 - ~13 + ~11
~24
- ~21 - ~14 + ~11
(RC interaction between
factors A and B)
EVidently, for each cell taken as reference cell, a new RC
definition would be originated.
Orthogonal polynomials (OP) method.
Another method of defining
parameters is the orthogonal polynomials (OP) method.
This method has
been widely used in factorial experiments when the levels of the factors
are quantitative.
The details of the OP method can be found in many
textbooks of experimental statistics [see, for example, Cochran and COX
(1950)J, but a few comments are justified since it will be used here.
In factorial experiments, the OP method is used primarily to get
definitions of the linear component of a main effect, the quadratic
component, and so on, as well as the corresponding interactions effects
between factors.
For the case where the levels are equally spaced,
42
suitable coefficients can be found in tables like those.presented in
Fisher and Yates (1943), which permit direct definitions of the
parameters as linear functions of the expected values.
For the situ-
ation where the levels are not equally spaced, a little arithmetic may
be required to obtain the coefficients. Two remarkable properties of
the OP method are:
(1) the defined parameters are orthogonal linear
functions of the expected values, and (2) the definition is unique.
The application of any of these four methods described above can
be extended to more complex cases, without much difficulty whenever
missing cells have not occurred.
Discussions on this problem as well
as others can be found in Helms (1977).
4.3 Estimability in Two Models
with Different Parameters
As seen in the last section, for a specific method of defining a
vector-valued parameter S of main effects and interactions, one may
have several possible definitions, all of them different, so one can
speak about, for example, the DFM definition of main effects.
Thus,
given two different models obtained by the same method of definition,
it will be necessary to verify in what sense they are different and in
what sense they are the same.
It might occur that the parameters are
not the same but the results of a determined analysis could be the
same.
This problem is explored in the next theorem, in a more general
context.
Theorem 4.3.1.
Let
E(~)
= ~1~1
and
E(~)
= ~2~2
linear models such that ~1 1 ~2' ~l 1 ~2 and R(~l)
canonical definitions of
~l
and
~2
be
be two full rank
= R(~2)· Let the
43
e
Let
~l
~l
= (~i!l)-l~iE(!)
(4.3.1)
~2
= (~2~2)-1~2E(!)
(4.3.2)
= ~i~l
(~l
being of full rank) be an estimable linear parametric
function in the model E(!)
(1)
~2 = ~2~2
= ~l~l. Then
is identical to
~l wi~h ~2 = ~i(~i~1)-1~i~2'
for
all values of E(Y) satisfying the models.
(2) ~l
= ~2 for all values of
!, when ~i
(3) The test statistic for HOl :
statistic for H02 : ~2
~l =.~
= ~,
is evaluated via model i;
is identical to the test
when the test statistic
for HOi is evaluated via model i.
Proof:
By the canonical definition of
and since
R(~l)
~2
we have that
= R(~2) it follows that
~2~2 = ~i(~i~l)-l~lE(~) = ~i~l
by the canonical definition of
~1.
Part (2) follows from part (1) by replacing E(Y) by Y and part
(3)
follows from (1) and (2).
Q.E.D.
Thus, if a method of defining parameters has V different versions,
like, for example, the ADBL method, and if
R(~i)
= R(~j)'
44
i,j
= 1,2, .•. , V, then one can pick any version, since the results
related to a fixed estimable linear parametric function will be the
same for any version.
45
5.
SPECIFICATION OF MODELS FOR THE COMPLETE
THREE-TREATMENT, TWO-PERIOD CROSSOVER DESIGN
5.1
Introduction
The different problems involved in the specification of mathematical models and the convenience of defining full rank models for each
period for crossover designs were treated in Chapter 3, together with
several aspects of the two-treatment, two-period design and the He1msShen approach.
In Chapter 4, there is a discussion of the problem of
equivalence between definitions of parameters in linear models.
Also,
four methods of defining parameters are presented and some of their
properties displayed .. Some of the results of Chapter 4 will be used
in the current chapter.
In this chapter the objective is to define
models of full-rank for the complete three-treatment, two-period crossover design, i.e, the design involving all possible sequences.
The literature on the two-treatment, two-period design is reasonably extensive but the same is not true for the three-treatment,
two-period.
Patterson and Lucas (1962) mentioned such designs among
several other kinds of designs.
Also, Gill and Magee (1976) showed how
to construct and to analyze balanced three-treatment, two-period designs
without residual effects in the models.
However, the problems discussed
in Chapter 3 for the two-treatment, two-period designs are similar to
those found in the three-treatment, two-period:
difficulties in model-
ing (several different 1ess-than-fu11-rank models), definitions and
interpretation of the parameters, confounding and so on.
As much as is
46
possible, the Helms-Shen approach will be used to define models for each
period and for reasons explained in Chapter 4, only first-observation
models will be considered.
In a particular experiment,.manyaspects of the differences between
treatments are important.
While one can study design without consider-
ing all the details of treatment differences, experiments seem to fall
into a few classes, which are important in the present context.
A
three-treatment, two-period crossover design may be carried out with the
two following types of treatments:
(1)
Three qualitatively different treatments,
(2)
Quantitatively increasing levels of the same treatment.
These two cases will be considered here, with the restriction that in
case (2) the levels will be considered equally spaced (this restriction
simplifies the presentation and is easily removed).
When the treatments A, Band C are qualitative in nature, the
definition of the parameters present some difficulties, as mentioned in Chapter 4.
First, certain concepts, such as ma in effects,1I
II
do not possess universal definition.
Second, for a given method of
defining parameters the definition may not be unique. Three of those
methods, involving definitions of main effects and interactions, will
be used in forthcoming sections.
For each method several definitions
of the parameters will be possible.
The approach to be followed is to
show a basic definition and to explain the existence of others.
The
selection of this basic definition is arbitrary, but will serve the
purpose of this work.
Another aspect to be noted here is the factorial structure of
the complete three-treatment, two-period design, which will be useful
47
in the forthcoming development.
As with the two-treatment, two-period
design, the three-treatment design can be viewed as a 2x3x3 factorial
arrangement, where the factors and respective levels are:
Factor 1 - Period, with levels 1 and 2
Factor 2 - First period treatments, with levels A, B, and C,
Factor 3 - Second period treatments, with levels A, B, and C.
The complete three-treatment, two-period crossover design has 9
sequences: AA, AB, AC, BA, BB, BC, CA, CB, CC.
~ptu'
If we let E(Yptuk)
=
where Yptuk is the k-th observation in the p-th period for the
sequence tu, p
= 1,2;
t,u
= A,
B, C and k
= 1,2, ... ,rtu '
the complete
factorial structure can be seen in the table of "cell means
II :
Period 1
e
Second period treatments
First period treatments
A
B
C
A
~lAA
'~lAB
~lAC
B
~lBA
~lBB
~lBC
C
~lCA
~lCB
~lCC
Period 2
Second period treatments
First period treatments
A
B
C
A
~2AA
~2AB
~2AC
B
~2BA
~2BB
~2BC
~2CA
~2CB
~2CC
C
48
The following sections define parameters and models for this
design, considering only first-observation models ("essence models")
based on the cell means, and for what follows,
~p
p
= 1,2
and
~p
are
defined to be
VI
-p
=
(V pAA1 YpAB1 YpAC1 YpBAl YpBB1 YpBC1 YpCAl YpCB1 YpCC1)
(5.1.1)
~p
(~PAA ~pAB ~pAC ~pBA ~pBB ~pBC ~pCA ~pCB ~pCC)
=
(5.1.2)
5.2 Orthogonal Polynomials Models
In an experiment where treatments are various levels of a quantitative factor, the terms "linear effect," "quadratic effect," etc., are
standard and often utilized in the analysis of variance, independently
of the design.
The definitions of such parameters for the complete
three-treatment, two-period crossover design will be made here using
orthogonal polynomials and will be called hereafter the OP definition.
The procedure to be followed is much the same for other methods of
definition:
First, the estimation space will be conveniently decomposed
in 9 components (degree of freedom), from which 8 will be associated
with sequence effects and one with a "general mean"; this will be
performed on each period.
be defined.
Then, for p
After that, the parameters of interest will
= 1,2 define the following sequence effects as
linear combinations of the cell means:
=
~pC.
-
~pA.'
(5.2.1 )
49
e
S(p)
3
=
~p.C
S(p)
4
=
~p.A - 2~p.B + ~p.C'
S(p)
= (~pAA - ~PAC) - (~PCA - ~PCC)'
S(p)
=
(~PCA - 2~pCB + ~pCC) - (~pAA - 2~pAB + ~pAC)'
S(p)
7
=
(~pAA - ~pAC) + 2(~PBA - ~PBC) - (~pCC - ~pCA)'
. S( p)
8
=
(~pAA - 2~PAB + ~PAC) - 2(~PBA - 2~PBB + ~pBC)
5
6
-
~p.A'
and the overall mean in the p-th period,
=
~
(5.2.2)
p ..
Other characterizations of the eight sequence effects defined above
could be used, but this particular one not only reflects the factorial
structure but will also be helpful in displaying confounding patterns
below.
Following the approach of Helms and Shen (1980), define the
following parameters of interest:
,~p)
the direct linear effect of treatments in the p-th
period, p
(1)
=
(2)
=
'1
'1
=
~lC.
-
~lA.
~2.C
-
~2.A'
1,2
(5.2.3)
the direct quadratic effect of treatments in the p-th
period, p = 1,2
50
(1)
1'2
= lJ1A. - 2lJ 1B.
(2)
1'2
= lJ2.A - 2lJ2 •B + lJ2.C
(5.2.4)
+ lJ1C.
the residual linear effect of the treatments
A1
= lJ2C. - lJ2A.
A1
(5.2.5)
the residual quadratic effect of the treatments
A2
= lJ 2A • - 2lJ 2B .
A2
(5.2.6)
+ lJ2C.
By examining equations (5.2.1) to (5.2.6), it can be seen that
some of the parameters have the same definition.
Thus, 1'~1) and 1'~1)
are identical to (confounded with) s~l) and S~l) respectively; 1'~2),
1'~2), A1 and A2 are confounded with S~2), si 2), si 2) and s~2)
Due to these confoundings, the effects si 1), s~l), si 2),
S~2), s~2), and si 2) must be assumed to be negligible (i .e., equal to
respectively.
But as has been discussed earlier, this may not bring serious
zero).
complications since in the majority of cases all sequence effects can
be taken to be zero. The effect of this assumption on the definitions
of parameters wi 1,1 be exami ned.
I
~ 11
QI
~
12
= (
(1)
\.11 1'1
Havi ng these facts in mi nd, defi ne
(1) S(l) S(1} S(1) S(l} S(l} S(l»
3
4
5
6
7
8
(5.2.7)
1'2
= (
, , (2) (2) S(2) S(2} S(2) S(2)}
lJ2 "1 "2 1'1 1'2
5
6
7
8
(5.2.8)
By solving the system of equations (5.2.1) to (5.2.6) and taking into
consideration what was said about sequence effects,
~11
and
~12
are
defined as:
~1
P
~
= A
E(Y~P ) ,
~1
p
= 1,2
(5.2.9)
e
51
e
where:
1/9 1/9 1/9 1/9 1/9 1/9 1/9 1/9 1/9
-1/3 -1/3 -1/3
a
a
a
1/3 1/3 1/3
1/3 1/3 1/3 -2/3 -2/3 -2/3 1/3 1/3 1/3
-1/3
~1 =
a
1/3 -1/3
a
1/3 -1/3
a
1/3
1/3 -2/3 1/3 1/3 -2/3 1/3 1/3 -2/3 1/3
- 1
2 - 1
a
a
- 1
a
2
1
a
1 - 2
- 1
1
1 - 2
a
a
a
a
a
a
1
1 - 2
1
a
1
1 - 2
1
- 1
- 2 - 1
4 - 2
(5.2.10)
By using the equation (5.2.9) and (5.2.10) and noting that Al is a
nonsingular matrix, the following model can be specified:
e
E(~p)
= ~l~lp ,
P
= 1,2
(5.2.11)
where:
1 -1/2 1/6 -1/2 1/6 1/4 -1/12 -1/12 1/36
1 -1/2 1/6
.a
-1/3
a
1/6
a
-1/18
1 -1/2 1/6 1/2 1/6 -1/4 -1/12 1/12 1/36
1
~1
=
1
1
a
a
a
-1/3 -1/2 1/6
-1/3
a
-1/3
-1/3 1/2 1/6
a
a
a
a
a
a
1/6 -1/18
a
-1/6
1/9
-1/18
1
1/2 1/6 -1/2 1/6 -1/4 1/12 -1/12 1/36
1
1/2 1/6
1
1/2 1/6 1/2 1/6 1/4 1/12 1/12 1/36
a
-1/3
a
-1/6
a
-1/18
(5.2.12)
e
52
Thus, (5.2.11) defines the OP essence model for the complete two-period
crossover design, when A, Band C are equally spaced levels of a single
Extension to the full model (in the observations) will be
factor.
discussed below.
5.3 Average Distance Between Lines Definitions
To get an intuitive understanding of this method (as well as for
the others) for the complete three-treatment, two-period crossover
design, some graphics are helpful.
In Figures 5.3.l(a), 5.3.l(b}
and 5.3.l(c), hypothetical cell means are plotted, taking into account
the factorial structure seen earlier.
Lines and values shown there
are fictitious, since the real value of the parameters cannot be known.
Following the ideas described in Chapter 4 and of the first
section of this chapter, a basic ADBL definition of the parameters for
~
the complete three-treatment, two-period crossover design is:
Sequence effects (within period):
S(p)
1
=
~pB.
- ~ pA.
S(p)
2
=
~pC.
-
S(p)
3
=
~p.B
- ~ p. A
S(p)
4
=
~p.C
- ~ p. A
S(p)
5
=
~pAA - ~pAB - ~pBA + ~pBB
S(p)
=
~pAA
- ~pAC - ~pBA + ~pBC
S(p)
=
~pAA
- ~pAB - ~pCA + ~pCC
6
7
(5.3.1)
~pA.
~
53
7
6
First period
treatment
5
C
~lCA
~lCB
~lCC
4
E{Yltuk)
B
3
~lBA
~lBB
~lBC
2
e
1
A
~lAA
~lAB
A
B
~lAC
0
C
Second period treatments
Figure 5.3.l{a)
Plots of the three-treatment, two-period crossover
design first period means
54
First period
treatments
8
7
112BC
I
(
B
A
6
5
E{Y2tuk)
4
112BA
3
C
2
112CA
1
112AA
0
A
B
C
Second period treatments
Figure 5.3.l{b)
Plots of the three-treatment two-period crossover
design second period means
e
55
112BC
7
6
Second Period
treatments
112AC
5
E{Y2tuk)
112CB
B
4
3
112AB
112CC
C
2
A
e
1
J;!2CA
112AA
112BB
0
A
B
C
First period treatments
Figure 5.3.l{c)
Plots of the three-treatment, two-period crossover
design second period means
56
s(p)
8
-
-
~pAA
-
~pAC
-
~pCA
+
~pCC
Note that these sequence effects are different from those used in the
OP method.
Overall period mean:
=
~
(5.3.2)
p••
Parameters of interest:
L~P)
the contrast of treatment B vs. treatment A in the
p-th period,
(1)
= 3"1 ? (~ 1Bj - ~ 1Aj )
(2)
L1
1
3" ~ (~2iB - ~2iA)
L1
(5.3.3)
J
L(P)
2
=
,
the contrast of treatment C versus treatment A in the
e
p-th peri od,
L2
= 3"1 ~
(~1 Cj - ~ 1Aj )
(2)
L2
= 3"1 ,~
(~2iC - ~2iA)
(1)
A1
J
(5.3.4)
the contrast of treatment B versus treatment A in the
second period, due to residual effects of the treatments
applied in the first period,
(5.3.5)
A2
the contrast of treatment C versus treatment A in the
second period, due to residual effects of the treatments
applied in the first period,
e
57
1. 2
1
=. "3 ~
J
,~1) and ,~2), i
().I2Cj - ).I2Aj)
=
(5.3.6)
1,2 are ADBL direct main effects of the treatments
in periods 1 and 2 respectively, and 1. 1 and 1. 2 and ADBL residual
effects of the treatments. Having defined the parameters, the patterns
of confounding can be examined.
,~1) and ,~1) are confounded with s~l)
and S~l) respectively; ,~2), ,~2), 1. 1 and 1. 2 are confounded with S~2),
si 2), 5~2) and 5~2) respectively. Taking these sequence effects to be
zero, define
~21
I
~22
e
= (
(5.3.7)
= ( , ,
(5.3.8)
(1) (1) 5(1) S(l) S(l) S(l) s(l) S(l))
).11 '1 '2
3
4
5
6.
7
8
(2) (2) S(2) s(2) S(2) s(2))
).12 A1 A2 '1 '2
5
6
7
8
From equations (5.3.1) to (5.3.6), we have that
~2p
P = 1,2
= ~2 E(~p)'
(5.3.9)
where:
1/9 1/9 1/9 1/9 1/9 1/9 1/9 1/9 1/9
-1/3 -1/3 -1/3 1/3 1/3 1/3
-1/3 -1/3 -1/3
-1/3 1/3
~2 =
-1/3
0
e
0 -1/3 1/3
0
0
0 - 1
1
0
0 - 1 - 1
0
1
0
1/3 1/3 1/3
0 -1/3 1/3
0
0
0
1/3
0
0
0
0
0
0
1/3 -1/3
0
0
0
0 - 1
1
0
0 - 1
0
0
0 - 1
0
1
1 - 1
1
0
1/3 -1/3
1 - 1
1
0
0
(5.3.10)
58
From expression (5.3.9) a mathematical model can be specified as:
(5.3.11 )
where:
1 -1/3 -1/3 -1/3 -1/3 1/9 1/9 1/9 1/9
1 -1/3 -1/3 2/3 -1/3 -2/9 1/9 -2/9 1/9
1 -1/3 -1/3 -1/3 2/3 1/9 -2/9 1/9 -2/9
1 2/3 -1/3 -1/3 -1/3 -2/9 -2/9 1/9 1/9
~2
1 2/3 -1/3 2/3 -1/3 4/9 -2/9 -2/9 1/9
=
(5.3.12)
1 2/3 -1/3 -1/3 2/3 -2/9 4/9 1/9 -2/9
1 -1/3 2/3 -1/3 -1/3 1/9 1/9 -2/9 -2/9
1 -1/3 2/3 2/3 -1/3 -2/9 1/9 4/9 -2/9
1 -1/3 2/3 -1/3 2/3 1/9 -2/9 -2/9 4/9
Certainly, instead of comparing treatment B versus treatment A
and treatment C versus treatment A, one could think of comparing A
versus C and B versus C, giving rise to a new definition of L~p), Lip),
Al and A2'
Although such parameters could still be called "ADBL main
effects," that would be a different ADBL definition of main effects.
Considering the possible combinations, there are 9 different definitions
of
~22
and 3 of
~21'
Our basic definition is expressed in (5.3.9) and
our basic model in (5.3.11), which will be used in further developments.
5.4 Deviations From Means Definitions
The difference in principle between Deviations From Means (DFM)
and the ADBL method can be evaluated in Figures 5.3.l(a), 5.3.l(b) and
5.3.l(c).
While in the ADBL method one averages distances between
pairs of points, in the DFM method distances are also averaged, but
59
between one point and the lIaverage line.
(1)
'1
=
1.3 J
\' (~lBj -
~lAj
1~ (~lA· -
iJ"" .)
J
J
)
.J
1I
Thus, for example,
for the ADBL method and
for the DFM method.
The definition of the parameters here will follow a similar pattern to
that stated in Chapter 4. Thus, for p
= 1,2, define:
Overall mean for p-th period
~p
= ~ p..
(5.4.1)
Sequence effects
s(p}
1
=
~pA.
-
~
s(p} =
2
~pB.
-
~
S(p} =
3
~p.A
-
~p
s(p}
4
=
~p.B
-
~p
s(p}
5
=
~pAA
-
S(p}
6
=
~pAB
+ s(p})
- (~ P + s(p)
1
4
s(p)
=
~pBA
+ s(p))
- (~ P + s(p)
2
3
s(p}
= YpBB -
7
8
{5.4.2}
p
P
(~
(~
p
p
+ s(p) + s(p}}
1
3
+ s(p) + s(p})
2
4
Parameters of interest
(5.4.3)
60
(1)
T2
=
j~
(2)
T1
=
l~
lJ
3 1 ( 2iA - lJ2i.)
(2)
T2
=
l~
lJ
lJ
3 1 ( 2iB - 2i.)
A1
=
l~ (lJ 2Aj - lJ 2. j )
3J
A2
=
j ~ (lJ 2Bj
e
(lJ 1Bj - lJ 1. j )
- lJ2.)
where:
(1)
T·1
and T~2) i = 1,2 are a DFM direct main effect of the
treatments in periods 1 and 2 respectively,
A1 and A2 are a DFM residual effects of the treatments.
Due to the method of defining sequence effects, the patterns of
confounding are similar to those in ADBL definition:
T~l)
and
i~l)
are identical to s~l) and s~l) respectively; T~2), T~2), A1 and A2 are
confounded with S~2), si 2), S~2) and s~2) respectively. Applying a
similar argument to that used before, define
(5.4.4)
(5.4.5)
Solving the system of equations shown in (5.4.1), (5.4.2) and (5.4.3),
we have the following definition:
~3p
=
~3 E(~p)
P
= 1,2
(5.4.6)
and consequently, a mathematical model of the form
(5 .4. 7)
e
61
e
where:
1 1 1 1 1 1 1 1
2 2 2 -1 -1 -1 -1 -1
-1 -1 -1
2 -1 -1
= 91
2 2 2 -1 -1 -1
2 -1 -1
2 -1 -1
2 -1 -1
2 -1 -1
2 -1
4 -2 -2 -2
1 1 -2
1 1-
-1
A
_3
-; l
4 -2
-2
1 1 4 -2 -2 -2
1 -2
1 -2
1 1 -2
-2
1 -2
4 -2
(5.4.8)
1
1 1
1 -2
1
1 1 0 1 0 1 0 0 0
1 1 0 0 1 0 1 0 0
e
1 1
o -1
-1 -1 -1
0
0
1 0 1 1 0 0 0 1 1
~3
=
1 0 1 0 1 0 0
1
1 -1 -1
0
(5.3.8)
o -1 0
o -1 o -1 0
1 o -1 o -1
1 0 1 -1 -1
1 -1 -1
o -1
1 -1 -1 -1 -1
0
1 1 1 1
As before, 8 other OFM definitions are possible; however, for the
following developments the basic DFM model is that in (5.4.7)
5.5
Reference Cell Models
Finally, we consider Reference Cell (RC) definitions.
e
Most of
the comments made for the other two methods are valid here and will not
be repeated in what follows.
Taking (p, AA) as the reference cell, for
62
P = 1,2, define:
e
Sequence effects:
S(p) =
E(YpBA) - llpAA
1
(5.5.1)
S(p) =
E(YpCA) - llpAA
2
S(p) =
E(YpAB) - llpAA
3
s(p) =
E(YpAC) - llpAA
4
S(p) = E(YpBB) - (llpAA + s~p) + s~p))
5
s(p) =
+ s(p))
E(YpCB) - ( llpAA + S(p)
2
3
6
S(p) =
+ s(p)
E(YpBC) - (ll pAA + S(p)
1
4
7
e
S(p) =
+ s(p))
E(yPCC) - ( llpAA + S(p)
2
4
8
Parameters of interest:
(1 )
= E(Y1 BA) - 11lAA
'1
(1)
'2
(5.5.2)
= E(Y1 CA) - 11lAA
(2)
= E(Y2AB) - 112AA
'1
(2)
= E(Y2AC) - 112AA
'2
where:
A1
= E(Y2BA) - 112AA
A2
= E(Y2CA) - 112AA'
e
63
T~l) a~d T~2), i = 1,2 are RC direct main effects of the
treatments in periods 1 and 2 respectively,
Al and A2 are RC residual effects of the treatments.
The confounding between some sequence effects and other effects
in this case is similar to those seen in previous methods, due to the
method of definition.
Note that the definitions of sequence effects are
reference cell definitions, different from previous sets, which readily
demonstrate confounding patterns. Assuming that sequence effects confounded with parameters of interest are zero, define:
I
~41
= (
(1)
~l Tl
(1) s(l) S(l) S(l) S(l) S(l) s(l»
T2
3
4
5
6
7
8
(5.5.3)
(5.5.4)
where:
~p
=
~pAA'
P = 1,2
(5.5.5)
It follows from (5.5.1), (5.5.2) and (5.5.5) that
(5.5.6)
(5.5.7)
where:
65
clear.
It can also be seen that the definitions of main effects are
very different between methods.
All specified models until this point are essence models; the
extension to the full model is not difficult.
Let
~p
for a moment be
of the form
{5.5.l0}
i.e., the vector of all observations in that order, so that Y
is a
~p
L r x 1 vector.
t,u tu
Let U be a
L r x 9 matrix of the form:
t,u tu
U =
{5.5.ll}
o
where
~i
is understood to be an ixl column vector of 1 IS. Then the full
model in the observations can be written as:
E{~p}
=
~ ~v ~vp'
v
P
In effect, U causes rows of
from a sequence.
{5.5.l2}
= 1,2,3,4
= 1,2
~v
to be repeated for multiple observations
The definition of S
p' v
~v
= 1,2,3,4
P
= 1,2
in
(5.5.l2) is equivalent to the definition found in {5.2.9}, {5.3.9},
{5.4.6} and {5.5.6} respectively by theorem 4.1.2.
66
5.6 conse¥uences of Omitting Sequence
Ef ects from the Models
In the previous sections basic mathematical models were defined
for the complete three-treatment, two-period crossover design, possessing some desirable properties.
Using three different methods of
defining main effects, it was seen that those methods provide different
definitions of main effects and each method gives rise to many different
definitions of main effects.
On several occasions it was mentioned that
the sequence effects could be considered negligible.
In this section,
there will be an investigation of what happens to the definition of main
effects when the parameters corresponding to sequence effects are considered to be zero. The importance of studying this particular problem
comes from the fact that sometimes parameters are eliminated from the
model on pre-determined criteria, and the analysis is carried out on
the reduced model.
The definition of the remaining parameters may not
be equivalent to the original definition.
case of Grizzle (1965).
This, for example, was the
Grizzle specified a less-than-ful1-rank model
which he used with and without residual effects.
He apparently did not
recognize that the "treatment effect" in the model with residual effects
was different from the "treatment effect" in the model in which residual
effects were assumed to be zero.
The difficulty was obscured by the
use of LTFR models in which "treatment effect" parameters are not well
defined.
Helms (1981) uses a simple example to demonstrate that a "parameter" usually has different definitions under different models for E(Y)
and proves the following results:
~
67
Theorem 5.6.1. Consider two possible full-rank models for E(Y):
1 ~2. Let ~j = ~j~j be a
well-defined axl parameter in the j-th model, j = 1,2. Then, under the
Model j:
E(~)
= ~j~j' j = 1,2 where
assumption that model j is correct,
~l
~1
- ~2 for all E(Y) satisfying
model j if and only if
C.
_J
-
)-lX'.X.
C. (I
X. X.
_,
_,
_,
_'_J
Corollary 5.6.1.
~l
(5.6.1 )
= ~2 under either model if and only if
(5.6.2)
for (i,j)
= (1,2) and (i,j) = (2,1). Notice that
R(~l)
1
R(~2)
is per-
mitted in these results.
Since the definition of a parameter depends upon the assumed model,
phrases such as IIADBL treatment effects only have meaning in the
ll
context of a specified model.
Theorem 5.6.1 is primarily concerned with definitions of a
parameter coming from different assumed models.
tors, however, are also very important.
tion of these results.
Modell:
E(Y)
Model 2:
E(Y)
In our case
~2
Concerns about estima-
We will use a simple applica-
Consider two models:
=
~1~1
will represent sequence effects.
Under the assumption
that Modell is correct (sequence effects are zero),
is BLUE for
~1.
If
~1
A
~1
= (~1~1)-
* the least square estimation of
= ~1'
model 2 is the first subvector of
~1
1
~1~
from
68
=
8
~l
=
~2
If
~i~2
= ~,
,,*
Var{~'~·l) ~
,. .
~l
then
,.
XI
_1
A*
= ~l;
e
y
XI
_2
~2~1 ~2~2
(~'~l)
Var
-1
~i~l ~i~2
otherwise,
for all:.
,..*
1 ~1 and, since ~l is BLUE,
~l
In our applications we will assume
that sequence effects are zero; under this assumption it will be shown
that
~l
= ~l* regardless of which model is used but estimates from the
"correct" model will have more preci si on than estimates from a "full"
model.
The present problem is to determine whether the definitions of the
main effect parameters in the preceding sections are invariant to
whether "sequence effects" are included in the model.
At that point we need to define some notation.
Let the essence
models defined in the preceding sections be written as:
(5.6.3)
v
= 1,2,3,4,
p
= 1,2,
c
= 1,2,3,4
where:
~vl
is a 9x3 matrix formed by the three first
~v2
is a 9x5 matrix formed by the five first columns of Xv'
~vpl
is the vector of parameters of interest in period p,
p =
1,2,
co~umns
of Xv'
69
~vp2
. is the vector of sequence effects not confounded with
parameters of interest in period p, p
= 1,2.
Let
(5.6.4)
~v2 = [~5~] ~v2
(5.6.5)
Thus, in the context of the full models seen in (5.6.3) we have two
well-defined parameters for each model, that can be put in the form
(5.6.6)
v
= 1,2,3,4,
= 1,2
p
where:
~ll
= [~3'~]
~12
= [~5,~J·
Consider now that all sequence effects are zero, i.e.,
~vp2
=
0,
v
= 1,2,3,4
(5.6.7)
P = 1,2
Then, under this assumption it follows from (5.6.3) that
E(~p}
=
~vp~vpl'
v
=
1,2,3,4
(5.6.8)
P = 1,2
Define the following parameters in the context of the models shown in
(5.6.8) :
70
(5.6.9)
~v2
=
~5~v21'
v
= 1,2,3,4
If we let
then (5.6.9) becomes
(5.6.10)
The problem now is to verify if
!v1
=
~vp'
v
= 1,2,3,4
P
= 1,2,
under the following conditions:
(a)
Under the "full mode'" (5.6.3),
(b)
Under the "reduced model
II
(5.6.8),
and the conclusions will be gotten by using theorem 5.6.1.
From the
definition of the models in (5.6.3), and the definitions of
~vp
!vp we have that for v
(1)
and
= 1,2,3
:21(~~1~V1)-1~~1~V =
= :3(~~1~V1)-1~~1[~Vl~C1J
by virtue of the orthogonality of the columns of X
_v 1 and Xl;
_c
(5.6.12)
71
(2)
~22(~~2~V2)-1~~2~v =
(5.6.13)
= ~5(~~2~v2)-1~~2[~V2~C2J =
again, by virtue of the orthogonality of
~v2
and
~c2.
For v
=4
(RC
definition) we have
(3)
~21(~~1~Vl)-1~~1~V =
= [!3
(4)
(5.6.14)
~J 1 ~ll
(I
~22 ~v2~v2
) -1 I
~v2~v =
(5.6.15)
= [!5 §J 1 ~12
where Hand G are nonzero matrices.
-
-
Thus, if the "full model" is true, i. e., if the sequence effects
are not zero, then
~vp
= !vp for all definitions but
RC definition.
However, if the design is unbalanced (essence models are balanced
designs), matrices
then that
~vp
~vp
and
~cp
are not orthogonal any more; it follows
_ !vp for all definitions, when the "full model II is true.
Under the reduced model (5.6.3) we have the following results:
(1)
C (XIX )-lX'X
-11 -v-v
-v-vl
=
(5.6.16)
72
(2)
:12 ~v~v
(
I
)-1
~v~v2 =
(5.6.17)
I
= [~5'~]{~~~V)-1~V2 =
for all v
= 1,2,3,4. Thus, under reduced mode1,11 i.e., under the
II
assumption that sequence effects are zero, e_v p = Y
_v P for all definitions. It can be seen that if the design is not balanced, results
(5.6.16) and (5.6.17) still hold.
Since one can reasonably assume that sequence effects are zero,
we are going to restrict attention to experiments using the reduced
models, in which case the definitions are the same as in the full
model for all methods of definition used in this study.
5.7 Equality of the Models
In sections 5.3, 5.4 and 5.5 basic definitions of the main effects
from three different methods were found for the complete three-treatment,
two-period crossover design, using the Helms-Shen approach.
It was
emphasized that each method yielded nine different definitions, which
means that we have 27 possible definitions of main effects and consequently 27 models for a fixed Y.
In section 5.6 it was verified that if
sequence effects are zero, omitting them from the model leaves other
parameter definitions unchanged.
Thus, all models mentioned hereafter
will not contain sequence effects, unless otherwise specified. The
issue in this section is the following:
Is there among those 27 models
one that should be preferred?
In a more general context suppose we have for a fixed Y (Nxl) K
full rank models and let i-th model be denoted E{Y)
~
,
= X.B
~l~ i
~
73
i
= 1,2, ... ,K,
and let a parameter
= ~i~i
~i
be defined in the i-th
model.
Lemma 5.7.1.
for any j
E
Let X" be Nxq, q
{l ,2, ... ,k},
= (~i~i)-l~i~j·
!ij
R(~i)
= rank
= R(~j)
(X.), i
-'
= 1,2, ... ,K.
Then
= ~i!ij
where
if and only if
~j
[Corollary of a result in Rao and Mitra (1971).]
For any value of E(Y) which satisfies model i, in model j define
*
e·
_J
=
*
C·s·
C.* = C.T
.. , Then
_J_J with _J
_'_'J
(a) The BLUE of ~j* using
* = e .. lt is easily shown that
e.
_J_'
model j is identical to the BLUE of
~i
using model i (hence, the standard deviations of the
estimates are also identical);
(b)
Since e·
_J* = e·,
_, H., : e·
_,
* _ Moreover, the
e.
_J = O.
F-test statistics of Hi using model i is identical to the
= 0
_ <=>
H.*
J
F-test statistics of H*j using model j.
Thus, for purposes of estimating a particular parameter or testing a particular hypothesis, if the
R(~i)
are all identical, the models
are all equal with respect to variance of estimators and power of
tests.
One is free to use that model which is most convenient.
All 28 design matrices (including one corresponding to OP defini-
tion) for the present situation have been verified to have the same
column sapce; the
~ij
transformation matrices are easily computed and
the conditions of the lemma above were easily verified for these
designs, using first observation models.
Note that the essence model T. . matrices are also the transforma-
-, J
tion matrices when there are multiple observations per cell.
~j
denote the essence design matrices as above, let
additional rows which lie in the row space of X..
-J
model design matrix is
~j~j
Letting
denote any
Then the new j-th
74
*
x.
~J
~J
X•
=
and one sees that the
~ij
=
=
~J
X.*T. .,
~J
X.T •.
-'-'J
(5.7.1)
~'-'J
matrices are also the transformation matrices
when there are multiple observations per cell.
Thus, the 28 models are equivalent regardless of the number of
observations per cell, as long as no cells are empty.
e
75
6.
SUBDESIGNS
6.1
Introduction
When one is planning an experiment the objective is to find a
design that meets the needs of the investigation and will be within the
budget of the experimenter as well.
least these two requirements.
A good design should satisfy at
When the experimental objectives lead to
the choice of a crossover design, specifically a three-treatment, twoperiod crossover, a natural question may be raised:
Will a subdesign
satisfy the necessities of the researcher? Most previous authors who
worked with three-treatment, two-period designs restricted their attention to the following specific subdesign:
Second Period Treatments
A
A
First Period
Treatments
B
I
C
I
That is one side of the problem:
to use a subdesign.
B
C
I
I
I
I
in the beginning a decision is made
However, for a fixed number of sequences, there
are many possible subdesigns and very often one faces the problem of
choosing one subdesign among several according to some criterion.
To facilitate the study of subdesigns, one may define classes
of subdesigns with respect to one or more criteria.
In the present
context, an obvious characteristic is the number of sequences, so that
76
one can consider designs of 5, 6, 7 and 8 sequences, since the complete
design has 9 sequences and the number of parameters in the second
period is 5. At this point additional notation is advisable.
Instead
of using AA, AB, ... , CC for the points of the complete design, define
the following correspondence:
Seguence
Seguence number (jl
AA
1
AB
AC
BA
BB
BC
CA
CB
CC
2
3
4
5
6
7
8
9
A particular sequence of the design will be written as i j
1
~
i
~
8,
j
,
= 1,2, ... ,9. The class of subdesigns of k points will
be denoted by Ok' 5
<
k
<
8. This notation will be used whenever
necessary.
6.2 Definition of the Parameters
We already have defined four classes of parameters and linear full
rank models for the complete design.
The definitions and interpretation
of the parameters were easily obtained due to the symmetry of the
design.
But the same may not hold for subdesigns where, in some cases,
the definition can become very complicated. The issue of this section
is to define parameters in subdesigns by using the definitions given in
the complete design and to verify whether the definitions are equivalent.
77
The kind of approach to be followed here is similar to that in the
previous chapter. but the nature of the problem is rather different.
Let
= Xe
E{Y)
(6.2.1)
be an essence linear full-rank model for a complete design of t points
with design matrix X (txh) and an unknown vector-parameter e (hxl).
-
-
The canonical definition of e is given by
e
Let s
<
= (X'X)-lX'E{Y) = CE{Y)
(6.2.2)
t be the number of points of a subdesign such that from (6.2.1)
we have:
E{Y*)
= X*e*
(6.2.3)
where Y* is an sxl vector of observations on the points of the subdesign. X* is an sxh matrix derived from X in (6.2.1) by eliminating
-
-
(t-s) rows from it. and e* a new parameter. Then the definition of e*
wi 11 be:
e*
= (x*,x*)-lX*'E{Y*)
(6.2.4)
= C*E{Y*).
assuming that x* still is a full-column-rank matrix. The point
addressed here is to verify whether C*E{Y*) and CE(Y) are equivalent
definitions of the same parameter. To achieve thi.s, expression (6.2.4)
has to be defined as a function of E(Y), which is easily done since
78
E{Y*)
= TE{Y)
for some matrix T.
0*
(6.2.5)
In this way (6.2.4) becomes
= C*TE{Y)
(6.2.6)
= T*E{Y).
For all four classes of subdesigns the following comments are
valid:
(1) Because the present topic concerns the definition of
parameters, we may use essence models, i.e., consider only
one observation per sequence;
(2) The linear model of the complete design does not contain
sequence effects (true for all four methods);
(3)
In considering methods of defining main effects, the linear
models to be used here are those called "basic mode1s" in
Sections 5.2, 5.3, 5.4 and 5.5.
Given the linear models
(6.2.7)
p
= 1,2, v = 1,2,3,4
defined in Chapter 5 (reduced models), the canonical definition of
~vp1 is
(6.2.8)
79
for a unique matrix ~vp' p = 1,2, v = 1,2,3,4. Suppose that instead of
having a complete design, one has a sUbdesign with sequence number
{6.2.9}
~vp
Then by removing the rows of
and
* and
sequences and calling them ~vp
E{~p}
*
E{~p}
corresponding to the missing
respectively, one has the
following models:
{6.2.l0}
* is
from which the definition of ~vp
{6.2.11}
* is a full-column-rank matrix for all possible combinaassuming that ~vp
tions of p and v.
{That is not true for some subdesigns considered
here, but this aspect will be discussed later on.} To put {6.2.11} as
a function of
h.
1
I ,.
J
E{~p}'
=
1
= 0
define
~
= {h ij } as a kx9 matrix in which
ifjl=i,.
1
{6.2.12}
otherwise,
such that
*
~~vp = ~vp
{6.2.13}
Thus, {6.2.11} can be written as
{6.2.14}
~
80
e
*
= ~vpE{~p}
P
= 1t2 t
v
= 1t2t3t4.
Now t {6.2.13} implies that
*
= ~3
for p
=1
*
= ~5
for p
=2
~vp~vp
~vp~vp
for all v and 5
<
k
<
8.
(6.2.15)
From corollary 4.1.1 t which gives necessary
and sufficient conditions for two definitions to be equivalent t it
* is of full
follows that if the matrix ~vp
co~umn
rank t then
~vpE{~p}
in
*
{6.2.8} and ~vpE{~p)
are equivalent definitions of the same parameter t
independent of the size k of the design and the method of definition
used.
FinallYt the conclusions can be extended to the linear model
with more than one observation per sequence t since the definition of
the parameters in the essence model is equivalent to the definition in
the model with all observations {theorem 4.1.2}.
6.3 Singular Subdesigns and
URobust h Subdesigns
Occasionally, the accidental loss of all data from one or more
sequences will produce unintended subdesigns.
There are 5-sequence and
6-sequence subdesigns in which one (or more) main effect{s} cannot be
estimated t regardless of the method of definition being used.
following subdesigns t for example, belong to this category:
The
81
Second Period Treatments
First Period
Treatments
A
B
A
I
I
B
I
C
I
C
I
Second Period Treatments
First Period
Treatments
A
B
C
A
I
I
I
B
I
I
I
C
A subdesign can be said to be "robust to the loss of n sequences"
if the deletion of any n sequences produces a subdesign which supports
full rank models as defined in Section 6.2.
By direct examination, we
have demonstrated that all seven- and eight-sequence subdesigns support
full rank models.
Thus, the complete nine-sequence design is robust to
the loss of two sequences and all eight-sequence designs are robust to
the loss of one sequence.
The seven-sequence subdesigns are not of much interest here, but
direct examination has shown that most are robust to the loss of one
sequence and two sequences.
The six- and five-sequence designs are of greater interest since
they appear to be more popular.
Direct examination shows that the
following is the complete class of six-sequence subdesigns which are
robust to the loss of one sequence:
\
~
82
Design 26
First Period
Treatments
Design 42
Second Period
Treatments
Second Period
Treatments
A
B
A
A
.;
.;
B
.;
.;
C
C
B
.;
C
.;
.;
.;
Second Period
Treatments
Second Period
Treatments
A
A
A
B
.;
C
.;
B
C
.;
.;
.;
.;
A
.;
B
.;
B
.;
.;
.;
C
C
.;
Design 59
Design 29
A
First Period
Treatments
.;
Design 38
Desi gn 57
Fi rst Peri od
Treatments
C
.;
.;
A
.;
B
Second Period
Treatments
Second Period
Treatments
A
B
A
.;
.;
.;
B
C
.;
C
A
.;
B
.;
.;
C
.;
B
C
.;
.;
.;
.;
It can easily be seen that any five-sequence subdesign derived
from any of these six designs gives rise to a full rank linear model,
by the procedures we have used here to build such models,
°
This sub-
class of subdesigns will be denoted hereafter by *6 , In this context
the selection of a design from 06* guarantees the estimability of the
83
main effects if it loses one sequence. A six-sequence subdesign
suggested by Patterson and Lucas (1962) can be recognized as Design 59
shown above. This subclass of subdesigns has other properties which
will be examined in subsequent sections. Obviously, none of the. fivesequence designs is robust to the loss of any sequence.
6.4 Optimal Subdesigns
When a collection of subdesigns satisfies the two criteria listed
in Section 6.1, an experimenter faces the problem of choosing one
design of this collection according to some other property. As has
been mentioned, usually a fraction of the complete three-treatment,
two-period crossover design is selected and given that fraction, there
E{Y) = Xe
(6.4.l)
be a linear full rank model with
Var{Y)
=
2
cr ~n
(6.4.2)
84
and X a typical (nxp) matrix; let C (axp) have full row rank and let
1
e
= CiS
be estimable.
Define
(6.4.3)
= TRACE[C'{XIX)-lC]
(3)
f3{~;~)
= ~X
(6.4.4)
{A; DET[~,{~,~)-lC - AI]
= O}
(6.4.5)
In the literature f l ·a 2 is called the generalized variance of ~ and
f 2·cr 2/rank (~) is called average variance [see, e.g., Ash and Hedayat
(1978)]. All three functions have been used in the following way:
Let Mbe the set of all possible design matrices.
a design d with design matrix
~d
We say that
is D-, A-, on E-optimal over Mfor
if f l , f 2, or f 3 is minimized at ~d. The statistical
meanings of these criteria have been given by several authors, e.g.,
estimating
~
Box and Lucas (1959), Evans (1974), and Ash and Hedayat (1978), and
can briefly be summarized as follows:
(l)
A design that is D-optimal over Mfor estimating e has a
confidence region for the parameters of smallest volume in
the parameter space;
(2) A design that is A-optimal over Mfor estimating e has the
minimum average variance;
(3) A design that is E-optimal has the property that for any t
~
such that tit
= 1 the maximum of Var(tle) is minimized.
Any or all of the three criteria can be applied to a subset of the
parameters.
For the three-treatment, two-period crossover design, we
have three sets of interest:
85
e
Period 1:
(1)
1'1
~1'(1)
=
(1)
1'2
0
C'
- 1'(1) =
1 0
(6.4.6)
0
0
1
denoted by
(6.4.9)
where X is the design matrix and i
= 1,2,3, p € {1'(1), 1'(2),
-
-
A}.
Again, we have to be concerned about what design matrix X will
be used to compute the values of the functions f"
f 2 and f 3 when
considering ADBL, DFM and RC definitions, since each type of parameterization can yield more than one design matrix for a fixed subdesign,
i.e., we can have several versions of X from each method of definition.
For example, different choices of the reference cell lead to different
86
RC X matrices.
For the OP definition, if we agree to assign the lowest
level to treatment A, the middle level to treatment B and the highest
level to treatment C, then there is just one version of the design
matrix defined in Section 5.2.
Since functions f l , f 2 and f 3 are related to properties of the
estimates of the parameters, and each version yields a different
parameter, it would seem to be necessary to evaluate these functions
for each version.
However, we shall see that it is sufficient to use
only the basic definition of each method of definition (defined in
Chapter 5).
Given the results obtained from the basic definition, one
can easily determine the effect of usinq a different version of the
model, i.e., given that a subdesign is optimal according to certain
criterion using the basic definition, the corresponding optimal subdesign for any other version is easily obtained. An optimal subdesign,
found by using the basic definition, may not be optimal for another
version, since the two versions define different parameters.
To show
how this is possible, consider two eight-sequence designs from the
designs in Table Al.l:
Design 1
Second Period Treatments
First Period
Treatments
A
B
C
A
I
I
I
B
I
I
I
·c
I
I
87
Design 9
Second Period Treatments
A
A
First Period
Treatments
B
C
.;
.;
B
.;
.;
.;
C
.;
.;
.;
Using the basic version of the DFM definition of period 1, the corresponding design matrices are:
Sequence
Sequence
~1
~9
a
a
AS
1 1
AB
a
1 1 a
AC
1 1
AC
1
1
a
BA
1
BA
1
1
BS
1
SB
1
1
BC
1
BC
1
a
a
a
1
CA
1 -1 -1
CA
1 -1 -1
CB
1 -1 -1
CB
1 -1 -1
CC
1 -1 -1
AA
r1
1
a
a
a
1
1
(6.4.9)
1
These two designs define the parameter ~
= (~, T~l), T~l))I, but not
the same estimators. Letting~. = (X~x.)-lX~Y., i = 1,9, and eva1u-' -,-, -,-,
ating the criteria functions gives the following results:
Design
Version
f
f
1
1
0.049
2
0.481
9
1
0.049
0.537
1
f
3
0.333
0.419
88
There is so much symmetry here that it may be surprising that Design 1
is superior to Design 9 [with respect to criteria A(f 2) and E(f 3)].
However, L~l), i = 1,2 parameters defined by the basic definition of
the DFM method are not symmetric in the treatments:
From (5.4.8) we
have (for the complete design):
(1)
L1
(1)
1
=
9"
L2
2 2 2 -1 -1 -1 -1 -1 -1
E(Y1)
-1 -1 -1
(6.4.10)
2 2 2 -1 -1 -1
(Recall that the two incomplete models produce equivalent definitions
of these parameters.)
A different version of the DFM definition will produce a different
design matrix (for both the complete design and subdesigns) and will
define different parameters.
For example, consider a different version
of the DFM definition in which
= 9"1
-1 -1 -1 -1 -1 -1
2 2 2
(6.4.11 )
-1 -1 -1
2 2 2 -1 -1 -1
and which leads to the following design matrices for Designs 1 and 9
above:
89
e
Sequence
Xl
*
Sequence
~9
AA
1 -1 -1
AB
1 -1 -1
AB
1 -1 -1
AC
1 -1 -1
AC
1 -1 -1
BA
1 0
1
BA
1 0
1
BB
1 0
1
BB
1 0
1
BC
1 0
1
BC
1 0
1
CA
1 1 0
CA
1 1 0
CB
1 1 0
CB
1 1 0
CC
1 1 0
* i
* the two designs and X.,
Again, although ~l* 1 ~9'
same parameter S* = (]1*, '1(1)* "2(2)*) .
-,
*
= 1,9, define the
I
-
We observe that the rows of ~9* are a permutation of the rows of
~l and th~ rows of ~l* are a permutation of the rows of ~9·
"'* are the same as
properties of ~9
same as
~9.
~l
A
Thus, the
"* are the
and the properties of ~l
In effect, the second version of the DFM definition was
obtained by simply renaming the treatments as:
= C
B* = B
C* = A
A*
(6.4.13)
This example illustrates two points:
(1)
The optimal properties of a design for a particular
parameterization may depend upon the version of the
parameterization which was selected;
(2) A particular design is a representative of a class of designs;
the class may be generated by renaming the treatments, i.e.,
by permuting the letters A, B, C.
e
90
In the above examples, by criteria A and E, Design 1 is better than
Design 9 for the basic DFM parameterization, but:
(a)
Design 9, in version (6.4.11), is a member of the class
represented by Design 1 in version (6.4.10), because
Design 9 can be obtained from Design 1 in (6.4.9) by the
permutation A*
(b)
= C,
B*
= Band
c*
= A,
and
There is an alternative version of the DFM parameterization
for which Design 9 is the optimal member of the class. The
alternative version is obtained by applying the same permutation of treatment names.
Note that not all eight-sequence designs can be obtained by permuting
names.
Design 6 below, for example, is not a member of the class of
designs represented by Design 1:
Design 6
Second Period Treatments
A
First Period
Treatments
A
B
C
I
I
I
I
I
I
I
B
C
I
In what follows when a design is said to be optimal for a
particular type of model, it will be understood that the design is
optimal for the "basic version" of the parameterization and another
member of the class, obtained by renaming the treatments, would be
optimal for the corresponding version of the parameterization.
91
We have computed values of the fi(~; ~p) criteria for all pos-
~
sible subdesigns of 5, 6, 7 and a sequences; the results are presented
in Appendix 2, Table A2.1, and are discussed below.
The results in Appendix 2 are arranged in one large table that
covers all the 5-, 6-, 7- and a-sequence subdesigns.
Within Table
A2.1 results are arranged separately for the four types of definition
(parameterization):
OP, ADBl, DFM and Re.
Within a definition type
there is one line for each design containing:
(a)
Design number, an identification number which keys this
line to the design definition in Appendix 1;
(b)
The nine
p
€
criteria values, i
= 1,2,3
and
{T(l), T(2), A};
-
~
(c)
fi(~; ~p)
-
-
Nine optimality indicators, OI(d,i ,p), where OI(d,i ,p)
=
1
if design d has the optimum value criterion i for
parameter p among all designs for this type of
parameterization and number of sequences;
=
(d)
0
if design d is not optimal in this sense;
L
A IITOTAl lI value, which is
i
,e
OI(d,i ,p) and which is a
-
count for the number of criteria versus parameter (ixp)
combinations for which this design attains the optimum
value.
Within a definition type (parameterization) the lines for designs are
arranged in order of ascending values of TOTAL.
For all designs with
the same value of TOTAL, lines are arranged in increasing order of
design number.
In each case the computations were performed for the case of one
replicate, ; .e., one observation per sequence.
The results may be
~
92
easily extended to any balanced number of replicates.
Using aU-matrix
as defined at (5.5.11) in which each diagonal submatrix of U has the
same dimension, a balanced design matrix is constructed as UX.
since U'U
Then,
= rI, where r is the number of replicates,
(1 ) f1(~~; ~)
=
(l)a
r f 1(X;
_ _C)
(6.4.14)
(2)
f2(~~; ~)
=
-1r f2(~; ~)
(6.4.15)
(3)
f3(~~; ~)
=
-1r
(6.4.16)
where a
f3(~; ~)
= rank (C) in (6.4.3). Thus, the results reported here may
easily be extended to balanced subdesigns with r
>
1 replicates.
One can see in Table A2.1 that results for ADBL and RC definitions
were the same for a fixed subdesign, showing the equivalence between
the two definitions.
The parameters defined in the complete model
(including sequence effects) in Sections 5.3 and 5.5 are not equivalent,
but since the sequence effects were eliminated from the model, the
definitions
0f
. both met h0 ds are
1"1(p) ,1"2(p) ,p -- 1 , 2 an d :\1':\2 ln
equivalent. This can readily be seen by looking at their definitions
in Sections 5.3 and 5.5 respectively, and adding the restriction that
there are no sequence effects.
All results, including those for RC
definition were included in Table A2.1, but discussions will be made
only with respect to the other three methods of definition.
In principle, for a fixed subclass of designs, one would like to
have a design that is "all optimum" in all definitions, i.e., a design
such that the value of TOTAL in Table A2.1 is 9 for each method of
definition. That desirable situation occurs only in one case:
1 in class 08 is "all optimum" in all methods of definition.
Design
Class 06
93
provides designs whose value of TOTAL is 9 for the OP and AOBL methods.
~
Classes 05 and 0] have no such designs.
A peculiar situation occurs in class 06 . The subclass 0*6 defined
in Section 6.3 is exactly the set of "all optimum J' subdesigns for OP
and AOBL definitions; a design is all optimum for AOBL and OP definitions, if and only if it belongs to 0*6 . Another relevant characteristic
of 06* involves the concept of equivalence between this subclass and
the corresponding subclass of subdesigns in another version of the
definition: The corresponding subclass of subdesigns that is all
optimum for OP and AOBL definitions in any other version is 0*6 itself.
By renaming the letters A, Band C for any element in 0*6 , the new
subdesign belongs to 0*6 . That is an important property, since one can
use any subdesign of 06* and yet it will be optimum whatever version of
~
OP or AOBL definition is selected. That property, for example, does
not hold in class 08 .
It can be the case that one is interested in selecting a design
by the total number of criteria of optimality, but not considering
which criteria (among those used here) or what method of definition.
For those situations we introduced Table A2.2, which shows this sort of
information. Table A2.2 was obtained by adding the optimality indications--OI(d,i,p)--and TOTAL over methods of definition.
Within each
class of subdesigns, a particular design has 10 values linked with it:
9 values corresponding to the sum of OI(d,i,p) over definitions, denoted
by SOI(d,i ,p) and the sum of TOTAL over definitions, denoted SCORE,
where SCORE
results with
= L SOI(d,i ,p), i = 1,2,3 and p E {,(l), ,(2),
e~~~
class Of-subdesigns are
ar;ange~
in o;der
A}.
The
0; ascend-
ing values of SCORE. The maximum value of SOI(d,i ,p) is 3 (indicating
4It
94
optimality of the design d, with respect to criteria i and parameter
set p for all three methods of definition
(OP, ADBL, DFM) and the
maximum value of SCORE is 27 (3 methods of definition versus 3 criteria
versus 3 parameter sets). An a11 optimum" subdesi gn in a11 three
lI
definitions would have SCORE = 27.
Only one design, number 1 in class OS' achieved the maximum
possible SCORE (27).
Design number 1 attained optimal values (in com-
parison with other S-sequence designs) for all criteria, all parameter
sets, and all methods of definition studied here.
Table A2.2 also shows that within OS' 06 and 07 several subdesigns are tied for the highest SCORE: four five-sequence subdesigns
have scores of 16, six six-sequence subdesigns have scores of 22, and
ten seven-sequence subdesigns have scores of 12.
In searching for an
optimal subdesign with a given number of sequences, one could begin by
examining these high-scoring subdesigns.
Table A2.3 displays the minimum and maximum values of
fi(~; ~p)
in all possible cases (i .e., over all designs with a given number of
sequences and a fixed method of definition).
fi(~; ~T(2))
-
and
fi(~; ~\)
-
The extreme values of
are the same throughout the table, i.e.,
the last three columns of Table A2.3 are the same as the preceding
three columns, but in most cases designs that attained the extreme value
in one column are not the same as the design which attained the extreme
value in another column.
For example, Designs 19 and 70 in OS' for DFM
A
definition.
Design 19 is 0-, A- and E-optimal for
0\
but is neither
A
0-, nor A-, nor E-optimal for
A
for
~T(2)'
Design 70 is 0-, A- and E-optimal
-
~T(2)but
-
A
is neither 0-, nor A-, nor E-optimal for
A
extreme values of f l , f 2 and f 3 for 0A and
0\;
however, the
A
~1(2)
are the same.
95
Since, in most cases in Table A2.3, the minimum value of a
criterion is less than the maximum value, for any specific criterion
and parameter there are "better designs" and "worse designs." The one
exception is that all designs in 08 have the same value of 0- criterion,
regardless of the parameter considered.
A large difference between MAX and MIN values in Table A2.3
(e.g., six-sequence designs, OFM definitions, A criterion, MIN
MAX
= 1.667 = twice
= 0.833,
MIN) indicates a great difference in efficiency of
designs within the subclass, but a small difference (e.g., eightsequence designs, AOBl definition, A criterion, MIN
1.833
= 1.583,
MAX
=
= 1.6 x MIN) indicates little difference among designs'
efficiencies within the class (for this criterion).
Where there is a
large difference, it is more important to exercise care in choosing a
subdesign.
In summary, an evaluation of the 0-, A-, and E-criteria reveals
that for a given number of sequences, no one design is uniformly
optimum for all three sets of parameters of interest, all three criteria,
and all three types of definition, with only one exception: design
number 1 among 8-sequence designs.
In all other cases, even if one
specifies the type of definition there are several designs which have
essentially equivalent optimality properties as shown in Table A2.1.
6.5 Power of the Tests in Subdesigns
Among many aspects that can be thought of in subdesigns are the
estimation of parameters and testing of hypothesis.
In the last
section, three estimation optimality criteria were used to discriminate
subclasses of optimal subdesigns with respect to several possible
96
combinations of criteria.
In the present section, attention will be
given to some aspects linked to the test of hypothesis.
In the analysis
·of the three-treatment, two-period crossover design, following
the
,
approach of a separate model for each period, the three following
hypotheses:
(1)
'1
(1)
=
(1)
'1
0
versus
(1)
'2
[::J
~
0
(6.5.1)
~
0
(6.5.2)
~
0
(6.5.3)
'2
=
0
versus
[::J
(2)
'1
(2)
'1
(2)
(2)
'2
'2
are the most important ones for the case of the complete design as well
as for the subdesigns.
Under normality assumptions, these hypotheses
will be tested by F tests.
One point to investigate in this setup is
the power of the F tests in each class of subdesigns with respect to
the power of the same tests when carried out in the complete design.
Certainly, the power of a specific F test in a subdesign is at most
equal to the power in the complete design.
A fair comparison is to
assume the same amount of information in both cases, i.e., the same
number of observations for the subdesign and complete design.
This
also provides the same degrees of freedom in both situations; which
facilitates the study.
97
The power of the F test depends on the values of the parameters,
4It
which are unknown; an indirect way has been devised to study the
behavior of the power of the tests.
Let
E(~l)
= ~l~ and
denote full rank models 1 and 2 respectively, where
~l
E(~2)
and
~2
= ~2~
are the
same dimension. Assume that Yl~N(Xls, 02 I ) and Y2~N(X2s, 02 I ). Con-
--
-
-
--
-
sider the following hypothesis testing problem in both models:
HO: :'~ = ~ versus HA: :'~ F ~
(6.5.4)
where C' has full row rank, rank (C) = k and CIS is testable in both
models. The noncentrality parameters are:
(6.5.5)
i
= 1 ,2.
Consider the following expression [to be called here IInoncentral ity
rati 011 (NR)]:
NR
A(1)
=
--r.2)
(6.5.6)
A\.
Since :'(~2~2)-1: is positive definite, NR has maximum and minimum as a
function of CiS [see, e.g., Rao (1973)], given by
~
~
max NR
CIS
(6.5.7)
min NR
CIS
(6.5.8)
Consider some possible ranges of NR:
(1)
0
<
NR
<
1
e
98
(2) a
~
NR
~
b,
(3)
a ~ NR ~ b,
(4)
NR
= constant
a
€
(0,1), b > 1
a, b, ~ 1
(6.5.9)
for all CiS,
with the following interpretations:
(1) The power in testing HO in model 1 is smaller than the power
achieved in model 2 for all possible values of CiS;
(2) The power in model 1 may be greater or smaller than the
power in model 2, depending on the value of CiS;
(3) The power in model 1 is at least equal to the power in
model 2 for all possible values of CiS;
e
(4)
If "constant"
If "constant"
= 1, the power is the same in both models.
>
1, the power in model 1 will be always
greater and if "constant"
<
1, the power in model 2 will be
always greater.
In the last case (4) the power of the test in model 1 is a function of
the power in model 2. Thus, even though the power of the test in model
2 is not known, inference might be made for some values of NR in
(6.5.6).
It was seen in Section 6.4 that it was not necessary to work on
every version of each method of definition to get the optimal subdesigns;
it is sufficient to find the results for one version.
If we agree that
the models of both the complete design and the subdesigns are from the
same version (for example, the "basic definition" defined in Chapter 5),
then, for a particular class of subdesigns, the set of extreme values
of NR for the hypothesis HOi' i
= 1,2,3 defined in (6.5.1), (6.5.2) and
99
(6.5.3) is the same for all versions, as expressions (6.5.7) and (6.5.8)
show.
~
However, it was verified by direct computation that the extreme
values of NR for a particular subdesign and fixed hypothesis are the
same for all three methods of definition (OP, AOBL, OFM) , by using
their IIbasic definitions
ll
in the computations. This fact very much
simplifies the discussion of the results.
To achieve the objective of this section, we will examine the
extreme values of the noncentrality ratio corresponding to HOi' i
=
1,2,3 for various subdesigns and the complete design respectively.
The analysis of these values may produce some subclasses of subdesigns
with desirable properties with respect to test of hypothesis.
The power
of a test in the complete design is used as a "baseline for comparisons
ll
with subdesigns. We shall assume:
(1) both the complete design and the
subdesign are balanced and (2) both designs have the same number of
observations. Thus, to compare a subdesign in 05 with the complete
design, it is assumed that we have 5 replicates of the complete design
and 9 replicates of the subdesign.
The same argument applies to other
classes.
The extreme values of NR for all three hypotheses and all four
classes of subdesigns are shown in Appendix 3, Table A3.l.
Within each
class of subdesigns, the results in Table A3.1 are arranged in order of
ascending values of the number of the design {defined in Table Al.1}.
For each subdesign, the maximum and minimum of NR were evaluated using
(6.5.7) and {6.5.8} for each of the three hypotheses.
Within each
class of subdesigns there are only a few different values for the ranges
of maximum and minimum NR values.
These values have been summarized,
separately for each hypothesis, in Table 6.5.1.
4It
100
Table 6.5.1
Possible maximum NR and minimum NR values found in the
four classes of subdesigns
Hypothesis
Class of
Subdesigns
05
e
06
07
08
HOl : Peri od 1
treatment effects.
H02 :
Residual effects
H03 : Period 2
.treatment effects
Max NR
Min NR
Max NR
Min NR
Max NR
Min NR
1.20
0.72
0.90
0.30
0.90
0.30
1.08
0.60
0.60
0.60
0.60
0.60
1.12
0.62
1.18
0.32
1.18
0.32
. 1.00
1.00
1.00
0.50
1.00
0.50
0.75
0.75
0.75
0.75
1.29
0.55
1.29
0.43
1.29
0.43
1.10
0.86
1.07
0.64
1.07
0.64
0.86
0.86
0.86
0.86
1.13
0.75
1.13
0.75
1.13
0.84
101
~
Table 6.5.1 shows that, for each hypothesis the extreme values of
NR partition class 05 in two subclasses, and partition 06 and 07 in two
subclasses in HOl and three subclasses in H02 and H03 ' Thus, in class
05 and H01 ' for example, there are 54 subdesigns for which Max NR = 1.20
and Min NR
= 0.72
and 27 subdesigns for which Max NR
= 1.08
and Min NR
=
0.60.
A particular subdesign may appear in more than one row of Table
For example, Table A3.1 shows that design 2 in 05 (second line
6.5.1.
in the table) has values that place it in the second line of Table
6.5.1 for hypothesis H01 ' but in the first line of Table 6.5.1 for
hypothesis H02 ' However, as shown in Table 6.5.1, for HOl all 5sequence designs had (Max, Min) NR values of either (1.20, 0.72) or
(1.08,0.60).
Table 6.5.1 shows that
~
subdesign has uniformly greater power
for all three hypotheses than the complete 9-sequence design with the
same number of observations.
Moreover, the complete design is uniformly
more powerful than all S-sequence designs for both second-period
hypotheses.
Only six of the 6-sequence designs have one or more Max NR values
greater than or equal to 1.
one or more
design.
~i~
For such designs there exist some values of
such that the subdesign has more power than the complete
These designs occur in two groups:
102
Designs
5, 14, 69, 71
39, 60
Max NR
1.22
1.00
Min NR
0.62
1.00
Max NR
1.18
1.00
Min NR
0.32
0.50
Max NR
1.00
1.18
Min NR
0.50
0.32
For period 1 treatment effects designs 39 and 60 are identical to the
complete design with the same number of observations and, for some
values of period 3 treatment effects, these designs have more power than
the complete design.
However, the maximal power of these designs for
carryover effects is equal to the power of the complete design.
Designs 5, 14, 69 and 71 (in 06) are neither uniformly more
powerful than nor uniformly less powerful than the complete 9-sequence
design with the same number of observations; except for period two
treatment effects, thei r maximal power can· be greater than the power
from the complete design.
Thus, no matter what the values of the parameters, there is no
six-sequence design which has greater power for all three tests than
the complete design.
Of the 36 7-sequence designs, 18 are uniformly less powerful than
the complete design with the same number of observations for at least
one of the hypotheses in Table 6.5.1. The remaining designs all have
the same values for Min and Max NR; the values are given in the middle
line of the 07 panel in Table 6.5.1.
Whether one of the designs in
103
this group is more powerful than or less powerful than the complete
design for a particular hypothesis depends upon the value of the
corresponding parameter.
All nine 8-sequence designs have the same Max and Min NR values,
viz., those shown in Table 6.5.1. Again, whether one of these designs
is more or less powerful than the complete design depends upon the
values of the parameters.
The results of this investigation indicate that it may be better
to use the complete design instead of subdesigns, when the same number
of observations would be used in either case.
Only in one case do sub-
designs yield tests whose power is the same to the complete design; in
all others, they are either uniformly less powerful than the complete
design or they can be more, equally or less powerful depending on the
values of the parameters.
Since the parameters are unknown, no exact
decision can be reached about the power of these subdesigns compared to
the complete design.
However, in the search for good subdesigns the
results of this study can be used in connection with the results
obtained in Section 6.4, such that subdesigns with additional properties
can be found.
All discussion in this section is linked to the IIbasic
definition/l obtained in Chapter 5.
The results for any other version
can easily be found by renaming the labels A,B and C of the treatments.
It would also be interesting to use the basic methodology seen in
this section [equations (6.5.7) and (6.5.8)) to make direct comparisons
of subdesigns in different classes.
Since the number of subdesigns in
each class would lead to a large number of comparisons, we did not
attempt to make such comparisons here.
104
Another way of comparing subdesigns versus the complete design is
to compute the number of replicates of a subdesign which would be
required so that the power of all three tests is at least as great as.
the power gotten in the complete design (with one replicate).
By
finding the new ranges of NR for several different sample sizes and
using the charts of the power function for analysis of variance given
by Pearson and Hartley (1951), we found that approximately 3 replicates
are necessary for any 5-sequence subdesign and 2 replicates for any
6-, 7- and 8-sequence subdesign; under these conditions, Min (NR)
for all subdesigns which implies they are at least as good as the
complete design with 1 replicate.
>
1
105
7.
SUMMARY AND CONCLUSIONS
In dealing with two-period crossover designs the typical approach
is to have a mathematical model encompassing both periods in only one
model, assuming that treatment effects in period 1 and period 2 are
the same. Due to the nature of such designs, problems such as confounding and correlated observations may cause difficulties in the
analysis of variance, forcing the search for new kinds of analyses and
models.
These problems are more troublesome in a subdesign where a
fraction of the complete design is used.
Following the approach of Helms and Shen (1980), by-period models
using four different methods of parameterization, were presented in
Chapter 5 for the three-treatment, two-period crossover design.
For
those cases when the treatments A, B, C are equally spaced levels of a
quantitative treatment factor, we present the Orthogonal Polynomials
(OP) model and for the cases of, three qualitatively different treatments
three parameterizations are presented: Average Distance Between Lines
(ADBL), Deviations From Mean (DFM) and the Reference Cell (RC) models.
Due to the fact that there are more than one version for each method of
definition (ADBL, DFM and RC methods), the models presented in Chapter
5 are named IIbasic" models. All models displayed are essence models,
models with one observation per cell, but the extension to the full
model (in the observations) is easily obtained.
Rarely is one interested in studying sequence effects in this kind
of experiment, since by assigning the individuals randomly to each
106
sequence, these effects can be considered zero.
Nevertheless, by
eliminating parameters from the model, the definition of the remaining
parameters may be affected. Thus, it was shown that for balanced
designs, under the full model (in the parameters), i.e., if the unconfounded sequence effects are not zero, the definition of the remaining
parameters in the reduced model is equivalent to the definition of the
parameters in the full model for all definitions except the RC definition.
Under the reduced model, i.e., under the assumption that the
sequence effects are zero, for balanced or unbalanced designs the
definitions of the parameters are equivalent in both models.
Since it
is usually reasonable to assume sequence effects are zero, attention
was given to models incorporating this assumption.
Under this assump-
tion it was shown that the ADBL and RC definitions are equivalent, i.e.,
define the same parameters.
Due to the existence of more than one version for each method of
definition, and consequently more than one mathematical model, a study
involving all models showed that all models generate the same column
space and consequently, for estimating a particular parameter 0, they
all are equivalent.
Chapter 6 contains the results of studying four aspects of subdesigns (designs with fewer than nine sequences, on cells):
(1) defini-
tion of parameters, (2) robust subdesigns with respect to the loss of
one or more cells, (3) optimality in subdesigns and (4) behavior of the
power of the tests in subdesigns compared to the power achieved in the
complete design for the same tests.
In a subdesign the question arises:
Are the parameters defined
by the model for the subdesign the same as the parameters defined by
107
the model for the complete design? Let E(Y)
= X8
denote the essence
model for the complete design (sequence effects, assumed to be zero,
are omitted).
Delete those rows of E(Y) and X corresponding to missing
cells in the subdesign to obtain E(Y*)
subdesign.
= X*8*
as the model for the
In Section 6.2 it was shown that when x* has full column
rank, 8* = 8, so that both models define the same parameter.
If x* is less than full rank, the subdesign is said to be
singular.
A design or subdesign is said to be "robust to the loss of
k cells" if the deletion of any k cells results in a nonsingular subdesign.
In Section 6.3 it was shown that all a-sequence designs are
robust to the loss of one cell and most are robust to the loss of two
cells. There is a special class of 6-sequence designs which have many
important properties, including the property that this is the class of
6-sequence designs which are robust to the loss of one sequence.
The selection of optimal subdesigns among a collection, according
to some criterion or criteria, was the subject of Section 6.4.
the number k, 5
~
Given
k ~ a of sequences in a three-treatment, two-period
crossover subdesign, one has many options in choosing one or more
subdesigns.
The aspects considered here are three properties of the
estimators of the three sets of parameters:
the generalized variance
(D-criterion), the average variance (A-criterion), and the "minimax
variance" (E-criterion).
The set of parameters considered were:
first
period treatment effects, second period treatment effects and carryover
effects. All three criteria were studied for each method of definition
(OP, ADBL and DFM).
It is shown in that same section that for a fixed
method of definition a subdesign may be optimal in one version but not
in others.
It is also shown that given that a subdesign is optimal
108
according to some criteria, the corresponding optimal subdesign for any
other version of the parameterization is readily obtained by permuting
the labels, A, B, C, of the treatments.
One example is worked out to
illustrate that point.
In Section 6.4 it was shown that only Design 1 in class 08
(8-sequence designs) is uniformly optimal--over types of parameterizations and optimality criteria--within its class.
Classes Os and 07 do
not have any subdesign that is "all optimum,1I even for a fixed method
In class 06 , the subclass 0*6 defined in Section 6.3 is
ll
lI all optimum
with respect to OP and AOBL definitions. Moreover, the
of definition.
corresponding optimal subdesigns in any other version of the AOBL
definition belong to 0*6 , which makes that subclass lI all optimum ll for
OP definition and any version of the AOBLdefinition.
The behavior of the power of F-tests in the subdesigns for testing the three relevant hypotheses in the three-treatment, two-period
crossover subdesigns is examined in Section 6.5.
The study was
carried out by assuming that both the subdesign and the complete design
have the same total number of observations and are balanced.
Values of
the noncentrality ratio, NR, the ratio of the noncentrality parameter
in the subdesign to the noncentrality parameter in the complete design,
were used to compare subdesigns versus complete design.
No subdesign
has uniformly greater power for all three hypotheses than the complete
9-sequence design with the same number of observations.
The complete
design is uniformly more powerful than all 0S subdesigns for the
second-period hypotheses. Only six of the 6-sequence subdesigns have
one or more maximum NR values greater than or equal to 1, in which case
they can be more or less powerful than the complete design, depending
109
on the values of the parameters. The study shows that in 07 , 18 subdesigns are uniformly less powerful than the complete design with the
~
same number of observations, for at least one of the hypotheses; the
remainingsubdesigns can be more or less powerful than the complete
design, depending upon the values of the parameters. All subdesigns
in 08 can be more or less powerful than the complete design for some
values of the parameters. These results show that under the approach
of one model for each period and separated analysis, it may be better
to use the complete design instead of a subdesign when the number of
observations would be the same.
Finally, we computed the number of replicates a subdesign must
have so that the power of all three tests is at least equal to the
power of the complete design.
For a fixed Type I error rate, it was
verified that at least 3 replicates would be needed for the 5-sequence
subdesigns and 2 replicates would be needed for the 6-, 7-, and 8sequence subdesigns.
These results, which are dependent upon the use of a by-period
model, show that there is no circumstance in which any subdesign is
preferable to the complete 9-sequence design, unless one has prior
information about the values of the parameters.
This result is very
interesting because we have not found any previous work in which this
design was recomnended for a IIcrossover situation.
1I
It is evident that a number of important problems linked with
crossover designs still remain to be solved, some of which are closely
related to those discussed in this work.
research, we give the following:
As suggestions for further
e
110
(1) The study of the complete design versus subdesigns for other
numbers of periods and numbers of treatments;
(2)
Investigation of the use of baseline measurements and their
effect on (a) models, (b) covariance structure, and
(c) optimality of subdesigns;
(3)
Investigation of the analysis of "change" (post-period
measurements versus pre-period measurements) rather than
analysis of the post-period measurements and the effect on
(a), (b) and (c) in (2).
111
8.
LIST OF REFERENCES
Armitage, P. 1979. The design of clinical trial.s.
Statist. 21{3}:266-281.
Austral. J.
Ash, A. and Hedayat, A. 1978. An introduction to design optimality
with an overview of the literature. Commun. Statist.-Theor.
Meth. A7{14}:1295-1325.
Atkinson, G. F. 1966. Designs for sequences of treatments with
carry-over effects. Biometrics 22:292-309.
Balaam, L. N. 1968. A two-period design with t 2 experimental units.
Biometrics 24:61-73.
Berenb1ut, I. I. 1968. Changeover designs balanced for the linear
component of first residual effects. Biometrika 55:297-303.
Berenb1ut, I. I. 1970. Treatment sequences balanced for the linear
component of residual effects. Biometrics 26:154-156.
Berenblut, 1. 1. and Webb, G. 1. 1974. Experimental design in the
presence of autocorrelated errors. Biometrika 61 :427-437.
Box, G. E. P. and Lucas, H. L. 1959. Design of experiments in nonlinear situations. Biometrika 46:77-90.
Brandt, A. E. 1938. Test of significance in reversal or switchback
trials. Iowa Agricultural Experimentation Station Research
Bulletin No. 234.
Brown, B. W. 1980. The crossover experiment for clinical trials.
Biometrics 36:69-79.
Chassan, J. B. 1964. On the analysis of simple crossovers with
unequal numbers of replicates. Biometrics 20:206-208.
Ciminera, J. L. and Wolfe, E. K. 1953. An example of the use of
extended crossover designs in the comparison of NPH insulin
mixtures. Biometrics 9:431-446.
Cochran, W. G., Autrey, K. M. and Cannon, C. Y. 1941. A double changeover design for dairy cattle feeding experiments. J. Dairy Sci.
24:937-951 .
Cochran, W. G. and Cox, G. M. 1950. Experimental Designs.
edition. John Wiley, New York.
First
112
Cole, J. W. L. and Grizzle, J. E. 1966. Applications of multivariate
analysis of variance to repeated measurements experiments.
Biometrics 22:810-828.
Cox, C. P. 1958. The analysis of Latin square designs with individual
curvatures in one direction. J. R. Statist. Soc. B20:l93-204.
Curnow, R. N. and Sharpe, E. 1962. The analysis of covariance as a
means of reducing standard errors in certain experiments involving
sequences of treatments. Biometrics 18:410-413.
Evans, J. W. 1974. Computer generated D-optimal, V-optimal and trace
optimal minimum bias experimental designs. Institute of Statistics
Mimeograph Series No. 936.
Federer, W. T. 1955. Experimental Designs: Theory and Application.
Macmillan, New York.
Federer, W. T. and Atkinson, G. F. 1964.
designs. Biometrics 20:168-181.
Tied-double-change-over
Gaito, J. 1961. Repeated measurements designs and counterbalancing.
Psychological Bulletin 58:46-54.
Gill, J. L. and Magee, W. T. 1976. Balanced two-period changeover
designs for several treatments. J. Animal Sci. 42:675-677.
Grizzle, J. E. 196~. The two-period changeover design and its use
in clinical trials. Biometrics 21:467-480. (Corrigenda:
Biometrics 30 727).
Helms, R. W. 1977. On Main Effects and Interactions. Unpublished
class notes. Department of Biostatistics, University of North
Carolina, Chapel Hill, N.C.
Helms, R. W. 1980. On the definition of primary parameters in linear
models. Proceedings of the ASA section on Statistical Computing
1980, American Statistical Association, Washington, D.C.
Helms, R. W. 1981. Personal communication from a manuscript in
preparation. Department of Biostatistics, University of North
Carolina, Chapel Hill, N.C.
Helms, R. W. and Shen, C. D. 1980. A comparison of treatment effect
estimators from selected unbalanced three-period, two-treatment
crossover designs. Presented at the 1980 Annual Meetings of the
American Statistical Association, Houston, Texas.
Helms, R. W., Kempthorne, O. and Shen, C. D. 1980. Augmented twoperiod crossover designs to reduce confounding and improve
interpretation. Presented at the Spring Meetings of the
Biometric Society, Charleston, S.C., March 1980.
113
Hills, M. and Armitage, P. 1979. The two-period crossover clinical
trial. Br. J. C1in. Pharmac. 8:7-20.
Je11inek, E. M. 1946. Clinical tests on comparative effectiveness
of analgesic drugs. Biometrics 2:87-91.
Kershner, R. P. and Federer, W. T. 1979. Two-treatment crossover
designs for estimating a variety of effects. Paper No. BU-675-M
in the Biometrics Unit, Cornell University.
Koch, G. G. 1972. The use of non-parametric methods in the statistical analysis of the two-period change-over designs. Biometrics
28:577-584.
Layard, M. W. and Arvesen, J. N. 1978. Analysis of Poisson data in
crossover experimental designs. Biometrics 34:421-428.
Loos1y, J. K. and Lucas, H. L. 1943. The effect of thiamin feeding
upon milk and fat production. J. Dairy Sci. 26:291-294.
Lucas, H. L. 1943. A method of equalized feeding for studies with
dairy cows. J. Dairy Sci. 26:1011-1022.
Lucas, H. L. 1951. Bias in estimation of error in changeover trials
with dairy cattle. J. Agric. Sci. 41 :146-148.
Lucas, H. L. 1956. Switchback trials for more than two treatments.
J. Dairy Sci. 39:146-154.
Lucas, H. L. 1957. Extra-period Latin-square changeover designs.
J. Dairy Sci. 40:225-239.
Namboodini, N. K. 1972. Experimental designs in which each subject
is used repeatedly. Psy. Bull. 77:54-64.
Patel, H. I. and Hearne, E. M. 1980. Multivariate analysis for the
two-period repeated measures crossover design with application
to clinical trials. Commun. Statist.-Theor. Meth. A9(18):
1919-1929.
Patterson, H. D. 1950. The analysis of change-over trials.
Sci. 40:375-380.
Patterson, H. D.
1951. Change-over trials.
J. Agric.
J.R.S.S. B 13:256-271.
Patterson, H. D. 1952. The construction of balanced designs for
experiments involving sequences of treatments. Biometrika 39:
32-48.
Patterson, H. D. 1970. Nonadditivity in change-over designs for a
quantitative factor at four levels. Biometrika 57:537-549.
~
,.,
114
Patterson, H. D.and Lucas, H. L. 1959. Extra-period change-over
designs. Biometrics 15:116-132.
Patterson, H. D. and Lucas, H. L. 1962. Change-over designs.
Carolina Agric. Exp. Station, Bull. No. 147.
North
Pearson,-E. S. and Hartley, H. O. 1951. Charts of the power function
for analysis of variance tests derived from the noncentral Fdistribution. Biometrika 31 :112-130.
Rao, C. R. 1973. Linear Statistical Inference and Its Implications.
Second Edition. John Wiley and Sons, New York.
Rao, C. R. and Mitra, S. K. 1971. Generalized Inverse of Matrices and
Its Applications. John Wiley and Sons, New York.
Rees, D. H. 1969. Some observations on changeover trials.
25:413-417.
Biometrics
Taylor, J. 1967. The value of orthogonal polynomials in the analysis
of changeover trials with dairy cows. Biometrics 23:297-311.
Taylor, W. B. and Armstrong, P. J. 1953. The efficiency of some
experimental designs used in dairy husbandry experiments. J.
Agric. Sci. 43:407.
Wallenstein, S. and Fisher, A. C. 1977. The analysis of the two-period
repeated measurements crossover design with application to clinical trials. Biometrics 33:261-269.
Wilk, R. E. 1963. The use of a crossover design in a study of student
teachers' classroom behaviors. The Journal of Experimental
Education 31 :337-341.
Williams, E. J. 1949. Experimental design balanced for the estimation
of residual effects of treatments. Austr. J. Sci. Res. A2:149168.
APPENDICES
117
Table Al.l
Definition of each subdesign (DES) in each class Ok
°SE
Ok
(k)
(d)
5
5
S
5
AA
AS
AC
BA
BB
BC
CA
CB
CC
1
1
1
1
1
1
1
1
0
1
0
~
4
5
1
1
1
1
5
1
1
0
1
0
0
0
0
0
0
0
0
0
0
1
1
1
0
1
1
0
C
0
2.
3
0
0
1
1
0
0
7
0
1
1
1
0
1
0
0
0
:)
1
0
0
1
1
1
1
0
0
1
1
1
0
0
1
1
0
0
1
0
1
0
1
0
1
1
0
0
1
1
1
0
0
0
1
0
0
1
1
5
5
5
14
15
0
16
5
5
17
5
a
9
II)
11
12
13
5
::3
5
5
5
5
5
:5
5
5
5
5
5
:5
5
5
~
5
5
5
5
:5
5
:5
:5
1
0
0
0
21
22
23
1
24
1
1
1
1
0
0
0
0
1
1
1
1
1
1
0
0
0
1
1
1
1
1
1
1
1
1
1
I)
1
0
1
0
1
1
1
1
0
0
0
0
40
1
\)
41
1
1
0
1
0
0
0
0
0
0
0
0
0
0
0
25
26
27
28
29
30
.Jl
J2
33
34
35
36
37
38
39
42
43
44
4~
46
47
48
49
1
1
1
1
0
0
0
a
50
0
51
I)
0
0
a
0
a
0
0
0
\)
0
1
1
1
1
1
1
1
1
1
1
0
0
0
0
0
0
0
1
1
0
0
0
0
1
1
1
1
1
1
1
1
a
1
0
1
0
0
1
20
5
5
5
5
1
1
1
5
c
1
1
1
1
1
1
1
1
1
18
19
;oJ
1
0
0
;)
~
-
1
1
1
1
1
1
1
1
1
1
1
1
5
5
5
5
e
Sequences
0
1
1
1
1
1
1
1
0
1
1
1
C
0
0
C
0
0
a
0
1
1
1
1
1
0
0
1
a
0
0
1
0
1
0
0
1
1
1
1
0
1
0
a
1
1
1
1
0
0
0
0
\)
1
1
0
0
0
0
1
1
1
C
1
1
1
a
a
1
1
1
1
1
1
1
1
1
1
1
1
C
0
0
1
0
1
0
0
1
1
1
1
1
1
1
C
1
a
0
1
0
a
1
1
1
1
0
0
1
1
\)
0
1
0
1
0
1
0
a
1
0
1
0
1
1
1
1
1
1
1
1
1
1
0
1
0
0
1
0
0
0
1
1
0
1
0
0
1
Q
0
0
1
0
C
a
C
1
0
1
0
1
a
a
1
1
1
C
1
1
1
1
a
1
0
a
1
1
1
1
1
0
1
1
0
1.
0
0
1
0
1
1
1
0
0
1
0
1
0
0
1
0
1
a
1
a
0
1
1
1
0
1
1
0
1
1
1
a
0
1
0
0
1
118
Table Al. 1 (Continued)
Ok
(k)
5
°S
(d)
AA
AS
AC
SA
SS
BC
CA
52
0
0
1
1
1
1
1
0
C
0
0
0
0
0
0
0
0
0
0
1
1
.1
.1
1
1
1
1
1
.1
1
1
1
J.
1
1
1
1
1
1
J.
1
5
5
5
5
53
54
55
5
53
5
s
56
57
59
5
60
01
tl
Sequences
E
a
5
02
5
03
0
5
64
0
!;)
05
5
66
0
5
5
07
68
0
b9
5
5
5
5
5
70
71
72
73
7475
5
5
77
!:i
5
5
5
5
tJ
0
0
b
6
0
CJ
6
6
0
6
6
6
0
0
u
0
<:>
0
6
0
76
78
79
80
til
1
Z
J
45
IJ
\)
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
IJ
0
0
0
0
1
1
1
1
1
1
1
1
0
0
0
0
1
1
1
1
1
1
1
0
.1
1
1
1
1
1
.1
.1
1
0
U
1
1
1
1
.1
a
1
1
1
1
1
0
\J
U
0
0
0
0
1
0
1
1
1
1
1
1
1
1
0
7
lj
1
9
10
12
1.3
14
15
10
17
18
1
1
1
1
1
1
1
1
1
1
lY
1
20
21
1
1
1
1
1
1
1
.1
1
1
1
a
1
\)
1
1
0
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
.1
1
1
.1
1
1
1
1
0
0
1
0
1
1
0
0
1
1
1
1
1
1
1
1
1
a
1
1
.1
0
0
C
0
0
C
0
0
0
0
0
.1
1
0
1
0
C
0
0
0
0
1
1
1
1
1
1
1
0
0
1
1
1
1
1
1
a
1
C
1
a
0
1
0
1
1
0
a
a
0
0
1
1
1
0
0
0
1
1
1
1
11
1
0
0
.1
.1
0
0
1
1
1
0
1
0
0
1
1
1
1
1
1
a
1
1
1
C
1
0
0
1
1
0
1
0
0
1
1
a
1
1
1
1
I)
1
0
0
1
0
C
1
C
1
0
1
0
1
a
1
0
1
1
I.l
i
a
1
0
e
1
1
0
1
1
1
0
1
1
1
1
0
0
1
1
C
1
0
1
0
1
0
1
1
.1
1
a
a
0
1
1
1
C
1
1
C
1
1
0
1
1
1
0
0
1
1
0
1
1
0
0
1
\)
0
1
0
1
1
1
0
0
1
1
0
C
1
0
1
0
1
0
0
0
0
1
0
1
0
1
1
1
1
1
0
1
1
1
.1
0
1
0
1
a
0
CC
0
0
1
0
1
1
1
1
.1
Cs
1
1
1
.1
C
0
1
0
0
1
0
1
1
0
0
1
0
1
1
0
1
1
0
0
1
e
119
Table Al.l
Ok
(k)
6
6
6
6
·6
6
0
(;)
0
U
0
6
6
6
e
0
(d)
2~
23
24
25
20
27
28
29
30
31
32
33
34
..35
36
6
~7
38
39
40
41
42
43
44
45
U
b
6
0
6
6
6
46
47
Sequences
AA
AB
AC
BA
BB
BC
CA
CB
1
1
1
1
1
1
1
1
1
1
1
1
0
C
1
1
1
1
1
1
1
1
1
1
1
1
1
0
0
0
1
1
0
0
0
C
1
1
1
0
0
1
1
1
1
1
0
1
1
1
0
1
1
1
a
0
1
1
1
0
1
0
0
0
0
0
0
0
0
0
0
0
0
0
1
1
1
1
C
1
1
1
1
0
1
1
1
1
1
1
0
0
1
1
1
1
1
1
46
49
00
1
0
6
51
52
1
1
0
5..3
6
0
6
6
54
55
50
57
5iJ
1
1
a
0
0
0
;)
0
0
0
0
6
5~
6
0
00
61
62
6
63
0
0
6
64-
0
0
65
0
0
0
66
67
0
~8
0')
u
1
1
b
6
6
u
0
0
0
0
0
a
0
0
0
0
0
0
0
0
0
1
1
1
1
1
1
1
1
1
1
1
1
6
70
71
J
1
1
1
1
1
1
0
1
(,)
72-
0
1
6
e-
°SE
0
0
0
(Continued)
o
a
0
0
0
1
1
1
1
1
1
1
1
1
1
0
0
0
0
0
a
1
1
1
1
1
1
1
1
1
1
1
1
1
1
a
0
0
0
a
0
1
1
1
1
1
1
1
1
1
1
1
1
0
a
0
0
0
1
1
1
1
1
1
0
C
0
1
1
1
1
C
1
1
1
1
0
1
1
1
0
a
1
1
1
1
1
a
1
0
0
1
1
0
1
0
1
1
1
0
1
1
1
C
1
0
0
1
1
0
1
0
0
0
1
1
0
1
1
1
a
1
1
1
1
1
1
1
1
1
1
C
1
1
1
1
0
1
1
0
1
C
1
1
1
0
1
1
1
0
1
1
1
C
0
1
0
1
1
1
0
1
1
.1
.1
0
0
1
1
1
1
0
1
1
1
1
1
1
1
1
1
1
0
1
0
1
1
1
1
0
1
1
1
1
1
a
1
1
0
1
1
a
1
1
1
1
\)
1
1
0
1
1
1
.1
1
0
1
1
Q
1
0
0
0
0
1
1
1
1
1
1
1
a
1
1
1
1
1
1
a
1
1
1
1
1
1
1
1
1
a
0
1
1
1
1
0
0
1
1
1
1
1
0
1
1
a
1
1
1
1
1
0
a
1
1
0
1
1
1
1
1
1
1
0
1
CC
1
a
1
1
0
1
a
1
0
1
0
a
a
1
1
1
1
1
1
1
120
Table Al.1
Ok
(k)
b
6
°S
(d)
AA
AS
AC
BA
BS
BC
CA
73
74
0
0
0
0
0
0
0
1
0
0
0
0
0
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
C
1
1
1
1
1
1
1
0
0
0
C
1
1
1
1
0
1
1
1
1
1
0
1
1
1
1
0
7~
Q
77
76
1
7
7
7
7
7
7
7
7
7
7
7
7
7
7
7
7
7
7
7
7
7
7
7
7
7
76
2
3
4
5
0
7
8
9
10
11
12
13
14
15
16
17
18
19
20
,U
22
23
24
25
26
27
20
7
2'::1l
:30
31
32
33
34
7
35
7
7
7
7
7
8
8
a
36
1
2
.3
8
d
4
(j
6
7
S
8
8
Sequences
E
6
6
6
7
7
7
7
(Continued)
5
8
9
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
.1
1
1
1
1
1
1
1
1
1
1
0
0
0
0
0
0
0
0
1
1
1
1
1
1
1
1
0
1
1
1
1
1
1
0
0
0
0
0
0
0
1
1
1
1
1
1
J.
0
1
1
1
1
1
1
1
0
.1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
0
0
0
0
0
0
1
1
1
1
1
1
0
1
1
1
1
1
1
0
1
1
1
1
1
1
1
0
1
1
1
0
1
1
1
1
1
1
1
1
1
1
0
0
0
0
0
1
1
1
1
1
0
1
1
1
1
1
0
1
1
1
1
0
1
1
1
1
.1
0
1
1
1
1
1
1
1
1
1
1
1
0
1
1
1
1
1
1
1
1
0
1
1
1
1
0
1
1
1
1
1
1
0
1
1
1
1
0
1
1
1
1
1
0
0
0
1
1
1
0
1
1
1
0
1
1
1
1
0
1
1
1
1
1
0
1
1
1
1
1
1
0
1
1
1
1
1
1
1
0
1
1
1
1
1
a
1
1
0
1
1
0
1
1
1
0
1
1
1
1
0
1
1
1
1
1
0
1
1
1
1
1
1
0
1
1
1
1
1
1
1
0
1
1
1
1
1
1
CB
1
0
1
1
1
1
0
1
a
1
0
1
1
0
1
1
1
C
1
1
1
1
0
1
1
1
1
1
0
1
1
1
1
1
1
0
1
1
1
1
1
1
1
0
1
1
1
1
1
1
1
CC
a
1
1
1
1
1
a
C
1
a
1
1
0
1
1
1
0
1
1
1
1
0
1
1
1
1
1
e
0
1
1
1
1
1
1
C
1
1
1
1
1
1
1
a
1
1
1
1
1
1
1
1
e
121
APPENDIX 2
Tabulation of the Design-Comparison Criteria and
Optimality Indicators for All Possible
5-, 6-, 7-, and 8-Sequence Subdesigns
Legend:
Definition 1: Orthogonal Polynomials
2: ADBL (Average Distance Between Lines)
3:
DFM (Deviation From Means)
4:
RC (Reference Cell)
Design Numbers:
Designs are defined by number, in Appendix 1.
fl(~; ~) = DET[~,(~,~)-l~]
f2(~; ~) = TRACE[~,(~,~)-l~]
f3(~; ~) = M~X{A; DET[~,(~,~)-l~ - A:] = 0
=[
0 ,
:2]
++
First period treatment effects;
2x1
C
I
= [ 0
_ r( 2)
:2]
++
Second period treatment effects;
2x3
C
_A
= [0
2xl
'
I
_2'
0]
2x2
++
Carryover effects
Table A2.l
Values of the design-comparison criteria f.(X;
1 _ C
_p ), Optimality Indicators
OI(a,i,p) and TOTAL = OI(d,i,p), found for each subdesign (DES), in each
.
method of definition (OEF) in each class Ok.
r
fi(~' ~p)
ok
0
E
F
0
E
S
First Period
Treatment Effects
5
5
5
5
5
f)
5
5
5
5
~
5
5
5
b
5
5
5
5
5
5
5
5
5
5
5
5
5
5
5
5
5
5
5
:i
b
5
5
•
(d)
1
1
I
I
1
I
I
1
&
1
I
1
1
&
1
I
I
I
I
I
1
1
I
I
I
1
&
I
&
1
1
&
1
1
1
1
1
&
18
~o
20
30
31
32
53
S~
2
3
4
6
1
8
Il
.24
21
.3
4.
45
50
63
6.
~fi
69
73
.
17
80
13
21
25
3.J
52
56
57
I
5
1(0)
2(A)
Second Period
Treatment Effects
Carryover Effects
Criterion
(k)
OI(d.i.p)
5.000 0.000 ~.ooo
6.000 6.000 ~.OOO
5.000 6.000 5.000
~.ooo 6.000 5.000
5.000 6.000 b.OOO
5.000 6.000 5.000
5.000 6.000 5.000
s.ooo 0.000 5.000
6.061 6.601 5.442
6.6101 6.601 5.442
~.Q67 0.601 5.4.2
6.667 6.061 b ••• 2
6.601 6.~61 5.442
0.067 6.661 5 ••42
5.000 5.000 3.618
5.000 5.000 ~.61Q
b.OOO 5.000 3.618
5.000 S.OOO 3.61a
~.661 6.661 5 •• 42
0.661 0.661 5 •• 42
5.000 5.000 3.616
5.00)0 5.000 :1.618
5.000 5.000 3.618
6.661 6.667 ~.442
6.661 6.661 5.442
S.OOQ 5.000 3.616
6.661 6.~61 5 ••42
0.601 6.6107 5.442
5.000 6.000 5.000
5.000 0.000 5.000
5.000 6.000 5.000
5.000 6.000 5.000
5.000 6.000 ~.OOO
5.000 6.000 5.000
5.000 6.000 5.000
5.000 6.000 5.000
6.667 6.661 5.442
6.661 6.661 5.442
1(0)
l~.~OO
16.000
16.000
16.000
16.000
10.000
16.000
10.000
110.000
16.000
16.000
16.000
lb.OOO
16.000
16.000
16.000
16.000
16.000
16.000
16.000
16.000
16.000
110.000
16.000
&6.000
16.000
16.000
16.000
12.000
16.000
&6.000
12.000
12.000
16.000
&6.000
12.000
12.000
12.000
2(A)
12.000
12.000
12.000
12.000
12.000
12.000
12.000
12.000
12.000
12.000
12.000
12.000
12.000
12.000
12.000
12.000
12.000
12.000
12.000
12.000
12.000
12.000
12.000
12.000
12.000
12.000
12.000
12.000
a.ooo
12.~00
12.000
8.000
a.ooo
12.000
12.000
8.000
8.000
a.ooo
3(E)
10 •• 72
10.412
10 ••,2
10•• ,2
10.412
10 ••,2
10.412
10.412
10.412
10.472
10.412
1'•• '2
10.412
10.412
10.472
10 •• ,2
1C•• ,2
10 ••,2
10.472
10 •• ,2
10.412
IC.412
10.412
10.412
lC.472
10.412
10.412
10.412
6.000
lC.412
10.412
6.000
10.000
10.412
10.412
6.000
6.000
6.000
1(0)
2(A)
3(E)
16.000 12.000 10•• 72
16.000 12.000 10.472
16.000 12.000 10.412
I~.OOO 12.000 10.412
16.000 12.000 10.412
16.000 12.000 10.412
16.000 12.000 10.412
16.000 12.000 10.412
12.000 8.000 6.000
12.000 8.000 6.000
12.000 8.000 6.000
12.000 8.000 6.000
12.000 8.000 6.000
12.000 8.000 6.000
16.000 12.000 10.412
16.000 12.000 10.412
16.000 12.000 10•• 72
16.000 12.000 10.472
&2.000 a.ooo 6.000
12.000 8.000 6.000
16.000 12.000 10 •• ,2
16. 000 12.000 10•• ,2
16.000 12.000 10.412
12.000 8.000 6.000
12.COO a.ooo 6.000
16.000 12.000 10.412
12.000 8.000 6.000
12.000 a.ooo 6.000
16.000 12.000 10 •• ,2
16.000 8.000 4.000
16.000 8.000 4.000
16. 000 12.000 I 0.412
16.000 12.000 10 •• ,2
16.000 8.000 4.000
16.000 8.000 4.000
16.000 12.000 10•• ,2
12.000 8.000 6.000
12.000 8.000 6.000
'e'
P .. A
Criterion
Criterion
Criterion
3(E)
p • TO)
P • y(2)
Criterion Criterion
2
3
1
2
3
1
2
1
1
0
0
0
0
0
0
0
0
0
0
0
0
0
0
I
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
I
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
I
I
0 0
0 0
00
0 0
0
0
0 0
0 0
0 0
I 0
I
0
0
I
I 0
0
I
0
I
0 0
0 0
0 0
0 0
0
I
& 0
0 0
0 0
0 0
0
I
0
I
0 0
0
I
0
I
0 0
I
I
I
1
I
0
0
0
0
0
0
I
I
I
I
0
0
I
I
1
0
0
I
0
0
I
I
I
I
I
1
I
I
0
0
I
I
I
0
0
I
I
I
0
0
I
0
0
0
0
0
0
0
0
0
0
0
0
I
0
0
I
I
0
0
I
I
I
I
I
0
0
I
I
I
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
I
I
I
I
0
0
0
0
I
I
0
0
0
I
1
0
I
1
0
0
0
0
0
0
0
0
I
I
I
I
0
0
I
I
0
I
I
A
l
3
1
I
T
0
T
I
I
0
0
I
I
0
0
0
I
I
I
I
I
I
I
I
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
3
3
3
3
3
3
3
3
--
"4
N
N
e
,e,
•
Table A2.l
e
(Continued)
fi(~i ~p)
ok
0
0
E
F
E
S
(k)
5
5
5
5
I
I
I
I
~
I
I
5
5
5
5
5
5
~
5
ti
5
5
5
5
5
5
5
5
5
5
5
5
5
5
5
5
5
5
5
5
5
5
5
5
I
I
I
I
1
I
I
I
I
1
1
I
1
I
1
1
I
1
I
I
•
1
I
1
I
I
I
1
I
1
I
I
First Period
Treatment Effects
1(0)
~
0.~07
10
12
15
22
23
2iJ
2 !.I
31
3 !.I
LtO
Ltl
42
48
.9
~I
61
t.7
~ti
7 ..
75
76
79
81
19
3 ..
35
36
b4
58
59
60
70
71
72
1~
11
38
5.000
5.000
5.000
5.000
5.000
5.000
5.000
~.OOO
5.000
5.000
6.6~7
5.000
5.000
5.000
5.000
5.000
5.000
6.~61
5.000
5.000
5.000
5.000
6.607
5.000
~.6~7
6.667
6.667
5.000
6.6t.7
6.667
6.667
0.607
u.667
6.667
5.000
5.000
5.000
'2(A)
~.607
5.000
5.000
5.000
5.000
5.000
5.000
5.000
5.000
5.000
5.000
6.667
5.000
5.000
5.000
5.000
5.000
5.000
6.b61
5.000
5.000
5.000
5.000
6.667
6.000
5.333
5.333
5.333
0.000
5.333
5.333
5.333
5.333
5.333
5.333
S.OOO
5.COO
5.000
Second Period
Treatment Effects
Carryover Effects
Criterion
(d)
OI(d.i.p)
1(0)
5 •••2 12.00U
3.618 12.000
3.61a 16.000
3.~16 10.000
3.618 12.000
3.61a 16.000
3.61U 16.000
3.618 12.000
3.~18 12.000
3.618 12.000
3.61U 16.000
5 ....2 12.000
3.61a 16.000
3.618 16.000
~.oI8 16.000
3.618 12.000
3.016 16.000
3.61& 16.000
5.442 12.000
3.618 16.000
3.01a 16.000
3.618 12.000
3.616 12.000
5 ..... 2 12.000
5.000 12.000
3.333 12.000
3.333 16.000
3.333 16.000
5.000 12.000
3.333 16.000
3.333 12.000
3.333 16.000
3.333 16.000
3.333 16.000
3.333 12.000
3.618 12.000
3.618 16.000
3.618 16.000
2(A)
8.000
a.ooo
8.00C
12.UOO
8.000
8.000
8.000
ti.OOO
8.000
8.000
8.00G
8.000
12.000
12.000
ti.OOO
.8.000
8.000
ti.OOO
8.000
12.000
8.000
a.ooo
8.000
8.000
8.000
8.000
8.000
8.000
8.000
8.000
8.000
8.000
8.000
8.000
8.000
8.000
8.000
8.000
3(E)
1(0)
b.OOO
6.000
4.000
10.472
6.000
... 000
4.000
6.000
6.000
6.000
4.000
6.000
10•• 12
10.472
4.000
6.000
... 000
4.000
6.000
10.472
".000
6.000
6.000
6.000
6.000
6.000
4.000
4.000
6.000
4.000
6.000
4.000
4.000
...000
6.000
to.OOO
4.000
4.000
12.000
2(A)
8.000
12.000
16.000 12.000
16.000 8.000
I~.OOO 12.000
16.000 12.000
16.000 12.000
16. 000 12.000
16.000 12.000
16.000 12.000
16.000 12.000
12.000 8.000
16.000 8.000
16.000 8.000
10.000 12.000
16.000 12.000
16.000 12.000
16.000 12.000
12.000 8.000
16.000 8.000
16.000 12.000
16.000 12.000
16.000 12.000
12.000 8.000
16.000 8.000
12.000 8.000
12.000 8.000
12.000 8.000
16.000 6.000
12.000 8.000
12.000 8.000
12.000 8.000
12.000 8.000
12.000 8.000
12.000 8.000
10.000 8.000
16.000 8.000
16.000 8.000
I~.OOO
= T(l)
P = ).
Criterion
Criterion
Criterion
3(E)
p
2 3
3(E)
1
6.000
10.472
10.472
4.000
10.472
10.472
10.472
10.412
1
1
1
1
1
I
1
1
1~.472
10.472
10.472
6.000
4.000
".000
10.472
10.472
10 ... 72
10.472
6.000
4.000
10.472
10 ... 72
10.472
6.000
".000
6.000
6.000
6.000
4.000
6.000
6.000
6.000
6.000
6.000
6.000
4.000
4.000
4.000
0
I
I
I
I
0
I
1
I
1
I
0
1
1
I
1
1
I
I
I
0
I
I
I
1
1
• •
0
I
I
I
1
0
I
0
0
0
1
0
0
0
0
0
0
1
1
I
0
I
I
I
1
0
0
0
0
0
0
0
0
0
0
0
0
1
I
1
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
I
I
I
0
I
I
I
I
I
I
0
0
0
P = T(2)
-
Criterion Criterion
1
1
1
0
0
I
0
0
I
I
I
0
1
0
0
0
I
2 3 1 2
I
I
1
0
I
I
I
1
I
1
I
I
0
0
I
I
•
• •
0
0
1
I
0
1
I
1
I
I
1
I
I
I
I
I
I
I
1
0
0
I
0
0
1
0
I
0
0
0
I
1
0
0
1
1
I
I
I
I
I
0
0
1
0
0
I
I
0
0
0
I
0
0
0
I
0
I
I
0
0
I
0
0
0
0
0
I
I
0
I
0
1
I
1
0
0
I
I
1
0
0
0
0
0
0
0
0
0
0
1
0
0
0
0
0
0
I
0
0
0
0
I
0
I
I
1
0
I
I
1
I
1
I
0
0
0
I
0
0
I
0
0
0
0
0
0
0
1
I
1
0
0
0
0
•
1
0
0
0
1
•
1
I
I
I
I
I
I
lI
1
1
I
3
0
0
0
1
0
0
0
0
0
0
0
0
I
I
0
0
0
0
0
I
0
0
0
0
I
0
0
0
I
0
0
0
0
0
0
I
I
I
T
0
T
A
l
4
4
4
4
4
4
4
4
4
4
4
4
4
4
4
4
4
4
4
4
4
4
4
..
5
5
5
5
5
5
5
5
5
5
5
6
6
6
.....
N
W
•
e
e,
Table A2.l
(Continued)
fi(~i ~~)
ok
0
E
F
5
5
5
5
5
5
5
5
5
5
5
=
5
5
5
5
5
5
l:i
5
5
5
5
5
=
5
:)
5
5
:)
5
5
5
:i
5
5
5
E
S
(d)
(k)
5
0
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
15
16
19
12
14
IS
lb
HI
20
2~
26
21
29
,)0
:13
34
41
47
48
50
51
54
55
56
57
59
68
1~
81
1
2
3
4
5
0
1
6
9
First Period
Treatment Effects
'2(A)
Second Period
Treatment Effects
Carryover Effects
Criterion
1(0)
OI(d.i.p)
1.250 ~.OOO 2.500
1.250 3.000 2.500
1.250 ~.ooo 2.500
1.250 2.~00 1.809
1.2~0 2.~00 1.609
1.250 2.500 1.809
1.250 2.500 l.ti09
1.250 2.5ao 1.809
1.250 2.500 1.809
1.250 2.5UO 1.80~
1.250 2.500 I.U09
1.25~ 2.500 1.809
1.250 2.500 1.809
1.2S0 2.500 1.809
1.250 2.500 1.809
1.661 3.,J.1.1 2.121
1.661 J • .l.J~ ~.121
1.250 2.eoo 1.80~
1.250 2.500 1.809
1.2~0 2.500 1.609
1.250 2.5~0 1.80v
1.250 2.500 1.809
1.250 2.500 1.809
1.250 2.500 1.809
1.250 2.500 1.809
1.667 3.333 2.721
1.667 3.J3J 2.721
1.661 3.3J3 2.121
1.661 J.33.l 2.721
1.bo7 2.6U7 1.667
1.067 2.661 1.667
1.661 2.667 1.601
1.661 2.667 1.667
1 ...61 2.661 1.667
1.661 2.661 1.667
1.667 2.667 1.667
1.661 2.001 1.b61
1.~61 2.~61 1.667
1(0)
4.000
3.000
3.000
4.000
4.000
4.000
3.000
3.000
4.000
4.000
4.000
4.000
3.000
4.000
3.000
3.000
3.000
3.000
4.000
4.000
3. 000
3.000
4.000
4.000
3.000
3.000
3.000
3.000
3.000
3.000
4.000
4.000
4.000
3.000
4.000
4.000
4.000
3.000
2(A)
6.000
4.000
4.000
6.000
4.000
4.000
4.000
4.000
6. 000
6.000
4.000
4.000
4.000
6.000
4.000
4.000
4.000
4.000
4.00C
4.000
4.000
4.000
4.000
4.000
4.000
4.000
4.000
4.000
4.0~0
4.000
4.000
4.000
•• 000
4.000
4.000
4.000
4.000
4.000
3(E)
1(0)
2(A)
5.236 4.000
4.000
3.000 4.000 6.000
3.000 4.000 '0.000
5.236 4.000 4.000
2.000 4.000 6.000
2.000 4.000 b.OOO
3.000 4.000 6.000
3.000 4.000 6.000
5.2.16 4.000 4.000
5.236 4.000 4.000
2.000 4. 000 6.000
2.000 4.000 6.000
3.000 4.000 6.000
5.236 4. 000 4.000
3.000 4.000 6.000
3.000 3.000 4.000
3.000 3.000 4.000
.l.000 4.000 6.000
2.000 4.000 6.000
2.000 4.000 6.000
3.000 4.000 6.000
3.000 •• 000 6.000
2.000 4.000 6.000
2.000 . 4.000 6.000
3.000 •• 000 6.000
3.000 3.000 4.000
3.000 3.000 4.000
3.000 3.000 4.000
J.OOO 3.000 4.000
.J.ooo 3.000 4.000
2.000 3.000 4.000
2.000 3.000 4.000
2.000 3.000 4.000
3.000 3.000 4.000
2.000 3.000 4.000
2.000 3.000 4.000
2.000 3.000 4.000
3.000 3.000 4.000
P .. A
Criterion
Criterion
Criterion
3(E)
p .. T(l)
3(E)
a.ooo
5.236
5.236
2.000
5.236
5.236
5.236
5.236
2.000
2.000
5.23b
5.236
5.236
2.000
5.236
3.000
3.000
5.236
5.236
5.236
5.236
5.236
5.236
5.236
5.236
3.000
3.000
3.000
3.000
3.000
3.000
3.000
3.000
3.000
3.000
3.000
3.000
3.000
P .. T(2)
Criterion Criterion
1
2 3
1
2 3 1
I
0
0
0
0
0
0
0
0
0
0
1
1
1
1
1
I
1
•
1
1
1
1
1
1
I
I
1
I
0
1
1
1
0
0
0
0
0
0
0
0
0
0
0
0
0
o
0
0
0
0
0
0
0
0
0
1
1
1
I
1
1
I
1
I
0
0
1
1
0
0
1
1
1
I
I
I
••
I
I
I
0
0
0
0
0
0
0
0
0
0
0
0
0
1
1
I
0
0
0
0
0
0
0
0
0
0
0
0
0
1
1
1
1
1
I
I
1
0
0
0
•
1
0
0
0
0
1
I
0
1
1
1
I
0
0
I
I
1
0
1
1
1
1
0
0
1
0
1
0
0
1
I
1
1
1
I
1
1
0
0
0
I
0
0
0
I
•
1
1
I
I
1
I
I
1
I
0
0
0
0
I
1
0
0
0
0
I
I
0
0
0
0
0
0
I
1
0
0
I
1
0
0
0
0
0
0
•
• •
1
1
I
1
I
1
I
I
1
I
1
1
0
I
1
1
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
1
1
0
0
0
0
0
0
0
0
1
1
I
1
1
I
2
I
0
0
0
0
0
0
0
0
0
0
I
I
I
I
I
0
0
0
1
0
1
I
0
0
0
0
0
0
0
0
1
I
•
1
I
1
I
I
I
1
1
I
I
0
0
1
1
(
3
1
1
I
1
1
I
0
0
0
1
0
0
0
0
0
0
0
a
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
,0
T
0
T
A
l
3
3
3
4
4
4
4
4
4
4
4
4
4
4
4
4
4
4
4
4
4
4
4
4
4
4
4
4
4
5
5
5
5
5
5
5
5
5
....
N
U'1
Table A2.l
(Continued)
fi(~; ~~)
D
k
D
D
E
F
E
S
First Period
Treatment Effects
(d)
5
5
5
fo
5
5
5
5
5
5
5
5
5
5
~
5
5
5
5
5
l;i
5
::
5
5
5
31
39
10
J
.l
14
3
3
3
3
3
;)
..l
3
3
3
3
3
3
;)
5
.1
5
5
5
.)
.)
II
13
18
~2
2.
25
32
18
20
4:1
2b
30
.31
32
..lU
40
42
43
~2
53
55
56
61
03
tllt
5
5
5
3
3
67
13
;)
1.
~
.)
.)
5
ti
:5
•
2
2
2
2
2
2
2
2
2
2
3
3
3
.)
15
78
2
;)
•6
1(D)
2(A)
1.250 3.000
I.~SO 3.000
1.250 2.500
1.250 2.500
1.250 2.500
1.250 2.500
1.250 2.500
1.250 2.500
1.250 2.500
1.250 2.500
0.139 0.944
0.139 0.94.
0.139 0.9.4
0.139 0.~.4
0.139 0.944
0.139 0.944
0.139 0.9.4
0.139 0.9"4
0.139 0.~44
0.139 0.9••
O. 139 0.9.4
0.139 0.9".
0.139 0.9••
0.139 0.~"4
0.139 0.944
0.139 O.s....
0.139 0.94.
0.139 0.Y44
0.139 o.~••
0.139 0.944
0.139 o.s...
0.139 0.944
0.139 0.9il"
0.139 0.9"4
0.185 0.903
0.la5 0.~03
0.185 0.903
0.185 0.S63
-
Second Period
Treatment Effects
Carryover Effects
Criterion
(k)
OI(d.i.p)
-p = .r(l)
-. Criterion
Criterion
Criterion
3(E)
1(D)
2(A)
3(E)
2.500
2.500
1.809
1.809
1.809
1.809
1.809
1.809
1.809
1.809
0.762
0.702
0.762
0.762
0.762
0.762
0.762
0.762
0.762
0.762
o. 702
0.762
0.762
0.762
0.762
0.162
0.162
0.702
0.762
0.762
0.762
0.762
0.762
0.762
0.697
0.697
0.697
0.691
3.000
3.000
3.000
4.000
3.000
4.000
3.000
4.000
3.000
•• 000
0.44.
0 ••••
0 •• 4.
0 •• 4.
0.4.4
0 •• 44
0 ••••
0.4.4
0.4••
0.4""
0 ••••
0 ••••
0 .....
0.4 ...
0 .... 4
0 .......
0 ••••
O.il ••
0." ••
0 ••• 4
0 ••••
0 .....
0 .....
0 ••••
0.4il ..
0 .....
0 ••• 4
0 ......
... 000
•• 000
4.0aO
... 000
•• 000
4.000
•• 000
•• 000
•• 000
4.000
1.556
1.556
2.222
2.222
1.556
2.222
2.222
1.556
1.556
1.556
2.222
2.222
2.222
2.222
1.556
1.556
1.556
2.222
2.222
1.556
2.222
2.222
1.556
1.556
1.556
1.556
1.556
1.556
3.000
3.000
3.000
2.000
1(0)
..l.ooo
2.000
3.000
2.000
3.000
2.000
1.118
1.118
2.000
2.000
1.118
2.000
2.0CO
1.178
1.178
1.178
2.000
2.0'0
2.000
2.000
1.178
1.178
1. 178
2.000
2.0CO
1.178
2.000
2.0CO
1.178
1.118
1.178
1.178
1.178
1.178
... 000
•• 000
4.000
4.000
•• 000
•• 000
•• 000
•• 000
4.000
•• 000
0 •••4
0••••
0 •• 4 ..
0.4••
o.... 4
0 ••".
o••••
0 ••••
0 ••••
0.4.4
0."••
o••••
0 ......
0 ••••
0 ••••
0 ••••
O••• 4
0 ••••
0 ••••
0 ••••
0 .....
O. . . . .
0 ••••
0 •• 4.
0.333
0.333
0.333
0.333
'e'
2(A)
•• 000
••000
•• 000
... 000
•• 000
••000
•• 000
4.000
4.000
•• 000
1.556
1.556
1.556
1.556
2.222
1.556
2.222
1.556
1.556
2.222
1.556
4!.222
1.556
2.222
2.222
1.556
1.556
1.556
2.222
2.222
1.556
1.556
1.556
1.556
1.333
1.333
1.333
1.333
3(E)
2.000
2.000
2.000
2.000
2.000
2.000
2.000
2.000
2.000
2.000
1.178
1.118
I. 178
1.178
2.000
1.178
2.000
1.178
1.178
2.000
1.178
2.000
1.178
2.000
2.000
1.178
1.178
1.178
2.000
2.000
1.178
1.118
1.17d
1.178
1.000
1.000
1.000
1.000
= J.
p
P = T(2)
-
Criterion Criterion
1
2 3
1
2 3
1
2
1
1
I
1
0
0
I
I
1
1
I
0
I
I
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
1
I
I
I
I
I
1
1
I
I
I
I
I
•
I
I
I
I
I
I
I
I
I
I
1
I
1
1
1
I
1
I
I
I
1
I
I
I
0
0
0
0
I
I
I
I
1
1
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
I
0
1
0
1
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
•
I
I
I
I
I
I
I
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
1
0
I
0
1
0
I
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
o .0
0
0
0
0
0
0
0
0
0
0
0
0
I
I
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
I
I
I
I
I
I
I
0
0
0
0
I
I
0
0
0
0
0
0
0
1
1
1
I
I
1
1
1
0
0
0
l
0
0
0
0
0
1
T
A
3
0
0
0
0
0
0
0
0
0
0
0
T
0
0
0
0
0
0
0
0
0
0
0
0
0
0
a
I
I
a.
5
5
6
6
6
6
6
6
6
6
I
I
I
I
I
1
I
I
1
1
1
I
I
I
I
I
I
I
I
1
I
I
I
I
3
3
3
3
--'
N
0\
e
•
·e·
e
Table A2.l
(Continued)
fi(~; ~~)
ok
°
E
F
0
First Period
Treatment Effects
E
S
5
5
fa
5
5
5
5
5
to
5
S
5
S
5
5
5
5
S
to
5
5
5
5
5
5
5
5
5
5
5
5
5
5
5
5
~
5
5
(d)
J
3
3
.J
3
3
3
3
3
3
3
3
3
.)
3
4
.-.-
.-4
4
4
4
..
1
5
9
10
16
~2
29
:H
41
47
51
59
68
72
81
38
"0
42
43
64
61
14
78
11
21
"""
"4
It
28
31
35
30
41t
4
45
4
49
.
..
..
4
4
4
46
52
53
tl8
60
65
1(0)
0.185
U.185
0.185
0.139
0.139
0.139
0.139
0.185
0.18S
0.139
0.139
0.185
0.185
0.1&5
0.185
1.250
1.250
1.~50
1.250
1.250
1.2S0
1.250
1.~50
1.250
1.250
1.250
1.250
1.667
1.667
1.667
1.661
1.2~0
1.~50
1.250
1.250
•• 661
1.661
1.667
2(A)
3(E)
1(0)
0.333
0.333
0.333
0.333
0.333
0.333
0.333
0.333
0.333
0.333
0.333
0.333
0.333
0.333
0.333
4.000
4.000
4.000
4.000
4.000
4.000
4.000
4.000
4.000
4.000
4.000
1t.000
4.000
4.000
4.000
4.000
4.000
4.000
4.000
4.000
4.000
4.000
1t.000
2(A)
3(E)
1.333
1.333
1.3':13
1 • .333
1.333
1.333
1.333
1.333
1.333
1.333
1.333
1.333
1.333
1.333
1.333
1.0eo
1.000
1.000
I.OCO
1.000
I.oeo
1.000
1.000
1.0CO
1.000
1.0CO
a.ooo
1.000
1.0CO
1.000
5.236
5.236
5.236
5.236
5.236
5.236
5.236
5.236
5.236
5.236
5.2.16
5.236
5.236
5.23ca
5.236
5.2.36
5.236
5.236
5.236
5.236
5.2.16
5.236
5.236
~.OOO
0.000
6.000
6.000
6.000
6.000
6.000
6.000
0.000
6.000
6.000
6.000
6.000
6.000
6.000
6.000
6.000
6.000
0.000
6.000
6.000
6.000
6.000
p =
1(0)
0.333
0.333
0.333
0.44.
0.4••
0.44.
0.444
0.333
0.3.:13
0.44.
0.444
0.333
0.333
0.333
0.333
4.000
4.000
•• 000
4.000
4.000
4.000
4.000
4.000
4.000
4.000
4.000
4.000
3.000
3.000
3.000
3. 000
4.000
4.000
".000
4.000
3.000
3.000
J.OOO
2(A)
1.333
1.333
1.333
a .556
1.556
1.556
2.222
1.3.:13
. . 333
1.556
2.222
1.333
1.333
1.333
1.333
6.000
6.000
6.000
6.000
0.000
6.000
6.000
6.000
6.000
6.000
6.000
6.000
4.000
•• 000
4.000
4.000
6.000
6.000
c..OOO
6.000
4.000
4.000
4.000
-dO
3(E)
1.000
a.ooo
1.000
1.178
a.178
1.178
2.000
1.000
1.000
1.178
2.000
1.000
a.ooo
1.000
1.000
5.236
5.236
S.236
5.236
5.236
5.236
5.236
5.236
5.236
5.236
5.236
5.236
3.000
3.000
3.000
3.000
5.236
5.236
5.236
5.236
3.000
3.000
3.000
Criterion Criterion
3
1
2
I
I
1
I
I
I
1
1
1
1
2
3
1
2
0
0
0
1
1
1
1
0
0
0
0
0
0
0
0
1
1
I
I
I
1
0
0
0
0
I
1
1
1
I
I
1
1
1
1
1
1
0
0
0
0
I
I
I
I
0
0
0
I
I
a
1
0
0
I
1
0
0
0
0
0
0
0
0
0
0
0
0
1
1
1
1
0
0
0
0
1
1
1
1
0
0
0
-p = T(2)
p " ).
Criterion
Criterion
Criterion
0.697
0.9b3 0.697
0.~~3 0.697
0.118 0.500
0.17& 0.500
0.778 0.500
0.778 0.500
0.S03 0.6~7
1.ldS 1.00~
0.17& 0.500
0.718 O.SOO
0."63 0.691
1.185 1.000
O.9b3 0.691
1.185 1.000
3.000 2.500
3.000 2.500
3.000 2.500
3.000 2.500
3.000 2.500
3.000 2.S00
3.000 2.500
J.OOO 2.500
2.50>0 1.809
2.500 1.809
2.5UO 1.809
2.500 1.609
3 • .133 2.721
3.333 2.721
3.33.1 2.721
3.333 2.721
2.500 1.809
2.500 1.809
2.500 1.609
;!.500 1.609
J.J33 2.721
3.333 2.721
3.333 2.721
0.96~
Second Period
Treatment Effects
Carryover Effects
Criterion
(k)
OI(d.i.p)
I
1
0
0
1
I
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
1
a
I
1
1
1
I
•
1
I
I
I
I
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
I
I
I
1
1
I
1
1
1
1
1
I
1
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
I
1
I
1
I
I
t
1
1
1
1
1
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
1
a
0
0
1
1
1
1
0
0
0
0
0
0
0
0
0
0
0
0
1
1
I
I
0
0
0
0
I
1
I
I
I
0
0
0
0
I
I
0
0
1
I
1
•
0
0
0
0
0
0
0
0
0
0
0
0
1
1
I
•
0
0
0
0
1
1
I
T
0
T
A
l
3
I
I
I
0
0
0
0
a
I
0
0
1
a
I
1
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
6
6
6
6
6
6
6
6
6
6
6
6
6
6
6
1
1
1
1
1
1
1
1
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
.....
N
(Xl
•
'e'
e
•
·e·
e
Table A2.l
(Continued)
OI(d.i.p)
fi(X;
C
)
~
~~
Ok
0
E
F
(k)
5
=.i
5
5
5
ti
5
5
5
5
5
5
5
5
5
5
5
5
::.
5
0
6
6
t.
Co
to
6
to
6
6
6
6
to
6
6
6
0
to
4
4
...
4
4
4
4
4
4
4
4
4
4
4
4
4
4
4
4
4
1
1
1
I
1
1
1
1
1
1
1
1
1
1
1
I
1
1
0
E
First Period
Treatment Effects
S
Criterion
(d)
1(0)
81
1
2
3
4
1.ou7
1.b07
1.667
1.6b7
1.667
1.667
1.667
1.ba7
1.667
1.667
1.250
1.250
1.250
1.250
1.250
1.250
1.250
1.250
1.250
1.250
4.000
4.000
4.000
.... 000
4.000
4.000
4.000
4.000
4.000
4.000
4.000
4.000
4.000
4.000
4.000
4.000
4.000
4.000
5
6
7
d
9
31
39
10
11
13
16
22
24
25
32
5
6
14
11
41
45
46
11
3
4
6
1
9
10
1.J
15
16
16
2(A)
Second Period
Treatment Effects
Carryover Effects
Criterion
3(E)
3.333 2.721
2.667 1.667
2.6~7 1.667
2.667 1.607
2.667 1.667
2.667 1.667
2.667 1.667
2.667 1.667
2.667 1.667
2.667 1.667
3.000 2.~00
3.000 2.500
2.500 1.809
2.500 1.609
2.500 1.609
2.500 1.809
2.500 1.809
2.500 1.609
2.500 1.809
2.500 1.809
4.607 3.535
5.661 4.840
5.661 4.840
5.661 4.840
5.607 4.840
5.667 4.640
5.661 4.840
4.bb7 3.535
4.607 3.535
4.667 3.535
4.667 3.535
5.661 4. e40
5.667 4.840
4.067 3.535
5.667 4.840
5.60 7 4.840
5.607 4.640
5.607 4.~40
1(0)
3.000
3.000
4.1)00
4.000
4.000
3.000
4.000
4.000
4.000
3.000
3.000
3.000
3.000
4.000
3.000
4.000
3.000
4.000
3.000
4.000
8.000
6.000
8.000
6.000
6.000
8.000
b.OOO
8.000
8.000
6.000
6.000
6.000
8.000
8.000
6.000
6.000
8.000
6.000
2(A)
4.000
4.000
4.000
4.000
4.000
4.000
4.000
4.000
4.000
4.000
4.000
4.000
4.000
4.000
4.000
4.000
4.000
4.000
4.000
4.000
8.000
7.000
10.000
1.000
7.000
10.000
7.000
8.000
e.ooo
5.500
5.500
7.000
10.000
e.ooo
7.000
1.000
10.000
7.000
3.000
J.OOO
2.000
2.000
2.000
3.000
2.000
2.000
2.000
3.000
3.000
J.OOO
J.OOO
2.000
3.000
2.000
3.000
2.000
3.000
c.ooo
6.828
6.000
9.123
6.000
t.OOO
9.12.J
6.000
6.828
6.028
4.000
4.000
t.ooo
9.123
6.828
6.000
6.000
9.123
6.000
1(0)
3.000
3.000
3.000
3.000
3. 000
3.000
3.000
3.000
3.000
3.000
4.000
4.000
4.000
4.000
4.000
4.000
4.000
4.000
4.000
4.000
6.000
6.000
6.000
b.OOO
b.OOO
6.000
6.000
6.000
b.OOO
u.OOO
6.000
6.000
6.000
6.000
0.000
6.000
6.000
6.000
2(A)
4.000
4.000
4.000
4.000
4.000
4.000
4.000
4.000
4.000
4.000
4.000
4.000
4.000
4.000
4.000
4.000
4.000
4.000
4.000
4.000
7.000
7.000
7.000
7.000
1.000
7.000
7.000
7.000
5.500
7.000
7.000
5.500
5.500
5.500
5.500
5.500
5.500
5.500
P =A
Criterion
Criterion
3(E)
= T(l)
p
- -3(E)
3.000
3.000
3.000
3.000
3.000
3.000
3.000
3.000
3.000
3.000
2.000
2.000
2.000
2.000
2.000
2.000
2.000
2.000
2.000
2.000
6.000
6.000
b.OOO
6.000
6.000
6.000
b.OOO
b.OOO
4.000
6.000
6.000
4.000
4.000
4.000
4.000
4.000
4.000
4.000
Criterion Criterion
1
2 3
1
0
0
0
0
0
0
0
0
0
0
0
0
0
Q
0
0
0
0
0
0
0
0
1
1
I
a
1
1
I
1
I
I
I
I
1
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
I
I
I
1
I
1
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
a 1
1 0
a 0
1 0
a a
1
•
1
1
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
P = T(2)
0
0
0
a
a
I
1
0
I
0
I
0
I
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
2 3 1
2
•
•a • •a •a
a
a
• a
• a a•
1
1
1
I
1
1
a
1
I
I
1
I
I
I
1
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
1
1
0
1
1
1
0
0
0
0
I
0
I
0
I
0
I
0
0
0
0
0
0
0
0
0
1
I
0
0
0
0
0
0
0
I
1
1
1
1
1
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
I
1
1
1
1
a
1
•
I
1
I
I
1
3
0
0
0
0
0
0
0
0
0
0
1
1
a
I
I
I
I
1
1
I
I
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
1
0
0
0
I
I
0
0
0
0
0
0
1
1
I
I
I
T
0
T
A
l
4
5
5
5
5
5
5
5
5
5
5
5
6
6
6
6
6
6
6
6
0
0
0
0
0
0
0
0
I
I
1
I
I
I
I
1
I
I
......
eN
0
•
'e'
e
•
e
·e·
Table A2.l
(Continued)
fi(~; ~~)
Ok
0
0
E
F
E
S
First Period
Treatment Effects
6
to
6
to
6
6
6
6
1
1
1
1
1
1
1
1
C
I
6
6
1
1
1
1
6
6
6
0
6
6
6
0
6
6
0
6
(;
6
6
b
6
t.
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
C;l
1
1
6
6
I
6
C
6
0
6
6
1
1
1
1
1
1
1
3(E)
2.1
31
32
4.000
4.000
4.000
4.000
4.000
4.000
4.000
5.601
5.661
5.661
4.661
4.061
5.661
5.661
5.667
4.661
4.007
4.661
4.601
4.667
4.661
4.333
4.333
4.333
4.840
4.840
4.840
3.535
3.535
4.840
4.840
4.840
3.535
3.53S
3.535
3.535
3.535
3.535
2.
12
33
34
35
48
50
68
70
12
74
78
19
20
21
24
31
43
41
49
53
54
55
61
61
69
P
P = >-
= T(2)
~-
T
0
4.000
4.000
4.000
4.000
4.000
4.000
4.000
4.000
4.000
4.000
4.000 4.~3
4.000 4.661
4.000 4.333
4.000 4.667
4.000 4.b61
4.000 4.333
4.000 4.661
4.000 4.333
4.000 4.333
4.000 4.333
3.000
3.000
3.000
3.000
3.53S
3.000
3.535
3.535
3.000
3.535
3.000
3.000
3.000
3.000 4.000 3.000
3.000
3.000
4.000
4.000
4.000
•• 000
4.000
3.000
Criterion
Criterion Criterion
A
L
"2(A)
11
~
T
1(0)
52
62
65
66
16
17
1
p = T(l)
Criterion
Criterion
(d)
~I
Second Period
Treatment Effects
Carryover Effects
Criterion
(k)
OI(d.i .p)
4.000 3.000
4.000 3.000
4.3~3 3.000
4.333 3.000
4.3J3 3.000
4.333 ~.OOO
4.333 3.000
•• 000 3.000
4.000 4.J33 3.000
4.000 •• 333 3.000
1(0)
6.000
6.000
2(A)
7.000
7.000
0.000 10.000
b.OOO
5.500
8.000
8.000
8.000 10.000
6.000
7.000
6.000
7.000
8.000 8.000
6.000
5.500
6.000 5.500
6.000 5.500
6.000
5.500
6.000 5.500
6.000
5.500
8.000
6.000
6.000 5.500
6.000
5.500
6.000 5.500
8.000 6.000
6.000
5.500
6.000 5.500
6.000
5.500
6.000 5.500
6.000
5.50e
6.000
5.500
0.000 6.000
6.000 1.000
6.000
1.000
).ooe
6.000
0.000
5.500
8.000 6.000
8.000 6.000
6.000 5.500
6.000 5.50C
6.000
1.000
6.000
5.500
6.000 5.500
3(E)
6.000
6.000
10.12.3
4.000
6.828
10.123
6.000
c.ooo
6.828
4.000
4.000
4.000
4.000
4.000
4.000
4.000
4.000
4.000
4.000
4.000
4.000
4.000
4.000
4.000
4. 000
4.000
4.000
1l.000
6.000
~. oeo
4.000
4.000
4.00e
4.000
4.000
(0.000
4.000
4.000
1(0)
2(A)
6.000 5.500
6.000 5.500
6.000 5.500
6.000 7.000
6.000 5.500
6.COO 5.500
6.000 5.500
6.000 5.500
6.000 5.500
6.000 7.000
6.000 5.500
6.000 5.500
6.000 5.500
6.000 5.500
6. 000 7.000
6.000
1.000
6.000 1.000
6.000 7.000
6.000 5.500
6.000 7.000
6.000 5.500
6.000 5.500
6.000 1.000
6.000 5.500
6. 000 5.500
6.000 5.500
6.000 5.500
8.000 8.000
0.000 10.000
8.000 10.000
6.000 5.500
6.000 5.500
6.000 5.500
6.000 5.500
6.000 5.500
8.000 8.000
6.000 5.500
6.000 5.500
3(E)
4.000
4.000
4.000
6.000
4.000
4.000
4.000
4.000
4.000
6.000
4.000
4.000
4.000"
4.000
6.000
6.000
6.000
6.000
4.000
6.000
4.000
... 000
6.000
4.000
4.000
4.000
".000
6.828
9.123
9.123
4.000
4.000
4.000
4.000
4.000
6.828
4.000
4.000
1
2
3
1
2
3
1
2
3
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
1
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
I
I
I
I
I
1
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
I
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
1
0
0
0
0
0
1
1
1
1
1
1
1
1
1
1
1
1
0
0
0
1
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
1
0
0
0
0
0
1
a
0
0
1
0
0
0
0
0
I
0
0
0
0
1
1
1
1
0
1
0
0
1
0
1
1
1
I
1
1
I
1
1
1
1
I
I
1
I
1
1
1
1
1
0
0
0
1
1
1
1
1
0
I
1
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
1
0
1
1
1
1
1
0
1
1
1
1
0
0
0
0
1
0
1
1
0
1
1
1
1
0
0
0
1
1
1
1
1
0
1
1
1
1
1
1
1
1
1
2
2.
2.
2
2
2.
2.
2.
.2
2.
2.
2
2
2.
3
3
3
3
:3
3
3
3
:3
.1
3
3
3
3
--'
eN
--'
Table A2.l
(Continued)
fi(~; ~~)
ok
°EF
t;.
6
6
6
C>
t.
6
0
6
6
6
6
6
t;.
6
6
6
6
6
•1
1
•
1
&
&
1
&
&
1
1
1
I
1
1
1
&
I
6
1
&
&
2
2
2
0
O!
6
6
6
{,
6
6
(>
6
6
6
0
6
6
E
2
2
2
2
2
2
2
2
2
2
2
2
First Period
Treatment Effects
Second Period
Treatment Effects
Carryover Effects
P = .\
P .. T(l)
S
Criterion
(d)
(k)
6
6
6
6
0
OI(d.i.p)
13
75
22
25
26
36
39
.0
....58
60
t:.4
23
30
50
63
20
29
38
42
57
59
49
52
53
02
09
70!
75
18
2&
32
34
45
47
48
50
51
1(0)
2(A)
4.000
4.000
3.000
3.000
4.333
•• 333
4.000
4.000
4.000
~.ooo
3.000
3.000
3.000
J.OOO
3.000
3.00~
3.000
3.000
3.000
3.000
3.000
3.000
3.000
3.000
3.000
3.000
3.000
1.000
1.000
1.000
&.000
1.000
1.000
&.000
1.000
1.000
1.000
1.000
1.000
1.000
1.000
1.000
1.000
~.OOO
4.000
4.000
4.000
4.000
4.000
4.000
4.GOO
4.000
4.000
4.000
4.000
4.000
4.000
4.000
4.000
4.000
2.833
2.833
2.333
2.333
2.833
2.833
2.833
2.633
2.333
2.333
2.333
2.333
2.633
2.833
2.833
2.833
Criterion
Criterion
3(E)
1(0)
3.000 6.000
3.000 6.000
3.000 6.000
3.000 c..OOO
3.uOO 6.000
3.000 6.000
3.000 6.000
3.000 6.000
3.000 6.000
3.000 6.000
3.000 6.000
3.000 6.000
3.000 6.000
3.000 6.000
3.000 6.000
3.000 6.000
3.000 5.333
3.000 5.333
3.000
5.333
3.000 5.333
3.000 5.333
3.000 5.333'
2.420
2.000
2.420 2.000
1.768 2.000
1.166 2.000
2.420
1.500
2.420
1.500
2.420
1.500
2.420
&.soo
&.168 2.000
2.000
&.768
1.7C.8 2.000
1.768 2.000
2.420
&.500
2.420
1.500
2.420
&.500
2.420, 1.500
2(A)
3(E)
6.000
5.500
5.500
5.500
7.000
5.500
5.500
5.500
5.500
7.000
5.50C
5.S00
5.S00
5.50C
5.500
5.500
5.333
5.333
5.333
5.333
5.333
5.333
5.000
5.000
4.000
".000
4.000
4.000
4.000
4.000
6.000
4.000
4.000
4.000
4.000
6.000
4.000
4.000
4.000
4.000
4.000
4.000
4.000
4.000
4.000
4.000
4.000
3.5~0
3.500
3.500
3.500
4.000
4.000
4.GOO
4.000
3.500
3.500
3.500
3.500
1(D)
4.~00
4.5062
4.562
3.414
3.4& ..
3.000
3.000
3.000
J.OOO
3.414
3."14
3.41 ..
3.4&4
3.000
J.OOO
3.000
3.000
6.000
6.000
8.000
8.000
8.000
8.000
8.000
a.ooo
8.000
1i.000
8.000
8.000
a.ooo
8.COO
8.000
8.000
5.333
5.333
5.333
5.333
5.333
5.333
1.500
1.500
&.500
1.500
1.500
1.500
1.500
1.500
1. SOO
1.500
1.500
1.500
1.500
1.500
1.500
&.500
2(A)
5.500
5.500
8.000
&0.000
6.000
Ii. 000
&0.000
&0.000
8.000
6.000
10.000
8.000
6.000
6.000
6.000
6.000
5.333
5.333
5.333
5.333
5.333
5.333
3.500
3.500
3.500
3.500
3.500
3.500
3.500
3.500
2.150
2.750
2.750
2.750
2.750
2.750
2.750
2.750
Criterion
3(E)
4.000
4.000
6.828
9.123
4.000
6.828
9.&23
9.123
6.828
4.000
9.123
6.828
4.000
4.000
4.000
4.000
4.000
4.000
4.000
4.000
4.000
4.000
3.000
3.000
3.000
3.000
3.000
3.000
3.000
3.000
2.000
2.000
2.000
2.000
2.000
2.000
2.000
2.000
P .. T(2)
-
Criterion Criterion
2 3
1
2 3
1
2
3
0
0
&
0
0
&
0
0
0
&
&
0
0
0
0
0
0
0
0
0
0
0
0
0
&
&
0
0
&
&
&
&
0
0
0
0
0
I
I
&
I
I
I
•
I
I
I
I
I
I
&
1
&
&
1
1
I
1
1
I
I
1
I
I
I
I
I
I
I
I
&
I
I
I
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
1
&
1
1
I
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
I
&
1
&
I
1
&
I
I
1
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
a
0
a a
a 0
0
0
a a
0
0
0
0
0
0
a
1
1
&
1
1
1
0
a
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
a
0
a
&
&
&
I
&
&
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
&
I
&
&
0
&
&
I
I
0
1
I
1
1
1
1
1
&
1
&
1
I
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
T
A
L
1
&
&
T
0
a
0
0
0
0
0
0
0
0
0
a
I
1
1
&
I
I
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
a
a
0
0
0
0
0
0
I
I
1
I
1
I
a
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
I
0
0
0
0
1
0
0
&
I
1
I
I
1
1
I
I
I
0
0
0
0
0
0
0
0
I
I
I
;J
..
.
..
3
4
4
4
4
4
4
5
5
5
5
9
9
9
9
9
9
0
0
0
0
0
0
0
0
1
&
I
I
I
I
I
I
&
&.
•
I
.....
1
W
N
•
e·
e
•
e
,e·
Table A2.l
(Continued)
OI(d,i,p)
fi(~; ~~)
Ok
°EF
(k)
6
6
Q
0
6
6
6
~
"66
6
6
C)
CI
6
6
L
6
b
6
6
6
0
0
b
6
6
0
6
6
6
4>
6
6
to
6
6
2
2
2
~
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
0
E
S
First Period
Treatment Effects
Criterion
(d)
1(0)
54
55
65
«>0
67
60
70
71
73
7.
76
a.ooo
1.000
1.000
a.ooo
1.000
1.000
1.000
1.000
I.UOO
1.000
1.000
1.000
1.000
1.000
1.000
1.000
1.000
1.000
1.000
1.000
1.000
1.000
1.000
1.000
1.000
1.000
1.000
1.000
1.000
1.000
1.000
1.000
1.000
1.000
1.000
1.000
1.000
1.000
17
9
IU
It
12
15
16
Ie;,
20
27
31
33
35
41
40
I
2
3
"
5
to
7
d
13
14
16
17
'2(A)
2.3~~
2.~~~
2.333
2.333
2.8..13
2.1333
2.833
2.833
2.633
2.833
2.833
2.833
2.167
2.167
2.167
2.167
2.lb7
2.161
2.333
2.333
2.333
2.333
2.333
2.333
2.333
2.333
2.167
2.167
2.1lo1
2.107
2.167
2.161
2.161
2.167
2.a~1
2.101
2.161
2.161
Second Period
Treatment Effects
Carryover Effects
a.7u6
1.7bO
1.768
1.768
2.420
2.420
2.420
2.420
2.420
2.420
2.420
2.420
1.500
1.500
1.500
1.500
1.500
1.500
1.768
1.768
1.768
1.768
1.7C)8
1.768
1.768
1.768
1.500
1.500
1.500
1.500
1.500
1.500
1.500
1.500
1.500
1.500
1.500
1.~00
1(0)
1.500
1.500
a.500
a.500
1.500
2.000
a. tWO
2.000
2.000
1.500
2.000
1.500
2.000
2.000
1.500
a.500
1.500
1.500
1.500
1.500
1.500
1.500
1.500
1.500
1.500
1.500
1.500
1.500
2.000
1.500
2.000
1.500
1.500
1.500
1.500
2.000
2.000
1.500
2(A)
2.750
2.750
2.750
2.750
3.500
5.000
3.500
5.000
5.000
3.500
5.000
3.500
3.000
3.000
2.750
2.750
2.750
2.750
2.75C
2.750
2.750
2.750
2.750
2~750
2.7:)0
2.750
2.750
2.750
3.000
2.750
3.000
2.150
2.750
2.150
2.750
3.000
3.000
2.750
3(E)
2.000
2.000
2.000
2.QOO
3.000
4.562
3.000
" .5«>2
4.562
3.000
4.562
3.000
2.000
2.000
2.000
2.000
2.000
2.000
2.000
2.000
2.000
2.000
2.000
... 000
2.000
2.000
2.000
2.000
2.000
2.000
2.000
2.000
2.000
"'.000
2.000
2.000
2.000
2.000
1(0)
a.500
1.500
a.500
1.500
1.500
1.500
1.500
1.500
a.500
1.500
1.500
1.500
1.500
1.500
1.500
1.500
1.500
1.500
1.500
1.500
1.500
1.500
1.500
1.500
1.500
1.500
1.500
1.500
1.500
1.500
1.500
1.500
1.500
1.500
1.500
1.500
1.500
1.500
2(A)
3.500
3.500
3.500
3.500
2.750
2.750
2.750
2.750
2.750
2.750
2.750
2.750
3.500
3.500
3.500
3.500
3.500
3.500
2.750
2.750
2.750
2.750
2."t50
2.750
2.750
2.750
2.750
2.750
2.750
2.750
2.150
2.750
2.150
2.150
2.750
2.750
2.750
2.750
= T(O
p
Criterion
Criterion
Criterion
3(E)
p
=A
1
2
3
1
2
3.000
3.000
3.000
3.000
2.000
2.000
2.000
2.000
2.000
2.000
2.000
2.000
3.000
3.000
3.000
3.000
3.000
3.000
2.000
2.000
2.000
2.000
2.000
2.000
2.000
2.000
2.000
2.000
2.000
2.000
2.000
2.000
2.000
2.000
2.000
2.000
2.000
2.000
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
a
I
1
1
1
1
1
0
0
0
0
0
0
0
0
1
1
I
I
I
1
1
I
I
1
I
1
T
= T(2)
-
0
Criterion Criterion
3(E)
0
0
P
0
0
0
0
0
0
0
0
0
0
0
0
3
1
2
3
a
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
I
1
I
0
0
0
0
0
0
0
0
I
1
I
I
I
1
I
1
1
1
I
I
1
I
I
1
I
1
1
1
1
1
1
1
1
1
I
I
T
A
L
I
I
1
I
a
I
1
1
1
1
1
I
1
1
1
2
2
2
2
2
2
2
2
2
2
2
2
I
I
0
0
0
0
0
0
1
1
1
I
1
I
I
I
1
2
I
I
;)
;)
;)
1
I
I
I
I
I
1
i
I
1
2
3
3
;)
3
;)
;)
;)
3
3
~
w
w
Table A2.l
(Continued)
f (X; C )
l ~ ~~
ok
0
0
E
F
E
Fl rst Period
Treatment Effects
Carryover Effects
S
Criterion
(k)
0
6
b
6
6
G
C
6
co
6
G
6
C.
6
6
6
co
6
t.
6
"
b
6
6
c.
C
6
b
6
b
G
6
6
6
6
b
6
6
(d)
.2
2
2
2
2
2
'l
2
2
2
2
2
2
2
.2
2
2
.2
2
2
2
2
2
2
3
3
3
.3
.3
::s
30
4.
56
coO
23
25
28
36
40
43
58
61
63
64
22
24
37
39
26
29
38
.. ~
57
59
6
9
I"
15
11
lU
3
J
3
41
45
4t-
:J
.3
3
.3
.3
46
49
51
52
62
1(0)
2(A)
OI(d.l.p)
Second Period
Treatment Effects
0.7~0 z.ooo 1.500
0.7~0 ~.OO~ 1.500
0.150 2.000 1.500
0.7~0 2.000 1.500
0.150 2.000 1.500
0.750 Z.OOO 1.500
0.750 2.000 1.500
0.750 2 .. 000 1.500
0.750 2.000 1.500
0.750 2.000 1.500
0.750 2.000 1.500
0.750 2.000 1.500
0.750 2.000 1.500
0.750 2.000 1.500
0.150 2.000 1.500
0.7~0 2.000 1.500
0.150 2.000 1.500
0.750 2.000 1.500
0.750 2.000 1.500
0.750 Z.OOO 1.500
0.150 2.000 1.500
0.750 2.000 1.500
O. 750 2. 00 0 1. foOO
0.750 2.000 1.500
0.111 0.852 0.691
0.111 O. f52 0.691
O.lll 0.852 0.691
0.111 0.852 0.691
0.111 0.f52 0.691
0.111 0.852 0.691
0.111 O. SO 1 o. 7bl
0.111 0.9010.761
0.111 0.901 0.7c.l
0.111 0.£:52 0.691
0.111 0."52 0.691
o. I I I O.SOl 0.161
0.1110.9010.761
0.111 0.907 0.761
1(0)
1.500
1.~OO
1.500
1.500
1.500
1.500
1.500
1.500
1.500
1.500
1.500
1.500
l.foOO
1.&00
1.~00
1.500
1.500
1.500
1.333
1.333
1.333
1. oJ33
1.333
1.333
0.167
0.222
0.222
0.167
0.161
0.161
0.167
0.222
0.167
0.167
0.222
0.161
0.222
0.222
~
P .. T(2)
~-
,
T
0
T
Criterion
Criterion
Crlterion
3(£)
P .. ).
p = TO)
2(A)
3(E)
3.500
3.500
.3.500
3.500
2.750
3.500
2.750
3.500
2.750
2.750
2.750
2.750
2.750
2.150
2.150
2.750
2.750
2.150
2.061
2.c.61
2.661
2.661
2.667
2.667
1.083
1.333
1.333
1.083
1.083
1.083
1.063
l.to61
1.083
1.083
1.333
1.083
1.661
1.001
3.000
.1.000
3.000
3.000
2.000
3.000
2.000
3.000
2.000
c.OOO
2.000
2.000
2.000
2.000
c.ooo
2.000
2.000
2.000
2.000
2.000
2.000
2.000
2.000
2.000
0.8~8
1.138
1.138
0.8S8
0.898
G.8~e
0 ...9 ..
1.521
0.898
'.898
1.138
0.8~8
1.521
1.521
1(0)
2.000
2.000
2.000
2.000
2.000
2.000
2.000
2.000
2.000
2.000
2.000
2.000
2.000
2.000
2.000
2.000
2.000
2.000
1.333
1.333
1.333
1.333
1.3';'3
1.333
0.167
0.167
0.167
0.167
0.161
0.167
0.167
0.167
0.167
0.167
0.167
0.167
0. 161
0.161
2(A)
5.000
5.000
4.000
4.000
4.000
3.000
4.000
3.000
4.000
4.000
5.000
~.OOO
5.000
5.000
3.000
3.000
3.000
3.000
2.661
2.661
2.661
2.667
2.667
2.667
1.083
1.083
1.083
1.083
1.083
1.083
1.083
1.083
1.083
1.083
1.083
1.083
1.083
1.083
3(E)
4.562
4.562
3.414
3.414
3.414
2.000
3.414
2.000
3.414
3.414
4.562
... 562
4.562
4.562
2.000
2.000
2.000
2.000
2.000
2.000
2.000
2.000
2.000
2.000
0.898
0 ...98
0.898
0.898
0.898
0.898
0.898
0.898
0.8ge
0."98
0.e98
0.898
0.898
0.a98
Criterion Criterion
1
2 3
1
2 3 1
2
3
I
I
I
I
I
I
I
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
1
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
I
I
I
I
I
I
I
1
1
I
1
1
I
I
I
1
I
I
I
I
1
I
I
I
I
I
I
I
I
1
I
1
0
0
0
0
0
0
0
0
0
0
0
0
0
0
1
1
1
I
I
I
I
1
I
I
I
I
I
I
I
I
I
I
I
I
I
I
1
I
I
I
1
I
I
I
I
I
I
I
I
1
I
I
I
I
I
I
I
I
I
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
1
I
I
I
0
0
0
1
1
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
1
0
1
0
I
I
I
I
I
I
I
1
I
I
I
I
1
1
1
I
0
0
0
0
0
0
0
0
0
0
0
0
0
0
1
I
I
0
0
0
0
0
0
0
0
0
0
0
0
0
0
1
I
0
0
0
0
0
0
0
0
0
0
0
0
0
0
I
0
I
0
0
0
0
0
0
1
I
1
I
I
I
I
I
I
I
0
0
0
0
0
0
0
0
0
0
0
0
0
0
A
l
3
3
3
3
4
4
4
4
4
4
4
..
4
4
5
5
5
5
9
9
9
9
9
9
0
0
0
0
0
0
0
0
0
0
0
0
0
0
-I
W
~
•
'e'
e
•
e
·e·
Table A2.l
(Continued)
OI(d.i .p)
fi(~; ~~)
Ok
0
0
E
F
E
(k)
6
t
0
Co
6
6
0
to
b
6
6
6
6
t:.
6
6
b
0
6
6
6
0
6
0
6
6
0
b
0
6
6
6
6
6
6
t:
0
6
3
3
3
..l
,]
3
..l
3
3
.:
3
3
3
..l
3
.1
.1
3
3
.)
;'j
3
3
3
3
3
3
3
.]
.]
3
.J
3
3
.3
3
.3
3
First Period
Treatment Effects
S
Carryover Effects
Criterion
(d)
1(0)
65
c6
68
69
11
72
H
7':>
77
7a
0.111
o. III
U.l11
0.111
0.111
0.111
o. III
0.111
0.111
c. III
0.111
O. III
0.111
0.111
0.111
0.111
0.111
0.083
0.083
0.111
0.083
~
10
34
53
7
U
16
2.
25
27
28
.]0
31
32
.36
37
43
4.
41
50
5i.
~6
60
61
67
70
73
70
2(A)
Criterion
3(E)
0.907 0.761
o. SO 1 0.761
0.8~2
0.852
C.S07
0.907
0.1:52
0.852
0.907
0.901
0.665
0.665
G.t85
0.b85
0.852
0.852
0.f52
0.~7
0.667
0.901
0.667
o.oa~ 0.t07
0.111 0.907
o. III 0.907
0.08~ 0.667
0.6~1
0.691
U.761
0.7t.l
0.091
0.691
0.701
0.761
0.422
0 ••22
0 •• 22
0.422
0.691
0.691
0.691
0.500
0.500
0.70a
0.500
0.500
0.761
0.761
0.5UO
0.083 0.bb7 0.500
U.U63
0.083
o. III
0.111
0.083
0.063
0.083
0.083
0.111
0.111
0.111
0.111
0.667
0.007
0.852
0.901
0.007
0.~b7
0.667
0.661
0.852
0.907
0.f52
0.907
-
Second Period
Treatment Effects
0.~00
0.500
0.691
0.101
0.500
0.500
0.500
0.500
0.691
0.761
0.0 .. 1
0.761
1(0)
2(A)
0.167
1.0113
0.167
a.Od']
0.222
1.333
0.167
1.083
1.667
0.222
0.167
1.083
0.167
1.0iU
0.167
1.083
0.107
1.083
0.167
1.083
0.222 1.000
0.222
1.000
0.222
1.000
0.222
1.000
0.167
1.083
0.107
1.083
0.222 "1.333
0.167
1.083
0.167 1.083
0.167 1.083
0.107
1.083
0.167 1.083
0.167
1.083
1.607
0.222
0.167
1.083
0.107 1.063
0.107 1.083
0.107
1.083
0.107 1.08.]
0.167
1.083
0.167
1.01U
0.167
1.083
0.167
1.083
0.107 1.08.3
O.ltll
1.083
0.167
1.083
0.222
1.333
0.222
1.667
(;.IIS8
0.a~8
1.138
0.898
1.521
c. &c; 8
0.898
0.698
0.8S8
C.896
C.b67
0.667
0.667
0.667
C.898
0.898
1.138
C.8S8
0.898
0.8S8
C.898
0.898
0.8S8
1.521
C.8S8
0.698
0.8<;;8
0.8 .. 8
0.698
0.8.. 8
0.898
0.898
C.8S8
0.898
0.8S8
0.698
1.138
1.521
1(0)
0.167
0.167
0.167
0.167
0.167
0.167
0.167
o. 167
0.167
0.167
0.167
0.167
0.167
0.167
0.167
0.167
0.167
0.222
0.222
0.167
0.222
0.222
0.167
0.167
0.222
0.222
0.222
0.222
0.167
0.167
0.222
0.222
0.222
0.222
0.167
0.167
0.167
0.161
2(A)
1.083
1.083
1.083
1.083
1.083
1.083
1.083
1.083
1.083
1.083
1.083
1.083
1.083
1.083
0.833
0.833
0.833
1.0CO
1.33.3
0.833
1.000
1.333
0.833
0.833
1.000
1.333
1.667
1.667
0.833
0.833
1.000
1.333
1.667
1.667
0.833
0.833
0.833
0.833
P = t(2)
P = >.
Criterion
Criterion
3(E)
= t(1)
p
-
Criterion Criterion
3(E)
1
2 3
1
2 3
1
2
3
0.898
0.898
0.898
0.898
0.898
0.898
0.898
0.898
0.898
0.898
0.898
0.898
0.896
0.898
0.500
0.500
0.500
0.667
1.138
0.500
0.667
1.138
0.500
0.500
0.667
1.138
1.521
1.521
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
1
1
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
1
a
0
I
1
0
0
1
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
I
1
I
0
0
1
0
0
1
1
0
0
0
0
O.~OO
O.SOO
0.667
1.138
1.521
1.521
0.500
0.500
0.500
0.500
I
1
0
0
1
1
I
1
0
0
1
I
1
1
0
0
0
0
I
I
1
0
0
1
1
I
I
0
0
0
0
0
0
0
0
0
0
0
0
0
0
I
1
1
I
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
1
1
1
0
0
1
0
0
1
1
0
0
0
0
I
1
0
0
0
0
1
I
••
I
I
0
0
0
0
I
I
1
I"
T
0
T
A
L
0
0
0
0
0
0
0
0
0
0
1
1
1
I
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
2
--'
w
<.n
•
e
·e·
Table A2.l
(Continued)
fi(~' ~~)
Ok
0
0
E
F
E
S
(k)
(>
6
c
6
6
6
6
6
6
6
6
6
t
6
tI
6
6
tI
6
b
6
0
6
6
6
t-
6
6
6
b
6
6
6
6
{;
6
6
6
..
4
"44
4
4
4
4
4
4
...4
.-4
....
..
.
4
4
4
4
4
"44
4
4
"
•"
4
4
4
4
First Period
Treatment Effects
1(0)
47
46
50
51
54
55
65
1.000
1.000
1.000
1.000
1.000
1.000
1.000
1.000
1.000
1.000
1.000
1.000
1.000
1.000
1.000
1.000
1.000
1.000
1.000
1.000
1.000
1.000
1.000
1.000
1.000
1.000
1.000
1.000
1.000
1.000
1.000
1.000
1.000
1.000
1.000
1.000
1.000
1.000
66
67
68
70
11
13
14
16
17
~
10
11
U
IS
16
19
20
27
31
33
35
41
46
1
2
3
4
5
6
7
8
Criterion
2(A)
3(E)
2.e~3
2.420
2.420
2.420
2.420
1.708
1.768
1.768
1.708
2.420
2.420
2.420
2.420
2.420
2.420
2.420
2.420
1.500
1.500
1.500
1.500
1.500
1.500
1.16a
1.768
1.708
1.768
1.768
1.168
1.768
1.768
1.500
2.833
2.833
2.83.3
2.333
2.333
2.333
2.333
2.833
2.83~
2.833
2.833
2.833
2.833
2.833
2.tJ3
2.1bl
2.167
2.167
2.107
2.167
2.167
2.333
2.333
2.333
2.333
2.333
2.333
2.333
2.333
2.167
2.167
I.~OO
1.500
2.167 1.500
2.167 1.500
2.167 1.500
2.107 I.~OO
2.167 1.500
2.1~7
Second Period
Treatment Effects
Carryover Effects
Cri terion
(d)
OI(d.i.p)
1(0)
1.500
1.500
1.500
1.500
1.500
1.500
1.500
1.500
1.500
2.000
1.500
2.000
2.000
1.500
2.000
1.500
2.000
2.000
1.500
1.500
1.500
1.500
1.500
1.500
1.500
1.500
1.500
1.500
1.500
1.500
1.500
1.500
2.000
1.500
2.000
1.500
l.bOO
1.500
2(A)
3.500
.3.500
3.500
3.500
2.750
2.750
2.750
2.750
3.500
5.000
3.:>00
5.000
5.000
3.50C
~.ooo
3.500
.1.000
3.000
2.750
2.750
2.7tiO
2.750
2.750
2.750
2.750
2.750
2.750
2.750
2.750
2.750
2.750
2.750
3.000
2.750
3.000
2.750
2.750
2.150
p =
~.\l00
3.000
3.000
3. 000
2.000
2.000
.0:.000
2.000
3.000
4.562
3.000
4.562
4.562
3.0ClO
•• 662
3.000
.0:.000
2.000
2.000
2.000
2.000
2.0GO
2.000
2.000
2.aoo
2.000
2.000
2.000
2.000
2.000
2.000
2.000
2.000
2.000
2.0UO
2.000
2.UOO
2.000
1(0)
1.500
1.500
1.500
1.500
1.500
1.500
1.500
1.500
1.500
1.500
1.500
1.500
1.500
1.500
1.500
1.500
1.500
1.500
1.500
1.500
1.500
1.500
1.500
1.500
1.500
1.500
1.500
1.500
1.500
1.500
1.500
1.500
1.500
1.500
1.500
1.500
1.500
1.500
P=
Criterion
Criterion
3(E)
T(l)
2(A)
3(E)
2.750
2.750
2.750
2.750
3.500
3.500
3.500
3.500
2.750
2.750
2.750
2.750
2.750
2.750
2.750
2.750
3.500
3.500
3.500
3.500
3.500
3.500
2.750
2.750
2.750
2.750
2.750
2.750
2.750
2.750
2.750
2.750
2.750
2.750
2.750
2.750
2.750
2.750
2.000
2.000
2.000
2.000
3.000
3.000
3.000
3.000
2.000
2.000
2.000
2.000
2.000
2.000
2.000
2.000
3.000
3.000
3.000
3.000
3.000
3.000
2.000
2.000
2.000
2.000
2.000
2.000
2.000
2.000
2.000
2.000
2.000
2.000
2.000
2.000
2.000
.!.ooo
2 3
1
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
1
1
I
1
1
I
0
0
0
0
0
0
0
0
0
1
1
1
1
1
0
1
1
0
0
I
-
Criterion Criteri on
1
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
P " T(2)
>.
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
T
0
T
A
l
2 3
1
2
3
0
0
0
0
1
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
I
I
I
I
0
1
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
I
I
1
0
0
0
0
0
0
0
0
1
1
1
I
1
I
1
1
I
I
I
1
1
1
I
1
1
I
1
1
1
I
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
1
1
0
0
0
I
I
1
I
1
1
I
1
0
0
0
0
0
0
1
1
I
1
1
1
1
1
1
I
1
1
1
1
1
1
1
1
I
I
1
1
I
1
I
I
1
I
1
2
2
2
2
2
2
2
2
2
2
2
2
2
2
3
3
3
3
3
3
3
3
--'
W
"'-J
Table A2.l
(Continued)
OI(d,i,p)
fi(~· ~~)
Ok
0
0
E
E
S
f
(k)
c
C
6
c
c
0
(>
6
6
c
()
6
6
c)
0
0
0
()
0
6
()
6
()
6
6
e
c
6
7
7
7
7
7
1
7
7
7
7
•4
1(0)
2(A)
13
1.000
1.000
1.000
1.000
0.750
2.107
2.167
2.167
2.167
2.000
2.000
2.000
2.000
2.COO
2.000
2.000
2.000
2.000
2.000
2.000
2.000
2.000
2.000
2.000
2.000
2.000
2.000
2.000
2.000
2.000
2.000
2.000
2.000
4.000
4.000
4.000
14
Ie:.
17
"
4
"
••
"
4
4
4
4
"
4
"4
"4
""1
1
1
1
1
1
1
a
1
1
25
28
30
40
"3
5d
cl
6::1
64
.22
2.
31
39
26
29
3d
42
57
59
1
2
3
5
7
9
10
12
14
15
Second Period
Treatment Effects
Carryover Effects
Criterion
(d)
""4 30
4
".
56
4"
60
4
23
4
First Period
Treatment Effects
Criterion
Criterion
3(E)
1.5UO
1.500
1.500
1.500
1.500
O.7~O
1.500
0.150
1.500
0.750
1.500
0.750
1.500
0.750
1.500
0.750
1.500
0.7ftO
1.500
0.750
1.500
0.75u
1.500
0.750
1.500
0.150
l.bOO
u.750
1.500
0.750
1.500
0.750
1.500
0.750
1.500
0.750
1.500
0.750
1.500
0.750
1.500
0.750
1.500
0.750
1.500
0.750
1.500
0.750
1.500
0.750
1.500
3.111
2.91t::l
3.111
2.943
3.11a
2.943
2.333 3.~to7 2.847
2.333 3.067 2.647
2.333 3.6t.7 2.841
3.11a 5 • .333 1t.661
2.33.3 3.667 2.~.7
~.lla ~.333 4.667
3.111 5.333 •• 667
1(0)
2(A)
3(E)
1.500
2.000
2.000
1.500
1.500
1.500
1.500
1.f.00
1.500
1.500
1.500
1.500
1.500
1.500
1.500
2.750
3.000
3.000
2.7ftO
3.500
3.500
3.500
3.ftOO
2.750
3.500
2.150
3.500
2.150
2.750
2.150
2.750
2.750
2.750
2.750
2.750
2.750
2.750
2.667
2.667
2.661
2.661
2.667
2.to07
It. 661
".to61.
4.667
4.533
4.533
4.533
6.667
4.533
6.667
6.607
2.000
2.000
2.000
2.000
3.000
3.000
3.000
:i.000
2.000
3.000
2.000
3.000
2.000
2.000
2.000
2.000
2.000
2.000
2.000
1.~00
1.500
1.~00
1.500
1.500
1.500
1.500
1.333
1.333
1.333
a.333
a.333
1.333
4.000
4.000
4.000
3.200
3.200
3.200
4.000
3.200
4.000
4.000
:i.obo
2.000
2.000
2.000
2.000
:i.000
2.000
:i.000
2.000
3.535
3.535
3.535
3.659
3.659
3.659
6.000
3.659
6.000
6.000
1(0)
I.~OO
1.500
1.500
1.500
2.000
2.000
2.000
2.000
2.000
2.000
2.000
2.000
2.000
2.000
2.000
2.000
2.000
2.000
2.000
2.000
2.000
2.000
1.333
1.333
'.333
1.333
1.333
a.333
~.OOO
3.000
3.000
3.200
3.200
3.200
3.000
3.200
3.000
3.000
P .. >.
P .. T(l)
-
Criterion
P .. T(2)
-
Criterion Criterion
2(A)
3(E)
1
2 3
1
2 3 1
2
3
2.750
2.150
2.750
2.750
5.000
5.000
4.000
4.000
4.000
3.000
4.000
3.000
4.000
4.000
5.000
5.000
5.000
5.000
3.000
3.000
3.000
3.000
2.667
2.661
2.067
2.661
2.667
2.too7
4.000
4.000
4.000
•• 533
4.533
4.53,)
4.000
•• 533
4.000
4.000
2.000
2.000
2.000
2.000
4.562
4.562
3.414
3.414
3.414
2.000
3.414
2.000
3.414
3.4.4
4.562
4.562
4.562
4.5t.2
2.000
2.000
2.000
2.000
2.000
2.000
2.000
2.000
2.000
2.000
3.000
3.000
3.000
3.659
3.659
3.659
3.000
3.659
3.000
3.000
0
0
0
0
1
1
1
0
0
0
0
1
1
1
1
1
1
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
I
1
1
1
1
I
0
0
0
0
0
0
0
0
0
0
I
1
1
I
I
I
I
1
1
• •
• •
•
• •
• • •
•
1
1
1
1
1
1
I
1
1
1
1
I
1
1
a
a
1
0
0
0
a
1
1
0
a
0
0
1
1
I
I
1
1
1
I
1
1
1
1
1
1
0
0
0
0
0
0
0
0
0
0
I
I
1
1
1
1
1
1
1
1
1
I
1
1
1
1
I
1
1
0
0
0
0
0
0
0
0
0
0
•
1
a
I
1
1
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
I
1
1
a
1
a
0
0
0
0
0
0
0
0
0
0
I
1
1
I
0
0
0
0
I
0
1
0
1
I
1
1
1
1
1
I
1
1
I
1
1
a
a
1
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
a
0
0
0
0
0
0
0
I
1
a
1
1
1
1
I
1
0
0
0
a
0
I
a
•
0
0
0
0
0
I
0
I
0
0
0
0
0
0
1
I
•
1
1
a
I
a
I
I
a
0
0
0
0
0
0
0
0
0
T
0
T
A
l
.)
3
.)
3
3
.)
3
3
4
4
4
4
4
4
4
4
4
4
5
5
5
5
9
9
9
9
9
9
1
a
1
1
a
1
a
a
1
1
-.0
W
00
•
·e·
e
•
e
,e·
Table A2.l
(Continued)
fi(~; ~p)
ok
0
0
E
F
E
S
First Period
Treatment Effects
,,
,
7
7
7
7
7
7
7
7
7
7
7
7
7
7
7
7
7
7
7
7
7
7
7
7
7
7
7
1
7
1
7
7
7
1
7
7
2
2
2
2
2
2
2
2
2
10
14
15
18
21
24
27
7
2
29
.,
1
I
I
I
I
I
I
I
I
1
t
1
I
I
I
I
I
t
1
t
I
I
I
2
2
20
25
27
28
33
35
36
4
8
13
19
26
34
6
I I
21
32
16
23
31
17
22
24
30
18
29
I
2
3
2.8
1(0)
2(A)
Second Period .
Treatment Effects
Carryover Effects
Criterion
(d)
(k)
Ol(d.i.p)
·3(E)
2.333 3.667 2.847
2.333 3.667 2.847
2.333 3.667 2.e47
3.111 4.000 2.943
2.333 3.667 2.847
3.111 4.000 2.943
3.lt I 4.000 2.943
2.333 3.667 2.847
2.333 3.667 2.847
2.3333.6672.847
2.333 3.667 2.847
2.333 3.667 2.847
2.333 3.667 2.847
2.333 3.667 2.847
2.333 3.667 2.ft47
2.333 3.667 2.e47
2.333 3.667 2.A47
2.333 3.333 2.333
2.333 :'I.3~:'I 2.3~3
2.333 3.333 2.333
2.333 3.333 2.333
2.333 3.333 2.333
2.333 3.333 2.333
2.333 3.333 2.333
2.333 3.333 2.33:'1
2.333 3.333 2.333
0.778 2.000 1.471
0.178 2.000 1.411
0.778 2.000 1.471
0.118 2.000 1.471
0.778 2.000 1.471
0.7782.000 1.471
0.SA3 1.833 1.424
0.583 1.833 1.424
0.583 1.833 1.424
0.583 1.833 1.424
0.778 2.667 2.33J
0.583 1.833 1.424
1(0)
"1.200
3.200
3.200
4.000
3.200
4.000
4.000
3.000
3.000
3.000
3.000
3.000
3.000
3.200
3.200
3.200
3.200
3.000
3.000
3.000
3.200
3.200
3.200
3.200
3.200
3.200
1.000
1.000
1.000
1.000
1.000
1.000
0.800
0.800
0.800
o.eoo
1.000
0.800
2(A)
4.533
4.533
4.5:'13
4.667
4.533
4.667
4.667
4.000
4.000
4.000
4.000
4.000
4.000
4.533
4.533
4.533
4.533
4.000
4.000
4.000
3.733
3.733
3.733
3.733
3.733
3.7:'13
2.3:'13
2.333
2.333
2.333
2.33~
2.333
2.267
2.267
2.2ti7
2.2ti7
3.333
2.267
3(E)
1(0)
3.659
3.659
3.659
3.535
3.659
3.535
3.535
3.000
3.000
3.000
3.000
3.000
3.000
3.659
3.200
'1.200
"1.200
3.000
3.200
3.000
3.000
4.000
4.000
4.000
4.000
4.000
4.000
3.200
"1.200
3.200
3.200
4.000
4.000
4.000
3.200
3.200
3.200
:".200
3.200
3.200
0.750
0.750
0.750
0.750
0.750
0.750
".800
0.800
3.1'\59
3.659
3.659
3.000
3.000
3.000
2.400
2.400
2.400
2.400
2.400
2.400
1.76'1
1.768
1.76A
1.76A
1.76A
1.768
1. ft2<)
1.829
1.82<)
1.829
3.000
1.829
o.eoo
0.800
0.750
O.AOO
2(A)
4.533
4.533
4.533
4.000
4.533
4.000
4.000
4.667
6.667
4.667
4.667
6.667
4.667
3.733
3.733
:,!.7:'!:'!
3.733
4.667
6.667
4.667
4.533
4.533
4.533
4.53:'1
3.733
3.733
2.000
2.000
2.000
2.000
2.000
2.000
2.267
2.267
2.2ti7
2.267
2.000
2.26'"
-
Criterion
Criterion
Criterion
P .. A
p '" T(l)
P '" T(2)
Criterion Criterion
3(E)
1
2
3
1
2 3 1 2
3.6l'>9
:'1.659
3.659
3.000
3.659
3.000
3.000
1
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
1
I
1
1
1
I
I
t
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
1
I
0
0
0
0
0
0
0
1
1
I
1
1
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
I
I
1
I
I
I
0
0
0
0
0
0
0
0
0
0
0
0
3.5::15
6.000
3.535
3.535
6.000
3.535
2.400
2.400
2.400
2.400
3.5'15
6.000
3.535
3.659
3."!,;9
3.659
3.659
2.400
2.400
1.500
1.500
1.500
1.500
1.500
I ."'00
1.829
1.82CJ
1.8?CJ
1.829
I .l'>00
I.A~9
I
1
0
1
0
0
I
1
I
1
I
1
0
0
0
0
0
0
I
I
I
I
0
I
I
0
0
0
0
0
0
0
0
0
0
0
0
I
I
1
.1
1
I
1
0
0
0
0
0
0
0
0
0
0
°
0
I
0
0
0
0
1
I
1
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
1
I
I
I
I
1
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
1
0
1
I
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
I
I
I
1
I
I
0
0
0
0
I
0
0
0
0
0
0
0
0
0
0
0
0
0
0
1
1
I
1
0
0
0
0
0
0
0
I
1
L
0
0
0
0
0
0
0
0
0
~
?
:?
?
0
1
3
0
I
1
I
a
0
0
0
4)
0
0
1
I
0
0
I)
t)
0
0
0
0
0
0
0
0
0
0
°
1
1
1
1
1
1
1
2
0
0
0
0
I)
A
3
0
0
T
0
T
0
0
0
0
~
.,
3
"1
4
"'5
4
'5
'5
'7"
7
1
,
I
I
1
I
I
I
I
I
1
I
--'
W
\0
Table A2.l
(Continued)
fi(~; ~~)
Ok
0
E
F
0
E
S
First Period
Treatment Effects
(d)
7
1
7
7
1
7
1
7
7
7
7
7
7
7
1
7
7
7
1
7
7
7
7
7
7
7
7
1
7
7
1
7
7
7
7
7
1
7
2
.2
2
2
2
2
2
2
2
2
2
2
.2
2
2
2
2
2
2
2
2
2
30
32
.33
3ti
36
16
HI
2':;
26
.31
.l4
11
20
22
2!:>
4
a
13
6
9
11
:J
12
5
7
21
33
10
14
It.
20
21
25
28
;)
32
.2
2
.)
3
3
J
3
3
3
3
3
3
35
36
.3
3
9
12
1(0)
o.se~
0.583
0.S83
0.778
0.778
0.583
0.563
0.S8.J
0.583
0.583
0.583
0.583
0.sa3
0.!:>63
0.583
0.583
0.583
0.583
0.583
0.583
0.583
0.Su3
0.583
0.S83
0.065
0.065
0.086
0.086
0.066
0.065
0.065
0.065
0.066
0.065
0.086
0.066
0.065
0.06!:>
1.833
l.al3
1.833
2.607
2.t61
1.833
1.f33
1.B33
1.424
1.424
1.424
2.333
0.~30
0.630
0.t30
0.815
0.630
0.815
0.815
0.574
0.~74
P = ).
~-
Criterion
p
= T(2)
Criterion Criterion
T
0
T
A
L
3(E)
1.833
1.833
1.B33
1.f33
1.633
1.833
1.667
l.t67
1.667
1.U67
1.607
1.667
l.t61
1.667
1.607
0.f30
0.630
0.B15
0.81S
0.815
= TO)
p
~
Criterion
Criterion
-2(A)
1.~3
Second Peri od
Treatment Effects
Carryover Effects
Cri terion
(k)
OI(d.i .p)
2.~33
1.424
1.424
1.424
1.424
1.424
1.424
1.424
1.424
1.424
1.424
1.167
1.167
1.167
1.167
1.167
1.167
1.167
1.167
1.167
0.500
o.SOO
0.689
0.689
0.689
0.500
o.tiOO
0.500
0.689
0.500
0.689
0.689
0.420
0.420
1(0)
0.800
0.800
o.eoo
1.000
1.000
0.750
0.750
0.150
0.750
0.750
0.750
0.800
0.800
0.800
0.800
0.750
0.750
0.750
0.800
o.eoo
0.800
O.bOO
0.800
0.800
0.089
0.089
0.111
0.111
0.111
0.089
0.069
0.089
0.111
0.089
O. I I I
0.111
0.089
0.089
2(A)
2.261
2.261
2.261
3.333
~.33.;j
2.000
2.000
2.000
2.000
2.000
2.000
2.267
2.261
2.267
2.261
2.000
2.000
2.000
1.867
1.861
1.807
1.861
1.861
1.867
0.800
0.800
1.000
1.000
1.000
0.800
0.800
0.800
1.000
0.800
1.000
1.000
0.661
0.661
1(0)
3(E)
1.e2S
1.829
1.829
3.000
.J.ooo
1.500
1.500
I.!:>OO
1.500
1.500
1.:»CiO
1.829
1.829
1.829
1.829
1.500
1.500
1.500
1.?00
1.200
1.200
1.200
1.200
1.200
0. of 1
0.b61
0.873
C.873
0.873
C.667
0.667
0.b67
C.813
0.661
0.873
0.873
0.482
0.482
o.eoo
0.800
0.800
0.150
0.750
1. ClOO
1.000
1.000
1.000
1.000
1.000
0.800
0. 800
0.800
0.800
1.000
1.000
1.000
0.800
0.800
0.800
0.800
o. eoo
0.800
0.089
0.089
0.083
0.083
0.083
0.089
0.089
0.089
0.083
0.089
0.083
0.083
0.089
0.089
2(A)
2.261
2.267
2.267
2.000
2.000
2.333
2.333
2.333
2.333
.1.333
3.333
1.867
1.867
1.867
1.867
2.333
2 • .333
3.333
2.267
2.267
2.267
2.267
1.867
1.867
0.800
0.800
0.667
0.667
0.667
0.667
0.661
0.667
0.667
0.667
0.667
0.661
0.800
0.800
3(E)
1.829
1.829
1.829
1.500
1.500
1.768
1.768
1.768
1.768
3.000
3.000
1.200
1.200
1.200
1.200
1.768
1.768
3.000
1.829
1.829
1.829
1.829
1.200
1.200
0.667
0.667
0.500
O.SOO
0.500
0.482
0.482
0.482
0.500
0.482
0.500
0.500
0.661
0.667
1
1
1
I
0
0
I
I
1
I
I
I
I
1
I
1
I
I
I
I
1
I
I
I
•0•
1
0
0
1
•
I
0
I
0
0
I
1
2
0
0
0
0
0
0
a
0
0
0
0
0
0
0
0
I
I
I
1
1
1
I
1
I
0
0
0
0
0
0
0
0
0
0
0
0
I
I
3
1
2
3
0
0
0
0
0
0
0
1
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
1
3
1
2
0
0
0
0
0
0
1
0
0
0
0
0
0
0
0
0
0
0
0
0
0
I
1
1
I
1
1
1
1
I
0
0
0
0
0
0
0
0
0
0
0
0
0
0
I
I
I
I
I
0
0
0
0
I
I
1
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
I
I
1
1
I
I
I
I
I
I
0
0
0
0
0
0
0
0
0
0
0
0
1
0
0
0
0
0
0
0
0
0
0
0
0
I
0
I
I
0
1
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
1
I
1
0
0
0
I
0
I
1
a
0
I
1
I
I
0
0
0
0
0
0
0
1
1
0
0
I
I
I
1
I
I
I
I
1
I
0
0
I
1
I
0
0
0
0
0
0
0
1
1
0
0
0
0
0
0
0
0
0
0
0
0
0
0
1
•
I
I
I
2
2
2
2
~
.2
3
3
3
.1
4
4
4
5
5
5
5
7
7
I
I
2
2
2
2
2
2
2
2
2
2
.3
.3
......
+:00
•
'e'
e
•
e
,e·
Table A2.l
(Continued)
OI(d.i.p)
fi(X; C )
-
ok
0
E
F
(k)
7
7
1
7
1
7
7
7
7
7
7
7
1
7
7
7
7
7
7
7
7
7
1
7
7
7
7
1
7
7
1
7
7
7
7
7
7
1
;J
3
3
:os
3
3
,)
3
3
.3
3
3
3
3
3
3
3
3
3
;J
3
3
4
4
••4
4
4
4
4
4
4
4
"
4
"4
0
E
S
First Period
Treatment Effects
1(0)
2(A)
3(E)
24
20
30
:OS4
0.065
0.005
u.Ob5
0.065
0.065
0.005
0.005
0.Ob5
0.065
0.065
0.065
0.065
0.065
0.065
0.065
0.065
0.066
0.086
0.086
0.065
0.065
0.005
0.778
0.778
0.778
0.718
0.778
0.776
0.563
0.574
0.630
0.574
0.630
0.574
0.574
0.574
0.57.
0.57.
0.57.
0.574
0.574
0.fl4
0.57.
0.57.
0.574
0.593
0.593
0.593
C.030
0.f74
0.57.
2.000
2.000
2.000
2.000
2.000
2.000
1.633
1.e33
1.833
1.833
2.667
1.633
I.S33
1.833
1.833
2.667
0.420
0.500
0••20
0.500
0.420
0.420
0 •• 20
0.420
0.420
0 •• 20
0.420
0.420
0.420
0.420
0 •• 20
0.420
0.333
0.333
0.333
0.500
0.420
0.420
1.471
1.471
1.471
1.471
1.471
1.471
1 •• 24
1.424
1.424
1.424
2.333
1.424
1.424
1.424
1.424
2.333
II
13
17
18
22
23
2~
31
1
2
.J
...,
•
16
1
~
3
10
14
15
18
21
<24
27
~8
29
30
::12
33
35
0.5d~
0.563
0.583
0.778
u.b63
0.563
0.583
0.583
0.778
1(0)
0.089
0.083
0.089
0.083
0.089
0.089
0.089
0.083
0.OU9
0.083
0.089
0.089
0.089
0.083
0.089
0.eS3
0.111
0.111
0.111
0.083
0.083
0.083
1.000
1.000
1.000
1.000
1.000
1.000
0.800
0.800
0.800
0.800
1.000
o.UOO
0.800
0.800
o.aoo
1.000
p " T(l)
2(A)
3(E)
0.661
0.007
0.667
0.667
0.667
0.667
0.667
0.667
0.661
0.667
0.661
0.667
0.667
0.661
0.067
0.667
0.667
0.667
0.667
0.667
0.667
0.667
2.333
2.333
2.333
2.333
2.333
2.333
2.267
2.267
2.267
2.267
3.333
2.267
2.267
2.267
2.267
.3.3.33
0 •• 82
0.500
0.482
0.500
0.482
0.482
0 •• 82
0.500
0.482
0.500
0.4e2
0.482
0.482
0.500
0 •• 82
0.500
0.3::13
0.333
( • .J33
0.500
0.500
0.500
1.768
1.768
1.7b8
1.768
1.168
1.168
1.829
1.829
1.82,.
1.829
3.0CO
1.829
1.829
1.8~'i
1.829
3.0(0
1(0)
0.089
o. III
0.089
O. III
0.OU9
0.089
0.089
o. III
0.089
0.111
0. 089
0.089
0.089
0.111
0.089
O. III
0.083
0.083
0.083
0.111
o. III
0.111
0.750
0.750
0.750
0.750
0.750
0.750
0.800
0.800
0.800
0.800
0. 750
0.800
0.800
0.800
0.800
0.150
2(A)
0.800
1.000
0.800
1.000
0.667
0.667
0.667
1.000
0.667
1.000
0.667
0.667
0.667
1.000
0.667
1.000
0.667
0.667
0.667
0.667
0.667
0.667
2.000
2.000
2.000
2.000
2.000
2.000
2.267
2.267
2.267
2.267
2.000
2.267
2.267
2.267
2.267
2.000
P"
Criterion
Criterion
Criterion
(d)
0
7
8
Second Period
Treatment Effects
Carryover Effects
Criterion
~
-~
-A
P " T(2)
-
T
Criterion Criterion
1
2 3
1
2 3
1
2
3
0.667
0.873
0.667
0.873
0 •• 82
0.482
0.482
0.873
0 •• 82
0.873
0•• 82
0.482
0.482
0.873
0 •• 82
0.873
0.500
0.500
0.500
0.333
0.33::1
0.333
1.500
1.500
1.500
1.500
1.500
1.500
1.829
1.829
1.829
1.829
1.500
1.829
1.829
1.829
1.829
1.500
I
I
I
I
I
I
1
1
1
I
1
I
I
1
I
I
0
I
0
I
I
1
I
I
I
I
I
1
1
I
I
0
0
0
I
I
I
I
I
I
I
I
1
I
1
1
I
1
1
1
1
I
I
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
I
I
1
0
1
0
I
I
I
0
I
0
I
I
I
I
I
I
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
I
0
0
0
I
I
I
0
0
0
0
0
0
I
1
1
1
0
I
I
I
I
0
0
0
I
1
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
I
I
I
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
I
0
0
0
1
0
1
0
0
0
I
0
I
0
0
0
I
I
I
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
I
I
I
I
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
I
I
I
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
A
L
3(E)
0
0
0
0
0
0
0
0
0
0
0
0
0
T
0
I
I
I
0
0
0
I
I
I
1
I
I
0
0
0
0
1
0
0
0
0
I
0
0
0
0
0
0
0
0
0
0
0
'0
0
0
0
0
0
I
I
I
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
3
3
3
3
4
•4
•••
••4
••
•5
5
5
5
6
6
I
I
I
1
I
I
1
I
1
I
1
1
I
I
I
1
--'
~
--'
Table A2.l
(Continued)
fl(~' ~~)
ok
0
E
0
F
S
First Period
Treatment Effects
E
7
1
7
7
7
7
7
(d)
..,.
4
4
<It
., ••
."
7
1
7
7
1
1
7
7
7
7
7
1
6
8
8
6
8
a
~
8
a
e
8
a
8
a
8
8
8
Ii
4
4
4
4
•4
"
"4
•
"I1
1
1
I
I
1
1
1
2
2
2
2
2
2
2
2
2
3t>
16
19
23
:26
31
3.
11
20
22
25
4
6
13
6
;,;
11
12
5
7
5
4
6
2
6
1
3
1
9
9
7
8
3
6
1
~
"5
Criter10n
1(0)
2(A)
3(E)
0.718
0.583
0.583
0.::;83
2.661
1.833
1.833
1.833
1.833
1.£33
1.833
1.8.33
1.833
1.833
l.e33
1.667
2.333
....2.
1.42.
•• 42.
1.42.
•• 424
1.424
1.42.
1.42.
1.42.
1.42..
1.167
1.167
1.167
1.167
I •• 67
1.167
1 •• 61
1.167
1.167
2.667
~.~a3
0.583
0.583
0.583
0.583
0.583
0.S83
0.563
0.583 1.~67
0.583 1.661
0.583 1.667
~.5b3
1.667
0.583 1.6(,1
0.583 1.~67
0.583 •• 661
0.583 1.667
1.776 3.333
1.776 3.333
1.778 3.333
1.718 3.000
1.778 3.000
1.778 3.000
1.178 3.aoo
•• 77U 3.000
•• 77d 3.000
0 ••• 4 1.667
0.44. 1.667
0 •••• 1.667
0 •••• 1.500
1 .500
00.444
•• "" 1.500
0.4.4 1.500
0.4 .... 1.500
0.4.4 1.500
Second Peri od
Treatment Effects
Carryover Effects
Cri terion
(k)
OI(d.1.p)
~.661
2.667
2.187
2.187
2.187
2.167
2.167
2.187
1.333
1.333
1.333
1.0~.
1.09"
1.09..
1.0Y"
1.09.
1.094
1(0)
1.000
0.150
0.750
0.750
0.750
0.750
0.750
0.800
0.800
0.800
0.800
0.750
0.150
0.150
0.800
0.800
0.800
0.800
0.600
0.800
2.000
2.000
2.000
2.000
2.000
2.000
2.000
2.000
2.000
0.500
0.500
0.500
0.500
0.500
0.500
0.500
0.l:>00
0.500
2(A)
,,).33..1
2.000
2.000
2.000
2.000
2.000
2.000
2.267
2.261
2.267
2.261
2.000
2.000
2.000
1.867
•• 867
1.867
1.867
1.867
1.807
3.667
3.661
3.607
3.167
3.167
.3. 1t.7
3.167
3.167
.3.167
1.833
1.833
1.833
1.563
1.583
1.583
1.583
1.583
1.583
3.000
•• 500
•• 500
•• 500
1.tiOO
1.500
1.5eQ
1.829
1.829
1.829
•• 829
I.SOC
1.500
•• 500
1.200
1.200
1.2eO
1.200
1.200
1.200
3.000
~.OQO
3.000
2.295
2.295
2.295
2.295
2.295
2.295
1.500
1.500
1.500
1.148
•• 140
1.1"8
1.1.8
1.148
1.1.8
1(0)
0.750
I. ClOO
1.000
1.000
•• 000
1.000
I. 000
0.800
0.800
0.800
0.800
1.000
1.000
1.000
0.800
0.800
o.eoo
0.800
0.800
o.aoo
2.000
2.000
2.000
2. 000
2.000
2.000
2.000
2.000
2.000
0.500
0.500
0.500
0.500
0.500
0.500
0.500
0.500
0.500
2(A)
2.000
2.333
2.333
2.333
2.333
3.333
3.333
1.867
•• 867
1.867
1.867
2.333
2.333
3.333
2.267
2.267
2.267
2.267
&.867
1.867
3.667
3.167
3 •• 67
,,).667
3.667
3 •• 67
3 •• 67
3.167
3.167
1.833
1.583
1.583
•• 833
1.833
•• 583
1.583
1.583
•• 583
P =A
Criterion
Criterion
3(E)
= t(1)
p
1
2 3
1
1.500
..768
•• 768
•• 768
1.768
3.000
3.000
•• 200
1.200
1.200
1.200
1.168
•• 768
3.000
1.829
1.829
1.829
1.829
1.200
1.200
3.000
2.295
2.295
3.000
3.000
2.295
2.295
2.295
2.295
•• 500
•• 148
1.148
1.500
1.500
•• 148
1.1.8
to .48
1.1"8
••
••
0
0
0
I
I
I
1
I
I
0
0
0
0
0
0
0
0
0
0
0
a
I
1
I
1
1
1
I
1
I
1
1
0
I
I
1
I
I
I
1
I
1
•
I
I
1
I
1
0
0
a
0
2 3
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
1
•
0
0
0
0
0
0
0
0
0
0
0
'2
0
0
0
0
0
0
0
••
•
1
0
0
0
0
0
0
0
T
0
T
3
0
0
0
0
0
0
a
1
1
I
I
0
0
0
0
0
0
0
A
l
•
2
2
2
2
2
2
3
3
3
3
•
g
•• •
•
• •• ••
•
• • ••
•
•
•• • •
•
•
•
•
•
•
• •
•
I
0
0
0
1
1
1
1
0
0
1
0
0
I
I
I
•
• •
•
• ••
•
•
• •
•
1
1
1
0
0
-
Criterion Criterion
3(E)
0
0
0
0
P = t(2)
0
I
1
1
1
I
1
I
1
0
0
0
I
I
I
0
0
0
I
I
1
I
I
I
0
0
0
0
0
0
I
1
I
1
I
1
1
I
1
1
I
I
1
I
1
1
0
0
0
1
I
1
I
I
0
0
0
1
1
I
1
I
0
0
0
I
1
I
I
I
I
1
1
0
0
0
I
I
1
1
I
0
0
0
I
1
1
1
1
0
0
0
0
0
0
1
I
1
1
1
I
I
0
1
1
I
0
0
I
I
I
I
0
I
I
0
0
1
I
I
t
1
1
I
1
I
I
I
I
I
I
0
I
1
0
0
1
1
1
1
0
4
5
5
5
5
7
7
3
5
5
7
7
9
9
9
9
3
5
I
0
0
I
1
5
7
7
9
9
9
9
--'
+:0
N
•
'e'
e
e
·e,
e
Table A2.l
(Continued)
OI(d.i.p)
fi(~; ~~)
Ok
0
E
F
(k)
8
8
8
8
.)
J
.)
3
.)
8
8
8
8
8
3
3
3
3
8
8
8
8
8
8
8
E
S
(d)
is
8
0
•44
•44
4
S
6
a
9
4
7
2
3
1
9
7
a
3
6
I
2
4
4
4
5
First Period
Treatment Effects
Criterion
2(A)
3(E)
0.0.9
0.049
0.049
0.049
0.049
0.537
0.537
0.537
0.f37
0.04~
0.481
0.481
0 ••81
1.667
l.bu7
1.607
1.500
l.fOO
1.500
1.500
1.500
1.500
0.419
0.419
0.419
0.419
0 •• 19
0.419
0.333
0.333
0.333
1 • .J33
1.333
1.333
1.094
1.094
1.094
1.094
1.094
1.094
0.~37
0.049
0.049
0 •• 4.
0.444
0.444
0.444
0 ••••
0.444
0.4 ••
0 ••••
0 ••44
l(O)
0.050
0.056
0.056
0.056
0.056
0.056
0.056
O.OSe')
0.056
0.500
0.500
0.500
O.tiOO
0.500
0.500
0.500
0.500
0.500
2(A)
0.58~
0.583
0.583
0.583
0.583
0.583
0.500
0.500
0.500
l.ti33
1.833
a.833
1.583
1.583
1.5e3
1.583
1.563
1.563
3(E)
0 ••0,]
0.46.)
C.463
0.463
0.463
0.463
C.33,]
0.333
0.333
1.500
1.500
1.500
1.148
1.14a
1.148
1.14a
1.148
1.148
l(O)
0.050
0.056
0.056
0.050
0.056
0.056
0.056
0.056
0.056
0. 500
0.500
0.500
0.500
0.500
O. fOO
0.500
0.500
0.500
2(A)
0.583
0.583
0.583
0.583
0.500
0.500
0.583
0.583
0.500
1.833
1.583
1.583
1.833
1.833
1.583
1.583
1.583
1.583
P=
p = T(l)
Criterion
Criterion
Criterion
l(O)
0.049 0.537
Second Period
Treatment Effects
Carryover Effects
P = T(2)
>..
-
Criterion Criterion
3(E)
1
2
3
1
2
3
1
2
3
0.463
0.463
0.463
0.463
0.333
0.333
0.463
0.463
0.333
1.500
1.148
1.148
1.500
1.500
1.148
1.148
1.148
1.148
1
1
1
1
1
1
0
0
0
0
0
0
1
1
1
0
0
0
0
0
0
0
0
0
1
1
1
0
0
0
1
1
1
1
1
1
1
1
1
1
0
0
0
0
0
0
1
1
1
0
0
0
1
0
0
0
0
0
0
1
1
1
1
1
1
1
1
1
1
1
0
0
0
0
1
1
0
0
1
0
0
0
0
0
1
I
1
I
1
1
1
1
I
1
I
I
1
I
1
I
1
1
1
I
1
I
I
1
I
I
1
1
1
1
1
1
1
I
I
1
1
1
I
1
1
0
0
0
I
I
I
I
1
1
I
I
I
1
I
1
I
1
I
0
0
1
1
I
1
I
0
0
1
0
1
1
0
0
1
1
I
I
T
0
T
A
l
3
3
3
3
5
5
7
7
9
3
5
5
7
7
9
9
9
9
~
.po
w
144
e
Table A2.2 Values of Sum of Optimality Indications
(SOI(d,i ,p)) and SCORE
= L SOI(d,i ,p)
found for
each subdesign (DESIGN) in each class Ok
Ok
0
E
S
I
G
N
(k)
s
5
5
5
5
5
5
.,'
;J
5
5
::)
5
5
::i
5
5
~
5
(d)
~1
43
5..3
04
20
21
26
First Period
Treatment
Effects
Carryover
Effects
Second Period
Treatment
Effects
0
Criterion
Criterion
Criterion
E
3
J
3
3
...""
3
..3
3
.3
42
52
.3
67
73
74
44
45
05
3
...
":l
J
..3
J
3
1
1
1
1
!
1
1
1
1
1
1
1
1
1
1
1
a
a
a
0
0
0
0
a
0
a
C
a
a
0
a
0
0
0
a
0
0
0
0
5
69
0
:J
77
C
0
0
0
0
0
0
5
80
0
5
5
14
16
3
5
5
5
5
..
5
~
.3
32
3
3d
50
~
~
61
75
7d
27
...
":l
J
.3
~
a
1
1
1
1
1
1
1
1
.3
5
5
0
28
3
.3
49
.3
~
50
5
5
5
2
J
0
oJ
..3
0
3
0
I)
4
6
C
0
C
C
0
0
0
0
0
0
5
5
5
7
5
35
36
08
::)
~
(3
5
5
00
70
71
11
;)
12
10
5
:i
...'"
5
5
R
1(0) 2(A) 3(E) 1(0) 2(A) 3(E) 1(0) 2(A) 3(E)
.;i0
40
55
63
S
C
0
0
0
0
C
0
..3
.3
17
J
.3
23
~
0
0
0
0
3
..3
J
3
J
a
a
a
0
C
a
a
a
0
1
1
1
1
1
1
1
1
0
0
0
0
0
0
a
a
0
C
0
a
0
a
a
0
0
c
a
a
Q
0
0
0
0
a
0
0
a
0
0
a
a
C
0
0
0
0
0
a
a
a
1
1
0
1
a
1
0
0
0
0
1
!
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
0
1
1
1
1
1
0
0
0
0
1
1
1
1
0
0
a
0
C
0
0
a
0
0
0
C
0
1
a
0
0
1
1
1
1
1
1
1
1
1
1
0
c
0,
a
0
1
0
0
c
a
1
1
1
a
a
0
0
1
0
1
0
0
1
1
1
1
1
1
1
1
1
1
a
0
1
1
1
1
1
1
1
1
1
1
1
1
0
c
c
a
C
a
0
C
c
c
c
0
a
a
0
1
0
i
1
1
0
1
0
1
a
0
a
a
a
a
1
c
0
0
1
C
oJ
J
..3
1
.3
J
J
1
1
1
.3
.,
1
3
1
1
1
1
1
1
1
1
0
C
0
.,C
1
a
C
C
..."
~
3
0
C
0
C
0
0
C
0
a
C
0
C
....,
...
..3
.....
."
1
1
-
...
...
."
.3
1
1
1
0
1
1
1
1
1
1
0
C
0
0
1
1
1
1
."
~
1
1
1
1
1
1
1
..
0
1
1
0
1
1
0
0
C
0
0
6
0
6
6
7
1
1
1
1
1
1
1
e
7
7
7
7
7
8
8
8
3
.3
.3
J
.1
1
6
{)
()
1
1
1
1
J
3
.3
.3
':I
6
C
6
~
3
...
4
'+
1
3
.3
3
-..
4
4
a
8
8
0
9
c;;
9
9
10
10
10
10
10
10
10
10
10
10
10
10
11
1
1
1
11
11
1
1.1
11
·e
145
Table A2.2 (Continued)
Ok
°
E
S
First Period
Treatment
Effects
Carryover
Effects
Second Period
Treatment
Effects
Criterion
Criterion
Criterion
I
G
N
( k)
5
3.3
.3
5
5
5
5
5
5
5
0
5
5
46
48
57
76
79
13
19
J
:i
e
;)
b
5
S
5
5
5
5
:J
S
5
5
5
5
5
;)
;)
6
6
6
0
6
6
0
0
6
(;)
6
0
6
6
0
b
6
e·
...,-
25
37
39
54
62
66
29
41
5.1
6S
81
1
5
9
J4
59
72
10
16
22
47
45
52
62
71
41
46
51
65
66
72
77
78
8
9
14
15
17
IS
0
4d
49
0
08
6
.3
3
J
J.,
-
1
.3
.3
1
1
1
1
J
3
J
J
.3
.3
1
1
1
1
1
.3
1
.3
.3
0
1
a
.3
.3
C
0
C
0
0
C
0
0
a
a
a
J
.3
.3
J
0
C
0
0
C
0
a
a
0
\J
0
0
C
a
J
a
a
a
a
0
.3
.3
J
.3
0
a
a
0
a
0
a
0
0
C
a
a
0
a
0
0
0
J
Q
t"
a"
J
C
a
a
.;
a
0
1
1
0
0
0
0
0
0
0
0
a
a
0
1
a
1
0
0
1
1
1
1
1
1
1
1
1
1
a
0
a
0
a
0
0
a
0
0
0
0
1
1
1
1
1
1
1
1
1
3
0
.3
.3
.3
.3
.3
.3
.3
3
.3
.3
.3
.3
.3
.3
a
1
1
.3
.3
.3
3
.3
.3
3
.3
.3
.3
.3
.3
.3
J
J
J
3.,
...
.3
:3
.3
.3
.3
3
.3
.3
J.,
3
.3
.3
1
1
I
1
1
1
.1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
a
a
.3
.3
.3
.3
.3
.3
0
0
0
0
0
0
0
1
1
1
1
1
1
1
1
1
1
1
-
.3
.3
a
c
a
a
a
.
0
....
a
0
a
a
0
C
0
a
c
a
0
a
a
a
0
a
0
a
0
a
a
a
0
0
a
0
0
1
0
0
c
1
1
1
1
1
1
0
0
C
0
C
C
0
C
0
0....
...
0
C
C
0
-a
...
3.3
.3
J
...
~
.3
a
C
a
C
c
a
c
0
0
c
0
c
C
c
C
0
0
C
0
c
C
0
c
0
0
C
1·
1
0
I
I
0
C
C
0
0
1
1
1
1
1
1
1
1
0
I
0
1
1
a
1
1
.1
1
1
1
1
1
a
.3
c
.3
.;:
.3
.3
J
.3
-
3
1
1
1
1
C
0
C
C
0
C
a
0
C
0
C
0
a
C
a
C
C
0
0
0
R
E
(d) 1(0) 2(A) 3(E) 1(0) 2(A) 3(E) 1(0) 2(A) 3(E)
..,...
1
1
24
a
1
J
1
1
U
ti
S
C
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
U
1
1
0
1
11
11
11
11
I 1
11
I 1
1.3
13
13
13
13
13
1.3
1:;
14
14
14
14
14
15
Ib
15
15
15
15
16
16
16
16
1
1
1
1
2
2
2
2
2
2
2
2
3
.3
3
3
.3
3
.3
.3
.3
147
Table A2.2 (Continued)
Ok
Carryover
Effects
Second Period
Treatment
Effects
I
G
N
Criterion
Criterion
Criterion
26
2;
38
4.2
57
59
27
33
10
14
15
7
7
7
7
7
7
7
7
7
7
7
7
7
7
7
1
7
7
7
7
7
7
7
7
7
7
7
7
7
7
7
28
35
36
20
21
25
.32
1
2
.3
26
34-
9
12
1~
24
30
8
13
23
31
4-
......
J
3
.3
J
3
J
0
a
0
C
C
0
3
3
J
:3
0
0
C
3
J
3
3
.3
3
.3
.3
.;)
J
3
3
5
.;
6
J
7
11
16
17
.3
7
7
7
7
8
18
J
3
3
.3
22
J
6
C!
0
8
.:J
8
9
47
7
8
8
8
8
29
5
2
::3
1
...
-
J
.3
J
3
3
J
J
J
3·
oJ
3
::3
3
--....
0
0
0
0
0
0
0
0
0
a
0
0
0
0
0
0
0
2
2
a
.2
2.
.2
2.
2
2.
2
2
2
2
2
2
2
2
2
.2
2
2.
2
2
2.
0
0
0
a
0
0
0
0
0
0
a
0
1
1
1
0
0
1
1
0
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
3
3
:3
3
.3
2
.:
::3
3
.3
3
3
3
a
0
0
c
c
0
0
0
0
0
c
0
0
0
0
3
3
0
0
3
0
0
3
...
':l
3
:3
::3
0
0
0
0
3
0
0
0
C
;;
3
3
::3
3
3
3
:3
.3
2
Z
2
2
2
2
0
0
0
0
0
0
u
0
0
a
a
0
1
1
1
2
2
2.
2
2
2
0
c
0
0
0
0
0
0
0
c
0
0
1
1
1
1
C
1
2
2
1
2
2
0
1
1
0
1
1
0
0
0
1
1
1
1
1
2
.2
2
2
1
2.
2
2
2
1
1
1
C
a
1
1
1
1
C
1
1
1
1
1
1
1
1
1
1
1
3
::3
::3
1
1
.3
.3
3
-3.,
-;
...
.;
'7
.:
0
c
3
2
.2
~
2
.2
2
0
c
1
-3
....
1
3
.3.,
1
-
0
c
C
0
-3.
:3
C
0
C
0
0
0
C
1
1
1
2.
2
2
2
1
1
1
C
0
C
0
1
C
0
0
c
C
0
C
C
0
c
0
C
1
.2
C
&.
0
2
2
1
2
2
2
.2
1
1
1
1
0
0
0
C
a
0
::3
.3
;;
.:
3
.:
.3
:3
;;
0
E
b
0
J
S
C
R
(d) 1(0) 2(A) 3(E) 1(0) 2(A) 3(E) 1( D) 2(A) 3( E)
b
e
First Period
Treatment
Effects
(k)
6
6
6
e
0
E
S
.2
.2
.2
2
2
2
a
0
0
22
22
22
22
22
22
3
3
4-
0
C
44
0
44
40
0
C
1
1
1
1
C
0
0
0
0
0
0
1
C
0
6
C
6
7
7
7
7
7
9
9
9
<J
9
0
10
C
0
0
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1C
...
10
10
12
12
12
12
12
12
12
12
12
12
15
15
1~
15
':l
19
3
:3
19
1
1
1
1
- - -.
23
23
27
Table A2.3 Extreme values of fi(~; ~p) found in each method of definition
(DEF) and each class Ok
Ok
First Period
Treatment Effects
0
E
F
~
lt~)
1
Criterion
Criterion
(k)
Second Period
Treatment Effects
Carryover Effects
2(A)
3(E)
1(0)
2(A)
Criterion
3(E)
lt~)
2(A)
3(E)
MAX
:.>.000
6.667
!;).OOO
6.661
3.3.U
5.442
12.000
16.01l0
t1.000
12.000
4.000
10.412
12.000
16.000
I~.OOO
4.000
10.412
~UN
1l.000
:>
2
MIN
MAX
1.250
1.667
2.500
3.333
1.667
2.721
3.000
"4.000
4.000
6.000
2.000
5.236
3.000
4.000
4.000
6.000
2.000
5.236
5
.)
MIN
MAX
0.139
0.185
0.778
1.185
O.SOO
1.000
0.333
.0.444
1.33.J
2.222
1.000
2.000
0.333
0.444
1.333
2.222
1.000
2.000
6
1
/41N
MAX
3.000
4.000
4.000
S.667
3.000
4.840
5.333
0.000
5.333
10.000
4.000
9.123
5.333
8.000
ti.333
10.000
4.000
9.123
6
2
MIN
MAX
O.7aO
1.000
2.000
2.6.33
1.500
2.420
1.333
2.000
2.667
5.000
2.000
4.5L2
1.333
2.000
2.6b7
5.000
2.000
4.562
0
.)
,"'IN
MAX
0.063
0.111
0.667
0.907
0.422
0.761
0.148
0.222
0.033
1.667
O.SOO
1.521
0.146
0.222
0.633
1.667
0.500
1.521
7
1
/-tIN
MAX
2 • .333
3. III
3.333
5.333
2.333
4.601
J.OOO
4.000
3.73.3
6.061
2.400
6.000
3.000
4.000
3.733
6.661
2.400
6.000
7
~
MIN
I-tAX
0.58;1
0.77d
1.6b7
2 ....07
1.161
2.33.3
C.150
1.000
1.861
3 • .333
1.200
3.000
0.750
1.000
1.1l67
3.333
1.200
3.000
7
j
MIN
MAX
0.06t>
0.08t.
0.514
0.815
0.333
0.bU9
0.083
0.111
0.601
1.000
0.333
0.1l73
O.OtS3
0.111
0.667
1.000
0.333
0.873
u
1
MIN
MAX
1.778
1.77b
3.000
3.333
2.187
2.667
2.000
2.000
3.107
3.667
2.295
3.000
2.000
2.000
3.161
3.667
2.295
3.000
II
2
/olIN
MAX
0 ... 44
0.444
1.500
1.667
1.0':14
1.333
0.500
0.500
l.titl3
1.633
1.148
1.500
0.500
0.500
1.5i:U
1.833
1.14a
1.500
U
J
"IN
I'tAX
0.049
0.049
0.481
0.3.J.J
0.419
O.OSb
0.0:>6
0.500
0.5£U
0.333
0.403
0.056
0.056
0.5:>0
0.563
0.333
0.463
0.~37
......
~
<Xl
e
'eo
e
APPENDIX 3
Tabulation of the Maximum (Max) and Minimum (Min)
Values of the Noncentrality Ratio (NR)
150
Table
Ok
A3.1
Maximum (MAX) and Minimum (MIN) values of the
noncentrality ratio (NR) found for each subdesign
(DES) in each class Ok for the hypotheses H '
01
H and H
°
E
S
02
HOl :
03
No Peri od
Treatment
Effects
1
H :
Effects
(k)
(d)
MAX
MIN
MAX
5
1
2
3
7
l.oS0
1.080
1. eso
1.080
J..080
1. 080
1.080
~
1.
O.bOO
0.600
0.600
0.600
0.600
O.6CO
0.000
0.600
0.600
0.720
0.720
0.720
0.720
0.720
0.720
0.720
0.720
0.720
0.720
0.720
0.720
0.720
0.720
0.720
0.720
0.720
0.720
0.720
0.720
0.720
0.720
0.720
0.720
0.6CO
0.000
O.6CO
0.720
0.720
0.720
0.720
. 0.6 eo
0.720
0.720
0.600
0.600
0.720
0.720
0.720
0.720
0.720
O.bOO
0.900
0.900
0.900
0.600
O.90e
0.900
0.900
0.600
0.600
0.900
0.900
0.600
Y.900
0.900
O.60e
0.900
0.900
0.600
0.900
0.900
0.600
O.SOO
0.900
0.600
0.900
0.900
0.900
0.600
0.900
0.<;;00
0.900
:)
5
5
5
S
:5
5
5
5
5
5
5
5
;;;
!:)
:5
5
5
;,)
0
5
0
5
5
~
:5
4
:5
6
9
10
11
12
1.3
14
1::)
16
17
1.J
19
20
21
22
23
24
2::)
26
27
5
2.3
5
29
30
31
.;j2
33
;)
5
5
5
5
:5
5
5
5
5
5
5
5
5
5
5
5
5
5
5
;J
~
~4
35
30
37
3d
39
q,0
41
42
43
q,.q.
45
40
47
4d
49
00
51
cao
1.080
1.200
1.200
1.2QO
1.200
1.200
1.200
1.200
1.200
1.200
1.200
1.200
1.200
1.200
1.200
1.200
1.200
1.200
1.200
1.2eo
1.200
1.200
1.200
1.200
1.200
1. 080
1.080
l.0eo
1.2.00
1.200
1.200
l.2CO
1. 080
1.200
1. ZOO
1.0SU
1. C80
1.Z00
1.200
1. ZOO
1.200
1.200
1.200
O.7~0
No
C~~ryover
0.600
O.QOO
O.':fOO
C.CiOO
0.000
O.CiOO
0.600
0.900
0.600
0.900
0.900
0.900
0.900
O.90e
0.600
0.900
0.900
0.900
O.60e
MIN
0.000
0.300
0.300
o.~OO
0.000
C.3 a 0
O.3uO
0.300
0.6 C0
o.c-OO
C• .3 a 0
0.300
0.600
0.:300
0.300
C.6CC
0.300
0 • .:100
a.coo
0.300
C.. 300
0.600
0.300
0.300
0.600
C.30C
0.300
O.3JO
O.60e
0.300
0 • .3 CC
0.300
0.600
c.cce
0 •.300
C.300
O.bOO
0 .. 300
O.60e
0.300
C.bOO
0.300
0.300
0.300
0 • .300
0.300
O.cOO
0.300
C.JCO
O.;JOO
0.600
H03 : No Period 2
Treatment
Effects
MAX
MIN
0.600
0.000
0.600
0.600
O.YOO
0.600
0.600
0.600
0.600
0.900
0.900
0.900
0.900
0.900
0.900
0.900
0.900
0.900
0.900
0.900
C.900
0.900
0.600
0.600
O.6CO
0.600
0.600
0 • .600
O. cOO
0.600
O.tOO
0.300
0.300
0.300
0.300
0.300
0.300
0.300
0.300
0.300
0.300
0.300
0.300
0.300
0 • .300
0.300
0.300
0.300
0.300
U.300
0.300
0.300
c.~oo
0.300
o.soo
0.900
0.900
0.900
0.900
C.. SOO
v.900
O.~OO
0.900
0.900
C.600
0.000
0.600
0.900
0.900
0.<;;00
0.900
0.600
0.900
0.900
0.600
0.000
0.900
0.900
0.900
c • .,OO
0.900
0.900
O.JOO
0.300
0.600
0.600
0.600
0 • .3 00
0.300
0.300
0.3;)0
O.6CO
0.300
0.300
O.CCO
0.600
O.JOO
0.300
0.300
0.300
o.JOO
0.300
e
·e
151
Table A3.1
Ok
°
E
S
(d)
MAX
MIN
5
5
52
5.J
5
5
5
5
55
56
57
1.200
1.200
1.200
1.200
1.200
1.200
1.080
1.0elO
1.080
1.200
1.200
1.200
1.200
1.080
1.200
1.200
1. C80
1.0eo
1.060
1.080
1.080
1.200
1.200
1.200
1.200
1.080
1.200
1.2eo
1.0dO
1.080
1.217
1.217
1.217
1.217
1.217'
1.217
1.217
1.217
1.217
1.217
1.217
1.217
1.217
1.217
1.217
1.217
1. 217
1.217
1.217
1.217
1.217
J.720
0.720
0.720
0.720
0.720
0.720
0.6CO
0.600
0.600
0.720
0.720
0.720
0.720
0.600
0.720
0.720
0.600
0.6 00
0.600
0.6 CO
0.600
0.720
0.720
0.720
0.720
0.600
0.720
0.720
0 • .0 00
0.6CO
a .tI 16
0.616
0.616
0.610
0.016
0.616
0.616
0.616
0.610
0.616
0.616
0.616
0.616
0.616
0.616
0.616
0.616
0.616
0.616
0.016
0.616
5
5
5
5
5
5
5
5
5
~
5
5
5
5
5
~
5
5
5
5
5
to
6
0
0
0
6
0
6
U
6
6
6
54
5tl
59
60
61
62
63
64-
co
66
67
6d
b9
7J
71
72
73
7475
76
77
7b
79
dO
81
1
2
3
45
6
7
a
9
10
11
tJ
12
13
1415
16
17
18
19
6
~O
0
0
6
6
t.>
•
H : No Period 1 H02: No
o1 Treatment
Carryover
Effects
Effects
(k)
5
5
5
e
(Continued)
b
/:)
21
MAX
0.':li00
0.900
0.600
0.900
0.900
0.600
0.900
0.600
0.900
0.900
0.600
0.900
0.900
0.900
0.600
0.900
0.600
0.900
0.900
0.900
0.600
0.900
0.900
0.900
0.600
0.900
0.900
0.600
0.900
0.600
1.000
1.000
1.163
1.000
1.18.3
1.000
1.000
1.000
1.183
1.163
1. 00 a
1.000
1.000
1.163
1. ooe
1.183
1.000
1. 00 a
1.000
1. 000
1.183
MIN
o.::o~
0.300
c.eoe
0.300
0.300
o .60C
0.300
o.cOO
0.300
C.300
o.cCC
o.JOO
0.300
0.300
c.cOC
0.3CO
0.000
0.3CO
0.300
0.300
c.ece
0.300
O• .Jeo
0.300
a.cca
0.30e
0.300
0.6CO
0.300
c.ceo
0.5CC
0.500
0.317
o.SOO
0.317
C.500
0.500
0.500
0.317
0.317
0.50e
0.500
0.500
0.317
C.50C
0 • .317
O •.5JO
C.500
0.500
c.5J a
0.317
H03 : No Period 2
Treatment
Effects
MAX
c.seo
0.5100
0.900
0.900
0.900
0.900
0.600
o.cOO
O.tOO
0.900
c.~OO
MIN
o.JOO
v.JOO
0.3eo
o.JCO
0.300
0.300
0.600
o. tOO
o.cOO
0.300
0.300
0.300
o. J CO
0.600
0.300
0.300
O.!JOO
0.900
C.<;OO
0.600
o.soo
0.900
0.600
c.cOO
0.600
a.6CO
0.600
0.900
C.SOO
0.900
J.900
IJ.t.OO
0.900
e.soo
c.cOO
C.600
1.000
1.000
1.000
1.000
1.000
1.000
1.000
1.000
1 .000
1.000
1.000
1 .000
1.000
1.000
O.cOO
0.600
o.cCO
0.300
O. JCO
0.300
0.300
0.600
0.300
0.300
0.600
0.000
o.soo
0.500
a. s co
0.500
0.500
O.SOO
0.500
1.000
1.000
1.000
1 .000
1.QOO
1.000
o.seo
o.soo
J. .0 aa
c. cOO
0.500
0.500
0.500
o.SOO
0.500
0.5CO
0.500
0.500
0.500
0.500
0.500
0.500
152
Table A3.1
Ok
°E
S
(Continued)
H01 : No Period 1
Treatment
Effects
(k)
(d)
MAX
~
6
22
23
24
2:)
26
27
28
29
30
.31
.32
33
:34
0
b
.JS
:16
0
-.37
6
..38
1.000
1.000
1.000
1.COI)
1.000
1.217
1.000
1.000
1.000
1.217
1.217
1.217
1.217
1.;Z17
1.00U
1.000
1. 000
1.000
1.000
1.217
1.000
1.000
1.000
1e 217
1.217
1.217
1.217
1.217
1.217
1.217
1.217
1.217
1.217
1.217
1.000
1.000
1.000
1.000
0
Q
0
0
0
0
0
6
6
0
0
6
6
39
40
41
42
4.3
44
45
40
47
48
49
50
51
52
53
ti4
55
6
56
~
57
58
59
60
61
62
63
64
05
66
07
08
<:.9
70
71
72
6
0
6
6
6
0
6
6
0
0
0
6
6
6
6
6
6
6
0
6
6
u
0
b
0
6
0
0
c:..
0
1. COO
1.000
1.217
1.000
1. 000
1.217
1.217
1.217
1. ~ 17
1.217
1.217
1.217
1.217
MIN
H02: No
Carryover
Effects
MAX
1. 000
1.000
1. 000
1.000
1.000
1.000
1.000
1. 000
0.750
1.000
0.616
1.000
1.000
1.000
1.000
0.750
1.000
1. 000
0.616
1.000
0.616
1.1d3
0.616
1.000
0.016
1.103
0.616
1.000
1.000
1.000
1.000
1.000
1.000
0.750
1.000
1.000
1.000
1.000
0.616
1.000
1.000
0.750
1. 000
1.000
1.000
1.000
0.616
1.183
0.616
1.000
0.610
1. 000
0.616
1. 00 a
0.616
1.183
0.616
1.000
0.616
1. 00 0
0.610
1.183
0.616
1.183
0.616
1.000
0.616
1.000
1.000
1.000
1.000
0.750
1.000
1.000
1.000
0.750
1.000
1. 000
1. 000
1.000
0.616
1.183
1.000 -1.000
I.OOO
1.000
0.616
1. 000
0.616
1.000
0.616
1.000
0.616
1.183
0.616
1.000
0.616
1.000
0.616
1.I8.J
iJ.016
1.000
MIN
0.5;)0
0.500
0.500
0.500
0.750
0.50u
0.500
0.750
0.500
C.50C
0.317
c.scc
0.317
o.~oo
0.500
0.500
0.750
0.500
0.5-0 a
o.soc
0.750
C.50C
O.~OO
0.317
0.500
0.500
0.500
0.317
0.500
o.seo
0.317
0.317
O.~iJO·
0.500
a.;c.c
0.700
c.sec
0.750
0.500
a.5eo
0.317
0.500
o.soo
0.500
0.50C
0.500
0.317
0.500
o.soo
a.317
0.500
H03 : No Period 2
Treatment
Effects
MAX
MIN
1.1a3
1.183
1 .. 183
1.18.3
C.750
1.000
1.183
0.750
1.183
1.000
1.000
1.000
1.000
1.000
1 .. 183
1 • 183
0.750
1.183
1 .183
1.000
0.750
1.183
1.183
1.000
1.00i;;
1.000
1.000
1.000
1.ClOO
1.COO
1 .000
I.JOO
1.000
1.QOO
0.317
0.317
0.317
0.317
0.750
0.500
0.317
0.750
0 • .317
1.18~
0.750
1.183
0.750
1.183
1.183
1.000
1. I8.J
1.13.3
1.000
1.000
1 .000
1.000
1.000
1.000
1.000
1 .oc 0
o.seo
0.500
0.500
0.500
O.~OO
0.317
0.317
0.750
0.317
0.317
0.500
0.750
0.:!!7
0.311
0.500
0.500
0.500
0.500
0.500
0.500
0.5eo
0.500
u.500
0.500
e
a .SOO
O.~17
0.750
0.~17
0.750
0.317
0.317
0.500
0.317
0.~17
0.50J
0.5eo
0.500
0.500
0.;00
0.500
0.;00
0.500
.-
153
Table A3.1
Ok
°S
(k)
(d)
MAX
MIN
b
7::3
14
75
16
77
7a
1
7
1.217
1.217
1.217
1.217
1.2.1 7
1.217
1.Z86
1.2c6
1.Z86
1.102
1.102
1.1QZ
1. 102
1.102
1.102
1.286
1.102
1.102
1.102
1.286
1 ~ 286
1.10Z
1.10Z
1.102
1.102
1. 102
1.102
1. 102
1.102
1.102
1. 102
1.102
1. 102
1.286
1.102
1.102
1.102
1.102
1. 102
1.J.02
1.286
1.286
1.125
1. 125
1. 125
1.125
1. 125
1.125
1. 125
8
9
1.125
0.616
0.616
0.616
0.616
0.616
0.616
0.551
0.!.i51
0.551
0.857
0.SS7
0.857
0.857
0.!357
0.8S7
0.551
0.857
0.857
0.857
0.551
0.551
0.857
0.857
0.857
0.857
0.SS7
C.SS7
0.857
0.S57
0.857
0.857
0.857
0.857
0.551
0.857
0.857
0.a57
0.857
0.S57
0.857
0.551
0.551
0.844
0.844
0.844
0.844
0.844
0.844
0.844
0.844
0.644
6
6
6
0
6
7
7
7
7
7
:r
.
e
7
7
7
7
7
7
7
7
7
7
7
7
7
7
7
7
7
7
7
7
7
7
7
7
7
7
7
7
7
7
8
a
•
(Continued)
d
d
d
d
d
d
13
E
~
.3
4
;;
0
7
d
9
10
11
12
13
14
15
16
. 17
18
19
20
21
22
23
24
25
26
2.7
28
29
30
31
32
3.3
.34
35
36
1
2
3
4
5
6
H : No Period 1
01
Treatment
Effects
1.12~
H02: No
Carryover
Effects
MAX
1.183
1.000
1.000
1.183
1.000
1. aoe
1.Z86
1.2.86
1.286
0.857
1. 071
1.071
1.071
0.857
1.071
I.Z80
1.071
1.071
0.857
1.266
1.286
0.857
1.071
1.071
0.857
1.071
1.071
1.071
0.857
1.071
1.071
0.857
1.071
1.266
1.071
1. 071
0.857
1.071
1.071
0.S57
1.Z60
1.28c
1.125
1.125
1.125
1.125
1.125
1.125
1.125
1.12.5
1 .125
MIN
0.317
0.500
0.500
0.~17
o.soo
0.500
0.42<;
0.429
0.429
0.857
0.643
0.643
0.64.3
0.S57
0.643
0.429
0.Q43
0.643
0.SS7
0.429
0.429
0.657
0.643
0.643
0.857
0.643
0.643
0.043
0.SS7
O.c43
0.643
0.8:i7
0.643
0.42<;
0.043
0.643
0.8:;;7
0.043
0.643
0.857
0.429
0.42<;
0.750
0.750
0.750
0.750
0.750
0.750
0.750
0.750
0.7:;;0
H : No Period 2
03
Treatment
Effects
MAX
1.000
1.000
1.000
1.000
1 .000
1.000
0.8~1
0.857
0.S57
1.286
1. 071
1.071
1.071
1.2~6
1 • a 11
0.857
1.071
1.071
1.286
0.857
C.857
1.286
1.011
1. 071
1.286
1.071
1.071
1.071
1.286
1 .071
1. 071
1.286
1.071
0.S57
1.071
1.071
1.286
1.071
1 .071
1.286
0.857
0.S57
1.125
1.125
1.125
1.125
.1.125
1.125
1 .125
1.125
1.125
MIN
0.500
0.500
0.500
0.5eo
0.500
0.500
0.857
0.857
0.. 857
0.4Z9
0.643
0.c43
0.64..3
0.429
0.64.3
0.857
0.64.3
0.643
0.429
0.857
0.857
0.429
0.643
0.64::3
0.429
0.643
0.643
0.64.3
0.429
0.643
0.643
0.429
0.643
0.657
0.643
0.643
0.429
0.643
0.643
0.429
0.857
0.857
0.750
0.750
0.750
0.750
0.750
0.750
0.750
0.750
0.750
© Copyright 2026 Paperzz