Notes Phase II Studies: Which Is Worse, False

(9) Tahara H, Zitvogcl L, Storkus WJ, Zeh HJ
3d, McKinney TG, Schreiber RD, et al. Effective eradication of established murine
tumors with IL-12 gene therapy using a
polycistronic retroviral vector. J Immunol
1995; 154:6466-74.
(10) Gately MK, Warrier RR, Honasoge S, Carvajal DM, Faherty DA, Connaughton SE, et
al. Administration of recombinant IL-12 to
normal mice enhances cytolytic lymphocyte
activity and induces production of IFNgamma in vivo. Int Immunol 1994;6:157-67.
(//) Clerici M, Lucey DR, Berzofsky JA, Pinto
LA, Wynn TA, Blatt SP, et al. Restoration of
HIV-specific cell-mediated immune responses by interleukin-12 in vitro. Science 1993;
262:1721-4.
(12) Chougnet C, Clerici M, Shearer GM. IL-12
in HIV infection/AIDS. Res Immunol. In
press.
(13) Bost KL, Bieligk SC, Jaffe BM. Lymphokine mRNA expression by transplantable
murine B lymphocytic malignancies. Tumorderived IL-10 as a possible mechanism for
modulating the anti-tumor response. J Immunol 1995; 154:718-29.
(14) Beissert S, Hosoi J, Grabbe S, Asahina A,
Granstein RD. IL-10 inhibits tumor antigen
presentation by epidermal antigen-presenting
cells. J Immunol 1995; 154:1280-6.
(15) Kim J, Modlin RL, Moy RL, Dubinett SM,
McHugh T, Nickoloff BJ, et al. IL-10 production in cutaneous basal and squamous
cell carcinomas. A mechanism for evading
the local T cell immune response. J Immunol
1995;154:2240-7.
(16) Elliott L, Brooks W, Roszman T. Role of interleukin-2 (IL-2) and IL-2 receptor expression in the prohferative defect observed in
mitogen-stimulated
lymphocytes
from
patients with gliomas. J Natl Cancer Inst
1982;78:919-22.
(17) Damle RN, Advani SH, Gangal SG. Impairment in proliferation, lymphokine production
and frequency distribution of mitogen-responsive and interleukin-2-producing cells in
Hodgkin's disease. Cancer Immunol Immunotherl991;34:205-10.
(18) Clerici M, Ferrario E, Trabattoni D, Viviani
S, Bonfanti V, Venzon DJ, et al. Multiple
defects of T helper cell function in newly
diagnosed patients with Hodgkin's disease.
Eur J Cancer 1994;30:1464-70.
(79) Huang M, Wang J, Lee P, Sharma S, Mao
JT, Meissner H, et al. Human non-small cell
lung cancer cells express a type 2 cytokine
pattern. Cancer Res 1995;55:3847-53.
(20) Maeurer MJ, Martin DM, Castelli C, Elder
E, Leder G, Storkus WJ, et al. Host immune
response in renal cell cancer interleukin-4
(IL-4) and IL-10 mRNA are frequently
detected in freshly collected tumor-infiltrating lymphocytes. Cancer Immunol Immunotherl995;41:lll-21.
Notes
Supported by grants from Istituto Superiore di
Sanita "VII Progetto AIDS 1994 and VIII Progetto
AIDS 1995" (M. Clerici); and by grant CNRACRO n. 95. 00486. PF 39; 1995 (E. Clerici).
Correspondence to: Gene M. Shearer, Ph.D.,
National Institutes of Health, Bldg. 10, Rm. 4B17, Bethesda,MD 20892.
462
CORRESPONDENCE
Phase II Studies: Which
Is Worse, False Positive or
False Negative?
When comparing treatments in phase
III studies, we judge whether a new
treatment is superior to a standard control. In this case, the control is of known
efficacy and should not be superseded
without serious evidence of the superiority of its competitor. Accordingly,
we set the chance of a false positive to
5% (a = 0.05 = type I error) and the
chance of a false negative to a larger
number, say 20% or less (P = 0.2 = 1 power = type II error), in the extreme.
These error limits are used to determine
study design elements, such as sample
size and stopping rules.
In phase II trials, the relative costs of
false-positive and false-negative conclusions may be reversed (J). On the one
hand, we do not want to inflict an ineffective treatment on more patients than
is absolutely necessary, but we do not
want to reject a potentially effective
treatment. The cost of a false positive in
phase II trials is that of repeated studies,
which will eventually demonstrate the
lack of efficacy. However, the cost of a
false negative is that a useful treatment
is completely discarded.
Statisticians usually assign a higher
cost to false positives than to false negatives. This practice is appropriate for
phase III studies, but is misplaced in
phase II studies. Accordingly, if we
were to set the chance of a false positive
to, say, a = 0.15 and the chance of a
false negative to P = 0.05, we would be
protecting the new treatment from an
untimely demise. Furthermore, to a first
approximation, sample size should not
be affected by this interchange. For example, suppose we test the null hypothesis that a treatment has a 15%
response frequency versus the alternative of a 35% response frequency. We
use an early-stopping design to limit the
use of a clearly ineffective treatment.
The study will be stopped early if fewer
than three responses are observed
among the first 17 patients, and the
treatment is deemed ineffective. Otherwise, after evaluating 35 patients, if nine
or more responses are observed, we may
reject the null hypothesis. The trial has a
2.8% type I error and an 83% power
(17% type II error). If we change the cut
point from nine to seven responses,
using the same sample size, the trial has
a 13% type I error and a 94% power
(6% type II error). The sum of error
probabilities is about the same for both
arrangements, but the second design
protects an effective treatment from
premature rejection. Moreover, by increasing power from 83% to 94%, we
have decreased the false-negative error
probability by a factor of three.
We recommend this shift of emphasis
in future phase II trials.
ANDRE ROGATKO
SAMUEL LTTWIN
Department of Biostatistics
Fox Chase Cancer Center
Philadelphia, PA
Reference
(/) Herson J. Statistical aspects in the design and
analysis of phase II clinical trials. In: Buyse
ME, Staquet MJ, Sylvester RJ, editors. Cancer
clinical trials: methods and practice. Oxford:
Oxford Univ Press, 1992:239-57.
Note
Correspondence to: Andr6 Rogatko, Ph.D.,
Department of Biostatistics, Fox Chase Cancer
Center, 7701 Burholme Ave., Philadelphia, PA
19111.
Are Time or Intensity Factors
Important to the Definition
of Metastases of
Unknown Origin?
Barista et al. (7) have recently
proposed that time and intensity factors
should be incorporated into the definition of metastasis of unknown origin
(MUO), suggesting that "MUO be defined as the presence of metastatic illness with an unknown primary site after
2 weeks of intensive investigation."
While it is interesting to draw a diagnostic parallel between the definition of
fever of unknown origin (2) and MUO,
our data suggest that the specific diagnostic studies employed during the
evaluation are more important than time
or intensity.
Journal of the National Cancer Institute, Vol. 88, No. 7, April 3, 1996