US006241686B1
(12) United States Patent
Balkin et al.
(54)
SYSTEM AND METHOD FOR PREDICTING
HUMAN COGNITIVE PERFORMANCE
USING DATA FROM AN ACTIGRAPH
(75)
Inventors: Thomas J. Balkin, Ellicott City;
Gregory L. Belenky, Kensington;
Stanley W. Hall, Silver Spring; Gary
H. Kamimori, Laurel; Daniel P.
Redmond, Silver Spring; Helen C.
Sing, Takoma Park; Maria L. Thomas,
Columbia, all of MD (US); David R.
Thorne, Washington, DC (US); Nancy
Jo Wesensten, Silver Spring, MD (US)
(73)
Assignee: The United States of America as
represented by the Secretary of the
Army, Washington, DC (US)
Notice:
Subject to any disclaimer, the term of this
patent is extended or adjusted under 35
U.S.C. 154(b) by 0 days.
Jun. 5, 2001
4/1994 CZeisler et al. .
9/1994 Fukuoka .
7/1995 Moore-Ede et al. .
(List continued on neXt page.)
OTHER PUBLICATIONS
Theodore R. Colburn et al., “An Ambulatory Activity Moni
tor With Solid State Memory,” paper presented at the 13th
Annual Rocky Mountain Bioengineering Symposium and
13th International ISA Biomedical Sciences Instrumentation
Symposium (Instrument Society of America), May 3—5,
1976, p. 117—122.
D.F. Kripke et al., “Wrist Actigraphic Measures of Sleep and
Rhythms,” Electroenephalography and Clinical Neurophysi
ology, 1978, vol. 44, pp. 674—676.
Daniel P. Redmond et al., “Observations on the Design and
Speci?cation of a Wrist—Worn Human Activity Monitoring
System,” Behavior Research Methods, Instruments, & Com
puters, 1985, vol. 17, Issue 6, pp. 659—669.
G. Belenky et al., “Sustaining Performance During Continu
ous Operations: The US. Army’s Sleep Management Sys
pp. 1—5.
(List continued on neXt page.)
Related US. Application Data
(51)
(52)
(58)
5,304,212
5,348,370
5,433,223
US 6,241,686 B1
tem,” Proceedings of the Army Science Conference, 1996,
(21) Appl. No.: 09/389,351
Sep. 3, 1999
(22) Filed:
(60)
(10) Patent N0.:
(45) Date of Patent:
Provisional application No. 60/106,344, ?led on Oct. 30,
Primary Examiner—Robert L. Nasser
(74) Attorney, Agent, or Firm—EliZabeth ArWine; Charles
1998, and provisional application No. 60/122,541, ?led on
Mar. 2, 1999.
H. Harris
Int. Cl.7 ...................................................... .. A61B 5/00
(57)
US. Cl. ......................... .. 600/544; 600/545; 600/300
Field of Search ................................... .. 600/544, 545,
A system and a method for providing a determination of
600/300; 186/857, 858
References Cited
(56)
U.S. PATENT DOCUMENTS
ABSTRACT
predicted cognitive performance of an individual based the
time of day and on factors including sleep history based on
activity data from an actigraph. The system and the method
provide a numerical representation of the predicted cogni
tive performance. Both may be used to optimize the Work
schedule of the actigraph Wearer to maximize the cognitive
4,893,291
5,006,985
5,197,489
5,259,390
1/1990 Bick et al. .
4/1991 Ehret et al. .
capacity during Working hours.
3/1993 Colan.
11/1993 Maclean.
53 Claims, 22 Drawing Sheets
Time Of Day Function
m(t) or M,‘: F+A1* cos(2Pi(t—V1)/P1)+A2* cos(2Pi(t-V2)/P2)
87
Cognitive /
S10
Predicted
Performance
Capacity
Cognitive
Performance
Cn...Ct
Et= Ct* Mt
US 6,241,686 B1
Page 2
US. PATENT DOCUMENTS
5,566,067
10/1996 Hobson et al. .
5,568,127
5,570,698
10/1996 Bang .
11/1996 Liang et al. .
5,573,013
5,585,785
5,595,488
5,647,633
11/1996
12/1996
1/1997
7/1997
5,682,144
10/1997 Mannik.
5,682,882 * 11/1997
Conlan .
Gwin et al. .
GoZlan et al. .
Fukuoka .
Liebeman ........................... .. 600/544
5,689,241
11/1997 Clarke, Sr et al. .
5,691,693
11/1997 Kithil .
5,720,294 *
2/1998
5,762,072
6/1998 Conlan et al. .
Skinner .............................. .. 600/544
5,911,581 *
6/1999
Reynolds et al. .................. .. 434/236
OTHER PUBLICATIONS
Thorne et al., “Plumbing Human Performance Limits Dur
ing 72 Hours of High Task Load,” Proceedings of the 24”1
DRG Seminar on the Human as a Limiting Element in
Military Systems, Defense and Civil Institute of Environ
mental Medicine, pp. 17—40 (1983).
Newhouse et al., “The Effects of d—Amphetamine on
Arousal Cognition, and Mood After Prolonged Total Sleep
Deprivation,” Neuropsychopharmacology, 1989, vol. 2, No.
2, pp. 153—164.
Dinges et al., “Cumulative Sleepiness, Mood Disturbance,
and Psychomotor Vigilance Performance Decrements Dur
ing a Week of Sleep Restricted to 4—5 Hours per Night,”
Sleep, 1997, vol. 20, No. 4, pp.267—277.
Hoddes et al., “Quanti?cation of Sleepiness: A New
Approach,” Pyschophysiology, Jul. 1973, vol. 10, No. 4,
pp.431—436.
Eus J. W. Van Someren, “Actigraphic Monitoring of Move
ment and Rest—Activity Rhythms in Aging, AlZheimer’s
Johns et al., “Daytime Sleepiness, Snoring and Obstructive
Disease, and Parkinson’s Disease,” IEEE Transactions on
vol. 103, No. 1, pp. 30—36.
Rehabilitation Engineering, Dec. 1997, vol. 5, No. 4, pp.
Akerstedt et al., “Subjective and Objective Sleepiness in the
Active Individual,” International Journal of Neuroscience,
1990, vol. 52, pp. 29—37.
Penetar et al., “Amphetamine Effects on Recovery Sleep
394—398.
Timothy H. Monk et al., “A Parallelism between Human
Body Temperature and Performance Independent of the
Endogenous Circadian Pacemaker,” Journal of Biological
Sleep Apnea: Epworth Sleepiness Scale,” Chest, Jan. 1993,
Following Total Sleep Deprivation,” Human Psychophar
Rhythms, Apr. 1998, vol. 13, No.2, pp.113—122.
macology, 1991, vol. 6, pp. 319—323.
Yuhui Shi et al., “Using Arti?cial Neural Network for
Fletcher et al., “A Predictive Model of Work—related Fatigue
Based on Hours of Work,” Journal of Occupational Health
Sleep/Wake Discrimination from Wrist Activity: Prelimi
nary Results,” Proceedings of the 20* Annual Internatonal
Conference of the IEEE Engineering in Medicine and Biol
ogy Society, 1998, vol. 20, No. 3, pp. 1113—1115.
M.R. Rosekind et al., “Alertness Management in Long—Haul
Flight Operations,” Proceedings of the 39”1 Annual Corpo
rate Aviation Safety Seminar, 1994, pp. 167—178 (printed
from the NASA website).
Advertiser ?yer for “The Actiwatch—Score,” Cambridge
and Safety, 1997, vol. 13, pp.471—485.
Murray Johns, “Rethinking the Assessment of Sleepiness,”
Sleep Medicine Review, 1998, vol. 2, No. 1, pp. 3—15.
Mitler et al., “Methods of Testing Sleepiness,” Behavioral
Medicine, 1996, vol. 21, pp. 171—183.
Thomas et al., “Regional Cerebral Metabolic Effects of
Prolonged Sleep Deprivation,” NeuroImage, 1998, vol. 7,
Neurotechnology.
No.4, p. S130.
Cole, et al., “Automatic Sleep/Wake Identi?cation from
Advertiser ?yer for “The Actiwatch Software,” Cambridge
Wrist Activity,” Sleep, 1992 vol. 15, No. 5, pp.461—469.
Neurotechnology.
Advertiser ?yer for “The Actiwatch and Actiwatch Plus,”
Cambridge Neurotecnology.
Cambridge Neurotechnology, printouts from company web
site
at
Newhouse et al., “Stimulant Drug Effects on Performance
and Behavior After Prolonged Sleep Deprivation: A Com
parison of Amphetamine, Nicotine, and Deprenyl,” Military
Psychology, 1992, vol. 4, pp. 207—233.
HTTP://WWW.CAMNTECH.CO.UK/
MAIN.HTML, Sep. 18, 1998.
* cited by examiner
U.S. Patent
Jun. 5, 2001
US 6,241,686 B1
Sheet 4 0f 22
FIG. 4(0)
S1
set 1, C0, and tLs
+
Input
SleepNVake
Data Dsw
S2
U.S. Patent
Jun. 5, 2001
Sheet 6 6f 22
8605 w>zEmo cmto
US 6,241,686 B1
w
Mgm
50
cozunm
_mE2xm u mtw cozua
mzc o ucmota
026360
_2
U.S. Patent
Jun. 5, 2001
Sheet 7 0f 22
US 6,241,686 B1
GE@
on
on
am?w la/mw ouw
U.S. Patent
Jun. 5, 2001
Sheet 8 0f 22
US 6,241,686 B1
FIG. 7(a)
\
set t, CO, and tLs
Input
SleepNVake
Data Dsw
4b
Dsw, = DswM
U.S. Patent
Jun. 5, 2001
Sheet 9 0f 22
US 6,241,686 B1
0
2m
.w9.53 0
mm>+
7
\am.w/
£6
6
E
.2
.J.
so
8;,
"2
2.6
+a.
.o
2E
E
2o
u1n|1-
4\
B
N6Sm
omm
422.w..o$59
n9568.~<|
Em
\
o:
how
+
mm>
ll».
E55.1:385n.6+"568
U.S. Patent
%m
m
mI
m0_ICZ:E|L-TF_I
M
wow
QMm
m..895wx>>
m.| éM/I
0QH.
+8
uJnLundQ %
eoueuuopad eAmu?og
m,0oc9n0doe0m,v28m>m0N_.b8
U.S. Patent
Jun. 5, 2001
Sheet 11 0f 22
US 6,241,686 B1
>60
6
;_:.—
mGE
0906
>8
@N>60
38
260
I I I
I I
0N? cow
I I
I
I I I
I I
I
I
I I
I
cm
wnwHdO %
eoueuwoyed aAmu?og)
0 60
U.S. Patent
Jun. 5, 2001
Sheet 12 0f 22
US 6,241,686 B1
0 :0
IH T ‘
IO
IG.
F
IT H
TI ' l
a
8
1-
‘
(D
(0
<1‘
wnwndo %
N
aaueuuoped eAmu?og
4Day
3
0 :0
Day2
0 :0 Day1
U.S. Patent
Jun. 5, 2001
Sheet 13 0f 22
US 6,241,686 B1
IT1 H l|F
FIG.//
0 :0
4Day
3
0 :0
Day2
0 :0
I
O
N
I
I
I
I
o
O
I
I
lj
o
00
I
I
l
I
o
(D
F1
I
I
I
O
'Q'
I
I
O
N
‘.
wnwndo %
esueuuoped GAlllU?OQ
O—I THI 0:0
Day1
U.S. Patent
Jun. 5, 2001
Sheet 14 0f 22
US 6,241,686 B1
FIG./2
O
N
CO
C
oooco
*
P
O
q‘
wnwndo %
O
N
esueuuoped aAmu?og)
ITUFHP]‘
O
0 :0
Day
4321
0 :0
U.S. Patent
Jun. 5, 2001
Sheet 16 0f 22
US 6,241,686 B1
I
II
I
I
I
I
l
I
l
I
II
I
I
I
I
0 :0
4Day
3
FIG.14
0 :0
2Day
1
I
I
II
I
II
I
I
VII
I
ITI
IIII
I
I1
I
I
I
I
l
I
I
8
I
II|I|I|III|WII|I
O
(D
O
(D
O
<l'
O
N
‘_
wnwHdO %
GOUBLUJOJJGCI eAmu?og
0
0 :0
U.S. Patent
Jun. 5, 2001
Sheet 17 0f 22
US 6,241,686 B1
GIQ
58Q83859608¢ :5QI28i8.£8260
Eg
.o? .2: .45
.3
umwndo 0/0
aouewJopad aAmu?og
o
v
U.S. Patent
Jun. 5, 2001
Sheet 18 0f 22
US 6,241,686 B1
3
Day
7
Manqd_tory‘
offdays
HlI[U? TlHIm H‘Il
'II'IrIIIIIIIIIIIIIII IIIIII-IIIIIIIIIIIIIIIIIIIIIIII
/
FIG.16
23465
Day
/ END Max60hours orne-adcuhtyed
0 :20
STAR
l i?l
q
O
O
O
<1‘
.
I'I'j
O
N
wnwndo %
aoueLuJopad aAmu?og
0
01
Day