US 20070030258A1
(19) United States
(12) Patent Application Publication (10) Pub. No.: US 2007/0030258 A1
Pittel et al.
Feb. 8, 2007
(43) Pub. Date:
(54)
CAPTURING HANDWRITING
and Which is a continuation-in-part of application No.
09/376,837, ?led on Aug. 18, 1999, noW Pat. No.
(76) Inventors: Arkady Pittel, Brookline, MA (US);
6,577,299.
Ilya Schiller, Brookline, MA (US);
Sergey Liberman, Bedford, MA (US);
(60)
Provisional application No. 60/161,752, ?led on Oct.
27, 1999. Provisional application No. 60/195,491,
Ethan A. Funk, Boston, MA (US);
Vladimir V. Subach, Lexington, MA
(US); Andrew M. Goldman,
Wake?eld, MA (US); Leonid Reznik,
?led on Apr. 10, 2000. Provisional application No.
60/230,912, ?led on Sep. 13, 2000. Provisional appli
cation No. 60/142,200, ?led on Jul. 1, 1999. Provi
sional application No. 60/142,201, ?led on Jul. 1,
1999. Provisional application No. 60/096,988, ?led
on Aug. 18, 1998.
Sudbury, MA (US)
Correspondence Address:
FISH & RICHARDSON PC
P.O. BOX 1022
Publication Classi?cation
MINNEAPOLIS, MN 55440-1022 (US)
(21) Appl. No.:
(22)
Filed:
Int. Cl.
(52)
US. Cl.
G09G 5/00
Jan. 6, 2006
(57)
Related US. Application Data
(60)
(51)
11/327,302
Division of application No. 10/ 623,284, ?led on Jul.
17, 2003, Which is a continuation of application No.
09/698,471, ?led on Oct. 27, 2000, noW abandoned,
(2006.01)
............................................................ .. 345/179
ABSTRACT
Motion of a Writing instrument is tracked from sensors
located in the vicinity. The signals generated from the
sensors are processed and used in a Wide variety of Ways.
' 263
.
Patent Application Publication
Feb. 8, 2007 Sheet 1 0f 30
FIG. 1
US 2007/0030258 A1
Patent Application Publication
Feb. 8, 2007 Sheet 2 0f 30
é/19
FIG. 2
US 2007/0030258 A1
Patent Application Publication
Feb. 8, 2007 Sheet 3 0f 30
/"
US 2007/0030258 A1
*502
3/’
/506
\
508
FIG. 3
Patent Application Publication
Feb. 8, 2007 Sheet 4 0f 30
FIG. 4
US 2007/0030258 A1
Patent Application Publication
Feb. 8, 2007 Sheet 5 0f 30
US 2007/0030258 A1
\4/\ \
FIG. 5
V
Patent Application Publication
Feb. 8, 2007 Sheet 6 0f 30
FIG. 6
FIG. 7
US 2007/0030258 A1
Patent Application Publication
EIS V
Feb. 8, 2007 Sheet 7 0f 30
US 2007/0030258 A1
Patent Application Publication
Feb. 8, 2007 Sheet 8 0f 30
/-56
.
()©
l
0
US 2007/0030258 A1
/-60
I
@0
\62
FIG. 10
Patent Application Publication
Feb. 8, 2007 Sheet 9 0f 30
FIG. 12
US 2007/0030258 A1
Patent Application Publication
Feb. 8, 2007 Sheet 10 0f 30
(KO
FIG. 13
US 2007/0030258 A1
Patent Application Publication
Feb. 8, 2007 Sheet 11 0f 30
FIG. 14
US 2007/0030258 A1
Patent Application Publication
Feb. 8, 2007 Sheet 14 0f 30
US 2007/0030258 A1
FAILURE
@
FAILURE
—@
@
L _______________________ _ fBLLUBE____________ __
:
v
w
v
v
ERRoR STATE 3
ERRoR STATE 2
ERRoR STATE 1
3 red blinks
3 red blinks
1 red blink
I
®
:
:
i
' _®
.
I
___________________________________________ __|
Rs 232 our
Success
‘gig/‘(5%’?
steady green
RS 232 IN
0
S
v
v
E
Q
[ Power 0”
A
A
SELF- CHECK
6‘
A 5ACOUSITIONbO/Nk
many green in s
(transition state) ENOIZEéIHOgLCE as pages in memory
‘\
1
RAnEQWLoW
Pen Out
Enough
Space
U53 IN
.
use our
(also see note)
IN FLASH
v
PEN. .IN. _®
in Flash
I use IN ]
blinking green
PEN IN
—@
PEN OUT
Ffg‘??
FLASH FULL
FLASH FULL
FILE OPERATION COMPLETE
yellow
doubleblinks
<——————®
PEN is IN
NOTE.‘
If battery is near dead (10 minutes from
death), 1 yellow blink is added to the
indication
In all states when battery is very low firmware powers
SPUTN/K down
FIG. 19A
(D
Patent Application Publication
Feb. 8, 2007 Sheet 15 0f 30
US 2007/0030258 A1
UPLOAD PAGE
Remove It from ?ash if successful
®.i____t
A
I
©'
I
CHECK USER ACCOUNT
|
)
IL
ESTABLISH INTERNET CONNECTION WITH DI2 SERVER )
A
FAILURE
ESTABLISH INTERNET COMMUNICATION WITH MODEM
DIAL UP
ESTABLISH PPP CONNECTION
,
c I. _______ § _____________________________________ EEGL'PI'L'ILI
G
PEN DETECTED
e
PEN DETECTED
ACQUISITION ON
no light
<
(also see NOTE)
PEN OFF PAPER
V
.
0’ PAPER CUP 0N (unl'kely)
ACTIVE ACQUISITION I
Pale 9men
(also see NOTE)
PEN IN
(Di or PAPERCLé/Z
NEW PA ON
(
v
) FILE OPERATION COMPLETE
‘
PEN is OUT
IF THERE ARE NEW
PIXELS
NEW FILE IS CREATED
Steady yellow
®
FLASH IS NEAR FULL
USB COMMANDS AVAILABLE
(L)
(atgjgpged
all steady
states)
get inpage
file names
Download File
Steam/state
Remove ?le
Put settings
Get current firmware version
H6‘ 198
Refgrmat
II/e systfem on flash
rogram new Irmware
Get date and time
Set date and time
‘I
Transition state
Patent Application Publication
M
Feb. 8, 2007 Sheet 16 0f 30
Tbursts = 1Hz
_ Iled0n=100H€
WW
FIG. 20
US 2007/0030258 A1
Patent Application Publication
Feb. 8, 2007 Sheet 17 0f 30
US 2007/0030258 A1
100Hz
601\
<
:
FRAME HATES
LED 01v
1
TZUOHZ
<
2
3
>
LED OFF
4
5
~
6
7
7
8
9
=
10 11 12
>
GOOHZ
<1:2<3:4<5>6
300HZ
:
1
>=
FIG.Z1
(0, 0) ‘
FIG. 22
2
>=
3
:
Patent Application Publication
Feb. 8, 2007 Sheet 18 0f 30
N
:(
l\
1/" Amp/men
|\
K
Act've
0,307
HPF
*
‘L {>
Amplifier:
K
i>
Active
0/307
HPF
—i>
<9
MD
*ACm/e
HPF
m
r1 lI>
l( -[>
l' ' :
g
y‘47 A’Z’Lg’f’
A52‘?
J,
/
603
-
j
Inverted gain
+/-1
.,
=D
of each
:i
51;):
l
Chopper with Integrator / i
inverted gain
r\
Ky
I
i
E
i:
8
I I20 E
5
E
K
|-_-,:
i
' 1? i:
'
l/
iii/15;:
5‘
L__}I
'
l
M, Integrator
Chopper
w/ih
lnveriedga/n
Q,
maize
|\
mg
:L____,:
\ 609 \ 611 Vac 00/00
Analog
frequency
l
:q ;U
:50’?
:
:E i
12 i§ 5‘:
Detection of
modulation
___|:
:
U’>—Wi>——-i bin?
5
X
D l
Integrator LL15; 2,; §&.@
W607
605
i
—|(—
+/-1
a
: 12H
inverted gain
D p
“5755'?”
____ |----,< INT
k<——— lnte rater : mi;I I
Chopper with
g
n- I
+/-l
a
US 2007/0030258 Al
|
-
-
‘
-
invert/on modulation
-
frequency
channel
FIG. 23
\67 3
i+
-
Patent Application Publication
Feb. 8, 2007 Sheet 19 0f 30
US 2007/0030258 A1
Normal Mode- ‘
during
Idle
—><— Continuos —><——-—-
writing
.
Idle
mode
.
Storage to Flash
Periodic
'
Acquisition
?ti
—><— Sleep mode ——>
m we
' 4" memory
__>
if
- -- --t-1-0-0-/_I---~ - -
sampling
_
Processor and on-pen
when page is full
frequency
Standby mode
’
and Filling up
available RAM
Wake up
End of Data
No data
processor on
Acquisition-
aquisition;
detection of
Flash page
optical signal
and Start Data
size filled in
HAM
Acquisition
electronics are in
FIG. 24
'
no traces
made; no
interrupts