US 20150046806A1
(19) United States
(12) Patent Application Publication (10) Pub. No.: US 2015/0046806 A1
Anderson et al.
(43) Pub. Date:
Feb. 12, 2015
(54)
PERSONAL USER HIGHLIGHT FROM
POPULAR HIGHLIGHTS
Publication Classi?cation
(51)
(71) Applicant: Amazon Technologies, Inc., Seattle, WA
(Us)
Int. Cl.
G06F 3/0483
G06F 3/0484
G06F 17/24
(72) Inventors: Emily Margaret Anderson, Seattle, WA
(52)
(US); Tom Killalea, Seattle, WA (U S)
(2006.01)
(2006.01)
(2006.01)
U.S. Cl.
CPC ............ .. G06F 3/0483 (2013.01); G06F 17/24
(2013.01); G06F 3/04842 (2013.01)
USPC
(21) Appl. No.: 14/524,388
........................................................ ..
(57)
(22)
Filed:
Oct. 27, 2014
715/273
ABSTRACT
A popular highlight may be presented to a user Who Wishes to
make the popular highlight a personal user highlight. Upon
Related US. Application Data
(62) Division of application No. 12/852,963, ?led on Aug.
9, 2010, noW Pat. No. 8,893,030.
activation of a control, a personal user highlight is generated
from the popular highlight. The user may then manipulate the
resulting personal user highlight as they would any other user
highlight.
f
HTlPil/MERCHANT-STORE.COM/PRODUCT/ROMEOJULIET
Romeo & Juliet
4/- 1204
by William Shakespeare
$29.99 USD
Romeo 8.
Juliet
— 1208
Average Review:
1i.
HIGHLlGHT
I ’
\ HiGHLlGHTED PASSAGES
CONTEXT
1218
\\ bite my thumb at them; which is a disgrace
to them
POPULAR!
Nay, as they dare.
I will
BITE MV THUMB AT
1220 \
THEM;
\ in fair Verona, where we lay our scene,
1222 \
WHICH IS A DISGRACE
TO THEM,
\ Myself condemned and myself excused.
L
1216J
if they bear it.
1200
Patent Application Publication
Feb. 12, 2015 Sheet 1 0f 22
US 2015/0046806 A1
[
100
DIGITAL CONTENT
118 x
r
I
_
\
USER HlGHLlGHT
Let us take the law of our Sldes; let them begun. ,/ 106
GREGORY
You, 23 Highlighters
HiGHUGHT
\ MATCH
I will frown as I pass by, and let them take it as
'1N1LL'CATOR
they list.
POPULAR HlGHLlGHT
’— 112
SAMPSON
Nay, as they dare. lwllllbite my thumb at them;|
|whioh is a disgrace to them,|if they bear it.
\
\
\
\
\
\
NETWORK
HlGHLlGHT(S)
108
HlGHLlGHTER
102(1)
I
104(1)
HIGHLlGHT
MATCH
INDICATOR 114
HlGHLlGHT(S)
106M)
POPULAR
HlGHLlGHT(S)
112
HlGHLlGHTER
HlGHLlGHT
SERVER(S)
110
1
READER 104(2)
116
Patent Application Publication
Feb. 12, 2015 Sheet 2 0f 22
US 2015/0046806 A1
HIGHLIGHT SERVER
m
[
PROCESSOR &
]
MEMORY
E
DIGITAL CONTENT COLLECTION MODULE
206
DIGITAL
T MER
HI HLI HT
gL/iiAgASE
CONTENT
208
DATABASE
212
M
210
"T"
k
DiTABiSE
I
II
HIGHLIGHT PROCESSING MODULE
214
H I G HU G HT
H IGHu G HT
HIGHLIGHT
ACQUISITION
MODULE
ASSESSMENT
MODULE
SELECTION MODULE
220
216
218
—
k
l
L
V
CLIENT
222
[
PROOEssOR 224
1
MEMORY
226
HIGHLIGHT FILE
230
HIGHLIGHT USER
INTERFACE MODULE
228
l
I
>
USER
POPULAR
HIGHLIGHTS
106
HIGHLIGHTS
112
L
FIG. 2
L
=
Patent Application Publication
Feb. 12, 2015 Sheet 3 0f 22
US 2015/0046806 A1
/
300
POSITION
304
PASSAGE
“
.
.
.
.
.
.
.
302 |\WI|| bItg my thurgb aithein; thQh IS\ a\dIsg(ace tq the\m, I \c thgy be‘ar It. Do
\
\‘
‘\
\:
‘
\\
\
\\
\\
\\
\
\
\
POSITION
\ \
\
\
8
\
\\
\
\
\
\
A
B
POPULAR
OiNT
306
\
\
I
\\
‘\
\
9101112131415161718
lGHLlGHT
HIGHLIGHT START
p
\
\
USER HIGHLIGHT
310
FIG. 3
HIGHLIGHT
END POINT
308
,,
Patent Application Publication
Feb. 12, 2015 Sheet 4 0f 22
US 2015/0046806 A1
/
ACQUIRE USER HIGHLIGHTS, EACH
HIGHLIGHT COMPRISING A START AND AN
END POINT
?
V
GENERATE SCORES FOR THE USER
HIGHLIGHTS
404
V
RANK THE USER HIGHLIGHTS BY THE
SCORE
406
V
r
1
SELECT HIGHEST RANKED HIGHLIGHT(s)
408
V
DESIGNATE HIGHEST RANKIED
HIGHLIGHT(s) AS A POPULAR HIGHLIGHT
410
V
REMOVE THE USER HIGHLIGHTS WHICH
OVERLAP AND/OR ARE ADJACENT TO THE
POPULAR HIGHLIGHT(S)
II
STORE THE POPULAR HIGHLIGHTS
414
FIG. 4
400
Patent Application Publication
Feb. 12, 2015 Sheet 5 0f 22
US 2015/0046806 A1
/ 500
SET HIGHLIGHT MINIMUM LENGTH AND
HIGHLIGHT MAXIMUM LENGTH
502
V
DISCARD HIGHLIGHTS HAVING A LENGTH
LESS THAN THE MINIMUM LENGTH OR
GREATER THAN THE MAXIMUM LENGTH
504
II
DESIGNATE AN ORIGIN POSITION
506
V
SELECT A TYPE OF HIGHLIGHT POINTS
(I.E., “START POINT" OR “END POINT")
508
V
DETERMINE A WEIGHT FOR HIGHLIGHT
POINTS OF THE SELECTED TYPE, THE
WEIGHT BASED AT LEAST IN PART UPON
RELATIVE DISTANCE FROM THE ORIGIN
POSITION
ilQ
V
r
1
GENERATE POSITION SCORE BY SUMMING
THE WEIGHTS FOR HIGHLIGHT POINTS OF
THE SELECTED TYPE FOR THE
DESIGNATED ORIGIN POSITION
512
FIG. 5
Patent Application Publication
Feb. 12, 2015 Sheet 6 0f 22
US 2015/0046806 A1
/
SELECT THE “START POINT” TYPE OF
HIGHLIGHT POSITION
602
II
' DETERMINE A HIGHEST RANKING START ‘
POINT POSITION HAVING A HIGHEST
POSITION SOORE
6.44
II
DESIGNATE THE HIGHEST RANKING START
POINT POSITION AS A POPULAR
HIGHLIGHT START POINT
@
II
SELECT THE “END POINT" TYPE OF
HIGHLIGHT POSITION
608
II
DETERMINE A HIGHEST RANKING END
POINT POSITION HAVING A HIGHEST
POSITION SCORE
QLQ
II
DESIGNATE THE HIGHEST RANKING END
POINT POSITION AS A POPULAR
HIGHLIGHT END POINT
w
FIG. 6
600
Patent Application Publication
Feb. 12, 2015 Sheet 7 0f 22
US 2015/0046806 A1
/
700
STARTING POINT SCORES
SCORE FOR EACH WORD POSiTION
OR1O1N
WORD
1
2
3
4
5
6
7
3
TOTAL
13 SCORE RANK
13
1
2.00
-
0.67
-
-
0.17
-
0.13
-
0.03
-
0.06
3.09
2
2
1.00
-
1.00
-
-
0.20
-
0.14
-
0.03
-
0.06
2.49
3
3
0.67
-
2.00
-
-
0.25
-
0.17
-
0.09
-
0.06
3.24
1
4
0.50
-
1.00
-
-
0.33
-
0.20
-
0.10
-
0.07
2.20
f5
5
0.40
-
0.67
-
-
0.50
-
0.25
-
0.11
-
0.07
2.00
/7
6
0.33
-
0.50
-
-
1.00
-
0.33
-
0.13
-
0.03
2.37
/4
7
0.29
-
0.40
-
-
0.50
-
0.50
-
0.14
-
0.03
1.91
3
0.25
-
0.33
-
-
0.33
-
1.00
-
0.17
-
0.09
2.17
14
0.14
-
0.17
-
-
0.11
-
0.14
-
0.50
-
0.20
1.26
13
0.11
-
0.13
-
-
0.03
-
0.09
-
0.17
-
1.00
1.57
/
3
/
6
/
10
/
9
POPULAR HIGHLIGHT START POINT /
ENDING POINT SCORES
704
706\
SCORE FOR EACH P03171031
OR1O1N
7
3
0
10
11
12
13
14
15
16
TOTAL
17 SCORE RANK
7
1.00
-
-
-
-
0.17
0.14
0.13
-
0.10
0.09
1.63
7
3
0.50
-
-
-
-
0.20
0.17
0.14
-
0.11
0.10
1.22
11
9
0.33
-
-
-
-
0.25
0.20
0.17
-
0.13
0.11
1.19
12
10
0.25
-
-
-
-
0.33
0.25
0.20
-
0.14
0.13
1.30
10
11
0.20
-
-
-
-
0.50
0.33
0.25
-
0.17
0.14
1.59
3
12
0.17
-
-
-
-
1.00
0.50
0.33
-
0.20
0.17
2.37
4
13
0.14
-
-
-
-
0.50
1.00
0.50
-
0.25
0.20
2.59
‘1
14
0.13
-
-
-
-
0.33
0.50
1.00
-
0.33
0.25
254
7'2
15
0.11
-
-
-
-
0.25
0.33
0.50
-
0.50
0.33
2.03
16
0.10
-
-
-
-
0.20
0.25
0.33
-
1.00
0.50
2.33
17
0.09
-
-
-
-
0.17
0.20
0.25
-
0.50
1.00
2.21
13
0.03
-
-
-
-
0.14
0.17
0.20
-
0.33
0.50
1.43/
POPULAR HIGHLIGHT END POINT /
708
FIG. 7
/6
/
/
3
5
9
Patent Application Publication
Feb. 12, 2015 Sheet 8 0f 22
US 2015/0046806 A1
/
POSITION
704
PASSAGE
“
.
800
.
_
.
.
\
to\ them,
\
if\ they
\ bear
\ it.\
702 {\wQLbRG myjhurpfn a: Shem, thOh Is\ a\ disgrace
\
\
\\
\
\
\\\\\\\
\\ \ \\\ \\\ \ \\ \
\
\
\
\\
\
\
POSITION
USER
HIGHLIGHT
\\ \\
\
\
\
\
\\
\
\
\
\ \ \ \ \\ \
\
\
\
\
\\
\
\
\
\
DOI
\
\ \ \\ \
\
\
\
\
\
\
\\ \\ \
\
\
~
\
‘\
\
\
\
\\
\I
‘
\
\
\
\
\
123456789101112131415161718
A
B
C
D
E
F
POPULAR
GPOPULAR
4 z
A
HIGHLIGHT START
POINT
704
POPULAR HIGHLIGHT
802
POPULAR
HIGHLIGHT END
POINT
708
NON-OVERLAPPING, NON-ADJACENT HIGHLIGHT
804
FIG. 8
Patent Application Publication
Feb. 12, 2015 Sheet 9 0f 22
/
SELECT THE USER HIGHLIGHTs
902
II
GENERATE A USER HIGHLIGHT SCORE
FOR EACH OF THE USER HIGHLIGHTS BY
SUMMING THE POSITION SCORES OF THE
START POINT AND THE END POINT
904
V
r
w
DETERMINE A HIGHEST RANKING USER
HIGHLIGHT HAVING THE HIGHEST USER
HIGHLIGHT SCORE
%
II
DESIGNATE THE HIGHEST RANKING USER
HIGHLIGHT As A POPULAR HIGHLIGHT
906
FIG. 9
US 2015/0046806 A1
900
Patent Application Publication
Feb. 12, 2015 Sheet 10 0f 22
co|\p
US 2015/0046806 A1
K
mam 5% ow.m Eim “me
\
2
m
0
i
3
n
:
a
9
o
m
me
F
woo
t
we
.QEor
m
v
2Z1IO03Ew<ma
N
Mme
PIG Q
<cooaLuu_O
Patent Application Publication
Feb. 12, 2015 Sheet 11 0f 22
US 2015/0046806 A1
1100
/
POSITION
704
PASSAGE
702
H
_
_
_
_
I
_
,
u
|\Wl\||
\ \bItg\my \thurpb\ a1 them; th1 Is\, a\dIngace tO the\m, Ifthgy be‘ar It\. Do1
\:\\\\\\\\
\\\\ \\\ \\ \ \\\\
\\ \ \\\ \\\ \\\ \\\ \ \ \ \\
\ \\ \
\\ \\ \\ \
\ \\
\
\
\
\
\\ \\\\ \\
POSITION
USER
HIGHLIGHT
\
\
\ \\ \\
\
\
\
\
\\
\
\
\\
\\
\\
\\
\
I
\
\
123456789101112131415161718
A
B
C
D
E
F
G
A»
POPULAR
POPULAR
f
4 i
/
%
HIGHLIGHT START
POINT
1102
4
POPULAR
HIGHLIGHT END
POINT
1104
POPULAR HIGHLIGHT
1002
NON-OVERLAPPING, MGM-ADJACENT HIGHLIGHT
804
FIG. 11
Patent Application Publication
com1\?
wow;-
Feb. 12, 2015 Sheet 12 0f 22
mom1 ?
59:1 meo
wo6:E3o.m
US 2015/0046806 A1
E\mwzn=5>xmsw $m.m:e
gm?
2549“w“z8Eo>8:m/E23>v5?a
4ELn922mESo6Q5/cW5;o.0E”m>
4tn.mucw/Esom>xE§
:652
/ /
N N/Fl
Patent Application Publication
Feb. 12, 2015 Sheet 13 0f 22
US 2015/0046806 A1
/
4
.
HIGHLIGHTER
102(1)
a
USER
HIGHLIGHT
;"'
SAMPSON
1302 _\
Let us take the law of our sides; let them begin.
GREGORY
I will frown as I pass by, and let them take it as
they list.
SAMPSON
Nay, as they dare. I will bite my thumb at them;
which is a disgrace to them, it they bear it.
Enter ABRAHAM and BALTHASAR
ABRAHAM
Do you bite your thumb at us, sir?
SAMPSON
I do bite my thumb, sir.
[
HIGHLIGHT /
CONTROL
Move cursor to highlight text.
DEVICE
104(1)
FlG. 13
]
1 300
Patent Application Publication
Feb. 12, 2015 Sheet 14 0f 22
US 2015/0046806 A1
[—
HiGHLiGHTER
I
102(1
|
’SAMPSON
1 400
‘
r1302
Let us take the law of our sides; let them begin.
HIGHLIGHT
I Will frown as | Pass by, and let them take it as
e MATCH
'
INDICATOR
they list.
1402
SAMPSON
Nay, as they dare. I will bite my thumb at them;
which is a disgrace to them, if they bear it.
Enter ABRAHAM and BALTHASAR
ABRAHAM
Do you bite your thumb at us, sir?
SAMPSON
I do bite my thumb, sir.
[
Move cursor to highlight text.
DEVICE
104(1)
FIG. 14
1
Patent Application Publication
Feb. 12, 2015 Sheet 15 0f 22
/
RECEIVE A USER HIGHLIGHT
1502
V
ACCESS A STORE OF COMMUNITY
HIGHLIGHTS
1504
V
COMPARE THE USER HIGHLIGHT WITH
THE COMMUNITY HIGHLIGHTS TO
DETERMINE CORRESPONDING
COMMUNITY HIGHLIGHTS
?
V
GENERATE A HIGHLIGHT MATCH
INDICATOR
1508
V
PRESENT THE HIGHLIGHT MATCH
INDICATOR
1510
FIG. 15
US 2015/0046806 A1
1 500
Patent Application Publication
Feb. 12, 2015 Sheet 16 0f 22
US 2015/0046806 A1
/
1600
l
HIGHLIGHTER
102(1)
’SAMPSON
f 1302
Let us take the law of our sides; let them begin.
GREGORY
I will frown as I pass by, and let them take it as
they list.
POPULAR
HIGHLIGHT -
802 \ Nay, as they dare. I willlbite my thumb at them;|
which is a disgrace to them,| if they bear it.
Enter ABRAHAM and BALTHASAR
ABRAHAM
Do you bite your thumb at us, sir?
SAMPSON
I do bite my thumb, sir.
[
Alt-M to convert Popular Highlight to a Personal Highlight
k
HIGHLIGHT /
CONTROL
]
A
DEVICE
104(1 )
FIG. 16
Patent Application Publication
Feb. 12, 2015 Sheet 17 0f 22
US 2015/0046806 A1
/
HlGHLlGHTER
1 700
I
102(1)
'SAMPSON
»— 1302
Let us take the law of our sides; let them begin.
GREGORY
I will frown as I pass by, and let them take it as
they list.
PERSONAL
SAMPSON
USER _\
HIGHLIGHT
1702
Nay, as they dare. I will bite my thumb at them'I
which is a disgrace to them, if they bear it.
Enter ABRAHAM and BALTHASAR
ABRAHAM
Do you bite your thumb at us, sir?
SAMPSON
I do bite my thumb, sir.
/[
1306 /
Move cursor to highlight text.
DEVlCE
104(1)
FIG. 17
}
Patent Application Publication
Feb. 12, 2015 Sheet 18 0f 22
cow1\?
US 2015/0046806 A1
$035.: me:
A///\\SmEoS:m\o
/\?g/\"
<62>9:.25ED655.2£t2Mm>Q08mm>8mE29m_u:;Ee
EsotE>>_=3E59:H295<5
.6:>9:mm33
/6..m59:3*0Emma59:22“ESmm50waw
Mm;ijng
A\cm\e?
ww056Ebm19:4/=n2w0>om,x1:cw
\
/ 1@owr
onz/i
2wom25DE30>50>E.w:
560me zow12<m
.ta255
Patent Application Publication
Feb. 12, 2015 Sheet 19 0f 22
US 2015/0046806 A1
20me m50u3Jm19: Now? 50:19 lJo/Ezo
l
l
/
mo\an\
A\g w
wEo56m:za2=o>x,mcw
\
\
EMPIODQ
..6.5meEwEH262%E.“>22mi95Sow:
A§2\
\
_/
gmon9595%E30>50>6:
Zf/ OWn//=2<w
5minuom 0:1/. mom?