US008532439B2
(12) United States Patent
(10) Patent No.:
Kosugiyama
(54)
(75)
(45) Date of Patent:
REPRODUCTION APPARATUS AND
JP
2006-203574
REPRODUCTION METHOD
JP
JP
2006203574
2007-066251
Inventor:
.
.
JP
Tsugumoto Kosuglyama, H1110 (JP)
_
(73) Ass1gnee: Olympus Imaging Corp., Tokyo (JP)
(*)
Notice:
US 8,532,439 B2
Subject to any disclaimer, the term of this
patent is extended or adjusted under 35
Sep. 10, 2013
8/2006
*
8/2006
3/2007
2008-11316
l/2008
JP
2008604625
20008
JP
2008-146624
6/2008
JP
2008146624
* 6/2008
W0
WO 2006/003516
l/2006
W0
WO 2006/115939
11/2006
OTHER PUBLICATIONS
U.S.C. 154(b) by 619 days.
Of?ce Action for Chinese Patent Application No. 201010117325.X,
(21) Appl. No.: 12/707,048
mailed Nov. 22, 2011 (5 pgs.) With translation (5 pgs.).
( 22 )
Notice of Rejection for Japanese Patent Application No. 2009
038608, mailed Feb. 26, 2013 (1 pg.) With translation (2 pgs.).
Of?ce Action for Chinese Patent Application No. 201010117325.X,
Filed;
Feb_ 17, 2010
(65)
Prior Publication Data
US 2010/0215274 A1
(30)
mailed APT 9, 2013 <7 PBS)
Aug. 26, 2010
* Cited by examiner
Foreign Application Priority Data
Primary Examiner i jayesh A Patel
(74) Attorney, Agent, or Firm * John C. Pokotylo; Straub &
Feb. 20, 2009
(JP) ............................... .. 2009-038608
pokotylo
(51) Int- Cl-
(57)
G06K 9/60
(52)
(58)
ABSTRACT
(2006.01)
_
_
_
_
_
U 5 Cl
A reproductlon apparatus lncludes an attribute 1nformat1on
USPC __________ __ 382/305. 382/118. 382/190, 348/130
recording unit for recording image attribute information in
Which an attribute Value representing an image attribute is set
Field of Classi?cation Search
for each of image, a target image selector for selecting an
image of interest from among the images, a search condition
USPC ........................ .. 382/118, 190, 305; 348/130
See application ?le for complete search history.
(56)
setting unit for setting, as a search condition, an attribute
References Cited
Value related to the image of interest set in the image attribute
information, a reproduction information generator for gener
U_S_ PATENT DOCUMENTS
ating reproduction information by setting one of pieces of
*
a
image attribute information that satis?es the search condition,
a search condition selector for selecting the search condition
ég?ig?eiteilélfx """
2007/0257985 A1 * 11/2007 Estevez et al‘ N
343/143
as a reproduction search condition, and a search result repro
2007/0277985 A1*
. 172/19
ducing unit for, When the reproduction search condition is
12/2007 Hager et a1. .
selected by the search condition selector, reproducing a
search result With respect to the image of interest by display
FOREIGN PATENT DOCUMENTS
CN
CN
101146178
3/2008
101167087
4/2008
JP
200251280
JP
2002-189757
JP
2002189757
JP
2005-244614
*
ing, on a display unit, an image Whose image attribute infor
.
.
.
.
.
7/2002
reproduction object.
7/2002
9/2005
18 Claims, 22 Drawing Sheets
7
2s
IMAGE ATrRIBuTE
sELEcTION
INFORMATION TABLE
OPERATION OF
(MAsTER TABLE)
TARGET IMAGE
IMAGE ATTRIBUTE
IMAGE ATTRIBUTE
INFORMATION HAVING
gircfgx?ggEARcH
SAME IMAGE ID
CONDITION
347
§
IMAGE ID
SEARCH
IMAGE
OONOITION
SELECTOR
SETTING UNIT
§ 29
IMAGE ATTRIBUTE
351 INFORMATION SATISFYING
349
§
TARGET
.
mat1on is designated W1th the reproductlon 1nformat1on as a
2s
OPERmION
.
20002
SEARCH
q
pEgiré?llsé?cH
CONDITION
RESULT TABLE
’ 291
LOCATION SEARCH
, 292
INFORMATION sATIsFYING
REPRODUCTION
LOCATION SEARCH
INFORMATION
GENERATOR
TEMPORARY TABLE
PERSON sEARcI-I
IMAGE ATTRIBuTE
CONDITION
S- 345
IMAGE
GENERATING/
IMAGE ATTR|BUTE
ATTRIBUTE
UPDATING
INFORMATION SATISFYING
IMAGE ATTRIBuTE INFORMATION
PERsON AND LOCATION
INFORMATION
REPRODUCT'ON
'
mm,
RESULT TABLE
PERSON AND
LOOATION sEARcI-I
RESULT TABLE
DISPLAY UPDATE
REQUEST
(WHEN UPDATING)
IMAGE OIsPLAY
DATA GENERATOR 7“ 355
_. 293
US. Patent
Sep. 10, 2013
Sheet 1 0f 22
US 8,532,439 B2
9»
REC PLAY
6
%
MENU
QB
W12
#13
US. Patent
Sep. 10, 2013
Sheet 2 0f22
US 8,532,439 B2
US. Patent
Sep. 10, 2013
Sheet 3 0f 22
US 8,532,439 B2
F|G.3
—
IMAGE FILE
IMAGE ID
N270
@271
SHOOTING
INFORMATION
(EXIF INFOMRATION) N273
SHOOTING
my
GPS DATA
“V275
DATE
274
IMAGE DATA
N277
THUMBNAIL DATA
N279
US. Patent
Sep. 10, 2013
Sheet 4 0f 22
US 8,532,439 B2
gm
l/
US. Patent
Sep. 10, 2013
Sheet 5 0f 22
US 8,532,439 B2
F I G .5
/26
'MAGE ‘D
INFIBERRSSTI'ON wES‘éI/Rk
SHSSTENG
10
0
HAWAII
2006/08/01
20
1
HAWAII
2006/08/02
30
2
HAWAII
2006/08/03
40
0
HAWAII
2006/08/04
50
0
NEW YORK
2007/05/01
60
2
NEW YORK
2007/05/01
70
2
NEW YORK
2007/05/02
80
0
NEW YORK
2007/05/02
90
0
TOKYO
2007/ 07/24
100
5
TOKYO
2007/07/24
110
2
TOKYO
2007/07/24
120
2
TOKYO
2007/07/30
130
1
OKINAWA
2007/07/30
140
2
OKINAWA
2007/07/30
150
0
OKINAWA
2007/07/31
160
2
OKINAWA
2007/07/31
170
0
OKINAWA
2007/08/01
180
2
TOKYO
2007/08/01
190
2
TOKYO
2008/01/01
200
2
TOKYO
2008/01/01
210
O
TOKYO
2008/01/01
J‘ R11
US. Patent
Sep. 10, 2013
Sheet 7 0f 22
US 8,532,439 B2
FIG.7
v391
IMAGE ID
|NF%ERR§§TI'ON |N%%%1‘LI%%N
SHSSTI'ENG
2O
1
HAWAII
2006/08/02
30
2
HAWAII
2006/08/03
60
2
NEW YORK
2007/05/01
70
2
NEW YORK
2007/05/02
100
5
TOKYO
2007/07/24
110
2
TOKYO
2007/07/24
120
2
TOKYO
2007/07/30
130
1
OKINAWA
2007/07/30
140
2
OKINAWA
2007/07/30
160
2
OKINAWA
2007/07/31
180
2
TOKYO
2007/08/01
190
2
TOKYO
2008/01/01
200
2
TOKYO
2008/01/01
US. Patent
Sep. 10, 2013
Sheet 8 0122
US 8,532,439 B2
FIG .8
292-1
IMAGE IG
111F‘?>ERR1?§T“1‘ON 1N'E%%‘1‘/X%%N
SHS/‘BTTENG
130
1
OKINAWA
2007/07/30
140
2
OKINAWA
2007/07/30
150
0
OKINAWA
2007/07/31
100
2
OKINAWA
2007/07/31
170
0
OKINAWA
2007/00/01
FIG .9
$22
IMAGE III
1N.F%E§1i§1“1‘011 lNk‘é‘é?T/i‘T’féN
SHSETENG
90
0
TOKYO
2007/07/24
100
5
TOKYO
2007/07/24
1 10
2
TOKYO
2007/07/24
120
2
TOKYO
2007/07/30
180
2
TOKYO
2007/00/01
190
2
TOKYO
2008/01/01
200
2
TOKYO
2008/01/01
210
0
TOKYO
2000/01/01
FIG. 1 0
K2100
IMAGE IG
111FF5E§§§T10N lNkg‘é?/l%%11
SHSEJENG
130
1
OKINAWA
2007/07/30
140
2
OKINAWA
2007/07/30
100
2
OKINAWA
2007/07/31
US. Patent
NPGE
Sep. 10, 2013
Sheet 10 0f 22
US 8,532,439 B2
US. Patent
Sep. 10, 2013
Sheet 11 0122
US 8,532,439 B2
F|G.13
2O
IMAGE ID
iNF‘gERRii'?T'ioN iN%%%i‘iT/l%%ii
SHSEJQNG
120
2
Tokyo
2007/07/30
130
1
Okinawa
2007/07/30
140
2
Okinawa
2007/07/30
150
O
Okinawa
2007/07/31
160
2
Okinawa
2007/07/31
170
0
Okinawa
2007/08/01
180
2
Tokyo
2007/08/01
~R21
’\/R23
US. Patent
Sep. 10, 2013
FIG.15
US 8,532,439 B2
Sheet 13 0f 22
SHOOTING MODE
PROCESSING
7
IS
SHOOTING INSTRUCTION
PERFORMED?
I
SHOOTING PROCESSING
|
OBTAIN SHOOTING DATE
I
OBTAIN GPS DATA
+
+
[N D?
RECORDING PROCESSING OF IMAGE
FILE
b9
EXTRACT FEATURE INFORMATION BY
ANALYZING IMAGE DATA OF SHOT
IMAGE
b11
CONVERT GPS DATA INTO LOCATION
INFORMATION
|’\/ b13
V
GENERATE IMAGE ATTRIBUTE
INFORMATION OF SHOT IMAGE, AND
REGISTER IMAGE ATTRIBUTE
INFORMATION TO IMAGE ATTRIBUTE
INFORMATION TABLE
b15
IS
SEARCH RESULT ABOUT
IMAGE OF INTEREST BEING
REPRODUCED’?
YES
b19
IS SEARCH CONDITION
SATISFIED?
YES
UPDATE CORRESPONDING
REPRODUCTION TEMPORARY TABLE
IS SEARCH
RESULT OF UPDATED
REPRODUCTION
TEMPORARY TABLE BEING
REPRODUCED?
I
b21
b23
NOTIFY DISPLAY UPDATE REQUEST
I \“ b25
US. Patent
Sep. 10, 2013
Sheet 14 0f 22
US 8,532,439 B2
FIG.16
EXTERNAL IMAGE
OBTAINING
PROCESSING
OBTAIN IMAGE FILE
RECORDING PROCESSING OF IMAGE
FILE
EXTRACT FEATURE INFORMATION BY
ANALYZING IMAGE DATA OF
EXTERNALLY-OBTAINED IMAGE
CONVERT GPS DATA INTO LOCATION
INFORMATION
GENERATE IMAGE ATTRIBUTE
INFORMATION OF EXTERNALLY
OBTAINED IMAGE, AND REGISTER
IMAGE ATTRIBUTE INFORMATION TO
IMAGE ATTRIBUTE INFORMATION
TABLE
|'\/c1
US. Patent
Sep. 10, 2013
Sheet 15 0f 22
US 8,532,439 B2
FIG-1 7
I
REPRODUCE ALL IMAGES
I <0
L
d1
7
IS SELECTION
OPERATION OF TARGET IMAGE
PERFORMED?
NO
I
SELECT TARGET IMAGE
I'MdS
I
SET SEARCH CONDITION
|~d7
REFERENCE IMAGE ATTRIBUTE INFORMATION
TABLE, AND GENERATE PERSON SEARCH RESULT
TABLE IN WHICH IMAGE ATTRIBUTE INFORMATION
SATISFYING PERSON SEARCH CONDITION IS SET
REFERENCE IMAGE ATTRIBUTE INFORMATION
TABLE, AND GENERATE LOCATION SEARCH RESULT
TABLE IN WHICH IMAGE ATTRIBUTE INFORMATION
SATISFYING LOCATION SEARCH CONDITION IS SET
REFERENCE IMAGE ATTRIBUTE INFORMATION
TABLE, AND GENERATE PERSON AND LOCATION
SEARCH RESULT TABLE IN WHICH IMAGE
ATTRIBUTE INFORMATION SATISFYING PERSON AND
LOCATION SEARCH CONDITION IS SET
d15
IS SELECTION
OPERATION OR DESELECTION
OPERATION OF REPRODUCTION SEARCH
CONDITION PERFORMED?
SELECT REPRODUCTION SEARCH CONDITION
NO
|'\/d16
IS IT PERSON
SEARCH CONDITION?
REFERENCE PERSON SEARCH RESULT TABLE, AND
(119
GENERATE IMAGE DISPLAY DATA
GENERATE OSD DATA ON BASIS OF PERSON
SEARCH CONDITION
d21
PERFORM PROCESSING FOR DISPLAYING OSD
DATA ON IMAGE DISPLAY DATA IN OVERLAPPING
MANNER, AND REPRODUCE PERSON SEARCH
RESULT
d23
US. Patent
Sep. 10, 2013
Sheet 16 0f 22
US 8,532,439 B2
FIG.18
d25
NO
IS IT LOCATION
SEARCH CONDITION?
REFERENCE LOCATION SEARCH RESULT
TABLE, AND GENERATE IMAGE DISPLAY DATA
‘I27
GENERATE OSD DATA ON BASIS OF LOCATION
SEARCH CONDITION
(I29
PERFORM PROCESSING FOR DISPLAYING OSD
DATA ON IMAGE DISPLAY DATA IN
OVERLAPPING MANNER, AND REPRODUCE
LOCATION SEARCH RESULT
IS IT PERSON AND LOCATION
SEARCH CONDITION?
REFERENCE PERSON AND LOCATION SEARCH
RESULT TABLE, AND GENERATE IMAGE
DISPLAY DATA
d35
GENERATE OSD DATA ON BASIS OF PERSON
AND LOCATION SEARCH CONDITION
‘1'37
PERFORM PROCESSING FOR DISPLAYING OSD
DATA ON IMAGE DISPLAY DATA IN
OVERLAPPING MANNER, AND REPRODUCE
PERSON AND LOCATION SEARCH RESULT
d35,
US. Patent
Sep. 10, 2013
Sheet 17 0f 22
US 8,532,439 B2
FIG.19
d41
IS
SELECTION OPERATION OF PERIOD
PERFORMED?
I
SET SELECTED PERIOD
l/\,d43
REFERENCE IMAGE ATTRIBUTE INFORMATION TABLE,
AND GENERATE SELECTED PERIOD IMAGE LIST
TABLE IN WHICH IMAGE ATTRIBUTE INFORMATION
WHOSE SHOOTING DATE IS IN SELECTED PERIOD IS
SET
d45
REFERENCE SELECTED PERIoD IMAGE LIST TABLE,
d4?
AND GENETE IMAGE DISPLAY DATA
GENERATE OSD DATA ON BASIS OF SELECTED
PERIoD
C149
PERFORM PROCESSING FOR DISPLAYING OSD DATA
ON IMAGE DIsPLAY DATA IN ovERLAPPING MANNER,
AND REPRODUCE IMAGES IN SELECTED PERIOD
d51
IS CONNECTION
OF EXTERNAL APPARATUS
DETECTED?
(I53
NO
EXTERNAL IMAGE OBTAINING PROCESSING
d55
OES EXTERNALLY
OBTAINED IMAGE NEWLY OBTAINED
SATISFY SEARCH
UPDATE CORRESPONDING REPRODUCTION
TEMPORARY TABLE
l’\1
d59
IS SEARCH RESULT
OF UPDATED REPRODUCTION TEMPORARY
TABLE BEING REPRODUCED?
I
NO
I
NOTIFY DISPLAY UPDATE REQUEST
|’\/d62
IS DISPLAY
UPDATE REQUEST NOTIFIED?
UPDATE AND DISPLAY SEARCH RESULT SCREEN
I’ \ld64