US 20140028921A1
(19) United States
(12) Patent Application Publication (10) Pub. No.: US 2014/0028921 A1
MOON et al.
(54)
(43) Pub. Date:
METHOD AND MOBILE TERMINAL FOR
DISPLAYING INFORMATION, METHOD AND
DISPLAY DEVICE FOR PROVIDING
INFORMATION, AND METHOD AND
MOBILE TERMINAL FOR GENERATING
CONTROL SIGNAL
Jan. 30, 2014
Publication Classi?cation
(51)
Int. Cl.
H04N 5/44
(52) us CL
CPC
_
USPC
(2006.01)
H04N 5/4403 (2013.01)
........................................................ ..
348/734
(71) Applicant: SAMSUNG ELECTRONICS CO.,
LTD., SuWon-si (KR)
(72) Inventors: Bo-seok MOON, Gunpo-si (KR);
Won-j ong CHOI, Seo-gu (KR)
(73) AssigneeZ SAMSUNG ELECTRONICS CO”
(21)
LTD suwomsi (KR)
’
Appl_ No; 13/950,507
(22) Filed;
(57)
ABSTRACT
A method in Which a mobile terminal displays information is
provided. The method includes: transmitting, to an external
display device, a ?rst signal for selecting an object displayed
on the external display device based on a ?rst input of a user
through the mobile terminal; transmitting, to the external
display device, a second signal for requesting additional
JUL 25, 2013
information corresponding to the selected object based on a
(30)
Foreign Application Priority Data
Jul. 25, 2012
(KR) ...................... .. 10-2012-0081434
second input of the user through the mobile terminal; and
displaying, on a screen of the mobile terminal, the additional
information received from the external display device.
200
300
SERVER
Patent Application Publication
Jan. 30, 2014 Sheet 1 0f 17
US 2014/0028921 A1
FIG. 1
200
FIG. 2
200
100
300
SERVER
Patent Application Publication
Jan. 30, 2014 Sheet 2 0f 17
FIG .3A
200
US 2014/0028921 A1
Patent Application Publication
Jan. 30, 2014 Sheet 3 0f 17
FIG. 3B
Ell ‘.L. |||l mg PM3:26
HEHIEI
All
Drama
Movie
News
Sports
5
FIG. SC
@l i. u" m E Pmzs
DU@452
I
rr
I
./
@202
i//I
US 2014/0028921 A1
Patent Application Publication
US 2014/0028921 A1
Jan. 30, 2014 Sheet 4 0f 17
FIG. 4
200
ABC
—|7
I1 100
El *MOVIE TH'LEI SHREK
*REVIEWI ‘kii'iiz
REINB
IDOWNLOADI
Q q, I. ma mm
‘
[El
100
*IVIOVIE TITLEI SHREK
*REVIEWf ****>A<
I DOWNLOAD i
01:
°
Patent Application Publication
Jan. 30, 2014 Sheet 5 0f 17
FIG. 5
200
100
IE"
* MOVIE
down loading
V/////////////%—
60%
US 2014/0028921 A1
Patent Application Publication
Jan. 30, 2014 Sheet 6 0f 17
FIG. 6
200
@
Q
©
|
I
100
IE"
@
@4218
—48Ibb®
B
US 2014/0028921 A1
Patent Application Publication
Jan. 30, 2014 Sheet 7 0f 17
US 2014/0028921 A1
FIG. '7
I START I
TRANSMIT SIGNAL FOR SELECTING OBJECT
BASED ON FIRST INPUT OF MOBILE TERMINAL
“*STIO
OBTAIN ADDITIONAL INFORMATION
CORRESPONDING TO OBJECT BASED ON
’— S720
SECOND INPUT OF THE MOBILE TERMINAL
DISPLAY TI-IE OBTAINED
ADDITIONAL INFORMATION
END
T S730
Patent Application Publication
Jan. 30, 2014 Sheet 8 0f 17
100
US 2014/0028921 A1
200
MOBILE
TERMINAL
DISPLAY DEVICE
S810
RECEIVE FIRST INPUT
S820
GENERATE SIGNAL FOR
SELECTING OBJECT
TRANSMIT THE SIGNAL FOR
SELECTING THE OBJECT (S830)
S840
MOVE SELECTION REGION
S850
S860
SELECT THE OBJECT
RECEIVE SECOND INPUT
REQUEST ADDITIONAL INFORMATION
CORRESPONDING TO THE SELECTED OBJECT (S870)
TRANSMIT THE ADDITIONAL INFORMATION (S880)
S890
DISPLAY THE ADDITIONAL
INFORMATION
Patent Application Publication
Jan. 30, 2014 Sheet 9 0f 17
100
US 2014/0028921 A1
200
MOBILE
TERMINAL
DISPLAY DEVICE
S910
RECEIVE FIRST INPUT
S920
SENSE THE FIRST INPUT
OF MOBILE TERMINAL
TRANSMIT SIGNAL FOR SELECTING OBJECT (S930)
S940
MOVE SELECTION REGION
S950
S960
SELECT THE OBJECT
RECEIVE SECOND INPUT
S970
SENSE THE SECOND INPUT
OF THE MOBILE TERMINAL
REQUEST ADDITIONAL INFORMATION
CORRESPONDING TO OBJECT (S980)
TRANSMIT THE ADDITIONAL INFORMATION
CORRESPONDING TO THE OBJECT (S990)
S995
DISPLAY THE ADDITIONAL
INFORMATION
Patent Application Publication
Jan. 30, 2014 Sheet 10 0f 17
300
SEVER
US 2014/0028921 A1
100
200
MOBILE
TERMINAL
DISPLAY DEVICE
S1005
RECEIVE FIRST INPUT
S1010
GENERATE SIGNAL FOR
SELECTING OBJECT
TRANSMIT THE SIGNAL FOR
SELECTING THE OBJECT
(S1015)
S1020
MOVE SELECTION
REGION
S1025
SELECT THE OBJECT
S1030
RECEIVE SECOND INPUT
REQUEST ADDITIONAL
INFORMATION (S1035)
TRANSMIT LINK INFORMATION
OF THE ADDITIONAL
INFORMATION (S1040)
REQUEST THE ADDITIONAL
INFORMATION (S1045)
TRANSMIT THE ADDITIONAL
INFORMATION (S1050)
S1055
DISPLAY THE ADDITIONAL
INFORMATION
Patent Application Publication
Jan. 30, 2014 Sheet 11 0f 17
US 2014/0028921 A1
FIG. 11
100
200
MOBILE
TERMINAL
DISPLAY DEVICE
S1110
DISPLAY ADDITIONAL
INFORMATION
i
RECEIVE THIRD INPUT
i
S1130
CONTROL THE DISPLAYED
ADDITIONAL INFORMATION
RECEIVE FOURTH INPUT
REQUEST CONTENTS CORRESPONDING TO THE
ADDITIONAL INFORMATION (S1150)
TRANSMIT THE CONTENTS (S1160)
S1170
DISPLAY, REPRODUCE, OR
STORE THE CONTENTS
Patent Application Publication
Jan. 30, 2014 Sheet 12 0f 17
US 2014/0028921 A1
FIG. 12
300
100
200
MOBILE
TERMINAL
SERVER
DISPLAY DEVICE
S1210
DISPLAY ADDITIONAL
INFORMATION
S1220
RECEIVE FOURTH INPUT
REQUEST OONTENTS
CORRESPONDING
TO THE ADDITIONAL
INFORNIATION (S1230)
TRANSMIT LINK INFORMATION
OF THE CONTENTS
(81240)
REQUEST THE OONTENTS
BASED ON THE LINK
INEORNIATION (S1250)
TRANSNIIT THE CONTENTS
(S1260)
S1270
OBTAIN THE CONTENTS
S1280
DISPLAY, REPRODUCE, OR
STORE THE CONTENTS
Patent Application Publication
Jan. 30, 2014 Sheet 13 0f 17
FIG. 13
US 2014/0028921 A1
Patent Application Publication
Jan. 30, 2014 Sheet 14 0f 17
110
US 2014/0028921 A1
130
COMMUNICATION UNIT
111
M
POWER SUPPLY
UNIT
190
BROADCASTING
RECEIvING MODULE
130
OBTAINING UNIT
112
131
MOBILE COMMUNICATION
ADDITIONAL INFORMATION
MODULE
_
OBTAINING UNIT
113
WIRELESS INTERNET
132
—
CONTENTS
MODULE
OBTAINING UNIT
114
140
SRORT—RANGE WIRELESS
COMMUNICATION MODULE
OUTPUT UNIT
141
H5
LOCATION INFORMATION
MODULE
CONTROL
UNIT
DISPLAY UNIT
142
120
—
SOUND OUTPUT
MODULE
USER INPUT UNIT
MOTION RECOGNITION
MODULE
ALARM UNIT
122
150
TOUCHMFgEDCUTQNITION
_
—
OPERATION MODE
DETERMINING UNIT
123
160
BENDING MOTION
RECOGNITION MODULE
_
124
170
vOICE RECOGNITION
MODULE
INTERFACE
UNIT
STORAGE UNIT
Patent Application Publication
Jan. 30, 2014 Sheet 15 0f 17
US 2014/0028921 A1
E
220
SELECTION
UNIT
210
260
COMMUNICATION UNIT
211
230
OUTPUT UNIT
231
RECEIVING MODULE
212
\NIRELEss INTERNET
MODULE
232
_
CONTROL UNIT
213
SOUND OUTPUT
MODULE
233
W|RED |NTERNET
MODULE
ALARM UNH'
214
SHORZRANGE WIRELESS
COMMUNICATION MODULE
250
sTORAOE UNIT
240
SENSING UNIT
241
CAMERA
242
MICROPHONE
Patent Application Publication
Jan. 30, 2014 Sheet 16 0f 17
US 2014/0028921 A1
FIG. 16
I START )
SELECT OBJECT BASED ON
FIRST INPUT OF MOBILE TERMINAL
,31610
TRANSMIT ADDITIONAL INFORMATION
CORRESPONDING TO THE SELECTED
“S1620
OBJECT TO THE MOBILE TERMINAL BASED ON
SECOND INPUT OF THE MOBILE TERMINAL
RECEIVE REQUEST FOR CONTENTS
CORRESPONDING TO THE
ADDITIONAL INFORMATION
TRANSMIT THE CONTENTS
TO THE MOBILE TERMINAL
END
rS163O
,81640
Patent Application Publication
Jan. 30, 2014 Sheet 17 0f 17
US 2014/0028921 A1
I START I
RECEIVE USER INPUT
¢~ S1710
S1720
IS OPERATION
MODE OF MOBILE TERMINAL
DETERMINED?
FIRST MODE
S1730
SECOND MODE
S1740
GENERATE FIRST CONTROL
SIGNAL FOR CONTROLLING
GENERATE SECOND CONTROL
SIGNAL FOR CONTROLLING
EXTERNAL DISPLAY DEVICE
CONTENTS DISPLAYED
ON THE MOBILE TERMINAL
END
US 2014/0028921 A1
METHOD AND MOBILE TERMINAL FOR
Jan. 30, 2014
DISPLAYING INFORMATION, METHOD AND
[0012] According to an aspect of an exemplary embodi
ment, there is provided a method in Which a mobile terminal
DISPLAY DEVICE FOR PROVIDING
displays information, the method including: transmitting a
INFORMATION, AND METHOD AND
?rst signal for selecting an object displayed on an external
display device to the external display device based on a ?rst
input of a user through the mobile terminal; transmitting a
MOBILE TERMINAL FOR GENERATING
CONTROL SIGNAL
CROSS-REFERENCE TO RELATED PATENT
APPLICATION
[0001] This application claims priority from Korean Patent
Application No. 10-2012-0081434, ?led on Jul. 25, 2012, in
the Korean Intellectual Property Of?ce, the disclosure of
Which is incorporated herein in its entirety by reference.
BACKGROUND
second signal for requesting additional information corre
sponding to the selected object to the external display device
based on a second input of the user through the mobile ter
minal; and displaying, on a screen of the mobile terminal, the
additional information received from the external display
device.
[0013] The transmitting of the ?rst signal for selecting the
object may include: converting the signal for selecting the
object according to a control protocol of the external display
device.
[0002]
1. Field
[0014]
[0003]
Exemplary embodiments relate to a method and
object may include: transmitting a signal for controlling a
movement of a selection region for selecting the object dis
played on the external display device.
mobile terminal for displaying information by selecting an
object displayed on an external display device based on an
The transmitting of the ?rst signal for selecting the
input of the mobile terminal and obtaining and displaying
[0015]
additional information corresponding to the selected object, a
movement of the selection region may include: transmitting a
signal for controlling at least one of a movement direction of
the selection region, a movement speed of the selection
region, and a number of objects displayed on a screen of the
external display device based on the ?rst input.
method and display device for providing information by
selecting an object based on an input of a mobile terminal and
providing additional information regarding the selected
object to the mobile terminal, and a method and mobile ter
The transmitting of the signal for controlling the
minal for generating a control signal by changing a received
[0016]
user input to the control signal based on an operating mode of
object may include: displaying thumbnail information of con
The transmitting of the ?rst signal for selecting the
the mobile terminal.
[0004] 2. Description of the Related Art
[0005] A smart television (TV) is a multifunctional TV
capable of utiliZing various functions such as Web sur?ng,
video on demand (VOD) Watching, a social networking ser
tents corresponding to the object on the screen of the mobile
terminal.
[0017] The thumbnail information may include at least one
of an image of the contents corresponding to the object, a title
of the contents, and a type of the contents.
vice (SNS), a game, etc. by combining a TV and an Internet
[0018]
access function and installing various applications.
object may include: displaying a movement direction of the
mobile terminal on the screen according to the ?rst input.
[0006] One characteristic of the smart TV is that a user and
the TV can transmit and receive information from each other.
This is a difference betWeen the smart TV and an existing TV
[0019]
The transmitting of the ?rst signal for selecting the
The ?rst input and the second input may include at
least one of a motion input, a key input, a touch input, a
that merely transfers information unilaterally. Thus, the smart
bending input, and a voice input.
TV is also referred to as an interactive TV.
[0020] The ?rst input may include a three-dimensional
(3D) motion input for moving the mobile terminal in a 3D
direction, Wherein the second input includes a rotational
motion input for rotating the mobile terminal by more than a
[0007] HoWever, it is very inconvenient for the user to use
the various functions of the smart TV by using a standard
remote controller. In particular, When the user broWses or
doWnloads contents, the user needs to manipulate the remote
controller through several steps.
[0008]
Therefore, a control device or system for alloWing
the user to easily control the smart TV is needed.
SUMMARY
[0009] Exemplary embodiments provide a method and
mobile terminal for displaying information by selecting an
predetermined angle.
[0021]
The transmitting of the second signal for requesting
additional information may include: receiving the additional
information from the display device.
[0022]
The transmitting of the second signal for requesting
additional information may include: receiving link informa
tion of the additional information from the external display
device based on the second input; and receiving the additional
information from a server based on the received link infor
object displayed on an external display device based on an
mation.
input of the mobile terminal and obtaining and displaying
additional information corresponding to the selected object.
[0010] Exemplary embodiments also provide a method and
display device for providing information by selecting an
[0023] The transmitting of the ?rst signal for selecting the
object to the display device may include: requesting control
authoriZation from the external display device; and receiving
object based on an input of a mobile terminal and providing
display device.
a control authorization acceptance message from the external
additional information regarding the selected object to the
[0024]
mobile terminal.
image, a moving image, an application, music, a Web page,
and an electronic program guide (EPG).
[0011] Exemplary embodiments also provide a method and
mobile terminal for generating a control signal by changing a
received user input to the control signal based on an operating
mode of the mobile terminal.
[0025]
The contents may include at least one of a still
The additional information may include at least one
of previeW information, prelistening information, application
information, user revieW information, update information,
US 2014/0028921 A1
newspaper article information, goods information, movie
information, game information, advertisement image infor
mation, and album information.
[0026] The method may further include: controlling the
additional information displayed on the screen of the mobile
terminal based on a third input of the user through the mobile
terminal.
[0027] The controlling of the additional information may
include: controlling at least one of displaying of the addi
tional information, playing of the additional information, and
changing to previous additional information or next addi
tional information based on the third input of the user through
the mobile terminal.
[0028] The method may further include: obtaining contents
corresponding to the additional information displayed on the
Jan. 30, 2014
requesting additional information corresponding to the
selected object to the external display device based on a
second input of the user through the mobile terminal; a dis
play Which is con?gured to display the additional information
received from the external display device; and a controller
Which is con?gured to control the communication unit, the
additional information obtaining unit, and the display unit.
[0040] The controller may convert the signal for selecting
the object according to a control protocol of the external
display device.
[0041] The communication unit may transmit a signal for
controlling a movement of a selection region for selecting the
object displayed on the external display device.
[0042]
The communication unit may transmit a signal for
controlling at least one of a movement direction of the selec
screen of the mobile terminal.
tion region, a movement speed of the selection region, and the
[0029] According to an aspect of another exemplary
embodiment, there is provided a method in Which a display
number of objects displayed on a screen of the external dis
play device based on the ?rst input.
device provides information to a mobile terminal, the method
[0043]
including: selecting an object displayed on the display device
contents corresponding to the object on a screen of the mobile
by receiving a ?rst input of a user through the mobile termi
terminal.
nal; and transmitting additional information corresponding to
[0044] The additional information obtaining unit may
receive the additional information from the external display
device.
[0045] The communication unit may receive link informa
tion of the additional information from the external display
device based on the second input, and Wherein the additional
information obtaining unit receives the additional informa
the selected object to the mobile terminal by receiving a
second input of the user through the mobile terminal.
[0030]
The transmitting may include: extracting the addi
tional information from contents corresponding to the
selected object.
[0031]
The selecting of the object may include: receiving a
control signal for controlling a movement of a selection
region for selecting the object from the mobile terminal; and
moving the selection region according to the control signal.
[0032] The selecting of the object may include: converting
the received ?rst input to a control signal for controlling a
movement of a selection region according to a control proto
col of the display device.
[0033] The receiving may include: receiving the control
signal for controlling the movement of the selection region
from each of a plurality of mobile terminals.
[0034] The method may further include: sensing at least
one of the ?rst input of the user through the mobile terminal
and the second input of the user through the mobile terminal.
[0035]
The selecting of the object may include: controlling
The display may display thumbnail information of
tion from a server based on the received link information.
[0046]
The controller may control the additional informa
tion displayed on the mobile terminal based on a third input of
the user through the mobile terminal.
[0047] The mobile terminal may further include: a contents
obtaining unit Which is con?gured to obtain content corre
sponding to the additional information displayed on the
mobile terminal.
[0048] According to an aspect of an exemplary embodi
ment, there is provided a display device including: a selection
unit Which is con?gured to select an object displayed on the
display device based on a ?rst input of a user through a mobile
terminal; a communication unit Which is con?gured to trans
mit additional information corresponding to the selected
at least one of a movement direction of the selection region, a
object to the mobile terminal by receiving a second input of
movement speed of the selection region, and a number of
objects displayed on a screen based on the ?rst input of the
user through the mobile terminal.
the user through the mobile terminal, and a controller Which
is con?gured to control the selection unit and the communi
cation unit.
[0049] The controller may extract the additional informa
[0036] The selecting of the object may include: transmit
ting thumbnail information of contents corresponding to the
object to the mobile terminal.
[0037] The transmitting of the additional information to the
mobile terminal may include: transmitting link information
tion from contents corresponding to the selected object.
[0050] The selection unit may receive a control signal for
controlling a movement of a selection region for selecting the
object from the mobile terminal and move the selection
of the additional information to the mobile terminal.
[0038] The terminal may further include: receiving a
request for transmission of contents corresponding to the
region according to the received control signal.
selected object from the mobile terminal; and transmitting the
region according to a control protocol of the display device.
contents corresponding to the selected object to the mobile
terminal.
[0039] According to an aspect of another exemplary
embodiment, there is provided a mobile terminal including: a
communication unit Which is con?gured to transmit a signal
for selecting an object displayed on an external display device
[0052] The display device may further include: a sensor
Which is con?gured to sense at least one of the ?rst input of the
to the external display device based on a ?rst input of a user
through the mobile terminal; an additional information
obtaining unit Which is con?gured to transmit a signal for
[0051]
The controller may convert the received ?rst input to
a control signal for controlling a movement of a selection
user through the mobile terminal and the second input of the
user through the mobile terminal.
[0053]
The controller may control at least one of a move
ment direction of the selection region, a movement speed of
the selection region, and a number of objects displayed on a
screen based on the ?rst input of the user through the mobile
terminal.