U.S. patent application number 12/126092 was filed with the patent office on 2009-07-09 for method for providing area of image displayed on display apparatus in gui form using electronic apparatus, and electronic apparatus applying the same.
This patent application is currently assigned to Samsung Electronics Co., Ltd.. Invention is credited to Han-chul Jung, O-jae Kwon, Chang-beom SHIN.
Application Number | 20090174653 12/126092 |
Document ID | / |
Family ID | 40844184 |
Filed Date | 2009-07-09 |
United States Patent
Application |
20090174653 |
Kind Code |
A1 |
SHIN; Chang-beom ; et
al. |
July 9, 2009 |
METHOD FOR PROVIDING AREA OF IMAGE DISPLAYED ON DISPLAY APPARATUS
IN GUI FORM USING ELECTRONIC APPARATUS, AND ELECTRONIC APPARATUS
APPLYING THE SAME
Abstract
An electronic apparatus to provide an area of an image displayed
on a display apparatus in a GUI form. The electronic apparatus
transfers a user command related to an external apparatus to the
external apparatus, and displays an area of an image displayed on
the external apparatus on a display. Therefore, it is possible to
display an area of an image displayed on a display apparatus in the
GUI form using another display apparatus so that the user may
select a desired GUI item more conveniently and more
intuitively.
Inventors: |
SHIN; Chang-beom; (Seoul,
KR) ; Jung; Han-chul; (Seoul, KR) ; Kwon;
O-jae; (Seoul, KR) |
Correspondence
Address: |
STEIN MCEWEN, LLP
1400 EYE STREET, NW, SUITE 300
WASHINGTON
DC
20005
US
|
Assignee: |
Samsung Electronics Co.,
Ltd.
Suwon-si
KR
|
Family ID: |
40844184 |
Appl. No.: |
12/126092 |
Filed: |
May 23, 2008 |
Current U.S.
Class: |
345/156 ;
345/1.1 |
Current CPC
Class: |
G06F 3/04845 20130101;
G06F 3/0346 20130101; G06F 3/04847 20130101; G06F 3/14 20130101;
G06F 3/04842 20130101; G06F 3/1454 20130101; G06F 3/1462 20130101;
H04N 21/4312 20130101; H04N 21/42224 20130101; H04N 21/42209
20130101; H04N 21/42222 20130101; H04N 21/4782 20130101; H04N
21/42204 20130101; G06F 3/038 20130101; G06F 3/0488 20130101; G06F
3/0354 20130101; H04N 21/41265 20200801; G06F 3/033 20130101; H04N
21/4131 20130101; G09G 5/12 20130101; G06F 3/0482 20130101 |
Class at
Publication: |
345/156 ;
345/1.1 |
International
Class: |
G09G 5/00 20060101
G09G005/00 |
Foreign Application Data
Date |
Code |
Application Number |
Jan 7, 2008 |
KR |
2008-1943 |
Claims
1. An electronic apparatus, comprising: a display; a communication
unit communicably connected to an external apparatus; and a control
unit to transfer a user command related to the external apparatus
to the external apparatus via the communication unit, and to
control an area of an image displayed on the external apparatus to
be displayed on the display.
2. The electronic apparatus of claim 1, wherein the area of the
image displayed on the display appears to a user to be greater in
size than the corresponding area of the image displayed on the
external apparatus.
3. The electronic apparatus of claim 1, wherein: the area of the
image comprises graphical user interface (GUI) items selectable by
the user; and the control unit transfers information regarding a
GUI item selected by the user to the external apparatus via the
communication unit so as to transmit the user command related to
the external apparatus to the external apparatus.
4. The electronic apparatus of claim 3, wherein: the display is a
touch screen; and the control unit transfers information regarding
a GUI item touched by the user among GUI items in an area of an
image displayed on the touch screen to the external apparatus via
the communication unit.
5. The electronic apparatus of claim 1, further comprising: a
sensing unit to detect movement of the electronic apparatus;
wherein the area of the image displayed on the display changes
according to the movement of the electronic apparatus detected by
the sensing unit.
6. The electronic apparatus of claim 5, wherein the control unit
transmits information regarding the movement of the electronic
apparatus detected by the sensing unit to the external apparatus
via the communication unit, and controls the area of the image
received via the communication unit from the external apparatus to
be displayed on the display.
7. The electronic apparatus of claim 5, wherein the direction of
the movement of the electronic apparatus detected by the sensing
unit corresponds to the direction in which the area of the image
changes.
8. The electronic apparatus of claim 1, wherein, when the user
inputs the user command related to the external apparatus using the
electronic apparatus, the distance between the electronic apparatus
and the user is less than the distance between the external
apparatus and the user.
9. The electronic apparatus of claim 1, further comprising: a
capturing unit to capture an area of an image displayed on the
external apparatus; wherein the control unit transmits the area of
the image captured by the capturing unit to the external apparatus
via the communication unit, and receives information regarding GUI
items in the area of the image from the external apparatus via the
communication unit.
10. The electronic apparatus of claim 1, wherein: the external
apparatus is a broadcast receiving apparatus; and the electronic
apparatus is a remote controller of the broadcast receiving
apparatus.
11. A method of providing a graphical user interface (GUI), the
method comprising: displaying an area of an image displayed on an
external apparatus communicably connected to an electronic
apparatus in a GUI form on the electronic apparatus; and
transferring a user command input using the area of the image
displayed on the electronic apparatus to the external
apparatus.
12. The method of claim 11, wherein the area of the image displayed
on the electronic apparatus appears to a user to be greater in size
than the corresponding area of the image displayed on the external
apparatus.
13. The method of claim 11, wherein: the area of the image
comprises GUI items selectable by the user; and the transferring of
the user command comprises transferring information regarding a GUI
item selected by the user to the external apparatus so as to
transmit the user command to the external apparatus.
14. The method of claim 13, wherein the transferring of the user
command comprises transferring information regarding a GUI item
touched by the user among GUI items in an area of an image
displayed on a touch screen of the electronic apparatus to the
external apparatus.
15. The method of claim 11, further comprising: detecting movement
of the electronic apparatus; wherein the area of the image
displayed on the electronic apparatus changes according to the
detected movement of the electronic apparatus.
16. The method of claim 15, wherein the direction of the detected
movement of the electronic apparatus corresponds to the direction
in which the area of the image changes.
17. A display apparatus, comprising: a display; a communication
unit communicably connected to an electronic apparatus; and a
control unit to execute a user command received from the electronic
apparatus via the communication unit, and to transfer information
regarding graphical user interface (GUI) items in an area of an
image displayed on the display to the electronic apparatus via the
communication unit.
18. The display apparatus of claim 17, wherein: the area of the
image displayed on the display is displayed on the electronic
apparatus; and the area of the image displayed on the electronic
apparatus appears to a user to be greater in size than the
corresponding area of the image displayed on the display.
19. The display apparatus of claim 17, wherein the control unit
transfers data regarding the area of the image displayed on the
display to the electronic apparatus via the communication unit.
20. The display apparatus of claim 19, wherein the control unit
transfers data regarding various areas of the image displayed on
the display to the electronic apparatus via the communication unit,
based on information regarding movement of the electronic apparatus
received via the communication unit.
21. An electronic apparatus to transfer user commands related to
peripheral apparatuses to the corresponding peripheral apparatuses,
the apparatus comprising: a display; a communication unit
communicably connected to the peripheral apparatuses; and a control
unit to determine which peripheral apparatus is facing the
electronic apparatus and to display a graphical user interface
(GUI) representing the peripheral apparatus found as a result of
the determination.
22. A system comprising: an external apparatus having a display; a
remote controller to control the external apparatus, the remote
control having a display to display an area of an image displayed
on the external apparatus; wherein the area of the image displayed
on the display of the remote control is scaled so as to appear
larger than the corresponding area of the image displayed on the
display of the external apparatus.
23. A remote controller to control an external apparatus having a
display, the remote control comprising: a screen; and a control
unit to control the external apparatus based on input from the
user, and to display an area of an image displayed on the external
apparatus; wherein the control unit scales the image displayed on
the screen so as to fit on the screen and to appear larger than the
area of the image displayed on the external apparatus, and
transmits input from the user to the external apparatus
corresponding to GUI items displayed within the area.
24. The remote controller of claim 23, wherein, when the user moves
the remote control, the control unit transmits information about
the movement of the remote control to the external apparatus,
receives information about a changed area corresponding to the
movement from the external apparatus, and updates the screen with
the changed area.
25. The remote controller of claim 24, further comprising: a
sensing unit to sense the movement of the remote control.
26. The remote controller of claim 25, wherein the sensing unit
senses movement of the remote control in a plane substantially
parallel to a plane of the display of the external apparatus.
27. The remote controller of claim 25, wherein the sensing unit
senses movement of the remote control in a plane substantially
perpendicular to a place of the display of the external
apparatus.
28. The remote controller of claim 23, further comprising: a
capturing unit to capture an image displayed on the external
apparatus; and wherein the controller determines the area to be
displayed on the screen based on the captured image.
29. The remote controller of claim 23, wherein: the screen is a
touchscreen; and if the area includes a GUI item, the controller
controls the screen to display the GUI item as a selectable
object.
30. The remote controller of claim 23, wherein the controller
transmits commands to the external apparatus based on the input of
the user and the area displayed on the screen.
31. The remote controller of claim 23, wherein the remote
controller receives an image corresponding to the area from the
external apparatus.
32. The remote controller of claim 23, wherein the controller
determines the area to be displayed on the screen.
Description
CROSS-REFERENCE TO RELATED APPLICATION
[0001] This application claims the benefit of Korean Application
No. 2008-1943, filed in the Korean Intellectual Property Office on
Jan. 7, 2008, the disclosure of which is incorporated herein by
reference.
BACKGROUND OF THE INVENTION
[0002] 1. Field of the Invention
[0003] Aspects of the present invention relate to a graphical user
interface (GUI) providing method and an electronic apparatus
applying the method, and more particularly, to a GUI providing
method which enables a user to interface with a display apparatus,
and an electronic apparatus applying the method.
[0004] 2. Description of the Related Art
[0005] Graphical user interfaces (GUI), by which users may select
GUI items such as icons, menus, or anchors displayed on display
apparatuses using pointers, have become widespread. In order to
input user commands in such GUI environments, a user may move a
pointer to a desired item using an input device such as a mouse or
a touch pad, and may press a specific key on the input device to
input a command to execute a specific function of the item
indicated by the pointer.
[0006] However, movement of the pointer to the desired item using
the input device may be troublesome to the user. This trouble may
increase when the size of a display apparatus (such as a large
screen television) becomes larger but the size of items becomes
smaller.
[0007] Additionally, if GUI items are grouped together on one area
of a display apparatus, more exact manipulation is required to move
the pointer. There is demand for a more convenient manipulation
method when using a GUI, and, therefore, there is a need for
methods by which the user may select a desired GUI item more
conveniently.
SUMMARY OF THE INVENTION
[0008] Aspects of the present invention relate to a method for
displaying an area of an image displayed on a display apparatus in
the form of a graphical user interface (GUI) using another display
apparatus so that the user may select a desired GUI item more
conveniently and more intuitively, and an electronic apparatus
applying the method.
[0009] According to an embodiment of the present invention, an
electronic apparatus is provided. The electronic apparatus includes
a display; a communication unit communicably connected to an
external apparatus; and a control unit to transfer a user command
related to the external apparatus to the external apparatus via the
communication unit, and to control an area of an image displayed on
the external apparatus to be displayed on the display.
[0010] According to another aspect of the present invention, the
area of the image displayed on the display appears to a user to be
greater in size than the corresponding area of the image displayed
on the external apparatus.
[0011] According to another aspect of the present invention, the
area of the image includes graphical user interface (GUI) items
selectable by the user. The control unit transfers information
regarding a GUI item selected by the user to the external apparatus
via the communication unit so as to transmit the user command
related to the external apparatus to the external apparatus.
[0012] According to another aspect of the present invention, the
display is a touch screen, and the control unit transfers
information regarding a GUI item touched by the user among GUI
items in an area of an image displayed on the touch screen to the
external apparatus via the communication unit.
[0013] According to another aspect of the present invention, the
electronic apparatus further includes a sensing unit to detect
movement of the electronic apparatus. The area of the image
displayed on the display changes according to the movement of the
electronic apparatus detected by the sensing unit.
[0014] According to another aspect of the present invention, the
control unit transmits information regarding the movement of the
electronic apparatus detected by the sensing unit to the external
apparatus via the communication unit, and controls the area of the
image received via the communication unit from the external
apparatus to be displayed on the display.
[0015] According to another aspect of the present invention, the
direction of the movement of the electronic apparatus detected by
the sensing unit corresponds to the direction in which the area of
the image changes.
[0016] According to another aspect of the present invention, when
the user inputs the user command related to the external apparatus
using the electronic apparatus, the distance between the electronic
apparatus and the user is less than the distance between the
external apparatus and the user.
[0017] According to another aspect of the present invention, the
electronic apparatus further includes a capturing unit to capture
an area of an image displayed on the external apparatus. The
control unit transmits the area of the image captured by the
capturing unit to the external apparatus via the communication
unit, and receives information regarding GUI items in the area of
the image from the external apparatus via the communication
unit.
[0018] According to another aspect of the present invention, the
external apparatus is a broadcast receiving apparatus, and the
electronic apparatus is a remote controller of the broadcast
receiving apparatus.
[0019] According to another embodiment of the present invention, a
method of providing a graphical user interface (GUI) is provided.
The method includes displaying an area of an image displayed on an
external apparatus communicably connected to an electronic
apparatus in a GUI form on the electronic apparatus; and
transferring a user command input using the area of the image
displayed on the electronic apparatus to the external
apparatus.
[0020] According to another aspect of the present invention, the
area of the image displayed on the electronic apparatus appears to
a user to be greater in size than the corresponding area of the
image displayed on the external apparatus.
[0021] According to another aspect of the present invention, the
area of the image includes GUI items selectable by the user. The
transferring of the user command includes transferring information
regarding a GUI item selected by the user to the external apparatus
so as to transmit the user command to the external apparatus.
[0022] According to another aspect of the present invention, the
transferring of the user command includes transferring information
regarding a GUI item touched by the user among GUI items in an area
of an image displayed on a touch screen of the electronic apparatus
to the external apparatus.
[0023] According to another aspect of the present invention, the
method further includes detecting movement of the electronic
apparatus. The area of the image displayed on the electronic
apparatus changes according to the detected movement of the
electronic apparatus.
[0024] According to another aspect of the present invention, the
direction of the detected movement of the electronic apparatus may
correspond to the direction in which the area of the image
changes.
[0025] According to another embodiment of the present invention,
provided a display apparatus is provided. The apparatus includes a
display; a communication unit communicably connected to an
electronic apparatus; and a control unit to execute a user command
received from the electronic apparatus via the communication unit,
and to transfer information regarding graphical user interface
(GUI) items in an area of an image displayed on the display to the
electronic apparatus via the communication unit.
[0026] According to another embodiment of the present invention, an
electronic apparatus to transfer user commands related to
peripheral apparatuses to the corresponding peripheral apparatuses
is provided. The apparatus includes a display; a communication unit
communicably connected to the peripheral apparatuses; and a control
unit to determine which peripheral apparatus is facing the
electronic apparatus and to display a graphical user interface
(GUI) representing the peripheral apparatus found as a result of
the determination.
[0027] Additional aspects and/or advantages of the invention will
be set forth in part in the description which follows and, in part,
will be obvious from the description, or may be learned by practice
of the invention.
BRIEF DESCRIPTION OF THE DRAWINGS
[0028] These and/or other aspects and advantages of the invention
will become apparent and more readily appreciated from the
following description of the embodiments, taken in conjunction with
the accompanying drawings of which:
[0029] FIGS. 1A and 1B illustrate a broadcast receiving system to
which the present invention is applicable;
[0030] FIGS. 2A and 2B illustrate patterns by which a user may move
a remote controller, according to an embodiment of the present
invention;
[0031] FIG. 3 is a detailed block diagram of a DTV and remote
controller, according to an embodiment of the present
invention;
[0032] FIG. 4 is a flowchart of a process for providing a user with
an area of a display image in the form of a GUI using a touch
screen on a remote controller in a broadcast receiving system shown
in FIG. 3;
[0033] FIG. 5 illustrates operation S440 of FIG. 4 in more detail,
according to an embodiment of the present invention;
[0034] FIG. 6 is a detailed block diagram of a DTV and remote
controller, according to another embodiment of the present
invention;
[0035] FIG. 7 is a flowchart of a process for providing a user with
an area of a display image in the form of a GUI using a touch
screen on a remote controller in a broadcast receiving system shown
in FIG. 6;
[0036] FIG. 8 illustrates a video system according to another
embodiment of the present invention; and
[0037] FIG. 9 is a detailed block diagram of a remote controller
shown in FIG. 8.
DETAILED DESCRIPTION OF THE EMBODIMENTS
[0038] Reference will now be made in detail to the present
embodiments of the present invention, examples of which are
illustrated in the accompanying drawings, wherein like reference
numerals refer to the like elements throughout. The embodiments are
described below in order to explain the present invention by
referring to the figures.
[0039] FIG. 1A shows a broadcast receiving system according to an
embodiment of the present invention. The broadcast receiving system
of FIG. 1A includes a digital television (DTV) 100 as a broadcast
receiving apparatus, and a remote controller 200 as a user input
device. Although described with respect to a broadcast receiving
apparatus, aspects of the present invention are applicable to any
external apparatus usable with a remote control, such as a
computer, a reproducing apparatus, a set-top box, a video game
console, or a multi-function device.
[0040] The DTV 100 provides a user U with a broadcast received by a
broadcast medium by displaying the broadcast on a display 140.
Additionally, the DTV 100 provides the user U with a Web page
received via the Internet by displaying the Web page on the display
140. FIG. 1A shows a situation in which a Web page is displayed on
the display 140.
[0041] The remote controller 200 sends operation commands by the
user U to the DTV 100, and the DTV 100 operates according to the
received input commands. The remote controller 200 includes a touch
screen 240. As shown in FIG. 1A, the area of an image displayed on
the display 140 of the DTV 100 (hereinafter, referred to as the
"area of the display image") may also be displayed on the touch
screen 240 on the remote controller 200.
[0042] The image displayed on the touch screen 240 may appear to
the user U to be greater in size than the area of the display
image. This may be because the actual size of the image displayed
on the touch screen 240 is greater than that of the area of the
display image, or because the actual size of the image displayed on
the touch screen 240 is smaller than that of the area of the
display image but the distance between the user U and the remote
controller 200 is less than the distance between the user U and the
DTV 100.
[0043] As indicated by arrows in FIG. 1A, the user U may move the
remote controller 200 in an upwards or downwards direction, or to
the left or right, or in a direction combining two of these
directions, such as an upper-leftwards direction, for instance. The
remote controller 200 may be moved in any direction.
[0044] For example, the remote controller 200 may be moved while
drawing a locus on a virtual plane (VP) which is in a parallel
relation with the screen of the display 140. FIG. 1B shows a
situation in which the remote controller 200 is moved to the left
by the user U while drawing a locus on a VP which is in a parallel
relation with the screen of the display 140. As shown in FIG. 1B,
the image displayed on the touch screen 240 remains on the touch
screen 240 even after the remote controller 200 is moved to the
left, but after a predetermined period of time, the image may be
changed to another image according to the movement of the remote
controller 200.
[0045] Similarly, if the remote controller 200 is moved to the
left, an area to the left of the area of the display image may be
displayed on the touch screen 240. If the remote controller 200 is
moved to the left, that is, if a frame around the area of the
display image is moved to the left, an image indicated by the frame
may be displayed on the touch screen 240. An image to be displayed
on the touch screen 240 may thus change in the same direction as
the remote controller 200 moves.
[0046] The VP may not be in a perfect parallel relation with the
screen of the display 140 of the DTV 100, and may not be a perfect
plane. It is practically impossible for the movement of the remote
controller 200 by the user U to be on a perfect plane and in a
perfect parallel relation with the screen of the display 140.
Accordingly, aspects of the present invention may be applicable to
a situation in which the remote controller 200 moves on an
imperfect plane and in an imperfect parallel relation with the
screen of the display 140.
[0047] As shown in FIG. 2A, the remote controller 200 may be moved
by the user U while drawing a locus on a VP that is perpendicular
to the screen of the display 140. FIG. 2A shows, using dotted
lines, a situation in which the user U moves the remote controller
200 to the left while drawing a locus on the VP. In this situation,
the VP may not be perfectly perpendicular to the screen of the
display 140 of the DTV 100, and may not be a perfect plane.
Accordingly, aspects of the present invention may be applicable to
a situation in which the remote controller 200 moves on an
imperfect plane and in an imperfect perpendicular relation with the
screen of the display 140.
[0048] The user U may move the remote controller 200 by turning
only his wrist while his arm holding the remote controller 200 is
fixed. If only the wrist of the user U moves in an upwards or
downwards direction, or to the left or right, or in a direction
combining these, such as an upper leftward direction, the remote
controller 200 may be moved upwards, downwards, or to the left or
right, or in a direction combining any of these movements, such as
an upper leftwards direction while drawing a curved locus on a
virtual hemispherical surface. FIG. 2B shows a situation in which
the remote controller 200 is moved to the left by the user U while
drawing a curved locus on a virtual hemispherical surface.
[0049] The virtual hemispherical surface, on which the remote
controller 200 is moved by rotation of the user's wrist, may be a
mathematically imperfect hemispherical surface. It is practically
impossible for the remote controller 200 to be moved by rotating
the wrist of the user U while drawing a locus on a mathematically
perfectly hemispherical surface. Accordingly, aspects of the
present invention may be applicable to a situation in which the
remote controller 200 does not move on a mathematically perfect
hemisphere, but moves on an imperfect hemispherical surface while
drawing a curved locus.
[0050] The DTV 100 and remote controller 200 will be described in
detail with reference to FIG. 3. FIG. 3 shows the DTV 100 and
remote controller 200, according to an embodiment of the present
invention. The remote controller 200 of FIG. 3 includes a movement
sensor 210, a remote control communicator 220, a remote control
unit 230, a touch screen 240 and a key input unit 250. According to
other aspects of the present invention, the remote controller 200
may include additional and/or different units.
[0051] The movement sensor 210 senses movement of the remote
controller 200 moved by the user U, and sends the result of sensing
to the remote control unit 230, which will be described in detail
below. The movement sensor 210 may be implemented as a biaxial gyro
sensor or an infrared ray sensor. The remote control communicator
220 is connected to the DTV 100 to enable communication using radio
frequency (RF) signals. The key input unit 250 includes a variety
of keys with which the user U may input user commands. The touch
screen 240 may function both as a display on which a screen is
displayed and as a user input means to receive touch input by the
user U, although such combined functionality is not required in all
aspects.
[0052] The remote control unit 230 transmits movement information
to the DTV 100 via the remote control communicator 220. The
movement information may include information regarding the
direction and distance of movement of the remote controller 200,
which is obtained from the sensing result transmitted from the
movement sensor 210. The remote control unit 230 may also send
information about keys pressed by the user U using the key input
unit 250 to the DTV 100 through the remote control communicator
220.
[0053] Additionally, the remote control unit 230 displays an image
based on data received from the DTV 100 on the touch screen 240.
The image displayed on the touch screen 240 may include a graphical
user interface (GUI) item, and the user U may thus select the GUI
item displayed on the touch screen 240 by touching the GUI item.
Accordingly, the remote control unit 230 may send information
regarding the GUI item selected by the user U through the touch
screen 240 to the DTV 100 via the remote control communicator
220.
[0054] As shown in FIG. 3, the DTV 100 includes a broadcast
receiving unit 110, a broadcast processing unit 120, a GUI
generating unit 130, a display 140, an audio output unit 150, an
Internet interface 160, a DTV control unit 170 and a DTV
communication unit 180.
[0055] The broadcast receiving unit 110 receives a broadcast via a
wired or wireless connection from a broadcasting station or a
satellite, and demodulates the received broadcast. The broadcast
processing unit 120 performs signal processing, such as video
decoding, video scaling, and audio decoding of the broadcast output
from the broadcast receiving unit 110. Additionally, the broadcast
processing unit 120 transmits video signals and audio signals to
the GUI generator 130 and the audio output unit 150,
respectively.
[0056] The GUI generating unit 130 generates a GUI that will be
displayed on the display 140, and combines the GUI with the video
output from the broadcast processing unit 120. The display 140
displays the video combined with the GUI output from the GUI
generating unit 130. The audio output unit 150 outputs the audio
signals output from the broadcast processing unit 120 to a speaker.
The Internet interface 160 is communicably connected to the
Internet, and receives a Web page from a Web server connected to
the Internet.
[0057] The DTV control unit 170 processes the Web page received via
the Internet interface 160 and sends the processed Web page to the
GUI generating unit 130, so that the Web page may be displayed on
the display 140. The DTV control unit 170 recognizes the commands
of the user U based on information regarding the operation provided
by the user U, including movement of the remote controller 200, key
input, or touch of a GUI item, which are received via the DTV
communication unit 180 from the remote controller 200. The DTV
control unit 170 controls the entire operation of the DTV 100
according to the recognized commands of the user U.
[0058] A process for providing the user U with an area of a display
image in the form of a GUI using the touch screen 240 on the remote
controller 200 in the broadcast receiving system of FIG. 3 will be
described in detail with reference to FIG. 4, which shows a
flowchart of a process for providing an area of a display image in
the form of the GUI using the touch screen 240 on the remote
controller 200 in the broadcast receiving system shown in FIG. 3,
according to an embodiment of the present invention.
[0059] In the flowchart of FIG. 4, operations performed by the
remote controller 200 are shown on the left, and operations
performed by the DTV 100 are shown on the right. Text in the center
of FIG. 4 refers to messages, data, or information received and
transmitted between the DTV 100 and remote controller 200. If the
user U inputs a remote control image display command using the key
input unit 250 on the remote controller 200 in operation S410-Y,
the remote control unit 230 transmits an initial image request
message to the DTV 100 through the remote control communicator 220
in operation S415.
[0060] The remote control image display command may be a user
command to display the area of the display image on the touch
screen 240 on the remote controller 200. As described above, the
area of the display image refers to the area of the image displayed
on the display 140 of the DTV 100.
[0061] In response to the initial image request message, the DTV
control unit 170 transmits data regarding the central area of an
image currently displayed on the display 140 (hereinafter, referred
to as "center of the display image") to the remote controller 200
through the DTV communication unit 180 in operation S420. For
example, if the image currently displayed on the display 140 is a
Web page written in Hypertext Markup Language (HTML), the DTV
control unit 170 may transmit HTML data regarding the center of the
display image to the remote controller 200.
[0062] In operation S425, the remote control unit 230 scales an
image using the data received from the DTV control unit 170 to fit
on the touch screen 240, and displays the scaled image on the touch
screen 240, so that the center of the display image may be
displayed on the touch screen 240. If the movement sensor 210
senses movement of the remote controller 200 in operation S430-Y,
the remote control unit 230 transmits movement information
regarding the remote controller 200 to the DTV 100 via the remote
control communicator 220 in operation S435.
[0063] The DTV control unit 170 designates an area of the display
image to be transmitted to the remote controller 200, using the
movement information received from the remote control unit 230, in
operation S440. The movement information may include information
regarding the direction and distance in which the remote controller
200 moves, so that the DTV control unit 170 may take into
consideration both the direction and the distance during operation
S440.
[0064] FIG. 5 shows, in more detail, operation S440 of FIG. 4, by
which the DTV control unit 170 designates an area of the display
image to be transmitted to the remote controller 200. In FIG. 5, an
image indicated by a frame on the center of the display 140
corresponds to the center of the display image transmitted to the
remote controller 200 in operation S420.
[0065] If the remote controller 200 is moved to the left by
approximately 10 cm, the DTV control unit 170 designates an image
indicated by a frame on the left of the display 140 shown in FIG. 5
to be transmitted to the remote controller 200 during operation
S440. Alternatively, if the remote controller 200 is moved to the
upper right by approximately 15 cm, the DTV control unit 170
designates an image indicated by a frame on the upper right of the
display 140 shown in FIG. 5 to be transmitted to the remote
controller 200 during operation S440. Subsequently, the DTV control
unit 170 transmits data regarding the image designated in operation
S440 to the remote controller 200 via the DTV communication unit
180 in operation S445 of FIG. 4.
[0066] The remote control unit 230 scales an image using the data
received from the DTV control unit 170 to fit on the touch screen
240 and displays the scaled image on the touch screen 240, so that
the image designated in operation S440 may be displayed on the
touch screen 240 in operation S450. The image displayed on the
touch screen 240 as a result of operation S450 may include GUI
items. As shown in FIG. 1B, a field "SEARCH" displayed on the touch
screen 240 and an input window disposed above the field "SEARCH"
are used as GUI items. The user U may select a desired GUI item
from among the GUI items displayed on the touch screen 240 by
touching the GUI item.
[0067] If the user U touches one of the GUI items displayed on the
touch screen 240 in operation S455-Y, the remote control unit 230
transmits information regarding the touched GUI item to the DTV 100
via the remote control communicator 220 in operation S460. The DTV
control unit 170 determines which GUI item is selected by the user
U, using the information regarding the touched GUI item received
from the remote control unit 230, and executes a function
corresponding to the selected GUI item in operation S465.
[0068] For example, if the user U touches the field "SEARCH", the
DTV control unit 170 may search the Internet using a search term
entered in the input window. Alternatively, if the user U touches a
hypertext anchor, the DTV control unit 170 connected to the
Internet interface 160 requests a Web page linked to the hypertext
anchor from a Web server connected to the Internet.
[0069] Although the user U inputs the remote control image display
command using the key input unit 250 on the remote controller 200
as described above, any method by which the user U is able to input
the remote control image display command can be used. For example,
in order to input the remote control image display command, the
user U may touch the touch screen 240 on the remote controller 200
or may shake the remote controller 200 horizontally, instead of
using the key input unit 250.
[0070] Additionally, the center of the image currently displayed on
the display 140 is set to be an initial image displayed on the
touch screen 240 in response to the remote control image display
command, but this is only for convenience of description.
Accordingly, areas other than the center of the image currently
displayed on the display 140 may be set to be an initial image
displayed on the touch screen 240.
[0071] Furthermore, the DTV 100 designates an area of the display
image that will be displayed on the touch screen 240 as described
above, but this is merely for convenience of description. Aspects
of the present invention are also applicable to a situation in
which the remote controller 200 designates an area of the display
image to be displayed on the touch screen 240.
[0072] Moreover, the remote controller 200 determines which GUI
item is selected by the user U as described above, but this is
merely for convenience of description. Aspects of the present
invention are also applicable to a situation in which the DTV 100
determines which GUI item is selected by the user U.
[0073] Additionally, the touch screen 240 may be another display,
and the remote controller 200 may be a mobile phone, a personal
multimedia player (PMP), a digital camera or an ultra-mobile
personal computer (UMPC). The DTV 100 may also be replaced by
another display apparatus.
[0074] A second embodiment of the present invention will be
described with reference to FIG. 6. FIG. 6 shows a DTV 500 and a
remote controller 600, according to the second embodiment of the
present invention. The remote controller 600 of FIG. 6 includes a
capturing unit 610, a remote control communicator 620, a remote
control unit 630, a touch screen 640 and a key input unit 650.
[0075] The capturing unit 610 captures an area of an image
displayed on a display 540 (hereinafter, referred to as "an area of
a display image"). Data regarding the area of the display image
captured by the capturing unit 610 is transferred to the remote
control unit 630, which will be described in detail below. The
capturing unit 610 may be disposed on the rear side of the remote
controller 600. For example, if the remote controller 600 is placed
as shown in FIGS. 1A and 1B, the capturing unit 610 may capture one
area of the display image.
[0076] The remote control communicator 620 is connected to a DTV
500 to enable communication using RF signals, or other signals,
such as infrared. The key input unit 650 includes a variety of keys
by which the user U may input user commands. The touch screen 640
functions as a display on which a screen is displayed and as a user
input device to receive touch input by the user U.
[0077] The remote control unit 630 transmits information regarding
the area of the display image captured by the capturing unit 610 to
the DTV 500 via the remote control communicator 620. The remote
control unit 630 also sends information about keys pressed by the
user U using the key input unit 650 to the DTV 500 through the
remote control communicator 620.
[0078] Additionally, the remote control unit 630 displays an image
based on data received from the DTV 500 on the touch screen 640.
The image displayed on the touch screen 640 may include a GUI item,
and the user U may thus select the GUI item displayed on the touch
screen 640 by touching the GUI item. Accordingly, the remote
control unit 630 may send information regarding the GUI item
selected by the user U through the touch screen 640 to the DTV 500
via the remote control communicator 620.
[0079] The DTV 500 of FIG. 6 includes a broadcast receiving unit
510, a broadcast processing unit 520, a GUI generating unit 530, a
display 540, an audio output unit 550, an Internet interface 560, a
DTV control unit 570 and a DTV communication unit 580. The
broadcast receiving unit 510, broadcast processing unit 520, GUI
generating unit 530, display 540, audio output unit 550, Internet
interface 560 and DTV communication unit 580 of the DTV 500 as
shown in FIG. 6 are configured in a similar manner as the broadcast
receiving unit 110, broadcast processing unit 120, GUI generating
unit 130, display 140, audio output unit 150, Internet interface
160 and DTV communication unit 180 of the DTV 100 as shown in FIG.
2, so detailed description thereof is omitted.
[0080] The DTV control unit 570 processes the Web page received via
the Internet interface 560, and sends the processed Web page to the
GUI generating unit 530, so that the Web page may be displayed on
the display 540. The DTV control unit 570 recognizes the commands
of the user U based on information regarding the operation,
provided by the user U, including movement of the remote controller
600, key input or touch of a GUI item, which is received from the
remote controller 600. The DTV control unit 570 controls the entire
operation of the DTV 500 according to the recognized commands of
the user U.
[0081] A process of providing the user U with an area of a display
image in the form of a GUI using the touch screen 640 of the remote
controller 600 in a broadcast receiving system of FIG. 6 will be
described in detail with reference to FIG. 7. In the flowchart of
FIG. 7, operations performed by the remote controller 600 are shown
on the left, and operations performed by the DTV 500 are shown on
the right. Text in the center of FIG. 7 refers to messages, data,
or information received and transmitted between the DTV 500 and the
remote controller 600.
[0082] In FIG. 7, if the user U inputs a remote control image
display command using the key input unit 650 on the remote
controller 600 in operation S710-Y, the remote control unit 630
controls the capturing unit 610 to initiate a capturing operation
in operation S715. If the user U causes a lens of the capturing
unit 610 to face the display 540 of the DTV 500 (for example, if
the lens is disposed on the rear side of the remote controller 600
when the user U grips the remote controller 600 as shown in FIG. 1A
or 1B), the capturing unit 610 captures an area of the display
image entered through the lens.
[0083] The remote control image display command refers to a user
command to display the area of the display image on the touch
screen 640 on the remote controller 600. As described above, the
area of the display image refers to the area of the image displayed
on the display 540 of the DTV 500. The remote control unit 630
displays the area of the display image captured by the capturing
unit 610 on the touch screen 640 in operation S720, and transfers
the captured area of the display image to the DTV 500 via the
remote control communicator 620 in operation S725.
[0084] The DTV control unit 570 searches for an area corresponding
to the captured area received from the remote control unit 630 from
an image currently displayed on the display 540 in operation S730.
In operation S730, the DTV control unit 570 may compare the
captured area received from the remote control unit 630 to the
image currently displayed on the display 540, to perform the
search. The DTV control unit 570 checks the position of GUI items
in the area found as a result of the search in operation S735, and
then transfers information regarding the position of the GUI items
to the remote controller 600 via the DTV communication unit 580 in
operation S740.
[0085] If the user U touches the touch screen 640 in operation
S745-Y, the remote control unit 630 determines whether there is a
GUI item at the location of the touch screen 640 touched by the
user in operation S750. The remote control unit 630 determines the
existence or nonexistence of the GUI item at the touched location
based on the information regarding the position of the GUI items
received from the DTV control unit 570.
[0086] If the user touched a GUI item, the remote control unit 630
transmits information regarding the GUI item touched by the user U
to the DTV 500 in operation S755. In this situation, the
information regarding the GUI item includes information regarding
the GUI item disposed on the location touched by the user in
operation S745.
[0087] The DTV control unit 570 determines which GUI item is
selected by the user U, using the information regarding the GUI
item received from the remote control unit 630, and executes a
function corresponding to the selected GUI item in operation
S760.
[0088] Although the user U inputs the remote control image display
command using the key input unit 650 on the remote controller 600
as described above, any method by which the user U is able to input
the remote control image display command can be used.
[0089] Additionally, the lens of the capturing unit 610 is disposed
on the rear side of the remote controller 600 as described above,
but this is only for convenience of description, and accordingly
the lens may be disposed on the remote controller 600 in any
position. For example, the lens may be disposed on the front side
of the remote controller 600. In this situation, the user U causes
the remote controller 600 to be disposed as shown in FIG. 2A or 2B,
and to capture an area of a display image.
[0090] Furthermore, the area of the display image captured by the
capturing unit 610 is displayed on the touch screen 640 as
described above, but this is merely for convenience of description.
Aspects of the present invention are also applicable to a situation
in which the DTV 500 transmits data found as a result of the search
of operation S730 to the remote controller 600 and the remote
controller 600 displays an image corresponding to the received data
on the touch screen 640.
[0091] Moreover, the remote controller 600 determines which GUI
item is selected by the user U from the touch screen 640 as
described above, but this is merely for convenience of description.
Aspects of the present invention are also applicable to a situation
in which the DTV 500 determines which GUI item is selected by the
user U. Additionally, the touch screen 640 may be replaced by
another display, and the remote controller 600 may be replaced by a
mobile phone, a PMP, a digital camera or a UMPC. The DTV 500 may
also be replaced by another display apparatus, such as a computer
monitor or a television.
[0092] A third embodiment of the present invention will be
described in detail with reference to FIG. 8. FIG. 8 illustrates a
video system according to the third embodiment of the present
invention. The video system of FIG. 8 is configured in such a
manner that home appliances, such as an air conditioner 810, a
digital versatile disc recorder (DVDR) 820, a DTV 830, a home
theater system (HTS) 840 and a PC 850, are connected to a remote
controller 900, enabling mutual communication.
[0093] The home appliances 810 to 850 each include respective radio
frequency identification (RFID) tags 815 to 855. Each of the RFID
tags 815 to 855 includes information regarding the respective home
appliances 810 to 850 to which each of the RFID tags 815 to 855
belongs. For example, the RFID tag 835 in the DTV 830 may include
ID information indicating the DTV 830.
[0094] If a user causes a front end of the remote controller 900 to
indicate a specific home appliance, the remote controller 900 may
read an RFID tag in the home appliance indicated by the front end
of the remote controller 900, and may search for the home appliance
from the home appliances 810 to 850. Additionally, the remote
controller 900 may provide the user with a menu screen related to
the home appliance found as a result of the search in the form of a
GUI.
[0095] The remote controller 900 shown in FIG. 8 will be described
in detail with reference to FIG. 9. FIG. 9 is a detailed block
diagram of the remote controller 900 shown in FIG. 8. The remote
controller 900 of FIG. 9 includes a remote control communicator
910, an RFID reader 920, a remote control unit 930, a touch screen
940, a key input unit 950 and a storage unit 960.
[0096] The remote control communicator 910 is connected to the home
appliances 810 to 850 to enable communication using RF signals. The
RFID reader 920 reads the RFID tag in the home appliance indicated
by the front end of the remote controller 900 from among the home
appliances 810 to 850. The touch screen 940 functions as a display
on which a screen is displayed and as a user input means to receive
touch input by the user U. The key input unit 950 includes a
variety of keys by which the user U may input user commands. The
storage unit 960 stores menus of each of the home appliances 810 to
850.
[0097] The remote control unit 930 searches for the home appliance
facing the front end of the remote controller 900, using
information regarding the RFID tag read by the RFID reader 920. The
remote control unit 930 reads the menu of the home appliance found
by the search from the storage unit 960, and then displays the read
menu on the touch screen 940, so that the user may be provided with
the menu in the form of a GUI.
[0098] If the user U selects a menu item on the menu screen
displayed on the touch screen 940 by touching the menu item, the
remote control unit 930 may transmit information regarding the
touched menu item to a corresponding home appliance via the remote
control communicator 910. Accordingly, the home appliance may
determine which menu item is selected by the user U, using the
information regarding the menu item received from the remote
controller 900, and execute a function corresponding to the menu
item.
[0099] As described above, according to aspects of the present
invention, it is possible to provide a user with an area of an
image displayed on a display apparatus in the form of a GUI using
another display. Accordingly, the user can select a desired GUI
item more conveniently and more intuitively.
[0100] Aspects of the present invention can also be embodied as
computer readable codes on a computer readable recording medium.
The computer readable recording medium is any data storage device
that can store data which can be thereafter read by a computer
system. Examples of the computer readable recording medium also
include read-only memory (ROM), random-access memory (RAM), CDs,
DVDs, magnetic tapes, floppy disks, and optical data storage
devices. Aspects of the present invention may also be embodied as
carrier waves (such as data transmission through the Internet). The
computer readable recording medium can also be distributed over
network coupled computer systems so that the computer readable code
is stored and executed in a distributed fashion. Also, functional
programs, codes, and code segments for accomplishing the present
invention can be easily construed by programmers skilled in the art
to which the present invention pertains.
[0101] Although a few embodiments of the present invention have
been shown and described, it would be appreciated by those skilled
in the art that changes may be made in this embodiment, without
departing from the principles and spirit of the invention, the
scope of which is defined in the claims and their equivalents.
* * * * *