U.S. patent application number 13/027275 was filed with the patent office on 2011-06-09 for interactive display method.
This patent application is currently assigned to INDUSTRIAL TECHNOLOGY RESEARCH INSTITUTE. Invention is credited to Yu-Kai Chen, Yung-Chin Hsiao, Sen Lee, Ying-Tzu Lin, Bou-Chih Yang.
Application Number | 20110134146 13/027275 |
Document ID | / |
Family ID | 39151119 |
Filed Date | 2011-06-09 |
United States Patent
Application |
20110134146 |
Kind Code |
A1 |
Lin; Ying-Tzu ; et
al. |
June 9, 2011 |
INTERACTIVE DISPLAY METHOD
Abstract
An interactive display system and an interactive display method
are introduced herein. The interactive display system includes a
mirror and a display unit. The display unit is built in the mirror,
for providing auxiliary showing an image of a user in front of the
display system. The image of the user can be automatically enlarged
or shrunk and displayed on the display unit when the user moves
forward to or away from the interactive display system. In the
method, a distance is sensed between the user and the display
system. When the user moves relative to the display system, the
captured image of the user displayed on the display system is
enlarged or shrunk using a zoom ratio based on a rate of change of
the distance between the user and the display system.
Inventors: |
Lin; Ying-Tzu; (Hsinchu
City, TW) ; Hsiao; Yung-Chin; (Taipei City, TW)
; Chen; Yu-Kai; (Chiayi City, TW) ; Lee; Sen;
(Taipei Hsien, TW) ; Yang; Bou-Chih; (Kaohsiung
City, TW) |
Assignee: |
INDUSTRIAL TECHNOLOGY RESEARCH
INSTITUTE
Hsinchu
TW
|
Family ID: |
39151119 |
Appl. No.: |
13/027275 |
Filed: |
February 15, 2011 |
Related U.S. Patent Documents
|
|
|
|
|
|
Application
Number |
Filing Date |
Patent Number |
|
|
11467927 |
Aug 29, 2006 |
7916129 |
|
|
13027275 |
|
|
|
|
Current U.S.
Class: |
345/661 ;
345/667 |
Current CPC
Class: |
G02B 27/0093
20130101 |
Class at
Publication: |
345/661 ;
345/667 |
International
Class: |
G09G 5/00 20060101
G09G005/00 |
Claims
1. An interactive display method for a display system, comprising:
capturing an image of a user; and sensing a distance between the
user and the display system, wherein when the user moves relative
to the display system, the captured image of the user displayed on
the display system is enlarged or shrunk using a zoom ratio based
on a rate of change of the distance between the user and the
display system.
2. The interactive display method for the display system as claimed
in claim 1, wherein the image of the user is captured from behind
the user.
3. The interactive display method for the display system as claimed
in claim 1, further comprising receiving commands given by the user
to enlarge or shrink the image displayed on the display system, or
to show a rear view of the user, or to change the ratio of
enlarging or shrinking.
4. The interactive display method for the display system as claimed
in claim 1, further comprising receiving commands given by the user
to determine a portion of the user's body to be enlarged and
displayed on the display system.
5. The interactive display method for the display system as claimed
in claim 1, further comprising receiving commands given by the user
to change light sources for simulating a scene selected by the
user.
6. The interactive display method for the display system as claimed
in claim 1, further comprising sensing another distance between the
user and the interactive display system.
7. An interactive display method for a display system, comprising:
capturing an image of a user; sensing a distance variation between
the user and the interactive display system; and conducting an
image data processing operation on the captured image for enlarging
or shrinking the captured image according to a movement of the user
and displaying the processed image.
8. The interactive display method for the display system as claimed
in claim 7, wherein the image of the user is captured from behind
the user.
9. The interactive display method for the display system as claimed
in claim 7, further comprising receiving commands given by the user
to enlarge or shrink the image displayed on the display unit, or to
show a rear view of the user, or to change a ratio of enlarging or
shrinking.
10. The interactive display method for the display system as
claimed in claim 7, further comprising receiving commands given by
the user to determine the portion of the user's body to be enlarged
and displayed on the display system.
11. The interactive display method for the display system as
claimed in claim 7, further comprising receiving commands given by
the user to change light sources for simulating a scene selected by
the user.
12. The interactive display method for the display system as
claimed in claim 7, further comprising sensing a distance variation
between the user and the display system.
13. An interactive display method for a display system, comprising:
capturing a first image of a user; and enlarging or shrinking the
first image of the user displayed on the display system using a
scaling factor based on a rate of change of a distance between the
user and the display system, wherein the scaling factor increases
as the distance between the user and the display system shortens
and decreases as the distance between the user and the display
system lengthens.
14. The interactive display method for the display system as
claimed in claim 13, further comprising reflecting a second image
of the user on the display system, wherein a scaling factor of the
second image is constant and the scaling factor of the first image
varies based on the distance between the user and the display
system.
15. The interactive display method for the display system as
claimed in claim 14, wherein the scaling factor of the second image
equals to 1.
16. The interactive display method for the display system as
claimed in claim 14, wherein the scaling factor of the first image
is greater than the scaling factor of the second image, and the
first image is a magnified image of a portion of the second
image.
17. The interactive display method for the display system as
claimed in claim 14, wherein the scaling factor of the first image
is less than the scaling factor of the second image, and the second
image is a magnified image of a portion of the first image.
18. The interactive display method for the display system as
claimed in claim 13, wherein the first image of the user is
captured from behind the user.
19. The interactive display method for the display system as
claimed in claim 13, further comprising receiving commands given by
the user to enlarge or shrink the image displayed on the display
system, or to show a rear view of the user, or to change the
scaling factor.
20. The interactive display method for the display system as
claimed in claim 13, further comprising receiving commands given by
the user to determine a portion of the user's body to be enlarged
and displayed on the display system.
21. The interactive display method for the display system as
claimed in claim 13, further comprising receiving commands given by
the user to change light sources for simulating a scene selected by
the user.
22. The interactive display method for the display system as
claimed in claim 13, further comprising sensing another distance
between the user and the interactive display system.
Description
CROSS-REFERENCE TO RELATED APPLICATION
[0001] This is a continuation application of and claims the
priority benefit of patent application Ser. No. 11/467,927, filed
on Aug. 29, 2006, now allowed. The entirety of the above-mentioned
patent application is hereby incorporated by reference herein and
made a part of this specification.
BACKGROUND OF THE INVENTION
[0002] 1. Field of Invention
[0003] The present invention relates to an interactive display
system, and more particularly to an integrated interactive display
system including a mirror embedded with a display unit, which can
reflect image of an object directly and display enlarged or shrunk
images of an object simultaneously.
[0004] 2. Description of the Related Art
[0005] With development of high technology, imaging devices have
been becoming a common product in daily life. Users may read
information via display systems and further choose specific
information by a control device such as touch panels on the display
systems. The display system can be implemented and embedded in a
mirror for providing information. If the display system is not
activated, the top surface of the display can be used just as a
part of the mirror for reflecting the object in front of the
mirror.
[0006] Refer to FIG. 1A, which shows a conventional mirror display
system including a mirror embedded with a display device. The
mirror display system 100 includes a mirror body 110, a support 120
for supporting rotational movement of the mirror body 110, and a
display device 130 embedded in the mirror body 110 for displaying
information by a video program. In the mirror display system 100,
the video program is continuously displayed in the display device
130 for advertisement. As disclosed in U.S. Patent Application No.
2002/0196333A1, which is entitled "Mirror and image display
system", discloses a vanity console including a mirror, an image
display and a touch screen positioned on the mirror for the use of
the image display. The related arts about a display built in a
mirror can be found in the U.S. Patent Publication No. 2006/0164725
proposed by Koninklijke Philips Electronics N.V., entitled "Mirror
with built in display", or in the U.S. Patent Publication No.
2006/0185278 proposed by Koninklijke Philips Electronics N.V., also
entitled "Mirror with built in display", all disclosures are
incorporated herein for reference herewith.
[0007] Another mirror display system including a mirror embedded
with a display device can be also applied to car industries, which
is adapted to be an interior rearview mirror. As shown in FIG. 1B,
the mirror display system 150 includes a rearview mirror body 160
embedded with a display device 170. The display device 170 can show
the rearview of the vehicle to the driver by using image capture
devices disposed on the rear of the vehicle.
[0008] Another minor display system including a mirror embedded
with a display device and an radio frequency identification (RFID)
is shown in FIG. 2, developed by a Japanese company Hitachi Inc.
The mirror display system 200 includes a mirror 210 or 220, an LCD
projection 230 or 240, and an RFID receiver (not shown). When a
customer wearing or bringing a product stands near the mirror
display system 200, the mirror display system 200 will
automatically display corresponding digital contents based on the
identities from the RFIDs of the product. For example, as shown in
FIG. 2, when the customer chooses a suit of clothes to try on, the
mirror display system 200 will show the customer wearing the suit
of the clothes in the mirror 210 or 220 and the corresponding
information about the suit of the closes or other options for the
customer simultaneously. The mirror display system 200 can be used
in shops and stores.
[0009] Most of the mirror display systems are developed for
commercial purposes or for advertisement, however, the mirror
display systems disclosed in the prior art do not focus on
improving the convenience of users. For example, it is often
inconvenient for a person to use the mirror disposed away from him
because of a wash-basin located in front of the mirror. Especially
when the person is short-sighted and putting on make-up or washing
face without wearing glasses, it is difficult for him to see a
clear image displayed in the mirror because the mirror is located
in a distance away from him.
SUMMARY OF THE INVENTION
[0010] In one of some embodiments, an interactive display system is
provided. A display embedded in a mirror for providing auxiliary
showing of an enlarged or a shrunk image of an object in front of
the mirror.
[0011] In one of some embodiments, an interactive display system is
provided. The interactive display system includes a mirror embedded
with a display unit, which when an user stands or seats in front of
the display system, the image of the user can be automatically
enlarged or shrunk and displayed on the display unit embedded in
the minor when the user moves forward to or away from the
interactive display system.
[0012] In one of some embodiments, an interactive display method is
introduced. The interactive display system includes a minor and a
display unit. The display unit is built in the minor, for providing
auxiliary showing an image of a user in front of the display
system. The image of the user can be automatically enlarged or
shrunk and displayed on the display unit when the user moves
forward to or away from the interactive display system. In the
method, a distance is sensed between the user and the display
system. When the user moves relative to the display system, the
captured image of the user displayed on the display system is
enlarged or shrunk using a zoom ratio based on a rate of change of
the distance between the user and the display system.
BRIEF DESCRIPTION OF THE DRAWINGS
[0013] The accompanying drawings are included to provide a further
understanding of the invention, and are incorporated in and
constitute a part of this specification. The drawings illustrate
embodiments of the invention and, together with the description,
serve for explaining the principles of the invention.
[0014] FIG. 1A shows a conventional minor display system including
a mirror embedded with a display device.
[0015] FIG. 1B shows a conventional mirror display system including
a minor embedded with a display device, which is applied to car
industries.
[0016] FIG. 2 shows another minor display system including a minor
embedded with a display device and an radio frequency
identification (RFID).
[0017] FIGS. 3A-3C show perspective views of a preferred embodiment
of an interactive display system of the present invention.
[0018] FIG. 3D shows a perspective view of another preferred
embodiment of an interactive display system of the present
invention.
[0019] FIGS. 4-5 shows an implementation embodiment of an
interactive display system of the present invention in different
modes.
[0020] FIG. 6 shows another implementation embodiment of an
interactive display system of the present invention.
DESCRIPTION OF THE EMBODIMENTS
[0021] The present invention provides an interactive display
system. A display unit is embedded in a mirror for providing
auxiliary showing of an enlarged or a shrunk image of an object in
front of the interactive display system. The display unit can be a
liquid crystal display (LCD), a light emitting diode (LED) display,
a vacuum fluorescent display (VFD), a plasma display (PDP), an
organic light emitting display (OLED) or a field emission display
(FED) and the like. In one embodiment, the interactive display
system further includes a control device such as a touch panel for
the user to give commands or select modes of the display.
[0022] When a user stands or sits in front of the interactive
display system, the image of the user can be automatically enlarged
or shrunk and displayed on a display unit embedded in the mirror
when the user moves forward to or away from the interactive display
system. For example, when the user moves forward close to the
mirror for putting on make-up or wearing contact lenses, the image
shown on the display unit will be automatically enlarged for user's
convenience. The reflected image of the user and the enlarged
partial image of the user can be displayed at the same time and
facial features can be clearly seen through the enlarged image
displayed on the display unit. When the user moves away from the
interactive display system for a full view of the whole body, the
image shown on the display unit will be automatically shrunk. The
reflected image of the user and the shrunk image of the user can be
displayed at the same time and a full view of the whole body can be
clearly seen on the display unit.
[0023] The interactive display system of the present invention
includes one or a plurality of image capture devices such as
cameras for capturing images of the user in front of the
interactive display system. Ordinarily, the captured image is
displayed by the display unit directly, that means the display unit
behaves as a part of the minor and user may not notice the presence
of the display unit. Otherwise, through an image data processing
operation conducted in an image processing unit, the captured
images can be enlarged or shrunk and displayed on the display unit.
The operation of enlarging or shrinking images can be done in
response to the movement of the user in front of the interactive
display system. In an alternative embodiment, the operation of
enlarging or shrinking images can be done in response to user's
commands. Besides, the portion of the user's body to be enlarged
and shown on the display unit, such as his right face or his nose,
and the enlarging/shrinking ratio of images shown on the display
unit also can be determined according to the commands given by the
user.
[0024] The interactive display system of the present invention
further includes one or a plurality of distance sensors for
detecting distance variation between the user and the display
system in order to decide how the image to be shown on the display
unit. By an automatic manner, in one case that when the user moves
forward close to the display system, the distance sensor detects
the user being moving forward, the captured image of the user is
enlarged and displayed on the display unit. If the user moves
closer to the display system, it means that the enlarging ratio of
the captured image is not enough for the user, then the captured
image of the user is enlarged again with a larger enlarging ratio
and displayed on the display unit. On the contrary, if the user is
moving away from the display system, the captured image of the user
is shrunk and displayed on the display unit. If the user moves
further away from the display system, it means that the shrinking
ratio of the captured image is not enough for the user, then the
captured image of the user is shrunk again with a larger shrinking
ratio and displayed on the display unit.
[0025] In an alternative embodiment, the user can choose to display
enlarged or shrunk image through a control device such as a touch
panel. By a user mode selection manner, if the user intends to
obtain a more enlarged portion of the image, the user can select
the enlarging ratio as desired through control device such as a
touch panel on the interactive display system. If the user intends
to obtain a full view of the whole body, the user can also select
the shrinking ratio as desired through control device.
[0026] The interactive display system of the present invention
further includes one or a plurality of behind cameras disposed
behind the user. In one example, the behind cameras are disposed in
an chair located in front of the interactive display system, which
is shown in FIGS. 3A and 3C. In another embodiment, the behind
cameras 380 are disposed in one part 307 extending from the main
body 305. The corresponding interactive display system 300A is
shown in FIG. 3D. In another example, the behind camera can be
disposed in a wall behind the user, which depends on the design.
The behind camera captures an rear image of the user which can be
shown on the display unit if the user selects the mode for showing
the rear view of the user. It is very convenient for the user to
see the rear view of the body, for example, when the user is trying
to buckle the buttons or wear a necklace.
[0027] The interactive display system of the present invention
further includes a scene light source, for providing a light source
simulating some specific environments, such as a party scene, an
office scene, an outdoor scene and various light settings showing
different weather conditions. The simulated lighting condition is
convenient for the user to put on make-up properly. In one
embodiment, the scene light source can be disposed on a portion of
a rim of the mirror.
[0028] Please refer to FIGS. 3A-3C, which show respective views of
a preferred embodiment of an interactive display system of the
present invention. As shown in FIG. 3A, the interactive display
system 300 is disposed in a main body 305. The main body includes a
desktop 350 and a chair 370 with a back support 375, which is
disposed in front of the main body 305. The interactive display
system 300 includes an mirror 320 disposed in a frame 310, a
plurality of cameras 330 disposed on the frame 310 or on the mirror
320, and a light source 340. A display unit 325 is built within the
mirror 320. The interactive display system 300 further includes a
behind camera 380 for capturing rear-view image of the user. The
interactive display system 300 further includes a plurality of
distance sensors 335 surrounding the mirror 320 for sensing several
distance variations in different angles between the user and the
interactive display system 300.
[0029] These cameras 330 in a front side of the interactive display
system 300 capture images of the user in front of the mirror 320.
The captured images will be displayed on the display unit 325, and
by an image data processing operation in an image processing unit
332 connected to the cameras 330 and the display unit 325, the
captured images can be easily enlarged or shrunk in response to the
movement of the user or based on the user's commands.
[0030] In the interactive display system, when the user moves
forward close to the display system, the distance sensors 335
detect the user being moving forward, the captured image of the
user is enlarged and displayed on the display unit 325. If the user
moves closer, the captured image of the user is enlarged again with
a larger enlarging ratio and displayed on the display unit. On the
contrary, if the user is moving away from the display system 300,
the captured image of the user is shrunk and displayed on the
display unit 325. If the user moves further away, the captured
image of the user is shrunk again with a larger shrinking ratio and
displayed on the display unit.
[0031] In a further application, while a portion of the user's body
is moving forward to the mirror 320, for example, the right side of
the user's face, the distance sensor 335 on the right side can
sense the part of the user moving closer to the mirror 320 and then
the camera 330 can focus on capturing the corresponding portion of
the user for enlarge display on the display unit. The interactive
manner is very convenient for the user.
[0032] The light source 340 is a scene simulating light source, for
providing a light source simulating some specific environments,
such as a party scene, an office scene, an outdoor scene and
various light settings showing different weather conditions. The
interactive display system 300 further includes an audio player 390
such as a CD player or a MP3 player, for providing sounds and
background music from a speaker 395 based on the user's
commands.
[0033] Please refer to FIG. 4, which shows an implementation
embodiment of an interactive display system of the present
invention. The interactive display system includes an mirror 410
with a display unit 413 built within. When the user 420 moves
forward for brushing her teeth, not only the image 411 reflected
directly by the mirror 410 but also a portion of the user 420 is
enlarged and displayed on the display unit 413 at the same time.
The interactive display system can further include a control device
such as a touch bottom 415 for the user 420 to apply commands for
further enlargement or shrinkage of the image shown in the display
413.
[0034] In the case that the user is brushing her teeth, she desires
to get an enlarged portion of her face. While the interactive
display system is operating in an automatic manner, if the user is
moving forward to the mirror 410, the enlarging ratio is increased
and, on the contrary, if the user is moving away from the mirror
410, the enlarging ratio is decreased. If the interactive display
system is operating in a user mode selection manner, because the
user is desiring to get an enlarged portion of her face, the user
can select the enlarging ratio as desired by, for example, through
a touch screen.
[0035] Please refer to FIG. 5, which shows the implementation
embodiment of an interactive display system in a different mode. By
the user's commands, the rear view of the user 520 is shown on the
display 513 built in the mirror 510. If the user 520 tries to plait
her hair, it is very convenient for the user 520 to look at the
rear view image displayed on the display unit.
[0036] Please refer to FIG. 6, which shows another implementation
embodiment of an interactive display system of the present
invention. The interactive display system of the present invention
includes a control device 610 comprising a touch screen 620. In the
touch screen 620, a plurality of options can be selected for
different modes, for example, the option by the reference number
621 indicates a menu for locations, and options of the locations
include "office", "outdoor", "party", and etc. If the user selects
the item "office", the selected command is transmitted to the
control device 610 and a light source of the interactive display
system will be adjusted to simulate the environment at the office
scene. The simulated environment can provide the user, for example,
to do some suitable make-up for an interview at the office. In the
touch screen 620, further options can be selected for different
commands, for example, an enlarge option (+) 632 and a shrink
option (-) 634 are provided for respectively enlarging/shrinking
the displayed image. An option "rear view" is provided for
displaying the user's rear view. A further option for selecting the
ratio of enlarging or shrinking by percentage (%) is provided for
changing the ratio of enlarging or shrinking.
[0037] In the embodiment, the touch screen 620 includes more
options for image display. For example, a menu for partially
enlarging the image captured, as referenced as "portion" 641 in
FIG. 6. The options for partially display includes a right face
option 643, a left face option 645, a nose option 647, and etc. If
the user intends to obtain an enlarged portion of the image, for
example, the nose of the user, he can select the command "nose
option" 647 as desired and then the command will be sent to the
control device 610 of the interactive display system. The portion
of the nose of the captured image will be enlarged at a larger
enlarge ratio and the user can obtain the image he desired.
[0038] It will be apparent to those skilled in the art that various
modifications and variations can be made to the structure of the
present invention without departing from the scope or spirit of the
invention. In view of the foregoing, it is intended that the
specification and examples to be considered as exemplary only, with
a true scope and spirit of the invention being indicated by the
following claims and their equivalents.
* * * * *