U.S. patent application number 12/126791 was filed with the patent office on 2008-11-27 for 3d image display method and system thereof.
This patent application is currently assigned to Eun-Soo KIM. Invention is credited to Suk-Pyo Hong, Eun-Soo Kim, Seung-Cheol Kim, Yong-Seok Oh, Dong-Hak Shin.
Application Number | 20080291269 12/126791 |
Document ID | / |
Family ID | 40072007 |
Filed Date | 2008-11-27 |
United States Patent
Application |
20080291269 |
Kind Code |
A1 |
Hong; Suk-Pyo ; et
al. |
November 27, 2008 |
3D IMAGE DISPLAY METHOD AND SYSTEM THEREOF
Abstract
A three-dimensional image display method is disclosed. The
three-dimensional image display method in accordance with an
embodiment of the present invention includes: displaying an object
image; displaying a background image by using a three-dimensional
image display method; and disposing the object image at a close
distance and the background image at a far distance such that the
object image and the background image overlap inside a same viewing
angle. By using images having a different sense of depth, a
high-resolution image can be displayed while providing a sense of
reality.
Inventors: |
Hong; Suk-Pyo; (Seongnam-si,
KR) ; Oh; Yong-Seok; (Busan, KR) ; Shin;
Dong-Hak; (Busan, KR) ; Kim; Eun-Soo; (Seoul,
KR) ; Kim; Seung-Cheol; (Seoul, KR) |
Correspondence
Address: |
KNOBBE MARTENS OLSON & BEAR LLP
2040 MAIN STREET, FOURTEENTH FLOOR
IRVINE
CA
92614
US
|
Assignee: |
KIM; Eun-Soo
Seoul
KR
Shin; Dong-Hak
Busan
KR
KWANGWOON UNIVERSITY RESEARCH INSTITUTE FOR INDUSTRY
COOPERATION
Seoul
KR
|
Family ID: |
40072007 |
Appl. No.: |
12/126791 |
Filed: |
May 23, 2008 |
Current U.S.
Class: |
348/51 ;
348/E13.001 |
Current CPC
Class: |
H04N 13/31 20180501;
H04N 13/307 20180501; H04N 13/305 20180501; H04N 13/354 20180501;
H04N 13/337 20180501; H04N 13/341 20180501; H04N 13/346 20180501;
H04N 13/232 20180501; H04N 13/229 20180501; H04N 13/334 20180501;
H04N 13/344 20180501; H04N 13/156 20180501; H04N 13/356
20180501 |
Class at
Publication: |
348/51 ;
348/E13.001 |
International
Class: |
H04N 13/04 20060101
H04N013/04 |
Foreign Application Data
Date |
Code |
Application Number |
May 23, 2007 |
KR |
10-2007-0050558 |
Oct 1, 2007 |
KR |
10-2007-0098961 |
Apr 17, 2008 |
KR |
10-2008-0035640 |
Claims
1. A three-dimensional image display method in a three-dimensional
image display system, the method comprising: displaying an object
image; displaying a background image by using a three-dimensional
image display method; and disposing the object image at a close
distance and the background image at a far distance such that the
object image and the background image overlap inside a same viewing
angle.
2. The method of claim 1, wherein, in the disposing the object
image and the background image, one of the object image and
background image is formed as a real image and the other is formed
as a virtual image, by using a half mirror, the half mirror
permeating one of the object image and background image and
reflecting the other.
3. The method of claim 2, wherein the object image is reflected on
the half mirror and is formed as a virtual image on an opposite
side of the half mirror.
4. The method of claim 1, wherein, in the displaying the background
image, the background image is projected to a lens array and is
displayed as an element image.
5. The method of claim 1, wherein the displaying comprises:
generating a mask image corresponding to the object image;
combining the background image with the mask image; and projecting
the combined image to a lens array and displaying the combined
image as an element image.
6. The method of claim 5, wherein an element image of the mask
image is treated black.
7. The method of claim 1, wherein the displaying comprises:
outputting the background image as a left image and a right image,
the left image and the right image having complementary colors with
each other; and using a color difference method to display the
background image, the color difference method comprising separating
the left image and right image of complementary colors by using
eye-glasses with color filters.
8. The method of claim 7, wherein the complementary colors of the
left image and right image are red and green, respectively.
9. The method of claim 1, wherein the displaying uses a
polarization method to display the background image, the
polarization method separating a left image and a right image of
the background image by using polarized eye-glasses, the polarized
eye-glasses having a left lens and a right lens that have different
polarizing directions from each other.
10. The method of claim 9, wherein the polarized eye-glasses use
the difference in oscillation direction of linear polarization or
the difference in rotation direction of circular polarization.
11. The method of claim 1, wherein the displaying comprises:
repeatedly outputting the background image periodically as a left
image and a right image, the left image and the right image having
different parallax; and using a time-division method to display the
background image, the time-division method comprising separating
the left image and the right image through an electronic shutter
synchronized with the repeated period.
12. The method of claim 1, wherein the displaying comprises using a
head mount display (HMD) method to display the background image,
the HMD method providing three-dimensionality by placing a display
device on the head and placing a screen right in front of the
eye.
13. The method of claim 1, wherein the displaying comprises:
outputting a left image and a right image alternately on a display
panel of the background image; and using a parallax barrier method
to display the background image, the parallax barrier method
comprising separating the left image and the right image through a
barrier placed at a distance from the display panel.
14. The method of claim 1, wherein the displaying comprises:
outputting a left image and a right image and arranging the left
image and the right image alternately on a display panel of the
background image; and using a lenticular method to display the
background image, the lenticular method comprising separating the
left image and the right image through a half-round cylindrical
shape lenticular placed at a distance from the display panel.
15. The method of claim 1, wherein the displaying comprises:
outputting a plurality of pairs of left and right images by
alternately arranging the left image and the right image on a
display panel of the background image; and using a multi-view
method to display the background image, the multi-view method
comprising separating the left image and the right image as a
plurality of point-of-views through a barrier placed at a distance
from the display panel.
16. The method of claim 1, wherein, in the displaying the object
image, the lens is a convex lens or a concave mirror.
17. The method of claim 1, wherein, in the displaying the key
image, the lens is a plurality of convex lenses or a plurality of
concave mirrors.
18. One or more processor-readable storage devices having
processor-readable code, the processor-readable code which, when
executed by one or more processors, performs a three-dimensional
image display method in a three-dimensional image display system,
the method comprising: displaying an object image; displaying a
background image by using a three-dimensional image display method;
and disposing the object image at a close distance and the
background image at a far distance such that the object image and
the background image overlap inside a same viewing angle.
19. A three-dimensional image display system, comprising: an object
image display system unit configured display an object image; an
integral image display system unit configured to display a
background image as an element image; and an optical unit
configured to dispose the object image at a close distance and the
background image at a far distance such that the object image and
the background image overlap inside a same viewing angle.
20. The system of claim 19, wherein the integral image display
system unit comprises a lens array, and wherein the integral image
display system unit displays the background image by projecting the
element image on the lens array.
21. The system of claim 19, wherein the object image display system
unit comprises: a display panel configured to display the object
image on a panel; and a floating lens, which is a convex lens or a
concave lens, wherein an image displayed on the display panel is
configured to be floating-displayed by being projected to the
floating lens.
22. The system of claim 21, wherein the floating lens is a
plurality of convex lenses of a plurality of concave mirrors.
23. The system of claim 21, wherein the floating-image display
system unit comprises a lens, allowing an object image displayed on
the display panel to be formed at a distance H, the distance H
being computed through a formula H = hf 1 h - f 1 , ##EQU00003## h
being the distance between the display panel and the lens, f1 being
the focal length of the lens, H being the distance of a location on
which the object image is formed.
24. The system of claim 19, wherein the integral image display
system unit comprises: a display panel, on which a background image
is displayed; and a lens array, placed at the front of the display
panel, wherein the background image is projected to the lens array
and displayed as an element image.
25. The system of claim 19, wherein the optical means is a half
mirror, the half mirror permeating one of the object image and
background image and reflecting the other.
26. The system of claim 25, wherein the half mirror reflects the
object image, whereas the object image is formed as a virtual image
on an opposite side of the half mirror.
27. A three-dimensional image display system, comprising: means for
displaying an object image; means for displaying a background image
by using a three-dimensional image display method; and means for
disposing the object image at a close distance and the background
image at a far distance such that the object image and the
background image overlap inside a same viewing angle.
Description
CROSS-REFERENCE TO RELATED PATENT APPLICATIONS
[0001] This application claims the benefit of Korean Patent
Application Nos. 10-2007-0050558, filed on May 23, 2007,
10-2007-0098961, filed on Oct. 1, 2007, and 10-2008-0035640, filed
on Apr. 17, 2008, in the Korean Intellectual Property Office, the
disclosure of which is incorporated herein in its entirety by
reference.
BACKGROUND OF THE INVENTION
[0002] 1. Field of the Invention
[0003] The present invention relates to a system and method of
displaying a 3D image, more specifically to a 3D image display
method, and a system thereof, having a background image for adding
three-dimensionality.
[0004] 2. Background Art
[0005] There have been a number of researches and developments on
three-dimension imagery and image display technologies. As a new
concept of virtual image media that will enhance the technological
level of visual information, the three-dimensional image-related
media are expected to lead the new generation of display
technology. Consequently, academic institutions and industry
researchers, both in Korean and overseas, are actively researching
in this field.
[0006] Three-dimensional images are more realistic and natural than
two-dimensional images, and are increasingly preferred to their
two-dimensional predecessors. While the conventional
two-dimensional display system provided an image on a flat plane,
the three-dimensional display system provides the inherent, real
image information of an object to an observer. In such sense, the
three-dimensional display system is an ultimate image display
technology.
[0007] For the display of such three-dimensional images,
stereoscopy, holography and integral imaging have been
developed.
[0008] In the stereoscopy method, which imitates the human visual
system, images corresponding to the left eye and the right eye,
respectively, are separately inputted. An image is separated into a
left-eye image and a right-eye image, which are then inputted to
the left eye and the right eye, respectively, of an observer, who
is wearing polarized glasses.
[0009] The holography method allows an observer to experience a
real-like three-dimensional image, without wearing any special
glasses, when looking at the holography created by use of laser.
With its high three-dimensionality, the holography method is known
to be least physically demanding to the observer, hence the most
ideal method for realizing three-dimensional imagery.
[0010] The integral imaging display method is mainly divided into
image pick-up and image display. The image pick-up process is
arranged by a two-dimensional sensor, such as an image sensor, and
a lens array, before which a three-dimensional object is placed. A
variety of information on the three-dimensional object is passed
through the lens array and stored in the two-dimensional sensor. As
an element image, the stored image is used for displaying the image
three-dimensionally. A reverse process of the image pick-up
process, the image display process of the integral imaging display
method is arranged by an image display device, such as a liquid
crystal display device, and a lens array. The element image
obtained by the image pick-up process is displayed on the image
display device, and the image information of the element image is
passed through the lens array and displayed in space
three-dimensionally.
[0011] A type of glass-less 3D display technology, the floating
display system can be often found in museums or exhibition
showcases.
[0012] Simple in the structure, the floating-image display system
is easy to realize a high-resolution image in real space. Once an
image from a flat display device, such as an LCD, passes through a
floating lens, which uses a convex lens or a concave mirror, the
image is formed in space, and the viewer can see the image floating
in space in front of his or her eyes. The image displayed by the
floating-image display system, however, is limited to a single real
plane, hindering the system from displaying the image
three-dimensionally.
[0013] The above 3D display methods, however, require an enormous
amount of data to process a near-perfect sense of
three-dimensionality, because they realize the 3D imagery from a
single 2D or 3D image, and thus are unable to provide consecutive
3D images. Moreover, the three-dimensionality that a user senses
has been somewhat limited when the 3D image is provided by a single
system.
SUMMARY OF CERTAIN INVENTIVE ASPECTS
[0014] One aspect of the present invention is a 3D image display
method, and a system thereof, having a background image.
[0015] Another aspect of the present invention is a 3D image
display method, and the system thereof, which can render a more
real-like three-dimensional image by solving the overlapping region
problem, which is often occurred when two or more real planes are
used in a 3D image display system.
[0016] Another aspect of the present invention is a 3D image
display method, and a system thereof, which can solve the problem
of deteriorated resolution when the image is realized by a
three-dimensional image display method only, by displaying a 3D
background image through the use of a three-dimensional image
display method and by displaying a 3D image through a separate
display of a high-resolution object image.
[0017] Another aspect of the present invention is a floating-image
display method, and a system thereof, which can implement a more
real-like background image by additionally using a 3D background
image.
[0018] An aspect of the present invention features a 3D image
display method.
[0019] The three-dimensional image display method in accordance
with an embodiment of the present invention includes: displaying an
object image; displaying a background image by using a
three-dimensional image display method; and disposing the object
image at a close distance and the background image at a far
distance such that the object image and the background image
overlap inside a same viewing angle.
[0020] In the step of disposing the object image and the background
image, one of the object image and background image can be formed
as a real image and the other can be formed as a virtual image, by
using a half mirror, which permeates one of the object image and
background image and reflects the other.
[0021] The object image can be reflected on the half mirror and
formed as a virtual image on an opposite side of the half
mirror.
[0022] In the step of displaying the background image, the
background image can be projected to a lens array and displayed as
an element image.
[0023] The step of displaying the background image can include:
generating a mask image corresponding to the object image;
combining the background image with the mask image; and projecting
the combined image to a lens array and displaying the combined
image as an element image.
[0024] An element image of the mask image can be treated black.
[0025] The step of displaying the background image can include:
outputting the background image as a left image and a right image,
the left image and the right image having complementary colors with
each other; and using a color difference method to display the
background image, the color difference method comprising the step
of separating the left image and right image of complementary
colors by using eye-glasses with color filters.
[0026] The complementary colors of the left image and right image
can be red and green, respectively.
[0027] The step of displaying the background image can use a
polarization method to display the background image. The
polarization method separates a left image and a right image of the
background image by using polarized eye-glasses, which have a left
lens and a right lens that have different polarizing directions
from each other.
[0028] The polarized eye-glasses can use the difference in
oscillation direction of linear polarization or the difference in
rotation direction of circular polarization.
[0029] The step of displaying the background image can include:
repeatedly outputting the background image periodically as a left
image and a right image, the left image and the right image having
different parallax; and using a time-division method to display the
background image, the time-division method comprising the step of
separating the left image and the right image through an electronic
shutter synchronized with the repeated period.
[0030] The step of displaying the background image can include
using a head mount display (HMD) method to display the background
image. The HMD method provides three-dimensionality by placing a
display device on the head and placing a screen right in front of
the eye.
[0031] The step of displaying the background image can include:
outputting a left image and a right image alternately on a display
panel of the background image; and using a parallax barrier method
to display the background image. The parallax barrier method
includes the step of separating the left image and the right image
through a barrier placed at a distance from the display panel.
[0032] The step of displaying the background image can include:
outputting a left image and a right image and arranging the left
image and the right image alternately on a display panel of the
background image; and using a lenticular method to display the
background image. The lenticular method includes the step of
separating the left image and the right image through a half-round
cylindrical shape lenticular placed at a distance from the display
panel.
[0033] The step of displaying the background image can include:
outputting a plurality of pairs of left and right images by
alternately arranging the left image and the right image on a
display panel of the background image; and using a multi-view
method to display the background image. The multi-view method
includes the step of separating the left image and the right image
as a plurality of point-of-views through a barrier placed at a
distance from the display panel.
[0034] In the step of displaying the object image, the lens can be
a convex lens or a concave mirror.
[0035] In the step of displaying the key image, the lens can be a
plurality of convex lenses or a plurality of concave mirrors.
[0036] Another aspect of the present invention features a recorded
medium.
[0037] The recorded medium in accordance with an embodiment of the
present invention tangibly embodies a program of instructions
executable by a digital processing apparatus to execute a
three-dimensional display method of any of claims 1 to 17, and the
program is readable by the digital processing apparatus.
[0038] Yet another aspect of the present invention features a
three-dimensional image display system.
[0039] The three-dimensional image display system in accordance
with an embodiment of the present invention can include: an object
image display system unit, displaying an object image; an integral
image display system unit, displaying a background image as an
element image; and optical means disposing the object image at a
close distance and the background image at a far distance such that
the object image and the background image overlap inside a same
viewing angle.
[0040] The integral image display system unit can include a lens
array, and the integral image display system unit can display the
background image by projecting the element image on the lens
array.
[0041] The object image display system unit can include: a display
panel, displaying the object image on a panel; and a floating lens,
which is a convex lens or a concave lens. An image displayed on the
display panel can be floating-displayed by being projected to the
floating lens.
[0042] The floating lens can be a plurality of convex lenses of a
plurality of concave mirrors.
[0043] The floating-image display system unit can include a lens,
which allows an object image displayed on the display panel to be
formed at a distance H. The distance H can be computed through a
formula
H = hf 1 h - f 1 , ##EQU00001##
whereas h is the distance between the display panel and the lens,
f1 is the focal length of the lens, and H is the distance of a
location on which the object image is formed.
[0044] The integral image display system unit can include: a
display panel, on which a background image is displayed; and a lens
array, placed at the front of the display panel. The background
image can be projected to the lens array and displayed as an
element image.
[0045] The optical means can be a half mirror, which permeates one
of the object image and background image and reflects the
other.
[0046] The half mirror can reflect the object image, and the object
image can be formed as a virtual image on an opposite side of the
half mirror.
BRIEF DESCRIPTION OF THE DRAWINGS
[0047] Embodiments of the present invention will be described with
reference to accompanying drawings where:
[0048] FIG. 1 shows how an integral imaging display method
works;
[0049] FIG. 2 shows how an overlap-removed background element image
used in a 3D image display system is created in accordance with an
embodiment of the present invention;
[0050] FIG. 3 shows the structures of the 3D image display system
in accordance with an embodiment of the present invention;
[0051] FIG. 4 shows how a floating-image display method works;
[0052] FIG. 5 shows a floating-image display method in accordance
with an embodiment of the present invention works;
[0053] FIG. 6 shows the structure of a 3D image display system in
accordance with another embodiment of the present invention;
[0054] FIG. 7 shows an experimental structure of a floating-image
display method having an integral image background in accordance
with an embodiment of the present invention;
[0055] FIG. 8 shows an object image and a background image used in
the experiment of a 3D image display method having an integral
image background in accordance with an embodiment of the present
invention;
[0056] FIG. 9 shows the creation of an overlap-removed background
image used in an integral image display system unit in accordance
with an embodiment of the present invention;
[0057] FIG. 10 shows a 3D image generated by the 3D image display
method in accordance with an embodiment of the present
invention;
[0058] FIG. 11 shows 3D images, viewed from different angles, of a
floating-image display having an integral image background in
accordance with an embodiment of the present invention;
[0059] FIGS. 12 to 14 show how the background image is displayed
using a stereoscopy method;
[0060] FIG. 13 shows how the background image is displayed using a
parallax barrier method in accordance with another embodiment of
the present invention;
[0061] FIG. 14 shows how the background image is displayed using a
lenticular method in accordance with another embodiment of the
present invention;
[0062] FIG. 15 shows how the background image is displayed using a
multi-view method in accordance with another embodiment of the
present invention;
[0063] FIG. 16 shows how the background image is displayed using a
holography method in accordance with another embodiment of the
present invention; and
[0064] FIG. 17 shows a floating-image display method in accordance
with yet another embodiment of the present invention.
DESCRIPTION OF CERTAIN INVENTIVE EMBODIMENTS
[0065] Since there can be a variety of permutations and embodiments
of the present invention, certain embodiments will be illustrated
and described with reference to the accompanying drawings. This,
however, is by no means to restrict the present invention to
certain embodiments, and shall be construed as including all
permutations, equivalents and substitutes covered by the spirit and
scope of the present invention.
[0066] Terms such as "first" and "second" can be used in describing
various elements, but the above elements shall not be restricted to
the above terms. The above terms are used only to distinguish one
element from the other. For instance, the first element can be
named the second element, and vice versa, without departing the
scope of claims of the present invention. The term "and/or" shall
include the combination of a plurality of listed items or any of
the plurality of listed items.
[0067] When one element is described as being "connected" or
"accessed" to another element, it shall be construed as being
connected or accessed to the other element directly but also as
possibly having another element in between. On the other hand, if
one element is described as being "directly connected" or "directly
accessed" to another element, it shall be construed that there is
no other element in between.
[0068] The terms used in the description are intended to describe
certain embodiments only, and shall by no means restrict the
present invention. Unless clearly used otherwise, expressions in
the singular number include a plural meaning. In the present
description, an expression such as "comprising" or "consisting of"
is intended to designate a characteristic, a number, a step, an
operation, an element, a part or combinations thereof, and shall
not be construed to preclude any presence or possibility of one or
more other characteristics, numbers, steps, operations, elements,
parts or combinations thereof.
[0069] Unless otherwise defined, all terms, including technical
terms and scientific terms, used herein have the same meaning as
how they are generally understood by those of ordinary skill in the
art to which the invention pertains. Any term that is defined in a
general dictionary shall be construed to have the same meaning in
the context of the relevant art, and, unless otherwise defined
explicitly, shall not be interpreted to have an idealistic or
excessively formalistic meaning.
[0070] Hereinafter, some embodiments will be described in detail
with reference to the accompanying drawings. Identical or
corresponding elements will be given the same reference numerals,
regardless of the figure number, and any redundant description of
the identical or corresponding elements will not be repeated.
Throughout the description of the present invention, when
describing a certain technology is determined to evade the point of
the present invention, the pertinent detailed description will be
omitted.
[0071] Referring to FIGS. 1 to 11, a 3D image display system with a
background image using an integral image display method in
accordance with an embodiment of the present invention will be
described. Referring to FIG. 12 and thereafter, a 3D image display
system with a background image in accordance with other embodiments
of the present invention will be described.
[0072] Firstly, FIGS. 1 and 2 will be used to describe how a
background image is displayed as an integral image and then how
this is disposed within the viewing angle such that the integral
image is overlapped with an object image. The object image is
formed as a virtual image if a translucent mirror is used only and
as a real image if a floating-image display method is used. This
will be described with reference to FIGS. 3 and 6.
[0073] FIG. 1 shows how an integral image display method works. The
integral image display method consists of a pick-up process and a
display process, as illustrated in FIG. 1. In the pick-up process,
element images are obtained using element lenses 104 from a 3D
object 100. Each element image has a different parallax in
accordance with the location of the corresponding element lens 104.
The element image having a different parallax refers to an image
obtained from a different point of view of the 3D object 100.
[0074] The pick-up process uses a lens array 106, in which the
element lenses 104 are arranged one-dimensionally or
two-dimensionally, to extract element images having different
parallaxes from the 3D object 100.
[0075] Therefore, after the element images are picked up using the
lens array 106, different images of the 3D object, viewed from
different angles, are stored as element images through the lens
array 106. For example, if a lens array having lenslets of
52.times.52 is used, element images are obtained for 2,704
lenslets.
[0076] In the display process, these element images are integrated
through the lens array 106 to be displayed as a 3D image. The types
of element images will be described later with reference to FIG.
10.
[0077] FIG. 2 shows how an overlap-removed background element image
used in the 3D image display system unit is created in accordance
with an embodiment of the present invention.
[0078] The 3D image display system in accordance with an embodiment
of the present invention can include an object image display system
unit and an integral image display system unit, as will be
described later. The object image display system unit and the
integral image display system unit output their respective
independent image. The object image will be described later with
reference to FIGS. 3 and 6.
[0079] Hereinafter, FIG. 2 will be referenced to describe the
process of creating an overlap-removed background image by use of
the pick-up process of integral image, which has been described
with reference to FIG. 1.
[0080] Firstly, the integral image display system unit can include
an input panel 210 and a lens array 212. The input panel can be a
CMOS image sensor or a CCD image sensor. In case there is an object
at the front of the input panel 210, the image of the object is
stored in the input panel 210.
[0081] However, as the lens array 212 is disposed at the front of
the input panel 210, light emitted or reflected from the object at
the front will be inputted to the input panel 210 through the lens
array 212.
[0082] For instance, the object can be a globe 200, spaced by Z2
252 from the lens array. The globe 200 is the base of an image to
be used as a background of a 3D image, which will be described
later with reference to FIG. 3, and is an image before it is picked
up as an element image. A space shuttle 290, which is spaced at a
distance of Z1 250 from the lens array 212, is a silhouette of an
image to be used as the object. That is, the space shuttle 290 is a
mask image, in which the inside of the image to be used as an
object is treated black.
[0083] The images 200 and 290 are placed at locations of Z2 252 and
Z1 205, respectively, by use of an LCD panel (not shown) on which
the globe is displayed and an LCD panel (not shown) on which the
space shuttle is displayed. Each of the images can be arranged by
use of a lens and a mirror (not shown).
[0084] The globe and space shuttle, placed at the distances of Z2
and Z1, are converted to element images as they pass through the
lens array, and the element images are stored in the input panel
210. Since the element image stored in the input panel is
overlapped with the black silhouette image of the space shuttle,
the overlapping area is removed and becomes black.
[0085] Hereinafter, the background image created through this
pick-up process will be referred to as an overlap-removed
background image. The overlap-removed background image is stored in
a memory, which is connected to the input panel 210, and can be
used to display a 3D image, which will be described later.
[0086] As described above, the silhouette of the object image is
removed from the background image of the globe, in order to
eliminate any overlapping and occlusion region problem between the
object image (space shuttle) and the background image (globe).
[0087] In other words, the overlapping region that occurs when the
object image and background image are displayed at the same time is
pre-removed.
[0088] As will be described with reference to FIG. 3, a user views
the object image and the background image from one viewing angle,
and if the object image and the background image, the overlapping
region of which is not removed, are overlapped, the color of the
object appears distorted.
[0089] Therefore, by pre-removing the object image from the
background image (i.e., by overlapping the mask image of the object
image on the background image), the overlap-removed background
image is generated, preventing the object image from appearing
distorted. As described earlier, the overlap-removed background
image is inputted (or converted) as an element image through the
lens array 212 and is stored in the input panel 210.
[0090] FIG. 3 is the structure of a 3D image display system in
accordance with an embodiment of the present invention.
[0091] Referring to FIG. 3, the display system can include integral
image display units 211 and 212, a translucent mirror 250 and an
object image display unit 260.
[0092] As described above with reference to FIG. 2, the 3D image of
the present invention is recognized by a user through the use of
the object image 290 and an overlap-removed background image 200R,
which have different perspectives. The perspective refers to a
sense of depth recognized by the user within the user's viewing
angle. For example, there can be a sense of perspective if a figure
appears clearly but the background image of mountain is blurry. The
overlap-removed background image 200R is outputted from a display
panel, and, as described with reference to FIG. 2, is combined with
the mask image and inputted or stored in the input panel through
the lens array as an element image.
[0093] While the pick-up process is described with reference to
FIG. 2, FIG. 3 will skip the description of the pick-up process and
will describe only the "display" process, in which the picked-up
overlap-removed background image is outputted through the display
panel (e.g., an LCD panel).
[0094] The object image 290 and overlap-removed background image
200R, which have different perspectives, are not generated from one
display panel but generated from each respective display panel.
However, the two images 290 and 200R are recognized by the user's
eyes through the translucent panel 250.
[0095] The object image 290 is displayed on a first display panel
260, which can be a flat display panel, such as an LCD or a
PDP.
[0096] The first display panel 260 outputs light that forms the
object image 290, which can be, for example, a space shuttle. The
object image 290 can be the space shuttle only, without any
background.
[0097] Referring to FIG. 3, the user should be able to see the
space shuttle only, if the user looks at the first display panel
260 directly without seeing through the mirror.
[0098] In the 3D image display system in accordance with an
embodiment of the present invention, the object image 290 is not
disposed to be projected to the user directly, but the light
outputted from the first display panel 260 is reflected to the
translucent mirror 250 before being directed to the user.
[0099] The translucent mirror 250 reflects some of the light and
allows some of the light pass through the mirror. The translucent
mirror 250 can be also referred to as a half mirror or a two-way
mirror.
[0100] Referring to FIG. 3, in which the user is viewing the
translucent mirror from the right side, the translucent mirror 250
reflects the object image 290 and permeates the overlap-removed
background image 200R, allowing the object image 290 and the
overlap-removed background image 200R to be overlapped within the
user's viewing angle. Although FIG. 3 illustrates that the user is
looking at the translucent mirror 250 from the right side, it shall
be evident that it is possible for the user to view the translucent
mirror from the lower side. Hereinafter, however, the case of the
user viewing the translucent mirror 250 from the right side will be
described, for the convenience of description and
understanding.
[0101] The user can view the space shuttle, which is the object
image 290, through the translucent mirror 250. The space shuttle
290 that is viewed (i.e., recognized) by the user is placed at a
distance of "L" on the opposite side of the translucent mirror 250.
That is, the space shuttle, which is a virtual image, is recognized
by the user that it is located at the distance of L on the other
side of the translucent mirror 250. The translucent mirror 250 can
be tilted by a predetermined angle (e.g., 45 degrees) such that the
image outputted from the first display panel is reflected and
projected to within the viewing angle of the user.
[0102] For a flat mirror, the image viewed by the user is always in
straight up and is formed at the distance of L from an object
(i.e., the first display panel in FIG. 3) in the back of the
mirror.
[0103] Therefore, even though the object image, which is displayed
from the first display panel 260, is distanced by L from the
translucent mirror 250 at the right angle from the user's viewing
line, the user recognizes that the object image is distanced by L
from the translucent mirror 250 in the direction of the viewing
line. This is the same principle as that of a periscope.
[0104] As described above, however, the 3D image formed by the 3D
image display system of the present invention does not consist of
the object image 290 only. In case there is a background image 200R
having a different perspective from that of the object image, the
user will recognize the image as a 3D image.
[0105] Therefore, the integral image system unit displays the
overlap-removed background image 200R through a second display
panel 211, which can be a flat panel display device, such as an LCD
or a PDP, like the first display panel 260, and can be substituted
by a projection display device.
[0106] As a light source of the overlap-removed background image
200R, the second display panel 211 outputs the overlap-removed
background image 200R, and the light constituting the
overlap-removed background image 200R passes through the
two-dimensional lens array 212.
[0107] The light that passed through the lens array 212 passes
through lenslets, which constitute the lens array 212, and forms an
image at a distance of Z2 252 from the lens array 212. The
overlap-removed background image 200R is, for example, a 3D
integral image of the earth seen from the space.
[0108] Since it is required that the overlap-removed background
image 200R is formed with a different depth from that of the object
image 290, the overlap-removed background image 200R must be placed
at a distance separated by Z1-Z2 from the object image 290. That
is, the overlap-removed background image 200R is recognized by the
user that it is placed behind the object image 290.
[0109] Although the overlap-removed background image 200R is
distanced by Z2 from the lens array 212 in FIG. 3 for the
convenience of illustration, it is also possible that the
overlap-removed background image 200R is formed as a virtual image,
depending on the radius of curvature or the location of the second
display panel 211. In other words, it shall be evident to those of
ordinary skill in the art that the overlap-removed background image
200R can be formed as a virtual image based on different
predetermined optical conditions, such as the type of lens array
212.
[0110] The conventional method has an overlapping region, in which
the object image 290 and the background image 200 are overlapped,
distorting the color of the object image. Therefore, as described
with reference to FIG. 2, the second display panel 211 of the
present invention outputs the overlap-removed background image
200R, in which the area corresponding to the object image 290 is
removed from the background image 200.
[0111] To prevent any overlapping region from occurring when the
user views the overlap-removed background image 200R, the area that
is overlapped by the object image 290 is obtained by the input
panel 210. The second display panel 211 can be connected to the
input panel 210 or include the input panel 210 such that the
overlap-removed background image 200R picked up by the input panel
210 can be outputted.
[0112] As described above, in the 3D image display system of the
present invention, the user recognizes that the space shuttle is
placed at the distance of L behind the mirror and the earth is
placed at the distance of Z1-Z2 behind the space shuttle.
Therefore, the user can three-dimensionally recognize the earth
200R and the space shuttle 290 seen from the space.
[0113] FIG. 2 shows how a floating-image display method works. The
floating-image display method is used to display the object image
described with reference to FIGS. 1 to 3.
[0114] Referring to FIG. 4, a floating-image display device
includes a display panel 400, for displaying an image, and a convex
lens 402. Two or more convex lenses 402 can be combined in order to
reduce the focal length. It is also possible that the convex lens
402 is substituted by a concave mirror. The convex lens can be a
Fresnel lens.
[0115] An image being displayed on the display panel 400 can have
the same resolution as that of the display panel 400. A
high-resolution object image displayed on the display panel 400
gets displayed as an object image 404 in space through the convex
lens 402. Here, if the distance between the display panel 400 and
the convex lens 402 is defined as h 420, and the focal length of
the convex lens as f1, the distance H 422 to the location on which
the object image 404 is displayed from the convex lens 402 is
defined as the following formula (1).
H = hf 1 h - f 1 ( 1 ) ##EQU00002##
[0116] The object image 404 gets displayed at the distance H 422
calculated by the formula (1), which summarizes the floating-image
display technology, which forms an image in the space.
[0117] FIG. 5 illustrates a floating-image display system in
accordance with an embodiment of the present invention.
[0118] Referring to FIG. 5, the floating-image display system is
used to display an object image. The floating-image display system
unit can include a display panel 500 and a convex lens 502.
[0119] There can be two or more convex lenses, in order to reduce
the focal length. In another embodiment, a concave mirror can be
used instead of the convex lens 502 to float the object image.
[0120] The object image to render is displayed on the display panel
500. A typical 2D image, this object image can be displayed in the
same resolution as that of the display panel 500. Once the
high-resolution object image is displayed on the display panel 500,
the object image (i.e., space shuttle) 504 is displayed in space
through the convex lens 502.
[0121] In other words, the 2D space shuttle shown on the display
panel 500 is displayed as the actual object image 504 through the
convex lens 502 at a distance H 542 from the convex lens 502.
[0122] Here, the location H, on which the actual image is formed,
can be calculated using a lens formula. Defining that the distance
between the display panel 500 and the convex lens 502 is h 540 and
that the focal length of the convex lens is f1, the location H 542,
on which the object image 504 is formed, is defined as the lens
formula (I).
[0123] FIG. 6 is the structure of a 3D image display system in
accordance with another embodiment of the present invention.
[0124] The display system illustrated in FIG. 6 forms an object
image by use of a floating lens 602.
[0125] Referring to FIG. 6, the 3D image display system consists
mainly of two system units, one of which is a floating display
system unit and the other an integral image display system unit.
The floating display system unit corresponds to the object image
display system unit.
[0126] Here, the two system units can place the object image at a
close distance and the background image at a far distance such that
the object image and the overlap-removed background image are
overlapped within the same viewing angle through a translucent
mirror 630.
[0127] For this, the translucent mirror 630 allows one of the
object image 620, displayed from the floating-image display system
unit, and the overlap-removed background image 614R, displayed from
the integral image display system unit, to pass through and the
other to reflect. Although FIG. 6 illustrates that the user is
looking at the translucent mirror 630 from the right side, it shall
be evident that it is possible for the user to view the translucent
mirror from the lower side. Hereinafter, however, the case of the
user viewing the translucent mirror 630 from the right side will be
described, for the convenience of description and understanding. In
FIG. 6, however, the object image 620 is reflected and the
overlap-removed background image 614R permeates to be projected to
within the viewing angle of the user, who is located on the right
side.
[0128] The floating-image display system unit can include a first
display panel 600 and a convex lens 602. The first display panel
600 displays an object image in 3D. The 3D image that appears on
the first display panel 600 is displayed as an actual object image
620 near the translucent mirror 630 through the convex lens 602.
This will not be described here since this has been already
described with reference to FIGS. 4 and 5.
[0129] The integral image display system unit can include a second
display panel 610 and a lens array 612. The second display panel
610 displays a background image (the globe) as the overlap-removed
background image (i.e., the globe, from which the space shuttle is
removed). The background element image outputted from the second
display panel 610 is displayed as the overlap-removed background
image 614R near the translucent mirror 630 through the lens array
612. Although the overlap-removed background image 614R is
distanced by Z2 from the lens array 612 in FIG. 6 for the
convenience of illustration, it is also possible that the
overlap-removed background image 614R is formed as a virtual image,
depending on the radius of curvature or the location of the second
display panel 610. This has been already described with reference
to FIGS. 2 and 3.
[0130] The 3D image 620 being displayed in accordance with an
embodiment of the present invention has a very different property
from the conventional floating-image display system. That is, the
3D image 620 being displayed in accordance with an embodiment of
the present invention includes two major images, one of which is
the object image 620 displayed by the floating-image display method
and the other the integral image background 614R displayed by the
integral image display method.
[0131] The object image 620 is the image to which viewers pay
attention, and requires high resolution. For this reason, the
object image 620 can be displayed using the floating-image display
method. On the other hand, the integral image background 614R is
for providing three-dimensionality and thus can be displayed using
the integral image display method.
[0132] By using the integral image background 614R displayed
through the integral image display technology, the present
invention can provide an image that can be viewed from multiple
points of view and can render a deep sense of three-dimensionality
by using the overlap-removed background image 614R combined with a
mask of the object image.
[0133] In addition, the present invention provides high resolution
in the object image 620 by displaying the object image 620 through
the floating-image display technology to overcome the problem of
low resolution, which has been a problem for the integral image
display method.
[0134] This system can also specify the location where the 3D image
620 is displayed. The floating-image display system unit can use
the formula (I) to place the object image at a distance Z1 650 and
can use the translucent mirror 630, which reflects the displayed
object image. The integral image display system unit places the
integral image background at a distance Z2 652.
[0135] Hitherto, the general structure of a 3D image display system
with a background image using an integral image display method in
accordance with an embodiment of the present invention has been
described. Hereinafter, the conditions and data from an experiment,
to which the 3D image display system with a background image using
the integral image display method in accordance with an embodiment
of the present invention, will be described.
[0136] FIG. 7 shows an experimental structure of a floating-image
display method having an integral image background in accordance
with an embodiment of the present invention.
[0137] The floating-image display system unit is shown on the upper
side, and the integral image display system unit is shown on the
lower side. The translucent mirror 630 is placed between these two
system units such that the images displayed by these two system
units are combined for the viewer to see.
[0138] In the floating-image display system unit, the object image
is displayed on the first display panel 600, which can be a
projector and a diffusion screen. The projector and diffusion
screen are used for a basic experiment and can be obviously
substituted by another display device, such as an LCD (liquid
crystal display) and a PDP (plasma display panel), depending on the
use and properties, as described above.
[0139] Used for the convex lens 602 is a Fresnel lens, which can
realize a reduced focal length easily. The convex lens 602 is
placed 680 mm away from the diffusion screen. In other words, the
distance h 640, between the first display panel 600 and the convex
lens 602, is 680 mm. According to the formula (I), the object image
(i.e., the space shuttle) 322 is formed 254 mm away from the convex
lens 602. That is, the location H 642, on which the object image
622 is formed, is 254 mm from the convex lens 602.
[0140] The integral image display system unit displays the element
image on the second display panel 610, which can be a projector and
a diffusion screen. The lens array 612 is placed in front of the
second display panel 610.
[0141] The lens array 612 used in the experiment consists of
53.times.53 of lenslets, the focal length of which is 3 mm.
[0142] By making the distance between the second display panel 610
and the lens array 612 identical to the focal length of the
lenslet, the background image 614R of the earth, being displayed as
the overlap-removed background image, is displayed 6 mm away, which
is indicated as Z2 652.
[0143] FIG. 8 shows an object image and a background image used in
the experiment of a 3D image display method having an integral
image background in accordance with an embodiment of the present
invention.
[0144] To perform an experiment for proving the usefulness of the
present invention, an object image and an overlap-removed
background image are created. Referring to FIG. 8, the experiment
used a space shuttle as the object image 620 and the earth as the
background image 613. The object image is displayed on the first
display panel 600, without any modification. The background image
613 must be modified to the overlap-removed background image 614R
before being displayed on the second display panel 610. The process
for creating the overlap-removed background image has been
described above with reference to FIG. 2.
[0145] FIG. 9 shows the creation of an overlap-removed background
image used in the integral image display system unit in accordance
with an embodiment of the present invention. The method of creating
the overlap-removed background image that is projected from the
second display panel 610 has been described above. Moreover, as
described above, it shall be evident that the overlap-removed
background image is recognized through the lens array 612 or 212 by
the user as a three-dimensional image.
[0146] Illustrated in FIG. 9 is an example of creating the
overlap-removed background image to be used in the integral image
display system unit.
[0147] Firstly, the three images have been inputted and stored in
input means 210 through the lens array 612 or 212. That is, the
three images are three-dimensional "element images" as multi-view
integral images through the lens array.
[0148] As described with reference to FIGS. 1 and 2, in the
background element image of these element images, an object is
passed through a lens array and reproduced by use of a computer
pick-up method. Therefore, the background element image in
accordance with an embodiment of the present invention consists of
52.times.52 elements.
[0149] In this example, a background element image 800 and an
element image 802 of the mask image (silhouette), from which the
object of the object image is treated in black, can be combined to
produce an overlap-removed background image 900R. As illustrated in
FIG. 9, the overlap-removed background image 900R is picked up and
reproduced through the lens array 612 or 212, and thus is an
"element image."
[0150] As described with reference to FIGS. 1 and 2, this is for
eliminating any overlapping region by removing the element image
802 of the object image from the background element image 800.
[0151] Therefore, the overlap-removed background images 200R and
614R, described with reference to FIGS. 3 and 6, are "element
images" of the integral image system unit, and are identical to the
image represented by 900R in FIG. 9.
[0152] FIG. 10 shows the 3D image generated by the 3D image display
method in accordance with an embodiment of the present
invention.
[0153] Using the object image 620 projected from the first display
panel 600 and the overlap-removed background image projected from
the second display panel 610, in accordance with the experiment
conditions of FIG. 7, an experiment for the floating-image display
method with an integral image background in accordance with an
embodiment of the present invention has been performed.
[0154] Images from the actual 3D image display experiment can be
found in FIG. 10. The left image 620 is the case of displaying the
object image only, and the middle image 614R is the case of
displaying the overlap-removed background image only. The right
image 904 is the case of displaying the object image with the
overlap-removed background image.
[0155] In more detail, images in FIG. 10 are resulted from the
structure shown in FIGS. 6 and 7, in which two kinds of images are
created. The image 620 displaying the object image only is created
by the floating-image display system unit. In this experiment, an
XGA projector is used, and the space shuttle image has a resolution
of about 600.times.400 pixels. The image displaying the
overlap-removed background image only is created by the integral
image display system unit. The integral image background 624 has a
resolution of about 50.times.50 pixels, which is identical to that
of the lens array 612.
[0156] The image 904 that displays the object image and
overlap-removed background image together is an image in which the
image displayed by the floating-image display system unit and the
image displayed by the integral image display system unit are
combined through the translucent mirror 630. As seen in FIG. 10, a
three-dimensional image can be created by combining the images from
two different systems. It can be also seen that the image 620
(i.e., the object image) displayed by the floating-image display
method has a much higher resolution than the image 614R (i.e., the
overlap-removed background image) displayed by the integral image
display system.
[0157] FIG. 11 shows 3D images, viewed from different angles, of a
floating-image display having an integral image background in
accordance with an embodiment of the present invention. Here, the
displayed result is viewed from various angles. Shown in FIG. 11
are a three-dimensional image 1000 viewed from the top, a
three-dimensional image 1002 viewed from the left, a
three-dimensional image 1004 viewed from the right, a
three-dimensional image 1006 viewed from the center and a
three-dimensional image 1008 viewed from the bottom.
[0158] Specifically, comparing the three-dimensional image 1000
viewed from the top and the three-dimensional image 1008 viewed
from the bottom with the three-dimensional image 1006 viewed from
the center, it can be seen that there is more room around the nose
section of the spaceship of the three-dimensional image 1000 viewed
from the top.
[0159] Likewise, comparing the three-dimensional image 1002 viewed
from the left and the three-dimensional image 1004 viewed from the
right with the three-dimensional image 1006 viewed from the center,
it can be seen that there is more room on the left side of the
spaceship of the three-dimensional image 1002 viewed from the
left.
[0160] It can be seen in FIG. 11 that the background image of the
3D image 620 viewed from different angles has
three-dimensionality.
[0161] Hitherto, an experiment for a background image using the
integral image method has been described. Hereinafter, the
background image displayed by other 3D image displaying methods
than the "element image" by the lens array will be described.
[0162] FIGS. 12 to 14 show how the background image is displayed by
use of the stereoscopy method.
[0163] A virtual 3D display method, the stereoscopy method uses the
binocular disparity of human eye to create virtual
three-dimensionality on a two-dimensional display space.
[0164] On average, human eyes have a 65 mm separation between the
right eye and the left eye. This causes the image viewed by the
left eye and the image viewed by the right image to have slightly
different image information. Once these two images are delivered to
the opposite side of the brain through the optic nerves, these
images are combined in the visual cortex (the cerebral cortex
region where visual information is processed) to give the viewer a
sense of three-dimensionality.
[0165] In other words, due to the parallax of human eyes, the
spatial information of an object perceived by the left eye and the
right eye differs slightly. When these two slightly different
images are delivered to the brain through the retina, the human
brain combines these two images and cognizes the
three-dimensionality. The stereoscopy method uses precisely this
principle, as a 2D display device displays a left image and a right
image, with parallax, and delivers each of these images to the
corresponding eye to create virtual three-dimensionality.
[0166] The stereoscopy method can be classified into the
eye-glasses type and no-glasses type, depending on whether the
eye-glasses are to be worn or not, and into the stereoscopic
display method and the multiview method, depending on how much
variety of angles can be rendered.
[0167] The eye-glasses type includes a color difference method, a
polarization method, a time-division method and a head mount
display (HMD) method.
[0168] In the color difference method, the left and right images
are separated to red and green, which are complementary colors, and
selected by color filters. Thus, the separated images are viewed
through the eye-glasses, which have a red lens on one side and a
green lens on the other side.
[0169] In the color difference method, the left and right images
are separated to red and green, which are complementary colors, and
selected by color filters. Thus, the separated images are viewed
through the eye-glasses, which have a red lens on one side and a
green lens on the other side.
[0170] In the time-division method, the left and right images are
repeatedly shown to the left and right eyes, respectively,
periodically. By wearing eye-glasses equipped with an electronic
shutter that is synchronized with the period of the repetition,
three-dimensionality can be provided to the viewer.
[0171] In the HMD method, a display device is placed on the head of
the viewer and the images are displayed right in front of the eyes
to provide three-dimensionality.
[0172] Each of the above methods can be applied to a floating-image
display system having a background image. However, use of the
polarization method may be restricted because the polarizing
direction can affect the floating-image display, and head-mounting
of the device in the HMD method also restricts the application of
the HMD method because the device can block the view. Therefore,
the time-division method may be preferable for a floating-image
display system. However, it shall be evident that this does not
restrict the application to any particular method and that any of
the above methods may be applied to display the background
image.
[0173] The major no-glasses type includes the parallax barrier
method and lenticular method. The no-glasses type does not use
glasses but uses the structure of the display device and the
refraction of lens to separate an image for the left eye and right
eye.
[0174] Hereinafter, some of the embodiments for displaying a
background image using each of the methods.
[0175] FIG. 12 shows how the background image is displayed using
the time-division method in accordance with another embodiment of
the present invention.
[0176] In the time-division method, the images on the left channel
and the right channel alternate fast. Shutter glasses, for example,
are used to block and unblock the alternately displayed images to
deliver one side of the images to the same side of the eyes.
[0177] Referring to FIG. 12, the second display panel 310 displays
images with different viewing angles at a fast rate. In this
particular experiment, a left image 1100 is green and a right image
1102 is blue. The shutter glasses worn by the viewer operate
electronically to block the left eye and right eye alternately, in
order to provide the image of the same side of the eyes. As this
operation is conducted at a rate of 60 times per second, the viewer
feels as if the two images are outputted from one screen, and these
two images are combined in the viewer's brain to give a sense of
three-dimensionality.
[0178] In other words, the blue image will be formed on a right eye
1104 of the viewer, and the green image will be formed on a left
eye 1106.
[0179] Since the time-division method can provide more freedom of
viewing angle and the left and right channels are simply outputted
alternately on the same screen, there is no loss of image from any
viewing angle, including the top, bottom, left and right side.
Therefore, the viewer can be much freer to choose the viewing
position to watch the virtual 3D image.
[0180] FIG. 13 shows how the background image is displayed using
the parallax barrier method in accordance with another embodiment
of the present invention.
[0181] The parallax barrier method does not use an optical
technology but rather uses a structure that is similar to a screen
to separate an image.
[0182] In the parallax barrier method, images for the left eye and
right eye are alternately arranged at a specific interval in the
back of the openings of narrow slits, called parallax barrier 1200.
If the images are viewed through these openings from a particular
point, the left image and right image can be precisely separated
and viewed. That is, without using an optical technology, such as
the polarization method, the parallax barrier method simple
separates an image by blocking the left and right channels.
[0183] Referring to FIG. 13, the left image 1100 and the right
image 1102 are alternately arranged on the second display panel
310. In this particular experiment, the left image 1100 is made
green, and the right image 1102 is made blue. The parallax barrier
1200, which is an array of narrow slit, is placed in front of the
second display panel 310, and the two images are separately
delivered to the left eye and the right eye, respectively, of the
viewer, who is positioned at a specific distance. In other words,
the blue image is formed in the right eye 1104 of the viewer, and
the green image is formed in the left eye 1106 of the viewer.
[0184] FIG. 14 shows how the background image is displayed using
the lenticular method in accordance with another embodiment of the
present invention.
[0185] In the lenticular method, the left image and right image,
which are refracted through a lenticular lens array 1300 on a
vertically arranged screen, are sent to the viewer's respective
eyes. Referring to FIG. 13, the second display panel 310 is
arranged with the left image 1100 and the right image 1102, which
are to enter the respective eyes, on a single lenticular lens. In
this experiment, the left image 1100 is made green, and the right
image 1102 is made blue. By placing the lenticular lens array 1300
in front of the second display panel 310, the left image 1100 and
the right image 1102 are separated and inputted to the left eye
1106 and right eye 1104, respectively. That is, the green image is
formed in the right eye 1104, and the green image is formed in the
left eye 1106.
[0186] The human brain then feels the same sense of
three-dimensionality as the conventional 3D display method.
[0187] The lenticular method has less loss of brightness than the
parallax barrier method, and does not have an unpleasant obstacle,
such as a barrier, on the 2D screen.
[0188] FIG. 15 shows how the background image is displayed using
the multi-view method in accordance with another embodiment of the
present invention.
[0189] The multi-view method is what the stereoscopic display
method is expanded. In the conventional stereoscopic method, two
images inputted to both eyes are recognized as an image of a single
point-of-view to provide the sense of three-dimensionality. The
multi-view method, however, increases the number of point-of-views
to create two or more point-of-views within the same viewing
angle.
[0190] Referring to FIG. 15, arranged on the second display panel
310 are 5 units (far left image, left image, center image, right
image and far right image) of pairs of images of left and right.
This seems similar to the conventional barrier method and the
lenticular method, but 5 colors, not 2 colors, are arranged for the
successive images.
[0191] Although an arrangement of 5 point-of-views are described
herein for the convenience of description, it shall be evident that
it is not limited to 5 point-of-views but any plurality of
point-of-views can be applied to the multi-view method. The image
created as such passes through a barrier 1400, placed in front of
the second display panel 610, and by viewing the image by changing
the point-of-views, the 5 images of different point-of-views are
seen in the order of viewing, realizing the multi-view display.
[0192] To increase the number of point-of-views, it is also
possible to structure the barrier 1400 in front of the second
display panel 610 at angle of 45 degrees or any other appropriate
angle.
[0193] FIG. 16 shows how the background image is displayed using a
holography method in accordance with another embodiment of the
present invention.
[0194] In the holography method, the laser beam is split into two
beams, and one of the beams is directly projected to the screen,
and the other beam is projected to an object to be seen by the
viewer. The beam directly projected to the screen is referred to as
a reference beam, and the beam projected to the object is referred
to as an object beam.
[0195] Since the object beam is reflected on the surface of the
object, its phase difference (the distance between the surface and
screen) varies depending on the surface of the object. The
unmodified reference beam then interferes with the object beam, and
an interference pattern is stored in the screen. A hologram is a
film in which this interference pattern is stored.
[0196] To reproduce the stored image, the beam used during the
recording must be projected again on the screen. The beam being
used during the reproduction must have the same number of
oscillation as the beam used during the recording, in order to
reproduce a three-dimensional image. Waves having a different
wavelength or phase have no effect and pass through the stored
hologram. Therefore, it is important that the beam is precisely
identical to the reference beam used during the recording.
[0197] The hologram is different from the conventional photo in
that the same beam is to be used during the storing and
reproduction and that a three-dimensional image is reproduced.
[0198] The hologram displays a three-dimensional image because it
also stores the direction of the beam while two-dimensional photos
store the intensity of the object beam only.
[0199] In this particular experiment, the actual hologram pattern
is not stored on the screen, but a computer generated hologram
(CGH) is used to create the pattern, and a parallel beam is used to
diffract the hologram pattern by a spatial light modulator and to
display a three-dimensional image in the actual space.
[0200] FIG. 16 shows the structure of a hologram display device for
displaying a background image. Referring FIG. 16, a beam generated
by a laser 1500 passes through an optical collimator 1502 and an
optical expander 1504 and becomes a parallel beam. This beam is
then entered to a spatial light modulator (SLM) 1508 through a
polarized beam splitter (PBS) 1506. The SLM used here can be a
reflective SLM or a transmissive SLM. The SLM 1508 is inputted with
the generated hologram pattern, and the beam diffracted out from
the SLM 1508 is visible as a three-dimensional hologram image
through a field lens.
[0201] Hitherto, methods for displaying the background image of the
floating display system having a background image have been
described by referring to FIGS. 12 to 16. It shall be evident to
anyone skilled in the art that any method that can reproduce a
three-dimensional image, besides the display methods described
above, can be used to display the background image. Hereinafter,
the floating-image display system using the conventional Fresnel
lens will be described.
[0202] FIG. 17 shows a floating-image display method in accordance
with another embodiment of the present invention.
[0203] In the floating-image display system described above, the
two-dimensional image outputted from the first display panel 600 is
formed on the screen, and this image is passed through a convex
lens and is displayed, through the lens formula, at the same
location as the mask image of the object image, which is near the
translucent mirror.
[0204] Referring to FIG. 17, the system is equipped with a concave
mirror, instead of the convex lens, in the floating-image display
system unit.
[0205] As described already, the floating-image display system unit
can include either a convex lens or a concave mirror 1600, which
has similar optical properties as the convex lens. The concave
mirror 1600 is used here in order to effectively overcome some of
the problems caused by using the convex lens.
[0206] Since the concave mirror 1600 has the same optical effect,
through its curvature, as the convex lens but reflects the image
formed on the first display panel 600 while the convex lens
transmits the image, the problems of reduced brightness, distortion
and aberration, which are caused by using the convex lens, can be
improved.
[0207] Referring to FIG. 17 more specifically, the two-dimensional
object image is outputted from the first display panel 600 and
reflected by a newly-added translucent mirror 1602 before entering
the concave mirror 1600. The entered image is affected by the
optical property of the concave mirror 1600 caused by the curvature
(i.e. the optical property of passing through the convex lens), and
the image reflected by the concave mirror is outputted to the
opposite direction of incident. Finally, the object image 620 is
displayed in the real field of a focal length, which is defined by
the distance of the concave mirror 1600, through the translucent
mirror 1602, like the distance of the image formed by the lens
formula through the convex lens.
[0208] All embodiments described above realize the image in the
real field, which is a plane that is passed through an optical
device. However, the integral display method, floating-image
display method and all 3D display methods described above can
realize the image in a virtual field, which is the opposite field
of the real field, by differing the optical structure or software
method of image pick-up. Moreover, by using the virtual field, it
is possible that the depth of a wider field is rendered or a new
application is found depending on the use, such as modifying the
viewing angle.
[0209] Although certain embodiments have been described, it shall
be evident to anyone who is skilled in the art to which the present
invention pertains that there can be a variety of permutations and
modifications within the technical ideas and scope of the
invention, which shall only be defined by the appended claims.
* * * * *