U.S. patent application number 17/313848 was filed with the patent office on 2021-10-14 for image display device, image display method, and moving object.
This patent application is currently assigned to Sony Group Corporation. The applicant listed for this patent is Sony Group Corporation. Invention is credited to Eiji Oba.
Application Number | 20210316661 17/313848 |
Document ID | / |
Family ID | 1000005681545 |
Filed Date | 2021-10-14 |
United States Patent
Application |
20210316661 |
Kind Code |
A1 |
Oba; Eiji |
October 14, 2021 |
IMAGE DISPLAY DEVICE, IMAGE DISPLAY METHOD, AND MOVING OBJECT
Abstract
Provided is an image display device including: a display unit
configured to display an image on a side window of a vehicle; and a
control unit configured to control an opening and closing motion of
the side window, according to a display state of the display
unit.
Inventors: |
Oba; Eiji; (Tokyo,
JP) |
|
Applicant: |
Name |
City |
State |
Country |
Type |
Sony Group Corporation |
Tokyo |
|
JP |
|
|
Assignee: |
Sony Group Corporation
Tokyo
JP
|
Family ID: |
1000005681545 |
Appl. No.: |
17/313848 |
Filed: |
May 6, 2021 |
Related U.S. Patent Documents
|
|
|
|
|
|
Application
Number |
Filing Date |
Patent Number |
|
|
16092863 |
Oct 11, 2018 |
11034296 |
|
|
PCT/JP2017/008249 |
Mar 2, 2017 |
|
|
|
17313848 |
|
|
|
|
Current U.S.
Class: |
1/1 |
Current CPC
Class: |
H04N 21/47 20130101;
G02B 2027/0138 20130101; B60R 2300/105 20130101; H04N 21/4316
20130101; G02B 27/0101 20130101; H04N 5/247 20130101; G02B 27/0093
20130101; E05Y 2900/55 20130101; G02B 2027/014 20130101; E05F 15/70
20150115; B60R 2300/8046 20130101; B60R 2300/202 20130101; B60R
2300/802 20130101; G02B 2027/0118 20130101; B60R 1/00 20130101;
B60R 2300/205 20130101; B60J 1/12 20130101; B60R 2300/303
20130101 |
International
Class: |
B60R 1/00 20060101
B60R001/00; H04N 21/47 20060101 H04N021/47; H04N 21/431 20060101
H04N021/431; E05F 15/70 20060101 E05F015/70; G02B 27/00 20060101
G02B027/00; G02B 27/01 20060101 G02B027/01; H04N 5/247 20060101
H04N005/247 |
Foreign Application Data
Date |
Code |
Application Number |
Apr 18, 2016 |
JP |
2016-082621 |
Claims
1. A display control apparatus, comprising: circuitry configured
to: receive an image captured by at least one camera mounted on a
vehicle; and display a combined image including a first region, a
second region, and a boundary line between the first region and the
second region, wherein the combined image is generated based on the
image, wherein each of the first region and the second region
includes at least one of a front sideward sight of the vehicle, a
rear sideward sight of the vehicle, or a side sight of the vehicle,
and wherein the boundary line has a view angle of 0.028 degrees or
more.
2. The display control apparatus according to claim 1, wherein the
combined image further includes a third region.
3. The display control apparatus according to claim 1, wherein the
first region includes the front sideward sight, the second region
includes the rear sideward sight, and the third region includes the
side sight.
4. The display control apparatus according to claim 1, wherein the
first region is located above the second region.
5. The display control apparatus according to claim 1, wherein the
third region is located on a side of the first and second
regions.
6. The display control apparatus according to claim 1, wherein the
circuitry is further configured to control at least one of:
brightness of the combined image, contrast of the combined image,
or a display configuration of a plurality of images captured by a
plurality of cameras mounted on the vehicle, on the basis of a
detection result of a sensor.
7. The display control apparatus according to claim 6, wherein the
circuitry is further configured to set the brightness or the
contrast of the combined image higher than a usual set value, in
response to the sensor detecting a head motion or a sight line
movement of a driver of the vehicle.
8. The display control apparatus according to claim 7, wherein the
circuitry is further configured such that, when the sensor does not
detect a head motion or a sight line movement of a driver of the
vehicle for a certain period, the circuitry sets the brightness or
the contrast of the combined image lower than a usual set
value.
9. An image display method comprising: receiving an image captured
by at least one camera mounted on a vehicle; and displaying a
combined image including a first region, a second region, and a
boundary line between the first region and the second region,
wherein the combined image is generated based on the image, wherein
each of the first region and the second region includes at least
one of a front sideward sight of the vehicle, a rear sideward sight
of the vehicle, or a side sight of the vehicle, and wherein the
boundary line has a view angle of 0.028 degrees or more.
10. The image display method according to claim 9, wherein the
combined image further includes a third region.
11. The image display method according to claim 9, wherein the
first region includes the front sideward sight, the second region
includes the rear sideward sight, and the third region includes the
side sight.
12. The image display method according to claim 9, wherein the
first region is located above the second region.
13. The image display method according to claim 9, wherein the
third region is located on a side of the first and second
regions.
14. The image display method according to claim 9, further
comprising: controlling at least one of: brightness of the combined
image, contrast of the combined image, or a display configuration
of a plurality of images captured by a plurality of cameras mounted
on the vehicle, on the basis of a detection result of a sensor.
15. The image display method according to claim 14, wherein the
circuitry is further configured to set the brightness or the
contrast of the combined image higher than a usual set value, in
response to the sensor detecting a head motion or a sight line
movement of a driver of the vehicle.
16. The image display method according to claim 15, wherein the
circuitry is further configured such that, when the sensor does not
detect a head motion or a sight line movement of a driver of the
vehicle for a certain period, the circuitry sets the brightness or
the contrast of the combined image lower than a usual set
value.
17. A computer-readable medium encoded with instructions that, when
executed by a controller, cause the controller to perform a method
comprising: receiving an image captured by at least one camera
mounted on a vehicle; and displaying a combined image including a
first region, a second region, and a boundary line between the
first region and the second region, wherein the combined image is
generated based on the image, wherein each of the first region and
the second region includes at least one of a front sideward sight
of the vehicle, a rear sideward sight of the vehicle, or a side
sight of the vehicle, and wherein the boundary line has a view
angle of 0.028 degrees or more.
Description
CROSS REFERENCE TO RELATED APPLICATIONS
[0001] The present application claims the benefit under 35 U.S.C.
.sctn. 120 as a continuation application of U.S. application Ser.
No. 16/092,863, filed on Oct. 11, 2018, which claims the benefit
under 35 U.S.C. .sctn. 371 as a U.S. National Stage Entry of
International Application No. PCT/JP2017/008249, filed in the
Japanese Patent Office as a Receiving Office on Mar. 2, 2017, which
claims priority to Japanese Patent Application Number
JP2016-082621, filed in the Japanese Patent Office on Apr. 18,
2016, each of which applications is hereby incorporated by
reference in its entirety.
TECHNICAL FIELD
[0002] The technology disclosed in the present specification
relates to an image display device, an image display method, and a
moving object for displaying a captured image of a camera, and for
example relates to an image display device, an image display
method, and a moving object for displaying an image behind or
diagonally behind a vehicle or the like that is captured by an
onboard camera in a vehicle interior.
BACKGROUND ART
[0003] In recent years, instead of door mirrors and a rear view
mirror of a car, a camera monitoring system (CMS) that displays an
rearward or diagonally rearward image captured by an onboard camera
on a flat panel display (FPD) device such as a liquid crystal
display (LCD) in order to visually confirm an approaching object
and an obstacle behind or diagonally behind a vehicle is being put
into production.
[0004] A mirror is removed and replaced by the CMS, making door
mirrors of the past unnecessary, and thereby not only car design
becomes sophisticated, but traveling of the vehicle becomes smooth
due to reduction of air resistance, and in addition there is
contribution to improvement of fuel efficiency. Also, in a vehicle
type that is unable to confirm its rearward by a rear view mirror
because of a rearward loading platform, like a large-sized vehicle,
can perform the same rearward confirmation as a rear view mirror of
a standard-sized car.
[0005] In the past (or when not utilizing the CMS), a sight is
ensured for a driver to view left and right in a frontward through
door mirrors, when the driver confirms a rearward via the door
mirrors. For example, a dangerous situation can be sensed to a
certain extent through a gap of a door mirror and a front pillar (A
pillar), by moving left and right eyes and a head. In contrast,
when rearward confirmation is performed by the CMS configured with
a camera and a monitor instead of the mirrors, a screen image of
the monitor located in the vehicle interior is made apart from a
direction of a sight that the driver is to confirm by viewing (in
particular, left and right sights in the frontward that are viewed
through the door mirrors), and thereby a motion sequence of
uniaxial rotation in which the driver momentarily views frontward
in a cycle of turning motion of a neck is lost. In particular, when
the monitor gets away from the left and right in the frontward,
turning of a sight line becomes less frequent, and thus it is
anticipated that frontward overlooking becomes more frequent, which
would be within the sight around the mirrors in the past. That is,
vehicle rearward and frontward left and right information becomes
discrete, and thereby the driver's sight line movement amount for
recognizing the vehicle surrounding area is increased so as to
influence quick situation determination.
[0006] For example, there is proposed an electronic side mirror
device that projects a video captured by an image capturing unit
that captures an image of a side direction from a vehicle, on a
holographic optical element arranged in a front window or a side
window of a vehicle (for example, refer to Patent Literature 1).
However, according to this electronic side mirror device, still
image information can be displayed by forming an image on a
holographic film of a window glass, but with a holographic panel
for the purpose of obtaining light diffraction characteristics, it
is difficult to achieve full-color moving image display performance
which is necessary in urgent vehicle recognition of the CMS. Also,
even if a full-color moving image is displayed on the holographic
panel, a smooth rearward view field is difficult to reproduce due
to a speckle problem of reference light, and safety driving is
thought to unachievable due to much convergence.
[0007] Note that a location of a mirror for confirming a rearward
approaching object from the vehicle left or right is limited to
door side, fender left and right, and the like, because of
characteristics of specular reflection. In particular, in a trend
of recent years, the location of the mirror is over left and right
side windows mainly, and in view of ensuring the frontward left and
right view fields at the time of turning right or left, a structure
is designed to ensure a slight interspace in the gap between the
door mirror and the front pillar, in order to ensure a sight for
allowing the driver to view the left and right in the frontward
through the door mirror.
[0008] Also, in view of preventing an accident hitting the
approaching object from the rearward at the time of motion of
turning right or left, the driver is to indirectly confirm the
approaching object from the rearward by the mirror, and turn to
confirm the blind angle of diagonally rearward, and simultaneously
confirm an obstacle in the forward travel turn direction, and the
above structure design has an advantage that the sight line is
concentrated in the area of straight sight line movement that
passes through a mirror vicinity.
[0009] In contrast, in the CMS, when the monitor is located at a
position significantly separated from the door mirror of the past,
the sight line movement amount becomes larger between when
confirming the approaching object from the rearward and when
confirming the obstacle in the forward travel turn direction, for
example at the vehicle interior near a door hinge, so as to
increase a risk of generating temporal delay in sensing a dangerous
situation.
CITATION LIST
Patent Literature
[0010] [PTL 1]
[0011] JP 2011-213186
[0012] [PTL 2]
[0013] WO 2013/191085
SUMMARY
Technical Problem
[0014] A purpose of the technology disclosed in the present
specification is to provide an image display device, an image
display method, and a moving object capable of preferably
displaying an image behind or diagonally behind a vehicle or the
like that is captured by an onboard camera, in a vehicle
interior.
Solution to Problem
[0015] According to a first aspect of the technology disclosed in
the present specification, there is provided an image display
device including: a display unit configured to display an image on
a side window of a vehicle; and a control unit configured to
control an opening and closing motion of the side window, according
to a display state of the display unit.
[0016] According to a second aspect of the technology disclosed in
the present specification, the control unit of the image display
device according to the first aspect prohibits an opening operation
of the side window, or closes the open side window while the
display unit is displaying the image.
[0017] According to a third aspect of the technology disclosed in
the present specification, the display unit of the image display
device according to the first aspect displays the image in a
partial region away from a pillar of the vehicle.
[0018] According to a fourth aspect of the technology disclosed in
the present specification, the display unit of the image display
device according to the first aspect includes a semi-transmissive
reflection plate arranged in a partial region of the side window,
and a projection unit that projects the image on the reflection
plate. The semi-transmissive reflection plate mentioned here may be
a reflection film of a constant static reflectance such as a
semi-transmissive reflection film, and may be a reflection film
that performs an electrochromic reflectance control capable of
controlling a reflectance electrically.
[0019] According to a fifth aspect of the technology disclosed in
the present specification, the projection unit of the image display
device according to the fourth aspect is located at a door of the
vehicle, and projects an image toward the reflection plate arranged
in the side window.
[0020] According to a sixth aspect of the technology disclosed in
the present specification, the reflection plate of the image
display device according to the fifth aspect is configured to
anisotropically retroreflect the projected light from the
projection unit. The anisotropic retroreflection mentioned here is
different from a film of a usual beads type and a light angle cube
type that reflects a light to the same direction relative to an
incident light, and means a reflection plate of a combiner function
for a head up display (HUD) which is of a Fresnel lens or micro
prism type that controls a reflection direction relative to an
incident light direction.
[0021] According to a seventh aspect of the technology disclosed in
the present specification, the reflection plate of the image
display device according to the fourth aspect is made of one of
retroreflection beads or film and a translucent film to which
corner cube is transferred and which reflects light to the incident
light direction with intense light distribution.
[0022] According to an eighth aspect of the technology disclosed in
the present specification, the display unit of the image display
device according to the first aspect includes a self light emitting
element arranged in a partial region of the side window.
[0023] According to a ninth aspect of the technology disclosed in
the present specification, the display unit of the image display
device according to the first aspect includes a monitor capable of
anisotropic display and a semi-transmissive reflection plate
arranged in a partial region of the side window.
[0024] According to a tenth aspect of the technology disclosed in
the present specification, the display unit of the image display
device according to the first aspect is configured to display the
image with a boundary line. It is preferable that the boundary line
has a significant line width that allows the driver to obviously
and instantaneously determine a boundary corresponding to a bezel
between the background and the monitor that enter in a view field
in the same direction, when the driver looks into the display image
of the display unit. For example, it is preferable that the image
is rimmed with a boundary line of at least 1/V=1.7 minutes, i.e.,
view angle of 0.028.degree. or more, which is converted from the
lowest eyesight V=0.6 of a usual driver who can acquire a
license.
[0025] According to an 11th aspect of the technology disclosed in
the present specification, the display unit of the image display
device according to the first aspect is configured to divide the
display region into a plurality of regions and display a plurality
of images simultaneously. It is preferable that the images are
separated by boundary lines that have a significant line width in
the same way as the above, when the plurality of images are
displayed simultaneously.
[0026] According to a 12th aspect of the technology disclosed in
the present specification, the display unit of the image display
device according to the 11th aspect displays an image of a front
sideward sight of the vehicle and an image of a rear sideward sight
side-by-side.
[0027] According to a 13th aspect of the technology disclosed in
the present specification, the display unit of the image display
device according to the 12th aspect further displays an image of a
side sight of the vehicle.
[0028] According to a 14th aspect of the technology disclosed in
the present specification, the image display device according to
the first aspect further includes: sensor unit; and display control
unit configured to control at least one of brightness and contrast
of the image displayed by the display unit and a reflectance of a
semi-transmissive reflection plate, on the basis of a detection
result of the sensor unit. For example, the sensor unit detects
external light from around the vehicle. Then, the display control
unit optimally controls the brightness or the contrast of the image
in such a manner that the brightness with which the driver views
the outside in the direct sight through the side window is not
different from the brightness of the image that the display unit
displays on the side window.
[0029] According to a 15th aspect of the technology disclosed in
the present specification, the display control unit of the image
display device according to the 14th aspect controls at least one
of the brightness and the contrast of the image and the reflectance
of the semi-transmissive reflection plate, in response to the
sensor unit detecting a head motion or a sight line movement of a
driver of the vehicle.
[0030] According to the 16th aspect of the technology disclosed in
the present specification, the display control unit of the image
display device according to the 14th aspect is configured to regard
the sensor unit detecting the head motion or the sight line
movement of the driver of the vehicle as a precursory sign of the
driver viewing the display image of the display unit and make the
brightness or the contrast of the image higher than a usual set
value.
[0031] According to the 17th aspect of the technology disclosed in
the present specification, the display control unit of the image
display device according to the 14th aspect is configured to find
no precursory sign of the driver viewing the display image of the
display unit when the sensor unit does not detect the head motion
or the sight line movement of the driver of the vehicle for a
certain period, and make the brightness or the contrast of the
image lower than the usual set value.
[0032] According to a 18th aspect of the technology disclosed in
the present specification, there is provided an image display
device including: display unit that is provided in a side window of
a vehicle, and that is configured to display an image in a partial
region away from a pillar of the vehicle.
[0033] According to a 19th aspect of the technology disclosed in
the present specification, there is provided an image display
method including: displaying an image on a side window of a
vehicle; and controlling an opening and closing motion of the side
window, according to a display state in the displaying step.
[0034] According to a 20th aspect of the technology disclosed in
the present specification, there is provided an image display
method including: displaying an image in a partial region away from
a pillar of a vehicle, in a side window of the vehicle.
[0035] According to a 21th aspect of the technology disclosed in
the present specification, there is provided a moving object
including: a side window configured to make an opening and closing
motion; a display unit configured to display an image on the side
window; and a control unit configured to control the opening and
closing motion of the side window, according to a display state of
the display unit.
[0036] According to a 22nd aspect of the technology disclosed in
the present specification, there is provided an apparatus
comprising circuitry configured to control an opening and closing
motion of a window of a vehicle based on a display state of a
display that is configured to display on the window an image
captured by a camera mounted on the vehicle.
[0037] According to a 23rd aspect of the technology disclosed in
the present specification, the camera according to the 22.sup.nd
aspect is a side-view camera mounted on a side of the vehicle; and
the display according to the 22.sup.nd aspect is configured to
display on a side window of the vehicle the image captured by the
camera.
[0038] According to a 24th aspect of the technology disclosed in
the present specification, the display according to the 23.sup.rd
aspect is configured to display the image in a partial region away
from a pillar of the vehicle.
[0039] According to a 25th aspect of the technology disclosed in
the present specification, the camera according to the 22.sup.nd
aspect is a side-view camera mounted on a side of the vehicle, and
the circuitry according to the 22.sup.nd aspect is further
configured to control the opening and closing motion of a side
window of the vehicle based on the display state of the
display.
[0040] According to a 26th aspect of the technology disclosed in
the present specification, the image captured by the side-view
camera according to the 25.sup.th aspect is from a rearward
perspective with respect to a forward-moving direction of the
vehicle.
[0041] According to a 27th aspect of the technology disclosed in
the present specification, the circuitry according to the 22.sup.nd
aspect is further configured to limit how far the window can be
opened while the display is displaying the image.
[0042] According to a 28th aspect of the technology disclosed in
the present specification, the circuitry according to the 22.sup.nd
aspect is further configured to, if the window is open by more than
a threshold amount when the image is to be displayed, close the
window so that the window is open by less than the threshold
amount.
[0043] According to a 29th aspect of the technology disclosed in
the present specification, the display according to the 22.sup.nd
aspect comprises a semi-transmissive reflection material disposed
within a region of the window, and a projector configured to
project the image onto at least a part of the region of the
window.
[0044] According to a 30th aspect of the technology disclosed in
the present specification, the window according to the 29.sup.th
aspect is a side window of the vehicle, and the projector according
to the 29.sup.th aspect is supported by a door of the vehicle in
which the window is disposed.
[0045] According to a 31.sup.st aspect of the technology disclosed
in the present specification, the reflection material according to
the 29.sup.th aspect is configured and arranged within the region
of the window so as to cause projected light from the projector to
be reflected anisotropically.
[0046] According to a 32.sup.nd aspect of the technology disclosed
in the present specification, the reflection material according to
the 29.sup.th aspect comprises at least one of retroreflection
beads, retroreflection film, or a translucent film.
[0047] According to a 33.sup.rd aspect of the technology disclosed
in the present specification, the display according to the
22.sup.nd aspect comprises a light emitting element arranged within
the region of the window.
[0048] According to a 34th aspect of the technology disclosed in
the present specification, the circuitry according to the 22.sup.nd
aspect is further configured to cause the display to display the
image with a boundary line.
[0049] According to a 35.sup.th aspect of the technology disclosed
in the present specification, the circuitry according to the
22.sup.nd aspect is further configured to cause the display to
divide a display region into a plurality of regions, and
simultaneously display a plurality of images captured by a
plurality of cameras mounted on the vehicle.
[0050] According to a 36th aspect of the technology disclosed in
the present specification, the circuitry according to the 22.sup.nd
aspect is further configured to cause the display to display an
image of a front sideward view from the vehicle and an image of a
rear sideward view from the vehicle side-by-side.
[0051] According to a 37.sup.th aspect of the technology disclosed
in the present specification, the circuitry according to the
36.sup.th aspect is further configured to cause the display to
display an image of a side view from the vehicle.
[0052] According to a 38th aspect of the technology disclosed in
the present specification, a system including the apparatus
according to the 22.sup.nd aspect further comprises a sensor, and
the circuitry according to the 22.sup.nd aspect is further
configured to control at least one of (i) brightness of the image
displayed by the display, (ii) contrast of the image displayed by
the display, (iii) a reflectance of a semi-transmissive reflection
material disposed within a region of the window, or (iv) a display
configuration of a plurality of images captured by a plurality of
cameras mounted on the vehicle, on the basis of a detection result
of the sensor.
[0053] According to a 39th aspect of the technology disclosed in
the present specification, the sensor according to the 38.sup.th
aspect comprises at least one of (a) a motion sensor configured to
detect a head motion or an eye motion of a driver of the vehicle,
(b) a vehicle speed sensor configured to detect a traveling speed
of the vehicle, or (c) an illuminance sensor configured to detect
an illuminance of an environment around the vehicle.
[0054] According to a 40th aspect of the technology disclosed in
the present specification, the circuitry according to the 38.sup.th
aspect is further configured to set the brightness or the contrast
of the image higher than a usual set value, in response to the
sensor detecting a head motion or a sight line movement of a driver
of the vehicle.
[0055] According to a 41.sup.st aspect of the technology disclosed
in the present specification, the circuitry according to the
40.sup.th aspect is further configured such that, when the sensor
does not detect a head motion or a sight line movement of a driver
of the vehicle for a certain period, the circuitry sets the
brightness or the contrast of the image lower than a usual set
value.
[0056] According to a 42.sup.nd aspect of the technology disclosed
in the present specification, the circuitry according to the
22.sup.nd aspect is further configured to display the image on the
window for a predetermined time after the vehicle is put in a
powered off state.
[0057] According to a 43.sup.rd aspect of the technology disclosed
in the present specification, an image display method comprises
acts of displaying an image on a window of a vehicle, and
controlling an opening and closing motion of the window, according
to whether the image is being displayed.
[0058] According to a 44th aspect of the technology disclosed in
the present specification, a computer-readable medium is encoded
with instructions that, when executed by a controller, cause the
controller to perform a method comprising controlling an opening
and closing motion of a window of a vehicle based on a display
state of a display that is configured to display on the window an
image captured by a camera mounted on the vehicle.
Advantageous Effects of Invention
[0059] According to the technology disclosed in the present
specification, there can be provided an image display device, an
image display method, and a moving object capable of preferably
displaying an image behind of diagonally behind a vehicle or the
like that is captured by an onboard camera in a vehicle
interior.
[0060] Note that the advantageous effects described in this
specification are merely for the sake of example, and the
advantageous effects of the present disclosure are not limited
thereto. Furthermore, in some cases the present disclosure may also
exhibit additional advantageous effects other than the advantageous
effects given above.
[0061] Further objectives, features, and advantages of the
technology disclosed in this specification will be clarified by a
more detailed description based on the exemplary embodiments
discussed hereinafter and the attached drawings.
BRIEF DESCRIPTION OF DRAWINGS
[0062] FIG. 1 is a diagram schematically illustrating an exemplary
configuration of an image display device 100 that employs the
technology disclosed in the present specification.
[0063] FIG. 2 is a diagram illustrating an example that applies an
image display device 100 to a vehicle.
[0064] FIG. 3 is a diagram illustrating an installation example of
onboard cameras 103 and image capturing areas 301.
[0065] FIG. 4 is a diagram for describing an exemplary variant of a
display unit 101.
[0066] FIG. 5 is a diagram for describing an exemplary variant of a
display unit 101.
[0067] FIG. 6 is a diagram for describing an exemplary variant of a
display unit 101.
[0068] FIG. 7 is a diagram for describing an exemplary variant of a
display unit 101.
[0069] FIG. 8 is a diagram for describing an exemplary variant of a
display unit 101.
[0070] FIG. 9 is a diagram for describing an exemplary variant of a
display unit 101.
[0071] FIG. 10 is a diagram for describing an exemplary variant of
a display unit 101.
[0072] FIG. 11 is a diagram for describing an exemplary variant of
a display unit 101.
[0073] FIG. 12 is a diagram for describing an exemplary variant of
a display unit 101.
[0074] FIG. 13 is a diagram illustrating an exemplary variant of an
image display device 100 illustrated in FIG. 1.
[0075] FIG. 14 is a diagram illustrating a state transition diagram
in a display control unit 105.
[0076] FIG. 15 is a diagram illustrating an exemplary variant of an
image display device 100 illustrated in FIG. 1.
[0077] FIG. 16 is a diagram illustrating an exemplary variant of an
image display device 100 illustrated in FIG. 1.
DESCRIPTION OF EMBODIMENTS
[0078] In the following, an embodiment of the technology disclosed
in the present specification will be described in detail with
reference to drawings.
[0079] FIG. 1 schematically illustrates an exemplary configuration
of an image display device 100 that employs the technology
disclosed in the present specification. The image display device
100 is provided in a vehicle (not illustrated) mainly, and is used
to display an image of a CMS on a side window in a vehicle
interior.
[0080] The image display device 100 includes a display unit 101
that displays an image on the side window, and a control unit 102
including circuitry that controls opening and closing motion of the
side window, depending on a display state of the display unit 101.
In some embodiments, the control unit 102 may determine when the
vehicle is in a powered on state or a powered off state. In such
embodiments, the control unit 102 may cause the display unit 101 to
display an image of a CMS on the side window at times that the
vehicle is in a powered on state, and cause the display unit 101 to
cease displaying the image on the window when the vehicle
transitions to a powered off state. In some embodiments, the
control unit 102 may cause the display unit 101 to display the
image on the window for a predetermined time after the vehicle is
put in a powered off state.
[0081] FIG. 2 illustrates an example that applies the image display
device 100 to the vehicle. The display unit 101 is configured with
a semi-transmissive reflection plate 201 located at a side window
210, and a projection unit 202 that projects an image on this
semi-transmissive reflection plate 201, for example. The
semi-transmissive reflection plate mentioned here may be a
reflection film of a constant static reflectance such as a
semi-transmissive reflection film, and may be a reflection film
that performs an electrochromic reflectance control capable of
controlling a reflectance electrically. The reflection plate 201 is
preferably arranged at a vicinity of a front pillar (or a site a
little away from the front pillar). On the other hand, the
projection unit 202 is installed near a dashboard (an instrument
panel cluster) in the illustrated example, and projects an image of
the CMS or the like toward the semi-transmissive reflection plate
201. The projection unit 202 is configured with a micro projector
or the like, for example.
[0082] In the example illustrated in FIG. 2, the semi-transmissive
reflection plate 201 is arranged in a partial region of the side
window 210, but the reflection plate may be arranged over the
entire side window 201. Note that, by employing a configuration
that arranges the semi-transmissive reflection plate 201 only in
the partial region of the side window 210, the driver can obtain a
frontward direct sight when trying to confirm a vehicle front side
direction from the side window 210, without interference by the CMS
image. That is, the driver can obtain a frontward direct sight
through the side window 210 and a rearward indirect sight by the
CMS image, within the same sight line. Preferably, the
semi-transmissive reflection plate 201 is arranged in a view field
direction in which the driver views a door mirror of the past.
[0083] The translucent reflection plate 201 is manufactured by
performing aluminum vapor deposition on a glass surface, for
example. The semi-transmissive reflection plate 201 is configured
with an anisotropic reflection sheet made of one of micro prism,
Fresnel lens configuration, and holographic reflection, or external
light short wavelength reference light excitation material, and an
image is displayed by projected light from the projection unit 202.
Also, the semi-transmissive reflection plate 201 may be configured
with a reflectance variable mirror (electrochromic mirror) capable
controlling the reflectance or the transmittance electrically, for
example. For example, a light-controlling half mirror (for example,
refer to Patent Literature 2) can be utilized as the reflection
plate 201. A directional CMS image can be displayed to the driver
via the reflectance variable mirror.
[0084] Alternatively, the reflection plate 201 may have a vertical
grid reflection mirror surface region. Alternatively, the
reflection plate 201 may have the vertical grid reflection mirror
surface region, and may be formed such that the proportion of this
grid interval and the mirror surface becomes smaller as the side
window 210 gets closer to its periphery.
[0085] Note that FIG. 2 illustrates an example in which the
reflection plate 201 is installed in the side window 210 of a
driver's seat side (or a right side), but a display unit of the
same configuration is also assumed to be installed in a side window
of a front passenger seat side (or a left side).
[0086] The image displayed by the display unit 101, in other words,
the image that the projection unit 202 projects on the
semi-transmissive reflection plate 201 is a CMS image for rearward
confirmation that the onboard cameras 103 capture the rearward of
the vehicle, specifically. In the following, unless otherwise
mentioned, color moving images captured by the onboard cameras 103
are displayed as the CMS images. FIG. 3 illustrates an installation
example of the onboard cameras 103 and their image capturing areas
301. The onboard camera 103 is installed at the side of the
driver's seat side (or the front passenger seat side) of the
vehicle, and captures an image of a region diagonally behind the
vehicle that has been covered by the door mirror of the past, and
displays the captured image as the CMS image for the rearward
confirmation by the display unit 101. Note that, from a view point
that the door mirror is replaced with the CMS image, the door
mirror is not depicted in the vehicle illustrated in FIG. 3.
[0087] The onboard camera 103 may be an all-sky camera or a wide
angle camera, for example. Then, a view angle corresponding to the
area that can be observed by the door mirror may be cut out from an
all-sky image or a wide angle image captured by the all-sky camera
or the wide angle camera, and be displayed by the display unit 101.
Alternatively, a view angle designated by a user such as the driver
may be cut out from the all-sky camera and the wide angle camera,
and be displayed by the display unit 101.
[0088] Also, during a period in which the display unit 101 displays
the CMS image for rearward confirmation (or when the driver
observes the CMS image for rearward confirmation), the control unit
102 sets the side window in a complete closing state and prohibits
opening motion, in order to maintain a state in which the
projection unit 202 can project the image on the semi-transmissive
reflection plate 201, in other words, a state in which the driver
can confirm the rearward.
[0089] For example, in the case of the vehicle provided with a
power window system, the control unit 102 prohibits (locks) opening
operation at the time of a closing state of the side window, and
drives the side window to close the side window at the time of an
opening state of the side window. Also, in the case of a
hand-operated side window, the control unit 102 may restrict the
opening operation of the side window by using a mechanism such as a
solenoid actuator, for example. As another exemplary configuration,
the display may be switched to a backup display unit that displays
the CMS image instead of the side window, when the side window
opens at a certain degree or more, in order to enable the rearward
confirmation even in an entire opening mode of the side window
while displaying the CMS image on the side window, at the time of
usual use (refer to FIG. 16).
[0090] From FIG. 2, it can be understood that, while the driver is
observing the CMS screen image or is moving the sight line to
observe the CMS screen image, visual perception in the front side
direction at the vicinity of the front pillar enters a part of the
view field, and therefore complete blind angle occurrence can be
prevented to the minimum. Thus, at the time of turning right or
left of the vehicle, the driver can simultaneously obtain a
frontward sight in the same view field, through the CMS image (or
by using a gap between the front pillar and the CMS image), when
visually confirming the vehicle rearward or diagonally rearward of
the vehicle with the CMS image for rearward confirmation displayed
at a part of the side window.
[0091] The driver can confirm the rearward with a substantially
same sight line movement as viewing the door mirror of the past,
and in a cycle of the motion sequence of the rearward confirmation,
can momentarily view the front view field as well, from the gap
between the CMS image displayed on the translucent reflection plate
201 of the side window and the front pillar, and perceive the front
video of the direct sight in the peripheral view field of the
driver during viewing the monitor image of the CMS at the center
view field of the sight line. Thus, the driver can reduce
overlooking and recognition delay to the minimum in the rearward
confirmation sequence, and prevent an accident hitting the
approaching object from the rearward or the like. Also, when the
image display device 100 according to the present embodiment is
applied to the vehicle, the driver can visually confirm the CMS
image for rearward confirmation with a little sight line movement
amount, and confirm the frontward view field immediately. That is,
the track of the sight line has a transition that is extremely
close to the door mirror of the past, and the work load of
confirmation by the driver is reduced, and thereby a danger is
expected to be recognized quickly.
[0092] Note that Patent Literature 1 discloses an electronic side
mirror device configured to project a video captured by an onboard
camera on a holographic optical element arranged in a side window.
However, although the holographic optical element reproduces and
displays a still image of a specific single wavelength by coherent
light, or functions as a diffraction plate of the projected image
by a specific wavelength light source at the time of moving image,
but there is a problem that the holographic optical element is
unable to display a full-color moving image for the CMS. The CMS is
a device necessary for instantaneous situation recognition around
the vehicle relevant to driving by the driver particularly, and has
an important role such as recognition of an urgent vehicle for
example, and thus does not play the role sufficiently with a
monochromatic display.
[0093] Here, an exemplary variant of the display unit 101 will be
described.
[0094] For example, a reflection plate that includes a vertical
grid reflection mirror surface region may be used as the reflection
plate 201. In this case, the driver can view the CMS image by
moving the sight line when the driver wants to confirm the
rearward, while viewing the direct sight during usual frontward
visual confirmation steering.
[0095] Also, the reflection plate 201 may include the vertical grid
reflection mirror surface region, and may be formed in such a
manner that the proportion of this grid interval and the mirror
surface becomes smaller as the side window 210 gets closer to its
periphery. In this case as well, the driver can view the CMS image
by moving the body intuitively when confirming the rearward, while
viewing the direct sight during the usual frontward visual
confirmation steering. That is, the driver can confirm the
rearward, while obtaining the direct sight, by moving the body
intuitively and naturally, depending on driving situation.
[0096] Also, an image having left-right parallax may be displayed
from the projection unit 202 to the reflection plate 201. In this
case, the driver observes the three-dimensional CMS image having
the left-right parallax to confirm the rearward.
[0097] Also, the region of the reflection plate 201 located at the
side window 210 does not set a noticeable frame basically. Note
that, in order to make it obvious that the CMS image is a sight
line movement target for the driver, the CMS image is not displayed
seamlessly, but a frame is formed as illustrated with the reference
number 211 of FIG. 2. The frame 211 is preferably to an extent that
does not become a large interference in the direct sight through
the side window 210 by the driver. The frame 211 may be provided in
side edges of the reflection plate 201, and the frame 211 may be
displayed in the CMS image projected by the projection unit 202. It
is preferable that the frame 211 is a boundary line that has a
significant line width that the driver can visually confirm. The
boundary line having the significant line width is a boundary line
that allows the driver to obviously and instantaneously determine
the background that enters the view field in same the direction and
the boundary corresponding to a bezel of the monitor, when the
driver looks into the CMS image projected on the reflection plate
201. For example, a boundary line of at least 1/V=1.7 minutes,
i.e., view angle of 0.028.degree. or more is desirable, which is
converted from the lowest eyesight V=0.6 of a usual driver who can
acquire a license. Note that, when the display unit is configured
by using a self light emitting element (described later), the frame
211 may be a bezel frame.
[0098] For reference, FIG. 4 illustrates a situation in which the
CMS image illustrated with a reference number 401 is seamlessly
displayed on the side window 210 (the dotted line is not displayed
actually). The seamlessly displayed CMS image 401 is concealed in
the direct sight that can be viewed through the side window 210,
and it is concerned that the driver is unable to instantaneously
identify which part is the display of the CMS image 401, causing a
significant failure in confirmation of the direct sight and the
indirect sight. If the boundary of the image peripheral portion of
this CMS is reduced to an degree unrecognizable visually, it
becomes difficult to determine whether the sight is the frontward
direct sight or the rearward indirect sight, depending on driving
situation, causing confusion in recognition during that and
increasing the risk of delay in handling operation and erroneous
recognition and incorrect operation, and thereby the display
illustrated in FIG. 4 is to be avoided.
[0099] Also, FIG. 2 has illustrated the exemplary configuration
that installs the projection unit 202 near the dashboard
(instrument panel cluster), but the installation site of the
projection unit 202 is not limited thereto. When the projection
unit 202 is configured with a small device like a micro projector,
the installation site is flexible. For example, a projection unit
502 may be embedded in the door, as illustrated in FIG. 5. Although
not depicted, the left side (or the door of the front passenger
seat side) is configured in the same manner. The projection unit
502 embedded in the door projects light such as the CMS image
toward a reflection plate 501 arranged in the side window 510
above. In the exemplary configuration illustrated in FIG. 2, the
projected light from the projection unit 202 is directed toward
outside, and therefore it is concerned that the light that passes
through the reflection plate 201 or the side window 210 enters the
sight of the driver of an adjacent vehicle to interfere the sight.
In contrast, according to the exemplary configuration illustrated
in FIG. 5, the projected light from the projection unit 502 is
directed upward, and therefore does not enter the sight of the
driver of the adjacent vehicle to interfere the sight.
[0100] Also, an anisotropic retroreflection sheet may be used as
the reflection plate 501, in the exemplary variant illustrated in
FIG. 5. In general, the retroreflection is a reflection phenomenon
in which incident light returns to an incidence direction again.
The anisotropic retroreflection mentioned here is different from a
film of a usual beads type and a light angle cube type that
reflects a light to the same direction relative to an incident
light, and means a reflection plate of a combiner function for a
head up display (HUD) which is of a Fresnel lens or micro prism
type that controls a reflection direction relative to an incident
light direction. In contrast, the reflection plate 501 made of the
anisotropic retroreflection sheet can add the characteristics that
projects and displays the CMS image projected from the projection
unit 502 below toward the driver, by directional characteristics
reflection. Thus, there is an advantage that the CMS image can be
viewed only by the driver, and is not dazzling for other passengers
and other surrounding traveling vehicles.
[0101] Also, FIG. 6 illustrates an exemplary variant in which a
projection unit 602 is installed at a head position at the vicinity
of eyeball positions of the driver. For example, the projection
unit 602 may be fixed to a top panel portion of the vehicle. In
this case, the projection unit 602 projects the light such as the
CMS image from the direction that is close to the eyeball positions
of the driver, such as a vehicle roof for example, on a reflection
plate 601 arranged in the side window 610. The CMS image can be
viewed only at the vicinity of the sight line position of the
driver, by using retroreflection beads or film, or a translucent
film to which corner cube is transferred, as the reflection plate
601. Thus, there is an advantage that the CMS image is viewed only
be the driver and is not dazzling for other passengers (same as
above). For example, the translucent film to which the corner cube
is transferred reflects light with intense light distribution to
the incident light direction.
[0102] FIG. 2, FIG. 5, and FIG. 6, have illustrated the exemplary
configuration of the display unit 101 that projects the CMS image
from the projection unit on the translucent reflection plate
located at the side window. In contrast, as illustrated in FIG. 7,
the display unit 101 can also be configured only with a self light
emitting element 701 that is arranged in a partial region of a side
window 710. The self light emitting element 701 may be of a
semi-transmissive type. With the self light emitting element 701 of
the semi-transmissive type, the frontward direct sight and the
rearward indirect sight can be provided in the same sight line of
the driver, in the same way as the above, by controlling the self
light emitting brightness and displaying the CMS image.
[0103] The self light emitting element of the semi-transmissive
type can be a display panel, such as a quantum-dot light emitting
diode (QLED) and an organic light emitting diode (OLED), for
example. Also, a semi-transmissive QLED or an OLED display panel
having a partial active light emitting unit may be used.
[0104] The self light emitting element of this type is of a
semi-transmissive type, and can adjust the brightness. Thus, the
brightness and contrast of the self light emitting element of the
monitor panel can be adjusted according to the object illumination
intensity in the region of the direct sight and according to the
environment light for example, and thereby a balance is made in
such a manner that attention to one of the direct sight and the
indirect sight is not interfered.
[0105] According to the exemplary configuration illustrated in FIG.
7, the display unit 101 includes only the self light emitting
element of the semi-transmissive type, and the projection unit is
unnecessary to simplify the configuration. Also, the projected
light from the projection unit is blocked by a part of the body of
the driver and the passenger, another object, or the like, and
there is no concern that a part of the CMS image becomes
incomplete.
[0106] Also, FIG. 8 illustrates an exemplary variant in which a
display region 801 provided in a partial region of a side window
810 is divided into a plurality of regions, and a plurality of CMS
images are displayed simultaneously. Specifically, the display
region 801 is divided into two parts in the front-back direction,
and the CMS image of the sight in the front side direction of the
vehicle itself is displayed on a front display region 801-1, and
the CMS image of the sight in the rear side direction of the
vehicle itself is displayed on a rear display region 801-2. As an
example of a configured image of display content, a cutout image of
the image of the vehicle frontward area generated from the wide
angle image illustrated in FIG. 3 by performing central projective
transformation may be displayed on the front display region 801-1,
and a legally imperative display region of the vehicle rearward
area from the wide angle image illustrated in FIG. 3 may be
displayed as a central projective transformation image without
distortion on the rear display region 801-2.
[0107] The display region 801 composed of a plurality of CMS images
of different sights can be configured as an image projected from
the projection unit on the semi-transmissive reflection plate
arranged in the partial region of the side window 810, as
illustrated in FIG. 2 or the like. Alternatively, as described with
reference to FIG. 7, the display region 801 can be configured with
the self light emitting element of the semi-transmissive type such
as the QLED and the OLED, and can be configured by dividing the
screen into a plurality of regions and simultaneously displaying
the CMS images of different sights on the respective regions.
[0108] As illustrated in FIG. 8, a plurality of CMS images of
different sights are simultaneously displayed on the display region
801 provided in a part of the side window 810, and thereby the
driver can confirm a wider sight by instantaneous sight line
movement to the side window 810 (or the display region 801) even
during traveling and paying attention to the frontward, and proceed
to recognition determination.
[0109] Also, FIG. 9 illustrates yet another exemplary variant in
which a display region 901 provided in a partial region of a side
window 910 is divided into a plurality of regions, and a plurality
of CMS images are displayed simultaneously. Specifically, the
display region 901 is divided into two in the up-down direction,
and a CMS image of a side sight (surround view) of the vehicle
itself is displayed on an upper side display region 901-1, and the
lower side is further divided into two in the front-back direction,
and a CMS image of the sight in the front side direction of the
vehicle itself is displayed on a front display region 901-2, and a
CMS image of the sight in the rear side direction of the vehicle
itself is displayed in tandem on a rear display region 901-3.
[0110] The exemplary display illustrated in FIG. 9 can also be
configured with the display unit 101 composed of a combination of
the semi-transmissive reflection plate arranged in the partial
region of the side window and the projection unit that projects an
image on this reflection plate. As a matter of course, the display
unit 101 can be configured with the self light emitting element of
the semi-transmissive type such as the QLED and the OLED, in the
same way.
[0111] A plurality of onboard cameras of different sights may be
installed on the side of the vehicle to obtain each CMS image of
the frontward sight, the rearward sight, and the side sight
(surround view) of the vehicle. Alternatively, it may be such that
one all-sky camera is installed on the side of the vehicle (refer
to FIG. 3), and the images of the frontward sight of the vehicle,
the rearward sight of the vehicle, and the side sight of the
vehicle are cut out from an all-sky image captured by the all-sky
camera, and are mapped on the respective display regions
illustrated in FIG. 8 and FIG. 9.
[0112] Note that, in the exemplary display illustrated in FIG. 9,
the display magnification rate of the CMS image of the front
sideward sight and the vehicle side sight (surround view) may be
set small for display as compared with the CMS image of the rear
sideward sight after the vehicle. The information of the front
sideward sight and the vehicle side sight has a lower priority than
the rear sideward sight, and thus the purpose is not to make a
determination by viewing the detail but to recognize rough
information such as presence or absence of an obstacle.
[0113] As illustrated in FIG. 8 and FIG. 9, in a case in which a
plurality of CMS images of different sights are simultaneously
displayed on one display region, a plurality of CMS images of
different sights enter the same view field when the driver moves
the sight line to the side window. In this case, if it takes a long
time for the driver to perform information determination from
individual CMS images, a serious situation can be caused. For
example, it is assumed that, when overtaking is performed while
traveling at a high speed without a sufficient inter-vehicle
distance, sudden braking operation is performed in the frontward
vehicle at a moment when the driver moves the sight line to confirm
the CMS image displayed on the partial region of the side window.
If it takes time until the driver recognizes the information of the
CMS image and returns the sight line to the frontward, it can
directly lead to the rear-end accident. That is, instantaneous
determination of 1 second or less has significant meaning.
[0114] The present applicant thinks that the location relationship
of the respective CMS images is extremely important to make
individual information determinations in a shorter time, from the
display region in which a plurality of CMS images of different
sights are displayed simultaneously. As illustrated in FIG. 8 for
example, it is anticipated that the driver can soon recognize the
information that enters visually, by displaying the CMS image of
the frontward sight of the vehicle and the CMS image of the
rearward sight of the vehicle in tandem. Further, as illustrated in
FIG. 9, it is anticipated that the information recognition of the
driver is made quicker by combining the CMS image of the side sight
of the vehicle.
[0115] Also, FIG. 10 illustrates an exemplary variant of FIG. 9. In
FIG. 10, the display region 901-2 of the CMS image of the front
sideward sight of the vehicle itself is explicitly and obviously
separated from the display region 901-3 of the CMS image of the
rear sideward sight and the display region 901-1 of the CMS image
of the side sight by a boundary line having a significant line
width (same as above), as illustrated with a reference number
1001.
[0116] At the time of the usual frontward traveling, the most
important information obtained from the door mirror (or back
reflecting mirror) is existence of an adjacent vehicle that travels
in the side direction of the vehicle itself and a following vehicle
that approaches from behind the vehicle itself. On the other hand,
the information in the front side direction of the vehicle itself
is necessary at the time of low speed steering when turning at a
parking or a street corner. That is, the priority of the rear
sideward sight of the vehicle itself is highest, and the priority
of the side sight of the vehicle itself is second highest. There is
much time to determine the information of the front sideward sight,
and even if recognition is a little slower than the rear sideward
sight and the vehicle side, the driver has much time for steering
enough to prevent accident at the time of low speed driving.
[0117] The boundary 1001 illustrated in FIG. 10 explicitly and
obviously displays the boundary between the display regions 901-1
and 901-3 of the CMS image of high priority, and the display region
901-2 of the CMS image of low priority. Thus, if the driver uses
the boundary 1001 as a mark to quickly complete the information
recognition of the CMS image of high priority, an accident can be
prevented.
[0118] Also, FIG. 11 illustrates an additional exemplary variant of
FIG. 9. In the example illustrated in FIG. 11, a display region
1101 provided in the partial region of a side window 1110 is
divided into two in the front-back direction, and the front side is
further divided into two in the up-down direction, and the CMS
image of the front sideward sight of the vehicle itself is
displayed in the front-side upper display region 1101, and the CMS
image of the rear sideward sight of the vehicle itself is displayed
in a front-side lower display region 1102, and the CMS image of the
side sight (surround view) of the vehicle itself is displayed in a
rear display region 1103. In doing so, the CMS images of the front
sideward sight and the vehicle side sight may be displayed with a
smaller display magnification rate than the CMS image of the rear
sideward sight. The information of the front sideward sight and the
vehicle side sight has a lower priority than the rear sideward
sight, and thus the purpose is not to make a determination by
viewing the detail but to recognize rough information such as
presence or absence of an obstacle.
[0119] Also, FIG. 12 illustrates another exemplary configuration of
the display unit 101. The illustrated display unit 101 is
configured with a liquid crystal display (LCD) monitor 1202 capable
of anisotropic display, and a semi-transmissive reflection plate
1201 arranged in a partial region of a side window 1210. The LCD
monitor 1201 is arranged below a wind shield glass (front glass)
1220. The CMS image displayed on the LCD monitor 1202 is reflected
by the semi-transmissive reflection plate 1201 arranged in the
partial region of the side window 1210. The driver can observe the
CMS image as the reflected light of the reflection plate 1202.
[0120] The LCD monitor 1201 has brightness anisotropy, and the
driver is unable to directly view the display image of the LCD
monitor 1202, but can observe the display image only via the
reflection plate 1202 arranged in the view field direction for
viewing the door mirror of the past. When the anisotropic display
LCD monitor 1201 is used, other content (i.e., other than the CMS
image) (for example, vehicle speed display, etc.) may be displayed
in the frontward direction, that is, in the direction that the
driver views directly.
[0121] Not only at the driver's seat side as described above, but
also at the front passenger seat side, a LCD monitor 1202' capable
of anisotropic display is arranged, and a semi-transmissive
reflection plate 1201' that reflects the display image of the LCD
monitor 1202' may be arranged in the side window 1210' of the front
passenger seat side. Note that, even if the location position of
the monitor in the front passenger seat side is generally slightly
different from the door mirror of the past, there is a large
distance from the viewpoint of the driver, and thus a use method
may be not via the semi-transmissive reflection plate 1201'
necessarily but direct visual confirmation of the LCD monitor
1202', and the configuration may be asymmetric between the driver's
seat side and the front passenger seat side.
[0122] Also in the working example illustrated in FIG. 12, the
configuration may be such that the display image of the LCD monitor
1202 is divided into a plurality of images, and a plurality of CMS
images are simultaneously displayed on the reflection plate 1201 in
the same way as the working example illustrated in FIGS. 8 to
11.
[0123] FIG. 13 illustrates an exemplary variant of the image
display device 100 illustrated in FIG. 1. The image display device
100 illustrated in FIG. 13 further includes a sensor unit 104 and a
display control unit 105. Also, the display unit 101 is assumed to
use a reflectance variable mirror (electrochromic mirror) that can
electrically control reflectance or transmittance as the reflection
plate 201, or to be able to control the brightness and contrast of
the CMS image projected from the projection unit 202 and the
illumination light strength of the backlight. Then, the display
control unit 105 controls the reflectance of the reflection plate
201 in the display unit 101, and the brightness, the contrast, or
the like of the CMS image projected from the projection unit 202,
on the basis of the detection result by the sensor unit 104. Note
that, when the display unit 101 is configured with the self light
emitting element as illustrated in FIG. 7, the display control unit
105 adjusts at least one of the brightness and contrast of the self
light emitting element or the reflectance of the semi-transmissive
reflection plate, on the basis of the detection result by the
sensor unit 104. In the following, display control based on the
detection result by the sensor unit 104 will be illustrated.
[0124] (1) Display Control According to External Light and
Environment Light
[0125] The sensor unit 104 is equipped with an illuminance sensor,
and detects external light and environment light. Then, the display
control unit 105 controls at least one switching of the reflectance
of the reflection plate 201 in the display unit 101, the brightness
and the contrast of the CMS image projected from the projection
unit 202, and the reflectance of the semi-transmissive reflection
plate, according to the strength of the external light and the
environment light detected by the sensor unit 104, in such a manner
that the brightness of the outside in the direct sight through the
side window viewed by the driver is not made different from the
brightness of the image displayed on the side window. For example,
when the external light and the environment light are intense, the
reflectance of the reflection plate 201 is set higher than a usual
set value to increase the brightness of the reflected light, and
the brightness and the contrast of the CMS image are set higher
than usual set values, in order to improve the visibility of the
CMS image. That is, the reflectance of the reflection plate 201 and
the brightness of the CMS image are adjusted according to the
object illumination intensity in the region of the direct sight,
and thereby the balance is made in such a manner that attention to
one of the direct sight or the indirect sight is not
interfered.
[0126] (2) Display Control According to Surrounding Environment and
Driving Environment
[0127] The sensor unit 104 detects the surrounding environment and
the driving environment of the vehicle, and the display control
unit 105 controls at least one of the reflectance of the reflection
plate 201 in the display unit 101, the brightness and the contrast
of the CMS image, the reflectance of the semi-transmissive
reflection plate, and the like, on the basis of the detection
result. Although the exemplary variant that displays the CMS image
has been illustrated in FIGS. 8 to 11, the standard display image
corresponding to the door mirror (or the side mirror) at the time
of usual traveling and the display image for supporting parking
during low speed traveling, may be switched according to the
intention of the driver.
[0128] For example, the sensor unit 104 detects the surrounding
environment and the driving environment on the basis of analysis
such as image recognition of the captured image of the onboard
camera, an analysis result of sound acquired by a sound collection
device such as a microphone, and the like. Further, the sensor unit
104 may detect the driving environment of the road that is
currently traveled, by utilizing a real-time distribution system of
road traffic information, such as vehicle information and
communication system (VICS) (registered trademark).
[0129] For example, when the sensor unit 104 detects that the
following vehicle is approaching on the basis of the image analysis
of the onboard camera or the like, the driver is to confirm the
rearward indirect sight by the CMS image, and thus the reflectance
of the reflection plate 201 and the brightness and the contrast of
the CMS image are set higher than the usual set values, in order to
improve the visibility of the CMS image.
[0130] Also, when the sensor unit 104 determines that an urgent
vehicle is approaching on the basis of the detection result of
siren sound or detects that an accident has occurred near the
vehicle itself on the basis of the image analysis of the onboard
camera, the reception information from outside vehicle such as VICS
(registered trademark), and the like, the display control unit 105
sets the reflectance of the reflection plate 201 and the brightness
and the contrast of the CMS image higher than the usual set values,
in order for the driver to easily confirm the indirect sight.
[0131] (3) Display Control According to Vehicle Speed
[0132] For example, the sensor unit 104 includes a gyro sensor that
detects an angular velocity of axial rotation motion of the vehicle
body, an acceleration sensor that detects an acceleration of the
vehicle, a sensor for detecting an engine speed or a wheel rotation
speed, and the like, and detects a traveling speed of the
vehicle.
[0133] In high speed traveling, such as when the vehicle travels on
a high speed road for example, it becomes more necessary for the
driver to confirm the rearward indirect sight by the CMS image.
Thus, the display control unit 105 may control the reflectance of
the reflection plate 201 and the brightness and the contrast of the
CMS image, according to the vehicle speed detected by the sensor
unit 104. For example, the reflectance of the reflection plate 201
is set higher than the usual set value to increase the brightness
of the reflected light, and the brightness and the contrast of the
CMS image are set higher than the usual set values in response to
the driver performing directional indicator operation for lane
change, or the sight line of the driver starting the transition for
confirming of diagonally rearward, during the high speed traveling
of the vehicle, in order to improve the visibility of the CMS
image. The brightness increase and the contrast increase of the
monitor are already performed in the driver's sight line movement
start period, to gain an effect of causing the sight line movement
to the target spot more immediately by human visual recognition
characteristics that leads attention to a place of large temporal
brightness change in the peripheral view field. That is, when the
sight line movement starts, the brightness change of the object
increases according to the movement of the eyeballs, by increasing
the contrast of the CMS image, thereby enabling earlier
recognition.
[0134] (4) Display Control According to Driving Operation
[0135] For example, the driver is to confirm the diagonally left or
right rearward of the vehicle, when the vehicle turns right or
left. The sensor unit 104 can detect that the vehicle is going to
turn left or right, on the basis of the operation of the
directional indicator, the steering angle of a steering, and the
like. Then, the display control unit 105 sets the reflectance of
the reflection plate 201 higher than the usual set value to
increase the brightness of the reflected light, or sets the
brightness and the contrast of the CMS image higher than the usual
set values, in response to the sensor unit 104 having detected
turning right or left of the vehicle itself, in order to improve
the visibility of the CMS image. When usual straight driving is
continued, the vehicle rearward is not to be confirmed unlike at
the time of lane change and turning right or left, and thus it is
not urgent for the driver to understand the situation as
appropriate. Thus, in a situation where it is not urgent to observe
the rearward image, the brightness and the contrast of the CMS
image are set low to lowly suppress the visual stimulation to the
peripheral view field of the driver, and when the driving operation
for turning right or left or the lane change is performed, and the
necessity to visually confirm the rearward image is imminent, the
brightness and the contrast of the CMS image is increased to make
it easier for the driver to perceive the sight line turning
destination target at the time of visual recognition. As a result,
there is an effect of helping driver's early rearward confirmation,
contributing to prompt vehicle surrounding area recognition. Also,
in a situation where the observation of the rearward image is not
urgent, such as when usual straight driving is continued, the
brightness and the contrast of the CMS image are set low to reduce
the electric power consumption of the vehicle.
[0136] (5) Display Control According to Intention of Driver
[0137] From ergonomic knowledge, a system that helps recognition
according to intention and necessity for the driver to confirm the
rearward is desired. The sensor unit 104 detects whether or not the
driver has an intention to confirm the rearward indirect sight with
the CMS image. Then, the display control unit 105 sets the
reflectance of the reflection plate 201 higher than the usual set
value, or sets the brightness and the contrast of the CMS image
higher than the usual set value, in response to detection of the
driver's intention of the rearward confirmation by the sensor unit
104, in order to improve the visibility of the CMS image.
[0138] The sensor unit 104 follows and tracks the motion of the
head of the driver and the sight line movement of the left and
right eyes. The sensor unit 104 is configured with a drive monitor
camera installed in the vehicle interior of the vehicle, for
example. Alternatively, a gyro sensor, an acceleration sensor, a
myoelectricity sensor, or the like attached to the head of the
driver can utilized as the sensor unit 104.
[0139] When the position of the head of the driver and the sight
line deviate from the usual default position, the display control
unit 105 actively switches the reflectance of the reflection plate
201, according to the movement amount detected by the sensor unit
104. Also, when the illumination light strength of the backlight of
the projection unit 202 is controllable, and the position of the
head of the driver and the sight line deviate from the usual
default position, the display control unit 105 actively switches
the illumination light strength of the backlight of the projection
unit 202 and the brightness and the contrast of the CMS image,
according to the movement amount detected by the sensor unit 104.
With regard to the detection of change from the default position,
it is difficult to set a specific threshold value, due to
individual variation of drivers. Thus, a system may be used in
which a trigger of actual switching is switchable, by learning the
feature of physical motion unique to individual drivers by using
artificial intelligence, for example.
[0140] Also, the display control unit 105 may control the
brightness of the CMS image projected and displayed on the
reflection plate 201, according to the movement amount in the
horizontal direction (i.e., to left and right) of the head detected
by the sensor unit 104.
[0141] For example, when the driver moves the head to left or right
to change the sight line position, it is considered as a precursory
sign of the driver confirming the rearward by the CMS image. Thus,
in response to the sensor unit 104 detecting the left-right
movement of the head of the driver and the movement of the sight
line position, the display control unit 105 sets the reflectance of
the reflection plate 201 higher than the usual set value to
increase the brightness of the reflected light, or sets the
brightness and the contrast of the CMS image projected on the
reflection plate 20 from the projection unit 202 higher than the
usual set value, in order for the driver to easily view the CMS
image for rearward confirmation. Also, the driver can
simultaneously obtain the frontward sight in the same view field
through the CMS image (or by using the gap between the front pillar
and the CMS image).
[0142] Here, when the driver puts the sight line on the rearward
indirect sight of the CMS image, there is large turning movement of
the head and the eyeballs. During the turning, the brightness and
the contrast of the CMS image is momentarily set higher than the
usual set value, and thereby the driver's sight line change motion
target stimulates dynamic visual acuity outside the view field, and
the driver's sight line change motion to the target becomes a
little more agile. That is, in response to detection of the sight
line movement of the driver, the peripheral view field, which is
referred to as rod, is stimulated by displaying the image whose
brightness and contrast are set higher than the usual set values,
and thereby the driver's sight line movement and the focal point
adjustment to the CMS image becomes a little more agile, thereby
speeding up the recognition sequence of the CMS image. Further, by
setting the brightness and the contrast of the CMS image higher
than the usual set values, there is an effect that the focal point
of the eyes of the driver immediately starts being shifted from
infinity to a finite length position of the CMS image (the
reflection plate 201 that displays the CMS image, or a hollow image
defined by the combiner).
[0143] On the other hand, if the CMS image is displayed in the
peripheral view field at all times, the driver gets used to the
change of the CMS image in terms of attention degree, decreasing
the attentiveness. During the usual frontward visual confirmation
steering, the surrounding image information by the bright luminous
body, as displayed by the CMS image, has little meaningful
information in view of safety traveling, but is even interference.
Thus, while the driver does not move the head to left or right or
does not change the sight line position during usual steering, the
sensor unit 104 does not detect the left-right movement of the head
of the driver and the movement of the sight line position for a
certain period, and therefore the display control unit 105 assumes
that there is no precursory sign of the driver confirming the
rearward with the CMS image, and sets the reflectance of the
reflection plate 201 lower than the usual set value, or sets the
brightness and the contrast of the CMS image projected on the
reflection plate 20 from the projection unit 202 lower than the
usual set values. Thereby, the decrease of the attentiveness of the
driver is prevented. Also, the driver can obtain the direct sight
to the frontward, without being interfered by the brightness of the
CMS image.
[0144] In addition, an effect can be expected in which unnecessary
eye fatigue and optic nerve fatigue are mitigated by decreasing the
brightness of the CMS image, while the driver does not view the CMS
image. Also, electric power consumption can be reduced by reducing
the illumination light strength of the backlight of the projection
unit 202.
[0145] (6) Display Control for Increasing Recognition Speed of CMS
Image
[0146] From the necessity of immediately feeding the information of
the vehicle diagonally rearward back to the driver at a necessary
timing, it is ideal that the image display device 100 promptly
perceives the visual confirmation motion of the CMS image in
response to the intention of the driver and assists the driver in
quickly performing brain recognition work.
[0147] In fact, the driver's thought is unable to be directly
confirmed, and therefore as described above the recognition speed
of the CMS image is decided depending on whether the feature of the
movement of the head and the sight line of the driver is
immediately detected to allow the sight line to promptly move to
and the focal point to be adjusted to the CMS image at the time of
motion start in order to start the recognition. It is effective if
peripheral view field perception of a person is used to utilize
living-body surrounding-area danger detection ability for setting
the center sight line at the spot that changes more brightly. To do
that, in response to detection of the movement of the head and the
sight line of the driver, the brightness and the contrast of the
CMS image may be set higher than the usual set values, to stimulate
the peripheral view field which is referred to as rod.
[0148] Thereafter, the brightness and the contrast of the CMS image
may be set back to standard, by detecting the end of the saccade
movement of the CMS image gazing (visual fixation) of the sight
line. Here, the saccade motion is wiggling eyeball motion of agile,
fine, stepwise, jumpy rotational acceleration and stopping at one
direction, and can be an index for estimating the attention degree
of the driver. Further, when entrance into a visual confirmation
stable status (visual fixation) is detected, the brightness of the
CMS image is set lower than the usual set value (for example, the
brightness of the backlight of the projection unit 202 is set lower
than the usual set value), in order to transition to the standby
state.
[0149] FIG. 14 illustrates a state transition diagram in the
display control unit 105. The display control unit 105 includes a
standby state in which the brightness and the contrast of the
display unit 101 are set low, a normal state in which the
brightness and the contrast of the display unit 101 are set at the
usual set values, and a brightness-contrast up state in which the
brightness and the contrast of the display unit 101 are set higher
than the usual set values momentarily.
[0150] When the vehicle travels at a low speed and the position and
the sight line of the head of the driver are at usual default
positions, the display control unit 105 waits in the standby state.
In the standby state, the illumination light of the backlight of
the projection unit 202 is reduced lowly, in a state of low
electric power consumption, for example.
[0151] When the position of the head and the sight line of the
driver deviate from the usual default position, the display control
unit 105 becomes the normal state, or the up state of the
brightness and the contrast, to increase the brightness and the
contrast of the display unit 101, thereby making it easy to confirm
the rearward indirect sight by the CMS image.
[0152] Also, when the vehicle turns right or left, and when the
urgent vehicle approaches, the display control unit 105 becomes the
normal state or the up state of the brightness and the contrast, to
increase the brightness and the contrast of the display unit 101,
thereby making it easy to confirm the rearward indirect sight by
the CMS image.
[0153] Also, in the up state of the brightness and the contrast,
the brightness and the contrast of the CMS image are set higher
than the usual set values momentarily, and thereby the dynamic
visual acuity with the driver's sight line change motion target
outside the view field is stimulated. Thereby, the driver's sight
line movement and the focal point adjustment to the CMS image of
become a little more agile by stimulating the peripheral view field
which is referred to as rod, speeding up the recognition sequence
of the CMS image. Further, there is an effect of starting setting
the focal point of the eyes of the driver from infinity to the
finite length position of the CMS image (displayed by reflection
plate 201) immediately, by setting the brightness and the contrast
of the CMS image higher than the usual set values.
[0154] Although the up state of the brightness and the contrast
assists in the driver's sight line movement and the focal point
adjustment to the CMS image, there is a problem that the electric
power consumption in the display unit 101 increases. Thus, the
display control unit 105 detects that the saccade movement of the
sight line gazing the CMS image has ended, and changes the
brightness and the contrast of the CMS image to the normal state,
achieving low electric power consumption.
[0155] The up state of the brightness and the contrast is not
continued and is changed to the normal state in which the
brightness and the contrast are reduced a little, and thereby the
brightness of the CMS image is decreased, to have an expected
effect of mitigating the unnecessary eye fatigue and the optic
nerve fatigue.
[0156] The saccade motion is wiggling eyeball motion of agile,
fine, stepwise, jumpy rotational acceleration and stopping at one
direction, and can be an index for estimating the attention degree
of the driver. When the saccade motion of the eyeball of the driver
is difficult to detect, the display control unit 105 may continue
the up state of the brightness and the contrast for a predetermined
time and then transition to the normal state automatically.
[0157] Thereafter, when entrance into the visual confirmation
stable status is detected, the brightness of the CMS image is set
lower than the usual set value (for example, the brightness of the
backlight of the projection unit 202 is set lower than the usual
set value), causing transition to the standby state. It is assumed
that the driver determines whether or not the lane change is
possible upon turning the head and then proceeds to the
confirmation at the time of starting the execution of the lane
change, except for the driver's reflective urgent lane change that
can occur when trying to preventing a rear-end collision. The
brightness and the contrast of the CMS image are increased at an
initial sight line movement to speed up visual confirmation, in
order to help the start of the surrounding area the recognition
sequence of the driver (the brightness-contrast up state of FIG.
14). It is assumed that the driver confirms the CMS image a
plurality of times until the end of target steering, and this
period corresponds to the normal state of FIG. 14. Thus, it is
desirable that the transition to the standby state in which the CMS
image has low brightness be performed after a predetermined time
when instantaneous confirmation of the CMS image becomes
unimportant after the end of a series of these motions. A
predetermined time mentioned here is a period in consideration of
this sequence, and desirably has a unit of several seconds at the
minimum, and if there is no other harmful effect, has a unit of
several ten seconds.
[0158] FIG. 15 illustrates an exemplary variant of the image
display device 100 illustrated in FIG. 13. The image display device
100 illustrated in FIG. 15 is equipped with an input unit 106 in
addition to the sensor unit 104, the display control unit 105.
[0159] The display unit 101 is assumed to use a reflectance
variable mirror (electrochromic mirror) that can electrically
control reflectance or transmittance as the reflection plate 201,
or to be able to control the brightness and contrast of the CMS
image projected from the projection unit 202 and the illumination
light strength of the backlight. Then, the display control unit 105
controls the reflectance of the reflection plate 201 in the display
unit 101, and the brightness, the contrast, or the like of the CMS
image projected from the projection unit 202, on the basis of the
detection result by the sensor unit 104. Note that, when the
display unit 101 is configured with the self light emitting element
as illustrated in FIG. 7, the display control unit 105 adjusts the
brightness and the contrast of the self light emitting element, on
the basis of the detection result by the sensor unit 104.
[0160] The display control unit 105 controls the brightness and the
contrast of the CMS image displayed by the display unit 101, as
illustrated in the above (1) to (6), on the basis of the detection
result by the sensor unit 104.
[0161] Further, the display control unit 105 actively switches the
reflectance of the reflection plate 201, according to an
instruction from the driver via the input unit 106, and actively
switches the illumination light strength of the backlight of the
projection unit 202 and the brightness and the contrast of the CMS
image.
[0162] For example, when the CMS image displayed at a part of the
side window is to be confirmed but is unable to be viewed due to
influence such as external light and environment light and other
causes, the driver instructs setting the brightness and the
contrast of the CMS image higher than the usual set values, via the
input unit 106.
[0163] Also, when the driver tries to confirm the vehicle front
sideward sight through the side window, and the indirect sight of
the CMS image interferes, or the brightness and the contrast of the
CMS image are too high to cause the driver to feel eye fatigue and
optic nerve fatigue, the driver instructs setting the brightness
and the contrast of the CMS image lower than the usual set values,
via the input unit 106.
[0164] Note that, even when the instruction is issued via the input
unit 106 from the driver, the display control unit 105 may prohibit
the switch of the brightness and the contrast of the CMS image
(does not switch according to the instruction), depending on the
detection result of the sensor unit 104. For example, while the
vehicle is traveling at a high speed, the rearward indirect sight
by the CMS image is to be confirmed at all times, and thus even if
instructed from the driver to set the brightness and the contrast
of the CMS image lower than the usual set values via the input unit
106, the display control unit 105 does not switch the brightness
and the contrast, or keeps the brightness and the contrast at the
minimum level necessary for ensuring the visual confirmation for
safety.
INDUSTRIAL APPLICABILITY
[0165] The foregoing thus describes the technology disclosed in
this specification in detail and with reference to specific
embodiments. However, it is obvious that persons skilled in the art
may make modifications and substitutions to these embodiments
without departing from the spirit of the technology disclosed in
this specification.
[0166] The technology disclosed in the present specification can be
applicable to various vehicles such as a car (including a gasoline
car and a diesel car), an electric vehicle, a hybrid electric
vehicle, a motorcycle, a bicycle, a personal mobility, and a moving
object of a form other than the vehicles that travel on a road.
[0167] Essentially, the technology disclosed in this specification
has been described by way of example, and the stated content of
this specification should not be interpreted as being limiting. The
spirit of the technology disclosed in this specification should be
determined in consideration of the claims.
[0168] It should be understood by those skilled in the art that
various modifications, combinations, sub-combinations and
alterations may occur depending on design requirements and other
factors insofar as they are within the scope of the appended claims
or the equivalents thereof.
[0169] Additionally, the present technology may also be configured
as below.
[0170] (1) An image display device including:
[0171] a display unit configured to display an image on a side
window of a vehicle; and
[0172] a control unit configured to control an opening and closing
motion of the side window, according to a display state of the
display unit.
[0173] (2) The image display device according to (1), wherein
[0174] while the display unit is displaying the image, the control
unit prohibits an opening operation of the side window, or closes
the open side window.
[0175] (3) The image display device according to (1), wherein
[0176] the display unit displays the image in a partial region away
from a pillar of the vehicle.
[0177] (4) The image display device according to (1), wherein
[0178] the display unit displays an image having left-right
parallax.
[0179] (5) The image display device according to (1), wherein
[0180] the display unit includes a semi-transmissive reflection
plate arranged in a partial region of the side window, and a
projection unit that projects the image on the reflection
plate.
[0181] (6) The image display device according to (5) including:
[0182] the reflection plate with a vertical grid reflection mirror
surface region.
[0183] (7) The image display device according to (5), wherein
[0184] the vertical grid reflection mirror surface region is formed
in such a manner that a grid interval and a proportion of mirror
surface become smaller when getting closer to a periphery of the
side window.
[0185] (8) The image display device according to (5), wherein
[0186] the projection unit is installed near an instrument panel
cluster of the vehicle.
[0187] (9) The image display device according to (5), wherein
[0188] the projection unit is located at a door of the vehicle, and
projects an image toward the reflection plate arranged in the side
window.
[0189] (10) The image display device according to (9), wherein
[0190] the reflection plate anisotropically retroreflects projected
light from the projection unit.
[0191] (11) The image display device according to (5), wherein
[0192] the projection unit is installed at a head position at a
vicinity of an eyeball position of a driver of the vehicle.
[0193] (12) The image display device according to (11), wherein
[0194] the reflection plate is made of any of retroreflection beads
or film, and a translucent film to which corner cube is
transferred.
[0195] (13) The image display device according to (1), wherein
[0196] the display unit includes a self light emitting element
arranged in a partial region of the side window.
[0197] (14) The image display device according to (1), wherein
[0198] the display unit includes a monitor capable of anisotropic
display and a semi-transmissive reflection plate arranged in a
partial region of the side window.
[0199] (15) The image display device according to (1), wherein
[0200] the display unit displays the image with a boundary
line.
[0201] (16) The image display device according to (1), wherein
[0202] the display unit divides a display region into a plurality
of regions, and simultaneously displays a plurality of images.
[0203] (17) The image display device according to (16), wherein
[0204] the display unit simultaneously displays a plurality of
images of different sights captured by an onboard camera of the
vehicle.
[0205] (18)
[0206] The image display device according to (16), wherein
[0207] the display unit displays an image of a front sideward sight
of the vehicle and an image of a rear sideward sight
side-by-side.
[0208] (19) The image display device according to (18), wherein
[0209] the display unit further displays an image of a side sight
of the vehicle.
[0210] (20) The image display device according to (18), wherein
[0211] the display unit displays the front sideward sight image at
a smaller display magnification rate than the rear sideward sight
image.
[0212] (21) The image display device according to (16), wherein
[0213] the display unit puts a boundary line between images
displayed simultaneously.
[0214] (22) The image display device according to (1), further
including:
[0215] a sensor unit; and
[0216] a display control unit configured to control at least one of
brightness and contrast of the image displayed by the display unit
and a reflectance of a semi-transmissive reflection plate, on the
basis of a detection result of the sensor unit.
[0217] (23) The image display device according to (22), wherein
[0218] the display unit includes a reflectance variable mirror
arranged in a partial region of the side window, and a projection
unit that projects the image on the reflectance variable minor,
and
[0219] the display control unit controls the reflectance of the
reflectance variable mirror on the basis of a detection result of
the sensor unit.
[0220] (24) The image display device according to (22), wherein
[0221] the display control unit controls at least one of the
brightness and the contrast of the image and the reflectance of the
semi-transmissive reflection plate, according to an external light
or an environment light detected by the sensor unit.
[0222] (25) The image display device according to (22), wherein
[0223] the display control unit controls at least one of the
brightness and the contrast of the image and the reflectance of the
semi-transmissive reflection plate, according to a driving
environment of the vehicle detected by the sensor unit.
[0224] (26) The image display device according to (22), wherein
[0225] the display control unit controls at least one of the
brightness and the contrast of the image and the reflectance of the
semi-transmissive reflection plate, in response to driving
operation of the vehicle detected by the sensor unit.
[0226] (27) The image display device according to (22), wherein
[0227] the display control unit controls at least one of the
brightness and the contrast of the image and the reflectance of the
semi-transmissive reflection plate, in response to the sensor unit
detecting a head motion or a sight line movement of a head of a
driver of the vehicle.
[0228] (28) The image display device according to (22), wherein
[0229] the display control unit controls at least one of the
brightness and the contrast of the image and the reflectance of a
semi-transmissive reflection plate, in response to the sensor unit
detecting a head motion or a sight line movement of a driver of the
vehicle,
[0230] (29) The image display device according to (22), wherein
[0231] the display control unit sets the brightness or the contrast
of the image higher than a usual set value, in response to the
sensor unit detecting a head motion or a sight line movement of a
driver of the vehicle.
[0232] (30) The image display device according to (22), wherein
[0233] when the sensor unit does not detect a head motion or a
sight line movement of a driver of the vehicle for a certain
period, the display control unit sets the brightness or the
contrast of the image lower than a usual set value.
[0234] (31) An image display device including:
[0235] a display unit that is provided in a side window of a
vehicle, and that is configured to display an image in a partial
region away from a pillar of the vehicle.
[0236] (32) An image display method including:
[0237] displaying an image on a side window of a vehicle; and
[0238] controlling an opening and closing motion of the side
window, according to a display state in the displaying step.
[0239] (33) An image display method including:
[0240] displaying an image in a partial region away from a pillar
of a vehicle, in a side window of the vehicle.
[0241] (34) A moving object including:
[0242] a side window configured to make an opening and closing
motion;
[0243] a display unit configured to display an image on the side
window; and
[0244] a control unit configured to control the opening and closing
motion of the side window, according to a display state of the
display unit.
[0245] (35) An apparatus, comprising:
[0246] circuitry configured to control an opening and closing
motion of a window of a vehicle based on a display state of a
display that is configured to display on the window an image
captured by a camera mounted on the vehicle.
[0247] (36) An image display system comprising the apparatus of
(35), the display, and the camera.
[0248] (37) The image display system according to (36), wherein
[0249] the camera is a side-view camera mounted on a side of the
vehicle, and
[0250] the display is configured to display on a side window of the
vehicle the image captured by the camera.
[0251] (38) The image display system according to (37), wherein
[0252] the display is configured to display the image in a partial
region away from a pillar of the vehicle.
[0253] (39) The apparatus according to (35), wherein
[0254] the camera is a side-view camera mounted on a side of the
vehicle, and the circuitry is further configured to control the
opening and closing motion of a side window of the vehicle based on
the display state of the display.
[0255] (40) The apparatus according to claim 39), wherein
[0256] the image captured by the side-view camera is from a
rearward perspective with respect to a forward-moving direction of
the vehicle.
[0257] (41) The apparatus according to (35), wherein
[0258] the circuitry is further configured to limit how far the
window can be opened while the display is displaying the image.
[0259] (42) The apparatus according to (35), wherein
[0260] the circuitry is further configured to, if the window is
open by more than a threshold amount when the image is to be
displayed, close the window so that the window is open by less than
the threshold amount.
[0261] (43) The image display system according to (36), wherein
[0262] the display comprises a semi-transmissive reflection
material disposed within a region of the window, and
[0263] a projector configured to project the image onto at least a
part of the region of the window.
[0264] (44) The image display system according to (44), wherein
[0265] the window is a side window of the vehicle, and the
projector is supported by a door of the vehicle in which the window
is disposed.
[0266] (45) The image display system according to (44), wherein
[0267] the reflection material is configured and arranged within
the region of the window so as to cause projected light from the
projector to be reflected anisotropically.
[0268] (46) The image display system according to (44), wherein
[0269] the reflection material comprises at least one of
retroreflection beads, retroreflection film, or a translucent
film.
[0270] (47) The image display system according to (36), wherein
[0271] the display comprises a light emitting element arranged
within the region of the window.
[0272] (48) The image display system according to (35), wherein
[0273] the circuitry is further configured to cause the display to
display the image with a boundary line.
[0274] (49) The image display system according to (35), wherein
[0275] the circuitry is further configured to cause the display to
divide a display region into a plurality of regions, and
simultaneously display a plurality of images captured by a
plurality of cameras mounted on the vehicle.
[0276] (50) The image display system according to (35), wherein
[0277] the circuitry is further configured to cause the display to
display an image of a front sideward view from the vehicle and an
image of a rear sideward view from the vehicle side-by-side.
[0278] (51) The image display system according to claim 50),
wherein
[0279] the circuitry is further configured to cause the display to
display an image of a side view from the vehicle.
[0280] (52) The image display system according to (36), wherein
[0281] the system further comprises a sensor, and the circuitry is
further configured to control at least one of (i) brightness of the
image displayed by the display, (ii) contrast of the image
displayed by the display, (iii) a reflectance of a
semi-transmissive reflection material disposed within a region of
the window, or (iv) a display configuration of a plurality of
images captured by a plurality of cameras mounted on the vehicle,
on the basis of a detection result of the sensor.
[0282] (53) The image display system according to (52), wherein
[0283] the sensor comprises at least one of (a) a motion sensor
configured to detect a head motion or an eye motion of a driver of
the vehicle, (b) a vehicle speed sensor configured to detect a
traveling speed of the vehicle, or (c) an illuminance sensor
configured to detect an illuminance of an environment around the
vehicle.
[0284] (54) The image display system according to (52), wherein
[0285] the circuitry is further configured to set the brightness or
the contrast of the image higher than a usual set value, in
response to the sensor detecting a head motion or a sight line
movement of a driver of the vehicle.
[0286] (55) The image display system according to (54), wherein
[0287] the circuitry is further configured such that, when the
sensor does not detect a head motion or a sight line movement of a
driver of the vehicle for a certain period, the circuitry sets the
brightness or the contrast of the image lower than a usual set
value.
[0288] (56) The apparatus according to (35), wherein
[0289] the circuitry is further configured to display the image on
the window for a predetermined time after the vehicle is put in a
powered off state.
[0290] (57) The image display system according to (36), in
combination with the vehicle.
[0291] (58) An image display method comprising:
[0292] displaying an image on a window of a vehicle; and
[0293] controlling an opening and closing motion of the window,
according to whether the image is being displayed.
[0294] (59) A computer-readable medium encoded with instructions
that, when executed by a controller, cause the controller to
perform a method comprising controlling an opening and closing
motion of a window of a vehicle based on a display state of a
display that is configured to display on the window an image
captured by a camera mounted on the vehicle.
REFERENCE SIGNS LIST
[0295] 100 image display device [0296] 101 display unit [0297] 102
control unit [0298] 103 onboard camera [0299] 104 sensor unit
[0300] 105 display control unit [0301] 106 input unit [0302] 201
semi-transmissive reflection plate [0303] 202 projection unit
* * * * *