U.S. patent application number 13/130074 was filed with the patent office on 2011-09-22 for device for monitoring an environment of a vehicle.
This patent application is currently assigned to DAIMLER AG. Invention is credited to Joachim Gloger.
Application Number | 20110228088 13/130074 |
Document ID | / |
Family ID | 41467062 |
Filed Date | 2011-09-22 |
United States Patent
Application |
20110228088 |
Kind Code |
A1 |
Gloger; Joachim |
September 22, 2011 |
DEVICE FOR MONITORING AN ENVIRONMENT OF A VEHICLE
Abstract
The invention relates to a device for monitoring an environment
of a vehicle, wherein the environment is captured by means of a
plurality of image capturing units, the capture ranges (2) thereof
at least partially overlapping each other and forming an overlap
range (3), wherein an overall image is generated from the
individual images captured by means of the image capturing units by
means of an image processing unit, said overall image showing the
vehicle and the environment thereof from a bird's-eye view.
According to the invention, the image capturing units are designed
as wafer-level cameras (1).
Inventors: |
Gloger; Joachim; (Bibertal,
DE) |
Assignee: |
DAIMLER AG
Stuttgart
DE
|
Family ID: |
41467062 |
Appl. No.: |
13/130074 |
Filed: |
November 19, 2009 |
PCT Filed: |
November 19, 2009 |
PCT NO: |
PCT/EP09/08234 |
371 Date: |
May 19, 2011 |
Current U.S.
Class: |
348/148 ;
348/E7.085 |
Current CPC
Class: |
H04N 5/23238 20130101;
B60R 1/00 20130101; B60R 11/04 20130101; B60R 2300/105 20130101;
B60R 2300/607 20130101; H04N 13/243 20180501; B60R 2300/30
20130101; B60R 2300/303 20130101; H04N 7/181 20130101; B60R
2300/806 20130101 |
Class at
Publication: |
348/148 ;
348/E07.085 |
International
Class: |
H04N 7/18 20060101
H04N007/18 |
Foreign Application Data
Date |
Code |
Application Number |
Dec 12, 2008 |
DE |
10 2008 061 760.1 |
Claims
1. A device for monitoring an environment of a vehicle, wherein the
environment is captured by means of a plurality of image capturing
units, the capture ranges (2) thereof at least partially
overlapping each other and forming an overlap range (3), wherein an
overall image is generated from the individual images captured by
means of the image capturing units by means of an image processing
unit, which overall image shows the vehicle and the environment
thereof from a bird's-eye view, wherein the image capturing units
are wafer-level cameras (1).
2. The device according to claim 1, wherein several wafer-level
cameras (1) are arranged parallel adjacent to each other in the
form of a line.
3. The device according to claim 1, wherein the wafer-level cameras
(1) are arranged at the sides of a vehicle body in an integrated
manner.
4. The device according to claim 1, wherein two wafer-level cameras
(1) of a line simultaneously record an image and transfer it to the
image processing unit.
5. The device according to claim 4, wherein the distance between
two wafer-level cameras (1) is variable.
6. The device according to claim 1, wherein a display device for
depicting the overall image is provided.
7. The device according to claim 1, wherein the image processing
unit is arranged in the immediate spatial proximity to the wafer
level cameras (1) in the vehicle.
8. The device according to claim 1, wherein the device is mounted
on the vehicle, wherein the vehicle has a body, and wherein the
wafer-level cameras (1) are integrated in the sides of the vehicle
body.
Description
[0001] The invention relates to a device for monitoring an
environment of a vehicle according to the characteristics of the
preamble of claim 1.
[0002] Utility vehicles for goods or people transport are often
characterized by large vehicle dimensions and a low viewing
clarity. Modern passenger motor vehicles often also have a low
viewing clarity due to their outer design. From this, it results
that particularly a maneuvering of these vehicles is very difficult
for a driver. It is thus advantageous, to depict vehicles and their
environment from a bird's-eye view on a screen, so that the vehicle
and its entire environment are visible to the driver.
[0003] From the state of the art are known different methods and
devices for such a monitoring and depiction of an environment of a
vehicle, wherein particularly an image of the vehicle and the
environment thereof is issued to a driver of the vehicle from a
bird's eye view. A better panorama view is thereby created for the
driver, which view serves him as an assistance function or support
during the drive operation, for example when maneuvering the
vehicle. Furthermore, accidents can be avoided, which often occur
due to a bad panorama view, particularly with large vehicles and
those whose view is limited.
[0004] From the state of the art is known a monitoring device for a
vehicle, as described in DE 100 59 786 B4. A device for monitoring
an environment that cannot be viewed directly and/or for the
forward-looking monitoring of the vehicle lane comprises a camera
arranged in the front and/or rear region of the vehicle, a signal
processing device and a display device in the viewing field of the
driver, Furthermore, the device has means for transferring the at
least one camera into a protected resting position with non-use and
into at least one defined operating position in use and means for
the forward-looking monitoring of the drive lane, on which the
wheels of the vehicle roll, wherein these means comprise at least
one sensing device at the vehicle for sensing ground unevenness,
and an evaluation unit, which converts the signals of the at least
one sensing unit into display signals and/or control commands for
vehicle assemblies that can be controlled actively. The at least
one sensing device of the means for the forward-looking monitoring
of the drive lane is formed by at least one camera present for
monitoring the environment of a vehicle that cannot be viewed
directly, wherein the means cooperating with the at least one
camera for transferring the at least one camera into a protected
resting position in non-use and into at least one defined operating
position in use have a pivot device for the vertical and/or
horizontal pivoting of the at least one camera.
[0005] From EP 1 145 905 A2 is known a camera with a viewing field
control for the dead angle monitoring with motor vehicles. A prism
for the reflection of incident light from a left and right image
capturing device is arranged at a vehicle. An alignment of an image
capturing unit can be pivoted vertically and obliquely to a
horizontal plane, so that objects above or below this horizontal
plane can be captured with the image capturing unit.
[0006] A device for monitoring an environment of a movable body is
known from DE 601 01 040 T2, wherein the movable body preferably
transports persons or freight, that is, is a vehicle in particular.
The device comprises an image processor, which can be operated in
such a manner that it transforms image data captured by at least
one image capturing unit to a display of the mobile body and its
environment in a bird's eye view in such a manner that a display
unit displays an image of the body and its environment in the
bird's eye view. The displayed image can thereby also be determined
by means of a combination of a first perspective image of a first
image capturing unit and a second perspective image of a second
image capturing unit. For the transformation of the image data, a
look-up table, also known as look-up table or conversion table, is
used.
[0007] US 2008 043 113 A1 further discloses a device and a method,
by means of which individual images from a front camera and a
lateral camera, which are arranged at a front and left side of the
vehicle, are converted to overall images, which show the vehicle
and its environment from a bird's eye view. For a capturing of the
environment of the vehicle as completely as possible, the capturing
ranges of the cameras overlap, wherein the overall image shown in a
bird's eye view is formed by means of a combination of the
individual images. The conversion of the individual images to the
overall image takes place by means of data of a conversion
table.
[0008] Furthermore, a so-called WLC technology (wafer-level camera)
is known from the state of the art. With the WLC technology, the
optical lenses are placed directly on a wafer. The production of
the wafer-level cameras functions similar to applying circuits onto
a wafer. Thereby, thousands of optical lenses are simultaneously
applied onto a wafer, aligned thereafter and adhered thereto. By
means of a so-called wafer stack technology, the necessary but
cost-intensive individual assembly and alignment of the lenses with
the conventional production method is omitted. The individual
wafer-level cameras are finally cut out from the wafer and placed
on a sensor module. The big advantage of this technique are the low
costs of production Furthermore, the wafer-level cameras with a
strength of 2.5 millimeters are only approximately half the size of
the smallest conventional camera modules.
[0009] The invention is based on the object to give an improved
device for monitoring an environment of a vehicle.
[0010] This object is solved according to the invention by a device
with the characteristics of claim 1.
[0011] Preferred designs and further developments of the invention
are given in the dependent claims.
[0012] With a device for monitoring an environment of a vehicle
according to the invention, the environment is captured by means of
a plurality of image capturing units, the capture ranges thereof
overlapping at least partially and forming an overlap range,
wherein an overall image is generated from the individual images
captured by means of the image capturing units by means of an image
processing unit, which overall image shows the vehicle and the
environment thereof from a bird's-eye view. The image capturing
units are formed as wafer-level cameras according to the
invention.
[0013] The wafer-level cameras advantageously cause low production
costs. The installation space requirement of the camera is so low
that several of these wafer-level cameras can be arranged adjacent
to each other in the form of a line.
[0014] By means of a large number of installed wafer-level cameras,
a complete environment of the vehicle can conveniently be captured
without requiring complicated pivot mechanisms for an individual
camera.
[0015] An improved panorama view is thereby created for the driver,
which serves him as an assistance function or support during the
drive operation, for example when maneuvering the vehicle.
Furthermore, accidents can be avoided, which often occur due to a
bad panorama view, particularly with large vehicles and whose view
is limited.
[0016] An embodiment of the invention is explained in more detail
in the following by means of a drawing.
[0017] The only FIG. 1 thereby shows a schematic depiction of a
line of several wafer-level cameras according to the invention.
[0018] Several, particularly 10 or more wafer-level cameras 1 are
arranged in a line and integrated at the sides of a vehicle body,
not shown in detail.
[0019] By means of the large number of wafer-level cameras 1, an
environment of the vehicle, not shown in detail, is captured
completely. Dead angles in the capture are avoided thereby.
[0020] The wafer-level cameras 1 are produced by means of a
so-called WLC technology (wafer-level camera). With the WLC
technology, the optical lenses 4 are placed directly onto a wafer
5. The production of the wafer-level camera 1 functions similar to
with applying circuits onto the wafer 5. Thousands of optical
lenses are thereby applied simultaneously onto a wafer 5, aligned
thereafter and adhered thereto. By means of a so-called wafer stack
technology, the necessary but cost-intensive individual assembly
and alignment of the lenses 4 with the conventional production
method is omitted. The individual wafer-level cameras 1 are finally
cut out from the wafer and placed on a sensor module 6. The big
advantage of this technique are the low costs of production.
Furthermore, the wafer-level cameras with a strength of 2.5
millimeters are only approximately half the size of the smallest
conventional camera modules.
[0021] In order to reproduce the environment of the vehicle or at
least critical regions of this environment, which are not in the
direct viewing field of the motorist, thus in the so-called dead
angle, as completely as possible, the wafer-level cameras 1 are
arranged and aligned in such a manner that their respectively
reproduced capture ranges 2 superpose partially, that is, partial
regions of the reproduced environment of the vehicle are captured
by several cameras and form an overlap range 3.
[0022] In order to in particular ease a maneuvering of the vehicle
for the driver or to for example to enable an improved overview of
objects next or behind the vehicle at traffic light crossings, an
image processing unit, not shown in detail, generates an overall
image from individual images captured by means of the wafer-level
cameras 1, which overall image shows the vehicle and its
environment from a bird's eye view. This overall image can
preferably be issued to the driver of the vehicle on a screen.
[0023] The overall image is transferred to a display device, not
shown in detail, which is arranged in the vehicle in viewing field
of the driver. A display device of a navigation system or of a
reversing assistance system can for example be used as such a
display device.
[0024] In a further embodiment, a depicted image of the wafer-level
cameras 1 can be cross-faded with markings on the display device,
which represent dimensions of the vehicle, for example a width and
additionally also a height of the vehicle, so that the driver can
detect quickly and clearly, if his vehicle can for example pass
between obstacles or below an obstacle. In this embodiment, the
monitoring device comprises for example additionally an image
processing unit, in order to position the markings correctly
corresponding to a respectively depicted image section.
[0025] In a further development of the invention, not shown in
detail, the vehicle is depicted in the drive direction on the
display unit, wherein the driver of the vehicle can choose in a
preferred manner, in which depiction the vehicle and its
environment shall be shown to him.
[0026] In a design of the invention not shown in detail, one can
switch over, depending on the drive situation, from the depiction
of the vehicle and its environment from a bird's eye view, to a
display from another viewing angle, for example an image of a
reversing camera, so that the driver of the vehicle can evaluate
the drive situation in a better manner.
[0027] In a preferred embodiment, a stereoscopy can be used. For
this, the images of two wafer-level cameras 1 are recorded from a
line of wafer-level cameras 1 and are transferred to the image
processing unit.
[0028] With the stereoscopy, a distance between the two recording
cameras, also called base width B, is important. This base width B
is variable with a line of wafer-level cameras 1. The base width B
can simply be varied by an actuation of different wafer-level
cameras 1. Wafer-level cameras 1 lying far apart can for example
record images with a large base width B. Analogously, wafer-level
cameras 1 lying close to each other can record images with a small
base width B.
[0029] This base width adjustment advantageously functions without
an elaborate mechanics for adjusting a camera.
[0030] In a further advantageous embodiment, the wafer-level
cameras 1 of a line are equipped with optical lenses 4 having
different focal widths. Images with different focal widths can
thereby be recorded by a simple switch-over between the different
wafer-level cameras 1.
[0031] Due to the large data amount by the recorded images, it is
convenient to arrange the image processing unit in the vehicle in
the immediate spatial proximity to the wafer-level cameras 1, in
order to keep the cable number and length low. Alternatively, a
wireless data transfer between wafer-level cameras 1 and the image
processing unit is also possible.
LIST OF REFERENCE NUMERALS
[0032] 1 Wafer-level camera [0033] 2 Capture range [0034] 3 Overlap
range [0035] 4 Optical lens [0036] 5 Wafer [0037] 6 Sensor module
[0038] B Base width
* * * * *