U.S. patent application number 12/885230 was filed with the patent office on 2010-12-30 for rear view mirror with integrated video system.
This patent application is currently assigned to Digital Ally, Inc.. Invention is credited to Robert D. Haler.
Application Number | 20100328463 12/885230 |
Document ID | / |
Family ID | 46331968 |
Filed Date | 2010-12-30 |
![](/patent/app/20100328463/US20100328463A1-20101230-D00000.png)
![](/patent/app/20100328463/US20100328463A1-20101230-D00001.png)
![](/patent/app/20100328463/US20100328463A1-20101230-D00002.png)
![](/patent/app/20100328463/US20100328463A1-20101230-D00003.png)
![](/patent/app/20100328463/US20100328463A1-20101230-D00004.png)
![](/patent/app/20100328463/US20100328463A1-20101230-D00005.png)
![](/patent/app/20100328463/US20100328463A1-20101230-D00006.png)
![](/patent/app/20100328463/US20100328463A1-20101230-D00007.png)
![](/patent/app/20100328463/US20100328463A1-20101230-D00008.png)
![](/patent/app/20100328463/US20100328463A1-20101230-D00009.png)
![](/patent/app/20100328463/US20100328463A1-20101230-D00010.png)
United States Patent
Application |
20100328463 |
Kind Code |
A1 |
Haler; Robert D. |
December 30, 2010 |
REAR VIEW MIRROR WITH INTEGRATED VIDEO SYSTEM
Abstract
A vehicle-mounted system (1010) for recording video and audio.
The system (1010) uses distributed processing, including encoding
the video and audio at their source(s), and a high-speed, e.g.,
Ethernet, bus (1148) connecting the various system components and
external devices. The system (1010) may include a display monitor
(1040) which is integrated into the same housing (1020) as a rear
view mirror (170) of the vehicle, with the display monitor (1040)
being located behind the mirror (170) and video displayed on the
monitor being visible through the mirror (170).
Inventors: |
Haler; Robert D.; (Blue
Springs, MO) |
Correspondence
Address: |
Hovey Williams LLP
10801 Mastin Blvd., Suite 1000
Overland Park
KS
66210
US
|
Assignee: |
Digital Ally, Inc.
Overland Park
KS
|
Family ID: |
46331968 |
Appl. No.: |
12/885230 |
Filed: |
September 17, 2010 |
Related U.S. Patent Documents
|
|
|
|
|
|
Application
Number |
Filing Date |
Patent Number |
|
|
12189192 |
Aug 10, 2008 |
|
|
|
12885230 |
|
|
|
|
11531955 |
Sep 14, 2006 |
|
|
|
12189192 |
|
|
|
|
60955129 |
Aug 10, 2007 |
|
|
|
60717602 |
Sep 16, 2005 |
|
|
|
Current U.S.
Class: |
348/148 ;
348/E7.085 |
Current CPC
Class: |
B60R 11/04 20130101;
B60R 2001/1253 20130101; B60R 2011/0033 20130101; H04N 7/18
20130101; H04N 5/23241 20130101; H04N 5/76 20130101; G07C 5/0891
20130101; H04N 5/775 20130101; H04N 5/22525 20180801; H04N 5/225
20130101; H04N 5/772 20130101; H04N 5/781 20130101; H04N 5/765
20130101; H04N 5/907 20130101; H04N 5/2251 20130101; H04N 9/8205
20130101; H04N 5/23293 20130101; B60R 1/12 20130101 |
Class at
Publication: |
348/148 ;
348/E07.085 |
International
Class: |
H04N 7/18 20060101
H04N007/18 |
Claims
1. A video surveillance system for a vehicle, the system
comprising: a housing for mounting within the vehicle, said housing
having a rearview mirror; a first video camera mounted in or on the
housing and operable to record a first video signal; a second video
camera associated with the vehicle and operable to record a second
video signal; a central control unit mounted within the housing and
including a processor for receiving the first and second video
signals from both the first and second video cameras, and a solid
state memory for storing the first and second video signals upon
receipt of the signals by the central control unit and from the
respective first and second video cameras; a display monitor
mounted behind the rearview mirror and in the housing and
configured to receive at least one of said first and second video
signals and display viewable video indicative of said received
video signals upon activation of the display monitor; and a
location determining device for acquiring the location of the
vehicle, wherein the system is configured to associate at least
some of the video signals with a location of the vehicle when the
video signals were recorded and to mark stored video signals with
the associated location.
2. The video surveillance system of claim 1, wherein the system is
operable to implement a pre-event recording loop, such that upon
activation of a record input, the system stores in said solid-state
memory the recorded video signals from at least one of said cameras
for a pre-set period of time prior to activation of the record
input.
3. The video surveillance system as set forth in claim 1, wherein
the system is configured to electronically stamp the video signals
with an electronic watermark to indicate tampering or alteration of
the video signals.
4. The video surveillance system as set forth in claim 1, wherein
said system is configured to stream a live video signal to a remote
location from either or both of said first or second video
cameras.
5. The video surveillance system as set forth in claim 1, wherein
the system is configured to receive a password or code prior to
activation of the system.
6. The video surveillance system as set forth in claim 1, the
system including at least one software component for implementing
the functionality of the system, wherein said at least one software
component of said system is upgradeable while said system is
located in the field as during normal use of the system.
7. The video surveillance system as set forth in claim 6, wherein
an upgrade of said at least one software component is performed by
use of an external device in wireless communication with said video
system.
8. The video surveillance system as set forth in claim 1, wherein
the system is configured to verify the identity of a user prior to
allowing the user access to the system.
9. The video surveillance system as set forth in claim 8, wherein
the system receives biometric data from the user to verify the
identity of the user.
10. The video surveillance system as set forth in claim 1, wherein
each of the first and second video cameras includes a unique
identifier, and the system is configured to stamp the video signals
recorded by the respective camera with the respective unique
identifier.
11. The video surveillance system as set forth in claim 1, wherein
at least one of said video camera, central control unit, or display
monitor comprises a backup power source for operating said video
camera, central control unit, or display monitor in the event a
primary power source is lost.
Description
RELATED APPLICATIONS
[0001] The present application is a continuation of and claims
priority benefit to previously-filed U.S. application Ser. No.
12/189,192, filed Aug. 10, 2008, entitled "VEHICLE-MOUNTED VIDEO
SYSTEM WITH DISTRIBUTED PROCESSING." The '192 Application is a
non-provisional of and claims priority benefit to previously-filed
U.S. Provisional Application No. 60/955,129, filed Aug. 10, 2007,
entitled "VEHICLE-MOUNTED VIDEO SYSTEM WITH DISTRIBUTED
PROCESSING." The '192 Application is also a continuation-in-part of
and claims priority benefit to previously-filed U.S. patent
application Ser. No. 11/531,955, filed Sep. 14, 2006, entitled
"REAR VIEW MIRROR WITH INTEGRATED VIDEO SYSTEM." The '955
Application is a non-provisional of and claims priority benefit to
previously-filed U.S. Provisional Application No. 60/717,602, filed
Sep. 16, 2005, entitled "REAR VIEW MIRROR WITH INTEGRATED VIDEO
SYSTEM." The identified earlier-filed patent applications are
hereby incorporated by reference in their entirety into the present
application.
FIELD OF THE INVENTION
[0002] The present invention relates generally to vehicle-mounted
systems for recording video and audio. More particularly, the
present invention concerns such a system using distributed
processing, including encoding the video and audio at their
source(s), and a high-speed, e.g., Ethernet, bus connecting the
various system components and external devices.
BACKGROUND OF THE INVENTION
[0003] Many law enforcement vehicles include video systems for
recording and displaying activity in and around the vehicle.
Unfortunately, these systems typically consist of one or two
cameras and an independent display monitor that is difficult to
view while the vehicle is in operation. Moreover, the current
systems are expensive, bulky, and difficult to operate and
maintain. It is also difficult to find sufficient space for the
camera, recording system, and monitor in the law enforcement
vehicles, which are already heavily loaded with extra equipment. It
is possible to locate certain components, such as the recording
system, which do not need to be frequently accessed, in the trunk
of the vehicle, but this then requires long cables extending
through the vehicle to connect the recording system with the camera
and monitor. Additionally, many current systems are limited to
simply recording and displaying visual images of the activity, and
do not provide any additional information associated with the
activity.
[0004] Furthermore, current systems are designed with a single
central processor unit (CPU) which controls most or all major
functions, including encoding video received from a camera.
Unfortunately, centralized processing creates bottlenecks for both
speed and processing capabilities (depending on the CPU, encoding
video signals may require 75% the CPU's processing capability),
requires significant changes in order to add new hardware features,
and, generally, results in an inability to make changes to the
system without investing significant expense and time.
Additionally, communicating unencoded analog signals within the
vehicle to the single CPU can result in significant electrical
interference and signal degradation.
SUMMARY OF THE INVENTION
[0005] The present invention overcomes the above-identified and
other problems by providing a vehicle-mounted video and audio
recording system using distributed processing, including encoding
the video and audio at their source(s), and a high-speed, e.g.,
Ethernet, bus connecting the various system components and external
devices.
[0006] In one embodiment, the video system for a vehicle broadly
comprises a video camera mounted on the vehicle and operable to
both capture and encode video, a central control unit mounted on
the vehicle and operable to receive and decode the encoded video,
and a display monitor mounted on the vehicle and operable to
display the decoded video.
[0007] In various implementations, the video system may further
include any one or more of the following features. The video camera
may be synchronized with the central control unit so as to provide
an accurate time stamp associated with the video. The video camera
may be operable to implement a pre-event recording loop. The video
camera and central control unit may be connected by a high speed
bus. There may be two or more video cameras connected to a hub,
wherein the hub is connected to the central control unit, and the
central control unit is operable to receive the encoded video from
each of the two or more video cameras substantially simultaneously.
The system may include a microphone operable to capture and encode
audio, wherein the central control unit is operable to receive and
decode the encoded audio, a vehicle interface box mounted on the
vehicle and operable to interface an external device to the central
control unit, wherein the external device may be any one or more of
a crash sensor, a radar gun, and a speedometer, and a co-processing
module mounted on the vehicle and operable to provide processing
for an additional feature of the system, wherein the additional
feature may be any one or more of a face recognition feature, a
license plate recognition feature, a streaming video feature, and a
wireless Internet access feature.
[0008] The system may include a rear view mirror housing, a mirror
mounted in the rear view mirror housing, and the display monitor
mounted in the rear view mirror housing substantially behind the
mirror, and the mirror and the display monitor being configured so
that the displayed video is viewable through the mirror.
[0009] The system may include a location determining device
operable to determine a location of the vehicle when the video is
captured, and a recording medium operable to record at a least a
portion of the captured video and the location of the vehicle when
the video was captured.
[0010] These and other details of the present invention are
described in greater below in the section below titled DESCRIPTION
OF THE INVENTION.
BRIEF DESCRIPTION OF THE DRAWINGS
[0011] Further features of the present invention will become
apparent to those skilled in the art to which the present invention
relates from reading the following description with reference to
the accompanying drawings, in which:
[0012] FIG. 1 is a functional block diagram of a video system
according to one embodiment of the present invention;
[0013] FIG. 2 is a perspective view of a rear view mirror
constructed according to one embodiment of the present
invention;
[0014] FIG. 3 is a perspective view of a rear view mirror
constructed according to an embodiment of the present invention and
illustrating an active monitor showing the image from a forward
facing external camera mounted in close proximity to the rear view
mirror;
[0015] FIG. 4 is a perspective view of the rear view mirror of FIG.
1;
[0016] FIG. 5 is a front elevation view of the rear view mirror of
FIG. 1;
[0017] FIG. 6 is an side elevation view of the rear view mirror of
FIG. 1;
[0018] FIG. 7 is a plan view of the rear view mirror of FIG. 1;
[0019] FIG. 8 is a perspective view of a rear view mirror
constructed according to another embodiment of the present
invention;
[0020] FIG. 9 is a front elevation view of the rear view mirror of
FIG. 8;
[0021] FIG. 10 is a rear elevation view of the rear view mirror of
FIG. 8;
[0022] FIG. 11 is a block diagram of a video system according to
another embodiment of the present invention; and
[0023] FIG. 12 is a block diagram of a camera component of the
video system of FIG. 11.
DETAILED DESCRIPTION
[0024] With reference to the figures, a video system is herein
described, shown, and otherwise disclosed in accordance with a
preferred embodiment of the present invention. More specifically,
the present invention provides a vehicle-mounted video system that
is capable of recording, storing, and replaying video images,
wherein the video system includes at least one internal camera and
a display monitor, with both being integrated into the same housing
as a rear view mirror of the vehicle, and with the monitor being
located substantially behind the mirror such that video images
displayed by the monitor are visible through the mirror. The video
system may also allow for capturing audio signals and other
desirable information, including, for example, location and speed
information.
[0025] Referring to FIG. 1, an embodiment of the video system 10 is
shown broadly comprising various components mounted in or on the
rear view mirror housing 20, including an internal camera 30, a
video monitor 40, an electronics module 50, a memory 60, an
internal microphone 70, a speaker 80, input buttons 90, LED
indicators 100, input connectors 110, output connectors 120, and at
least one infrared LED 130. The system 10 may also include an
external camera 140, a GPS antenna 150, and a speed detector
160.
[0026] The internal camera 30 is typically positioned on an upper
and central portion of the mirror housing 20 so that it can capture
video images of activity within the passenger compartment of the
vehicle. Alternatively, the internal camera 30 may be hidden behind
the mirror 170. The internal camera 30 may be mounted at an
appropriate angle, such as approximately between 10 degrees and 20
degrees to the left, so that the camera 30 is able to properly view
the passenger compartment even when the mirror 170 is angled
towards the driver during normal use. Camera 30 may also be mounted
at approximately 160 degrees or greater when camera 30 is a
wide-angle camera. One appropriate camera for use as the internal
camera 30 is a 510.times.492 black and white CMOS sensor with TV
resolution, 0.01 Lux sensitivity, and a 140 degree 4-element coated
glass lens.
[0027] The external camera 140 is mounted outside of the mirror
housing 20 in a separate enclosure. The external camera 140 is
useful, for example, to record video images when an officer leaves
the vehicle, such as during a traffic stop. One appropriate camera
for use as the external camera 140 is a color CCD sensor NTSC with
768.times.484 pixels and 470 lines of resolution, a 10.times.
optical zoom and auto focus capabilities, a wide viewing angle that
is from 50.7 to 5.4 degrees, and standard and low light modes.
[0028] The monitor 40 is mounted substantially behind the mirror
170 (see FIGS. 2 and 3) and works in conjunction with the mirror
170 so that when the monitor 40 is turned on it is viewable through
the mirror 170, and when it is turned off it is not visible. The
monitor 40 may be operable to automatically turn off when the
vehicle begins to move or when the vehicle's transmission is
shifted into reverse or drive, so that the driver has full use of
the mirror 170 while the vehicle is in motion. Alternatively, the
monitor may be mounted adjacent to or only partially behind the
mirror 170. One appropriate monitor for use as the video monitor 40
is a 3.5 inch diagonal, 640.times.480 TFT LCD monitor.
[0029] The electronics module 50 includes a number of electronic
components, including components for receiving video signals from
the video cameras 30,140 and for transmitting video signals to the
monitor 40. The electronics module 50 also includes components
operable to receive and execute instructions stored in internal
memory. In one embodiment, for example, these instructions include
menu instructions for setting operational modes and resolutions,
These instructions may be updated by loading instructions into a
memory card and then inserting that card into a port in the system
10.
[0030] The input and output connectors 110,120 are connected to the
module 50 for receiving electronic signals thereto and transmitting
electronic signals therefrom. The input connectors 110 may include,
for example, a connector for power, for the output from the speed
detector 160, and for the output from the GPS antenna 150. The
input connectors 110 may also include one or more connectors for
receiving signals to trigger operation of the system. These
triggers may include, for example, turning on the vehicle's siren
and/or signal lights. The input connectors 110 may also include a
connector for receiving the output of a second external camera,
such as a rear-facing camera, and a connector for receiving the
output of a second external microphone. The input connectors 110
may also include a port, such as a USB 2.0 port, to allow for
directly accessing the memory 60 using a laptop or other computer.
The output connectors 120 may include, for example, an audio/visual
connector for transmitting audio/visual signals to an external
monitor or recording device. Additionally or alternatively, any one
or more of these physical connectors 110,120, may be replaced with
wireless communication technology allowing the system 10 to
wirelessly receive or transmit any of the aforementioned input or
outputs. In one embodiment, the input and output connectors 110,120
are provided on an interface module or block which is not located
on or integrated into the housing 20, but rather is located in a
remote location, such as under the vehicle's dash, and operatively
coupled with the module 50 by wire or wirelessly.
[0031] The module 50 may also include components for receiving
audio signals from audio sources, such as the internal microphone
70, and for transmitting audio signals to the speaker 80. The
module 50 may also include components for receiving wireless
signals from one or more remote microphones, such as a wireless
microphone worn by the officer. In this case, the module 50 may
include an integrated 900 MHz (or another suitable frequency
allowed by law), spread spectrum, dual receiver capable remote
microphone system with a nominal range of up to approximately 1000
feet or greater (a range of several miles may be achieved under the
proper conditions).
[0032] The module 50 may also include an integrated GPS receiver
connected to the GPS antenna 150. Utilizing the information
provided by these components, the module 50 may mark recorded video
with real-time position data. The system may include a "dead
reckoning" function which works with GPS to allow for operation in
shielded locations, such as underground garages.
[0033] The module 50 may also be connected to the speed detector
140, which may be a radar gun or other conventional speed detecting
device, and operable to record speed information provided by the
speed detector 140 along with the video images.
[0034] The memory 60 is in communication with the module 50 for
receiving and storing the video, audio, and other data. One
appropriate form of electronic memory for use as the memory 60 is a
CF card form factor removable memory module, and one appropriate
format for storing the data is MPEG 4 format. Other appropriate
forms of electronic memory for use as the memory 60 include micro
hard drives, laptop-type hard drives, and flash memory cards. As
will be understood by those in the field, the amount of data
storable in the memory 60 is dependent, at least in part, on the
resolution utilized by the electronics module 50. It is
contemplated, however, that the memory 60 may store approximately
one hour of data per gigabyte of memory per simultaneous camera for
high resolution, approximately two hours of data per gigabyte of
memory per simultaneous camera for medium resolution, and
approximately four hours of data per gigabyte of memory per
simultaneous camera for low resolution.
[0035] Referring also to FIGS. 2-7, the input buttons 90 are
mounted on the video housing 20 and allow for controlling various
components and functions of the system 10. In one embodiment, these
buttons 90 may include and operate as follows. A REC button 180
triggers recording in the mode shown in a menu displayed on the
monitor 40. Pressing the REC button 180 during recording allows for
cycling through the various night and day camera settings. Day and
night recording modes may be set automatically using information
from an on-board real-time clock or from a light sensor or from the
camera 30. A red indicator LED 100 on the front of the unit and a
red record LED on the back of the unit are both turned on when the
system is recording. A MARK button 190 sets a place for the current
GPS position in the video data. A DISP button 200 toggles through
settings such as Video Monitor and Control illumination/indicators
ON, Video Monitor OFF, Control illumination/indicators ON, and
Video Monitor and Control illumination OFF. A Menu button 210
toggles the menu display on the monitor 40 and turns the monitor 40
ON if the display is OFF. A "Play" (large right-facing arrow)
button 220 executes commands in Menu Mode and toggles Play/Pause in
video playback mode. A "Stop" (square) button 230 acts to cancel
the current function in Menu Mode, stops video in Playback Mode,
and toggles pre-set Zoom positions in Record Mode. A REV/DOWN
button 240 zooms the camera 30 towards Wide in Record Mode, moves
down in Menu Mode, and moves in reverse in Playback Mode. A FWD/UP
button 250 zooms the camera 40 towards TELE in Record Mode, moves
up in Menu Mode, and moves forward in Playback Mode. Other buttons
may include an auto zoom feature to assist in reading license
plates on other vehicles.
[0036] The at least one infrared LED 130 is disposed in the mirror
housing 20 and operable to provide infrared illumination inside the
vehicle's passenger compartment so that the internal camera 30 can
capture video images even when there is little visible light.
[0037] Power is supplied to the components of the video system 10
from the vehicle. The power provided is heavily filtered and
regulated to avoid interference. The video system 10, using the
particular components described herein, may require 4 amps from a
10 V to 13.8 V DC power supply.
[0038] The rear view mirror includes the mirror 170 mounted within
the housing 20. One appropriate mirror 170 is constructed of mirror
glass. One appropriate housing for use as the housing 20 is
constructed of a polycarbonate plastic that is resistant to high
impacts and high temperatures and is approximately between 12
inches and 14 inches long, 3 inches and 4 inches high, and 0.5
inches and 1.5 inches deep. The vehicle's conventional rear view
mirror mount may be replaced by a stronger mount better able to
support the weight of the mirror 170 and housing 20 and other
components of the system 10. The input buttons 90, discussed above,
may be mounted on a front or side surface of the housing 20. The
mirror housing 20, and the housings of other components of the
system, may include materials operable to shield against electrical
or radio interference.
[0039] Additionally, the system 10 may be provided with a "stealth"
mode in which the cameras 30,140 and the microphone 70 are active
and recording, but the lights and indicators, such as the LED 100,
are turned off, thereby making the system 10 appear to be
dormant.
[0040] Additionally, the system 10 may provide "pre-event"
recording in which the system 10 records constantly in a loop of a
selected duration of time, such as thirty seconds or sixty seconds,
so that when an event triggers recording, the events occurring
shortly prior to the initiation of recording are also recorded and
stored.
[0041] Additionally, various embodiments of the system 10 include
any one or more of the following features. The system 10 requires
entry of a password or code prior to accessing and changing
operational settings. The system 10 requires use of a key to remove
any removable memory components. The system 10 incorporates
electronic watermarks into the recorded video images to prevent
tampering or alteration. The system 10 allows for wirelessly
downloading the contents of the memory 60 to a laptop or other
computer. The system 10 allows for streaming the live video from
the cameras 30,140, and possibly other inputs and/or outputs, via a
high-speed wireless data network. The system 10 is operable to
encode multiple video streams from four or more cameras
simultaneously. The system 10 includes a remote control device for
allowing a user to remotely control the operation of the system 10.
The system 10 includes a temperature sensor and temperature
indicator operable to detect and warn the user if the system 10 is
at risk of malfunction or damage due to an ambient temperature that
is too high or too low for proper operation, such as may easily
occur in a vehicle on a very hot or very cold day. The housing 20,
and possibly the housings of other components of the system 10, is
vented to dissipate heat, and may include other passive or active
features to moderate temperature, especially in relatively extreme
environments.
[0042] Referring also to FIGS. 8-10, a second implementation of the
system 10 is shown which is somewhat different in appearance than
the implementation shown in FIGS. 2-7, particularly with regard to
the housing 220 and the layout of certain components thereabout,
but which is otherwise substantially similar in functionality.
[0043] It will now be apparent that the present invention is both
inexpensive to manufacture and easy to use, especially when
compared to current vehicle video systems. The video system of the
present invention is fully integrated into a small, easily
installable and replaceable package that requires minimal space
inside the vehicle. Thus, it replaces several single-purpose
devices with a multifunction device that requires the same or less
space in the vehicle. Moreover, the video system includes novel
features and/or capabilities not present in currently available
systems. Those skilled in the art will perceive additional
significant improvements, changes, and modifications.
[0044] Referring also to FIG. 11, another embodiment of the
above-described system is shown which uses distributed processing,
including encoding the video and audio at their source(s) rather
than at a centralized location, and a high-speed, e.g., Ethernet,
bus connecting the system components and various external
devices.
[0045] In one implementation, the system 1010 broadly comprises the
rear view mirror housing 1020, a central control unit 1012, the
internal camera 1030, the display monitor 1040, the input buttons
1090, one or more of the external cameras 1140, one or more
external microphones 1142, a vehicle interface box 1144, one or
more co-processing modules 1146, and the high-speed bus 1148.
[0046] In this implementation, the central control unit 1012 does
not itself encode the video and audio generated by the external
camera 1140 and microphone 1142, but rather receives the signals
already encoded. As such, the central control unit 1012 includes a
decoder for decoding the encoded video and audio to allow for
communication via the display monitor 1040 and an associated
speaker.
[0047] The one or more external cameras 1140 are each operable to
both capture video and encode the video before transmitting it to
the central control unit 1012 for display and storage. Because
encoding can account for 75% of the processing workload in prior
art systems, encoding the video at the camera 1140 rather than at
the CPU of the central control unit 1012 advantageously allows the
central control unit 1012 to support multiple external cameras
simultaneously.
[0048] Generally, existing IP ("Internet protocol") cameras are
unsuitable for use in the present system 1010 because they have a
tendency to lose frames, which is not acceptable for law
enforcement applications in which the video might be used as
evidence, and because they have relatively narrow bandwidths, which
is also problematic for law enforcement applications in which
activity often takes place under extreme lighting conditions, e.g.,
bright streetlights and dark shadows. However, referring also to
FIG. 12, with significant modification, a camera potentially
suitable for use as the external camera 1140 in the system 1010 is
the IP Reference Camera available from Nuvation Research
Corporation. This particular camera includes its own onboard CPU
1160 for encoding video and audio, can be upgraded to high
definition (HD) by changing the CPU, and includes an Ethernet port
1162. The IP Reference Camera is significantly less likely to lose
frames and has a significantly larger bandwidth than other IP
cameras. Nevertheless, as mentioned, the IP Reference Camera still
requires significant modification for use in the present system
1010. For example, it is necessary to synchronize the CPU of the
central control unit 1012 with the CPUs 1160 of the cameras 1140 in
order to obtain an accurate time stamp. Also, the pre-event
recording loop, described above, is, in this embodiment,
implemented on the camera 1140.
[0049] In one implementation of the present system, a camera used
in conjunction with the present system, such as the Nuvation
Research Corporation IP Reference Camera described above, includes
a storage component such that captured frames are stored in the
camera in addition to being sent to central control unit 1012.
These stored frames are also time-stamped during the normal course
of operation of the present system. Thus, in the event any frames
are lost during transmission from the camera to central control
unit 1012, central control unit 1012 is able to request that the
camera transmit the lost frames again. Once the lost frames are
received, central control unit 1012 can integrate the lost frames
into the data already received so that a complete record is formed.
Time synchronization between the camera and central control unit
1012 ensures that central control unit 1012 is able to accurately
identify missing frames, query the camera for those frames, and
properly integrate the missing frames into the record once they are
received.
[0050] The one or more external microphones 1142 are also each
operable to both capture audio and encode the audio before
transmitting it to the central control unit 1012 for play or
storage, thereby advantageously allowing the central control unit
1012 to support multiple external microphones simultaneously.
[0051] The vehicle interface box 1144 is operable to interface
various external devices to the system 1010. The external devices
may include, for example, any one or more of a crash sensor, a
radar gun, and a speedometer.
[0052] The one or more co-processing modules 1146 are each operable
to provide processing for various additional features to the system
1010. The additional features may include, for example, any one or
more of a face recognition feature, a streaming video feature, and
a wireless Internet access feature. Further, wireless access may be
provided for other networks, such as wireless mesh, that are not
associated with the internet in any way.
[0053] The high-speed bus 1148 is operable to connect and allow for
communication between the various other components of the system
1010. In one implementation, the bus is an Ethernet bus carrying
power and data on the same cable. In one implementation,
components, such as the cameras 1140 and microphones 1142 spaced
apart from the central processing unit 1012, are connected to a hub
1064, and the hub 1064 is connected to the central processing unit
1012 by a single cable. In other implementations of the present
system, other methods of communication between the various
components of the present system may be used. Such other methods
may include, for example, wireless communications, or combinations
of wireless and wired communications. Further, although the
implementation of the present system shown in the drawings utilize
Power Over Ethernet (POE) in order to provide power to components
of the present system, it is contemplated that any suitable method
of providing such power may be utilized, and that numerous methods
of providing power are known to those of skill in the art. It is
further contemplated that a backup power source, such as a batter
backup, may be used in conjunction with the present system.
[0054] It will now be apparent that, along with the
earlier-discussed advantages of the first embodiment of the system,
the second embodiment provides a number of additional advantages
over prior art systems. For example, each external camera and
microphone encodes its own video and audio, and therefore, the
central control unit can support multiple cameras and microphones
simultaneously, the cameras and microphones can be located much
further away from the central control housing (which is important
in larger vehicles) because encoded digital signals are less
susceptible to the electrical interference and signal degradation
experienced by unencoded analog signals, and the cameras and
microphones can be easily added or replaced without requiring
significant changes to the central control unit. Additionally, the
high-speed bus carries both data and power to system and external
components on the same cable, thereby eliminating the plurality of
separate cables for power, video, audio, and communication required
by prior art systems. Bus hubs allow for collecting and
communicating data streams from multiple cameras, microphones, and
other devices over a single cable, thereby eliminating the need to
provide a long cable for each device. Bus connectivity and standard
communication protocols allow for quickly adding features using
plug-in modules. More generally, changes to the system can be
accomplished with significantly less expense and time, allowing the
system to adapt to user demands and extending the system's useful
life.
[0055] Although various exemplary data formats and data transfer
protocols are identified above, it is contemplated that any
suitable format or protocol, whether now existing or hereafter
developed, may be used in conjunction with the present invention.
The discussion of specific formats or protocols herein is not
intended to limit the scope of the present invention. For example,
although the MPEG-4 format is mentioned above for encoding and
storing audiovisual data obtained by the present system, it is
contemplated that other formats such as, for example, H.263 and
H.264, may also be used. Likewise, audiovisual data may be stored
in high-definition (HD) format. Hardware or software changes or
upgrades may be required in order to change formats, however the
inventive functionality of the present system, as described herein,
is preserved regardless of the specific format used. Because one
goal of law enforcement implementations of the present system is to
produce an evidentiary record, it is preferred that a lossless
format be used in those implementations.
[0056] In addition to various suitable formats that may be used in
conjunction with the present system, it is contemplated that any
suitable data transfer protocol may be used. For example, real-time
streaming protocol (RTSP) may be used to transfer data in the
present system providing that the system is adapted to recover any
lost frames from the camera. User datagram protocol (UDP) provides
a better, lossless protocol for use with the present system. Any
suitable existing protocol may be used, and new protocols may be
developed for use with the present system. Because implementations
of the present system include a data storage function in the
camera, as described above, for retrieval of frames lost during
data transfer, it is contemplated that typical IP cameras having
such a storage feature may be used, with the system ensuring that
lost frames are faithfully transmitted to central control unit 1012
when requested therefrom.
[0057] As noted above, the present system may be used with a
variety of software, audiovisual formats, data transfer protocols,
and the like. In some instances, changes to formats or protocols,
or even making hardware changes such as upgrading the system to a
HD-capable camera, may require that the software of the present
system be updated. In some implementations of the present system,
it is contemplated that the system software will be capable of
being upgraded in the field. In such implementations, software
upgrades may be provided via a memory card, portable flash memory
device, a wireless data link to a portable devices, a wireless
internet data link, or any other suitable device or method for
upgrading the system software in the field. In some implementations
wherein wireless communications are used for system upgrades, it is
contemplated that the present system may optionally include a
wireless communications component adapted to connect to a remote
source for obtaining updates automatically. Such communications
could, for example, be carried out over the internet via a cellular
communications signal that allows the present system to access the
internet.
[0058] In addition to what has been described above, various
peripheral devices may be utilized in conjunction with the present
invention. In law enforcement implementations of the present
system, for example, or in other implementations where security is
important, the present system may be provided with a biometric
identification component or other secure identification component.
In an implementation of the present system requiring biometric
identification, for example, a fingerprint may be required before a
user of the present system can log into the system and begin to use
the system. Other security peripherals include, for example, a
dongle carried by a user of the present system that can be
presented to the system in order to verify the identity of a user.
Any suitable security component or method may be included with the
present invention.
[0059] In addition to maintaining or verifying user security, the
present system may also include additional components to establish
the security and evidentiary value of the audiovisual data recorded
thereby. For example, it is contemplated that the cameras 1140
associated with the present system include a unique identifier,
such as a serial number or other identifier that is unalterable,
and that audiovisual signals obtained by any given camera are
stamped with that camera's identifier. Thus, the identity of the
camera that acquired any given data is verified and secured along
with the actual data recorded by the system.
[0060] It is further contemplated that a CD or DVD burner may be
provided as a component of the present system so that a user of the
system can make a copy of captured audiovisual data while in the
field. Any suitable recording device and medium known in the art
may be used in association with the present invention.
[0061] Peripheral devices used for interfacing with the present
system may also be provided. For example, a keyboard may be
provided, the keyboard adapted to plug directly into the present
system or to communicate wirelessly with the present system via
Bluetooth, infrared, or other suitable method of wireless
communication. Further, it is contemplated that a PDA, laptop,
smartphone, or other mobile device may be adapted (for example by
installing software thereon) for communication with and
manipulation of the present system. Such devices may be used to
manipulate a display associated with the present system, or to
configure or control the present system.
[0062] With respect to any of the various peripherals that may be
associated with the present system, whether described herein or
not, it is contemplated that the peripherals may be plugged into or
otherwise associated with electronics module 50 or central control
unit 1012, or that any of cameras 1140 may be adapted to
communicate with the peripherals, either through a hard-wired or
wireless connection.
[0063] Although the invention has been disclosed with reference to
various particular embodiments, it is understood that equivalents
may be employed and substitutions made herein without departing
from the contemplated scope of the invention. For example, specific
suitable hardware, processors, software, and the like as described
above is exemplary and not intended to limit the present invention.
Any suitable hardware may be used to implement the inventive
functionality of the present system.
[0064] Having thus described the invention, what is claimed as new
and desirable to be protected by Letters Patent includes the
following:
* * * * *