U.S. patent application number 15/546717 was filed with the patent office on 2018-09-27 for system for monitoring event related data.
This patent application is currently assigned to NEC Corporation. The applicant listed for this patent is NEC Corporation. Invention is credited to Takeshi ARIKUMA, Masahiro TANI.
Application Number | 20180276983 15/546717 |
Document ID | / |
Family ID | 56692171 |
Filed Date | 2018-09-27 |
United States Patent
Application |
20180276983 |
Kind Code |
A1 |
TANI; Masahiro ; et
al. |
September 27, 2018 |
SYSTEM FOR MONITORING EVENT RELATED DATA
Abstract
A system for monitoring event related data including a sensor
data analyzer, an event analyzer and an actuator is disclosed. The
sensor data analyzer detects events based on sensor data, the event
analyzer couples to the sensor data analyzer and estimates the size
of the detected entire events based on event related data of the
detected events from the sensor data analyzer, and the actuator
couples to the sensor data analyzer and the event analyzer and
actuates a predetermined device based on the estimated size of the
detected entire events.
Inventors: |
TANI; Masahiro; (Singapore,
SG) ; ARIKUMA; Takeshi; (Tokyo, JP) |
|
Applicant: |
Name |
City |
State |
Country |
Type |
NEC Corporation |
Minato-ku, Tokyo |
|
JP |
|
|
Assignee: |
NEC Corporation
Minato-ku, Tokyo
JP
|
Family ID: |
56692171 |
Appl. No.: |
15/546717 |
Filed: |
February 16, 2016 |
PCT Filed: |
February 16, 2016 |
PCT NO: |
PCT/JP2016/000783 |
371 Date: |
July 27, 2017 |
Current U.S.
Class: |
1/1 |
Current CPC
Class: |
G08B 13/19643 20130101;
H04N 7/188 20130101; G08B 13/19 20130101; G08B 13/19697 20130101;
G08B 25/006 20130101; G08B 17/125 20130101; G08B 29/188
20130101 |
International
Class: |
G08B 29/18 20060101
G08B029/18; H04N 7/18 20060101 H04N007/18; G08B 13/196 20060101
G08B013/196; G08B 25/00 20060101 G08B025/00; G08B 13/19 20060101
G08B013/19 |
Foreign Application Data
Date |
Code |
Application Number |
Feb 17, 2015 |
SG |
10201501222X |
Claims
1. A system for monitoring an event related data comprising: a
sensor data analyzer for detecting events based on sensor data; an
event analyzer coupled to the sensor data analyzer for estimating
the size of the detected entire events based on event related data
of the detected events from the sensor data analyzer; and an
actuator coupled to the sensor data analyzer and the event analyzer
for actuating a predetermined device based on the estimated size of
the detected entire events.
2. The system according to claim 1, wherein the predetermined
device is a camera and the actuator actuates the camera so that
imaging range of the camera is adjusted based on the event related
data and the estimated size of the detected entire events.
3. The system according to claim 1, wherein the predetermined
device is a display and the actuator actuates the display so that
the display shows location and size of the detected entire events
on a map based on the event related data and the estimated size of
the detected entire events.
4. The system according to claim 1, wherein the predetermined
device is an alarm notification system and the actuator actuates
the alarm notification system so that the system selects a
notification destination based on the estimated size of the
detected entire events.
5. The system according to claim 1, wherein the sensor is a
microphone for sensing acoustic sound of the events.
6. The system according to claim 1, wherein the sensor is an odor
sensor for sensing odor related to the events.
7. The system according to claim 1, wherein the sensor is an
infrared sensor for sensing infrared light radiating from objects
related to the events.
8. The system according to claim 2, wherein the event analyzer
estimates the size of the event by calculating both right and left
maximum angles to the direction of the camera.
9. The system according to claim 8, wherein the actuator controls
the camera by comparing the current setting of the camera with the
estimated size of the event consisting of the maximum angles.
10. The system according to claim 1, further comprising sensing
device information, wherein the event analyzer further estimates
the size of the detected entire events based on the sensing device
information.
11. A method for monitoring event related data comprising:
detecting events based on sensor data by a sensor data analyzer;
estimating the size of the detected entire events based on event
related data of the detected events; and actuating a predetermined
device based on the estimated size of the detected entire
events.
12. The method according to claim 11, wherein the actuating
comprises actuating a camera so that imaging range of the camera is
adjusted based on the event related data and the estimated size of
the detected entire events.
13. The method according to claim 11, wherein the actuating
comprises actuating a display so that the display shows location
and size of the detected entire events on a map based on the event
related data and the estimated size of the detected entire
events.
14. The method according to claim 11, wherein the actuating
comprises actuating an alarm notification system so that the alarm
notification system selects a notification destination based on the
estimated size of the detected entire events.
15. The method according to claim 11, wherein the detecting
comprises detecting events based on acoustic sounds of the events
by a microphone.
16. The method according to claim 11, wherein the detecting
comprises detecting events based on odor related to the event by an
odor sensor.
17. The method according to claim 11, wherein the detecting
comprises detecting events based on infrared light radiating from
objects related to the events by an infrared sensor.
18. The method according to claim 12, wherein the estimating
comprises estimating the size of the event by calculating both
right and left maximum angles to the direction of the camera.
19. The method according to claim 18, wherein the actuating
comprises actuating the camera by comparing the current setting of
the camera with the estimated size of the event consisting of the
maximum angles.
20. The method according to claim 11, wherein the estimating
comprises estimating the size of the detected entire events based
on the sensing device information.
21. (canceled)
Description
TECHNICAL FIELD
[0001] The invention relates to a surveillance system. More
specifically, the invention relates to a system for monitoring
event related data.
BACKGROUND ART
[0002] Surveillance systems such as video surveillance systems have
been used in several areas for routine surveillance and for event
detection. Abnormal events such as terrorism, riot, theft,
fighting, fire, car accidents, etc. are meant to be captured by
such surveillance systems.
[0003] However, in some situations, a surveillance camera cannot
capture abnormal events within the surveillance area at an
appropriate size to adequately cover the abnormal event. Therefore,
users, including security officers and police officers, are not
able to understand an incident appropriately because a surveillance
camera captures only a part of the whole of the event.
[0004] Thus, what is needed and an object of the disclosure is to
provide an improved surveillance system that captures abnormal
events within a surveillance area at a size appropriate to the
abnormal event. Furthermore, other desirable features and
characteristics will become apparent from the subsequent detailed
description and the appended claims, taken in conjunction with the
accompanying drawings and this background of the disclosure.
SUMMARY OF INVENTION
[0005] In a first aspect of the present invention, a system for
monitoring event related data including a sensor data analyzer, an
event analyzer and an actuator is disclosed. The sensor data
analyzer detects events based on sensor data. The event analyzer is
coupled to the sensor data analyzer and estimates the size of the
entire detected events based on event related data of the detected
events from the sensor data analyzer. The actuator is coupled to
the sensor data analyzer and the event analyzer and actuates a
predetermined device based on the estimated size of the entire
detected events.
[0006] In a second aspect of the present invention, a method for
monitoring event related data is disclosed. The method includes
detecting events based on sensor data; estimating the size of the
entire detected events based on event related data of the detected
events; and actuating a predetermined device based on the estimated
size of the entire detected events.
[0007] In addition, the object is also achieved by a computer
program that achieves the method for monitoring event related data
having the above-described configurations with a computer, and a
computer-readable recording medium that stores the computer
program.
BRIEF DESCRIPTION OF DRAWINGS
[0008] The accompanying figures, where like reference numerals
refer to identical or functionally similar elements throughout the
separate views and which together with the detailed description
below are incorporated in and form part of the specification, serve
to illustrate various embodiments and to explain various principles
and advantages in accordance with the present embodiment.
[0009] FIG. 1 depicts a block diagram of a video surveillance
system in accordance with a first exemplary embodiment.
[0010] FIG. 2 depicts an example of imaging range adjustment based
on sound (zoom-out) in accordance with the first exemplary
embodiment.
[0011] FIG. 3 illustrates an example of imaging range adjustment
based on sound (zoom-in and controlling the direction of the
camera) in accordance with the first exemplary embodiment.
[0012] FIG. 4 depicts an example of imaging range adjustment based
on the type of sound event (zooming-out) in accordance with the
first exemplary embodiment.
[0013] FIG. 5 depicts an example of imaging range adjustment using
an odor sensor and infrared sensor (zooming-out) in accordance with
the first exemplary embodiment.
[0014] FIG. 6 depicts a flowchart of a method of monitoring event
related data in accordance with the first exemplary embodiment.
[0015] FIG. 7 depicts a display showing the estimated size of the
detected entire events on a map in accordance with the first
exemplary embodiment.
[0016] FIG. 8 depicts a look-up table for alarm notification system
in accordance with the first exemplary embodiment.
[0017] FIG. 9 depicts a block diagram of a system in accordance
with a second exemplary embodiment.
[0018] FIG. 10 depicts a computer system for implementing a method
of monitoring event related data in accordance with the first and
the second exemplary embodiment.
[0019] Skilled artisans will appreciate that elements in the
figures are illustrated for simplicity and clarity and have not
necessarily been depicted to scale. For example, the dimensions of
some of the elements in the simulation visualization or steps in
the flowcharts may be exaggerated in respect to other elements to
help improve understanding of the present embodiment.
DESCRIPTION OF EMBODIMENTS
[0020] The following detailed description is merely exemplary in
nature and is not intended to limit the invention or the
application and uses of the invention. Furthermore, there is no
intention to be bound by any theory presented in the preceding
background of the invention or the following detailed description.
It is the intent of the following embodiments to present an
improved method for monitoring event related data.
First Exemplary Embodiment
[0021] FIG. 1 depicts a block diagram of a video surveillance
system 100 in accordance with a present embodiment. The video
surveillance system 100 includes a sensor data analysis part 104,
an event size estimation part 108 and a camera control part 110.
The sensor data analysis part 104 receives sensor data 102 captured
by sensing device(s), and detects an abnormal event with related
information, including the detected time, within a surveillance
area. The event size estimation part 108 is coupled to the sensor
data analysis part 104 and estimates the size of the entire
detected event using a time series of the detected event and
sensing device information, including the device location stored
within a sensing device information database 106. The camera
control part 110 controls the surveillance camera (e.g. zooming-in,
zooming-out, changing the direction of the camera) based on the
estimated size of the entire detected event. Alternatively, a
display 112 may show information based on the estimated size of the
entire detected event. Also, an alarm notification system 114 may
send alarm to a predetermined destination based on the estimated
size of the entire detected event. In an example, the system 100
may include one or more of the following predetermined device: a
camera control part 110, a display 112 and an alarm notification
system 114.
[0022] The event size estimation part 108 advantageously estimates
the appropriate size of entire detected events. And then, an
actuator actuates a predetermined sensing device to facilitate
understanding of the situation. In one example, the surveillance
camera captures the whole event and facilitates security officers
to understand the situation quickly. Alternatively, a display
device shows the estimated size of entire detected events on a map
to assist security officers to understand the situation quickly.
Users may customize the predetermined device to actuate in a
predetermined manner in response to detection of predetermined
situations.
[0023] Also, the size estimation of entire detected events is based
on the type of events detected by the sensor data analysis part
104. For example, if the type of detected event is an explosion,
the size of the entire detected event is considered large. Thus, an
actuator actuates a predetermined device taking into account the
large size of the entire detected event. Therefore, users,
including security officers and police officers, are able to
understand an incident appropriately since a surveillance camera or
other devices are adjusted automatically based on the size of the
incident (abnormal event) to capture the whole of the event. The
present embodiment enables the users to deal with the incident
quickly and properly. The users may customize the size of the event
corresponding to the type of event. The users are also able to
investigate the incident using the appropriate video footage after
the incident.
[0024] FIG. 2 depicts an imaging range adjustment based on sound
(zoom-out) 200 in accordance with a present embodiment. Timeline
202 shows 4 steps (A to D) for the imaging range adjustment 200. At
step A, Field of View 206 of a camera and microphone array 208 is
set at an initial imaging range 204. At step B, the camera and
microphone array 208 captures sounds of breaking glass 210 from a
direction of arrival 212. At step C, the camera and microphone
array 208 further captures sounds of shouting 214 from a direction
of arrival 216. At step D, the event size estimation part 108
estimates the size of the event by calculating both right and left
maximum angles for Field of View within the direction of the camera
in the camera and microphone array 208 and within a predetermined
time width. Then, the camera control part 110 controls the camera
in the camera and microphone array 208 by comparing the current
setting of the camera with the estimated size of the event
consisting of the maximum angles and Field of View 206 of the
camera and microphone array 208 to cause the camera and microphone
array 208 to zoom-out to adjusted imaging range 218.
[0025] FIG. 3 depicts an imaging range adjustment based on sound
(zoom-in and controlling the direction of the camera) 300. Timeline
302 shows three steps (A to C) for the imaging range adjustment
300. At step A, a Field of View 306 of a camera and microphone
array 308 is set at an initial adjustment range 304. At step B, the
camera and microphone array 308 captures sounds of fighting 310
from a direction of arrival 312. At step C, the event size
estimation part 108 estimates the size of the event by calculating
both right and left maximum angles for Field of View within the
direction of the camera and microphone array 308 and within a
predetermined time width. Then, the camera control part 110
controls the camera and microphone array 308 by comparing the
current setting of the camera with the estimated size of the event
consisting of the maximum angles to cause the camera and microphone
array 308 to control the direction and Field of View of the camera
to rotate and zoom-in to an adjusted imaging range 314.
[0026] FIG. 4 depicts an imaging range adjustment based on the type
of sound event (zoom-out) 400. Timeline 402 shows three steps (A to
C) for the imaging range adjustment 400. At step A, a Field of View
406 of a camera and microphone array 408 is set at an initial
adjustment range 404. At step B, the camera and microphone array
408 captures a sound of an explosion 410 from a direction of
arrival 412. At step C, the event size estimation part 108
estimates the size of the event by the type of event (e.g. when the
sensor data analysis part 104 detects a large-scale event like the
explosion 410, the event size estimation part 108 decides the size
of the event is "Large"). Then, the camera control part 110
controls the surveillance camera 408 in response to the received
size of the event. When the size is "Large", the camera control
part 110 zooms out the camera to a predetermined setting (the
widest setting). Then, the camera control part 110 controls the
direction and Field of View of camera 408 to zoom-out to adjusted
imaging range 414. When the sensor data analysis part 104 detects a
small-scale event like the theft, the event size estimation part
108 can decide the size of the event is "Small". Also, when the
sensor data analysis part 104 detects a medium-scale event like the
fire, the event size estimation part 108 can decide the size of the
event is "Medium".
[0027] FIG. 5 depicts an imaging range adjustment using an odor
sensor and infrared sensor (zoom-out) 500. Timeline 502 shows four
steps (A to D) for the imaging range adjustment 500. At step A, a
Field of View 508 of a camera and microphone array 512 is set at an
initial adjustment range 510. The sensor data analysis part 104 may
receive sensor data captured by any sensing device, such as an odor
sensor 504 and an infrared sensor 506, to detect abnormal
events.
[0028] At step B, an abnormal odor 514 is detected at the odor
sensor 504 within a detected time. At step C, an unusual crowd 516
is detected at the infrared sensor 506. At step D, the event size
estimation part 108 estimates the size of the event by calculating
both right and left maximum angles for Field of View within the
direction of the camera and within a predetermined time width using
the sensor's location information. Then, the camera control part
110 controls the surveillance camera by comparing the current
setting of the camera with the estimated size of the event
consisting of the maximum angles. The camera control part 110 then
controls the camera and microphone array 512 to zoom-out to an
adjusted imaging range 518.
[0029] FIG. 6 depicts a flowchart 600 of a method for monitoring
event related data in accordance with a present embodiment. A
sensor data analyzer detects events based on sensor data (S602).
Based on the event related data of the detected events, the size of
the detected entire events is estimated (S604). Then, a
predetermined device is actuated based on the estimated size of the
detected entire events (S606).
[0030] FIG. 7 depicts a display 700 showing the size of the
detected entire events on a map in accordance with a present
embodiment. In the present embodiment, sounds of breaking glass 702
are detected by a sensor, such as a microphone. Next, crowds 704
are detected by a sensor, such as an infrared sensor. After that
sounds of fighting 706 are detected by a sensor such as a
microphone. Based on these event related data, the geographical
size of the detected entire events 708 is estimated by the event
size estimation part 108. A display 700 may be actuated to show the
estimated size of the detected entire events on a map.
[0031] FIG. 8 depicts a look-up table 800 for alarm notification
system 114 in accordance with a present embodiment. In the present
embodiment, an event or a plurality of events are detected by one
or more sensors. Based on the event related data from the sensors,
the size of the detected entire events is estimated by the event
size estimation part. The actuator actuates an alarm notification
system 114 so that the alarm notification system 114 selects a
notification destination based on the estimated size of the
detected entire events. For example, if the estimated size of the
detected entire events is `Small`, the alarm notification system
114 refers to a look-up table 800 and selects `Police` as a
notification destination. Then, the alarm notification system 114
sends alarm to `Police`. Alternatively, if the estimated size of
the detected entire events is `Medium` or `Large`, the alarm
notification system 114 selects `Fire and Ambulance Service
Division` or `Counter-Terrorism Action Group` as a notification
destination based on the look-up table 800. Users may customize the
notification destination and size of the detected entire events in
the look-up table 800.
Second Exemplary Embodiment
[0032] FIG. 9 depicts a block diagram of a system 850 in accordance
with the second exemplary embodiment. The system 850 includes a
sensor data analyzer 860, an event analyzer 870 and an actuator
880. The sensor data analyzer 860 detects events based on sensor
data. The event analyzer 870 is coupled to the sensor data analyzer
860 and estimates the size of the detected entire events based on
event related data of the detected events from the sensor data
analyzer 860. The actuator 880 is coupled to the sensor data
analyzer 860 and the event analyzer 870 and actuates a
predetermined device based on the estimated size of the detected
entire events.
[0033] The sensor data analyzer 860 includes the sensor data
analysis part 104 of the first exemplary embodiment. The event
analyzer 870 and the actuator 880 include the event size estimation
part 108 of the first exemplary embodiment.
[0034] By the above-described configuration, according to the
second exemplary embodiment, the improved system that can capture
abnormal events within a surveillance area at a size appropriate to
the abnormal event can be provided.
[0035] The method and system of the described exemplary embodiments
can be implemented on a computer system 900, schematically shown in
FIG. 10. It may be implemented as software, such as a computer
program being executed within the computer system 900, and
instructing the computer system 900 to conduct the method of the
example embodiments.
[0036] Some portions of the description which follows are
explicitly or implicitly presented in terms of algorithms and
functional or symbolic representations of operations on data within
a computer memory. These algorithmic descriptions and functional or
symbolic representations are the means used by those skilled in the
data processing arts to convey most effectively the substance of
their work to others skilled in the art. An algorithm is here, and
generally, conceived to be a self-consistent sequence of steps
leading to a desired result. The steps are those requiring physical
manipulations of physical quantities, such as electrical, magnetic
or optical signals capable of being stored, transferred, combined,
compared, and otherwise manipulated.
[0037] Unless specifically stated otherwise, and as apparent from
the following, it will be appreciated that throughout the present
specification, discussions utilizing terms such as "scanning",
"calculating", "determining", "replacing", "generating",
"initializing", "outputting", or the like, refer to the action and
processes of a computer system, or similar electronic device, that
manipulates and transforms data represented as physical quantities
within the computer system into other data similarly represented as
physical quantities within the computer system or other information
storage, transmission or display devices.
[0038] The present specification also discloses apparatus for
performing the operations of the methods. Such apparatus may be
specially constructed for the required purposes, or may comprise a
general purpose computer or other device selectively activated or
reconfigured by a computer program stored in the computer. The
algorithms and displays presented herein are not inherently related
to any particular computer or other apparatus. Various general
purpose machines may be used with programs in accordance with the
teachings herein. Alternatively, the construction of more
specialized apparatus to perform the required method steps may be
appropriate. The structure of a conventional general purpose
computer will appear from the description below.
[0039] In addition, the present specification also implicitly
discloses a computer program, in that it would be apparent to the
person skilled in the art that the individual steps of the method
described herein may be put into effect by computer code. The
computer program is not intended to be limited to any particular
programming language and implementation thereof. It will be
appreciated that a variety of programming languages and coding
thereof may be used to implement the teachings of the disclosure
contained herein. Moreover, the computer program is not intended to
be limited to any particular control flow. There are many other
variants of the computer program, which can use different control
flows without departing from the spirit or scope of the
invention.
[0040] Furthermore, one or more of the steps of the computer
program may be performed in parallel rather than sequentially. Such
a computer program may be stored on any computer readable medium.
The computer readable medium may include storage devices such as
magnetic or optical disks, memory chips, or other storage devices
suitable for interfacing with a general purpose computer. The
computer readable medium may also include a hard-wired medium such
as exemplified in the Internet system, or wireless medium such as
exemplified in the GSM (Global System for Mobile communications)
mobile telephone system. The computer program when loaded and
executed on such a general-purpose computer effectively results in
an apparatus that implements the steps of the preferred method.
[0041] The computer system 900 comprises a computer module 902,
input modules such as a keyboard 904 and mouse 906 and a plurality
of output devices such as a display 908, and printer 910.
[0042] The computer module 902 is connected to a computer network
912 via a suitable transceiver device 914, to enable access to e.g.
the Internet or other network systems such as Local Area Network
(LAN) or Wide Area Network (WAN).
[0043] The computer module 902 in the example includes a processor
918, a Random Access Memory (RAM) 920 and a Read Only Memory (ROM)
922. The computer module 902 also includes a number of Input/Output
(I/O) interfaces, for example I/O interface 924 to the display 908,
and I/O interface 926 to the keyboard 904.
[0044] The components of the computer module 902 typically
communicate via an interconnected bus 928 and in a manner known to
the person skilled in the relevant art.
[0045] The application program is typically supplied to the user of
the computer system 900 encoded on a data storage medium such as a
CD (Compact-Disc)-ROM or flash memory carrier and read utilising a
corresponding data storage medium drive of a data storage device
930. The application program is read and controlled in its
execution by the processor 918. Intermediate storage of program
data may be accomplished using RAM 920.
[0046] The processor 918 may execute a set of instructions that
perform the method claimed with respect to FIG. 6. The processor
918 is configured to receive sensor data 102 captured by the
sensing devices disclosed with regard to FIG. 1. The sensor data
102 may be received by sensors 950 that are located at e.g. a
remote surveillance area. The processor 918 is configured to
analyze the sensor data 102 to detect event(s) and event related
data. Based on the event related data of the detected event(s), the
processor 918 is configured to estimate the size of the detected
entire events. The processor 918 sends out actuation data 952 to
one or more actuators 954 so that the one or more actuators 954 can
actuate one or more predetermined devices such as a camera, a
display and an alarm notification system. The one or more
predetermined devices are actuated based on the estimated size of
the detected entire events.
[0047] While exemplary embodiments have been presented in the
foregoing detailed description of the invention, it should be
appreciated that a vast number of variations exist. For example,
those skilled in the art will realize from the teachings herein
that the present technology may also be applied to any part in the
other type of chemical sensors.
[0048] It should further be appreciated that the exemplary
embodiments are only examples, and are not intended to limit the
scope, applicability, operation, or configuration of the invention
in any way. Rather, the foregoing detailed description will provide
those skilled in the art with a convenient road map for
implementing an exemplary embodiment of the invention. It is
understood that various changes may be made in the function and
arrangement of elements and method of operation described in an
exemplary embodiment without departing from the scope of the
invention as set forth in the appended claims.
[0049] A part or the whole of the foregoing exemplary embodiment
and the variations thereof may be defined as a supplementary note
cited hereunder. However, the exemplary embodiment and the
variations are not limited to the following supplementary note.
(Supplementary Note 1)
[0050] A non-transitory computer readable storage medium storing
the program that causes a computer to perform:
[0051] a process that detects events based on sensor data by a
sensor data analyzer;
[0052] a process that estimates the size of the detected entire
events based on event related data of the detected events; and
[0053] a process that actuates a predetermined device based on the
estimated size of the detected entire events.
[0054] This application is based upon and claims the benefit of
priority from Singapore Patent Application No. 10201501222X filed
on Feb. 17, 2015, the entire disclosure of which is incorporated
herein.
INDUSTRIAL APPLICABILITY
[0055] The present invention can be applied to, for example, video
surveillance systems which are used in several areas for routine
surveillance.
REFERENCE SINGS LIST
[0056] 100 Video surveillance system [0057] 102 Sensor data [0058]
104 Sensor data analysis part [0059] 106 Sensing device information
database [0060] 108 Event size estimation part [0061] 110 Camera
control part [0062] 112 Display [0063] 114 Alarm notification
system [0064] 200 Imaging range adjustment (zoom-out) [0065] 202
Timeline [0066] 204 Initial imaging range [0067] 206 Field of View
[0068] 208 Camera and microphone array [0069] 210 Breaking glass
[0070] 212 Direction of arrival [0071] 214 Shouting [0072] 216
Direction of arrival [0073] 218 Adjusted imaging range [0074] 300
Imaging range adjustment based on sound (zoom-in and controlling
the direction of the camera) [0075] 302 Timeline [0076] 304 Initial
adjustment range [0077] 306 Field of View [0078] 308 Camera and
microphone array [0079] 310 Fighting [0080] 312 Direction of
arrival [0081] 314 Adjusted imaging range [0082] 400 Imaging range
adjustment based on the type of sound event (zooming-out) [0083]
402 Timeline [0084] 404 Initial adjustment range [0085] 406 Field
of View [0086] 408 Camera and microphone array [0087] 410 Explosion
[0088] 412 Direction of arrival [0089] 414 Adjusted imaging range
[0090] 500 Imaging range adjustment using an odor sensor and
infrared sensor (zooming-out) [0091] 502 Timeline [0092] 504 Odor
sensor [0093] 506 Infrared sensor [0094] 508 Field of View [0095]
510 Initial adjustment range [0096] 512 Camera and microphone array
[0097] 514 Abnormal odor [0098] 516 unusual crowd [0099] 518
Adjusted imaging range [0100] 600 Flowchart of the method for
monitoring event related data [0101] 602 Step of detecting events
[0102] 604 Step of estimating the size of the detected entire event
[0103] 606 Step of actuating predetermined device based on the
estimated size of event [0104] 700 Display [0105] 702 Breaking
glass [0106] 704 Crowd [0107] 706 Fighting [0108] 708 Size of the
detected entire events [0109] 800 Look-up table [0110] 900 Computer
system [0111] 902 Computer module [0112] 904 Keyboard [0113] 906
Mouse [0114] 908 Display [0115] 910 Printer [0116] 912 Computer
network [0117] 914 Suitable transceiver device [0118] 918 Processor
[0119] 920 Random Access Memory (RAM) [0120] 922 Read Only Memory
(ROM) [0121] 924 I/O interface to display [0122] 926 I/O interface
to keyboard [0123] 928 Interconnected bus [0124] 930 Data storage
device [0125] 950 Sensors [0126] 952 Actuation data [0127] 954
Actuators
* * * * *