U.S. patent application number 14/394581 was filed with the patent office on 2015-03-12 for image processing system, server device, image pickup device and image evaluation method.
This patent application is currently assigned to PANASONIC CORPORATION. The applicant listed for this patent is PANASONIC CORPORATION. Invention is credited to Hirofumi Fujii, Michio Miwa, Masataka Sugiura, Takeshi Watanabe, Sumio Yokomitsu.
Application Number | 20150071548 14/394581 |
Document ID | / |
Family ID | 49383235 |
Filed Date | 2015-03-12 |
United States Patent
Application |
20150071548 |
Kind Code |
A1 |
Fujii; Hirofumi ; et
al. |
March 12, 2015 |
IMAGE PROCESSING SYSTEM, SERVER DEVICE, IMAGE PICKUP DEVICE AND
IMAGE EVALUATION METHOD
Abstract
An image pickup device transmits to a server a transmission
sample including a detection image detected by a first detection
section from a transmitting/receiving section under the control of
a transmission sample control section. The server performs
detection processing that requires more resources than those of the
first detection section on the detection image transmitted by a
second detection section from the image pickup device, and
determines whether or not the detection image in question is
spurious, based on a second detection score which is thereby
obtained. A transmission frequency deciding section generates
transmission frequency control information such as to raise the
transmission frequency by an image pickup device that has a high
frequency of spurious detection; a transmitting/receiving section
transmits the transmission frequency control information to the
image pickup device.
Inventors: |
Fujii; Hirofumi; (Kanagawa,
JP) ; Yokomitsu; Sumio; (Tokyo, JP) ;
Watanabe; Takeshi; (Kanagawa, JP) ; Sugiura;
Masataka; (Tokyo, JP) ; Miwa; Michio; (Chiba,
JP) |
|
Applicant: |
Name |
City |
State |
Country |
Type |
PANASONIC CORPORATION |
Osaka |
|
JP |
|
|
Assignee: |
PANASONIC CORPORATION
Osaka
JP
|
Family ID: |
49383235 |
Appl. No.: |
14/394581 |
Filed: |
April 18, 2013 |
PCT Filed: |
April 18, 2013 |
PCT NO: |
PCT/JP2013/002615 |
371 Date: |
October 15, 2014 |
Current U.S.
Class: |
382/195 |
Current CPC
Class: |
G06K 9/00979 20130101;
G06K 9/6857 20130101; H04N 7/181 20130101; G06K 9/036 20130101;
G06K 2009/6864 20130101; H04N 7/18 20130101 |
Class at
Publication: |
382/195 |
International
Class: |
G06K 9/68 20060101
G06K009/68 |
Foreign Application Data
Date |
Code |
Application Number |
Apr 18, 2012 |
JP |
2012-094538 |
Claims
1-8. (canceled)
9. An image processing system, comprising: an image transmitting
apparatus; and a receiving apparatus, wherein the image
transmitting apparatus includes: a first detecting section that
detects a desired image region from an image; a transmission sample
control section that selects an image region from among the
detected image regions; and a transmitting section that transmits
the selected image region, and the receiving apparatus includes: a
second detecting section that performs a detection process
requiring more resources than the first detecting section on the
image region transmitted from the image transmitting apparatus, and
that determines the image region whose detection score is less than
a predetermined threshold to be an erroneous detection.
10. The image processing system according to claim 9, wherein the
transmission sample control section selects the image region based
on a detection score by the first detecting section from among the
detected image regions.
11. The image processing system according to claim 9, wherein the
transmission sample control section selects the image region whose
detection score by the first detecting section is less than a
predetermined threshold from among the detected image regions.
12. The image processing system according to claim 9, wherein the
first detection section and the second detection section perform
detection for an identical purpose.
13. The image processing system according to claim 9, wherein the
first detection section and the second detection section perform
detection for at least one of a person and a face of a person.
14. A receiving apparatus, comprising: a detecting section that
performs, on an image region transmitted from an apparatus, a
detection process requiring more resources than resources used for
detection of the image region in the apparatus, and that determines
the image region whose detection score is less than a predetermined
threshold to be an erroneous detection; a transmission frequency
deciding section that decides transmission frequency for the
apparatus for which frequency of an erroneous detection
determination is equal to or greater than predetermined frequency,
and that generates transmission frequency control information
representing the decided transmission frequency; and a transmitting
section that transmits the generated transmission frequency control
information to the apparatus.
15. The receiving apparatus according to claim 14, wherein the
transmission frequency deciding section decides the transmission
frequency when the image region in which the frequency of the
erroneous detection determination is equal to or greater than the
predetermined frequency has been determined to be an erroneous
detection in the past.
16. A receiving apparatus, comprising: a detecting section that
performs, on an image region transmitted from an image transmitting
apparatus, a detection process requiring more resources than
resources used for detection of the image region in the imaging
transmitting apparatus, and that determines the image region whose
detection score is less than a predetermined threshold to be an
erroneous detection; an erroneous detection region deciding section
that measures a number of detection images determined to be an
erroneous detection for each of a plurality of regions obtained by
dividing an entire input image in the image transmitting apparatus,
that decides a region in which a predetermined number of the
detection images are measured, and that generates erroneous
detection region information representing the decided region; and a
transmitting section that transmits the generated erroneous
detection region information to the image transmitting
apparatus.
17. The receiving apparatus according to claim 14, further
comprising a notifying section that notifies an administrator of
the apparatus for which frequency of an erroneous detection
determination is equal to or greater than predetermined
frequency.
18. An image transmitting apparatus, comprising: a detection
section that detects a desired image region from an image; a
transmission sample control section that selects an image region
based on a detection score from among the detected image regions;
and a transmitting section that transmits the selected image
region.
19. The image transmitting apparatus according to claim 18, wherein
the transmission sample control section selects the image region
whose detection score is less than a predetermined threshold from
among the detected image regions.
20. An image processing method, comprising: an image transmitting
step; and a receiving side image processing step, wherein the image
transmitting step includes: a first detecting step of detecting a
desired image region from an image; a transmission sample control
step of selecting an image region from among the detected image
regions; and a transmitting step of transmitting the selected image
region, and the receiving side image processing step includes: a
second detecting step of performing a detection process requiring
more resources than the first detecting step on the image region,
and determining the image region whose detection score is less than
a predetermined threshold to be an erroneous detection.
21. The image processing method according to claim 20, wherein, in
the transmission sample control step, an image region is selected
based on a detection score by the first detecting step from among
the detected image regions.
22. The image processing method according to claim 20, wherein, in
the transmission sample control step, the image region whose
detection score by the first detecting step is less than a
predetermined threshold is selected from among the detected image
regions.
23. The image processing method according to claim 20, wherein, in
the first detection step and the second detection step, detection
is performed for an identical purpose.
24. The image processing method according to claim 20, wherein, in
the first detection step and the second detection step, detection
is performed for at least one of a person and a face of a
person.
25. A receiving side image processing method, comprising: a
detecting step of performing, on an image region transmitted in an
image transmitting step, a detection process requiring more
resources than resources used for detection of the image region in
the image transmitting step, and determining the image region whose
detection score is less than a predetermined threshold to be an
erroneous detection; a transmission frequency deciding step of
deciding transmission frequency for an apparatus for which
frequency of an erroneous detection determination is equal to or
greater than predetermined frequency, and generating transmission
frequency control information representing the decided transmission
frequency; and a transmitting step of transmitting the generated
transmission frequency control information to the apparatus.
26. The receiving side image processing method according to claim
25, wherein, in the transmission frequency deciding step, the
transmission frequency is decided when the image region in which
the frequency of the erroneous detection determination is equal to
or greater than the predetermined frequency has been determined to
be an erroneous detection in the past.
27. A receiving side image processing method, comprising: a
detecting step of performing, on an image region transmitted from
an apparatus, a detection process requiring more resources than
resources used for detection of the image region in the apparatus,
and determining the image region whose detection score is less than
a predetermined threshold to be an erroneous detection; an
erroneous detection region deciding step of measuring a number of
detection images determined to be an erroneous detection for each
of a plurality of regions obtained by dividing an entire input
image in the apparatus, deciding a region in which a predetermined
number of the detection images are measured, and generating
erroneous detection region information representing the decided
region; and a transmitting step of transmitting the generated
erroneous detection region information to the apparatus.
28. The receiving side image processing method according to claim
25, further comprising a notifying step of notifying an
administrator of the apparatus for which frequency of an erroneous
detection determination is equal to or greater than predetermined
frequency.
29. An image transmitting method, comprising: a detection step of
detecting a desired image region from an image; a transmission
sample control step of selecting an image region based on a
detection score from among the detected image regions; and a
transmitting step of transmitting the selected image region.
30. The image transmitting method according to claim 29, wherein,
in the transmission sample control step, the image region whose
detection score is less than a predetermined threshold is selected
from among the detected image regions.
Description
TECHNICAL FIELD
[0001] The present invention relates to an image processing system,
a server apparatus, an imaging apparatus, and an image determining
method for extracting desired data from a photographed image.
BACKGROUND ART
[0002] In recent years, there has been an increasing need for image
processing techniques for extracting desired data from an image
photographed by an imaging apparatus such as a camera. Examples of
expected techniques include one that detects a face of a person
captured by a surveillance camera, extracts parameters indicating
features such as eyes, a mouth, or hair from the detected face,
compares the extracted parameters with previously prepared
corresponding parameters, and acquires information such as an age
or a sex of the person captured by the surveillance camera.
[0003] As an example of a technique to which such an image
processing technique is applied, a remote meter-reading system is
disclosed in Patent Literature (hereinafter, abbreviated as "PTL")
1. FIG. 1 is a block diagram illustrating a configuration of a
remote meter-reading system disclosed in PTL 1. Referring to FIG.
1, the remote meter-reading system includes remote meter-reading
apparatus 10 and meter-reading sensor 20.
[0004] Remote meter-reading apparatus 10 includes: imaging section
11 that photographs indicator value display 2 of meter 1; pattern
recognizing section 12 that generates indicator value pattern C
based on original image A photographed by imaging section 11 and
recognizes indicator value D; determining section 13 that
determines whether or not the recognition result is valid; and
communication section 15 that transmits predetermined meter-reading
data to meter-reading center 20 via communication path 3 based on
the determination result.
[0005] When determining section 13 determines that the recognition
result is valid, remote meter-reading apparatus 10 transmits
indicator value D as meter-reading data. Meanwhile, when
determining section 13 determines that the recognition result of at
least some digits of the indicator value is not valid, remote
meter-reading apparatus 10 transmits determination result F,
original image A, and indicator value pattern C, or intermediate
image B for the data as indicator data.
[0006] Meter-reading center 20 includes: communication section 21
that receives predetermined meter-reading data such as an indicator
value or image data via predetermined communication path 3; second
pattern recognizing section 22 that recognizes indicator value E of
digits determined as being invalid in the recognition result at
least in remote meter-reading apparatus 10 from original image A,
intermediate image B, or indicator value pattern C received from
remote meter-reading apparatus 10; second determining section 23
that determines whether or not the recognition result obtained by
second pattern recognizing section 22 is valid; and meter-reading
result recording section 24 that records indicator value D received
by communication section 21 and indicator value E recognized by
second pattern recognizing section 22.
[0007] According to above-described remote meter-reading system,
even when a remote meter-reading apparatus cannot recognize or
erroneously recognizes an indicator value, it is possible to
correctly recognize an indicator value from a remote site such as
the meter-reading sensor.
CITATION LIST
Patent Literature
PTL 1
Japanese Patent Application Laid-Open No. 2002-24828
SUMMARY OF INVENTION
Technical Problem
[0008] In the remote meter-reading system disclosed in PTL 1,
however, since the process of recognizing and determining image
data in the imaging apparatus (corresponding to the remote
meter-reading apparatus) that photographs an image is simple, there
is no increase in the processing load of the camera side, but
detecting a face of a person captured by the surveillance camera
requires an advanced process to determine whether or not erroneous
detection has occurred. For this reason, there arises a problem in
that the processing load of the imaging apparatus increases.
[0009] It is an object of the present invention to provide an image
processing system, a server apparatus, an imaging apparatus, and an
image determining method that reduce the processing load of an
imaging apparatus and that efficiently determine erroneous
detection in the imaging apparatus.
Solution to Problem
[0010] An image processing system according to an aspect of the
present invention includes: an imaging apparatus; and a server
apparatus, in which the imaging apparatus includes: an imaging
section that receives an image from an imaging element; a first
detecting section that detects a desired image region from the
received image; a transmission sample control section that selects
an image region for a band in ascending order of first detection
scores among the detected image regions; and a transmitting section
that transmits the selected image region, and the server apparatus
includes: a second detecting section that performs a detection
process requiring more resources than the first detecting section
on the image region transmitted from the imaging apparatus, and
that determines the image region whose detected second detection
score is less than a predetermined threshold to be an erroneous
detection.
[0011] A server apparatus according to an aspect of the present
invention includes: a second detecting section that performs, on an
image region transmitted from an imaging apparatus, a detection
process requiring more resources than resources used for detection
of the image region in the imaging apparatus, and that determines
the image region whose detected second detection score is less than
a predetermined threshold to be an erroneous detection; a
transmission frequency deciding section that decides transmission
frequency for the imaging apparatus for which frequency of an
erroneous detection determination is equal to or greater than
predetermined frequency, and that generates transmission frequency
control information representing the decided transmission
frequency; and a transmitting section that transmits the generated
transmission frequency control information to the imaging
apparatus.
[0012] A server apparatus according to an aspect of the present
invention includes: a second detecting section that performs, on an
image region transmitted from an imaging apparatus, a detection
process requiring more resources than resources used for detection
of the image region in the imaging apparatus, and that determines
the image region whose detected second detection score is less than
a predetermined threshold to be an erroneous detection; an
erroneous detection region deciding section that measures a number
of detection images determined to be an erroneous detection for
each of a plurality of regions obtained by dividing an entire input
image in the imaging apparatus, that decides a region in which a
predetermined number of the detection images are measured, and that
generates erroneous detection region information representing the
decided region; and a transmitting section that transmits the
generated erroneous detection region information to the imaging
apparatus.
[0013] An imaging apparatus according to an aspect of the present
invention includes: an imaging section that receives an image from
an imaging element; a first detecting section that detects a
desired image region from the received image; a transmission sample
control section that selects an image region for a band in
ascending order of first detection scores among the detected image
regions; and a transmitting section that transmits the selected
image region.
[0014] An image determining method according to an aspect of the
present invention includes: a second detecting process of
performing, on an image region transmitted from an imaging
apparatus, a detection process requiring more resources than
resources used for detection of the image region in the imaging
apparatus, and determining the image region whose detected second
detection score is less than a predetermined threshold to be an
erroneous detection; and a transmission frequency deciding process
of deciding transmission frequency for the imaging apparatus for
which frequency of an erroneous detection determination is equal to
or greater than predetermined frequency, and generating
transmission frequency control information representing the decided
transmission frequency.
[0015] An image determining method according to an aspect of the
present invention includes: a second detecting process of
performing, on an image region transmitted from an imaging
apparatus, a detection process requiring more resources than
resources used for detection of the image region in the imaging
apparatus, and determining the image region whose detected second
detection score is less than a predetermined threshold to be an
erroneous detection; and an erroneous detection region deciding
process of measuring a number of detection images determined to be
an erroneous detection for each of a plurality of regions obtained
by dividing an entire input image in the imaging apparatus,
deciding a region in which a predetermined number of the detection
images are measured, and generating erroneous detection region
information representing the decided region.
Advantageous Effects of Invention
[0016] According to the present invention, it is possible to reduce
the processing load of an imaging apparatus and to efficiently
determine erroneous detection in the imaging apparatus.
BRIEF DESCRIPTION OF DRAWINGS
[0017] FIG. 1 is a block diagram illustrating a configuration of a
remote meter-reading system disclosed in PTL 1;
[0018] FIG. 2 is a block diagram illustrating a configuration of an
image monitoring system according to Embodiment 1 of the present
invention;
[0019] FIG. 3 is a diagram for describing a detection sample;
[0020] FIGS. 4A and 4B are diagrams illustrating how transmission
frequency is set for each camera;
[0021] FIG. 5 is a block diagram illustrating a configuration of an
image monitoring system according to Embodiment 2 of the present
invention;
[0022] FIG. 6 is a diagram for describing an operation of a
transmission sample control section according to Embodiment 2 of
the present invention;
[0023] FIG. 7 is a block diagram illustrating another configuration
of an imaging apparatus; and
[0024] FIG. 8 is a block diagram illustrating another configuration
of a server.
DESCRIPTION OF EMBODIMENTS
[0025] Hereinafter, some embodiments of the present invention will
be described with reference to the appended drawings. In the
following embodiments, components having the same function are
denoted by the same reference numerals, and any redundant
description will be omitted.
Embodiment 1
[0026] FIG. 2 is a block diagram illustrating a configuration of
image monitoring system 100 according to Embodiment 1 of the
present invention. The configuration of image monitoring system 100
will be described below with reference to FIG. 2. Referring to FIG.
2, image monitoring system 100 includes imaging apparatus 110 and
server 150. Although FIG. 2 illustrates only one imaging apparatus,
an assumption is made that a plurality of imaging apparatuses are
actually connected to the server.
[0027] Imaging apparatus 110 includes camera section 111, first
detecting section 112, first storage section 113, transmission
sample control section 114, and transmission and reception section
115. Camera section 111 receives an image from an imaging element
such as a charge coupled device (CCD) imaging element or a
complementary metal oxide semiconductor (CMOS) imaging element and
outputs the received image to first detecting section 112.
[0028] First detecting section 112 detects, from the image output
from camera section 111, a desired region through a detection frame
configured with a rectangular region, for example, and outputs the
detected image (hereinafter, referred to as "detection image") and
a detection score (likelihood) of the image to first storage
section 113 as a detection sample. Here, for example, an image
region similar to a face model of a person is considered as a
desired region. Further, there are cases in which a detection
sample includes a detection position indicating the position of the
detection frame (coordinates of an apex and vertical and horizontal
lengths of a detection frame) and a detection IL) identifying the
detection frame.
[0029] First storage section 113 stores the detection samples
output from first detecting section 112, and outputs the detection
samples stored for a predetermined period of time to transmission
sample control section 114.
[0030] Transmission sample control section 114 selects a detection
sample for a band in ascending order of detection scores among the
detection samples for the predetermined period of time which are
output from first storage section 113, and outputs transmission
samples corresponding to the selected detection samples to
transmission and reception section 115. Further, the transmission
sample may include at least a detection image among corresponding
detection samples and some or all of the detection score, the
detection position, and the detection ID. When transmission
frequency control information is output from transmission and
reception section 115, transmission sample control section 114
selects the number of detection samples corresponding to the
transmission frequency represented by transmission frequency
control information, and outputs the transmission samples
corresponding to the selected detection samples to transmission and
reception section 115.
[0031] Transmission and reception section 115 transmits the
transmission samples output from transmission sample control
section 114 to server 150. The transmission frequency control
information transmitted from server 150 is output to transmission
sample control section 114.
[0032] Server 150 includes transmission and reception section 151,
second detecting section 152, notifying section 153, second storage
section 154, and transmission frequency deciding section 155.
Transmission and reception section 151 receives the transmission
samples transmitted from imaging apparatus 110, and outputs the
received transmission samples to second detecting section 152.
Further, transmission and reception section 151 transmits the
transmission frequency control information output from transmission
frequency deciding section 155 to imaging apparatus 110.
[0033] Second detecting section 152 obtains detection scores by
performing a detection process (for example, a process of detecting
a feature value of a dimension different from a dimension of first
detecting section 112) requiring more resources such as a memory
than first detecting section 112 of imaging apparatus 110 on the
transmission samples output from transmission and reception section
151. Here, as the detection process requiring more resources than
first detecting section 112, there is a process of obtaining a
detection result with higher accuracy than that of first detecting
section 112. Second detecting section 152 determines a transmission
sample whose obtained detection score is smaller than a
predetermined threshold to be an erroneous detection, and measures
the frequency (the number of times per unit time) of an erroneous
detection determination for each imaging apparatus. Second
detecting section 152 outputs the frequency (erroneous detection
frequency) of an erroneous detection determination of each imaging
apparatus and an ID identifying an imaging apparatus to second
storage section 154, and outputs an ID identifying an imaging
apparatus having high erroneous detection frequency to notifying
section 153.
[0034] Notifying section 153 notifies the administrator of the ID
output from second detecting section 152.
[0035] Second storage section 154 stores the erroneous detection
frequency of each imaging apparatus and the ID of the imaging
apparatus output from second detecting section 152. When the
previously stored imaging apparatus having high erroneous detection
frequency is identical to the imaging apparatus having the high
erroneous detection frequency output from second detecting section
152, second storage section 154 outputs the ID of the imaging
apparatus to transmission frequency deciding section 155. Here, the
high erroneous detection frequency means that the erroneous
detection frequency is equal to or greater than the predetermined
threshold. Further, second storage section 154 outputs an ID
identifying an imaging apparatus that has been installed just
before, an ID identifying an imaging apparatus in which a learning
model has been just updated, and an ID identifying an imaging
apparatus currently collecting learning samples to transmission
frequency deciding section 155 as well.
[0036] Transmission frequency deciding section 155 generates
transmission frequency control information causing the imaging
apparatus represented by the ID output from second storage section
154 to increase the transmission frequency of the transmission
sample, and outputs the transmission frequency control information
to transmission and reception section 151. As a result, it is
possible to allocate a band preferentially to an imaging apparatus
that is to collect more transmission samples among a plurality of
imaging apparatuses. At this time, since a limited band is shared
by a plurality of imaging apparatuses, transmission frequency
deciding section 155 reads an imaging apparatus having low
erroneous detection frequency from second storage section 154, and
generates transmission frequency control information causing the
read imaging apparatus to decrease the transmission frequency of
the transmission sample. As described above, transmission frequency
deciding section 155 controls the transmission frequency of a
plurality of imaging apparatuses according to the erroneous
detection frequency such that the number of transmission samples
increases or decreases.
[0037] Next, an operation of image monitoring system 100 will be
described. First, in imaging apparatus 110, first detecting section
112 detects desired regions and detection scores thereof from an
image photographed by camera section 111.
[0038] The detection samples including the detection image and the
detection score thereof are stored in first storage section 113,
and detection samples DS.sub.A, DS.sub.B, . . . , DS.sub.K (where,
K=D) corresponding to a predetermined period of time are output to
transmission sample control section 114 as illustrated in FIG.
3.
[0039] Among detection samples DS.sub.A, DS.sub.B, . . . , and
DS.sub.D corresponding to the predetermined period of time,
detection samples DS.sub.B, DS.sub.C, and DS.sub.D (where,
S.sub.B<S.sub.C<S.sub.D<S.sub.A is true for the detection
scores) corresponding to a band (where, 3 transmission samples can
be transmitted) are selected in the ascending order of the
detection scores in transmission sample control section 114, and
transmission samples SS.sub.B, SS.sub.C, and SS.sub.D corresponding
to the selected detection samples DS.sub.B, DS.sub.C, and DS.sub.D
are transmitted to server 150 through transmission and reception
section 115.
[0040] As a detection image having a low detection score is
preferentially transmitted to server 150 as described above, server
150 can perform high-accuracy detection on a detection image that
is likely to result in an erroneous detection.
[0041] In server 150, second detecting section 152 performs a
detection process requiring more resources than first detecting
section 112 on transmission samples SS.sub.B, SS.sub.C, and
SS.sub.D transmitted from imaging apparatus 110, and obtains
detection scores. Second detecting section 152 determines a
transmission sample whose obtained detection score is smaller than
a predetermined threshold to be an erroneous detection, and
measures the frequency of an erroneous detection determination for
each imaging apparatus.
[0042] When the imaging apparatus having the previously stored high
erroneous detection frequency is identical to the imaging apparatus
having the high erroneous detection frequency output from second
detecting section 152, second storage section 154 outputs the ID of
the imaging apparatus to transmission frequency deciding section
155. By confirming that the imaging apparatus having the high
erroneous detection frequency output from second detecting section
152 has been already stored, it is possible to specify an imaging
apparatus in which erroneous detection continuously occurs.
[0043] Transmission frequency deciding section 155 generates
transmission frequency control information causing the imaging
apparatus represented by the ID specified by second storage section
154 to increase the transmission frequency of the transmission
sample. Further, transmission frequency deciding section 155 reads
an ID of an imaging apparatus having low erroneous detection
frequency from second storage section 154, and generates
transmission frequency control information causing the read imaging
apparatus to decrease the transmission frequency of the
transmission sample.
[0044] The transmission frequency control information generated by
transmission frequency deciding section 155 is transmitted to
imaging apparatus 110 through transmission and reception section
151.
[0045] Transmission sample control section 114 of imaging apparatus
110 acquires the transmission frequency control information
transmitted from server 150, selects the number of detection
samples corresponding to the transmission frequency indicated by
the acquired transmission frequency control information, and
transmits transmission samples corresponding to the selected
detection samples to server 150 through transmission and reception
section 115.
[0046] As described above, controlling the transmission frequency
for a plurality of imaging apparatuses according to the erroneous
detection frequency such that the number of transmission samples
increases or decreases within a limited band allows server 150 to
perform an erroneous detection determination of a detection image
with high accuracy. For example, referring to FIG. 4A, an
assumption is made that cameras 1 to 3 each transmit three
transmission samples to the server before the transmission
frequency is controlled. Here, it is assumed that in camera 1, a
transmission sample is determined to be an erroneous detection, in
camera 2, no transmission samples are determined to be an erroneous
detection for a long period of time, and in camera 3, a learning
model has been just updated. In this case, transmission frequency
deciding section 155 sets high transmission frequency for camera 1
and camera 3 and sets low transmission frequency for camera 2. As a
result, after the transmission frequency is controlled, each of
camera 1 and camera 3 is set to transmit four transmission samples,
and camera 2 is set to transmit one transmission sample as
illustrated in FIG. 4B.
[0047] As described above, according to Embodiment 1, the first
detecting section of the imaging apparatus preferentially transmits
a detection image having a low detection score among detected
detection images to the server, and the second detecting section of
the server performs the detection process requiring more resources
than the first detecting section on a detection image transmitted
by the imaging apparatus, determines whether or not the detection
image has been erroneously detected based on the obtained detection
score, and gives an instruction to increase the transmission
frequency to the imaging apparatus having the high erroneous
detection frequency. As a result, the imaging apparatus that has
received the instruction to increase the transmission frequency can
transmit more detection images, and the server can perform an
erroneous detection determination of an detection image with a high
degree of accuracy, and thus it is possible to reduce the
processing load of the imaging apparatus and to verify a detection
image transmitted from the imaging apparatus having the high
erroneous detection frequency with high accuracy.
Embodiment 2
[0048] FIG. 5 is a block diagram illustrating a configuration of
image monitoring system 200 according to Embodiment 2 of the
present invention. A configuration of image monitoring system 200
will be described below with reference to FIG. 5. FIG. 5 is
different from FIG. 2 in that, in an imaging apparatus,
transmission sample control section 114 is replaced with
transmission sample control section 211, and in a server, second
storage section 154 is removed, second detecting section 152 is
replaced with second detecting section 251, and transmission
frequency deciding section 155 is replaced with erroneous detection
region deciding section 252.
[0049] Transmission sample control section 211 selects detection
samples for a hand in the ascending order of the detection scores
among detection samples for a predetermined period of time output
from first storage section 113, and outputs transmission samples
corresponding to the selected detection samples to transmission and
reception section 115. Further, when erroneous detection region
information is output from transmission and reception section 115,
transmission sample control section 211 reads a detection sample of
a region indicated by the erroneous detection region information
from first storage section 113, and outputs a transmission sample
corresponding to the read detection sample to transmission and
reception section 115.
[0050] Second detecting section 251 performs the detection process
requiring more resources such as a memory than first detecting
section 112 of imaging apparatus 210 on the transmission samples
output from transmission and reception section 151, and obtains
detection scores. Second detecting section 251 determines the
transmission sample whose obtained detection score is smaller than
a predetermined threshold to be an erroneous detection, and outputs
a detection position of the transmission sample determined to be an
erroneous detection to erroneous detection region deciding section
252.
[0051] Erroneous detection region deciding section 252 measures the
number of transmission samples determined to be an erroneous
detection for each of a plurality of regions obtained by dividing
an entire input image based on the detection position output from
second detecting section 251. Erroneous detection region deciding
section 252 generates erroneous detection region information
indicating a region in which a certain number is measured, and
outputs the generated erroneous detection region information to
transmission and reception section 151. Further, erroneous
detection region deciding section 252 may output an instruction
(transmission frequency control information) causing imaging
apparatus 210 to increase the transmission frequency of the
transmission sample to transmission and reception section 151
together with the erroneous detection region information.
[0052] Further, when there are a plurality of cameras, an entire
input image may be divided into a plurality of regions for each
camera, and the number of transmission samples determined to be an
erroneous detection may be measured for each divided region.
Erroneous detection region deciding section 252 generates erroneous
detection region information representing a region in which a
predetermined number is measured for each camera, and outputs the
generated erroneous detection region information to transmission
and reception section 151.
[0053] Next, an operation of transmission sample control section
211 of image monitoring system 200 described above will be
described with reference to FIG. 6. FIG. 6 illustrates detection
frames 1 to 6 in images input during a predetermined period of
time. Here, for convenience of description, an example in which
detection frames in different input images are illustrated on the
same input image, and an entire input image is divided into six
regions (a to f).
[0054] When an initial setting is performed or when no erroneous
detection region information is received from server 250,
transmission sample control section 211 equally selects a detection
image having a low detection score from the entire input image
illustrated in FIG. 6. Here, the number of transmission samples is
assumed to be three, and the detection frames 1, 3, and 6 are
assumed to be selected. Further, when a plurality of detection
images are close to each other, one detection image is selected.
Specifically, in FIG. 6, when detection frame 3 is lowest in
detection score among detection frames 2, 3, and 5, detection frame
3 is selected.
[0055] Further, when the erroneous detection region information
(representing region b herein) is received from server 250,
transmission sample control section 211 selects detection frames of
region b represented by the erroneous detection region information
for the number of transmission samples. Specifically, when the
number of transmission samples is three, since the erroneous
detection region information represents region b, detection frames
2, 3, and 5 are selected. Here, when there are detection frames
equal to or greater than the number of transmission samples in the
region represented by the erroneous detection region information,
detection frames are selected in the ascending order of the
detection scores. Further, there are only detection frames less
than the number of transmission samples in the region represented
by the erroneous detection region information, detection frames are
selected from the entire input image in the ascending order of the
detection scores to meet the number of transmission samples.
[0056] As described above, according to Embodiment 2, the first
detecting section of the imaging apparatus preferentially transmits
a detection image having a low detection score among detected
detection images to the server, and the second detecting section of
the server performs the detection process requiring more resources
than the first detecting section on the detection image transmitted
by the imaging apparatus, determines whether or not the detection
image has been erroneously detected based on the obtained detection
score, measures the number of detection images determined to be an
erroneous detection for each of a plurality of regions obtained by
dividing the entire input image in the imaging apparatus, and
instructs the imaging apparatus to transmit the region in which a
predetermined number of the detection images are measured. As a
result, the imaging apparatus can transmit the image of the region
instructed through the erroneous detection region information to
the server, and the server can perform an erroneous detection
determination with high accuracy, and thus it is possible to verify
the region determined to be an erroneous detection with high
accuracy.
[0057] The embodiments have been described so far.
[0058] The above embodiments have been described in connection with
the case in which detection samples for a predetermined period of
time are transmitted from first storage section 113 of imaging
apparatus 110 (210) to transmission sample control section 114
(211), but a configuration illustrated in FIG. 7 may be employed.
Referring to FIG. 7, first storage section 113 stores the detection
samples (for example, DS.sub.A, DS.sub.B, DS.sub.C, and DS.sub.D)
output from first detecting section 112, outputs a detection list
including a detection ID and a detection score among the stored
detection samples to transmission sample control section 114, and
outputs transmission samples (SS.sub.A, SS.sub.B, SS.sub.C, and
SS.sub.D) corresponding to the stored detection samples (DS.sub.A,
DS.sub.B, DS.sub.C, and DS.sub.D) to the transmission and reception
section. A set of a detection ID and a detection score is used as
the detection list, and for example, (ID.sub.A,S.sub.A),
(ID.sub.B,S.sub.B), (ID.sub.C,S.sub.C), and (ID.sub.D,S.sub.D) are
used as the detection list.
[0059] Transmission sample control section 114 generates the
transmission sample list (for example, ID.sub.A and ID.sub.B when
two transmission samples can be transmitted) from the detection
list output from first storage section 113, and outputs the
generated transmission sample list to transmission and reception
section 115.
[0060] Transmission and reception section 115 selects the
transmission samples (SS.sub.A and SS.sub.B) corresponding to the
transmission sample list (ID.sub.A and ID.sub.B) output from
transmission sample control section 114 from the transmission
samples (SS.sub.A, SS.sub.B, SS.sub.C, and SS.sub.D) output from
first storage section 113, and transmits the selected transmission
samples to the server.
[0061] Embodiment 1 has been described in connection with the case
in which server 150 includes transmission frequency deciding
section 155, and Embodiment 2 has been described in connection with
the case in which server 250 includes erroneous detection region
deciding section 251, but the present invention is not limited to
the above cases described above. For example, as illustrated in
FIG. 8, second detecting section 152 may obtain a transmission
sample of high frequency whose detection score is smaller than a
threshold and notify notifying section 153 of an ID identifying an
imaging apparatus that has transmitted the corresponding
transmission sample.
[0062] Performing the detection process requiring more resources
than the first detecting section of the imaging apparatus by the
second detecting section of the server as described above reduces
the processing load of the imaging apparatus and thus makes it
possible to efficiently determine erroneous detection in the
imaging apparatus.
[0063] In the above embodiments, the image monitoring system, the
server apparatus, the imaging apparatus, and the image determining
method have been described, but it is also possible to build a
system for an application other than image monitoring such as a
system for analyzing the trend of store visitors in a store, for
example, by detecting a person or a face from an image, an image
processing system that performs work analysis of workers in a
factory, and the like using the present invention.
[0064] Further, a security-purpose surveillance camera or a
non-security-purpose network camera may be used as the camera
section.
[0065] Further, imaging apparatus 110 and server 150 may be
connected to each other via a wired network or a wireless
network.
[0066] The disclosure of the specification, drawings and abstract
in Japanese Patent Application No. 2012-094538 filed on Apr. 18,
2012 is incorporated herein by reference in its entirety.
INDUSTRIAL APPLICABILITY
[0067] The image processing system, the server apparatus, the
imaging apparatus, and the image determining method according to
the present invention are suitable for reducing a processing load
of an imaging apparatus and efficiently determining erroneous
detection in the imaging apparatus.
REFERENCE SIGNS LIST
[0068] 110, 210 Imaging apparatus [0069] 111 Camera section [0070]
112 First detecting section [0071] 113 First storage section [0072]
114, 211 Transmission sample control section [0073] 115, 151
Transmission and reception section [0074] 150, 250 Server [0075]
152, 251 Second detecting section [0076] 153 Notifying section
[0077] 154 Second storage section [0078] 155 Transmission frequency
deciding section [0079] 252 Erroneous detection region deciding
section
* * * * *