U.S. patent application number 12/214130 was filed with the patent office on 2008-12-25 for picture imaging apparatus and imaging control method.
This patent application is currently assigned to Sony Corporation. Invention is credited to Masamichi Asukai, Taiji Ito, Yoshiteru Kamatani, Itaru Kawakami, Nozomu Ozaki, Hirotaka Sakaguchi, Yoichiro Sako, Akane Sano, Hidehiko Sekizawa, Akinobu Sugino.
Application Number | 20080316339 12/214130 |
Document ID | / |
Family ID | 39598419 |
Filed Date | 2008-12-25 |
United States Patent
Application |
20080316339 |
Kind Code |
A1 |
Sugino; Akinobu ; et
al. |
December 25, 2008 |
Picture imaging apparatus and imaging control method
Abstract
A picture imaging apparatus includes: an imaging means for
imaging a subject picture to acquire taken picture data; a storage
processing means for performing a storage process of taken picture
data acquired by the imaging means; a motion detecting means for
detecting motion of the picture imaging apparatus itself; a
manipulating means for manipulating a shutter; and a control means
for instructing the imaging means to perform a process in
accordance with a shutter manipulation at a timing based on a
result detected in the motion detecting means during a period
during which the shutter is being manipulated by the manipulating
means.
Inventors: |
Sugino; Akinobu; (Kanagawa,
JP) ; Ozaki; Nozomu; (Kanagawa, JP) ; Asukai;
Masamichi; (Kanagawa, JP) ; Ito; Taiji;
(Kanagawa, JP) ; Sekizawa; Hidehiko; (Tokyo,
JP) ; Sano; Akane; (Tokyo, JP) ; Sakaguchi;
Hirotaka; (Tokyo, JP) ; Kamatani; Yoshiteru;
(Kanagawa, JP) ; Sako; Yoichiro; (Tokyo, JP)
; Kawakami; Itaru; (Kanagawa, JP) |
Correspondence
Address: |
WOLF GREENFIELD & SACKS, P.C.
600 ATLANTIC AVENUE
BOSTON
MA
02210-2206
US
|
Assignee: |
Sony Corporation
Tokyo
JP
|
Family ID: |
39598419 |
Appl. No.: |
12/214130 |
Filed: |
June 17, 2008 |
Current U.S.
Class: |
348/231.99 |
Current CPC
Class: |
H04N 5/23248 20130101;
H04N 2101/00 20130101; H04N 5/2327 20130101; G03B 7/00 20130101;
H04N 5/23258 20130101 |
Class at
Publication: |
348/231.99 |
International
Class: |
H04N 5/76 20060101
H04N005/76 |
Foreign Application Data
Date |
Code |
Application Number |
Jun 25, 2007 |
JP |
JP2007-166118 |
Claims
1. A picture imaging apparatus comprising: an imaging means for
imaging a subject picture to acquire taken picture data; a storage
processing means for performing a storage process of the taken
picture data acquired by the imaging means; a motion detecting
means for detecting motion of the picture imaging apparatus itself;
a manipulating means for manipulating a shutter; and a control
means for instructing the imaging means to perform a process in
accordance with a shutter manipulation at a timing based on a
result detected in the motion detecting means during a period
during which the shutter is being manipulated by the manipulating
means.
2. The picture imaging apparatus according to claim 1, wherein the
control means instructs the imaging means to perform a second
process in accordance with the shutter manipulation at a second
timing at which a second result detected by the motion detecting
means showing that motion is stopped is obtained.
3. The picture imaging apparatus according to claim 1, wherein the
control means instructs the imaging means to perform a second
process in accordance with the shutter manipulation at a second
timing at which a second result detected by the motion detecting
means showing that it is estimated that motion will be stopped is
obtained.
4. The picture imaging apparatus according to claim 1, wherein in
addition to a period during which the shutter is being manipulated
by the manipulating means, for a predetermined period after the
shutter manipulation, the control means instructs the imaging means
to perform a second process in accordance with the shutter
manipulation at a second timing based on a second result detected
in the motion detecting means.
5. The picture imaging apparatus according to claim 1, further
comprising: a warning means for outputting warning, wherein when
the timing that instructs the process in accordance with the
shutter manipulation is not obtained as the timing based on a
result detected by the motion detecting means, the control means
allows the warning means to output a warning.
6. An imaging control method for operating a picture imaging
apparatus that performs a first process of acquiring an image as a
subject picture in accordance with a shutter manipulation and
performs a second process of storing taken picture data obtained by
the image acquiring process, the imaging control method comprising:
detecting the shutter manipulation; detecting motion of the picture
imaging apparatus itself during a shutter manipulation period; and
instructing a process in accordance with a shutter manipulation at
a timing based on a result detected in the act of motion
detecting.
7. A picture imaging apparatus comprising: an imaging unit
configured to image a subject picture to acquire taken picture
data; a storage processing unit configured to perform a storage
process of the taken picture data acquired by the imaging unit; a
motion detecting unit configured to detect motion of the picture
imaging apparatus itself; a manipulating unit configured to
manipulate a shutter; and a control unit configured to instruct the
imaging unit to perform a process in accordance with a shutter
manipulation at a timing based on a result detected in the motion
detecting unit during a period during which the shutter is being
manipulated by the manipulating unit.
Description
CROSS REFERENCES TO RELATED APPLICATIONS
[0001] The present invention contains subject matter related to
Japanese Patent Application JP 2007-166118 filed in the Japanese
Patent Office on Jun. 25, 2007, the entire contents of which being
incorporated herein by reference.
BACKGROUND OF THE INVENTION
[0002] 1. Field of the Invention
[0003] The present invention relates to a picture imaging apparatus
and an imaging control method, particularly to a technique which
solves effects caused by the movement of the hands in taking a
picture.
[0004] 2. Description of the Related Art
[0005] Heretofore, for example, when a photographer takes a picture
with a picture imaging apparatus such as a digital still camera, a
so-called movement of the hands in taking a picture sometimes
happens to take a blurred picture. This movement of the hands in
taking a picture often happens because in user shutter
manipulation, a photographer presses a shutter button to trigger
shutter manipulation, which causes a picture imaging apparatus main
body to move.
[0006] For a technique to avoid the movement of the hands in taking
a picture, JP-A-5-142616 (Patent Reference 1) discloses a technique
in which the level of pressure in pressing a shutter button is
detected to find the situations of camera shake just before
operated for predicting camera shake. Then, based on this predicted
result, the programmed combinations of the aperture value and the
shutter speed are changed as necessary to prevent camera shake.
[0007] In addition, JP-A-7-218970 (Patent Reference 2) discloses a
technique in which exposure is not permitted until a predetermined
time period elapses after a photographer manipulates a shutter,
whereby it is prevented to take a blurred picture even though the
movement of the hands in taking a picture happens at the time at
which the photographer manipulates the shutter.
[0008] Furthermore, JP-A-2004-242360 (Patent Reference 3) discloses
a technique in which a plurality of primary memories is provided to
store picture data before trigger operation to trigger imaging
operation and picture data after trigger operation, and picture
data at the time at which the shutter is turned on is not used to
prevent the movement of the hands in taking a picture.
SUMMARY OF THE INVENTION
[0009] However, in the technique described in the Patent Reference
1, camera shake is predicted from the pressure in pressing a
shutter button, but it is difficult to cope with camera shake in
the case in which camera shake occurs because of factors other than
the pressure in pressing a shutter button.
[0010] In addition, in the technique described in the Patent
Reference 2, it is difficult to avoid a blurred picture caused by
the movement of the hands in taking a picture in the case in which
the movement of the hands in taking a picture is occurring even
after a predetermined time period has elapsed. For example, in the
case in which a changeable telephoto lens is mounted on a picture
imaging apparatus for taking a picture, since a photographer bears
the weight of a picture imaging apparatus main body and as well as
the weight of the telephoto lens, the movement of the
photographer's hands in taking a picture may not stop even after a
predetermined time period has elapsed. Or, also in the case in
which the imaging skills of a photographer are simply poor, it can
be thought that the movement of the hands in taking a picture is
occurring even after a predetermined time period has elapsed.
[0011] Furthermore, in the technique described in the Patent
Reference 3, it can be thought that the movement of the hands in
taking a picture is occurring even before and after the trigger
operation.
[0012] Thus, it is desirable to avoid degrading the quality of a
taken picture caused by the movement of the hands in taking a
picture that takes place when a photographer uses a picture imaging
apparatus for taking a picture.
[0013] A picture imaging apparatus according to an embodiment of
the invention is a picture imaging apparatus including: an imaging
means for imaging a subject picture to acquire taken picture data;
a storage processing means for performing a storage process of
taken picture data acquired by the imaging means; a motion
detecting means for detecting motion of the picture imaging
apparatus itself; a manipulating means for manipulating a shutter;
and a control means for instructing the imaging means to perform a
process in accordance with a shutter manipulation at a timing based
on a result detected in the motion detecting means during a period
during which the shutter is being manipulated by the manipulating
means.
[0014] In addition, the control means may instruct the imaging
means to perform a process in accordance with a shutter
manipulation at a timing at which a result detected by the motion
detecting means showing that motion is stopped is obtained.
[0015] Alternatively, the control means may instruct the imaging
means to perform a process in accordance with a shutter
manipulation at a timing at which a result detected by the motion
detecting means showing that it is estimated that motion will be
stopped is obtained.
[0016] In addition, in addition to a period during which the
shutter is being manipulated by the manipulating means, for a
predetermined period after a shutter manipulation, the control
means may instruct the imaging means to perform a process in
accordance with a shutter manipulation at a timing based on a
result detected in the motion detecting means.
[0017] In addition, the picture imaging apparatus according to the
embodiment of the invention may further include: a warning means
for outputting warning, wherein when a timing that instructs a
process in accordance with the shutter manipulation is not obtained
as a timing based on a result detected by the motion detecting
means, the control means allows the warning means to output a
warning.
[0018] An imaging control method according to an embodiment of the
invention is an imaging control method of a picture imaging
apparatus that performs a process of acquiring an image as a
subject picture in accordance with a shutter manipulation and
performs a process of storing taken picture data obtained by the
image acquiring process, the imaging control method including the
steps of: detecting the shutter manipulation; detecting motion of
the picture imaging apparatus itself during a shutter manipulation
period; and instructing a process in accordance with a shutter
manipulation at a timing based on a result detected in the motion
detecting step.
[0019] According to the embodiment of the invention, the picture
imaging apparatus and the imaging control method according to the
embodiment of the invention basically perform the processes of
acquiring and storing a taken picture in accordance with the
shutter manipulation. The picture imaging apparatus sets the timing
of instructing the process in accordance with the shutter
manipulation based on the motion of the apparatus itself, for
example, the detected result of the motion of the picture imaging
apparatus itself caused by the movement of the hands in taking a
picture. For example, during the period of the shutter
manipulation, a process in accordance with the shutter manipulation
is instructed at the timing at which the motion becomes the
smallest, whereby taken picture data at that timing is extracted
and stored.
[0020] According to the embodiment of the invention, even though
the movement of the hands in taking a picture happens to move the
picture imaging apparatus itself at the time at which a
photographer manipulates the shutter, taken picture data to be
stored is acquired (for example, one frame of taken picture data is
extracted which is data to be stored as a still picture) at the
timing based on the detected result of the motion of the picture
imaging apparatus itself. Therefore, taken picture data can be
obtained at the timing at which the motion of the picture imaging
apparatus itself is the smallest, that is, taken picture data with
no blur can be obtained.
[0021] In addition, since the image stabilizing function can be
implemented without adding a large scale mechanism or a process for
correcting blur, the apparatus configuration and processes can be
simplified, and a reduction in costs can be facilitated.
BRIEF DESCRIPTION OF THE DRAWINGS
[0022] FIG. 1 shows a block diagram depicting an imaging apparatus
according to an embodiment of the invention;
[0023] FIG. 2 shows an illustration depicting an exemplary imaging
process operation I in the imaging apparatus according to the
embodiment;
[0024] FIG. 3 shows a flow chart depicting an exemplary image
stabilizing process I according to the embodiment;
[0025] FIG. 4 shows an illustration depicting an exemplary imaging
process operation II in the imaging apparatus according to the
embodiment;
[0026] FIG. 5 shows a flow chart depicting an exemplary image
stabilizing process II according to the embodiment;
[0027] FIG. 6 shows an illustration depicting an exemplary imaging
process operation III in the imaging apparatus according to the
embodiment; and
[0028] FIG. 7 shows a flow chart depicting an exemplary image
stabilizing process III according to the embodiment.
DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0029] Hereinafter, embodiments of the invention will be described.
Discussions will be given in the following order. [0030] 1.
Exemplary configuration of an imaging apparatus [0031] 2. Exemplary
imaging process operation I [0032] 3. Exemplary imaging process
operation II [0033] 4. Exemplary imaging process operation III
[0034] 5. Modifications
1. Exemplary Configuration of an Imaging Apparatus
[0035] Here, for an exemplary picture imaging apparatus according
to the embodiment, for example, an imaging apparatus as a digital
still camera will be taken and described.
[0036] FIG. 1 shows a block diagram depicting the internal
configuration of an imaging apparatus 1.
[0037] As shown in the drawing, the imaging apparatus 1 has a
system controller 2, an imaging part 3, an imaging control part 4,
a display part 5, a display control part 6, a manipulation input
part 7, an acceleration sensor 8, a storage part 9, a sound output
part 10, and a bus 11.
[0038] For example, the system controller 2 is configured of a
microcomputer having a CPU (Central Processing Unit), a ROM (Read
Only Memory), a RAM (Random Access Memory), a non-volatile memory
part, and an interface part, which is a control part that controls
the overall imaging apparatus 1. Based on a program stored in the
ROM, the system controller 2 performs various computing processes,
sends and receives control signals with individual blocks through
the bus 11, and allows the individual blocks to do necessary
operations.
[0039] The imaging part 3 has an imaging optical system 3a, an
imaging device part 3b, and an imaging signal processing part
3c.
[0040] In the imaging optical system 3a in the imaging part 3, a
lens system configured of a diaphragm, a zoom lens, and a focus
lens is provided as well as a drive system that allows the lens
system to do focus operation and zooming operation.
[0041] In addition, in the imaging device part 3b in the imaging
part 3, a solid state imaging device array is provided that detects
imaging light obtained by the imaging optical system 3a for
photoelectric conversion to generate imaging signals. For example,
the solid state imaging device array is a CCD (Charge Coupled
Device) sensor array, or a CMOS (Complementary Metal Oxide
Semiconductor) sensor array.
[0042] In addition, in the imaging signal processing part 3c in the
imaging part 3, a sample hold/AGC (Automatic Gain Control) circuit
that adjusts gain or shapes waveforms for the signals obtained by
the solid state imaging device and a video A/D converter are
provided, in which taken picture data as digital data is obtained.
In addition, it performs white balance processing, brightness
processing, and color signal processing for taken picture data.
[0043] The imaging part 3 having the imaging optical system 3a, the
imaging device part 3b, and the imaging signal processing part 3c
images pictures and obtains taken picture data.
[0044] Picture data obtained through the imaging operation by the
imaging part 3 is processed in the imaging control part 4.
[0045] Under control performed by the system controller 2, the
imaging control part 4 performs a process that converts taken
picture data into a predetermined picture data format and a process
that supplies the converted taken picture data to the storage part
9 and the display control part 6 in accordance with the situations
of operation.
[0046] In addition, based on the instruction by the system
controller 2, the imaging control part 4 performs on/off control of
the imaging operation in the imaging part 3, drive control of the
zoom lens and the focus lens in the imaging optical system 3a,
control of the sensitivity and frame rate of the imaging device
part 3b, parameter control of individual processes in the imaging
signal processing part 3c, and the settings of working
processes.
[0047] For the configuration in which images are represented for a
user in the imaging apparatus 1, the display part 5, and the
display control part 6 are provided.
[0048] The display part 5 is provided with a display drive part
that drives a liquid crystal display to display images. The display
drive part is configured of a pixel drive circuit that displays
picture data supplied from the imaging control part 4 on a liquid
crystal display, for example. The pixel drive circuit applies a
drive signal based on a video signal to each pixel arranged on the
liquid crystal display in a matrix at a predetermined
horizontal/vertical drive timing for representations.
[0049] Based on control performed by the system controller 2, the
display control part 6 drives the pixel drive circuit in the
display part 5 to do a predetermined representation. In other
words, it allows representations as the imaging monitor in the
imaging part 3.
[0050] In addition, for these representations, for example,
brightness level adjustment, color correction, contrast adjustment,
and sharpness (edge enhancement) adjustment can be performed.
Moreover, image effect processes can be performed including
generating an enlarged image that a part of picture data is
enlarged, generating a scale down image, soft focus, mosaic,
brightness inversion, partial highlighting of an image
(highlighting), and changing the atmosphere of the entire
color.
[0051] For example, the manipulation input part 7 has operators
such as a key, a button, and a dial to form operators for use in
on/off manipulation of a power source, on/off manipulation of a
image stabilizing function, described later, and shutter
manipulation, zooming manipulation, expose setting manipulation,
and self-timer manipulation in the imaging system.
[0052] The manipulation input part 7 supplies information obtained
from these operators to the system controller 2, and the system
controller 2 performs necessary computing processes and control
corresponding to these items of information.
[0053] The acceleration sensor 8 detects the acceleration of the
motion of the imaging apparatus 1 itself, and supplies a signal
corresponding to the detected acceleration to the system controller
2.
[0054] For example, in the case in which a user uses the imaging
apparatus 1 to shoot a subject, the acceleration sensor 8 can
detect vibrations caused by a so-called movement of the hands in
taking a picture that the imaging apparatus 1 itself shakes caused
by vibrations of the user hands.
[0055] Then, the system controller 2 performs a process that
acquires the detected acceleration value of the motion of the
imaging apparatus 1 itself as a signal supplied from the
acceleration sensor 8.
[0056] The storage part 9 is used for storing various items of
data. For example, it is used for storing taken picture data.
[0057] The storage part 9 may be configured of a RAM or a solid
state memory such as a flash memory, or may be configured of a HDD
(Hard Disk Drive), for example.
[0058] In addition, the storage part 9 may not be a built-in
recording medium, which may be a recording and reproducing drive
dealing with a recording medium such as a portable recording
medium, for example, a memory card having a solid state memory
therein, an optical disk, a magneto-optical disk, and a hologram
memory.
[0059] Of course, a built-in memory such as a solid state memory
and a HDD as well as a recording and reproducing drive dealing with
a portable recording medium may be both mounted.
[0060] Based on control performed by the system controller 2, the
storage part 9 records and stores taken picture data.
[0061] In addition, based on control performed by the system
controller 2, the storage part 9 reads recorded data, and supplies
the date to the system controller 2 and the display control part
6.
[0062] For example, the sound output part 10 has a sound generating
part, a sound synthesizing part, an amplifier circuit and a
speaker, which outputs sounds such as a warning sound or a message
in accordance with the instruction from the system controller 2.
For example, in the case in which the system controller 2 instructs
the sound output part 10 to generate electronic sounds or perform
speech synthesis, the sound generating part 10 generates a sound
signal as a warning sound or a message speech, and amplifies the
generated sound signal by the amplifier circuit to output it as
sounds from the speaker.
[0063] As discussed above, the configuration of the imaging
apparatus 1 is described, but this is only an example. Of course,
it can be considered that various components may be added or
removed in accordance with the operations and functions actually
performed.
2. Exemplary Imaging Process Operation I
[0064] The imaging apparatus 1 according to the embodiment thus
configured performs the operation of an imaging process that
implements the image stabilizing function of preventing a taken
picture from being blurred because of effects caused by the
movement of the hands in taking a picture which is resulted from
user's shutter manipulation.
[0065] Hereinafter, the operation of the imaging process as the
embodiment will be described.
[0066] FIG. 2 shows changes in the detected acceleration values of
the downward motion of the imaging apparatus 1 detected in the
acceleration sensor 8 while a user is manipulating the shutter. In
FIG. 2, the horizontal axis depicts time, and the vertical axis
depicts the detected acceleration value. In addition, it is the
acceleration when the imaging apparatus 1 is moved in the downward
direction, but it is the same as the acceleration when the imaging
apparatus 1 is moved in the other three directions (the upward
direction, the right direction, and the left direction).
[0067] Moreover, the time instant at which a user starts
manipulating the shutter is indicated as time t0, the time instant
at which the user finishes manipulating the shutter is indicated as
time t2, and a period from the time t0 to the time t2 is indicated
as a shutter manipulation period. For example, the shutter
manipulation period is a period about 0.5 second to 2 seconds.
[0068] FIG. 2 shows the state in which from the time t0 at which
the user starts manipulating the shutter and later, because of
effects of the movement of the hands in taking a picture in
pressing a shutter key, for example, the imaging apparatus 1 itself
is moved to increase the detected acceleration value, and after
that, the detected acceleration value is zero at time t1.
[0069] Generally, the user is cautious not to move the hands in
taking a picture as much as possible in manipulating the shutter.
However, since the imaging apparatus 1 itself is often moved more
ore less when the user manipulates the shutter in one hand and the
user tries not to move the imaging apparatus 1 on the other hand,
the detected acceleration value as the motion of the imaging
apparatus 1 is often changed as shown in FIG. 2.
[0070] In a typical imaging apparatus, a shutter process is
performed in accordance with the shutter manipulation. The shutter
process is a process that stores one frame of a picture taken at
that timing. As described in FIG. 2, this operation is the
operation that at the time t0 at which a shutter manipulation is
detected, the system controller 2 instructs the imaging control
part 4 and the storage part 9 to perform the shutter process.
However, in this case, since a time lag also occurs between control
and processing, for example, one frame of taken picture data
acquired at the timing at which the acceleration is increasing is
stored as a still picture of an imaged result. More specifically, a
blurred picture is stored.
[0071] In contrast to this, in this embodiment, the timing at which
the system controller 2 instructs the imaging control part 4 and
the storage part 9 to perform the shutter process is decided based
on the result detected by the acceleration sensor 8 as shown in
FIG. 2 (hereinafter, an event that the system controller 2
instructs the imaging control part 4 and the storage part 9 to
perform processes of extracting and storing one frame of taken
picture data is referred to as a "shutter instruction")
[0072] For example, the system controller 2 gives a shutter
instruction in accordance with the value zero detected at the time
t1, and performs control over the operation of acquiring/storing
taken picture data in accordance with the shutter manipulation.
[0073] At the time t1 at which the detected value is zero, it is
the state in which the motion of the imaging apparatus 1 itself is
stopped and the hands are not moved in taking a picture. Thus, the
system controller 2 gives a shutter instruction at this timing to
perform control of recording the imaged taken picture data in the
storage part 9, and then the taken picture data that avoids effects
of the movement of the hands in taking a picture can be stored as a
subject picture.
[0074] In addition, for example, as shown in FIG. 2, the detected
acceleration value does not sometimes become zero within the period
in which the user is manipulating the shutter like the period from
the time t0 to time t2. Then, it is unable to obtain the timing of
giving a shutter instruction. In other words, it is unable to image
a picture in accordance with the user shutter manipulation
(acquiring/storing taken picture data). In this case, the system
controller 2 performs control that outputs a warning sound or a
warning message telling that the imaging apparatus 1 is moving in
speech from the sound output part 10, for example, whereby the user
is notified.
[0075] A process performed by the system controller 2 for
implementing such operation will be described with reference to
FIG. 3.
[0076] In addition, the process shown in FIG. 3 is performed based
on the program stored in the ROM incorporated in the system
controller 2 (processes shown in FIGS. 5 and 7, described later,
are the same).
[0077] Step F101 describes a monitoring process of a shutter
manipulation done by the user. If the user manipulates the shutter,
the system controller 2 advances the process to Step F102.
[0078] In Step F102, the detected acceleration value from the
acceleration sensor 8 is confirmed.
[0079] Then, in Step F103, it is confirmed whether the acceleration
is zero. Here, if it is determined that the detected acceleration
value is zero, the process goes to Step F104. On the other hand, if
it is determined that the detected value is not zero, the process
goes to Step F105.
[0080] In Step F105, the system controller 2 confirms whether the
shutter manipulation is finished. More specifically, it is
determined whether it is the state in which the user releases the
shutter key in the manipulation input part 7 (it is determined
whether the press of the shutter key is not detected). If the user
is still manipulating the shutter, the process returns to Step
F102.
[0081] For example, as shown in FIG. 2, in the case in which an
increase in the acceleration is detected from the time at which the
shutter is manipulated, it is not determined that the acceleration
is zero.
[0082] On this account, the processes in Steps from F103, F105,
F102, F103, F105 and so on are repeated while the acceleration is
being detected in Step F102.
[0083] The acceleration zero is detected at a certain time as the
detected result of the acceleration in Step F102, and then the
system controller 2 advances the process from Step F103 to Step
F104 for giving a shutter instruction.
[0084] Thus, the imaging control part 4 extracts one frame of taken
picture data obtained in the imaging part 3 at the timing of giving
a shutter instruction, performs a predetermined process, and
transfers the frame to the storage part 9 for making the frame an
imaged still picture. The storage part 9 performs the process that
records the transferred one frame of taken picture data on a
recording medium. More specifically, "taking a picture" instructed
by the shutter manipulation done by the user is to be
performed.
[0085] In addition, even though the user finishes manipulating the
shutter, the acceleration does not sometimes become zero. In this
case, the system controller 2 advances the process from Step F105
to Step F106.
[0086] In Step F106, the system controller 2 performs an warning
process. More specifically, the system controller 2 performs the
process that outputs a warning sound or a message telling that the
motion of the imaging apparatus 1 is not stopped in speech from the
sound output part 10.
[0087] For example, in this case, since the process does not reach
the shutter instruction in Step F104 and it is unable to "take a
picture" desired by the user, it is sufficient that the user is
notified of this.
[0088] In other words, it is sufficient to tell the user that the
warning sound is the sound indicating that taking a picture is
failed. Alternatively, such a scheme may be possible in which such
a message sound is outputted by synthetic speech that "Taking a
picture is failed. Please press the shutter with caution not to
move your hands".
[0089] The system controller 2 performs the process shown in FIG.
3, whereby taking a still picture can be implemented which avoids
effects of the movement of the hands in taking a picture. More
specifically, even though the hands are moved in taking a picture
when the user takes a picture of a subject with the imaging
apparatus 1, a taken picture is stored at the timing at which the
movement of the hands in taking a picture is stopped, whereby taken
picture data can be obtained which is not affected by the movement
of the hands in taking a picture.
[0090] In addition, the image stabilizing function like this is not
a mechanism provided in the lens system or in the imaging device
part 3b, for example, for avoiding effects of the movement of the
hands in taking a picture, or a function that corrects the movement
of the hands in taking a picture by signal processing for a taken
picture. Therefore, the image stabilizing function can be
implemented easily at low costs with no addition of a large scale
mechanism to the imaging apparatus 1, or no increase in processing
efforts.
3. Exemplary Imaging Process Operation II
[0091] In the operation of the imaging process that implements
image stabilization described above, at the time at which the
detected value is zero during the period in which the user is
manipulating the shutter, the system controller 2 gives a shutter
instruction to control the process of acquiring taken picture data
in accordance with the shutter manipulation.
[0092] However, in the actual operation, a time lag occurs more or
less until the imaging part 3 is allowed to take a picture of a
subject after the system controller 2 gives a shutter instruction
in response to the event that the detected value is zero. This time
lag occurs as the time difference between the stop of the actual
motion and the system controller 2 recognizing the acceleration
zero, and a time lag between the timing at which the system
controller 2 gives a shutter instruction to the imaging control
part 4 and the timing at which the imaging control part 4 performs
the process of extracting one frame.
[0093] Then, because of the time lag, taken picture data as a still
picture actually stored in the storage part 9 by the imaging
apparatus 1 is a picture at the time slightly shifted from the time
instant at which the detected value is zero. Particularly, in the
case in which the motion of the imaging apparatus 1 itself is
stopped for a moment and then the imaging apparatus 1 is moved,
taken picture data can be a picture at the time at which the
imaging apparatus 1 begins to move.
[0094] It can be considered that effects of the movement of the
hands in taking a picture are reduced because of the balance
between the shutter speed in the imaging device part 3b and the
speed of the motion of the imaging apparatus 1 itself, and then the
taken picture data obtained at the time at which the apparatus is
moved more or less is substantially a picture with almost no blur.
However, it is better that a frame image acquired at the timing of
the acceleration zero can be stored as much as possible.
[0095] Then, it can be also considered that the imaging apparatus 1
performs the process in which the system controller 2 gives a
shutter instruction at the time before the time at which the
detected value is zero, and then the extracting/storage process is
performed to extract/store picture data of a subject acquired at
the timing of the detected value zero. More specifically, a shutter
instruction is given at the timing at which such a detected result
is obtained that the motion of the imaging apparatus 1 itself is
predicted to stop.
[0096] The operation of the imaging process like this will be
described.
[0097] As similar to FIG. 2 described above, FIG. 4 shows changes
in the acceleration of the motion of the imaging apparatus 1
detected in the acceleration sensor 8 while the user is
manipulating the shutter.
[0098] In addition, a period from the time t0 to the time t12 is a
shutter manipulation period during which the user is manipulating
the shutter, and also as similar to the shutter manipulation period
shown in FIG. 2, this shutter manipulation period is a period about
0.5 second to 2 seconds, for example.
[0099] In the case shown in FIG. 4, the acceleration is increased
from the time t0 at which the user starts manipulating the shutter,
and after that, the detected acceleration value is zero at time
t11. Then, the system controller 2 gives a shutter instruction at
the timing of time t10, a predetermined time period a before the
time t11.
[0100] It is sufficient that this predetermined time period .alpha.
is computed and stored in advance as a time period (time lag) until
the imaging part 3 actually acquires one frame of taken picture
data after the system controller 2 gives a shutter instruction.
[0101] Then, the system controller 2 gives a shutter instruction at
the time t10 at which the detected value will be zero after a
predetermined time period .alpha..
[0102] However, because the system controller 2 is observing the
detected acceleration value, it is necessary to determine the
timing a predetermined time period .alpha. before from the detected
acceleration value. The following scheme can be considered to
achieve this.
[0103] For example, the system controller 2 computes the rate of
increase of the detected acceleration value from the time to as
shown in the drawing. Then, suppose the rate of increase (slope) of
the detected value is the same as the rate of decease (slope) of
the detected acceleration value while the acceleration slows toward
the time till. Based on this assumption, an acceleration value that
will be zero after a time period .alpha. can be computed. This
acceleration value corresponds to an acceleration value at the time
t10 in FIG. 4.
[0104] Then, the time at which the value reaches the computed
acceleration value is detected while the acceleration value is
decreasing (while the acceleration is becoming zero), and then it
is determined that the time (the time t10 shown in FIG. 4) is the
timing of giving a shutter instruction.
[0105] Alternatively, such a scheme may be possible in which a
predetermined value around the acceleration zero is set in a fixed
manner, and when the detected acceleration becomes a predetermined
value X around the acceleration zero, it is estimated that the
value will become the acceleration zero after a time period
.alpha.. In this case, it may be considered that the time at which
the value becomes a predetermined value X while the acceleration is
decreasing corresponds to the time t10 shown in FIG. 4.
[0106] As described above, the system controller 2 gives a shutter
instruction at the time t10 a predetermined time period .alpha.
before the time t11 at which the detected acceleration value is
zero, and then one frame of the picture at the timing of the time
t11 at which the detected acceleration value is zero can be
acquired as taken picture data in accordance with the shutter
manipulation.
[0107] Furthermore, in the case in which a value is not detected at
the time that is estimated as the time a predetermined time period
.alpha. before the time at which the detected acceleration value is
zero during the shutter manipulation period of the user, as similar
to the case described in FIG. 2, the system controller 2 allows the
sound output part 10 to output a warning sound or a warning message
by speech in sound output.
[0108] The process of the system controller 2 for implementing the
operation like this is shown in FIG. 5.
[0109] First, in the process from Step F201 to Step F202, the same
process as the process from Step F101 to Step F102 shown in FIG. 3
is performed.
[0110] In other words, it is determined whether the user
manipulates the shutter. If the user manipulates the shutter, in
Step F202, the detected acceleration value of the motion of the
imaging apparatus 1 itself supplied from the acceleration sensor 8
is confirmed.
[0111] Then, in Step F203, it is determined whether it is a timing
of giving a shutter instruction. In this case, the timing of giving
a shutter instruction is whether it is the timing corresponding to
the time t10 shown in FIG. 4. In other words, it is whether to be
the timing estimated a predetermined time period .alpha. before the
time instant at which the detected value will be zero.
[0112] In addition, since the motion of the imaging apparatus 1
caused by the movement of the hands in taking a picture is
completely changeable, unpredictable motion or halt sometimes
occurs. Therefore, also in the case in which it is unable to detect
the timing corresponding to the time t10 and the acceleration zero
is detected, preferably, it is the timing of giving a shutter
instruction.
[0113] In Step F203, if it is determined that it is not the timing
of giving a shutter instruction, the process goes to Step F205.
[0114] In addition, in Step F205, the system controller 2 confirms
whether the shutter manipulation is finished. More specifically, it
is determined whether it is the state in which the user releases
the shutter key in the manipulation input part 7 (it is determined
whether the press of the shutter key is not detected). If the user
is still manipulating the shutter, the process returns to Step
F202.
[0115] In Step F203, if it is determined that it is the time
instant a predetermined time period .alpha. before the time at
which the detected value is zero, it is the timing of giving a
shutter instruction, the process goes to Step F204, and then a
shutter instruction is given.
[0116] Thus, in accordance with the shutter instruction, the
imaging control part 4 extracts one frame of taken picture data
obtained in the imaging part 3 to perform a predetermined process
to make the frame an imaged still picture, and then transfers it to
the storage part 9. The storage part 9 performs a process that
records the transferred one frame of taken picture data on the
recording medium. More specifically, "taking a picture" instructed
by the shutter manipulation done by the user is performed.
[0117] In addition, even though the user finishes manipulating the
shutter, the timing of giving a shutter instruction may not be
sometimes detected. In this case, the process of the system
controller 2 goes from Step F205 to Step F206 for a warning
process. For example, the process is performed in which the sound
output part 10 outputs a warning sound or a message by speech
telling that it is unable to take a picture because the motion of
the imaging apparatus 1 is not stopped.
[0118] As described above, the operation of the image stabilization
process is performed to as well acquire taken picture data with no
effect caused by the movement of the user's hands in taking a
picture.
[0119] Furthermore, the system controller 2 gives a shutter
instruction at the time that is estimated as a time lag a
predetermined time period .alpha. before the time instant at which
it is estimated that the detected acceleration value is zero,
whereby taken picture data at the time at which the imaging
apparatus 1 is stable in consideration of the time lag for
processing can be acquired, which is also preferable in that a
picture with no blur can be acquired.
4. Exemplary Imaging Process Operation III
[0120] In the exemplary imaging process operations I and II
described so far, the detected acceleration value is zero or the
detected acceleration value becomes the value that is estimated to
be zero during the shutter manipulation period, and then a shutter
instruction is given. However, on the other hand, even though the
shutter manipulation is finished, it sometimes remains the state in
which the shutter instruction is still not performed. More
specifically, it is the case in which under the situations that the
movement of the hands in taking a picture is not stopped, the
process goes to Step F106 shown in FIG. 3 and Step F206 shown in
FIG. 5, and then a warning telling that it is unable to take a
picture is outputted.
[0121] Originally, since the imaging apparatus 1 takes a still
picture in response to the user manipulating the shutter (more
specifically, the timing at which the user intends to take a
picture), it is not adequate so much that a taken picture is
acquired/stored after the user finishes manipulating the
shutter.
[0122] However, on the other hand, in the process, it is possible
that taking a picture is not done because the movement of the hands
in taking a picture is not stopped during shutter manipulation. In
addition to this, it can be thought that the motion of the imaging
apparatus 1 is often stopped immediately after the user stops
manipulating the shutter.
[0123] In consideration of these, in a certain period after the
shutter manipulation is finished, a picture is taken depending
whether the motion caused by the movement of the hands in taking a
picture is stopped, and then the possibility of taking a picture in
accordance with user's intention of manipulating the shutter can be
made higher even though the shutter timing is shifted more or
less.
[0124] Then, an exemplary operation of the image stabilization
process will be described in which an extension period is set after
the shutter manipulation period is finished and taken picture data
can be acquired even though the detected value becomes zero
immediately after the user finishes manipulating the shutter.
[0125] As similar to FIGS. 2 and 4 described above, FIG. 6 shows
changes in the detected acceleration values of the motion of the
imaging apparatus 1 detected by the acceleration sensor 8 when the
user manipulates the shutter.
[0126] In addition, a period from time t0 to time t20 is a shutter
manipulation period during which the user is manipulating the
shutter, and as similar to the shutter manipulation period shown in
FIGS. 2 and 4, it is assumed that it is a period about 0.5 second
to 2 seconds, for example.
[0127] In the case shown in FIG. 6, during the period from the time
to at which the user starts manipulating the shutter to the time
t20 at which the shutter manipulation is ended, the acceleration is
not zero or around zero. In the case of the exemplary imaging
process operations I and II, in this situation, it is actually
unable to take a picture because the timing of giving a shutter
instruction is not obtained.
[0128] In this example, here, an extension period after the shutter
is manipulated is set, which is a period from the time t20 at which
the shutter manipulation period is finished to time t23, for
example. This extension period after the shutter is manipulated is
a period in which the system controller 2 performs a process that
recognizes a signal supplied from the acceleration sensor 8 and
gives a shutter instruction when the detected value is zero even
after the shutter manipulation period is finished. For example, it
is sufficient that the period is set to a period about a few
seconds (for example, about one second to ten seconds).
[0129] Then, as shown in the drawing, in the case in which the
detected value becomes zero at time t22, the system controller 2
gives a shutter instruction at the time t22 to control the process
of acquiring taken picture data in accordance with a shutter
manipulation.
[0130] Alternatively, in consideration of the time lag described in
the exemplary imaging process operation II, such a scheme may be
possible in which a shutter instruction is given at time t21 at
which it is estimated as the time a predetermined time period a
before the time t22 at which the detected value is zero.
[0131] As discussed above, the extension period is provided after
the shutter is manipulated, whereby a picture of a subject can be
imaged and the imaged taken picture data can be stored also in
coping with the case in which the motion of the imaging apparatus 1
is stopped immediately after the user finishes manipulating the
shutter.
[0132] The process of the system controller 2 for implementing this
process is shown in FIG. 7. First, in the process from Step F301 to
Step F305, the same process as the process from Step F101 to Step
F105 shown in FIG. 3 is performed.
[0133] More specifically, in Step F301, it is determined whether
the user manipulates the shutter. If the user manipulates the
shutter, in Step F302, this process is performed which recognizes
the detection signal of the acceleration of the motion of the
imaging apparatus 1 itself detected and supplied from the
acceleration sensor 8. Then, in Step F303, it is determined whether
the acceleration is zero.
[0134] Furthermore, in Step F303, if it is determined that the
acceleration is zero, in Step F304, a shutter instruction is given.
Thus, picture data taken during the shutter manipulation period is
acquired/stored.
[0135] However, as discussed above, the shutter manipulation is
sometimes finished as the acceleration zero is still not detected.
In this case, the process goes from Step F305 to the process after
Step F306.
[0136] In Step F306, a process is performed in which a message is
outputted. More specifically, since the motion of the imaging
apparatus 1 is not stopped and the user finishes manipulating the
shutter before a shutter instruction is given, such control is
performed that the sound output part 10 is allowed to output a
warning message to the user so as not to move the imaging apparatus
1. For example, a message telling that "Please do not move the
apparatus", or a warning sound is outputted.
[0137] In addition, in Step F307, a process is performed in which
counting an extension period after the shutter is manipulated is
started. More specifically, after the time at which the user
finishes manipulating the shutter, counting the extension period
after the shutter is manipulated is started.
[0138] Then, in Step F308, determinations are made in Steps F309
and F310 while the process is performed which recognizes the
detected acceleration value supplied from the acceleration sensor
8.
[0139] In other words, it is monitored whether the acceleration
becomes zero during the extension period after the shutter is
manipulated. Then, if it is determined that the detected
acceleration value is zero, the process goes to Step F304, and a
shutter instruction is given to perform acquiring/storing taken
picture data in accordance with the shutter manipulation.
[0140] On the other hand, if the extension period after the shutter
is manipulated is finished while the acceleration does not become
zero, the process goes to Step F311, and a warning is outputted.
For example, a message telling that it is unable to take a still
picture or an electronic sound is outputted from the sound output
part 10.
[0141] According to this process, even after the user finishes
manipulating the shutter, it is monitored whether the acceleration
becomes zero for a certain period, and a shutter instruction is
given depending whether the acceleration zero is detected. Thus,
the opportunity to acquire a picture with no blur is prolonged,
whereby the possibility of finishing the operation as it is unable
to take a picture can be reduced.
[0142] Particularly, a warning is outputted for attention in Step
F306 to allow the user to stop the motion of the imaging apparatus
1 itself after the user manipulates the shutter, which increases
the probability of successful imaging.
[0143] In addition, in Steps F303 and F309, it is determined
whether the acceleration becomes zero. From the idea similar to the
exemplary imaging process operation II, in consideration of the
time lag, such a scheme may be possible in which it is determined
whether it is the time that is estimated as the time a
predetermined time period .alpha. before the time at which the
detected value is zero.
5. Modifications
[0144] As discussed above, the embodiment of the invention has been
described, but the invention should not be restricted to the
embodiment described so far.
[0145] For example, such a scheme may be possible in which in the
operation of the image stabilizing process described so far, the
user can freely turn on/off the function by manipulating modes. The
image stabilizing function is turned off, whereby the system
controller 2 promptly gives a shutter instruction in response to
the user manipulating the shutter, and controls the process of
acquiring/storing taken picture data in accordance with the shutter
manipulation.
[0146] For example, preferably, in the case in which the user as a
photographer desires to intentionally obtain blurred picture data,
the user manipulates modes through the manipulation input part 7 to
turn off the image stabilizing function like the exemplary
process.
[0147] In addition, for warning output, in the embodiment, the
sound output part 10 outputs a warning in sound output. However,
such a scheme may be possible in which a warning is made by
outputting light with the use of a light emitting diode such as an
LED. Moreover, such a scheme may be possible in which the display
part 5 is allowed to display a message. Furthermore, such an
exemplary process can be thought that no warning is outputted.
[0148] In addition, for the process corresponding to the shutter
instruction, the imaging control part 4 extracts one frame of a
picture and it is stored in the storage part 9 as taken still
picture data. However, for the storage process, it may be thought
that data is sent to an external device. More specifically, such
operation is also included in the storage process according to the
embodiment of the invention in which a sending part is provided for
an external device and taken picture data is sent and stored in the
external device.
[0149] It should be understood by those skilled in the art that
various modifications, combinations, sub-combinations and
alterations may occur depending on design requirements and other
factors insofar as they are within the scope of the appended claims
or the equivalents thereof.
* * * * *