U.S. patent application number 09/736201 was filed with the patent office on 2001-04-19 for image processing device.
This patent application is currently assigned to FUJI PHOTO FILM CO., LTD.. Invention is credited to Uchida, Mitsuaki.
Application Number | 20010000315 09/736201 |
Document ID | / |
Family ID | 26505818 |
Filed Date | 2001-04-19 |
United States Patent
Application |
20010000315 |
Kind Code |
A1 |
Uchida, Mitsuaki |
April 19, 2001 |
Image processing device
Abstract
A test pattern which has an outputted image obtained by said
image processing executing normal image processing is used to
self-judge an image processor. Namely, image data of the above
described test pattern is transmitted to the image processor and
image processing is effected by the image processor. The image
outputted (the results of the image processing) from this image
processing and the original image are compared to each other. When
they do not correspond to each other, the image processing by the
current image processor is judged to be abnormal. In this case, the
image processing using the image processor (hard ware process) is
switched promptly and automatically to be emulated by an auto
set-up engine (soft ware process). Further, in the image processor
section, ordinarily, all of the three frame memories are used to
effect processes including reading of image data, image processing,
and outputting of image data at the same time and in parallel. For
example, image processing is switched in such a manner that when
any one of the frame memories is judged to be abnormal, two
remaining frame memories which are judged to be normal are used to
execute image processing.
Inventors: |
Uchida, Mitsuaki;
(Ashigarakami-gun, JP) |
Correspondence
Address: |
BIRCH STEWART KOLASCH & BIRCH
8110 GATEHOUSE ROAD
SUITE 500 EAST
FALLS CHURCH
VA
22042
US
|
Assignee: |
FUJI PHOTO FILM CO., LTD.
|
Family ID: |
26505818 |
Appl. No.: |
09/736201 |
Filed: |
December 15, 2000 |
Related U.S. Patent Documents
|
|
|
|
|
|
Application
Number |
Filing Date |
Patent Number |
|
|
09736201 |
Dec 15, 2000 |
|
|
|
09115758 |
Jul 15, 1998 |
|
|
|
Current U.S.
Class: |
382/305 ;
345/536; 345/556; 358/404 |
Current CPC
Class: |
H04N 1/00002 20130101;
H04N 1/00031 20130101; H04N 1/00082 20130101; H04N 1/00021
20130101; H04N 1/00045 20130101 |
Class at
Publication: |
382/305 ;
345/556; 358/404; 345/536 |
International
Class: |
G06K 009/54; G06K
009/60; H04N 001/00 |
Foreign Application Data
Date |
Code |
Application Number |
Jul 15, 1997 |
JP |
9-190025 |
Claims
What is claimed is:
1. An image processing device comprising: an image processor which
executes a predetermined image processing for image data; executing
means for executing by software the same image processing as the
image processing executed by said image processor; judging means
for judging whether the image processing executed by said image
processor is normal; and switching control means for, when image
processing executed by said image processor is judged to be
abnormal by said judging means, switching to said executing means
so that said executing means executes by software the same image
processing as the image processing executed by said image
processor.
2. An image processing device according to claim 1, wherein said
judging means judges whether the image processing executed by said
image processor is normal by comparing an outputted image obtained
by said image processor executing the image processing and an
outputted image obtained by said image processor executing normal
image processing.
3. An image processing device according to claim 1, further
comprising information means which reports that said image
processor is out of order when the image processing by said image
processor is judged to be abnormal by said judging means.
4. An image processing device according to claim 2, further
comprising information means which reports that said image
processor is out of order hen the image processing by said image
processor is judged to be abnormal by said judging means.
5. An image processing device, comprising: a plurality of memories;
judging means which judges whether each of said processing
executing means for, in a case in which said judging means judges
all of said memories to be normal, executing image processing by
using all of said memories, and in a case in which said judging
means judges at least one of said memories to be abnormal,
executing processing by using said memory judged to be normal.
6. An image processing device according to claim 5, wherein said
judging means writes predetermined image data into each of said
memories, reads image data written from each of said memories,
compares the read image data and said predetermined image data to
each other, and judges whether each of said memories is normal on
the basis of the results of said comparison.
7. An image processing device according to claim 5, further
comprising information means which reports that a memory/memories
is out of order when at least one of said memories is judged to be
abnormal by said judging means.
8. An image processing device according to claim 6, further
comprising information means which reports that a memory/memories
is out of order when at least one of said memories is judged to be
abnormal by said judging means.
9. An image processing device according to claim 5, further
comprising: processable size reporting means which previously
stores information about image sizes which can be processed
depending on whether said plurality of memories are normal, and
reports image sizes which can be processed when at least one of
said memories is judged to be abnormal by said judging means.
10. An image processing device according to claim 6, further
comprising: processable size reporting means which previously
stores information about image sizes which can be processed
depending on whether said plurality of memories are normal, and
reports image sizes which can be processed when at least one of
said memories is judged to be abnormal by said judging.
11. An image processing device according to claim 7, further
comprising: processable size reporting means which previously
stores information about image sizes which can be processed
depending on whether said plurality of memories are normal, and
reports image sizes which can be processed when at least one of
said memories is judged to be abnormal by said judging means.
12. An image processing device according to claim 8, further
comprising: processable size reporting means which previously
stores the information about image sizes which can be processed
depending on whether said plurality of memories are normal, and
reports the image size which can be processed when at least one of
said memories is judged to be abnormal by said judging means.
13. An image processing device, comprising: three memories; judging
means which judges whether each of said memories is normal; and
control means for executing processing, in which, when all of the
three memories is judged to be normal by said judging means, the
three memories are used to concurrently and repeatedly execute
three processes which are a reading process for reading image data,
image processing for the read image data, and an outputting process
for outputting image data for which image processing has been
completed, and when one of the three memories is judged to be
abnormal by said judging means, two memories which are judged to be
normal are used to repeatedly execute said three processes while
executing two processes out of said three processes
concurrently.
14. An image processing device according to claim 13, wherein said
judging means writes predetermined image data into each of said
memories, reads image data written from each of said memories,
compares the read image data and said predetermined image data to
each other, and judges whether each of said memories is normal on
the basis of the results of said comparison.
15. An image processing device according to claim 13, further
comprising information means which reports that a memory/memories
is out of order when at least one of said memories is judged to be
abnormal by said judging means.
16. An image processing device according to claim 14, further
comprising information means which reports that a memory/memories
is out of order when at least one of said memories is judged to be
abnormal by said judging means.
17. An image processing device according to claim 13, further
comprising: processable size reporting means which previously
stores information about image sizes which can be processed
depending on whether said plurality of memories are normal, and
reports image sizes which can be processed when at least one of
said memories is judged to be abnormal by said judging means.
18. An image processing device according to claim 14, further
comprising: processable size reporting means which previously
stores information about image sizes which can be processed
depending on whether said plurality of memories are normal, and
reports image sizes which can be processed when at least one of
said memories is judged to be abnormal by said judging means.
19. An image processing device according to claim 15, further
comprising: processable size reporting means which previously
stores information about image sizes which can be processed
depending on whether said plurality of memories are normal, and
reports image sizes which can be processed when at least one of
said memories is judged to be abnormal by said judging means.
20. An image processing device according to claim 16, further
comprising: processable size reporting means which previously
stores information about image sizes which can be processed
depending on whether said plurality of memories are normal, and
reports image sizes which can be processed when at least one of
said memories is judged to be abnormal by said judging means.
Description
BACKGROUND OF THE INVENTION
1. 1. Field of the Invention
2. The present invention relates to an image processing device, and
more particularly to an image processing device in which image
processing is executed for image data read from a film image or the
like, and image data inputted from external devices such as a
personal computer (PC) and the like, and which outputs the results
of the image processing.
3. 2. Description of the Related Art
4. Conventionally, an image processing device has been known in
which a film image recorded on a photographic film is read by an
image reading device having a reading sensor such as a CCD (charge
coupled device), image processing including expansion and/or
compression, various types of correction and the like are effected
on the basis of image data provided by reading a film image or the
like, and image data inputted from external devices such as a
personal computer and the like, and images are thereby recorded on
recording materials or displayed on a display screen.
5. An image processor is mounted on such a conventional image
processing device as hard ware (an image processing board) which is
used exclusively for carrying out such a predetermined image
processing as described above. By this image processor, image
processing has been effected at a high processing rate on the basis
of image data which is read by a scanner or the like or image data
inputted from the external PC or the like.
6. Since the above-described image processor is made of hardware,
when it is used for a long period of time, the components which are
used for forming the processor can deteriorate. Accordingly, sooner
or later, the image processor may fail.
7. Because the image processor is not an expendable product but an
expensive member, when it is out of order, it often takes time to
supply and replace another image processor for the broken image
processor. For this reason, when the image processor is broken, the
image processing device cannot be used for a long period of
time.
8. Therefore, a method, in which when one image processor is
broken, it can be replaced by other image processors through
installing a plurality of image processors in the image processing
device, has been thought of. However, with this method, as
described above, because image processors are expensive, a problem
arises in that manufacturing costs for the image processing device
is extremely high.
9. For this reason, when an image processor is out of order, an
alternative means which can replace the image processor and
continue image processing has been long awaited.
10. Further, an image processing in such an image processing device
as described above is effected with higher processing rate for a
large amount of image data. Indeed, various types of image
processing devices in which a plurality of frame memories for
storing image data is provided and three processes including
reading of image data, image processing, and outputting of image
data for which image processing has been completed are effected
concurrently by using the plurality of the frame memories have
actually been provided.
11. However, a technical problem may be caused in that although
image processing can be effected with a high processing rate, when
one of a plurality of the memories is out of order, the
aforementioned three processes cannot be processed concurrently so
that image processing is thereby interrupted.
SUMMARY OF THE INVENTION
12. In order to solve the above-described problems, it is an object
of the present invention to provide an image processing device in
which image processing can be continued even when an image
processor is out of order. It is another object of the present
invention to provide an image processing device in which image
processing can be continued even when one of a plurality of
memories is out of order.
13. In order to accomplish the first object, a first aspect of the
present invention is an image processing device comprising: an
image processor which executes a predetermined image processing for
image data; executing means for executing by software the same
image processing as the image processing executed by the image
processor; judging means for judging whether the image processing
executed by the image processor is normal; and switching control
means for, when image processing executed by the image processor is
judged to be abnormal by the judging means, switching to the
executing means so that the executing means executes by software
the same image processing as the image processing executed by the
image processor.
14. A second aspect of the present invention is an image processing
device according to the first aspect, wherein the judging means
judges whether the image processing executed by the image processor
is normal by comparing an outputted image obtained by the image
processor executing the image processing and an outputted image
obtained by the image processor executing normal image
processing.
15. In the image processing device according to the first aspect of
the present invention, a predetermined image processing is executed
on the basis of image data (for example, image data obtained by
reading the image by a scanner or the like or image data inputted
from external devices). Because an image processor is manufactured
exclusively for a predetermined image processing, the image
processing using the image processor can be effected at a high
processing rate.
16. Further, the image processing device according to the first
aspect of the present invention, comprises: executing means in
which the same image processing which has been effected by the
image processor is effected through a software (namely, image
processing is emulated); and judging means which judges whether the
image processing through the image processor is normal.
17. The judging means judges whether the image processing using the
current image processor is normal. In the same manner as the second
aspect of the present invention, the judging means executes an
image processing using the image processor on the basis of the
original image data, and compares an outputted image obtained by
the image processor executing image processing and an outputted
image obtained by the image processor executing normal image
processing. When they correspond to each other, the judging means
judges that the image processing by the image processor is normal.
When they do not correspond to each other, the judging means judges
that the image processing by the current image processor is
abnormal.
18. Moreover, it is desired that the above-described judging using
the judging means is effected periodically (for example, at the
start-up time every morning) and immediately when the operator
instructs the image processing device to implement this judging
means.
19. When the image processing executed by the image processor is
judged to be abnormal by the judging means, switching control means
switches to the executing means so that the executing means
executes through software the same image processing as the image
processing executed by the current image processor. However, in
this case, because image processing is merely emulated by the
executing means, the processing rate of image processing using
software is lower than the processing rate at which the image
processing is executed by the image processor which is used
exclusively for image processing.
20. As described above, when the image processor is out of order,
the switching control means switches to the executing means so that
the executing means executes by software the same image processing
as the image processing executed by the image processor, image
processing can be continued without being disabled (interrupted)
until another image processor is prepared.
21. In order to accomplish the second object of the present
invention, a third aspect of the present invention is an image
processing device, comprising: a plurality of memories; judging
means which judges whether each of the memories is normal; and
processing executing means for, in a case in which the judging
means judges all of the memories to be normal, executing image
processing by using all of the memories, and in a case in which the
judging means judges at least one of the memories to be abnormal,
executing processing by using the memory judged to be normal.
22. The image processing device according to the fourth aspect of
the present invention, comprises three memories; judging means
which judges whether each of the memories is normal; and control
means for executing processing when all of the three memories is
judged to be normal by the judging means, the three memories are
used to concurrently and repeatedly execute three processes which
are a reading process for reading image data, image processing for
the read image data, and an outputting process for outputting image
data for which image processing has been completed, and when one of
the three memories is judged to be abnormal by the judging means,
two memories which are judged to be normal are used to repeatedly
execute the three processes while executing two processes out of
the three processes concurrently.
23. The image processing device according to the third aspect of
the present invention comprises: judging means which judges whether
each of the memories is normal. When all of the memories are judged
to be normal by the judging means, all of the memories are used to
effect image processing by the processing means.
24. Meanwhile, when at least one of the memories is out of order
and it is judged to be abnormal by the judging means, the
processing executing means implements further image processing
without being interrupted by using the memories which are judged to
be normal. For example, if the image processing device has three
memories or more, when one of the memories has already been out of
order, while another one is newly out of order, the control means
implements further image processing by using the one remaining
memory alone and without the aforementioned memories which are
judged to be abnormal.
25. Accordingly, even when one or more of a plurality of memories
is out of order, the current image processing can be continued
without being interrupted.
26. In the image processing device according to the fourth aspect
of the present invention, when all three memories are normal, the
control means effects three processes by using all three memories.
The three processes include the image reading process for reading
image data, the image processing for the image data read, and the
outputting process for outputting image data for which image
processing has been completed. In this way, when all of the three
memories are used for image processing, the processing rate is
three times higher than when one memory is used.
27. When one of the three memories is out of order, it is judged to
be abnormal by the judging means. In the control means, two
memories which are judged to be normal are used to effect two
processes out of the three processes concurrently, while the three
processes are being implemented repeatedly.
28. Even when one of the memories is out of order, image processing
can be continued without being disabled. In this case, although
processing efficiency may drop, image processing can be effected
with twice the efficiency of just one memory.
29. It is preferred that the above-described judging by the judging
means is executed periodically, and at the moment when the operator
instructs the image processing device to execute the judgment.
30. Methods in which memory failure and processable image sizes are
reported to the operator or the service man can be effected by
displaying messages or image size information on a computer screen,
by a spoken message from a speaker or the like, or by writing in a
printing paper a message or image size information. Further, it is
very effective to send a message about memory failure by e-mail to
a service man.
BRIEF DESCRIPTION OF THE DRAWINGS
31. FIG. 1 is a schematic block diagram illustrating a digital lab
system according to an embodiment of the present invention.
32. FIG. 2 is a schematic structural block diagram illustrating an
image processing section.
33. FIG. 3 is a view which explains a switching function in an
image process at the image processing section.
34. FIG. 4 is a view which explains three steps for carrying out
image processing at an image processor section.
35. FIG. 5A is a view which illustrates time changes for the steps
which are executed by using each frame memory when all of the frame
memories are normal (at an ordinary time).
36. FIG. 5B is a view which illustrates time changes for the steps
which are executed by using frame memories 142B and 142C when a
frame memory 142A is out of order.
37. FIG. 6 is a flow chart which illustrates a control routine of a
self-judgment process.
38. FIG. 7 is a flow chart which illustrates a control routine of a
confirmation process after switching of the image processor.
39. FIG. 8A is a flow chart which illustrates a control routine of
a memory judgment process and an image processing control process
according to the present embodiment.
40. FIG. 8B is a flow chart which illustrates the control routine
of the memory judgment process and the image processing control
process according to the present embodiment.
41. FIG. 9 is a flowchart which illustrates a subroutine of the
memory judgment process.
DESCRIPTION OF THE PREFERRED EMBODIMENTS
42. A detailed description of an embodiment of the present
invention will be given hereinafter with reference to the drawings.
Further, hereinafter, the present invention will be explained by
using values which cause no damage to the present invention.
However, the present invention is not limited to the values which
will be described below. Moreover, a description of a digital lab
system according to the present invention will be given
hereinafter. The digital lab system is used at a relatively small
size lab, i.e., a so-called mini lab.
43. [A schematic structure of the entire system]
44. A digital lab system 10 according to the present embodiment is
shown in FIG. 1. The lab system 10 is structured by an input
section which has an area CCD scanner 12, a line CCD scanner 14,
and an image processing section 16, and an output section which has
a laser printer section 18 and a processor section 20.
45. The area CCD scanner 12 and the line CCD scanner 14 are used to
read film images recorded on a photographic film such as a negative
film, a reversal film or the like. For example, the area CCD
scanner 12 can read film images formed on a 135 size-photographic
film, a 110 size-photographic film, and a photographic film having
a transparent magnetic layer formed thereon (a 240
size-photographic film: a so-called APS film). The line CCD scanner
14 can read film images which are formed on a 120 size-photographic
film and a 220 size-photographic film (both films are Brownie
size).
46. The area CCD scanner 12 and the line CCD scanner 14 read the
aforementioned film images by an area CCD and a line CCD, and
output image data. Further, the digital lab system 10 does not have
to comprise both the area CCD scanner 12 and the line CCD scanner
14. For example, when the size of the photographic film whose film
images are supposed to be read is limited, either the area CCD
scanner 12 or the line CCD scanner 14 (e.g., the area CCD scanner
12) can be provided at the digital lab system 10. Further, instead
of the area CCD scanner 12 and the line CCD scanner 14, a scanner
which can read all film images on photographic films formed of all
sizes (preferably, a line scanner) can be provided.
47. The image processing section 16 is structured so that image
data (image data scanned) outputted from the area CCD scanner 12 or
the line CCD scanner 14 is inputted thereto, and image data
obtained by digital camera photography, image data obtained by
reading documents other than film images (for example, a reflecting
document or the like), image data created by a computer, or the
like (hereinafter, these data are all referred to as file image
data) are inputted from external portions (for example, data is
inputted via a storage medium such as a memory card or the like, or
data is inputted from other information processing devices via a
communication line or the like).
48. The image processing section 16 executes various image
processings such as correction and the like for image data
inputted, and outputs the inputted image data to the laser printer
section 18 to be printed. Further, the image processing section 16
outputs image data from which image processing has been effected
(for example, data is outputted to a storage medium such as a
memory card or the like, data is transmitted to another information
processing devices via a communication line, or the like).
49. The laser printer section 18 comprises a laser (light) source
which is formed by R, G, B. The modulated laser light is irradiated
onto printing paper in accordance with image data which is supposed
to be recorded, inputted from the image processing section 16, and
the image inputted is recorded on printing paper through
scanning/exposure. Further, in the processor section 20, each of
the processings such as color developing, bleaching/fixing,
washing, and drying is effected on printing paper on which images
have been formed through scanning/exposure in the laser printer
section 18.
50. [Structure of an image processing section]
51. Next, a description of the structure of the image processing
section 16 relating to the present invention is given with
reference to FIG. 2. An area scanner correction section 120
corresponding to the area CCD scanner 12, and a line scanner
correction section 122 corresponding to the line CCD scanner 14 are
provided in the image processing section 16.
52. The area scanner correction section 120 is provided with a dark
correction circuit 124, a defective pixel correction section 128,
and a bright correction circuit 130. The dark correction circuit
124 stores image data inputted from the area CCD scanner 12 for
each pixel in a state in which the area CCD is shielded by a
shutter on the light irradiated side thereof (data representing
dark outputting level of the area CCD) and corrects image data by
reducing the dark outputting level for each pixel on the basis of
the image data scanned, which is inputted from the area CCD scanner
12.
53. Further, photoelectric transfer characteristics of the area CCD
may vary for each CCD cell unit. In the bright correction circuit
130 which is provided downstream of the defective pixel correction
section 128, a film image which is used for adjustment and whose
entire image screen has a fixed density is set at the area CCD
scanner 12 and is read by the area CCD. Image data for the film
image for adjustment is inputted from the area CCD scanner 12. On
the basis of the inputted image data for the film image for
adjustment, gains are determined for each pixel (variations of
density for each pixel are caused by those of photoelectric
transfer characteristics inherent in each CCD cell). In this way,
the bright correction circuit 130 corrects image data to be read
which is inputted from the area CCD scanner 12, for each pixel.
54. On the other hand, in image data of the film image for
adjustment, when some specified pixels are largely different from
others in their densities, the CCD cells corresponding to the
specified pixels are abnormal in some points, and accordingly, the
specified pixels can be judged to be defective pixels. The
defective pixel correction section 128 operates in such a way that
it stores addresses of the defective pixels on the basis of image
data for adjustment of the film image, and interpolates data for
the defective pixels among image data to be read of the film image
which is inputted from the area CCD scanner 12 with data for
surrounding pixels.
55. The line scanner correction section 122 has three signal
processing systems including the aforementioned dark correction
circuit 124, the defective pixel correction section 128, and the
bright correction circuit 130, and it processes image data
comprising R, G, B which are outputted in parallel from the line
CCD scanner 14. Further, in the line CCD, three lines (a row of CCD
cells) are sequentially disposed so as to be spaced apart from each
other at a predetermined distance along the transport direction of
a photographic film. Accordingly, the timing at which image data
for each of the component colors R, G, and B is outputted from the
line CCD scanner 14 differs. The line scanner correction section
122 delays the output timing of image data with different timing
for each of the component colors R, G, and B in such a way that R,
G, and B image data having the same pixels are outputted
concurrently on the film image.
56. The output ends of the area scanner correction section 120 and
the line scanner correction section 122 are connected to the input
end of the selector 132. Image data outputted from the correction
sections 120 and 122 are inputted to the selector 132. The input
end of the selector 132 is also connected to the data output end of
the I/O controller 134. File image data inputted from the external
portion is inputted to the selector 132. The output end of the
selector 132 is connected to the data input ends of the I/O
controller 134 and image processor sections 136A and 136B,
respectively. The selector 132 can selectively output the image
data inputted to each of the I/O controller 134, and the input
image processor sections 136A and 136B.
57. The image processor section 136A includes a memory controller
138, an image processor 140, and three frame memories 142A, 142B,
and 142C. Each of the frame memories 142A, 142B and 142C has a
storage capacity which can store image data of a single film image,
and image data inputted from the selector 132 is stored in any one
of three frame memories 142. However, the memory controller 138
controls addresses which are used when image data is stored in the
frame memories 142 so that data for each pixel of the inputted
image data is stored in parallel in a fixed order in the storage
area of each of the frame memories 142.
58. The image processor 140 fetches image data stored in the frame
memory 142, and executes various types of image processings
including gradation conversion, color conversion, and hyper tone
processing by which the gradation of super low frequency bright
components of an image are compressed, hyper sharpness processing
by which the sharpness of an image is emphasized while image
graininess is controlled, or the like. Further, processing
conditions of the above-described image processing are
automatically computed by an auto set-up engine 144 (which will be
described later). An image processing is effected depending on the
computed processing conditions. The image processor 140 is
connected to the I/O controller 134, and image data for which image
processing has been completed is temporarily stored in the frame
memory 142, and is thereafter outputted to the I/O controller 134
at a predetermined timing. Moreover, because the image processor
section 136B is structured in the same manner as the aforementioned
image processor section 136A, a description thereof will be
omitted.
59. In the present embodiment, data is read twice in the area CCD
scanner 12 or the line CCD scanner 14, for each film image. In the
first reading (hereinafter, it is referred to as a prescanning),
when the film image has an extremely low density (for example, an
overexposed negative image on a negative film), the reading of the
film image is executed under the reading conditions which have been
determined such that the area CCD 42 or the line CCD 116 is not
saturated with accumulated charges. Image data which is obtained
through the prescanning (prescanned image data) is inputted from
the selector 132 to the I/O controller 134, and is further
outputted to the auto set-up engine 144 which is connected to the
I/O controller 134.
60. The auto set-up engine 144 is structured so that it comprises
CPU 146, RAM 148 (for example, DRAM), ROM (for example, ROM in
which the storage contents can be rewritten), and I/O port 152,
which are connected to each other via a bus 154.
61. On the basis of the prescanned image data of the film image,
which is equal to a plurality of frames which are inputted from the
I/O controller 134, the auto set-up engine 144 computes processing
conditions of image processing for image data which is obtained by
fine scanning (fine scanned image data), and it outputs the
computed processing conditions to the image processor 140 of the
image processor section 136. In a computation of processing
conditions in image processing, it is determined whether there are
a plurality of film images in which similar scenes have been
photographed on the basis of the exposure amount at the time of
filming, the type of photographic light source, or other
characteristics. When there are a plurality of film images in which
a plurality of similar scenes have been photographed, image
processing conditions for fine scanned image data of these film
images are determined to be approximate or the same as each
other.
62. Further, the optimum conditions for image processing may vary
depending upon whether image data for which image processing has
been completed is used for recording an image on printing paper in
the laser printing section 18, whether it is outputted to the
external portion, or the like. Since the image processing section
16 has two image processor sections 136A and 136B, for example, if
image data is used for recording an image on printing paper, and it
is outputted to the external portion, the auto set-up engine 144
computes the optimum processing conditions in accordance with
respective purposes, and outputs the computed conditions to the
image processor sections 136A and 136B. Accordingly, in the image
processor sections 136A and 136B, image processing is executed
under different processing conditions for the same fine scanned
image data.
63. Further, on the basis of the prescanned image data which has
been inputted from the I/O controller 134, the auto set-up engine
144 computes image recording parameters which define gray balance
or the like when an image is recorded on printing paper with the
laser printer section 18, and outputs the computed parameters at
the same that image data to be recorded (will be described later)
is outputted to the laser printer section 18.
64. The I/O controller 134 is connected to the laser printer
section 18 via an I/F circuit 156. When image data for which image
processing has been completed is used for recording an image on
printing paper, image data for which image processing has been
executed at the image processor section 136 is outputted from the
I/O controller 134 via an I/F circuit 156 to the laser printer
section 18 as image data for recording. Further, the auto set-up
engine 144 is connected to the personal computer 158. When image
data for which image processing has been completed is outputted to
the external portion as an image file, image data for which image
processing has been effected in the image processor section 136 is
outputted to the personal computer 158 from the I/O controller 134
via the auto set-up engine 144.
65. The personal computer 158 comprises a CPU 160, a memory 162, a
display 164, a key board 166, a hard disk 168, a CD-ROM driver 170,
a transport control section 172, an expansion slot 174, an image
compression/expansion section 176 and a communication control
section 175, which are connected to each other via a bus 178. The
transport control section 172 is connected to a film carrier 38,
and it controls the transport of photographic film by the film
carrier 38. Further, when an APS film is set on the film carrier
38, the information which is read by the film carrier 38 from a
magnetic layer of the APS film (for example, image recording size
or the like) is inputted. A communication wire 177 is connected to
the communication control section 175, and it is structured so that
e-mail can be sent from the personal computer 158 to the external
information processing device (i.e., a personal computer or the
like which is installed at a station where a service man is
standing by.)
66. A driver (not shown) which reads/writes data for a storage
medium such as a memory card or the like and a communication
controller which communicates with another information processing
device are connected to the personal computer 158 via the expansion
slot 174. When image data to be outputted from the I/O controller
134 to the external portion is inputted, the image data is
outputted to the external portion (the aforementioned driver, the
communication controller or the like) as an image file, via the
expansion slot 174. Further, when the file image data is inputted
from the external portion via the expansion slot 174, the inputted
file image data is outputted to the I/O controller 134 via the auto
set-up engine 144. In this case, the I/O controller 134 outputs the
inputted file image data to the selector 132.
67. The image processing section 16 outputs the prescanned image
data or the like to the personal computer 158, displays the film
image which is read by the area CCD scanner 12 and the line CCD
scanner 14 on the display 164, and displays the assumed image which
may be obtained by recording the film image onto printing paper.
When modifications or the like of the image are instructed by an
operator via the key board 166, the instructions can be reflected
on the image processing conditions.
68. As will be described later, the image processing section 16
according to the present embodiment has a self judgment function
and a switching function. The self judgment function judges whether
the image processing is executed normally by the image processor
140. The switching function terminates image processing by the
image processor 140, and automatically switches image processing so
as to be effected by an auto set-up engine 144 when the image
processing using the image processor 140 is judged to be abnormal.
For this reason, in the image processing section 16, as shown in
FIG. 3, ordinarily, image processing (hardware processing shown in
FIG. 3) is effected by the image processor 140 which is made as an
exclusive processor for carrying out image processing. However,
when image processing by the image processor 140 is judged to be
abnormal due to a failure or the like, image processing is
automatically switched by the auto-set-up engine 144 so that the
emulation which is a similar processing to the image processing of
the image processor 140 is executed.
69. As will be described later, the auto set-up engine 144
according to the present embodiment has a memory judging function,
a switching function, and a processable size reporting. The memory
judging function judges whether each of the frame memories 142A,
142B, and 142C is normal. When at least one of the frame memories
is abnormal, the switching function switches the current image
processing to another image processing by using the remaining
normal frame memories. When at least one of the frame memories is
judged to be abnormal, the user/ operator is informed of image
sizes which can be processed on the basis of the number of frame
memories which are normal at this time through the processable size
reporting means.
70. FIG. 4 shows the flow of image data for the image processing
which is executed in the image processor section 136. As shown in
FIG. 4, in the image processor section 136, image processing is
executed in the following three steps. Further, as described above,
the memory controller 138 of the image processor section 136
controls storage addresses which are involved when image data is
stored in the frame memory 142. Accordingly, in FIG. 4, the memory
controller 138 is drawn on both sides of the frame memories 142,
where image data is input or output.
71. In the image processor section 136, image data which is
transmitted from the selector 132 of FIG. 2 is read by any one of
the frame memories 142 (step A: reading of image data). Next, image
data is read from the frame memory 142, and image processing by the
image processor 140 is executed, and image data for which image
processing has been completed is rewritten in the frame memory 142
(step B: image processing). Thereafter, image data for which image
processing has been executed is read from the frame memory 142 and
outputted (step C: outputting of image data).
72. When such image processing is execute at the image processor
section 136, as shown in FIG. 5A, ordinarily, all of the three
frame memories are used to effect the aforementioned three steps
concurrently, repeatedly and sequentially. For example, at time
t.sub.1, the frame memory 142A is used to start implementing step
A. At time t.sub.2, the frame memory 142A is used to start
implementing step B, and the frame memory 142B is used to start
implementing step A. At time of t.sub.3, the frame memory 142A is
used to start implementing step C, the frame memory 142B is used to
start implementing step B, and the frame memory 142C is used to
start implementing step A. In this way, image processing is
implemented by changing steps per time period T with each frame
memory.
73. In this state, for example, when the frame memory 142A is
judged to be abnormal, as shown in FIG. 5B, the auto set-up engine
144 automatically switches the current image processing to another
image processing at the image processor section 136. Namely, the
auto set-up engine 144 switches the processing at the image
processor section 136 so that three steps are effected sequentially
and repeatedly, while a concurrent processing is applied to two
steps by using the remaining normal frame memories 142B and
142C.
74. [Operation of the present embodiment]
75. A description of operation according to the present embodiment
in which the aforementioned self judgment and switching functions
are processed will be given hereinafter.
76. FIG. 6 shows a self judgment process in the image processing
section 16. The CPU 146 of the auto set-up engine 144 starts the
self judgment process when an operator instructs it to carry out
this self judgment process through a keyboard, or when it is set to
work periodically at a predetermined time (for example, at starting
up time every morning).
77. In Step 202 in FIG. 6, the CPU 160 of the personal computer 158
must read from the hard disk 168 the original test pattern image
data having an outputted image obtained by the image processor
executing normal image processing (hereinafter, it is simply
referred to as the original image data). The original image data is
sent from the hard disk 168 to the image processor 140 via the bus
178, the I/O port 152, the I/O controller 134, the selector 132,
and the memory controller 138. In Step 204, image processing for
the original image data is implemented.
78. In Step 206, the outputted image from the image processor 140
is fetched via the I/O controller 134, the I/O port 152, and the
bus 154, and the outputted image and the original image are
compared to each other.
79. In accordance with the results of the comparison, when the
image outputted from the image processor 140 and the original image
are the same, the image processing by the image processor 140 can
be judged to be normal. Accordingly, the routine proceeds to Step
214, where the operator is given information to this effect on the
display 164 of the personal computer 158. In this case, image
processing is continued by the image processor 140 at high
speed.
80. On the other hand, in Step 208, when the outputted image from
the image processor 140 and the original image are different, the
image processing by the image processor 140 is judged to be
abnormal. Accordingly, the routine proceeds to Step 210, where the
current image processing using the image processor 140 is
suspended, and is switched so as to emulate the image processing
using the auto set-up engine 144.
81. Thereafter, the CPU 146 of the auto set-up engine 144
temporarily stores in RAM 148, image data which is transmitted via
the selector 132, the I/O controller 134, the I/O port 152, and the
bus 154, reads from ROM 150, a program having the same processing
contents as the image processing using the image processor 140 so
that the image processing for the image data which has been
temporarily stored is emulated. The processing rate of emulation of
the image processing is lower than that of the image processing
using the image processor 140. However, it is possible to continue
image processing for image data.
82. Further, in Step 212, the operator is informed by the display
164 of the PC 158 that the image processing using the image
processor 140 is abnormal and the current image processing has been
switched to emulation of the image processing by the auto set-up
engine 144.
83. By using such processings as described above, even when the
image processor 140 is abnormal and the current image processing
using the image processor 140 cannot be executed correctly, it is
possible to detect quickly whether the image processing is abnormal
by a judging using the aforementioned test pattern and to switch
the current image processing so as to be emulated by the auto
set-up engine 144. Thus, even when the image processor 140 is out
of order, image processing can be continued free of trouble until
the image processor 140 is replaced.
84. Moreover, when the image processing by the image processor 140
is judged to be abnormal, because the operator is immediately
informed that image processing in the image processor 140 is
abnormal, the operator can recognize it quickly and handle the
problem by preparing another image processor 140, or the like.
85. Further, after a new image processor has been replaced by a
service man or an operator, a confirmation process which is shown
in FIG. 7 is executed by the CPU 146 of the auto set-up engine
144.
86. In Steps 202 to 208 in FIG. 7, in the same manner as the self
judgment process in FIG. 6, the original image data is outputted to
the new image processor 140. An image processing is executed for
the original image data using the image processor 140. The
outputted image and the original image are compared to each
other.
87. By this comparison, when the outputted image from the new image
processor 140 and the original image are the same, since the image
processing using the new image processor 140 can be judged to be
normal, the routine proceeds to Step 215, where emulation of image
processing which until this stage has been effected temporarily by
the auto set-up engine 144 is suspended, and the image processing
is switched so as to be executed by using the new image processor
140. In Step 217, the operator is informed by the display 164 of
the PC 158 that the image processor 140 in Step 215 is judged to be
normal.
88. On the other hand, when the outputted image from the new image
processor 140 and the original image are different, the image
processing using the new image processor 140 can be judged to be
abnormal. Accordingly, the routine proceeds to Step 211, where the
operator is informed that the image processing by the new image
processor 140 is abnormal, and a second image processor 140 switch
is demanded. Therefore, the operator can immediately recognize that
the image processor 140 is abnormal, and thereby promptly switch
the image processor 140 for another image processor 140.
89. Further, in the above-described embodiment, an example in which
the image processing is emulated by the auto set-up engine 144 when
the image processor 140 fails has been explained. However, instead
of the auto set-up engine 144, a personal computer 158 can emulate
the image processing so that effects similar to those brought about
by the auto set-up engine 144 can be obtained.
90. Moreover, in the above described embodiment, an example in
which the self judgment process in FIG. 6 and the confirmation
process after the switching of image processor in FIG. 7 are
executed by the CPU 146 of the auto set-up engine 144 has been
explained, but they can be executed by CPU 160 of the personal
computer 158.
91. Further, in the present embodiment, an example in which the
above-described information about whether the image processor 140
is normal, and when it is abnormal, image processing by the same
processor 140 is emulated by the auto set-up engine 144 is given to
the operator on the display 164. However, it can be written on
paper or spoken from an unillustrated speaker mounted on the PC
158.
92. In the auto set-up engine 144 according to the present
embodiment, the memory judging process and the image processing
control process, shown in FIGS. 8A and 8B, are executed by the CPU
146 when instructed by the operator through the keyboard 166, or
when executed periodically at a predetermined time (for example, at
start-up time every morning). Further, in the present embodiment,
as an example, the memory size of each frame memory 142 is 4000
pixels.times.2000 pixels and the picture element density is 300 dpi
(dot/inch).
93. In Step 202 in FIG. 8A and 8B, a sub routine of the memory
judging process in FIG. 9 is effected. In Step 252 in FIG. 9, CPU
160 of the PC 158 is demanded to read image data from the hard disc
168. This test data is transmitted to the image processor section
136 via a bus 178, the I/O port 152, the I/O controller 134, and
the selector 132. In the image processor section 136, the test data
is written into one frame memory which is supposed to be judged
among three frame memories 142A, 142B, and 142C. At the same time,
test data is transmitted from the hard disk 168 to the CPU 146 via
the bus 178, the I/O port 152, and the bus 154.
94. In Step 254, the written test data is read from the frame
memory which is to be judged, and is transmitted to the CPU 146 via
the I/O controller 134, the I/O port 152, and the bus 178. In Step
256, the read test data and the original test data are compared to
each other.
95. By this comparison, when both data correspond to each other, in
Step 260, the frame memory to be judged is judged to be normal.
When both data do not correspond to each other, in Step 262, the
frame memory to be judged is judged to be abnormal.
96. In this way, through Steps 252 to 262 in FIG. 9, it is judged
whether one frame memory to be judged is normal. Steps 252 to 262
are repeated for the other frame memories in order to diagnose
whether each frame memory is normal.
97. After Steps 252 to 262 have been implemented for all the frame
memories, the routine returns to the main routine in FIGS. 8A and
8B.
98. In the main routine in FIGS. 8A and 8B, in Step 204; on the
basis of the results from the memory judging process in Step 202,
it is judged whether all of the three frame memories 142A, 142B,
and 142C are normal. When all of the three frame memories 142A,
142B, and 142C are normal, the routine proceeds to Step 206. In
Step 206, as shown in FIG. 5A, all of the three frame memories
142A, 142B, and 142C are used to control the image processor
section 136 to carry out the above-described three steps (step A:
reading of image data, step B: image processing, and step C:
outputting (printing) of image data), sequentially and
repeatedly.
99. Accordingly, in the image processor section 136, for example,
as shown in FIG. 5A, at time t.sub.1, the frame memory 142A is used
to start step A, at time t.sub.2, the frame memory 142A is used to
start step B, and the frame memory 142B is used to start step A,
respectively. Further, at time t.sub.3, the frame memory 142A is
used to start step C, the frame memory 142B is used to start step
B, and the frame memory 142C is used to start step A, respectively.
Thus, an image processing is implemented by changing steps at each
frame memory for each period of time T. In addition, when all three
frame memories 142A, 142B and 142C are normal, they can be
processed for all image sizes in general use.
100. In Step 208, information that all of the frame memories 142A,
142B and 142C are normal and information of all of the processable
image sizes is displayed on the display 164 of the PC 158.
101. On the other hand, when at least one of the frame memories is
abnormal, the judgment in Step 204 is negative. The routine
proceeds to Step 210, where it is judged whether one of the three
frame memories 142A, 142B and 142C is abnormal. When one frame
memory is abnormal, the routine proceeds to Step 212. In Step 212,
as shown in FIG. 5B, the image processing at the image processor
section 136 is switched such that three steps are implemented
sequentially and repeatedly while two steps are being processed
concurrently by using the other two normal frame memories.
102. Accordingly, at the image processor section 136, for example,
as shown in FIG. 5B, at time t.sub.1, the frame memory 142B is used
to start step A. At time t.sub.2, the frame memory 142B is used to
start step B, and the frame memory 142C is used to start step A. At
time t.sub.3, the frame memory 142B is used to start step C, and
the frame memory 142C is used to start step B. Thus, an image
processing is implemented by changing steps for each period of time
T.
103. In Step 214, two frame memories are used to read the
information about image sizes which can be processed, from hard
disk 168. The information that one frame memory is abnormal, and
image sizes which can be processed by two memories (in this case,
image sizes except for a "wide" quarter size (4500
pixels.times.3000 pixels)) is transmitted to the operator through
the display 164. Further, a message having the same information
that one memory is abnormal is transmitted to a service man by
e-mail via a communication line 177 from the communication control
section 175 of the PC 158.
104. On the other hand, when two frame memories or more are
abnormal, the judgment in Step 210 is negative. The routine
proceeds to Step 216, where it is judged whether two frame memories
among three frame memories 142A, 142B, and 142C are abnormal. When
two frame memories are abnormal, the routine proceeds to Step 218,
where the image processing at the image processor section 136 is
switched such that the remaining one normal frame memory is used to
carry out an image processing comprising three steps Step by step
sequentially and repeatedly.
105. In Step 220, information about image sizes which can be
processed by one frame memory is read from the hard disk 168.
Accordingly, information that two frame memories are abnormal, and
image sizes which can be processed by one frame memory (e.g., image
sizes except for a "wide" quarter size (4500 pixels.times.3000
pixels) and a quarter size (3600 pixels.times.3000 pixels)) is
transmitted to the operator through the display 164. Further, a
message that two frame memories are abnormal is sent to a service
man by e-mail from the communication control section 175 via the
communication line 177.
106. When all of the frame memories are abnormal, because image
processing cannot be implemented, the routine is forwarded to Step
222, where the image processor section 136 is used to suspend the
image processing. In Step 224, information that all of the frame
memories are abnormal and the image processing is suspended is
transmitted to the operator through the display 164. Also, a
message that all of the three frame memories are abnormal is sent
to a service man by e-mail from the communication control section
175 via the communication line 177.
107. Because image processing is effected in this manner, when at
least one of the three frame memories is out of order, image
processing can be continued by using the remaining normal
memory/memories.
108. Further, when a frame memory is out of order, information that
a frame memory is out of order and of the image sizes which can be
processed in accordance with the number of the remaining normal
frame memories is immediately transmitted to the operator. The
operator can easily see that failure has occurred to a frame memory
and continue image processing within a specified range of image
sizes which can be processed.
109. Further, because a message that a frame memory is abnormal is
sent to a service man by e-mail via the communication line 177, the
service man can quickly recognize the failure of a frame memory,
and prepare another frame memory promptly.
110. In the above-description, an example in which three frame
memories are provided at the image processing section 16 has been
described. However, two frame memories, or four frame memories or
more, may be provided, and similar effects to the present
embodiment can be obtained.
111. In the above-description, an example has been explained in
which the image processings which are shown in FIGS. 8A and 8B, and
FIG. 9 are executed by the CPU 146 of the auto set-up engine 144.
However, CPU 160 of the PC 158 can be used.
112. As described above, in accordance with a first aspect of the
present invention, when image processing by the image processor has
been judge to be abnormal, the image processing of the image
processor is immediately switched with software so as to effect the
same image processing. Although the processing rate may
deteriorate, image processing can be continued until another image
processor is prepared.
113. In accordance with a second aspect of the present invention,
said judging means judges whether the image processing executed by
said image processor is normal by comparing an outputted image
obtained by said image processor executing the image processing and
an outputted image obtained by said image processor executing
normal image processing.
114. As a result, a correct judging can be effected.
115. In accordance with a third aspect of the present invention,
even when at least one of the memories is out of order, because
image processing can be effected by the memory/memories which is
judged to be normal, image processing can be continued without
being interrupted.
116. In accordance with a fourth aspect of the present invention,
even when one of three memories is out of order, the processes out
of three processes, while the three processes are executed
concurrently, sequentially and repeatedly. As a result, even when
any one of the memories is out of order, image processing can be
continued without being interrupted.
* * * * *