U.S. patent application number 12/838184 was filed with the patent office on 2010-11-04 for method and system for producing formatted information related to defects of appliances.
This patent application is currently assigned to DO Labs. Invention is credited to Frederic Guichard, Bruno Liege.
Application Number | 20100278415 12/838184 |
Document ID | / |
Family ID | 26213095 |
Filed Date | 2010-11-04 |
United States Patent
Application |
20100278415 |
Kind Code |
A1 |
Liege; Bruno ; et
al. |
November 4, 2010 |
METHOD AND SYSTEM FOR PRODUCING FORMATTED INFORMATION RELATED TO
DEFECTS OF APPLIANCES
Abstract
The method and a system for producing formatted information
related to defects of appliances of a chain of appliances. To
produce the formatted information related to the defects of an
image-capture appliance of the chain, the method includes a first
calculation algorithm with which there can be chosen, within a set
of parameterizable transformation models, within a set of
parameterizable reverse transformation models, within a set of
synthesis images, within a set of reference scenes, and within a
set of transformed images: a reference scene, and/or a transformed
image, and/or a parameterizable transformation model with which a
reference image of the reference scene can be transformed to the
transformed image, and/or a parameterizable reverse transformation
model, with which the transformed image can be transformed to the
reference image, and/or a synthesis image obtained from the
reference scene and/or obtained from the said reference image. The
formatted information is at least partly composed of the parameters
of the chosen parameterizable transformation model and/or of the
parameters of the said chosen parameterizable reverse
transformation model.
Inventors: |
Liege; Bruno; (Boulogne,
FR) ; Guichard; Frederic; (Paris, FR) |
Correspondence
Address: |
OBLON, SPIVAK, MCCLELLAND MAIER & NEUSTADT, L.L.P.
1940 DUKE STREET
ALEXANDRIA
VA
22314
US
|
Assignee: |
DO Labs
Boulogne
FR
|
Family ID: |
26213095 |
Appl. No.: |
12/838184 |
Filed: |
July 16, 2010 |
Related U.S. Patent Documents
|
|
|
|
|
|
Application
Number |
Filing Date |
Patent Number |
|
|
10483322 |
Jun 28, 2004 |
7760955 |
|
|
PCT/FR02/01914 |
Jun 5, 2002 |
|
|
|
12838184 |
|
|
|
|
Current U.S.
Class: |
382/141 |
Current CPC
Class: |
G06T 5/003 20130101;
G06T 5/006 20130101; H04N 1/00071 20130101; H04N 1/387 20130101;
H04N 1/00007 20130101; G06T 3/0056 20130101; H04N 1/58 20130101;
H04N 1/00045 20130101; G06T 5/002 20130101; G06T 1/0007 20130101;
G06T 5/00 20130101; H04N 1/40093 20130101 |
Class at
Publication: |
382/141 |
International
Class: |
G06K 9/00 20060101
G06K009/00 |
Foreign Application Data
Date |
Code |
Application Number |
Jul 12, 2001 |
FR |
01 09291 |
Jul 12, 2001 |
FR |
01 09292 |
Claims
1. A method for producing formatted information related to defects
of appliances of at least two appliance chains, addressed to an
image-processor for modifying quality of images processed by the
image-processor, each appliance chain including at least one
image-capture appliance, at least one image-restitution appliance,
or a combination thereof, the method comprising: producing data of
the formatted information according to a standard format,
characterizing the defects of the appliances of each appliance
chain, and storing the formatted information in a database, wherein
at least one image-capture appliance is provided with at least one
variable characteristic depending on the image, fractions of the
formatted information being related to the defects of the at least
one image-capture appliance, each variable characteristic being
configured to be associated with a value to form a combination
including the set of the variable characteristics and of the
values, the method further including producing a first fraction of
the formatted information for a predetermined selection of the
combinations, the first fraction of the formatted information being
entered in a field of the formatted information as measured
formatted information, and obtaining a second fraction of the
formatted information related to an arbitrary combination from the
measured formatted information, as extended formatted information,
the formatted information including the extended formatted
information in place of the measured formatted information.
Description
CROSS-REFERENCE TO RELATED APPLICATIONS
[0001] This Application is a division of application Ser. No.
10/483,322 filed Jun. 28, 2004, the entire content of which is
incorporated herein in its entirety by reference. U.S. application
Ser. No. 10/483,322 is the national stage of PCT Application No.
PCT/FR02/01914, filed Jun. 5, 2002, and claims the benefit of
priority under 35 U.S.C. .sctn.119 from French Application
01-09291, filed Jul. 12, 2001 and French Application No. 01-09292,
filed Jul. 12, 2001.
BACKGROUND
[0002] The present invention relates to a method and a system for
producing formatted information related to defects of appliances of
an appliance chain. The present invention also relates to the
formatted information obtained in this way and addressed to
image-processing means.
METHOD
[0003] The invention relates to a method for producing formatted
information related to the defects of appliances of an appliance
chain. The formatted information is addressed to image-processing
means, especially software, for the purpose of modifying the
quality of images processed by the image-processing means. The
appliance chain includes in particular at least one image-capture
appliance and/or at least one restitution means and/or at least one
observer. The method includes the stage of producing data
characterizing the defects of appliances of the appliance chain.
The data are referred to hereinafter as the formatted
information.
Image-Capture Appliance
[0004] The appliance chain includes at least one image-capture
appliance, especially a scanner. In a preferred embodiment
according to the invention, the method is more particularly
designed in this case to produce formatted information related to
defects of the image-capture appliance. The method additionally
includes the stage of producing data characterizing the defects of
the image-capture appliance, especially the sharpness
characteristics. The formatted information also includes the data
characterizing the defects of the image-capture appliance.
[0005] The appliance chain includes at least one image-capture
appliance. To produce the formatted information related to defects
of the image-capture appliance, especially the distortion
characteristics, preferably, according to the invention, the method
includes a first algorithm for calculating the formatted
information. By means of this first calculation algorithm, it is
possible to make a choice: [0006] within a set of parameterizable
transformation models, [0007] within a set of parameterizable
reverse transformation models, within a set of synthetic images,
[0008] within a set of reference scenes and within a set of
transformed images.
[0009] This choice is based on: [0010] a reference scene, and/or
[0011] a transformed image, and/or [0012] a parameterizable
transformation model with which the reference image obtained by
capturing the reference scene by means of the image-capture
appliance can be transformed to the transformed image, and/or
[0013] a parameterizable reverse transformation model with which
the transformed image can be transformed to the reference image,
and/or [0014] a synthetic image obtained from the reference scene
and/or obtained from the reference image.
[0015] The choice is made in such a way that the transformed image
is close to the synthetic image. The transformed image exhibits a
deviation compared with the synthetic image.
[0016] The formatted information is at least partly composed of the
parameters of the chosen parameterizable transformation model
and/or of the parameters of the chosen parameterizable reverse
transformation model.
[0017] Preferably, according to the invention, it is possible by
means of the first calculation algorithm to choose, within a set of
mathematical projections, one mathematical projection with which
the synthetic image can be constructed from the reference
scene.
[0018] The appliance chain includes at least one image-capture
appliance. Preferably, according to another alternative embodiment
of the invention, to produce the formatted information related to
defects of the image-capture appliance, especially the distortion
characteristics, the method includes a second algorithm for
calculating the formatted information. This second algorithm
includes the stages of: [0019] choosing at least one reference
scene, [0020] capturing at least one reference image of each
reference scene by means of the image-capture appliance.
[0021] This second algorithm additionally includes the stage of
choosing, within a set of parameterizable transformation models and
within a set of synthetic images: [0022] a parameterizable
transformation model with which the reference image can be
transformed to a transformed image, and/or [0023] a synthetic image
obtained from the reference scene and/or obtained from the
reference image,
[0024] such that the synthetic image is close to the transformed
image. The transformed image exhibits a deviation compared with the
synthetic image. The formatted information is at least partly
composed of the parameters of the chosen parameterizable
transformation model and/or of the parameters of the
parameterizable reverse transformation model. By means of the
parameterizable reverse transformation model, the transformed image
can be transformed to the reference image.
[0025] Preferably, according to the invention, it is possible by
means of the second calculation algorithm to choose, within a set
of mathematical projections, one mathematical projection with which
the synthetic image can be constructed from the reference
scene.
[0026] Preferably, according to the invention, the method includes
a third algorithm for calculating the deviations. This third
algorithm for calculating the deviations includes the stages of:
[0027] calculating the deviations between the transformed image and
the synthetic image, [0028] associating the deviations with the
formatted information.
[0029] The appliance chain includes at least one image-capture
appliance. The image or images are images of scenes, especially of
animated scenes captured by a user by means of the image-capture
appliance. Preferably, according to this other alternative
embodiment of the invention, to produce the formatted information
related to defects of the image-capture appliance, especially the
distortion characteristics, the method includes a fourth algorithm
for calculating the formatted information. This fourth algorithm
includes the stages of: [0030] constructing a synthetic-image class
by specified mathematical projections of at least one reference
scene onto a surface, [0031] capturing at least one reference image
of at least one reference scene by means of the image-capture
appliance, [0032] choosing, within a set of parameterizable
transformation models, that with which the reference image can be
transformed to a transformed image close to the synthetic-image
class of the reference scene.
[0033] The transformed image exhibits a deviation compared with the
synthetic-image class. The formatted information is at least partly
composed of the parameters of the chosen parameterizable
transformation models.
[0034] Preferably, according to the invention, the method includes
a fifth algorithm for calculating the deviations. This fifth
algorithm includes the stages of: [0035] calculating the deviations
between the transformed image and the synthetic-image class, [0036]
associating the deviations with the formatted information.
Variable Focal Length
Image-Capture Appliance
[0037] The image-capture appliance of the appliance chain is
provided with at least one variable characteristic depending on the
image, especially the focal length and/or the aperture. A fraction
of the formatted information is related to the defects of the
image-capture appliance provided with the variable characteristic
or characteristics. Each variable characteristic can be associated
with a value to form a combination composed of the set of variable
characteristics and values. Preferably in this case, according to
the invention, the method additionally includes the stage of
producing the fraction of the said formatted information for a
predetermined selection of the said combinations. The formatted
information obtained in this way in the said fraction of formatted
information is entered in the field of formatted information. This
formatted information is referred to hereinafter as the measured
formatted information.
[0038] Preferably, according to the invention, the method includes
the stage of obtaining the fraction of formatted information
related to an arbitrary combination from measured formatted
information. The fraction of formatted information related to an
arbitrary combination is referred to hereinafter as extended
formatted information.
[0039] The formatted information can include the extended formatted
information instead of and in place of measured formatted
information.
[0040] The measured formatted information and the said extended
formatted information may exhibit an interpolation deviation.
Preferably, according to the invention, the method additionally
includes the stage of selecting zero or one or more variable
characteristics, in such a way that the interpolation deviation for
the extended formatted information obtained for the variable
characteristics selected in this way is below a predetermined
interpolation threshold. It results from the combination of
technical features that the modification of image quality employs
simple calculations. It also results from the combination of
technical features that the extended formatted information is
compact. It also results from the combination of technical features
that the eliminated variable characteristics have the least
influence on the defect.
Image-Restitution Means
[0041] The appliance chain can include at least one
image-restitution means, especially a printer or a visual display
screen. The method is designed additionally to provide, to
image-processing means, especially software, formatted information
related to the defects of the image-restitution means. Preferably
in this case, according to the invention, the method additionally
includes the stage of producing data characterizing the defects of
the image-restitution means, especially the distortion
characteristics. The formatted information also includes data
characterizing the defects of the restitution means.
[0042] The appliance chain includes at least one image-restitution
means. Preferably, according to the invention, to produce the
formatted information related to defects of the image-restitution
means, especially the distortion characteristics, the method
includes a sixth algorithm for calculating the formatted
information. By means of this sixth algorithm, it is possible to
make a choice: [0043] within a set of parameterizable restitution
transformation models, [0044] within a set of parameterizable
reverse restitution transformation models, [0045] within a set of
mathematical restitution projections, [0046] within a set of
restitution references and within a set of corrected reference
restitution images.
[0047] The choice made by this sixth algorithm is based on: [0048]
a restitution reference, and/or [0049] a corrected reference
restitution image, and/or [0050] a parameterizable restitution
transformation model with which the restitution reference can be
transformed to the corrected reference restitution image, and/or
[0051] a parameterizable reverse restitution transformation model
with which the corrected reference restitution image can be
transformed to the restitution reference, and/or [0052] a
mathematical restitution projection with which a synthetic
restitution image can be constructed from the corrected reference
restitution image.
[0053] The choice is made by this sixth algorithm in such a way
that the synthetic restitution image is close to the restituted
reference obtained by restitution of the restitution reference by
means of the image-restitution means. The restituted reference
exhibits a restitution deviation compared with the synthetic
restitution image. The formatted information is at least partly
composed of the parameters of the chosen parameterizable
restitution transformation model and/or of the parameters of the
chosen parameterizable reverse restitution transformation
model.
[0054] The appliance chain includes at least one image-restitution
means. Preferably in this case, according to an alternative
embodiment of the invention, to produce the formatted information
related to the defects of the image-restitution means, especially
the distortion characteristics, the method includes a seventh
algorithm for calculating the formatted information. This seventh
algorithm includes the stages of: [0055] choosing at least one
restitution reference, [0056] restituting the restitution reference
to a restituted reference by means of the image-restitution
means.
[0057] By means of this seventh algorithm it is also possible to
choose, within a set of parameterizable restitution transformation
models and within a set of mathematical restitution projections:
[0058] a parameterizable restitution transformation model with
which the restitution reference can be transformed to a corrected
reference restitution image, and [0059] a mathematical restitution
projection with which a synthetic restitution image can be
constructed from the corrected reference restitution image.
[0060] The choice is made by the seventh algorithm in such a way
that the synthetic restitution image is close to the restituted
reference. The restituted reference exhibits a restitution
deviation compared with the synthetic restitution image. The
formatted information is at least partly composed of the parameters
of the chosen parameterizable restitution transformation model
and/or of the parameters of the parameterizable reverse restitution
transformation model. By means of the parameterizable reverse
restitution transformation model, it is possible to transform the
corrected reference restitution image to the restitution
reference.
[0061] The appliance chain includes at least one image-restitution
means. Preferably, according to this other alternative embodiment
of the invention, to produce the formatted information related to
the defects of the image-restitution means, especially the
distortion characteristics, the method includes an eighth algorithm
for calculating the formatted information. This eighth algorithm
includes the stage of choosing a corrected reference restitution
image. This eighth algorithm also includes the stage of making a
choice within a set of parameterizable restitution transformation
models, within a set of mathematical restitution projections and
within a set of restitution references. This choice is based on:
[0062] a restitution reference, and/or [0063] a parameterizable
restitution transformation model with which the restitution
reference can be transformed to the corrected reference restitution
image, and/or [0064] a parameterizable reverse restitution
transformation model with which the corrected reference restitution
image can be transformed to the restitution reference, and/or
[0065] a mathematical restitution projection with which a synthetic
restitution image can be constructed from the corrected reference
restitution image.
[0066] The eighth algorithm makes this choice in such a way that
the synthetic restitution image is close to the restituted
reference obtained by restitution of the restitution reference by
means of the image-restitution means. The restituted reference
exhibits a restitution deviation compared with the synthetic
restitution image. The formatted information is at least partly
composed of the parameters of the chosen parameterizable
restitution transformation model and/or of the parameters of the
chosen parameterizable reverse restitution transformation
model.
[0067] Preferably, according to the invention, the method includes
a ninth algorithm for calculating the restitution deviations. This
ninth algorithm includes the stages of: [0068] calculating the
restitution deviations between the restituted reference and the
synthetic restitution image, [0069] associating the restitution
deviations with the said formatted information.
[0070] It results from the combination of technical features that
it is possible to verify automatically, for example during
manufacture of the appliance, that the method has produced
formatted information within acceptable tolerances.
Variable Focal Length
Image-Restitution Means
[0071] The image-restitution means of the appliance chain can be
provided with at least one variable restitution characteristic
depending on the image, especially the focal length and/or the
aperture. A fraction of the formatted information is related to the
defects of the image-restitution means provided with the variable
restitution characteristic or characteristics. Each variable
restitution characteristic can be associated with a value to form a
restitution combination composed of the set of variable restitution
characteristics and values. Preferably in this case, according to
the invention, the method additionally includes the stage of
producing the fraction of the formatted information for a
predetermined selection of the restitution combinations. The
formatted information obtained in this way in the fraction and
entered in the field of formatted information is referred to
hereinafter as the measured formatted restitution information.
[0072] Preferably, according to the invention, the method includes
the stage of obtaining the fraction of formatted information
related to an arbitrary combination from measured formatted
restitution information. The fraction of formatted information
related to an arbitrary restitution combination is referred to
hereinafter as extended formatted restitution information.
[0073] The formatted information can include the extended formatted
restitution information instead of and in place of measured
formatted restitution information.
[0074] The measured formatted restitution information and the said
extended formatted restitution information can exhibit a
restitution interpolation deviation. Preferably in this case,
according to the invention, the method additionally includes the
stage of selecting zero or one or more variable restitution
characteristics, in such a way that the restitution interpolation
deviation for the extended formatted restitution information
obtained for the variable restitution characteristics selected in
this way is below a predetermined restitution interpolation
threshold. It results from the combination of technical features
that the modification of image quality employs simple calculations.
It also results from the combination of technical features that the
extended formatted restitution information is compact. It also
results from the combination of technical features that the
eliminated variable restitution characteristics have the least
influence on the defect.
[0075] Preferably, according to the invention, the restitution
means is associated with an image-capture appliance to restitute,
in digital form, the restituted reference from the restitution
reference. The method is such that, to produce the formatted
information related to the defects of the restitution means, there
is used the formatted information related to the image-capture
appliance associated with the restitution means.
[0076] The appliance chain includes at least two appliances.
Preferably in this case, according to the invention, to produce
formatted information related to the defects of the appliances of
the appliance chain, the method additionally includes the following
stages: [0077] the stage of producing formatted information related
to each of the appliances of the appliance chain, [0078] the stage
of combining the formatted information related to each of the
appliances of the appliance chain, in order to obtain formatted
information related to the appliance chain.
System
[0079] The invention relates to a system for producing formatted
information related to the defects of appliances of an appliance
chain. The formatted information is addressed to image-processing
means, especially software, for the purpose of modifying the
quality of images processed by the image-processing means. The
appliance chain includes in particular at least one image-capture
appliance and/or at least one restitution means and/or at least one
observer. The system includes data-processing means for producing
data characterizing the defects of appliances of the appliance
chain. The data are referred to hereinafter as the formatted
information.
[0080] Image-Capture Appliance
[0081] The appliance chain includes at least one image-capture
appliance, especially a scanner. Preferably in this case, according
to the invention, the system is more particularly designed to
produce formatted information related to defects of the
image-capture appliance. The system includes data-processing means
for producing data characterizing the defects of the image-capture
appliance, especially the sharpness characteristics. The formatted
information also includes the data characterizing the defects of
the image-capture appliance.
[0082] The appliance chain includes at least one image-capture
appliance. Preferably, according to the invention, to produce the
formatted information related to defects of the image-capture
appliance, especially the distortion characteristics, the
data-processing means are capable of employing a first algorithm
for calculating the formatted information. By means of the
data-processing means employing the first calculation algorithm, it
is possible to make a choice within a set of parameterizable
transformation models, within a set of parameterizable reverse
transformation models, within a set of synthetic images, within a
set of reference scenes and within a set of transformed images.
[0083] This choice is based on: [0084] a reference scene, and/or
[0085] a transformed image, and/or [0086] a parameterizable
transformation model with which the reference image obtained by
capturing the reference scene by means of the image-capture
appliance can be transformed to the transformed image, and/or
[0087] a parameterizable reverse transformation model with which
the transformed image can be transformed to the reference image,
and/or [0088] a synthetic image obtained from the reference scene
and/or obtained from the reference image.
[0089] The data-processing means make this choice in such a way
that the transformed image is close to the synthetic image. The
transformed image exhibits a deviation compared with the synthetic
image. The formatted information is at least partly composed of the
parameters of the chosen parameterizable transformation model
and/or of the parameters of the chosen parameterizable reverse
transformation model.
[0090] Preferably, according to the invention, the data-processing
means employing the first calculation algorithm include calculating
means for choosing, within a set of mathematical projections, one
mathematical projection with which the synthetic image can be
constructed from the reference scene.
[0091] The appliance chain includes at least one image-capture
appliance. Preferably, according to an alternative embodiment of
the invention, to produce the formatted information related to
defects of the image-capture appliance, especially the distortion
characteristics, the data-processing means employ a second
algorithm for calculating the formatted information. The
data-processing means employing the second calculation algorithm
include calculating means for choosing at least one reference
scene. By means of the image-capture appliance, it is possible to
capture at least one reference image of each reference scene. By
means of the calculating means it is additionally possible to make
a choice, within a set of parameterizable transformation models and
within a set of synthetic images: [0092] of a parameterizable
transformation model with which the reference image can be
transformed to a transformed image, and/or [0093] of a synthetic
image obtained from the reference scene and/or obtained from the
reference image.
[0094] The calculating means make this choice in such a way that
the synthetic image is close to the transformed image. The
transformed image exhibits a deviation compared with the synthetic
image. The formatted information is at least partly composed of the
parameters of the chosen parameterizable transformation model
and/or of the parameters of the parameterizable reverse
transformation model. By means of the parameterizable reverse
transformation model, the transformed image can be transformed to
the reference image.
[0095] Preferably, according to the invention, the calculating
means with which the second calculation algorithm can be employed
include specific calculating means for choosing, within a set of
mathematical projections, one mathematical projection with which
the synthetic image can be constructed from the reference
scene.
[0096] Preferably, according to the invention, the data-processing
means are capable of employing a third algorithm for calculating
the deviations. For this purpose, the data-processing means include
calculating means appropriate for: [0097] calculating the
deviations between the transformed image and the synthetic image,
[0098] associating the deviations with the said formatted
information.
[0099] Preferably, according to another alternative embodiment of
the invention, the system is such that, to calculate the formatted
information related to an image-capture appliance of the appliance
chain, it additionally uses at least one reference scene. The
image-capture appliance constructs a reference image for each
reference scene. To calculate the formatted information relative to
the image-capture appliance, the system additionally includes
calculating and processing means for: [0100] constructing a
synthetic-image class by specified mathematical projections of at
least one reference scene onto a surface, [0101] choosing, within a
set of parameterizable transformation models, that with which the
reference image can be transformed to a transformed image close to
the synthetic-image class of the reference scene.
[0102] The transformed image exhibits a deviation compared with the
synthetic-image class. The formatted information is at least partly
composed of the parameters of the chosen parameterizable
transformation models.
[0103] Preferably, according to the invention, the system includes
calculating means for: [0104] calculating the deviations between
the transformed image and the synthetic-image class, [0105]
associating the deviations with the said formatted information.
Variable Focal Length
Image-Capture Appliance
[0106] Preferably, according to the invention, the system is such
that the image-capture appliance of the appliance chain is provided
with at least one variable characteristic depending on the image,
especially the focal length and/or the aperture. A fraction of the
formatted information is related to the defects of the
image-capture appliance provided with the variable characteristic
or characteristics. Each variable characteristic can be associated
with a value to form a combination composed of the set of variable
characteristics and values. The system additionally includes
data-processing means for producing the fraction of the formatted
information for a predetermined selection of the combinations. The
formatted information obtained in this way in the fraction of
formatted information and entered in the field of formatted
information is referred to hereinafter as the measured formatted
information.
[0107] Preferably, according to the invention, the data-processing
means are capable of obtaining the fraction of formatted
information related to an arbitrary combination from measured
formatted information. The fraction of formatted information
related to an arbitrary combination is referred to hereinafter as
extended formatted information.
[0108] The formatted information can include the extended formatted
information instead of and in place of measured formatted
information.
[0109] The measured formatted information and the said extended
formatted information exhibit an interpolation deviation.
Preferably, according to the invention, the system additionally
includes selection means for selecting zero or one or more variable
characteristics, in such a way that the interpolation deviation for
the extended formatted information obtained for the variable
characteristics selected in this way is below a predetermined
interpolation threshold.
Image-Restitution Means
[0110] The appliance chain can include at least one
image-restitution means, especially a printer or a visual display
screen. The system is designed to provide, to image-processing
means, especially software, formatted information related to the
defects of the image-restitution means. Preferably in this case,
according to the invention, the system additionally includes
data-processing means for producing data characterizing the defects
of the image-restitution means, especially the distortion
characteristics. The formatted information also includes data
characterizing the defects of the restitution means.
[0111] Preferably, in the case in which the appliance chain
includes at least one image-restitution means, to produce the
formatted information related to defects of the image-restitution
means, especially the distortion characteristics, the system
includes calculating means for making a choice: [0112] within a set
of parameterizable restitution transformation models, [0113] within
a set of parameterizable reverse restitution transformation models,
[0114] within a set of mathematical restitution projections, [0115]
within a set of restitution references and within a set of
corrected reference restitution images.
[0116] The choice made by the calculating means is based on: [0117]
a restitution reference, and/or [0118] a corrected reference
restitution image, and/or [0119] a parameterizable restitution
transformation model with which the restitution reference can be
transformed to the corrected reference restitution image, and/or
[0120] a parameterizable reverse restitution transformation model
with which the corrected reference restitution image can be
transformed to the restitution reference, and/or [0121] a
mathematical restitution projection with which a synthetic
restitution image can be constructed from the corrected reference
restitution image.
[0122] The calculating means make this choice in such a way that
the synthetic restitution image is close to the restituted
reference obtained by restitution of the restitution reference by
means of the image-restitution means. The restituted reference
exhibits a restitution deviation compared with the synthetic
restitution image. The formatted information is at least partly
composed of the parameters of the chosen parameterizable
restitution transformation model and/or of the parameters of the
chosen parameterizable reverse restitution transformation
model.
[0123] The appliance chain can include at least one
image-restitution means. Preferably in the case of this alternative
embodiment according to the invention, to produce the formatted
information related to the defects of the image-restitution means,
especially the distortion characteristics, the system includes
calculating means for choosing at least one restitution reference.
By means of the image-restitution means, it is possible to
restitute the restitution reference to a restituted reference. By
means of the calculating means it is additionally possible to make
a choice within a set of parameterizable restitution transformation
models and within a set of mathematical restitution projections:
[0124] of a parameterizable restitution transformation model with
which the restitution reference can be transformed to a corrected
reference restitution image, and [0125] of a mathematical
restitution projection with which a synthetic restitution image can
be constructed from the corrected reference restitution image.
[0126] The calculating means make this choice in such a way that
the synthetic restitution image is close to the restituted
reference. The restituted reference exhibits a restitution
deviation compared with the synthetic restitution image. The
formatted information is at least partly composed of the parameters
of the chosen parameterizable restitution transformation model
and/or of the parameters of the parameterizable reverse restitution
transformation model. By means of the parameterizable reverse
restitution transformation model, it is possible to transform the
corrected reference restitution image to the restitution
reference.
[0127] The appliance chain can include at least one
image-restitution means. Preferably in the case of this alternative
embodiment according to the invention, to produce the formatted
information related to the defects of the image-restitution means,
especially the distortion characteristics, the system includes
calculating means for choosing a corrected reference restitution
image. By means of the calculating means, it is additionally
possible to make a choice within a set of parameterizable
restitution transformation models, within a set of mathematical
restitution projections and within a set of restitution references:
[0128] of a parameterizable restitution transformation model with
which the specific restitution reference can be transformed to the
corrected reference restitution image, and/or [0129] of a
parameterizable reverse restitution transformation model with which
the corrected reference restitution image can be transformed to the
restitution reference, and/or [0130] of a mathematical restitution
projection with which a synthetic restitution image can be
constructed from the corrected reference restitution image.
[0131] The calculating means make this choice in such a way that
the synthetic restitution image is close to the restituted
reference obtained by restitution of the restitution reference by
means of the image-restitution means. The restituted reference
exhibits a restitution deviation compared with the synthetic
restitution image. The formatted information is at least partly
composed of the parameters of the chosen parameterizable
restitution transformation model and/or of the parameters of the
chosen parameterizable reverse restitution transformation
model.
[0132] Preferably, according to the invention, the system includes
calculating means for: [0133] calculating the restitution
deviations between the restituted reference and the synthetic
restitution image, [0134] associating the restitution deviations
with the said formatted information.
Variable Focal Length
Image-Restitution Means
[0135] The image-restitution means of the appliance chain can be
provided with at least one variable restitution characteristic
depending on the image, especially the focal length and/or the
aperture. A fraction of the formatted information is related to the
defects of the image-restitution means provided with the variable
restitution characteristic or characteristics. Each variable
restitution characteristic can be associated with a value to form a
restitution combination composed of the set of variable restitution
characteristics and values. Preferably in the case of this
alternative embodiment according to the invention, the system
additionally includes in this case data-processing means for
producing the fraction of the formatted information for a
predetermined selection of the restitution combinations. The
formatted information obtained in this way in the fraction and
entered in the field of formatted information is referred to
hereinafter as the measured formatted restitution information.
[0136] Preferably, according to the invention, the system includes
data-processing means for obtaining the fraction of formatted
information related to an arbitrary combination from measured
formatted restitution information. The formatted information making
up the fraction of formatted information related to an arbitrary
restitution combination is referred to hereinafter as extended
formatted restitution information.
[0137] The formatted information can include the extended formatted
restitution information instead of and in place of measured
formatted restitution information.
[0138] The measured formatted restitution information and the said
extended formatted restitution information exhibit a restitution
interpolation deviation. Preferably in this case, according to the
invention, the system additionally includes selection means for
selecting zero or one or more variable restitution characteristics,
in such a way that the restitution interpolation deviation for the
extended formatted restitution information obtained for the
variable restitution characteristics selected in this way is below
a predetermined restitution interpolation threshold.
[0139] According to an alternative embodiment of the invention, the
restitution means is associated with an image-capture appliance to
restitute, in digital form, the restituted reference from the
restitution reference. Preferably in this case, the system includes
data-processing means for producing the formatted information
related to the defects of the restitution means, by using the
formatted information related to the image-capture appliance
associated with the restitution means.
[0140] The appliance chain can include at least two appliances.
Preferably in the case of this alternative embodiment of the
invention, to produce formatted information related to the defects
of the appliances of the appliance chain, the system additionally
includes data-processing means for producing formatted information
related to each of the appliances of the appliance chain and for
combining the formatted information related to each of the
appliances of the appliance chain, in such a way as to obtain
formatted information related to the appliance chain.
BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWINGS
Detailed Description
[0141] Other characteristics and advantages of the invention will
become apparent upon reading of the description of alternative
embodiments of the invention, provided by way of indicative and
non-limitative examples, and of the figures, wherein
respectively:
[0142] FIG. 1 illustrates a schematic view of image capture,
[0143] FIG. 2 illustrates a schematic view of image
restitution,
[0144] FIG. 3 illustrates a schematic view of the pixels of an
image,
[0145] FIGS. 4a and 4b illustrate two schematic views of a
reference scene,
[0146] FIG. 5 illustrates the organizational diagram of the method
with which the difference between the mathematical image and the
corrected image can be calculated,
[0147] FIG. 6 illustrates the organizational diagram of the method
with which the best restitution transformation for an
image-restitution means can be obtained,
[0148] FIG. 7 illustrates a schematic view of the elements
composing the system according to the invention,
[0149] FIG. 8 illustrates a schematic view of fields of formatted
information,
[0150] FIG. 9a illustrates a schematic front view of a mathematical
point,
[0151] FIG. 9b illustrates a schematic front view of a real point
of an image,
[0152] FIG. 9c illustrates a schematic side view of a mathematical
point,
[0153] FIG. 9d illustrates a schematic profile view of a real point
of an image,
[0154] FIG. 10 illustrates a schematic view of an array of
characteristic points,
[0155] FIG. 11 illustrates the organizational diagram of the method
with which the formatted information can be obtained,
[0156] FIG. 12 illustrates the organizational diagram of the method
with which the best transformation for an image-capture appliance
can be obtained,
[0157] FIG. 13 illustrates the organizational diagram of the method
with which the quality of an image derived from or addressed to a
chain of appliances can be modified,
[0158] FIG. 14 illustrates an example of a file containing
formatted information,
[0159] FIG. 15 illustrates an example of formatted information,
[0160] FIG. 16 illustrates a representation of parameters of
parameterizable models,
[0161] FIG. 17 illustrates an organizational diagram of the method
with which the best transformation for an image-restitution
appliance can be obtained.
DETAILED DESCRIPTION
[0162] FIG. 1 illustrates a scene 3 containing an object 107, a
sensor 101 and sensor surface 110, an optical center 111, an
observation point 105 on a sensor surface 110, an observation
direction 106 passing through observation point 105, optical center
111, scene 3, and a surface 10 geometrically associated with sensor
surface 110.
[0163] FIG. 2 illustrates an image 103, an image-restitution means
19 and a restituted image 191 obtained on the restitution medium
190.
[0164] FIG. 3 illustrates a scene 3, an image-capture appliance 1
and an image 103 composed of pixels 104.
[0165] FIGS. 4a and 4b illustrate two alternative versions of a
reference scene 9.
[0166] FIG. 5 illustrates an organizational diagram employing a
scene 3, a mathematical projection 8 giving a mathematical image 70
of scene 3, a real projection 72 giving an image 103 of scene 3 for
the characteristics 74 used, a parameterizable transformation model
12 giving a corrected image 71 of image 103, the corrected image 71
exhibiting a difference 73 compared with mathematical image 70.
[0167] FIG. 6 illustrates an organizational diagram employing an
image 103, a real restitution projection 90 giving a restituted
image 191 of image 103 for the restitution characteristics 95 used,
a parameterizable restitution transformation model 97 giving a
corrected restitution image 94 of image 103, a mathematical
restitution projection 96 giving a mathematical restitution image
92 of corrected restitution image 94 and exhibiting a restitution
difference 93 compared with restituted image 191.
[0168] FIG. 7 illustrates a system comprising an image-capture
appliance 1 composed of an optical system 100, of a sensor 101 and
of an electronic unit 102. FIG. 7 also illustrates a memory zone 16
containing an image 103, a database 22 containing formatted
information 15, and means 18 for transmission of completed image
120 composed of image 103 and formatted information 15 to
calculating means 17 containing image-processing software 4.
[0169] FIG. 8 illustrates formatted information 15 composed of
fields 91.
[0170] FIGS. 9a to 9d illustrate a mathematical image 70, an image
103, the mathematical position 40 of a point, and the mathematical
shape 41 of a point, compared with the real position 50 and the
real shape 51 of the corresponding point of the image.
[0171] FIG. 10 illustrates an array 80 of characteristic
points.
[0172] FIG. 11 illustrates an organizational diagram employing an
image 103, the characteristics 74 used, and a database 22 of
characteristic. The formatted information 15 is obtained from the
characteristics 74 used and stored in database 22. The completed
image 120 is obtained from image 103 and formatted information
15.
[0173] FIG. 12 illustrates an organizational diagram employing a
reference scene 9, a mathematical projection 8 giving a synthetic
image class 7 of reference scene 9, and a real projection 72 giving
a reference image 11 of reference scene 9 for the characteristics
74 used. This organizational diagram also employs a parameterizable
transformation model 12 giving a transformed image 13 of reference
image 11. Transformed image 13 exhibits a deviation compared with
synthetic image class 7.
[0174] FIG. 17 illustrates an organizational diagram employing a
restitution reference 209, a real restitution projection 90 giving
a restituted reference 211 of the said restitution reference 209
for the restitution characteristics 95 used, a parameterizable
restitution transformation model 97 giving a corrected reference
restitution image 213 of the said restitution reference 209, a
parameterizable reverse restitution transformation model 297
producing the said restitution reference 209 from the said
corrected reference restitution image 213. This organizational
diagram also employs a mathematical restitution projection 96
giving a synthetic restitution image 307 of the corrected reference
restitution image 213. The said synthetic restitution image 307
exhibits a restitution deviation 214 compared with the restituted
reference 211.
DEFINITIONS AND DETAILED DESCRIPTION
[0175] Other characteristics and advantages of the invention will
become apparent on reading: [0176] of the definitions explained
hereinafter of the employed technical terms, referring to the
indicative and non-limitative examples of FIGS. 1 to 17, [0177] of
the description of FIGS. 1 to 17.
Scene
[0178] Scene 3 is defined as a place in three-dimensional space,
containing objects 107 illuminated by light sources.
Image-Capture Appliance, Image, Image Capture
[0179] Referring to FIGS. 3 and 7, a description will now be given
of what is understood by image-capture appliance 1 and image 103.
Image-capture appliance 1 is defined as an appliance composed of an
optical system 100, of one or more sensors 101, of an electronic
unit 102 and of a memory zone 16. By means of the said
image-capture appliance 1, it is possible to obtain, from a scene
3, fixed or animated digital images 103 recorded in memory zone 16
or transmitted to an external device. Animated images are composed
of a succession of fixed images 103 in time. The said image-capture
appliance 1 can have the form in particular of a photographic
appliance, of a video camera, of a camera connected to or
integrated in a PC, of a camera connected to or integrated in a
personal digital assistant, of a camera connected to or integrated
in a telephone, of a videoconferencing appliance or of a measuring
camera or appliance sensitive to wavelengths other than those of
visible light, such as a thermal camera.
[0180] Image capture is defined as the method by which image 103 is
calculated by image-capture appliance 1.
[0181] In the case in which an appliance is equipped with a
plurality of interchangeable subassemblies, especially an optical
system 100, image-capture appliance 1 is defined as a special
configuration of the appliance.
Image-Restitution Means, Restituted Image, Image Restitution
[0182] Referring to FIG. 2, a description will now be given of what
is understood by image-restitution means 19. Such an
image-restitution means 19 can have the form in particular of a
visual display screen, of a television screen, of a flat screen, of
a projector, of virtual reality goggles, of a printer.
[0183] Such an image-restitution means 19 is composed of: [0184] an
electronic unit, [0185] one or more sources of light, of electrons
or of ink, [0186] one or more modulators: devices for modulation of
light, of electrons or of ink, [0187] a focusing device, having in
particular the form of an optical system in the case of a light
projector or the form of electron-beam focusing coils in the case
of a CRT screen, or the form of filters in the case of a flat
screen, [0188] a restitution medium 190 having in particular the
form of a screen in the case of a CRT screen, of a flat screen or
of a projector, the form of a print medium on which printing is
performed in the case of a printer, or the form of a virtual
surface in space in the case of a virtual-image projector.
[0189] By means of the said image-restitution means 19, it is
possible to obtain, from an image 103, a restituted image 191 on
restitution medium 190.
[0190] Animated images are composed of a succession of fixed images
in time.
[0191] Image restitution is defined as the method by which the
image is displayed or printed by means of image restitution means
19.
[0192] In the case in which a restitution means 19 is equipped with
a plurality of interchangeable subassemblies or of subassemblies
that can be shifted relative to one another, especially restitution
medium 190, image-restitution means 19 is defined as a special
configuration.
Sensor Surface, Optical Center, Focal Distance
[0193] Referring to FIG. 1, a description will now be given of what
is defined as sensor surface 110.
[0194] Sensor surface 110 is defined as the shape in space drawn by
the sensitive surface of sensor 101 of image-capture appliance 1 at
the moment of image capture. This surface is generally plane.
[0195] An optical center 111 is defined as a point in space
associated with image 103 at the moment of image capture. A focal
distance is defined as the distance between this point 111 and
plane 110, in the case in which sensor surface 110 is plane.
Pixel, Pixel Value, Exposure Time
[0196] Referring to FIG. 3, a description will now be given of what
is understood by pixel 104 and pixel value.
[0197] A pixel 104 is defined as an elemental zone of sensor
surface 110 obtained by creating a grid, generally regular, of the
said sensor surface 110. Pixel value is defined as a number
associated with this pixel 104.
[0198] Image capture is defined as determining the value of each
pixel 104. The set of these values constitutes image 103.
[0199] During image capture, the pixel value is obtained by
integration, over the surface of pixel 104, during a time period
defined as exposure time, of part of the light flux derived from
scene 3 via optical system 100, and by converting the result of
this integration to a digital value. The integration of the light
flux and/or the conversion of the result of this integration to a
digital value are performed by means of electronic unit 102.
[0200] This definition of the concept of pixel value is applicable
to the case of black-and-white or color images 103, whether they be
fixed or animated.
[0201] Depending on the cases, however, the part in question of the
light flux is obtained in various ways:
[0202] a) In the case of a color image 103, sensor surface 110 is
generally composed of a plurality of types of pixels 104,
associated respectively with light fluxes of different wavelengths,
examples being red, green and blue pixels.
[0203] b) In the case of a color image 103, there may also be a
plurality of sensors 101 disposed side-by-side, each receiving part
of the light flux.
[0204] c) In the case of a color image 103, the colors used may be
different from red, green and blue, such as for North American NTSC
television, and they may exceed three in number.
[0205] d) Finally, in the case of an interlaced television scanning
camera, the animated images produced are composed of an alternation
of images 103 containing even-numbered lines and of images 103
containing odd-numbered lines.
Configuration Used, Adjustments Used, Characteristics Used
[0206] The configuration used is defined as the list of removable
subassemblies of image-capture appliance 1, such as optical system
100 which, if it is interchangeable, is mounted on image-capture
appliance 1. The configuration used is characterized in particular
by: [0207] the type of optical system 100, [0208] the serial number
of optical system 100 or any other designation.
[0209] Adjustments used are defined as: [0210] the configuration
used as defined hereinabove, as well as [0211] the value of the
manual or automatic adjustments available in the configuration used
and having an impact on the content of image 103. These adjustments
may be made by the user, especially by means of pushbuttons, or may
be calculated by image-capture appliance 1. These adjustments may
be stored in the appliance, especially on a removable medium, or on
any device connected to the appliance. These adjustments may
include in particular the adjustments of focusing, diaphragm and
focal length of optical system 100, the adjustments of exposure
time, the adjustments of white balance, and the integrated
image-processing adjustments, such as digital zoom, compression and
contrast.
[0212] Characteristics 74 used or set of characteristics 74 used
are defined as:
[0213] a) Parameters related to the intrinsic technical
characteristics of image-capture appliance 1, determined during the
phase of design of image-capture appliance 1. For example, these
parameters may include the formula of optical system 100 of the
configuration used, which impacts the geometric defects and the
sharpness of the captured images; the formula of optical system 100
of the configuration used includes in particular the shape, the
arrangement and the material of the lenses of optical system
100.
[0214] These parameters may additionally include: [0215] the
geometry of sensor 101, or in other words sensor surface 110 as
well as the shape and relative arrangement of pixels 104 on this
surface, [0216] the noise generated by electronic unit 102, [0217]
the equation for conversion of light flux to pixel value.
[0218] b) Parameters associated with the intrinsic technical
characteristics of image-capture appliance 1, determined during the
phase of manufacture of image-capture appliance 1 and, in
particular: [0219] the exact positioning of the lenses in optical
system 100 of the configuration used, [0220] the exact positioning
of optical system 100 relative to sensor 101.
[0221] c) Parameters associated with the technical characteristics
of image-capture appliance 1, determined at the moment of capture
of image 103 and, in particular: [0222] the position and
orientation of sensor surface 110 relative to scene 3, [0223] the
adjustments used, [0224] the external factors, such as temperature,
if they have an influence.
[0225] d) The user's preferences, especially the color temperature
to be used for image restitution. For example, these preferences
are selected by the user by means of pushbuttons.
Observation Point, Observation Direction
[0226] Referring to FIG. 1, a description will now be given of what
is understood by observation point 105 and observation direction
106.
[0227] Mathematical surface 10 is defined as a surface that is
geometrically associated with sensor surface 110. For example, if
the sensor surface is plane, it will be possible for mathematical
surface 10 to coincide with the sensor surface.
[0228] Observation direction 106 is defined as a line passing
through at least one point of scene 3 and through optical center
111. Observation point 105 is defined as the intersection of
observation direction 106 and surface 10.
Observed Color, Observed Intensity
[0229] Referring to FIG. 1, a description will now be given of what
is understood by observed color and observed intensity. Observed
color is defined as the color of the light emitted, transmitted or
reflected by the said scene 3 in the said observation direction 106
at a given instant, and observed from the said observation point
105. Observed intensity is defined as the intensity of the light
emitted by the said scene 3 in the said observation direction 106
at the same instant, and observed from the said observation point
105.
[0230] The color can be characterized in particular by a light
intensity that is a function of wavelength, or else by two values
as measured by a colorimeter. The intensity can be characterized by
a value such as measured with a photometer.
[0231] The said observed color and the said observed intensity
depend in particular on the relative position of objects 107 in
scene 3 and on the illumination sources present as well as on the
transparency and reflection characteristics of objects 107 at the
moment of observation.
Mathematical Projection, Mathematical Image, Mathematical Point,
Mathematical Color of a Point, Mathematical Intensity of a Point,
Mathematical Shape of a Point, Mathematical Position of a Point
[0232] Referring in particular to FIGS. 1, 5, 9a, 9b, 9c and 9d, a
description will be given of the concepts of mathematical
projection 8, mathematical image 70, mathematical point,
mathematical color of a point, mathematical intensity of a point,
mathematical shape 41 of a point, and mathematical position 40 of a
point.
[0233] Referring to FIG. 5, a description will now be given of how
a mathematical image 70 is constructed by specified mathematical
projection 8 of at least one scene 3 on mathematical surface
10.
[0234] Firstly, a description will be given of what is understood
by specified mathematical projection 8.
[0235] A specified mathematical projection 8 associates a
mathematical image 70 with: [0236] a scene 3 at the moment of
capture of an image, [0237] and with the characteristics 74
used.
[0238] A specified mathematical projection 8 is a transformation
with which the characteristics of each point of mathematical image
70 can be determined from scene 3 at the moment of image capture
and from the characteristics 74 used.
[0239] Mathematical projection 8 is preferentially defined in the
manner to be described hereinafter.
[0240] Mathematical position 40 of the point is defined as the
position of observation point 105 on mathematical surface 10.
[0241] Mathematical shape 41 of the point is defined as the
geometric, punctiform shape of observation point 105.
[0242] Mathematical color of the point is defined as the observed
color.
[0243] Mathematical intensity of the point is defined as the
observed intensity.
[0244] Mathematical point is defined as the association of
mathematical position 40, mathematical shape 41, mathematical color
and mathematical intensity for the observation point 105 under
consideration. Mathematical image 70 is composed of the set of said
mathematical points.
[0245] The mathematical projection 8 of scene 3 is mathematical
image 70.
Real Projection, Real Point, Real Color of a Point, Real Intensity
of a Point, Real Shape of a Point, Real Position of a Point
[0246] Referring in particular to FIGS. 3, 5, 9a, 9b, 9c and 9d, a
description will be given hereinafter of the concepts of real
projection 72, real point, real color of a point, real intensity of
a point, real shape 51 of a point, and real position 50 of a
point.
[0247] During image capture, image-capture appliance 1 associates
an image 103 of scene 3 with the characteristics 74 used. The light
originating from scene 3 in an observation direction 106 passes
through optical system 100 and arrives at sensor surface 110.
[0248] For the said observation direction, there is then obtained
what is defined as a real point, which exhibits differences
compared with the mathematical point.
[0249] Referring to FIGS. 9a to 9d, a description will now be given
of the differences between the real point and the mathematical
point.
[0250] The real shape 51 associated with the said observation
direction 106 is not a point on the sensor surface, but it has the
form of a cloud in three-dimensional space, where it has an
intersection with one or more pixels 104. These differences are due
in particular to coma, spherical aberration, astigmatism, grouping
into pixels 104, chromatic aberration, depth of field, diffraction,
parasitic reflections and field curvature of image-capture
appliance 1. They give an impression of blurring, or of lack of
sharpness of image 103.
[0251] In addition, real position 50 associated with the said
observation direction 106 exhibits a difference compared with
mathematical position 40 of a point. This difference is due in
particular to the geometric distortion, which gives an impression
of deformation: for example, vertical walls appear to be curved. It
is also due to the fact that the number of pixels 104 is limited,
and that consequently the real position 50 can have only a finite
number of values.
[0252] In addition, the real intensity associated with the said
observation direction 106 exhibits differences compared with the
mathematical intensity of a point. These differences are due in
particular to gamma and vignetting: for example, the edges of image
103 appear to be darker. Furthermore, noise may be added to the
signal.
[0253] Finally, the real color associated with the said observation
direction 106 exhibits differences compared with the mathematical
color of a point. These differences are due in particular to gamma
and the color cast. Furthermore, noise may be added to the
signal.
[0254] A real point is defined as the association of the real
position 50, the real shape 51, the real color and the real
intensity for the observation direction 106 under
consideration.
[0255] The real projection 72 of scene 3 is composed of the set of
real points.
Parameterizable Transformation Model, Parameters, Corrected
Image
[0256] A parameterizable transformation model 12 (or
parameterizable transformation 12 for short) is defined as a
mathematical transformation in which a corrected image 71 can be
obtained from an image 103 and from the value of parameters. As
indicated hereinbelow, the said parameters can in particular be
calculated from the characteristics 74 used.
[0257] By means of the said parameterizable transformation 12, it
is possible in particular to determine, for each real point of
image 103, the corrected position of the said real point, the
corrected color of the said real point, the corrected intensity of
the said real point, and the corrected shape of the said real
point, from the value of the parameters, from the real position of
the said real point and from the values of the pixels of image 103.
As an example, the corrected position can be calculated by means of
polynomials of fixed degree as a function of the real position, the
coefficients of the polynomials depending on the value of the
parameters. The corrected color and the corrected intensity can be,
for example, weighted sums of the values of the pixels, the
coefficients depending on the value of the parameters and on the
real position, or else can be nonlinear functions of the values of
the pixels of image 103.
[0258] A parameterizable reverse transformation model 212 (or
parameterizable reverse transformation 212 for short) is defined as
a mathematical transformation in which an image 103 can be obtained
from a corrected image 71 and from the value of parameters. The
said parameters can be calculated in particular from the
characteristics 74 used as indicated hereinbelow.
[0259] By means of the said parameterizable reverse transformation
212, it is possible in particular to determine, for each point of
the corrected image 71, the real point of image 103 corresponding
to the said point of corrected image 71, and in particular the
position of the said real point, the color of the said real point,
the intensity of the said real point, and the shape of the said
real point, from the value of the parameters and from corrected
image 71. As an example, the position of the real point can be
calculated by means of polynomials of fixed degree as a function of
the position of the point of the corrected image 71, the
coefficients of the polynomials depending on the value of the
parameters.
[0260] The parameters can include in particular: the focal length
of optical system 100 of the configuration used, or a related value
such as the position of a group of lenses, the focusing of optical
system 100 of the configuration used, or a related value such as
the position of a group of lenses, the aperture of optical system
100 of the configuration used, or a related value such as the
position of the diaphragm.
Difference Between the Mathematical Image and the Corrected
Image
[0261] Referring to FIG. 5, the difference 73 between mathematical
image 70 and corrected image 71 for a given scene 3 and given
characteristics 74 used is defined as one or more values determined
from numbers characterizing the position, color, intensity, and
shape of all or part of the corrected points and of all or part of
the mathematical points.
[0262] For example, the difference 73 between mathematical image 70
and corrected image 71 for a given scene 3 and given
characteristics 74 used can be determined as follows: [0263] There
are chosen characteristic points which, for example, may be the
points of an orthogonal array 80 of regularly disposed points, as
illustrated in FIG. 10. [0264] The difference 73 is calculated, for
example, by taking, for each characteristic point, the sum of the
absolute values of the differences between each number
characterizing the corrected position, the corrected color, the
corrected intensity and the corrected shape respectively for the
real point and for the mathematical point. The sum function of the
absolute values of the differences may be replaced by another
function such as the mean, the sum of the squares or any other
function with which the numbers can be combined.
Reference Scene
[0265] A reference scene 9 is defined as a scene 3 for which
certain characteristics are known. As an example, FIG. 4a shows a
reference scene 9 composed of a paper sheet bearing regularly
disposed, solid black circles. FIG. 4b shows another paper sheet
bearing the same circles, with the addition of colored lines and
areas. The circles are used to measure the real position 50 of a
point, the lines to measure the real shape 51 of a point, and the
colored areas to measure the real color of a point and the real
intensity of a point. This reference scene 9 may be composed of a
material other than paper.
Reference Image
[0266] Referring to FIG. 12, a definition will now be given of the
concept of reference image 11. A reference image 11 is defined as
an image of reference scene 9 obtained with image-capture appliance
1.
Synthetic Image, Synthetic-Image Class
[0267] Referring to FIG. 12, a definition will now be given of the
concept of synthetic image 207 and of synthetic-image class 7. A
synthetic image 207 is defined as a mathematical image 70 obtained
by mathematical projection 8 of a reference scene 9. A
synthetic-image class 7 is defined as a set of mathematical images
70 obtained by mathematical projection 8 of one or more reference
scenes 9 for one or more sets of characteristics 74 used. In the
case in which there is only one reference scene 9 and only one set
of characteristics 74 used, the synthetic-image class 7 comprises
only one synthetic image 207.
Transformed Image
[0268] Referring to FIG. 12, a definition will now be given of the
concept of transformed image 13. A transformed image 13 is defined
as the corrected image obtained by application of a parameterizable
transformation model 12 to a reference image 11.
Transformed Image Close to a Synthetic-Image Class, Deviation
[0269] Referring to FIG. 12, a description will now be given of the
concept of transformed image 13 close to a synthetic-image class 7
and of the concept of deviation 14.
[0270] The difference between a transformed image 13 and a
synthetic-image class 7 is defined as the smallest difference
between the said transformed image 13 and any one of the synthetic
images 207 of the said synthetic-image class 7.
[0271] Referring to FIG. 12, a description will next be given of a
fourth algorithm with which it is possible to choose, among the
parameterizable transformation models 12, that with which each
reference image 11 can be transformed to a transformed image 13
close to the synthetic-image class 7 of the reference scene 9
corresponding to the said reference image 11, in different cases of
reference scenes 9 and characteristics 74 used. [0272] In the case
of a given reference scene 9 associated with a set of given
characteristics 74 used, there is chosen the parameterizable
transformation 12 (and its parameters) with which the reference
image 11 can be transformed to the transformed image 13 that
exhibits the smallest difference compared with synthetic-image
class 7. Synthetic-image class 7 and transformed image 13 are then
said to be close. Deviation 14 is defined as the said difference.
[0273] In the case of a group of given reference scenes associated
with sets of given characteristics 74 used, the parameterizable
transformation 12 (and its parameters) is chosen as a function of
the differences between the transformed image 13 of each reference
scene 9 and the synthetic-image class 7 of each reference scene 9
under consideration. There is chosen the parameterizable
transformation 12 (and its parameters) with which the reference
images 11 can be transformed to transformed images 13 such that the
sum of the said differences is minimized. The sum function may be
replaced by another function such as the product. Synthetic-image
class 7 and transformed images 13 are then said to be close.
Deviation 14 is defined as a value obtained from the said
differences, for example by calculating the mean thereof. [0274] In
the case in which certain characteristics 74 used are unknown, it
is possible to determine them from the capture of a plurality of
reference images 11 of at least one reference scene 9. In this
case, there are simultaneously determined the unknown
characteristics and the parameterizable transformation 12 (and its
parameters) with which the reference images 11 can be transformed
to transformed images 13, such that the sum of the said differences
is minimized, in particular by iterative calculation or by solving
equations concerning the sum of the said differences and/or their
product and/or any other appropriate combination of the said
differences. Synthetic-image class 7 and transformed images 13 are
then said to be close. The unknown characteristics may be, for
example, the relative positions and orientations of sensor surface
110 and of each reference scene 9 under consideration. Deviation 14
is defined as a value obtained from the said differences, for
example by calculating the mean thereof. Referring to FIG. 12, a
description will next be given of a first calculation algorithm
with which a choice can be made: [0275] within a set of
parameterizable transformation models, [0276] within a set of
parameterizable reverse transformation models, [0277] within a set
of synthetic images, [0278] within a set of reference scenes and
within a set of transformed images.
[0279] This choice is based on: [0280] a reference scene 9, and/or
[0281] a transformed image 13, and/or [0282] a parameterizable
transformation model 12 with which the reference image 11 obtained
by capturing reference scene 9 by means of image-capture appliance
1 can be transformed to transformed image 13, and/or [0283] a
parameterizable reverse transformation model 212 with which
transformed image 13 can be transformed to reference image 11,
and/or [0284] a synthetic image 207 obtained from reference scene 9
and/or obtained from reference image 11.
[0285] The choice adopted is that which minimizes the difference
between transformed image 13 and synthetic image 207. Synthetic
image 207 and transformed image 13 are then said to be close.
Deviation 14 is defined as the said difference.
[0286] Preferably, according to the invention, it is possible by
means of the first calculation algorithm to choose, within a set of
mathematical projections, one mathematical projection 8 with which
synthetic image 207 can be constructed from reference scene 9.
[0287] Referring to FIG. 12, a description will next be given of a
second calculation algorithm that includes the stages of: [0288]
choosing at least one reference scene 9, [0289] capturing at least
one reference image 11 of each reference scene 9 by means of
image-capture appliance 1.
[0290] This second algorithm additionally includes the stage of
choosing, within a set of parameterizable transformation models and
within a set of synthetic images: [0291] a parameterizable
transformation model 12 with which reference image 11 can be
transformed to a transformed image 13, and/or [0292] a synthetic
image 207 obtained from reference scene 9 and/or obtained from
reference image 11,
[0293] The choice adopted is that which minimizes the difference
between transformed image 13 and synthetic image 207. Synthetic
image 207 and transformed image 13 are then said to be close.
Deviation 14 is defined as the said difference.
[0294] Preferably, according to the invention, it is possible by
means of the second calculation algorithm to choose, within a set
of mathematical projections, one mathematical projection 8 with
which synthetic image 207 can be constructed from reference scene
9.
Best Transformation
[0295] The best transformation is defined as: [0296] the
transformation with which, among the parameterizable transformation
models 12, each reference image 11 can be transformed to a
transformed image 13 close to synthetic-image class 7 of the
reference scene 9 corresponding to the said reference image 11,
and/or, [0297] the parameterizable transformation models 12 among
which the parameterizable transformation models, such as the
transformed image 13, are close to synthetic image 207, and/or
[0298] the parameterizable reverse transformation models 212 among
which the parameterizable reverse models, such as the transformed
image 13, are close to the synthetic image 207.
Calibration
[0299] Calibration is defined as a method with which data related
to the intrinsic characteristics of image-capture appliance 1 can
be obtained, for one or more configurations used, each composed of
an optical system 100 associated with an image-capture appliance
1.
[0300] Case 1: in the case in which there is only one
configuration, the said method includes the following stages:
[0301] the stage of mounting the said optical system 100 on the
said image-capture appliance 1, [0302] the stage of choosing one or
more reference scenes 9, [0303] the stage of choosing several
characteristics 74 used, [0304] the stage of capturing images of
the said reference scenes 9 for the said characteristics used,
[0305] the stage of calculating the best transformation for each
group of reference scenes 9 corresponding to the same
characteristics 74 used.
[0306] Case 2: in the case in which all the configurations
corresponding to a given image-capture appliance 1 and to all
optical systems 100 of the same type are taken into consideration,
the said method includes the following stages: [0307] the stage of
choosing one or more reference scenes 9, [0308] the stage of
choosing several characteristics 74 used, [0309] the stage of
calculating images 103 from characteristics 74 used and in
particular from formulas for optical system 100 of the
configuration used and from values of parameters, by means, for
example, of software for calculating the optical system by ray
tracing, [0310] the stage of calculating the best transformation
for each group of reference scenes 9 corresponding to the same
characteristics used.
[0311] Case 3: in the case in which all the configurations
corresponding to a given optical system 100 and to all the
image-capture appliances 1 of the same type are taken into
consideration, the said method includes the following stages:
[0312] the stage of mounting the said optical system 100 on an
image-capture appliance 1 of the type under consideration, [0313]
the stage of choosing one or more reference scenes 9, [0314] the
stage of choosing several characteristics 74 used, [0315] the stage
of capturing images of the said reference scenes 9 for the said
characteristics used, [0316] the stage of calculating the best
transformation for each group of reference scenes 9 corresponding
to the same characteristics used.
[0317] Calibration can be performed preferentially by the
manufacturer of image-capture appliance 1, for each appliance and
configuration in case 1. This method is more precise but imposes
more limitations and is highly suitable in the case in which
optical system 100 is not interchangeable.
[0318] Alternatively, calibration can be performed by the
manufacturer of image-capture appliance 1, for each appliance type
and configuration in case 2. This method is less precise but is
simpler.
[0319] Alternatively, calibration can be performed by the
manufacturer of image-capture appliance 1 or by a third party, for
each optical system 100 and type of appliance in case 3. This
method is a compromise in which one optical system 100 can be used
on all image-capture appliances 1 of one type, without repeating
the calibration for each combination of image-capture appliance 1
and optical system 100. In the case in which an image-capture
appliance has a non-interchangeable optical system, the method
permits the calibration to be performed only one time for a given
type of appliance.
[0320] Alternatively, calibration can be performed by the appliance
seller or installer, for each image-capture appliance 1 and
configuration in case 1.
[0321] Alternatively, calibration can be performed by the appliance
seller or installer, for each optical system 100 and type of
appliance in case 3.
[0322] Alternatively, calibration can be performed by the appliance
user, for each appliance and configuration in case 1.
[0323] Alternatively, calibration can be performed by the appliance
user, for each optical system 100 and type of appliance in case
3.
Design of the Digital Optical System
[0324] Design of the digital optical system is defined as a method
for reducing the cost of optical system 100, by: [0325] designing
an optical system 100 having defects, especially in positioning of
real points, or choosing the same from a catalog, [0326] reducing
the number of lenses, and/or [0327] simplifying the shape of the
lenses, and/or [0328] using less expensive materials, processing
operations or manufacturing processes.
[0329] The said method includes the following stages: [0330] the
stage of choosing an acceptable difference (within the meaning
defined hereinabove), [0331] the stage of choosing one or more
reference scenes 9, [0332] the stage of choosing several
characteristics 74 used.
[0333] The said method also includes iteration of the following
stages: [0334] the stage of choosing an optical formula that
includes in particular the shape, material and arrangement of the
lenses, [0335] the stage of calculating images 103 from the
characteristics 74 used and in particular from the formulas for
optical system 100 of the configuration used, by employing, for
example, software for calculating the optical system by ray
tracing, or by making measurements on a prototype, [0336] the stage
of calculating the best transformation for each group of reference
scenes 9 corresponding to the same characteristics 74 used, [0337]
the stage of verifying if the difference is acceptable, until the
difference is acceptable.
Formatted Information
[0338] Formatted information 15 associated with image 103, or
formatted information 15, is defined as all or part of the
following data: [0339] data related to the intrinsic technical
characteristics of image-capture appliance 1, especially the
distortion characteristics, and/or [0340] data related to the
technical characteristics of image-capture appliance 1 at the
moment of image capture, especially the exposure time, and/or
[0341] data related to the preferences of the said user, especially
the color temperature, and/or [0342] data related to the deviations
14.
[0343] Database of Characteristics
[0344] A database 22 of characteristics is defined as a database
containing formatted information 15 for one or more image-capture
appliances 1 and for one or more images 103.
[0345] The said database 22 of characteristics can be stored in
centralized or distributed manner, and in particular can be: [0346]
integrated into image-capture appliance 1, [0347] integrated into
optical system 100, [0348] integrated into a removable storage
device, [0349] integrated into a PC or other computer connected to
the other elements during image capture, [0350] integrated into a
PC or other computer connected to the other elements after image
capture, [0351] integrated into a PC or other computer capable of
reading a storage medium shared with image-capture appliance 1,
[0352] integrated into a remote server connected to a PC or other
computer, itself connected to the other image-capture elements.
Fields
[0353] Referring to FIG. 8, a definition will now be given of the
concept of fields 91. The formatted information 15 associated with
image 103 can be recorded in several forms and structured into one
or more tables, but it corresponds logically to all or part of
fields 91, comprising:
[0354] (a) the focal distance,
[0355] (b) the depth of field
[0356] (c) the geometric defects.
[0357] The said geometric defects include geometric defects of
image 103 characterized by the parameters associated with the
filming characteristics 74 and a parameterizable transformation
representing the characteristics of image-capture appliance 1 at
the moment of filming. By means of the said parameters and of the
said parameterizable transformation, it is possible to calculate
the corrected position of a point of image 103.
[0358] The said geometric defects also include the vignetting
characterized by the parameters associated with filming
characteristics 74 and a parameterizable transformation
representing the characteristics of image-capture appliance 1 at
the moment of filming. By means of the said parameters and the said
parameterizable transformation, it is possible to calculate the
corrected intensity of a point of image 103.
[0359] The said geometric defects also include the color cast
characterized by the parameters associated with filming
characteristics 74 and a parameterizable transformation
representing the characteristics of image-capture appliance 1 at
the moment of filming. By means of the said parameters and the said
parameterizable transformation, it is possible to calculate the
corrected color of a point of image 103.
[0360] The said fields 91 also include (d) the sharpness of image
103.
[0361] The said sharpness includes the blurring in resolution of
image 103 characterized by the parameters associated with filming
characteristics 74 and a parameterizable transformation
representing the characteristics of image-capture appliance 1 at
the moment of filming. By means of the said parameters and the said
parameterizable transformation, it is possible to calculate the
corrected shape of a point of image 103. Blurring covers in
particular coma, spherical aberration, astigmatism, grouping into
pixels 104, chromatic aberration, depth of field, diffraction,
parasitic reflections and field curvature.
[0362] The said sharpness also includes the blurring in depth of
field, in particular spherical aberrations, coma and astigmatism.
The said blurring depends on the distance of the points of scene 3
relative to image-capture appliance 1, and it is characterized by
the parameters associated with filming characteristics 74 and a
parameterizable transformation representing the characteristics of
image-capture appliance 1 at the moment of filming. By means of the
said parameters and of the said parameterizable transformation, it
is possible to calculate the corrected shape of a point of image
103.
[0363] The said fields 91 also include (e) parameters of the
quantization method. The said parameters depend on the geometry and
physics of sensor 101, on the architecture of electronic unit 102
and on any processing software that may be used.
[0364] The said parameters include a function that represents the
variations of intensity of a pixel 104 as a function of wavelength
and light flux derived from the said scene 3. The said function
includes in particular gamma information.
[0365] The said parameters also include: [0366] the geometry of the
said sensor 101, especially the shape, the relative position and
the number of sensitive elements of the said sensor 101, [0367] a
function representative of the spatial and temporal distribution of
noise of image-capture appliance 1, [0368] a value representative
of the exposure time for image capture.
[0369] The said fields 91 also include (f) parameters of the
digital-processing operations performed by image-capture appliance
1, especially digital zoom and compression. These parameters depend
on the processing software of image-capture appliance 1 and on the
user's adjustments.
[0370] The said fields 91 also include:
[0371] (g) parameters representative of the user's preferences,
especially as regards the degree of blurring and the resolution of
image 103.
[0372] (h) the deviations 14.
Calculation of Formatted Information
[0373] The formatted information 15 can be calculated and recorded
in database 22 in several stages.
[0374] a) A stage at the end of design of image-capture appliance
1.
[0375] By means of this stage it is possible to obtain intrinsic
technical characteristics of image-capture appliance 1, and in
particular: [0376] the spatial and temporal distribution of the
noise generated by electronic unit 102, [0377] the formula for
conversion of light flux to pixel value, [0378] the geometry of
sensor 101.
[0379] b) A stage at the end of calibration or design of the
digital optical system.
[0380] By means of this stage it is possible to obtain other
intrinsic technical characteristics of image-capture appliance 1,
and in particular, for a certain number of values of
characteristics used, the best associated transformation and the
associated deviation 14.
[0381] c) A stage in which the user's preferences are chosen by
means of pushbuttons, menus or removable media, or of connection to
another device.
[0382] d) An image capture stage.
[0383] By means of this stage (d) it is possible to obtain
technical characteristics of image-capture appliance 1 at the
moment of image capture, and in particular the exposure time, which
is determined by the manual or automatic adjustments made.
[0384] By means of stage (d) it is also possible to obtain the
focal distance. The focal distance is calculated from: [0385] a
measurement of the position of the group of lenses of variable
focal length of optical system 100 of the configuration used, or
[0386] a set value input to the positioning motor, or [0387] a
manufacturer's value if the focal length is fixed.
[0388] The said focal distance can then be determined by analysis
of the content of image 103.
[0389] By means of stage (d) it is also possible to obtain the
depth of field. The depth of field is calculated from: [0390] a
measurement of the position of the group of focusing lenses of
optical system 100 of the configuration used, or [0391] a set value
input to the positioning motor, or [0392] a manufacturer's value if
the depth of field is fixed.
[0393] By means of stage (d) it is also possible to obtain the
defects of geometry and of sharpness. The defects of geometry and
of sharpness correspond to a transformation calculated by means of
a combination of transformations of the database 22 of
characteristics obtained at the end of stage (b). This combination
is chosen to represent the values of parameters corresponding to
the characteristics 74 used, especially the focal distance.
[0394] By means of stage (d) it is also possible to obtain the
parameters of digital processing performed by image-capture
appliance 1. These parameters are determined by the manual or
automatic adjustments made.
[0395] The calculation of formatted information 15 according to
stages (a) to (d) can be performed by: [0396] a device or software
integrated into image-capture appliance 1, and/or [0397] driver
software in a PC or other computer, and/or [0398] software in a PC
or other computer, and/or [0399] a combination of the three.
[0400] The foregoing transformations in stage (b) and stage (d) can
be stored in the form of: [0401] a general mathematical formula,
[0402] a mathematical formula for each point, [0403] a mathematical
formula for certain characteristic points.
[0404] The mathematical formulas can be described by: [0405] a list
of coefficients, [0406] a list of coefficients and coordinates.
[0407] By means of these different methods it is possible to reach
a compromise between the size of the memory available for storage
of the formulas and the calculating power available for calculation
of the corrected images 71.
[0408] In addition, in order to retrieve the data, identifiers
associated with the data are recorded in database 22. These
identifiers include in particular: [0409] an identifier of the type
and of the reference of image-capture appliance 1, [0410] an
identifier of the type and of the reference of optical system 100,
if it is removable, [0411] an identifier of the type and of the
reference of any other removable element having a link to the
stored information, [0412] an identifier of image 103, [0413] an
identifier of the formatted information 15.
Completed Image
[0414] As described by FIG. 11, a completed image 120 is defined as
the image 103 associated with the formatted information 15. This
completed image 120 can preferentially have the form of a file
P100, as described by FIG. 14. Completed image 120 can also be
distributed into a plurality of files.
[0415] Completed image 120 can be calculated by image-capture
appliance 1. It can also be calculated by an external calculating
device, such as a computer.
Image-Processing Software
[0416] Image-processing software 4 is defined as software that
accepts one or more completed images 120 as input and that performs
processing operations on these images. These processing operations
can include in particular: [0417] calculating a corrected image 71,
[0418] performing measurements in the real world, [0419] combining
several images, [0420] improving the fidelity of the images
relative to the real world, [0421] improving the subjective quality
of images, [0422] detecting objects or persons 107 in a scene 3,
[0423] adding objects or persons 107 to a scene 103, [0424]
replacing or modifying objects or persons 107 in a scene 3, [0425]
removing shadows from a scene 3, [0426] adding shadows to a scene
3, [0427] searching for objects in an image base.
[0428] The said image-processing software can be: [0429] integrated
into image-capture appliance 1, [0430] run on calculating means 17
connected to image-capture appliance 1 by transmission means
18.
Digital Optical System
[0431] A digital optical system is defined as the combination of an
image-capture appliance 1, a database 22 of characteristics and a
calculating means 17 that permits: [0432] image capture of an image
103, [0433] calculation of the completed image, [0434] calculation
of the corrected image 71.
[0435] Preferentially, the user obtains corrected image 71
directly. If he wishes, the user may demand suppression of
automatic correction.
[0436] The database 22 of characteristics may be: [0437] integrated
into image-capture appliance 1, [0438] integrated into a PC or
other computer connected to the other elements during image
capture, [0439] integrated into a PC or other computer connected to
the other elements after image capture, [0440] integrated into a PC
or other computer capable of reading a storage medium shared with
image-capture appliance 1, [0441] integrated into a remote server
connected to a PC or other computer, itself connected to the other
image-capture elements.
[0442] Calculating means 17 may be: [0443] integrated onto a
component together with sensor 101, [0444] integrated onto a
component together with part of electronics unit 102, [0445]
integrated into image-capture appliance 1, [0446] integrated into a
PC or other computer connected to the other elements during image
capture, [0447] integrated into a PC or other computer connected to
the other elements after image capture, [0448] integrated into a PC
or other computer capable of reading a storage medium shared with
image-capture appliance 1, [0449] integrated into a remote server
connected to a PC or other computer, itself connected to the other
image-capture elements.
Processing of the Complete Chain
[0450] The foregoing paragraphs have essentially presented precise
details of the concepts and description of the method and system
according to the invention for providing, to image-processing
software 4, formatted information 15 related to the characteristics
of image-capture appliance 1.
[0451] In the paragraphs to follow, an expanded definition will be
given of the concepts and a supplemented description will be given
of the method and system according to the invention for providing,
to image-processing software 4, formatted information 15 related to
the characteristics of image-restitution means 19. In this way the
processing of a complete chain will be explained.
[0452] By means of the processing of the complete chain, it is
possible: [0453] to improve the quality of image 103 from one end
of the chain to the other, to obtain a restituted image 191 while
correcting the defects of image-capture appliance 1 and of
image-restitution means 19, and/or [0454] to use optical systems of
lower quality and of lower cost in a video projector in combination
with software for improvement of image quality.
Definitions Associated with the Image-Restitution Means
[0455] On the basis of FIGS. 2, 17 and 6, a description will now be
given of how the characteristics of an image-restitution means 19
such as a printer, a visual display screen or a projector are taken
into account in the formatted information 15.
[0456] The supplements or modifications to be made to the
definitions in the case of an image-restitution means 19 may be
inferred by analogy by a person skilled in the art by analogy with
the definitions provided in the case of an image-capture appliance
1. Nevertheless, in order to illustrate this method, a description
with reference in particular to FIG. 6 and FIG. 17 will now be
given of the main supplements or modifications.
[0457] By restitution characteristics 95 used there are designated
the intrinsic characteristics of image-restitution means 19, the
characteristics of image-restitution means 19 at the moment of
image restitution, and the user's preferences at the moment of
image restitution. In the case of a projector in particular, the
restitution characteristics 95 used include the shape and position
of the screen used.
[0458] By parameterizable restitution transformation model 97 (or
parameterizable restitution transformation 97 for short), there is
designated a mathematical transformation similar to parameterizable
transformation model 12. By parameterizable reverse restitution
transformation model 297 (or parameterizable reverse restitution
transformation 297 for short), there is designated a mathematical
transformation similar to parameterizable reverse transformation
model 212.
[0459] By corrected restitution image 94 there is designated the
image obtained by application of parameterizable restitution
transformation 97 to image 103.
[0460] By mathematical restitution projection 96 there is
designated a mathematical projection that associates, with a
corrected restitution image 94, a mathematical restitution image 92
on the mathematical restitution surface geometrically associated
with the surface of restitution medium 190. The mathematical
restitution points of the mathematical restitution surface have a
shape, position, color and intensity calculated from corrected
restitution image 94.
[0461] By real restitution projection 90 there is designated a
projection that associates a restituted image 191 with an image
103. The pixel values of image 103 are converted by the electronic
unit of restitution means 19 to a signal that drives the modulator
of restitution means 19. Real restitution points are obtained on
restitution medium 190. The said real restitution points are
characterized by shape, color, intensity and position. The
phenomenon of grouping into pixels 104 described hereinabove in the
case of an image-capture appliance 1 does not occur in the case of
an image-restitution means. On the other hand, an inverse
phenomenon occurs, with the result in particular that lines take on
a staircase appearance.
[0462] Restitution difference 93 is designated as the difference
between restituted image 191 and mathematical restitution image 92.
This restitution difference 93 is obtained by analogy with
difference 73.
[0463] By restitution reference 209 there is designated an image
103 in which the values of pixels 104 are known. By restituted
reference 211 there is designated the restituted image 191 obtained
by mathematical restitution projection 90 of restitution reference
209. By corrected reference restitution image 213, there is
designated the corrected restitution image 94 corresponding to
restitution reference 209 for parameterizable restitution
transformation model 97 and/or for parameterizable reverse
restitution transformation model 297. By synthetic restitution
image 307 there is designated the mathematical restitution image 92
obtained by mathematical restitution projection 96 of corrected
reference restitution image 213.
[0464] By best restitution transformation there is designated:
[0465] for a restitution reference 209 and the restitution
characteristics 95 used, that with which image 103 can be
transformed to a corrected restitution image 94 such that its
mathematical restitution projection 92 exhibits the minimum
restitution difference 93 compared with restituted image 191,
and/or [0466] the parameterizable restitution transformation 97
among the parameterizable restitution transformation models such
that restituted reference 211 exhibits the minimum restitution
difference 93 compared with the synthetic restitution image 307,
and/or [0467] the parameterizable reverse restitution
transformation 297 among the parameterizable reverse transformation
models such that the restituted reference 211 exhibits the minimum
restitution difference 93 compared with the synthetic restitution
image 307.
[0468] The restituted reference 211 and the synthetic restitution
image 307 are then said to be close.
[0469] The methods of restitution calibration and of design of the
digital optical restitution system are comparable with the methods
of calibration and of design of the digital optical system in the
case of an image-capture appliance 1. Nevertheless, differences are
present in certain stages, and in particular the following stages:
[0470] the stage of choosing a restitution reference 209; [0471]
the stage of performing restitution of the said restitution
reference; [0472] the stage of calculating the best restitution
transformation.
[0473] Preferably, according to the invention, the method includes
a sixth algorithm for calculation of the formatted information 15.
By means of this sixth algorithm it is possible to make a choice:
[0474] within a set of parameterizable restitution transformation
models, [0475] within a set of parameterizable reverse restitution
transformation models, [0476] within a set of mathematical
restitution projections, [0477] within a set of restitution
references and within a set of corrected reference restitution
images.
[0478] The choice made by this sixth algorithm is based on: [0479]
a restitution reference 209, and/or [0480] a corrected reference
restitution image 213, and/or [0481] a parameterizable restitution
transformation model 97 with which the restitution reference 209
can be transformed to the corrected reference restitution image
213, and/or [0482] a parameterizable reverse restitution
transformation model 297 with which the corrected reference
restitution image 213 can be transformed to the restitution
reference 209, and/or [0483] a mathematical restitution projection
96 with which a synthetic restitution image 307 can be constructed
from the corrected reference restitution image 213.
[0484] The choice is made by this sixth algorithm in such a way
that the synthetic restitution image 307 is close to the restituted
reference 211 obtained by restitution of restitution reference 209
by means of image-restitution means 19. Restituted reference 211
exhibits a restitution deviation 214 compared with synthetic
restitution image 307.
[0485] According to an alternative embodiment of the invention, the
method includes a seventh algorithm for calculation of the
formatted information. This seventh algorithm includes the stages
of: [0486] choosing at least one restitution reference 209, [0487]
restituting restitution reference 209 to a restituted reference 211
by means of image-restitution means 19.
[0488] By means of this seventh algorithm it is also possible to
choose, within a set of parameterizable restitution transformation
models and within a set of mathematical restitution projections:
[0489] a parameterizable restitution transformation model 97 with
which restitution reference 209 can be transformed to a corrected
reference restitution image 213, and [0490] a mathematical
restitution projection 96 with which a synthetic restitution image
307 can be constructed from corrected reference restitution image
213.
[0491] The choice is made by the seventh algorithm in such a way
that synthetic restitution image 307 is close to restituted
reference 211. The restituted reference exhibits a restitution
deviation 214 compared with the synthetic restitution image 307. By
means of parameterizable reverse restitution transformation model
297, it is possible to transform corrected reference restitution
image 213 to restitution reference 209.
[0492] According to another alternative embodiment of the
invention, the method includes an eighth algorithm for calculation
of the formatted information. This eighth algorithm includes the
stage of choosing a corrected reference restitution image 213. This
eighth algorithm also includes the stage of making a choice within
a set of parameterizable restitution transformation models, within
a set of mathematical restitution projections and within a set of
restitution references. This choice is based on: [0493] a
restitution reference 209, and/or [0494] a parameterizable
restitution transformation model 97 with which restitution
reference 209 can be transformed to corrected reference restitution
image 213, and/or [0495] a parameterizable reverse restitution
transformation model 297 with which the corrected reference
restitution image 213 can be transformed to the restitution
reference 209, and/or [0496] a mathematical restitution projection
96 with which a synthetic restitution image 307 can be constructed
from the corrected reference restitution image 213.
[0497] The eighth algorithm makes this choice in such a way that
synthetic restitution image 307 is close to restituted reference
211 obtained by restitution of restitution reference 209, by means
of image-restitution means 19. Restituted reference 211 exhibits a
restitution deviation compared with synthetic restitution image
307.
[0498] Preferably, according to the invention, the method includes
a ninth algorithm for calculating the restitution deviations 214.
This ninth algorithm includes the stages of: [0499] calculating the
restitution deviations 214 between restituted reference 211 and
synthetic restitution image 307, [0500] associating restitution
deviations 214 with formatted information 15.
[0501] It results from the combination of technical features that
it is possible to verify automatically, for example during
manufacture of the appliance, that the method has produced
formatted information within acceptable tolerances.
[0502] The formatted information 15 related to an image-capture
appliance 1 and that related to an image-restitution means 19 can
be used end-to-end for the same image.
[0503] It is also possible to combine the formatted information 15
related to each of the appliances to obtain formatted information
15 related to the appliance chain, for example by addition of a
vector field, in the case of geometric distortion.
[0504] In the foregoing, a description was given of the concept of
field in the case of an image-capture appliance 1. This concept is
also applicable by analogy in the case of image-restitution means
19. Nonetheless the parameters of the quantization method are
replaced by the parameters of the signal-reconstitution method,
meaning: the geometry of restitution medium 190 and its position, a
function representing the spatial and temporal distribution of the
noise of image-restitution means 19.
[0505] In an alternative embodiment according to the invention,
restitution means 19 is associated with an image-capture appliance
1 to restitute, in digital form, restituted reference 211 from
restitution reference 209. The method is such that, to produce the
formatted information 15 related to the defects P5 of restitution
means 19, the formatted information 15 related to image-capture
appliance 1 associated with the restitution means is used, for
example, to correct the defects of image-capture appliance 1 in
such a way that restituted reference 211 contains only the defects
P5 of restitution means 19.
Generalization of the Concepts
[0506] The technical features of which the invention is composed
and which are specified in the claims have been defined, described
and illustrated by referring essentially to image-capture
appliances of digital type, or in other words appliances that
produce digital images. It can be easily understood that the same
technical features are applicable in the case of image-capture
appliances that would be the combination of an appliance based on
silver technology (a photographic or cinematographic appliance
using sensitive silver halide films, negatives or reversal films)
with a scanner for producing a digital image from the developed
sensitive films. Certainly it is appropriate in this case to adapt
at least some of the definitions used. Such adaptations are within
the capability of the person skilled in the art. In order to
demonstrate the obvious character of such adaptations, it is merely
necessary to mention that the concepts of pixel and pixel value
illustrated by referring to FIG. 3 must, in the case of the
combination of an appliance based on silver technology with a
scanner, be applied to an elemental zone of the surface of the film
after this has been digitized by means of the scanner. Such
transpositions of definitions are self-evident and can be extended
to the concept of the configuration used. As an example, the list
of removable subassemblies of image-capture appliance 1 included in
the configuration used can be supplemented by the type of
photographic film effectively used in the appliance based on silver
technology.
[0507] Other characteristics and advantages of the invention will
become clear upon reading the indicative and non-limitative
definitions and examples explained hereinafter with reference to
FIGS. 1 to 17.
Appliance
[0508] Referring in particular to FIGS. 2, 3 and 13, a description
will be given of the concept of appliance P25. Within the meaning
of the invention, an appliance P25 may be in particular: [0509] an
image-capture appliance 1, such as a disposable photo appliance, a
digital photo appliance, a reflex appliance, a scanner, a fax
machine, an endoscope, a camcorder, a surveillance camera, a game,
a camera integrated into or connected to a telephone, to a personal
digital assistant or to a computer, a thermal camera or an
echographic appliance, [0510] an image-restitution appliance 19 or
image-restitution means 19, such as a screen, a projector, a
television set, virtual-reality goggles or a printer, [0511] an
appliance, including its installation, such as a projector, a
screen and the manner in which they are positioned, [0512] the
positioning of an observer relative to an image-restitution
appliance 19, which introduces parallax errors in particular,
[0513] a human being or observer having vision defects, such as
astigmatism, [0514] an appliance which it is hoped can be emulated,
to produce images having, for example, an appearance similar to
those produced by an appliance of the Leica brand, [0515] an
image-processing device, such as zoom software, which has the edge
effect of adding blurring, [0516] a virtual appliance equivalent to
a plurality of appliances P25, [0517] a more complex appliance P25,
such as a scanner/fax/printer, a photo-printing Minilab, or a
videoconferencing appliance can be regarded as an appliance P25 or
as a plurality of appliances P25.
Appliance Chain
[0518] Referring in particular to FIG. 13, a description will now
be given of the concept of appliance chain P3. An appliance chain
P3 is defined as a set of appliances P25. The concept of appliance
chain P3 may also include a concept of order.
[0519] The following examples constitute appliance chains P3:
[0520] a single appliance P25, [0521] an image-capture appliance
and an image-restitution appliance 19, [0522] a photo appliance, a
scanner or a printer, for example in a photo-printing Minilab,
[0523] a digital photo appliance or a printer, for example in a
photo-printing Minilab, [0524] a scanner, a screen or a printer,
for example in a computer, [0525] a screen or projector, and the
eye of a human being, [0526] one appliance and another appliance
which it is hoped can be emulated, [0527] a photo appliance and a
scanner, [0528] an image-capture appliance and image-processing
software, [0529] image-processing software and an image-restitution
appliance 19, [0530] a combination of the preceding examples,
[0531] another set of appliances P25.
Defect
[0532] Referring in particular to FIG. 13, a description will now
be given of the concept of defect P5. A defect P5 of appliance P25
is defined as a defect related to the characteristics of the
optical system and/or of the sensor and/or of the electronic unit
and/or of the software integrated in an appliance P25; examples of
defects P5 include geometric defects, sharpness defects,
colorimetry defects, geometric distortion defects, geometric
chromatic aberration defects, geometric vignetting defects,
contrast defects, colorimetry defects, in particular rendering of
colors and color cast, defects of flash uniformity, sensor noise,
grain, astigmatism defects and spherical aberration defects.
Image
[0533] Referring in particular to FIGS. 2, 5, 6 and 13, a
description will now be given of the concept of image 103. Image
103 is defined as a digital image captured or modified or
restituted by an appliance P25. Image 103 may originate from an
appliance P25 of appliance chain P3. Image 103 may be addressed to
an appliance P25 of appliance chain P3. More generally, image 103
may be derived from or addressed to appliance chain P3. In the case
of animated images, such as video images, composed of a time
sequence of fixed images, image 103 is defined as one fixed image
of the sequence of images.
Formatted information
[0534] Referring in particular to FIGS. 7, 8, 10 and 13, a
description will now be given of the concept of formatted
information 15. Formatted information 15 is defined as data related
to the defects P5 or characterizing the defects P5 of one or more
appliances P25 of appliance chain P3 and enabling image-processing
means P1 to modify the quality of images 103 by making allowance
for the defects P5 of appliance P25.
[0535] To produce the formatted information 15, there can be used
various methods and systems based on measurements and/or
simulations and/or calibrations, such as, for example, the
calibration method described hereinabove.
[0536] To transmit the formatted information 15, there can be used
a file P100 containing the completed image 120. As an example, an
image-capture appliance 1 such as a digital photo appliance can
produce files containing image 103, formatted information 15 copied
from an internal memory of the appliance, and data in Exif format
containing the adjustments used.
[0537] To produce the formatted information 15, it is possible, for
example, to use the method and the system described in the
International Patent Application filed on the same day as the
present application in the name of Vision IQ and entitled "Method
and system for producing formatted information related to geometric
distortions". That application describes a method for producing
formatted information 15 related to the appliances P25 of an
appliance chain P3. Appliance chain P3 is composed in particular of
at least one image-capture appliance and/or at least one
image-restitution appliance. The method includes the stage of
producing formatted information 15 related to the geometric
distortions of at least one appliance P25 of the chain.
[0538] Appliance P25 preferably makes it possible to capture or
restitute an image on a medium. Appliance P25 contains at least one
fixed characteristic and/or one variable characteristic depending
on the image. The fixed characteristic and/or variable
characteristic can be associated with one or more values of
characteristics, especially the focal length and/or the focusing
and their values of associated characteristics. The method includes
the stage of producing, from a measured field, measured formatted
information related to the geometric distortions of the appliance.
The formatted information 15 may include the measured formatted
information.
[0539] To produce the formatted information 15, it is possible, for
example, to use the method and the system described in the
International Patent Application filed on the same day as the
present application in the name of Vision IQ and entitled "Method
and system for producing formatted information related to the
defects of at least one appliance of a chain, especially to
blurring". That application describes a method for producing
formatted information 15 related to the appliances P25 of an
appliance chain P3. Appliance chain P3 is composed in particular of
at least one image-capture appliance and/or at least one
image-restitution appliance. The method includes the stage of
producing formatted information 15 related to the defects P5 of at
least one appliance P25 of the chain. Preferably, appliance P25
with which an image can be captured or restituted contains at least
one fixed characteristic and/or one variable characteristic
depending on the image (I). The fixed and/or variable
characteristics can be associated with one or more values of
characteristics, especially the focal length and/or the focusing
and their values of associated characteristics. The method includes
the stage of producing measured formatted information related to
the defects P5 of appliance P25 from a measured field. The
formatted information 15 may include the measured formatted
information.
[0540] To produce the formatted information 15, it is possible, for
example, to use the method and the system described in the
International Patent Application filed on the same day as the
present application in the name of Vision IQ and entitled "Method
and system for reducing update frequency of image processing
means". That application describes a method for reducing the update
frequency of image-processing means P1, in particular software
and/or a component. The image-processing means make it possible to
modify the quality of the digital images derived from or addressed
to an appliance chain P3. Appliance chain P3 is composed in
particular of at least one image-capture appliance and/or at least
one image-restitution appliance. Image-processing means P1 employ
formatted information 15 related to the defects P5 of at least one
appliance of appliance chain P5. The formatted information 15
depends on at least one variable. The formatted information 15
makes it possible to establish a correspondence between one part of
the variables and of the identifiers. By means of the identifiers
it is possible to determine the value of the variable corresponding
to the identifier by taking the identifier and the image into
account. It results from the combination of technical features that
it is possible to determine the value of a variable, especially in
the case in which the physical significance and/or the content of
the variable are known only after distribution of image-processing
means P1. It also results from the combination of technical
features that the time between two updates of the correction
software can be spaced apart. It also results from the combination
of technical features that the various economic players that
produce appliances and/or image-processing means can update their
products independently of other economic players, even if the
latter radically change the characteristics of their product or are
unable to force their client to update their products. It also
results from the combination of technical features that a new
functionality can be deployed progressively by starting with a
limited number of economic players and pioneer users.
[0541] To search for the formatted information 15, it is possible,
for example, to use the method and the system described in the
International Patent Application filed on the same day as the
present application in the name of Vision IQ and entitled "Method
and system for modifying the quality of at least one image derived
from or addressed to an appliance chain". That application
describes a method for modifying the quality of at least one image
103 derived from or addressed to a specified appliance chain. The
specified appliance chain is composed of at least one image-capture
appliance and/or at least one image-restitution appliance. The
image-capture appliances and/or the image-restitution appliances
being progressively introduced on the market by separate economic
players belong to an indeterminate set of appliances. The
appliances P25 of the set of appliances exhibit defects P5 that can
be characterized by formatted information 15. For the image in
question, the method includes the following stages: [0542] the
stage of compiling directories of the sources of formatted
information related to the appliances P25 of the set of appliances,
[0543] the stage of automatically searching for specific formatted
information related to the specified appliance chain among the
formatted information 15 compiled in this way, [0544] the stage of
automatically modifying the image by means of image-processing
software and/or image-processing components, while taking into
account the specific formatted information obtained in this
way.
[0545] To exploit the formatted information 15, it is possible, for
example, to use the method and the system described in the
International Patent Application filed on the same day as the
present application in the name of Vision IQ and entitled "Method
and system for calculating a transformed image from a digital image
and formatted information related to a geometric transformation".
That application describes a method for calculating a transformed
image from a digital image and formatted information 15 related to
a geometric transformation, especially formatted information 15
related to the distortions and/or chromatic aberrations of an
appliance chain P3. The method includes the stage of calculating
the transformed image from an approximation of the geometric
transformation. It results therefrom that the calculation is
economical in terms of memory resources, in memory bandpass, in
calculating power and therefore in electricity consumption. It also
results therefrom that the transformed image does not exhibit any
visible or annoying defect as regards its subsequent use.
[0546] To exploit the formatted information 15, it is possible, for
example, to use the method and the system described in the
International Patent Application filed on the same day as the
present application in the name of Vision IQ and entitled "Method
and system for modifying a digital image, taking into account its
noise". That application describes a method for calculating a
transformed image from a digital image and formatted information 15
related to the defects P5 of an appliance chain P3. Appliance chain
P3 includes image-capture appliances and/or image-restitution
appliances. Appliance chain P3 contains at least one appliance P25.
The method includes the stage of automatically determining the
characteristic data from the formatted information 15 and/or the
digital image. It results from the combination of technical
features that the transformed image does not exhibit any visible or
annoying defect, especially defects related to noise, as regards
its subsequent use.
Image-Processing Means
[0547] Referring in particular to FIGS. 7 and 13, a description
will now be given of the concept of image-processing means P1.
Within the meaning of the present invention, image-processing means
P1 are defined, for example, as image-processing software 4 and/or
a component and/or an equipment item and/or a system capable of
modifying the quality of image 103 by employing formatted
information 15 in order to produce a modified image, such as a
corrected image 71 or a corrected restitution image 97. The
modified image may be addressed to a second appliance of appliance
chain P3, distinct or not from appliance P25, for example, the
following appliance in appliance chain P3.
[0548] The modification of image quality by image-processing means
P1 may consist, for example, in: [0549] suppressing or attenuating
the defects P5 of one or more appliances P25 of appliance chain P3
in image 103, and/or [0550] modifying image 103 to add at least one
defect P5 of one or more appliances P25 of appliance chain P3 in
such a way that the modified image resembles an image captured by
appliance or appliances P25, and/or [0551] modifying image 103 to
add at least one defect P5 of one or more appliances P25 of
appliance chain P3 in such a way that the restitution of the
modified image resembles an image restituted by appliance or
appliances P25, and/or [0552] modifying image 103 by taking into
account the formatted information 15 related to the vision defects
P5 of the eye P25 of a human being in appliance chain P3 in such a
way that restitution of the modified image is perceived by the eye
of the human being as corrected for all or part of the defects
P5.
[0553] A correction algorithm is defined as the method employed by
an image-processing means P1 to modify image quality depending on
the defect P5.
[0554] Image-processing means P1 may assume various forms depending
on the application.
[0555] Image-processing means P1 may be integrated entirely or
partly in appliance P25, as in the following examples: [0556] an
image-capture appliance that produces modified images, such as a
digital photo appliance in which image-processing means P1 are
integrated, [0557] an image-restitution appliance 19, which
displays or prints modified images, such as a video projector in
which image-processing means P1 are included, [0558] a hybrid
appliance, which corrects the defects of its elements, such as a
scanner/printer/fax machine in which image-processing means P1 are
included, [0559] a professional image-capture appliance, which
produces modified images, such as an endoscope in which
image-processing means P1 are included.
[0560] In the case in which image-processing means P1 are
integrated in appliance P25, appliance P25 in practice corrects its
own defects P5, and the appliances P25 of appliance chain P3 can be
determined by design, for example in a fax machine: a scanner and a
printer; nevertheless, the user is able to use only part of the
appliances P25 of appliance chain P3, for example if the fax
machine can also be used as a stand-alone printer.
[0561] Image-processing means P1 can be integrated entirely or
partly in a computer, for example in the following manner: [0562]
in an operating system, such as Windows or the Mac OS, in order to
modify automatically the quality of images derived from or
addressed to a plurality of appliances P25, which may vary
depending on image 103 and/or in time, examples being scanners,
photo appliances and printers; the automatic correction may be
made, for example, when image 103 is input into the system, or when
printing is requested by the user, [0563] in an image-processing
application, such as Photoshop.TM., to modify automatically the
quality of images derived from or addressed to a plurality of
appliances P25, which may vary depending on image 103 and/or in
time, examples being scanners, photo appliances and printers; the
automatic correction may be made, for example, when the user
activates a filter command in Photoshop.TM., [0564] in a
photo-printing appliance (such as Photofinishing or Minilab in
English), to modify automatically the quality of images derived
from a plurality of photo appliances, which may vary depending on
the image and/or in time, examples being disposable cameras,
digital photo appliances and compact disks, the automatic
correction may take into account the photo appliances as well as
the integrated scanner and printer, and may be applied at the
moment at which the printing jobs are initiated, [0565] on a
server, for example on the Internet, to modify automatically the
quality of images derived from a plurality of photo appliances,
which may vary depending on the image and/or in time, examples
being disposable cameras and digital photo appliances, the
automatic correction may take into account the photo appliances as
well as a printer, for example, and may be applied at the moment at
which the images 103 are recorded on the server, or at the moment
at which the printing jobs are initiated.
[0566] In the case in which image-processing means P1 are
integrated in a computer, image-processing means P1 are for
practical purposes compatible with multiple appliances P25, and at
least one appliance P25 of appliance chain P3 may vary from one
image 103 to another.
[0567] To provide formatted information 15 in a standard format to
image-processing means P1, it is possible, for example, to
associate the formatted information 15 with image 103: [0568] in a
file P100, [0569] by using identifiers of appliances P25 of
appliance chain P3, such as data in Exif format in file P100, in
order to retrieve formatted information 15 in database 22 of
characteristics.
Variable Characteristic
[0570] On the basis of FIG. 13, a description will now be given of
the concept of variable characteristic P6. According to the
invention, a variable characteristic P6 is defined as a measurable
factor, which is variable from one image 103 to another that has
been captured, modified or restituted by the same appliance P25,
and which has an influence on defect P5 of the image that has been
captured, modified or restituted by appliance P25, especially:
[0571] a global variable characteristic, which is fixed for a given
image 103, an example being a characteristic of appliance P25 at
the moment of capture or restitution of the image, related to an
adjustment of the user or related to an automatic function of
appliance P25, such as the focal length, [0572] a local variable
characteristic, which is variable within a given image 103, an
example being coordinates x, y or rho, theta in the image,
permitting image-processing means P1 to apply local processing that
differs depending on the zone of the image.
[0573] A measurable factor which is variable from one appliance P25
to another but which is fixed from one image 103 to another that
has been captured, modified or restituted by the same appliance P25
is not generally considered to be a variable characteristic P6. An
example is the focal length for an appliance P25 with fixed focal
length.
[0574] The adjustments used as described hereinabove are examples
of variable characteristics P6.
[0575] The formatted information 15 may depend on at least one
variable characteristic P6.
[0576] By variable characteristic P6 there can be understood in
particular: [0577] the focal length of the optical system, [0578]
the redimensioning applied to the image (digital zoom factor:
enlargement of part of the image; and/or under-sampling: reduction
of the number of pixels of the image), [0579] the nonlinear
brightness correction, such as the gamma correction, [0580] the
enhancement of contour, such as the level of deblurring applied by
appliance P25, [0581] the noise of the sensor and of the electronic
unit, [0582] the aperture of the optical system, [0583] the
focusing distance, [0584] the number of the frame on a film, [0585]
the underexposure or overexposure, [0586] the sensitivity of the
film or sensor, [0587] the type of paper used in a printer, [0588]
the position of the center of the sensor in the image, [0589] the
rotation of the image relative to the sensor, [0590] the position
of a projector relative to the screen, [0591] the white balance
used, [0592] the activation of a flash and/or its power, [0593] the
exposure time, [0594] the sensor gain, [0595] the compression,
[0596] the contrast, [0597] another adjustment applied by the user
of appliance P25, such as a mode of operation, [0598] another
automatic adjustment of appliance P25, [0599] another measurement
performed by appliance P25.
[0600] In the case of a restitution means 19, the variable
characteristic P6 can also be defined as variable restitution
characteristic.
Variable Characteristic Value
[0601] On the basis of FIG. 13, a description will now be given of
the concept of variable characteristic value P26. A variable
characteristic value P26 is defined as the value of variable
characteristic P6 at the moment of capture, modification or
restitution of a specified image, such value being obtained, for
example, from data in Exif format present in file P100.
Image-processing means P1 can then process or modify the quality of
image 103 as a function of variable characteristics P6, by using
formatted information 15 that depends on variable characteristics
P6 and by determining the value P26 of the variable
characteristics.
[0602] In the case of a restitution means 19, the value of variable
characteristic P6 can also be defined as a variable restitution
characteristic.
Measured Formatted Information, Extended Formatted Information
[0603] As illustrated in FIG. 15, the formatted information 15 or a
fraction of the formatted information 15 can include measured
formatted information P101 to illustrate a raw measurement, such as
a mathematical field related to geometric distortion defects at a
certain number of characteristic points of an array 80. As
illustrated in FIG. 15, the formatted information 15 or a fraction
of the formatted information 15 can include extended formatted
information P102, which can be calculated from measured formatted
information P101, for example by interpolation for real points
other than the characteristic points of array 80. In the foregoing,
it has been seen that a formatted information item 15 might depend
on variable characteristics P6. According to the invention, a
combination P120 is defined as a combination composed of variable
characteristics P6 and of values P26 of variable characteristics,
an example being a combination P120 composed of the focal length,
of the focusing, of the diaphragm aperture, of the capture speed,
of the aperture, etc. and of associated values. It is difficult to
imagine how the formatted information 15 related to different
combinations P120 can be calculated, all the more so because
certain characteristics of combination P120, such as the focal
length and the distance, can vary continuously.
[0604] The invention provides for calculating the formatted
information 15 in the form of extended formatted information P102
by interpolation from measured formatted information P101 related
to a predetermined selection of combinations P120 of known variable
characteristics P6.
[0605] For example, measured formatted information P101 related to
the combination P120 of "focal length=2, distance=7, capture speed=
1/100", to the combination of "focal length=10, distance=7, capture
speed= 1/100" and to the combination of "focal length=50,
distance=7, capture speed= 1/100" is used to calculate extended
formatted information P102 that depends on focal length as the
variable characteristic P6. By means of this extended formatted
information P102, it is possible in particular to determine
formatted information related to the combination of "focal
length=25, distance=7 and capture speed= 1/100".
[0606] The measured formatted information P101 and the extended
formatted information P102 may exhibit an interpolation deviation
P121. The invention may include the stage of selecting zero or one
or more variable characteristics P6, such that interpolation
deviation P121 for the extended formatted information P102 obtained
for the variable characteristics P6 selected in this way is smaller
than a predetermined interpolation threshold. In fact, certain
variable characteristics P6 may have a smaller influence than
others on the defect P5, and the error introduced by making the
approximation that these are constant may merely be minimum; for
example, the focusing adjustment may have merely a slight influence
on the vignetting defect, and for this reason may not be part of
the variable characteristics P6 selected. The variable
characteristics P6 may be selected at the moment of production of
the formatted information 15. It results from the combination of
technical features that the modification of image quality employs
simple calculations. It also results from the combination of
technical features that the extended formatted information P102 is
compact. It also results from the combination of technical features
that the eliminated variable characteristics P6 have the least
influence on the defect P5. It results from the combination of
technical features that image quality can be modified with
specified precision by means of the formatted information 15.
[0607] In the case of a restitution means 19, the combination 120
may also be defined as a restitution combination.
[0608] In the case of a restitution means 19, the measured
formatted information P101 may also be defined as measured
formatted restitution information.
[0609] In the case of a restitution means 19, the extended
formatted information P102 may also be defined as extended
formatted restitution information.
[0610] In the case of a restitution means 19, the interpolation
deviations P121 may also be defined as interpolation restitution
deviations.
Parameterizable Model, Parameters
[0611] Referring in particular to FIGS. 5, 6 and 16, a description
will now be given of the concept of parameters P9 and
parameterizable model P10. Within the meaning of the invention, a
parameterizable model P10 is defined as a mathematical model that
may depend on variables P6 and that may be related to one or more
defects P5 of one or more appliances P25; parameterizable
transformation model 12, parameterizable reverse transformation
model 212, parameterizable restitution transformation model 97 and
parameterizable restitution transformation model 297 described
hereinabove are examples of parameterizable models P10; for
example, a parameterizable model P10 may be related to: [0612]
sharpness defects or blurring of a digital photo appliance, [0613]
geometric vignetting defects of a photo appliance which it is hoped
can be emulated, [0614] geometric distortion defects and geometric
chromatic aberration defects of a projector, [0615] sharpness or
blurring defects of a disposable photo appliance combined with a
scanner.
[0616] The formatted information 15 related to a defect P5 of an
appliance P25 may be presented in the form of the parameters P9 of
a parameterizable model P10 depending on variable characteristics
P6; by means of the parameters P9 of parameterizable model P10, it
is possible to identify a mathematical function P16 in a set of
mathematical functions, such as multi-variable polynomials; by
means of the mathematical functions P16, it is possible to modify
image quality as a function of specified values of the variables
P6.
[0617] In such a way that image-processing means P1 can use the
parameters P9 of parameterizable transformation model P10 to
calculate the modified image, for example to calculate the
corrected intensity or the corrected restitution intensity of a
point of the image.
Color Plane
[0618] Referring in particular to FIG. 15, a description will now
be given of the concept of color plane P20 of a colored image 103.
Image 103 can be decomposed into color planes P20 in various ways:
number of planes (1, 3 or more), precision (8 bits unsigned, 16
bits signed, floating, etc.) and significance of the planes
(relative to a standard color space). Image 103 can then be
decomposed in various ways into color planes P20: red color plane
composed of red pixels, green color plane, blue color plane (RGB)
or brightness, saturation, hue, etc.; on the other hand, color
spaces such as PIM exist, or negative pixel values are possible in
order to permit representation of subtractive colors, which cannot
be represented in positive RGB; finally, it is possible to encode a
pixel value on 8 bits or 16 bits, or by using floating values. As
an example of how the formatted information 15 may be related to
the color planes P20, the sharpness defects can be characterized
differently for the planes of red, green and blue color, to permit
image-processing means P1 to correct the sharpness defect
differently for each color plane P20.
Provision of the Formatted Information
[0619] On the basis in particular of FIGS. 8, 13, 15 and 16, a
description will now be given of an alternative embodiment of the
invention. To provide formatted information 15 in a standard format
to image-processing means P1, the system includes data-processing
means and the method includes the stage of filling in at least one
field 91 of the standard format with the formatted information 15.
Field 91 may then contain in particular: [0620] values related to
the defects P5, for example in the form of parameters P9, in such a
way that image-processing means P1 can use the parameters P9 to
modify image quality by taking the defects P5 into account, and/or
[0621] values related to the sharpness defects, for example in the
form of parameters P9, in such a way that image-processing means P1
can use the parameters P9 to modify image quality by taking the
sharpness defects into account, and to calculate the corrected
shape or the corrected restitution shape of a point of the image,
and/or [0622] values related to the colorimetry defects, for
example in the form of parameters P9, in such a way that
image-processing means P1 can use the parameters P9 to modify image
quality by taking the colorimetry defects into account, and to
calculate the corrected color or the corrected restitution color of
a point of the image, and/or [0623] values related to the geometric
distortion defects and/or to the geometric chromatic aberration
defects, for example in the form of parameters P9, in such a way
that image-processing means P1 can use the parameters P9 to modify
image quality by taking the geometric distortion defects and/or the
geometric chromatic aberration defects into account, and to
calculate the corrected position or the corrected restitution
position of a point of the image, and/or [0624] values related to
the geometric vignetting defects, for example in the form of
parameters P9, in such a way that image-processing means P1 can use
the parameters P9 to modify image quality by taking the geometric
vignetting defects into account, and to calculate the corrected
intensity or the corrected restitution intensity of a point of the
image, and/or [0625] values related to the deviations 14, and/or
[0626] values that are functions of variable characteristics P6
depending on image 103, for example the polynomial coefficients and
terms which depend on the variable characteristic P6 corresponding
to the focal length and with which it is possible to calculate the
corrected intensity of a point of the image as a function of its
distance from the center, in such a way that the image-processing
means can calculate the corrected intensity of a point for any
value of focal length of the image-capture appliance at the moment
at which image 103 was captured, [0627] values related to formatted
information related to the color planes P20, [0628] values related
to formatted information, [0629] values related to measured
formatted information, [0630] values related to extended formatted
information.
Production of Formatted Information
[0631] On the basis in particular of FIGS. 7, 12 and 17, a
description will now be given of an alternative embodiment of the
invention. To produce formatted information 15 related to the
defects P5 of the appliances P25 of an appliance chain P3, the
invention can employ data-processing means and the first algorithm
and/or second algorithm and/or third algorithm and/or fourth
algorithm and/or fifth algorithm and/or sixth algorithm and/or
seventh algorithm and/or eighth algorithm as described
hereinabove.
Application of the Invention to Cost Reduction
[0632] Cost reduction is defined as a method and system for
lowering the cost of an appliance P25 or of an appliance chain P3,
especially the cost of the optical system of an appliance or of an
appliance chain, the method consisting in: [0633] reducing the
number of lenses, and/or [0634] simplifying the shape of the
lenses, and/or [0635] designing an optical system having defects P5
that are larger than those desired for the appliance or the
appliance chain, or choosing the same from a catalog, and/or [0636]
using materials, components, processing operations or manufacturing
methods that are less costly for the appliance or the appliance
chain and that add defects.
[0637] The method and system according to the invention can be used
to lower the cost of an appliance or of an appliance chain: it is
possible to design a digital optical system, to produce formatted
information related to the defects of the appliance or of the
appliance chain, to use this formatted information to enable
image-processing means P1, whether they are integrated or not, to
modify the quality of images derived from or addressed to the
appliance or to the appliance chain, in such a way that the
combination of the appliance or the appliance chain with the
image-processing means is capable of capturing, modifying or
restituting images of the desired quality at reduced cost.
* * * * *