U.S. patent application number 15/427765 was filed with the patent office on 2018-08-09 for in-pixel digital gain and offset corrections.
The applicant listed for this patent is Sensors Unlimited, Inc.. Invention is credited to Andrew Eckhardt, John Liobe, Joshua Lund.
Application Number | 20180227519 15/427765 |
Document ID | / |
Family ID | 63014034 |
Filed Date | 2018-08-09 |
United States Patent
Application |
20180227519 |
Kind Code |
A1 |
Liobe; John ; et
al. |
August 9, 2018 |
IN-PIXEL DIGITAL GAIN AND OFFSET CORRECTIONS
Abstract
A method includes correcting for at least one of gain and offset
during frame integration for photodetector events. Gain and offset
correction is performed separately in each pixel of a digital
read-out integrated circuit (DROIC) for a plurality of
corresponding pixels in a photodetector array. First and second
binary counters respectively use a gain register and an offset
register to implement gain and offset correction.
Inventors: |
Liobe; John; (New York,
NY) ; Eckhardt; Andrew; (Richboro, PA) ; Lund;
Joshua; (Dallas, TX) |
|
Applicant: |
Name |
City |
State |
Country |
Type |
Sensors Unlimited, Inc. |
Princeton |
NJ |
US |
|
|
Family ID: |
63014034 |
Appl. No.: |
15/427765 |
Filed: |
February 8, 2017 |
Current U.S.
Class: |
1/1 |
Current CPC
Class: |
H04N 5/378 20130101;
H04N 5/37455 20130101; H04N 5/3651 20130101; H04N 5/379
20180801 |
International
Class: |
H04N 5/365 20060101
H04N005/365; H04N 5/378 20060101 H04N005/378; H04N 5/374 20060101
H04N005/374 |
Claims
1. (canceled)
2. A method comprising: correcting for at least one of gain and
offset during frame integration for photodetector events, wherein
gain and offset correction is performed separately in each pixel
pitch of a digital read-out integrated circuit (DROIC) for a
plurality of corresponding pixels in a photodetector array, wherein
the DROIC includes a first binary counter and a second binary
counter in each pixel pitch of the DROIC and wherein correcting
includes: counting pulses in a pulse stream by incrementing a
counter value in the first binary counter of each pixel in the
DROIC; resetting counter value in the first binary counter whenever
the counter value reaches a value equal to a value in a respective
gain register for each the pixel pitch of the DROIC; and masking a
subsequent pulse after resetting the counter value of the first
binary counter to refrain from incrementing the counter value in
the secondary binary counter for the subsequent pulse.
3. The method as recited in claim 2, further comprising: loading an
offset register value into the second binary counter in the DROIC
to initialize the counter value of the second register at the
beginning of frame integration; and reading out the counter value
from the second binary counter at the end of frame integration so
that the second binary counter reads out a gain and offset
corrected digital output for each respective pixel pitch of the
DROIC.
4. The method as recited in claim 3, wherein offset and gain
registers for each pixel pitch of the DROIC are only loaded once
for multiple frame integrations.
5. (canceled)
6. A system comprising: a photodetector array including a plurality
of photodetector pixels; a read-out integrated circuit (ROIC)
operatively connected to the photodetector array; and a digital
read-out integrated circuit (DROIC) operatively connected to the
ROIC to receive pixel pulses from the ROIC indicative of
photodetector events incident on the photodetector pixels, wherein
the DROIC is configured for correcting for at least one of gain and
offset during frame integration for photodetector events, wherein
gain and offset correction is performed separately in each pixel
pitch of the DROIC for a plurality of corresponding pixels in a
photodetector array, wherein the DROIC includes a respective pixel
for each of the photodetector pixels, wherein each pixel of the
DROIC includes: a first binary counter configured to increment a
counter value of the first binary counter in response to analog
pixel pulses read into the first binary counter; a comparator
operatively connected to a respective gain register and to the
first binary counter to compare the counter value of the first
binary counter to a gain value of the gain register; and a second
binary counter operatively connected to the comparator which
disables the second binary counter each time the counter value of
the first binary counter equals the gain value of the gain
register.
7. The system of claim 6, further comprising a respective offset
register in each pixel pitch of the DROIC operatively connected to
the second binary counter, wherein the second binary counter is
configured to initialize the counter value of the second binary
counter to equal an offset value of the offset register and to read
out gain and offset corrected digital output.
8. The system of claim 6, further comprising at least one of a
non-volatile memory or a dynamic random access memory (DRAM)
operatively connected to the DROIC to load values for the offset
register and the gain register for each pixel pitch of the DROIC
only once for multiple frame integrations.
9. The system of claim 6, wherein each of the first binary counter
and the second binary counter are operatively connected to receive
a pulse stream from an imaging pixel.
10. The system of claim 9, wherein the comparator has an output
connected to reset the counter value in the first binary counter
whenever the counter value of the first binary counter equals the
gain value of the gain register, and further comprising a NOT logic
component connecting the output of the comparator to the second
binary counter to disable the second binary counter when the
counter value in the first binary counter equals the gain value of
the gain register.
11. The system of claim 6, wherein only the first binary counter is
operatively connected to receive a pulse stream from an imaging
pixel, and the second binary counter is not directly connected to
receive the pulse stream.
12. The system of claim 11, wherein the comparator has an output
connected to reset the counter value in the first binary counter
whenever the counter value of the first binary counter equals the
gain value of the gain register, and further comprising an XOR
logic component, wherein the XOR logic component includes two
inputs, one connected to receive the pulse stream from the imaging
pixel and another connected to the output of the comparator, and
wherein the XOR logic component includes an output connected as an
input to the second binary counter.
13. The system of claim 6, wherein at least one of the gain
register or the offset register is physically located in the pixel
pitch of the DROIC for each respective pixel pitch of the
DROIC.
14. The system of claim 6, wherein at least one of the gain
register or the offset register is physically located outside of
the pixel pitch of the DROIC for each respective pixel pitch of the
photodetector array.
Description
BACKGROUND OF THE INVENTION
1. Field of the Invention
[0001] The present disclosure relates to imaging, and more
particularly to gain and offset corrections in digital imaging.
2. Description of Related Art
[0002] Many imaging sensors require pixel-wise corrections to
adjust for gain, offset, and linearity variation. This is typically
done with digital post-processing. Correction parameters may be
stored in non-volatile memory and/or dynamic random access memory
(DRAM) and can be loaded into a correction processor as pixel
values are read out. The power and electronics complexity for
supporting a high bandwidth memory interface are both significant
contributors to camera SWaP (size, weight, and power).
[0003] The conventional techniques have been considered
satisfactory for their intended purpose. However, there is an ever
present need for improved gain and offset correction. This
disclosure provides a solution for this problem.
SUMMARY OF THE INVENTION
[0004] A method includes correcting for at least one of gain and
offset during frame integration for photodetector events. Gain and
offset correction is performed separately in each pixel pitch of a
digital read-out integrated circuit (DROIC) for a plurality of
corresponding pixels in a photodetector array.
[0005] The DROIC can include a first binary counter and a second
binary counter in each pixel pitch of the DROIC. Correcting can
include counting pulses in a pulse stream by incrementing a counter
value in the first binary counter of each pixel in the DROIC, and
resetting counter value in the first binary counter whenever the
counter value reaches a value equal to a value in a respective gain
register for each the pixel pitch of the DROIC.
[0006] The method can include disabling the second binary counter
each time the counter value of the first binary counter reaches the
value equal to the value in the respective gain register. This same
method can include masking a subsequent pulse after resetting the
counter value of the first binary counter to refrain from
incrementing the counter value in the secondary binary counter for
the subsequent pulse.
[0007] In another aspect, it is contemplated that the method can
include loading an offset register value into the second binary
counter in the DROIC to initialize the counter value of the second
register at the beginning of frame integration, and reading out the
counter value from the second binary counter at the end of frame
integration so that the second binary counter reads out a gain and
offset corrected digital output for each respective pixel pitch of
the DROIC. Offset and gain registers for each pixel pitch of the
DROIC need only be loaded once for multiple frame integrations.
[0008] A system includes a photodetector array including a
plurality of photodetector pixels. A read-out integrated circuit
(ROIC) is operatively connected to the photodetector array. A
digital read-out integrated circuit (DROIC) is operatively
connected to the ROIC to receive pulses from the ROIC indicative of
photodetector events incident on the photodetector pixels. The
DROIC includes a respective pixel pitch for each of the
photodetector pixels. Each pixel pitch of the DROIC includes a
first binary counter configured to increment a counter value of the
first binary counter in response to pulses read into the first
binary counter, a comparator operatively connected to a respective
gain register and to the first binary counter to compare the
counter value of the first binary counter to a gain value of the
gain register, and a second binary counter operatively connected to
the comparator to disable the second binary counter from
incrementing its counter value each time the counter value of the
first binary counter equals the gain value of the gain
register.
[0009] The system can include a respective offset register in each
pixel pitch of the DROIC operatively connected to the second binary
counter, wherein the second binary counter is configured to
initialize the counter value of the second binary counter to equal
the offset value of the offset register and to read out gain and
offset corrected digital output. The system can include at least
one of a non-volatile memory or a dynamic random access memory
(DRAM) operatively connected to the DROIC to load values for the
offset register and the gain register for each pixel pitch of the
DROIC only once for multiple frame integrations.
[0010] Each of the first binary counter and the second binary
counter can be operatively connected to receive a pulse stream from
an imaging pixel. The comparator can have an output connected to
reset the counter value in the first binary counter whenever the
counter value of the first binary counter equals the gain value of
the gain register, and a NOT logic component can connect the output
of the comparator to the second binary counter to disable the
second binary counter when the counter value in the first binary
counter equals the gain value of the gain register.
[0011] In another aspect, only the first binary counter need be
operatively connected to receive a pulse stream from an imaging
pixel, e.g., wherein the second binary counter is not directly
connected to receive the pulse stream. The comparator can have an
output connected to reset the counter value in the first binary
counter whenever the counter value of the first binary counter
equals the gain value of the gain register, and a XOR logic
component can be included, wherein the XOR logic component has two
inputs, one connected to receive the pulse stream and another
connected to the output of the comparator, and wherein the XOR
logic component includes an output connected as an input to the
second binary counter.
[0012] At least one of the gain register or the offset register can
be physically located in the pixel pitch of the DROIC for each
respective photodetector pixel. It is also contemplated that at
least one of the gain register or the offset register can be
physically located outside of the pixel pitch of the DROIC for each
respective photodetector pixel.
[0013] These and other features of the systems and methods of the
subject disclosure will become more readily apparent to those
skilled in the art from the following detailed description of the
preferred embodiments taken in conjunction with the drawings.
BRIEF DESCRIPTION OF THE DRAWINGS
[0014] So that those skilled in the art to which the subject
disclosure appertains will readily understand how to make and use
the devices and methods of the subject disclosure without undue
experimentation, preferred embodiments thereof will be described in
detail herein below with reference to certain figures, wherein:
[0015] FIG. 1 is a schematic, exploded perspective view of an
exemplary embodiment of a system constructed in accordance with the
present disclosure, showing a photodetector array, a read-out
integrated circuit (ROIC), and a digital read-out integrated
circuit (DROIC);
[0016] FIG. 2 is a schematic view of one of the pixel
implementations of the DROIC of FIG. 1, showing an embodiment of
the connections of the binary counters; and
[0017] FIG. 3 is a schematic view of another of the pixel
implementations of the DROIC of FIG. 1, showing another embodiment
of the connections of the binary counters.
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0018] Reference will now be made to the drawings wherein like
reference numerals identify similar structural features or aspects
of the subject disclosure. For purposes of explanation and
illustration, and not limitation, a partial view of an exemplary
embodiment of a system in accordance with the disclosure is shown
in FIG. 1 and is designated generally by reference character 100.
Other embodiments of systems in accordance with the disclosure, or
aspects thereof, are provided in FIGS. 2-3, as will be described.
The systems and methods described herein can be used for digital
gain and offset correction in imaging devices such as digital
cameras.
[0019] System 100 includes a photodetector array 102 including a
plurality of photodetector pixels 104. A read-out integrated
circuit (ROIC) 106 is operatively connected to the photodetector
array 102 to receive and condition signals from the pixels 104 for
the read-out on a pixel by pixel basis. The ROIC 106 includes one
respective pixel 105 for each of the photodetector pixels 104. A
digital read-out integrated circuit (DROIC) 108 is operatively
connected to the ROIC 106 to receive pulses from the ROIC 106
indicative of photodetector events incident on the photodetector
pixels, such as arrival of a given number of photons. The DROIC 108
includes a pixel 110 for each of the photodetector pixels 104. For
the DROIC 108, a pixel 110 can also represent some digital circuit
elements available to each photodetector pixel 104 in photodetector
array 102, but these digital circuit elements need not be confined
in the same pixel pitch as photodetector pixel 104.
[0020] With reference now to FIG. 2, each pixel 110 of the DROIC
108 includes a first binary counter 112 configured to increment a
counter value of the first binary 112 counter in response to pulses
read into the first binary counter, e.g., from line 114. A
comparator 116 is operatively connected to a respective gain
register 118 and to the first binary counter 112 to compare the
counter value of the first binary counter 112 to a gain value of
the gain register 118. A second binary counter 120, or gain and
offset corrected result counter, is operatively connected to the
comparator 116 to disable the second binary counter 120 each time
the counter value of the first binary counter 112 equals the gain
value of the gain register 118. A respective offset register 122 is
included in each pixel 110 of the DROIC 108, operatively connected
to the second binary counter 120. The second binary counter 120 is
configured to initialize the counter value of the second binary
counter 120 to equal the offset value of the offset register 122,
and to read out a gain and offset corrected digital output, e.g.,
from line 124.
[0021] Each of the first binary counter 112 and the second binary
counter 120 is operatively connected to receive a pulse stream from
an imaging pixel, e.g., through lines 114 and 126. The comparator
116 has an output 128 connected to reset the counter value in the
first binary counter 112 whenever the counter value of the first
binary counter 112 equals the gain value of the gain register 118.
The output 128 of the comparator 116 is also connected to a NOT
logic component 130 that connects the output 128 of the comparator
116 to the second binary counter 120 to disable the second binary
counter 120 when the counter value in the first binary counter 112
equals the gain value of the gain register 118.
[0022] The system 100 can include a memory 132 such as a
non-volatile memory and/or a dynamic random access memory (DRAM)
operatively connected to the pixel 110 of the DROIC 108 to load
values for the offset register 122 and the gain register 118 at
each pixel 110 of the DROIC 108. This loading of offset and gain
values need only occur once for multiple frame integrations, as
opposed to having to load the offset and gain values from memory
each time a frame is integrated, e.g., each time a photograph or a
frame of a video is taken.
[0023] At least one of the gain register 118 or the offset register
122 can be physically located in the pixel 110 of the DROIC 108 for
each respective pixel pitch 104 of the photodetector array 102. It
is also contemplated that at least one of the gain register 118 or
the offset register 122 can be physically located outside of the
pixel pitch 110 of the DROIC 108 for each respective pixel 110 of
the DROIC 108.
[0024] With reference now to FIG. 3, another exemplary embodiment
of a DROIC pixel 210 is shown, which can be used in lieu of DROIC
pixel 110. DROIC pixel 210 includes a line 214 for input, a first
binary counter 212, a comparator 216, a gain register 218, a second
binary counter 220, an offset register 222, and a line 224 for
read-out much as described above. Only the first binary counter 212
is operatively connected to receive a pulse stream from an imaging
pixel, e.g., the second binary counter 220 is not directly
connected to receive the pulse stream from line 214. The comparator
216 has an output 228 connected to reset the counter value in the
first binary counter 212 whenever the counter value of the first
binary counter 212 equals the gain value of the gain register 218.
A XOR logic component 230 can be included. The XOR logic component
230 has two inputs, one connected to receive the pulse stream,
e.g., from line 226, the other connected to the output 228 of the
comparator 216. The XOR logic component 230 includes an output 234
connected as an input to the second binary counter 220, so that
binary counter 220 increments its counter value whenever the
counter value of the first binary counter 212 is reset. In short,
the pulse stream in lines 214 and 114, and the read-out from lines
124 and 224 in DROIC pixels 110 and 210 operate identically, i.e.,
the same input results in the same output for DROIC pixels 110 and
210.
[0025] A method includes correcting for at least one of gain and
offset during frame integration for photodetector events. Gain and
offset correction is performed separately in each pixel pitch, e.g.
pixels 110 or 210, of a DROIC, e.g., DROIC 108, for a plurality of
corresponding pixels, e.g. pixels 104, in a photodetector array,
e.g., photodetector array 102.
[0026] The DROIC can include a first binary counter, e.g. binary
counters 112 and 212, and a second binary counter, e.g., second
binary counters 120 and 220, in each pixel pitch of the DROIC.
Correcting can include counting pulses in a pulse stream by
incrementing a counter value in the first binary counter of each
pixel in the DROIC, e.g., where each pulse represents an amount of
photocharge, and resetting the counter value in the first binary
counter whenever the counter value reaches a value equal to a value
in a respective gain register, e.g. gain registers 118 and 218, for
each the pixel of the DROIC.
[0027] The method can include incrementing a counter value in the
second binary counter each time the counter value of the first
binary counter reaches the value equal to the value in the
respective gain register. The method can include masking a
subsequent pulse after resetting the counter value of the first
binary counter to refrain from incrementing the counter value in
the secondary binary counter for the subsequent pulse, thus
applying gain.
[0028] In another aspect, it is contemplated that the method can
include loading an offset register value, e.g., from offset
registers 122 and 222, into the second binary counter in the DROIC
to initialize the counter value of the second register at the
beginning of frame integration, and reading out the counter value
from the second binary counter at the end of frame integration so
that the second binary counter reads out gain and offset corrected
digital output for each respective pixel pitch of the DROIC. This
readout from each pixel can be provided to a processor outside of
the DROIC for post-processing and/or output, e.g., as output of a
camera. Offset and gain registers for each pixel pitch of the DROIC
need only be loaded once for multiple frame integrations, e.g.,
when the imaging sensor system such as a camera incorporating
system 100 is first powered on.
[0029] The methods and systems of the present disclosure, as
described above and shown in the drawings, provide for digital gain
and offset corrections with superior properties including the
removal of the necessity to require DRAM to store correction values
for each frame that is integrated. Therefore, power and bandwidth
requirements are reduced as corrections values are no longer
required to be read out of a DRAM for every frame, and corrections
can be implemented immediately in each pixel in the DROIC, allowing
additional post-corrections processing to also be done on the
DROIC. While the apparatus and methods of the subject disclosure
have been shown and described with reference to preferred
embodiments, those skilled in the art will readily appreciate that
changes and/or modifications may be made thereto without departing
from the scope of the subject disclosure.
* * * * *