U.S. patent application number 14/257174 was filed with the patent office on 2014-10-09 for reading apparatus having partial frame operating mode.
This patent application is currently assigned to Hand Held Products, Inc.. The applicant listed for this patent is Hand Held Products, Inc.. Invention is credited to Charles P. Barber, Robert C. Gardiner, Carl W. Gerst, III, Robert M. Hussey, Matthew W. Pankow, George S. Smith, II.
Application Number | 20140299665 14/257174 |
Document ID | / |
Family ID | 27117802 |
Filed Date | 2014-10-09 |
United States Patent
Application |
20140299665 |
Kind Code |
A1 |
Barber; Charles P. ; et
al. |
October 9, 2014 |
READING APPARATUS HAVING PARTIAL FRAME OPERATING MODE
Abstract
A method is disclosed for decoding a decodable symbol using an
optical reader having a 2D image sensor that is configured to
operate in a partial frame capture operating mode. In a partial
frame operating mode, the reader clocks out and captures at least
one partial frame of image data having image data corresponding to
less than all of the pixels of an image sensor pixel array. In one
embodiment, the reader operating in a partial frame operating mode
captures image data corresponding to a linear pattern of pixels of
the image sensor, reads the image data, and attempts to decode for
a decodable bar code symbol which may be represented in the image
data.
Inventors: |
Barber; Charles P.;
(Fayetteville, NY) ; Gerst, III; Carl W.; (Clifton
Park, NY) ; Smith, II; George S.; (Skaneateles,
NY) ; Hussey; Robert M.; (Waxhaw, NC) ;
Gardiner; Robert C.; (Fayetteville, NY) ; Pankow;
Matthew W.; (Camillus, NY) |
|
Applicant: |
Name |
City |
State |
Country |
Type |
Hand Held Products, Inc. |
Fort Mill |
SC |
US |
|
|
Assignee: |
Hand Held Products, Inc.
Fort Mill
SC
|
Family ID: |
27117802 |
Appl. No.: |
14/257174 |
Filed: |
April 21, 2014 |
Related U.S. Patent Documents
|
|
|
|
|
|
Application
Number |
Filing Date |
Patent Number |
|
|
13892921 |
May 13, 2013 |
8702000 |
|
|
14257174 |
|
|
|
|
12249742 |
Oct 10, 2008 |
8439264 |
|
|
13892921 |
|
|
|
|
11895803 |
Aug 27, 2007 |
7492493 |
|
|
12249742 |
|
|
|
|
11637231 |
Dec 11, 2006 |
7434733 |
|
|
11895803 |
|
|
|
|
10651298 |
Aug 28, 2003 |
7270273 |
|
|
11637231 |
|
|
|
|
09766806 |
Jan 22, 2001 |
6637658 |
|
|
10651298 |
|
|
|
|
09766922 |
Jan 22, 2001 |
7268924 |
|
|
09766806 |
|
|
|
|
Current U.S.
Class: |
235/462.28 |
Current CPC
Class: |
G06K 7/10722 20130101;
G06K 7/10752 20130101; G06K 7/10821 20130101 |
Class at
Publication: |
235/462.28 |
International
Class: |
G06K 7/10 20060101
G06K007/10 |
Claims
1. A reading apparatus, comprising: an imaging assembly comprising
an image sensor having a plurality of pixels, the plurality of
pixels formed in a plurality of rows of pixels, the imaging
assembly having optics focusing an image onto the image sensor;
wherein the reading apparatus is adapted to enable an operator to
select between a first user selected operating state and an
alternative user selected operating state, the reading apparatus
being adapted for attempting to decode decodable indicia
represented in a frame of image data captured using the image
sensor whether the first user selected operating state or the
alternative user selected operating state is active; wherein the
reading apparatus is adapted to clock out image data corresponding
to pixels of the image sensor whether the first user selected
operating state or the alternative user selected operating state is
active; wherein with the first user selected operating state
active, the reading apparatus is adapted for capturing a partial
frame of image data and for attempting to decode decodable indicia
represented in the partial frame of image data, the reading
apparatus not being adapted for capturing a full frame of image
data with the first user selected operating state active; wherein
with the alternative user selected operating state active, the
reading apparatus is adapted for capturing a full frame of image
data and attempting to decode decodable indicia in the full frame
of image data.
2. The reading apparatus of claim 1, wherein the reading apparatus
incorporates a hand graspable housing.
3. The reading apparatus of claim 1, wherein the reading apparatus
includes a menu symbol reading system configured for enabling said
operator to select between a first user selected operating state
and an alternative user selected operating state.
4. The reading apparatus of claim 1, wherein the reading apparatus
includes a GUI configured for enabling said operator to select
between a first user selected operating state and an alternative
user selected operating state.
5. The reading apparatus of claim 1, wherein the reading apparatus
is adapted to subject an adjacent set of pixels to clock out for
capture of a frame of image data for processing to attempt to
decode the decodable indicia whether the first user selected
operating state or the alternative operating state is active.
6. The reading apparatus of claim 1, wherein the number of pixels
subject to clock out for capture of a frame of image data for
processing to attempt to decode the decodable indicia increases
between frames when the alternative user selected operating state
is active.
7. The reading apparatus of claim 1, wherein pixels subject to
clock out with the alternative user selected operating state active
include each pixel of the image sensor.
8. The reading apparatus of claim 1, wherein the reading apparatus
when operating in the first user selected operating state clocks
out image data corresponding to a set of pixels of the image sensor
defining a linear pattern.
9. The reading apparatus of claim 1, wherein the reading apparatus
when operating in the first user selected operating state clocks
out image data corresponding to a set of pixels of the image sensor
at or near a center of the image sensor defining a horizontally
oriented linear pattern.
10. The reading apparatus of claim 1, wherein the reading apparatus
when operating in the first user selected operating state clocks
out image data corresponding to a set of pixels defining a linear
pattern, the linear pattern having a plurality of spaced apart
lines.
11. The reading apparatus of claim 1, wherein the reading apparatus
when operating in the first user selected operating state clocks
out image data corresponding to a set of pixels defining a linear
pattern, the linear pattern having a plurality of angularly offset
lines.
12. The reading apparatus of claim 1, wherein the reading apparatus
when operating in the alternative user selected operating state is
further adapted to control the image sensor for capture of partial
frame of image data corresponding to electrical signals
representing less than all of the pixels of the image sensor.
13. The reading apparatus of claim 1, wherein the reading apparatus
when operating in the alternative user selected operating state is
adapted to control the image sensor so that the full frame of image
data corresponds to electrical signals representing each pixel of
the image sensor.
Description
CROSS-REFERENCE TO RELATED APPLICATIONS
[0001] The present application claims the benefit of U.S. patent
application Ser. No. 13/892,921 for a Reading Apparatus having
Partial Frame Operating Mode filed May 13, 2013 (and published Sep.
26, 2013 as U.S. Patent Application Publication No. 2013/0248605),
which claims the benefit of U.S. patent application Ser. No.
12/249,742 for a Reading Apparatus having Partial Frame Operating
Mode filed Oct. 10, 2008 (and published May 14, 2013 as U.S. Patent
Application Publication No. 2009/0032597), now U.S. Pat. No.
8,439,264, which claims the benefit of U.S. patent application Ser.
No. 11/895,803 for a Bar Code Reading Device Having Plurality of
Operating States filed Aug. 27, 2007 (and published Feb. 17, 2009
as U.S. Patent Application Publication No. 2008/0170275), now U.S.
Pat. No. 7,492,493, which claims the benefit of U.S. patent
application Ser. No. 09/766,922 for an Optical Reader having
Reduced Parameter Determination Delay filed Jan. 22, 2001 (and
published Sep. 12, 2002 as U.S. Patent Application Publication No.
2002/0125317), now U.S. Pat. No. 7,268,924. Each of the foregoing
patent applications, patent publications, and patents is hereby
incorporated by reference in its entirety.
[0002] U.S. patent application Ser. No. 12/249,742 also claims the
benefit of U.S. patent application Ser. No. 11/637,231 for an
Optical Reader having Partial Frame Operating Mode filed Dec. 11,
2006 (and published Aug. 9, 2007 as U.S. Patent Application
Publication No. 2007/0181693), now U.S. Pat. No. 7,434,733, which
claims the benefit of U.S. patent application Ser. No. 10/651,298
for an Optical Reader having Partial Frame Operating Mode filed
Aug. 28, 2003 (and published Oct. 7, 2004 as U.S. Patent
Application Publication No. 2004/0195332), now U.S. Pat. No.
7,270,273, which claims the benefit of U.S. patent application Ser.
No. 09/766,806 for an Optical Reader having Partial Frame Operating
Mode filed Jan. 22, 2001 (and published Apr. 3, 2003 as U.S. Patent
Application Publication No. 2003/0062418), now U.S. Pat. No.
6,637,658. Each of the foregoing patent applications, patent
publications, and patents is hereby incorporated by reference in
its entirety.
FIELD OF THE INVENTION
[0003] The invention relates to optical readers in general and in
particular to methods for operating an optical reader having a 2D
image sensor.
BACKGROUND
[0004] Optical readers having 2D image sensors commonly are used to
read both 1D and 2D symbols. Some optical readers having a 2D image
sensor read a 1D symbol by capturing a 2D image representation, or
"frame" of image data corresponding to a target area which
comprises a 1D symbol, and launching a scan line or lines in order
to attempt to decode for 1D symbols which may be represented in the
area. Other optical readers having 2D image sensors read 1D symbols
by capturing a 2D image representation of an area containing the 1D
symbol, preliminarily analyzing the image data represented in the
area to determine that the image data comprises a representation of
a 1D symbol, and then launching a scan line in an attempt to decode
for the 1D symbol determined to be present. In either case, a full
frame 2D image representation is captured in order to decode for a
1D symbol.
[0005] Capturing a 2D image representation requires a substantial
amount of time, especially in applications wherein one or more
"test" frames of image data must be captured prior to capture of a
frame that is subjected to processing. Furthermore, assuming a
constant processing speed, the time required for an optical reader
to capture a 2D image representation increases with the resolution
of the image sensor which is incorporated in the reader. Currently
available CMOS mega pixel image sensors have low frame clock out
rates of about 15 frames per second (FPS).
[0006] A user's satisfaction with an optical reader often varies
directly with the decoding speed of the optical reader. Given that
higher resolution, including mega pixel readers, are expected to
grow in popularity, the frame capture time will become an
increasingly important factor for consideration in performance of
an optical reader.
SUMMARY
[0007] A method and apparatus for decoding a decodable symbol using
an optical reader having a 2D image sensor that is configured to
operate in a partial frame capture operating mode. In a partial
frame operating mode, the reader clocks out and captures at least
one partial frame of image data having image data corresponding to
less than all of the pixels of an image sensor pixel array. In one
embodiment, the reader operating in a partial frame operating mode
captures image data corresponding to a linear pattern of pixels of
the image sensor, reads the image data, and attempts to decode for
a decodable bar code symbol which may be represented in the image
data.
BRIEF DESCRIPTION OF THE DRAWINGS
[0008] The objects and features of the invention can be better
understood with reference to the drawings described below, and the
claims. The drawings are not necessarily to scale, emphasis instead
generally being placed upon illustrating the principles of the
invention. In the drawings, like numerals are used to indicate like
parts throughout the various views.
[0009] [Beginning of Section Excerpted from U.S. patent application
Ser. No. 09/766,922]
[0010] FIGS. 1a and 1b are image maps illustrating possible low
resolution frames of image data clock out during a low resolution
frame clock out mode of the invention;
[0011] FIG. 2a is a block diagram of an optical reader of a type in
which the invention may be incorporated;
[0012] FIGS. 2b-2h show various types of optical reader housings in
which the invention may be incorporated;
[0013] FIG. 3a is a process flow diagram illustrating frame
clocking operations in an optical reader having an image sensor
including a one-frame buffer.
[0014] FIG. 3b is a time line illustrating frame clock out
operations in a prior art optical reader;
[0015] FIG. 3c is a time line illustrating a frame clock out of
operations in an optical reader operated according to the
invention.
[0016] [End of Section Excerpted from U.S. patent application Ser.
No. 09/766,922]
[0017] [Beginning of Section Excerpted from U.S. patent application
Ser. No. 09/766,806].
[0018] FIGS. 4a-4g illustrate various image data patterns that may
be captured by an optical reader operating in a partial frame
capture mode according to the invention;
[0019] FIG. 5a is a block diagram of an optical reader of a type in
which the invention may be incorporated;
[0020] FIGS. 5b-5h show various types of optical reader housings in
which the invention may be incorporated.
[0021] [End of Section Excerpted from U.S. patent application Ser.
No. 09/766,806].
[0022] FIGS. 6a-6g illustrate various image data patterns that may
be captured by an optical reader operating in a partial frame
capture mode according to the invention;
[0023] FIG. 7a is a block diagram of an optical reader of a type in
which the invention may be incorporated;
[0024] FIGS. 7b-7h show various types of optical reader housings in
which the invention may be incorporated;
[0025] FIG. 8 is a flow diagram showing an illustrative process in
which a partial frame of an image of an encoded indicium is
processed extract encoded information, according to principles of
the invention;
[0026] FIG. 9 is another flow diagram showing an illustrative
process in which a partial frame of an image of an encoded indicium
is processed to extract encoded information, according to
principles of the invention; and
[0027] FIG. 10 is yet another flow diagram showing an illustrative
process in which a partial frame of an image of an encoded indicium
is processed to extract encoded information, according to
principles of the invention;
[0028] FIG. 11 is a perspective view of an imaging module;
[0029] FIG. 12 is an illustration showing an illumination pattern
and an illumination pattern that may be projected by the imaging
module of FIG. 11.
DETAILED DESCRIPTION
[0030] [Beginning of Section Excerpted from U.S. patent application
Ser. No. 09/766,922]
[0031] When operated to generate valid pixel data, presently
available optical reading devices clock out electrical signals
corresponding to pixel positions of an image sensor at a uniform
clock out rate such that the electrical signal corresponding to
each pixel of the image sensor array accurately represents light
incident on the pixel.
[0032] By contrast, an image sensor of the present invention is
made to operate under two major frame capture modes, a "low
resolution" frame clock out mode and a "normal resolution" frame
clock out mode. In a "low resolution" mode of operation, an image
sensor according to the invention is operated to clock out
electrical signals corresponding to some pixels of an image sensor
array at a high clock out rate and other pixels of the image sensor
at a normal clock out rate. Clocking out a portion of the
electrical signals using a faster than normal clock out rate
results in a reduction in the overall frame clock out time while
clocking out a portion of the signals at a normal clock out rate
enables the generation of pixel data sufficient to enable
determination of parameter settings for use in subsequent frame
captures. In a "normal resolution" mode of operation the image
sensor is operated to clock out electrical signals corresponding to
pixels of the array using a single uniform clock out speed as in
prior art readers. The low resolution mode of operation may also be
carried out by clocking out electrical signals corresponding to
only a portion of a frame's pixels and not clocking out electrical
signals corresponding to the remaining pixels.
[0033] A reader configured in accordance with the invention clocks
out and captures in a memory storage location at least one
parameter determination frame of image data in a "low resolution"
frame capture mode, reads pixels of the parameter determination
frame in establishing at least one operation parameter that is
based on actual illumination conditions, utilizes the determined
operation parameter in clocking out a subsequent frame of image
data in a "normal resolution mode," then captures and subjects the
frame of image data clocked out utilizing the operation parameter
to image data searching, decoding, and/or recognition processing.
The reader may be adapted to decode a decodable symbol represented
in a frame of image data developed utilizing a determined operating
parameter.
[0034] An optical reading system is which the invention may be
employed is described with reference to the block diagram of FIG.
2a.
[0035] Optical reader 10 includes an illumination assembly 20 for
illuminating a target object T, such as a 1D or 2D bar code symbol,
and an imaging assembly 30 for receiving an image of object T and
generating an electrical output signal indicative of the data
optically encoded therein. Illumination assembly 20 may, for
example, include an illumination source assembly 22, together with
an illuminating optics assembly 24, such as one or more lenses,
diffusers, wedges, reflectors or a combination of such elements,
for directing light from light source 22 in the direction of a
target object T. Illumination assembly 20 may comprise, for
example, laser or light emitting diodes (LEDs) such as white LEDs
or red LEDs. Illumination assembly 20 may include target
illumination and optics for projecting an aiming pattern 27 on
target T. Illumination assembly 20 may be eliminated if ambient
light levels are certain to be high enough to allow high quality
images of object T to be taken. Imaging assembly 30 may include an
image sensor 32, such as a 1D or 2D CCD, CMOS, NMOS, PMOS, CID OR
CMD solid state image sensor, together with an imaging optics
assembly 34 for receiving and focusing an image of object T onto
image sensor 32. The array-based imaging assembly shown in FIG. 2a
may be replaced by a laser array based imaging assembly comprising
multiple laser sources, a scanning mechanism, emit and receive
optics, at least one photodetector and accompanying signal
processing circuitry.
[0036] Optical reader 10 of FIG. 2a also includes programmable
control circuit 40 which preferably comprises an integrated circuit
microprocessor 42 and an application specific integrated circuit
(ASIC 44). The function of ASIC 44 could also be provided by field
programmable gate array (FPGA). Processor 42 and ASIC 44 are both
programmable control devices which are able to receive, output and
process data in accordance with a stored program stored in memory
unit 45 which may comprise such memory elements as a read/write
random access memory or RAM 46 and an erasable read only memory or
EROM 47. RAM 46 typically includes at least one volatile memory
device but may include one or more long term non-volatile memory
devices. Processor 42 and ASIC 44 are also both connected to a
common bus 48 through which program data and working data,
including address data, may be received and transmitted in either
direction to any circuitry that is also connected thereto.
Processor 42 and ASIC 44 differ from one another, however, in how
they are made and how they are used.
[0037] More particularly, processor 42 is preferably a general
purpose, off-the-shelf VLSI integrated circuit microprocessor which
has overall control of the circuitry of FIG. 2a, but which devotes
most of its time to decoding image data stored in RAM 46 in
accordance with program data stored in EROM 47. Processor 44, on
the other hand, is preferably a special purpose VLSI integrated
circuit, such as a programmable logic or gate array, which is
programmed to devote its time to functions other than decoding
image data, and thereby relieve processor 42 from the burden of
performing these functions.
[0038] The actual division of labor between processors 42 and 44
will naturally depend on the type of off-the-shelf microprocessors
that are available, the type of image sensor which is used, the
rate at which image data is output by imaging assembly 30, etc.
There is nothing in principle, however, that requires that any
particular division of labor be made between processors 42 and 44,
or even that such a division be made at all. This is because
special purpose processor 44 may be eliminated entirely if general
purpose processor 42 is fast enough and powerful enough to perform
all of the functions contemplated by the present invention. It
will, therefore, be understood that neither the number of
processors used, nor the division of labor there between, is of any
fundamental significance for purposes of the present invention.
[0039] With processor architectures of the type shown in FIG. 2a, a
typical division of labor between processors 42 and 44 will be as
follows. Processor 42 is preferably devoted primarily to such tasks
as decoding image data, once such data has been stored in RAM 46,
recognizing characters represented in stored image data according
to an optical character recognition (OCR) scheme, handling menuing
options and reprogramming functions, processing commands and data
received from control/data input unit 39 which may comprise such
elements as trigger 74 and keyboard 78 and providing overall system
level coordination.
[0040] Processor 44 is preferably devoted primarily to controlling
the image acquisition process, the A/D conversion process and the
storage of image data, including the ability to access memories 46
and 47 via a DMA channel. Processor 44 may also perform many timing
and communication operations. Processor 44 may, for example,
control the illumination of LEDs 22, the timing of image sensor 32
and an analog-to-digital (A/D) converter 36, the transmission and
reception of data to and from a processor external to reader 10,
through an RS-232, a network such as an Ethernet, a serial bus such
as USB, a wireless communication link (or other) compatible I/O
interface 37. Processor 44 may also control the outputting of user
perceptible data via an output device 38, such as a beeper, a good
read LED and/or a display monitor which may be provided by a liquid
crystal display such as display 82. Control of output, display and
I/O functions may also be shared between processors 42 and 44, as
suggested by bus driver I/O and output/display devices 37' and 38'
or may be duplicated, as suggested by microprocessor serial I/O
ports 42A and 42B and I/O and display devices 37'' and 38'. As
explained earlier, the specifics of this division of labor is of no
significance to the present invention.
[0041] FIGS. 2b through 2g show examples of types of housings in
which the present invention may be incorporated. FIGS. 2b-2g show
1D/2D optical readers 10-1, 10-2 and 10-3. Housing 12 of each of
the optical readers 10-1 through 10-3 is adapted to be graspable by
a human hand and has incorporated therein at least one trigger
switch 74 for activating image capture and decoding and/or image
capture and character recognition operations. Readers 10-1 and 10-2
include hard-wired communication links 79 for communication with
external devices such as other data collection devices or a host
processor, while reader 10-3 includes an antenna 80 for providing
wireless communication device or a host processor.
[0042] In addition to the above elements, readers 10-2 and 10-3
each include a display 82 for displaying information to a user and
a keyboard 78 for enabling a user to input commands and data into
the reader.
[0043] Any one of the readers described with reference to FIGS. 2b
through 2g may be mounted in a stationary position as is
illustrated in FIG. 2h showing a generic optical reader 10 docked
in a scan stand 90. Scan stand 90 adapts portable optical reader 10
for presentation mode scanning In a presentation mode, reader 10 is
held in a stationary position and an indicia bearing article is
moved across the field of view of reader 10.
[0044] As will become clear from the ensuing description, the
invention need not be incorporated in a portable optical reader.
The invention may also be incorporated, for example, in association
with a control circuit for controlling a non-portable fixed mount
imaging assembly that captures image data representing image
information formed on articles transported by an assembly line, or
manually transported across a checkout counter at a retail point of
sale location. Further, in portable embodiments of the invention,
the reader need not be hand held. The reader may be part or wholly
hand worn, finger worn, waist worn or head worn for example.
[0045] Referring again to particular aspects of the invention, a
low resolution frame clock out mode of the invention is described
in detail with reference to the pixel maps of FIGS. 1a and 1b.
Control circuit 40 establishes a clock out rate for clocking out an
electrical signal corresponding to a pixel of an image sensor 32 by
appropriate state control of control signals in communication with
image sensor 32. In the present invention, image sensor 32 is
selected to be of a type whose pixel clock out rate can be varied
by way of control signals received from control circuit 40. In
presently available optical readers, an image sensor's pixel clock
out rate is not changed during the course of clocking out of a
frame of image data.
[0046] In a "low resolution" frame clock out mode of the invention,
however, control circuit 40 causes image sensor 32 to clock out
electrical signals corresponding to the pixels of the array at
least two speeds during a single frame capture period. During a
single frame clock out period, control circuit 40 controls image
sensor 32 so that some pixels are clocked out at normal clock out
rate sufficient to develop electrical signals accurately
representing the intensity of light at the respective pixel
positions, while other pixels are either not clocked out or are
clocked out at a clock out rate which may be insufficient to allow
development of electrical signals that accurately represent the
intensity of light at the respective pixels but which nevertheless
results in a reduction of the overall frame clock out time of the
frame of image data being clocked out.
[0047] FIG. 1a shows a schematic diagram of an exemplary image map
frame that is clocked out according to the low resolution frame
clock out mode of the invention and then captured into memory 45.
The image map is divided into "zones" of valid data and invalid
data. Valid zones 84 shown are rows of pixels that are clocked out
at a normal clock out speed while invalid zones 86 shown are rows
of pixels that are clocked out at a faster clock out speed, which
is normally (but not necessarily) a speed insufficient to allow
development of electrical signals accurately representing the
intensity of light at a pixel.
[0048] FIG. 1b shows another possible division of an image map into
valid zones and invalid zones. This type of embodiment in which
valid zones 84 comprise less than full pixel rows is conveniently
realized by appropriate control of an image sensor manufactured
using CMOS fabrication methods. Using CMOS fabrication methods, an
image sensor can be merged with a microprocessor, an ASIC, or
another timing device on a single die to the end that a
pre-established clocking sequence in which a pixel clock out rate
is changed multiple times during the course of clock out a frame of
image data may be actuated in response to the activation of a
single control signal in communication with image sensor 32.
[0049] Using CMOS fabrication techniques, image sensors are readily
made so that electrical signals corresponding to certain pixels of
a sensor can be selectively clocked out without clocking out
electrical signals corresponding to remaining pixels of the sensor.
CMOS image sensors are available from such manufacturers as
Symagery, Pixel Cam, Omni Vision, Sharp, Natural Semiconductor,
Toshiba, Hewlett-Packard and Mitsubishi. Further aspects of a
partial frame clock out mode are described in commonly assigned
application Ser. No. 09/766,806 entitled "Optical Reader Having
Partial Frame Operating Mode," now U.S. Pat. No. 6,637,658 filed
concurrently herewith and incorporated herein by reference.
[0050] The invention is also conveniently realized with use of an
image sensor having an image sensor discharge function. Image
sensors having a discharge function are typically adapted to
receive a discharge clock out signal which when active results in
all pixels of a frame being read out at a high clock out rate
insufficient to allow development of electrical signals. In
presently available readers having a directional function, a
control circuit sets the discharge clocking signal to an active
state while clocking out an initial "discharge period" frame of
image data immediately after reception of a trigger actuation. This
initial discharge process removes any residual charges built up on
image sensor 32 prior to capturing a first frame including valid
pixel data.
[0051] For producing an image map divided into valid and invalid
zones using an image sensor having a discharge function, control
circuit 40 may be made to intermittently change the state of a
discharge clock out signal during a frame clock out period during
which image sensor 32 is otherwise operated according to a normal
resolution clock out mode.
[0052] An exemplary embodiment of the invention in which the
invention is employed in a reader equipped with a SONY ICX084AL CCD
image sensor (that includes a one frame analog buffer memory) and a
SONY CXD2434TQ timing generator is described with reference to
FIGS. 3a, 3b and 3c. FIG. 3a shows a flow diagram, of an imaging
system in which the image sensor includes a one frame buffer
memory. For purposes of illustrating the advantages of the
invention, FIG. 3b shows a time line illustrating the time required
to clock out and capture a frame of image data useful for searching
and decoding in a prior art reader having a buffer memory not
configured to operate in accordance with a low resolution frame
clock out mode. FIG. 3c shows a time line illustrating the time
required to clock out and capture a frame of image data useful for
searching, decoding, and recognizing characters in a reader having
a buffer memory configured to operate in a low resolution frame
clock out mode according to the invention.
[0053] When a reader includes a one frame buffer memory, then the
activation of an appropriate frame clock out signal by image sensor
32 causes electrical charges representative of light on pixels of
an image sensor's pixel array 32a to be transferred to analog
buffer memory 32b and causes electrical signals corresponding to
pixel value storage locations of buffer 32b (representing light on
the pixels during a previous timing period) to be clocked out to
analog to digital converter 36 so that the frame of image data
stored on buffer memory can be captured in memory 45, wherein the
data may be read by control circuit 40.
[0054] Referring to time line 92 corresponding a prior art reader
it can be seen that a substantial parameter determination delay is
present without use of a low resolution frame capture mode
according to the invention. At time T0, control circuit 40
activates a frame discharge control signal so that residual charges
built up in the storage locations of buffer memory 32b are
eliminated or "cleaned" during clock out period CPO.
[0055] At time T1, control circuit 40 activates a frame clocking
signal to commence the clock out a first frame of pixel data
according to a normal resolution frame clock out mode (the pixel
data clocked out during clock out period CP1 is normally invalid
pixel data). During clock out period CP1, the charges built up on
pixel array 32a during clock out period CP0 are transferred to
buffer memory 32b and then clocked out to A/D converter 36. Also
during clock out period CP1 pixel array 32a is exposed to light for
a time determined by an exposure parameter value, e.sub.0, that was
previously transmitted at time Te.sub.0 prior to time T1. The
exposure parameter e.sub.0 is based on previous exposure values
during a previous trigger actuation period or based on expected
illumination conditions, but is not based on actual illumination
conditions present.
[0056] At time T2, control circuit 40 activates a frame clock out
signal to commence the clock out of a second frame of image data in
accordance with a normal resolution frame clock out mode. During
clock out period CP2, the charges built up on pixel array 32a
during clock out period CP1 are transferred to buffer memory 32b
and then clocked out to A/D converter 36. Also during clock out
period CP2 pixel array 32 is exposed to light for a time determined
by an exposure parameter value, e.sub.1, that was previously
transmitted at time Te.sub.1 prior to time T2. The exposure
parameter e.sub.1, like exposure parameter e.sub.0, also cannot be
based on actual illumination conditions since the most recent frame
image data available for reading by circuit 40 prior to the
transmittal of exposure parameter e.sub.1 is the invalid frame data
resulting from transmittal of frame discharge signal at time
T0.
[0057] At time T3, control circuit 40 activates a frame clock out
signal to commence the capture of a third frame of image data in
accordance with a normal resolution frame clock out mode. During
clock out period CP3, the charges built up on pixel array 32a
during clock out period CP2 are transferred to buffer memory 32b
and then clocked out to A/D converter 36. Also during clock out
period CP3, pixel array 32a is exposed to light for a time
determined by an exposure parameter value, e.sub.2, that was
previously transmitted at time Te.sub.2 prior to time T3. Unlike
the previous exposure values e.sub.0 and e.sub.1, the exposure
parameter value e.sub.2 can be a value determined from actual
illumination conditions since the frame of image data resulting
from pixel array 32a being exposed to light during clock out period
CP1, is available for reading by control circuit 40 prior to the
time that the exposure parameter e.sub.2 must be communicated to
image sensor 32. However, because of the built in one frame delay
resulting from the presence of buffer 32b, it is seen that a frame
of image data clocked out while being exposed with the exposure
parameter value e.sub.2, determined based on actual illumination
conditions, will not be available for reading by control circuit
unit after the expiration of clocking period CP4. Accordingly, it
can be seen that the above reader exhibits a typical parameter
determination delay of four normal resolution clock out periods,
CP1+CP2+CP3+CP4 plus the frame discharge clock out parameter CP0.
The normal resolution frame clock out period of the
above-referenced SONY image sensor is about 33.37 ms and the frame
discharge period is about 8.33 ms, resulting in a typical-case
total parameter determination delay in the example described of 140
ms (an earlier frame may be subjected to image data searching,
decoding, and recognition if e.sub.0 or e.sub.1 yields an image of
acceptable quality).
[0058] Advantages of operating image sensor 32 according to a low
resolution frame clock out mode of operation are easily observable
with reference to time line 94 corresponding to a reader having an
image sensor operated in accordance with a low resolution frame
clock out mode. In the example illustrated by time line 94 control
circuit 40 operates image sensor as described in connection with
FIG. 3b except that control circuit 40 operates image sensor 32
according to a low resolution frame clock out mode during clocking
periods CP1, CP2, and CP3. Because electrical signals corresponding
to only some of the pixels during these timing periods are clocked
out at speeds sufficiently slow to read valid image data, the total
frame clock out time associated with these clocking periods is
significantly shorter than that of a frame clocked out according to
a normal resolution frame clock out mode. In an exemplary
embodiment in which control circuit 40 alternatingly changes the
state of a discharge clock out control signal (known as an EFS
signal) in communication with a SONY ICX084AL CCD image sensor, to
result in a zone division pattern having valid zones comprising
four pixel rows clocked out at normal speed bounded by invalid rows
having eighteen rows of pixels clocked out at high speed, the low
resolution frame clock out rate is 8.52 ms. The overall typical
parameter determination delay is therefore reduced to
T0+T1+T2+T3+T4=66.2 ms as compared to the 140 ms delay in the prior
art reader example described with reference to FIG. 3a.
[0059] In the example described in which image sensor 32 comprises
a one frame buffer 32b, pixel array 32a is exposed to light for at
least some time currently as electrical signals are clocked out
from buffer 32b. In the control of presently available image
sensors that do not have one frame buffers, frame clock out periods
normally follow frame exposure periods without overlapping the
exposure periods.
[0060] A low resolution parameter determination frame of image data
clocked out using a low resolution clock out mode is useful for
determining an exposure control parameter because exposure
parameter values can be accurately determined by sampling only a
small percentage of pixel values from a frame of image data. In
fact, for improving the processing speed of an optical reader it is
preferred to determine an exposure control value based on a
sampling of a small percentage of pixel values from a frame of
image data. The proper exposure parameter setting varies
substantially linearly with illumination conditions, and therefore
is readily determined based on a sampling of pixel values from a
single frame of image data.
[0061] Additional reader operating parameters can be determined by
reading pixel values from a frame of image data clocked out
according to a low resolution clock out mode of the invention.
These additional parameters which may be determined from a low
resolution parameter determining frame of image data include an
amplification parameter for adjusting the gain of an amplifier
prior to analog-to-digital conversion, an illumination level
parameter for adjusting the current level delivered to, and
therefore the radiance of light emitted from LEDs 22, an
illumination time parameter for adjusting the on-time of LEDs 22, a
light level parameter for adjusting a light level of a subsequently
captured frame of image data, a dark level parameter for adjusting
a dark level of a subsequently captured frame of image data, and an
analog-to-digital converter reference parameter for adjusting a
reference voltage of analog-to-digital converter 36.
[0062] [End of Section Excerpted from U.S. patent application Ser.
No. 09/766,922]
[0063] [Beginning of Section Excerpted from U.S. patent application
Ser. No. 09/766,806]
[0064] Referring to FIGS. 4a-4g the invention is an optical reader
equipped with a 2D image sensor that is configured to operate in a
partial frame capture mode. In a partial frame clock out mode, a
control circuit of an optical reader clocks out (or "reads")
electrical signals corresponding to less than all of the 2D image
sensor's pixels, and captures image data corresponding to the pixel
locations into memory.
[0065] Partial frames of image data which may be clocked out and
captured by an optical reader control circuit during a partial
frame capture mode are illustrated in FIGS. 4a-4g in which valid
zones 212 represent frame image data corresponding to image sensor
pixel positions that are clocked out and invalid zones (indicated
by the shaded regions of the views of FIGS. 4a-4g) represent
potential image data positions corresponding to pixel positions
that are not clocked out.
[0066] Border 210 defines the full field of view of an optical
reader in the case the reader is operated in a full frame captured
mode while symbols 216-1, 216-2, 216-3, 216-4, 216-6 and 216-7 are
symbols entirely within the full field of view of an optical reader
defined by border 10 but are only partially within certain valid
zones shown. Valid zones 212-1, 212-3, 212-7, 212-8, 212-9, 212-10,
and 212-13 are valid zones of image data that partially contain
representations of a decodable symbol while valid zones 212-11 and
212-12 are valid zones of image data captured during a partial
frame capture mode which contain representations of an entire
decodable symbol.
[0067] In the examples illustrated with reference to FIGS. 4a-4e an
optical reader operating in a partial frame clock out mode clocks
out electrical signals corresponding to linear patterns of pixels.
It is useful to cause a reader to clock out electrical signals
corresponding to linear patterns as shown in FIGS. 4a-4d when a
reader will be used to decode mainly 1D linear bar code
symbols.
[0068] In the examples illustrated with reference to FIGS. 4f and
4g an optical reader operating in a partial frame clock out mode
clocks out electrical signals corresponding to non-linear groupings
of pixels. It is useful to cause a reader to clock out electrical
signals corresponding to pixel groupings as shown in FIGS. 4f and
4g when a reader will be used to decode symbols which are expected
to be within a certain position in an image sensor's field of
view.
[0069] A reader may be configured so that the reader automatically
switches out of partial frame capture mode on the sensing of a
certain condition. For example a reader according to the invention
may be made to switch out of partial frame capture operating mode
and into a full frame capture mode on the sensing that a 2D symbol
is partially represented in the partial frame of image data, or on
the condition that processing of the partial frame of image data
fails to result in image data being decoded.
[0070] An optical reading system in which the invention may be
employed is described with reference to the block diagram of FIG.
5a.
[0071] Optical reader 110 includes an illumination assembly 120 for
illuminating a target object T, such as a 1D or 2D bar code symbol,
and an imaging assembly 130 for receiving an image of object T and
generating an electrical output signal indicative of the data
optically encoded therein. Illumination assembly 120 may, for
example, include an illumination source assembly 122, together with
an illuminating optics assembly 124, such as one or more lenses,
diffusers, wedges, reflectors or a combination of such elements,
for directing light from light source 122 in the direction of a
target object T. Illumination assembly 120 may comprise, for
example, laser or light emitting diodes (LEDs) such as white LEDs
or red LEDs. Illumination assembly 120 may include target
illumination and optics for projecting an aiming pattern 127 on
target T. Illumination assembly 120 may be eliminated if ambient
light levels are certain to be high enough to allow high quality
images of object T to be taken. Imaging assembly 130 may include an
image sensor 132, such as a 1D or 2D CCD, CMOS, NMOS, PMOS, CID OR
CMD solid state image sensor, together with an imaging optics
assembly 134 for receiving and focusing an image of object T onto
image sensor 132. The array-based imaging assembly shown in FIG. 5a
may be replaced by a laser array based imaging assembly comprising
multiple laser sources, a scanning mechanism, emit and receive
optics, at least one photodetector and accompanying signal
processing circuitry.
[0072] The partial frame clock out mode is readily implemented
utilizing an image sensor which can be commanded to clock out
partial frames of image data or which is configured with pixels
that can be individually addressed. Using CMOS fabrication
techniques, image sensors are readily made so that electrical
signals corresponding to certain pixels of a sensor can be
selectively clocked out without clocking out electrical signals
corresponding to remaining pixels of the sensor. CMOS image sensors
are available from such manufacturers as Symagery, Pixel Cam, Omni
Vision, Sharp, National Semiconductor, Toshiba, Hewlett-Packard and
Mitsubishi. A partial frame clock out mode can also be carried out
by selectively activating a frame discharge signal during the
course of clocking out a frame of image data from a CCD image
sensor, as is explained in concurrently filed U.S. patent
application Ser. No. 09/766,922, entitled "Optical Reader Having
Reduced Parameter Determination Delay," incorporated previously
herein by reference.
[0073] Optical reader 110 of FIG. 5a also includes programmable
control circuit 140 which preferably comprises an integrated
circuit microprocessor 142 and an application specific integrated
circuit (ASIC 144). The function of ASIC 144 could also be provided
by field programmable gate array (FPGA). Processor 142 and ASIC 144
are both programmable control devices which are able to receive,
output, and process data in accordance with a stored program stored
in memory unit 145 which may comprise such memory elements as a
read/write random access memory or RAM 146 and an erasable read
only memory or EROM 147. RAM 146 typically includes at least one
volatile memory device but may include one or more long term
non-volatile memory devices. Processor 142 and ASIC 144 are also
both connected to a common bus 148 through which program data and
working data, including address data, may be received and
transmitted in either direction to any circuitry that is also
connected thereto. Processor 142 and ASIC 144 differ from one
another, however, in how they are made and how they are used.
[0074] More particularly, processor 142 is preferably a general
purpose, off-the-shelf VLSI integrated circuit microprocessor which
has overall control of the circuitry of FIG. 5a, but which devotes
most of its time to decoding image data stored in RAM 146 in
accordance with program data stored in EROM 147. Processor 144, on
the other hand, is preferably a special purpose VLSI integrated
circuit, such as a programmable logic or gate array, which is
programmed to devote its time to functions other than decoding
image data and, thereby, relieve processor 142 from the burden of
performing these functions.
[0075] The actual division of labor between processors 142 and 144
will naturally depend on the type of off-the-shelf microprocessors
that are available, the type of image sensor which is used, the
rate at which image data is output by imaging assembly 130, etc.
There is nothing in principle, however, that requires that any
particular division of labor be made between processors 142 and
144, or even that such a division be made at all. This is because
special purpose processor 144 may be eliminated entirely if general
purpose processor 142 is fast enough and powerful enough to perform
all of the functions contemplated by the present invention. It
will, therefore, be understood that neither the number of
processors used, nor the division of labor there between, is of any
fundamental significance for purposes of the present invention.
[0076] With processor architectures of the type shown in FIG. 5a, a
typical division of labor between processors 142 and 144 will be as
follows. Processor 142 is preferably devoted primarily to such
tasks as decoding image data, once such data has been stored in RAM
146, recognizing characters represented in stored image data
according to an optical character recognition (OCR) scheme,
handling menuing options and reprogramming functions, processing
commands and data received from control/data input unit 139 which
may comprise such elements as trigger 174 and keyboard 178 and
providing overall system level coordination.
[0077] Processor 144 is preferably devoted primarily to controlling
the image acquisition process, the A/D conversion process and the
storage of image data, including the ability to access memories 146
and 147 via a DMA channel. Processor 144 may also perform many
timing and communication operations. Processor 144 may, for
example, control the illumination of LEDs 122, the timing of image
sensor 132 and an analog-to-digital (A/D) converter 136, the
transmission and reception of data to and from a processor external
to reader 110, through an RS-232, a network such as an Ethernet, a
serial bus such as USB, a wireless communication link (or other)
compatible I/O interface 137. Processor 144 may also control the
outputting of user perceptible data via an output device 138, such
as a beeper, a good read LED and/or a display monitor which may be
provided by a liquid crystal display such as display 182. Control
of output, display and I/O functions may also be shared between
processors 142 and 144, as suggested by bus driver I/O and
output/display devices 137' and 138' or may be duplicated, as
suggested by microprocessor serial I/O ports 142A and 142B and I/O
and display devices 137' and 138'. As explained earlier, the
specifics of this division of labor is of no significance to the
present invention.
[0078] Some or all of the above optical and electronic components
may be incorporated in an imaging module as are described in
commonly assigned U.S. patent application Ser. No. 09/411,936,
incorporated herein by reference.
[0079] FIGS. 5b-5g show examples of types of housings in which the
present invention may be incorporated. FIGS. 5b-5g show 1D/2D
optical readers 110-1, 110-2 and 110-3. Housing 112 of each of the
optical readers 110-1 through 110-3 is adapted to be graspable by a
human hand and has incorporated therein at least one trigger switch
174 for activating image capture and decoding and/or image capture
and character recognition operations. Readers 110-1 and 110-2
include hard-wired communication links 179 for communication with
external devices such as other data collection devices or a host
processor, while reader 110-3 includes an antenna 180 for providing
wireless communication device or a host processor.
[0080] In addition to the above elements, readers 110-2 and 110-3
each include a display 182 for displaying information to a user and
a keyboard 178 for enabling a user to input commands and data into
the reader. Control circuit 140 may cause a graphical user
interface (GUI) to be displayed on display 182. A pointer on the
GUI may be moved by an actuator or actuators protruding from
housing 112.
[0081] Any one of the readers described with reference to FIGS.
5b-5g may be mounted in a stationary position as is illustrated in
FIG. 5h showing a generic optical reader 110 docked in a scan stand
190. Scan stand 190 adapts portable optical reader 110 for
presentation mode scanning In a presentation mode, reader 110 is
held in a stationary position and an indicia bearing article is
moved across the field of view of reader 110.
[0082] As will become clear from the ensuing description, the
invention need not be incorporated in a portable optical reader.
The invention may also be incorporated, for example, in association
with a control circuit for controlling a non-portable fixed mount
imaging assembly that captures image data representing image
information formed on articles transported by an assembly line, or
manually transported across a checkout counter at a retail
point-of-sale location. Further, in portable embodiments of the
invention, the reader need not be hand held. The reader may be part
or wholly hand worn, finger worn, waist worn or head worn for
example.
[0083] Referring again to particular aspects of the invention,
control circuit 140 in the example of FIG. 4a executes a partial
frame capture mode in order to clock out and capture pixel data
illustrated by valid zone 212-1. Reading the pixel values of valid
zone 212-1 is effective to decode 1D symbol 216-1 in the reader's
full field of view. Given that clocking out and capturing image
data of valid zone 212-1 consumes less time than clocking out and
capturing a full frame of image data, it is seen that execution of
a partial frame capture mode decreases the decode time of the
reader. In prior art 2D optical readers, electrical signals
corresponding to full frame 210 are clocked out in order to decode
a single 1D symbol 216-1. The pixels of valid zone 212-1 may
comprise a single row of pixels (a scan line) or a plurality of
rows.
[0084] In the example of FIG. 4b, of control circuit 140 executes a
partial frame capture mode in order to capture data defining valid
zones 212-2, 212-3 and 212-4 of a full frame of image data
corresponding to a full field of view of a 2D image sensor. Valid
zones 212-2, 212-3 and 212-4 are line patterns of image data at
various angular orientations. Reading of pixels of line valid zones
arranged at various angular orientations is effective to decode a
1D symbol which may be located at an oblique angle in a field of
view. It is seen that reading of pixels of line valid zone 212-3
will result in the successful decoding of 1D bar code symbol 216-2.
Zones 212-2, 212-3 and 212-4 may be one or more pixels wide.
[0085] In the example of FIG. 4c, control circuit 140 executes a
partial frame capture mode in order to clock out and capture image
data defining valid zones 212-5 through 212-9. Valid zones 212-5 to
212-9 form a plurality of horizontal parallel lines. The pattern of
valid zones shown in FIG. 4c clocked out and captured in a partial
frame capture mode is effective for decoding substantially
horizontally oriented 1D symbols which are at an unknown height in
a full field of view. It is seen that the reading of image data of
valid zone 212-8 will not result in the decoding of symbol 216-3
because symbol 216-3 is not a 1D symbol. Nevertheless, because
valid zone 212-8 intersects symbol bullseye 216b, reading of image
data of valid zone 212-8 may be effective to determine that a 2D
symbol is likely present in the full field of view of image sensor
132. In one aspect of the invention, reader 110 may be configured
to switch out of a partial frame capture mode and into a full frame
capture mode when reading of image data captured in the partial
frame capture mode reveals that a 2D symbol is likely to be
represented in the image data corresponding to the image sensor's
full field of view.
[0086] The states of operation of reader 110 operating in
accordance with the invention are normally selected by actuating
appropriate buttons of keyboard 178, or control of a GUI, or by the
reading of menuing symbols, as are explained in commonly assigned
U.S. Pat. No. 5,929,418 incorporated herein by reference.
[0087] It should be apparent that several operating states of the
invention are possible. In a first operating state, reader 110 is
made to operate only in a partial frame capture mode until the time
the first operating state is deactivated.
[0088] In a second operating state, as is alluded to in the example
of FIG. 4c, the reader operates in a partial frame capture mode
until the time that reading of image data captured in the partial
frame capture mode reveals that a 2D symbol is likely to be
included in the full frame field of view of image sensor 132. When
reading of the partial frame of image data reveals that a 2D symbol
is likely to be included in a full frame field of view, control
circuit 140 captures at least one full frame of image data from
sensor 132 and attempts to decode for the 2D symbol determined
likely to be represented in the full frame of image data. A reader
operating in the second operating state may also be made to switch
to a full frame operating mode on the condition that a symbol is
not successfully decoded during operation of the reader in the
partial frame operating mode.
[0089] A third operating state of a reader operating in accordance
with the invention is described with reference to FIGS. 4d and 4e.
Operating in accordance with a third operating state, a reader
operates in a partial frame capture mode to clock out and capture
image data of valid zone 212-10 which corresponds to a
predetermined pattern and position in field of view 210. It is seen
that reading of image data of zone 212-10 will not be effective to
decode symbol 216-4 because symbol 216-4 is of a type of 2D symbol
known as a stacked linear bar code. Control circuit 140 may
nevertheless detect that symbol is a 2D symbol given that valid
zone 212-10 intersects a finder pattern 216f of symbol 216-4.
[0090] Sensing that a 2D symbol is likely present in the field of
view when reading the partial frame image data corresponding to
valid zone 212-10, the reader operating in the third operating
state then continues to operate in a partial frame mode to clock
out and capture image data that defines a second valid zone 212-11
of pixel positions as seen in FIG. 4e. The second valid zone 212-11
is not of a predetermined size and position, but rather is of an
adaptive position whose position, and possibly size, orientation
and shape depends on the result of the reading of the image data
corresponding to the first valid zone 212-10. Specifically, the
second valid zone 212-11 is normally at least of a size and
position that is likely to encompass the symbol 216-5 detected to
be present when reading of the image data of first valid zone
212-10 (labeled 216-4 in FIG. 4d). It is seen that the third
operating state is likely to be operative to further reduce the
clocking out and capture of irrelevant image data, and therefore is
likely to further increase decoding speed. In the third operating
state, additional adaptive position valid zones may be clocked out
and captured if the reading of image data of first adaptive valid
zone 212-11 does not result in a symbol being decoded.
[0091] In the example of FIGS. 4f and 41g valid zones 212-12 and
212-13 correspond to nonlinear groupings of pixels. Capturing of
the valid zone patterns 212-12 and 212-13 of FIGS. 4f and 4g is
particularly useful for decoding symbol image data in the case that
a symbol is likely to be at a certain position in relation to an
image sensor's full frame field of view such as in the center of an
image sensor's field of view as shown in FIG. 4f.
[0092] In the example of FIG. 4f control circuit 140 can
successfully decode symbol 216-6 because symbol 216-6 is located
entirely within valid zone 212-12.
[0093] In the example of FIG. 4g, control circuit 140 cannot decode
symbol 216-7 if operating in the first operating state since symbol
216-7 is a 2D symbol and is not entirely located within valid zone
212-13. If operating in the second operating state, then a reader
capturing image data within valid zone 212-13 may successfully
decode symbol 216-7 by reading the image data of zone 212-13 to
determine that a 2D symbol is present, switching operation to a
full frame capture mode to capture a full frame 210 of image data,
and processing the full frame of image data to decode symbol 216-7.
A reader operating in the third operating state described
hereinabove may decode symbol 216-7, in the example of FIG. 4g, by
reading image data within valid zone 212-13, capturing image data
within an adaptively defined valid zone (not shown) of sufficient
size and position to encompass symbol 216-7, and then processing
the image data within the adaptively defined valid zone to decode
symbol 216-7.
[0094] [End of Section Excerpted from U.S. patent application Ser.
No. 09/766,806]
[0095] The invention relates to a method for configuring an optical
reader having a 2D image sensor so the reader captures and
processes image data at higher speeds. Capturing a 2D image
representation requires a substantial amount of time, especially in
applications wherein one or more "test" frames of image data must
be captured prior to capture of a frame that is subjected to
processing as has been explained in commonly assigned U.S. patent
application Ser. No. 09/766,922, entitled "Optical Reader Having
Reduced Parameter Determination Delay," filed Jan. 22, 2001, and
incorporated herein by reference in its entirety. A 1D or 2D symbol
that represents information and that is amenable to imaging and
being recognized using a 2D image sensor is referred to generically
herein as an encoded indicium. Objects carrying 1D or 2D symbols
indicative of the object's identity or quality, of the contents of
an object (such as a package), or that provide other information,
are frequently used in performing business or commercial
activities. Higher speed is useful in commercial or business
settings. Higher speed permits greater productivity per unit of
time, and concomitantly, allows reductions in cost through
reductions in the number of imaging devices and or personnel
required to accomplish a given repetitive task.
[0096] As will be understood by those of ordinary skill, the terms
"commercial transaction" and "business transaction" as used herein
include both transactions that involve an agreement or promise for
which consideration is exchanged and the activities that may be
conducted in preparation for or in completion of such agreements,
as well as interactions that are unilateral, such as the making of
a gift (a promise for which consideration is not exchanged), or
internal activities within an organization, such as maintaining
inventory records, maintaining personnel records or records of
assets, or other activities that can be categorized as "overhead"
in a business context. Activities performed in governmental or
quasi-governmental settings are also contemplated, such as the use
of encoded indicia by such organizations as the United States
Postal Service and the military, as well as by State and local
governmental agencies.
[0097] In some embodiments, the encoded indicium is a symbol that
comprises a plurality of fields or regions. An example of such an
encoded indicium is a check or bank draft, which represents a
payment of money, and which is a two-dimensional document having a
plurality of fields, such as a date, a payee, an amount, a
signature of a maker, and information regarding a financial
institution holding the funds represented by the check, and an
account against which the funds are payable.
[0098] According to the invention, a control circuit of an optical
reader equipped with a 2D image sensor is configured to operate in
a partial frame operating mode. In a partial frame operating mode,
the control circuit clocks out and captures less than a full frame
of image data and processes that image data. The control circuit
may process the image data of the partial frame, for example, by
reading the image data from memory and outputting the image data to
an output location such as a display device or a processor system
in communication with the reader, by reading and attempting to
decode decodable symbols which may be recorded in the partial
frame, or by reading and performing optical character recognition
on characters represented in the partial frame of image data.
[0099] In one embodiment, the partial frame operating mode is
employed to clock out and capture image data corresponding to at
least one linear pattern sufficient so that a 1D symbol in the
field of view of the image sensor may be decoded without clocking
out and capturing an entire frame of image data. The partial frame
of image data that is clocked out from the image sensor during the
partial frame capture operating mode may be, for example, a row of
symbols at or near the center of the image sensor or a limited
number of lines of image data corresponding to pixel locations of
the image sensor, possibly at varying angular orientations. The
control circuit may be configured so that if the control circuit
cannot decode a 1D symbol during the course of operating in the
partial frame capture mode, or detects that a 2D symbol is
represented in the captured image data, the control circuit
switches operation to a full frame capture mode.
[0100] In another embodiment, the partial frame operating mode is
employed to clock out and capture pixel values corresponding to a
grouping of pixels at or near a center of an image sensor other
than a linear pattern of pixels. This embodiment may be
advantageously employed in cases where decodable symbols are
expected to be concentrated proximate a center of an image sensor's
field of view. A control circuit may be configured so that if the
control circuit cannot decode a symbol represented in the partial
frame, or determines that a symbol is represented partially or
entirely outside the image data of the partial frame, the control
circuit automatically switches operation to a full frame image
capture mode.
[0101] In one aspect, the invention features a method of conducting
a business transaction involving information recorded in an encoded
indicium. The method comprises the steps of operating an optical
reader having a 2D image sensor; capturing with the 2D image sensor
a partial frame of image data from an encoded indicium; and
processing image data of the partial frame of image data to extract
information encoded by the encoded indicium whereby the purposes of
the business transaction are advanced.
[0102] In one embodiment, the capturing step includes the step of
capturing image data corresponding to a linear pattern of pixels.
In one embodiment, the capturing step includes the step of
capturing image data corresponding to a plurality of angularly
offset linear patterns of pixels. In one embodiment, the capturing
step includes the step of capturing image data corresponding to a
plurality of vertically spaced apart horizontally oriented linear
patterns of pixels. In one embodiment, the capturing step includes
the step of capturing image data corresponding to a grouping of
pixels about a center of the image sensor. In one embodiment, the
processing step includes the step of reading the image data out of
a memory device. In one embodiment, the processing step includes
the steps of reading the image data out of a memory device and
attempting to decode for a decodable symbol which may be
represented in the image data.
[0103] In one embodiment, the method further includes the step of
capturing a full frame of image data if the processing step reveals
that a 2D symbol is likely partially represented in the partial
frame of image data.
[0104] In one embodiment, the method further includes the step of
capturing an adaptively positioned partial frame of image data if
the processing step reveals that a 2D symbol is likely partially
represented in the partial frame of image data.
[0105] In one embodiment, the processing step includes the step of
attempting to decode for a decodable symbol represented in the
image data, the method further including the step of capturing a
full frame of image data if the processing step reveals that a 2D
symbol is likely partially represented in the partial frame of
image data.
[0106] In another aspect, the invention relates to a method of
conducting a business transaction involving information recorded in
an encoded indicium. The method comprises the steps of: (a)
operating an optical reader having a 2D image sensor; (b) in a
partial frame operating mode, capturing a partial frame of image
data, the partial from of image data including at least a portion
of the encoded indicium; (c) attempting to extract information
encoded by the encoded indicium from the captured partial frame of
image data; and (d) if in step (c) the reader fails to extract
information encoded by the encoded indicium, switching operation of
the reader to a full frame capture mode.
[0107] In one embodiment, the capturing step includes the step of
capturing image data corresponding to a linear pattern of pixels.
In one embodiment, the capturing step includes the step of
capturing image data corresponding to a plurality of angularly
offset linear patterns of pixels. In one embodiment, the capturing
step includes the step of capturing image data corresponding to a
plurality of vertically spaced apart horizontally oriented linear
patterns of pixels. In one embodiment, the capturing step includes
the step of capturing image data corresponding to a grouping of
pixels about a center of the image sensor.
[0108] In still another aspect, the invention relates to a method
of conducting a business transaction involving information recorded
in an encoded indicium. The method comprises the steps of: (a)
operating an optical reader having a 2D image sensor; (b) in a
partial frame operating mode, capturing a partial frame of image
data, the partial from of image data including at least a portion
of the encoded indicium; (c) attempting to extract information
encoded by the encoded indicium from the captured partial frame of
image data; and (d) if in step (c) the reader fails to extract
information encoded by the encoded indicium, switching operation of
the reader to a second partial frame capture mode.
[0109] In one embodiment, the capturing step includes the step of
capturing image data corresponding to a linear pattern of pixels.
In one embodiment, the capturing step includes the step of
capturing image data corresponding to a plurality of angularly
offset linear patterns of pixels. In one embodiment, the capturing
step includes the step of capturing image data corresponding to a
plurality of vertically spaced apart horizontally oriented linear
patterns of pixels. In one embodiment, the capturing step includes
the step of capturing image data corresponding to a grouping of
pixels about a center of the image sensor. In one embodiment, the
method further comprises the step of switching operation of the
reader to a full frame operating mode if the reader fails to
extract information encoded by the encoded indicium from data
captured using the second partial frame capture mode.
[0110] In yet another aspect, the invention features an apparatus
for conducting a business transaction involving information
recorded in an encoded indicium. The apparatus comprises an optical
reader having a 2D image sensor configured to image an encoded
indicium; a control module configured to operate the 2D image
sensor to capture a partial frame of image data from the encoded
indicium; and a processing module configured to process the partial
frame of image data to extract therefrom information encoded by the
encoded indicium, whereby the purposes of the business transaction
are advanced.
[0111] In one embodiment, the apparatus further comprises an
analysis module configured to deduce that a 2D encoded indicium is
present in the partial frame of image data. In one embodiment, the
apparatus further comprises a control module that configures the 2D
sensor to operate in a full frame operating mode.
[0112] In one embodiment, the apparatus further comprises a sensor
module configured to sense that a 2D encoded indicium is present in
the partial frame of image data. In one embodiment, the apparatus
further comprises a control module that configures the 2D sensor to
operate in a second partial frame operating mode.
[0113] Encoded indicia, including 1D and 2D symbols such as bar
codes, stacked bar codes, and two dimensional encoded symbologies,
are commonly used in many business settings. Some representative
examples include the labeling of goods and/or packages containing
the goods, the use of encoded indicia to identify documents (for
example patient records in a hospital or managed health care
facility), and the use of encoded indicia to reduce the possibility
of fraud or the use of counterfeit documents (such as the addition
of encoded indicia to drivers' licenses). As already alluded to,
some commonly used adjuncts to business transactions, such as
checks or bank drafts, can also be considered as encoded indicia
having a plurality of fields or regions in which encoded
information is present.
[0114] Referring to FIGS. 6a-6g, there is shown an optical reader
equipped with a 2D image sensor that is configured to operate in a
partial frame capture mode. In a partial frame clock out mode, a
control circuit of an optical reader clocks out (or "reads")
electrical signals corresponding to less than all of the 2D image
sensor's pixels, and captures image data corresponding to the pixel
locations into memory. It should be understood that while the 2D
image sensor can view, or image, the entire area from which
illumination is provided to its pixels, in the partial frame mode
contemplated, only a subset of such pixels are actually
interrogated or caused to provide electrical signals that are then
used for analysis. The partial frame mode is controlled by a
control module, as will be explained in greater detail below. The
partial frame of image data is processed using a processing module
configured to extract information encoded by the encoded indicium,
as will be explained in greater detail below.
[0115] Partial frames of image data which may be clocked out and
captured by an optical reader control circuit (or control module)
during a partial frame capture mode are illustrated in FIGS. 6a-6g
in which valid zones 1012 represent frame image data corresponding
to image sensor pixel positions that are clocked out and invalid
zones 1014 represent potential image data positions corresponding
to pixel positions that are not clocked out.
[0116] Border 1010 defines the full field of view of an optical
reader in the case the reader is operated in a full frame captured
mode while symbols 1016-1, 1016-2, 1016-3, 1016-6, 1016-6 and
1016-7 are symbols entirely within the full field of view of an
optical reader defined by border 1010 but are only partially within
certain valid zones shown. Valid zones 1012-1, 1012-3, 1012-7,
1012-8, 1012-9, 1012-10, and 1012-13 are valid zones of image data
that partially contain representations of a decodable symbol while
valid zones 1012-11 and 1012-12 are valid zones of image data
captured during a partial frame capture mode which contain
representations of an entire decodable symbol.
[0117] In the examples illustrated with reference to FIGS. 6a-6d an
optical reader operating in a partial frame clock out mode clocks
out electrical signals corresponding to linear patterns of pixels.
It is useful to cause a reader to clock out electrical signals
corresponding to linear patterns as shown in FIGS. 6a-6d when a
reader will be used to decode mainly 1D linear bar code
symbols.
[0118] In the examples illustrated with reference to FIGS. 6e, 6f
and 6g an optical reader operating in a partial frame clock out
mode clocks out electrical signals corresponding to non-linear
groupings of pixels. It is useful to cause a reader to clock out
electrical signals corresponding to pixel groupings as shown in
FIGS. 6e, 6f and 6g when a reader will be used to decode symbols
which are expected to be within a certain position in an image
sensor's field of view.
[0119] A reader may be configured so that the reader automatically
switches out of partial frame capture mode on the sensing of a
certain condition. For example a reader according to the invention
may be made to switch out of partial frame capture operating mode
and into a full frame capture mode on the sensing that a 2D symbol
is partially represented in the partial frame of image data, or on
the condition that processing of the partial frame of image data
fails to result in image data being decoded. The control module can
control the mode of operation of the reader based upon instructions
provided in a computer program operating on an electronic
processor, and can cause the reader to operate in either of the
partial frame capture mode or the full frame capture mode, as
appropriate.
[0120] An optical reading system in which the invention may be
employed is described with reference to the block diagram of FIG.
7a.
[0121] Optical reader 1110 includes an illumination assembly 1120
for illuminating a target object T, such as a 1D or 2D bar code
symbol, and an imaging assembly 1130 for receiving an image of
object T and generating an electrical output signal indicative of
the data optically encoded therein. Illumination assembly 1120 may,
for example, include an illumination source assembly 1122, together
with an illuminating optics assembly 1124, such as one or more
lenses, diffusers, wedges, reflectors or a combination of such
elements, for directing light from light source 1122 in the
direction of a target object T. Illumination assembly 1120 may
comprise, for example, laser or light emitting diodes (LEDs) such
as white LEDs or red LEDs. Illumination assembly 1120 may include
target illumination and optics for projecting an aiming pattern
1127 on target T. Illumination assembly 1120 may be eliminated if
ambient light levels are certain to be high enough to allow high
quality images of object T to be taken. Imaging assembly 1130 may
include an image sensor 1132, such as a 1D or 2D CCD, CMOS, NMOS,
PMOS, CID OR CMD solid state image sensor, together with an imaging
optics assembly 1134 for receiving and focusing an image of object
T onto image sensor 1132. The array-based imaging assembly shown in
FIG. 7a may be replaced by a laser array based imaging assembly
comprising multiple laser sources, a scanning mechanism, emit and
receive optics, at least one photodetector and accompanying signal
processing circuitry.
[0122] The partial frame clock out mode is readily implemented
utilizing an image sensor which can be commanded by a control
module to clock out partial frames of image data or which is
configured with pixels that can be individually addressed. Using
CMOS fabrication techniques, image sensors are readily made so that
electrical signals corresponding to certain pixels of a sensor can
be selectively clocked out without clocking out electrical signals
corresponding to remaining pixels of the sensor. CMOS image sensors
are available from such manufacturers as Symagery, Pixel Cam, Omni
Vision, Sharp, National Semiconductor, Toshiba, Hewlett-Packard and
Mitsubishi. A partial frame clock out mode can also be carried out
by selectively activating a frame discharge signal during the
course of clocking out a frame of image data from a CCD image
sensor, as is explained in U.S. patent application Ser. No.
09/766,922, entitled "Optical Reader Having Reduced Parameter
Determination Delay," previously incorporated herein by
reference.
[0123] Optical reader 1110 of FIG. 7a also includes programmable
control circuit (or control module) 1140 which preferably comprises
an integrated circuit microprocessor 1142 and an application
specific integrated circuit (ASIC 1144). The function of ASIC 1144
could also be provided by a field programmable gate array (FPGA).
Processor 1142 and ASIC 1144 are both programmable control devices
which are able to receive, to output and to process data in
accordance with a stored program stored in memory unit 1145 which
may comprise such memory elements as a read/write random access
memory or RAM 1146 and an erasable read only memory or EROM 1147.
Other memory units that can be used include EPROMs and EEPROMs. RAM
1146 typically includes at least one volatile memory device but may
include one or more long term non-volatile memory devices.
Processor 1142 and ASIC 1144 are also both connected to a common
bus 1148 through which program data and working data, including
address data, may be received and transmitted in either direction
to any circuitry that is also connected thereto. Processor 1142 and
ASIC 1144 differ from one another, however, in how they are made
and how they are used. The processing module that is configured to
extract information encoded by the encoded indicium employs some or
all of the capabilities of processor 1142 and ASIC 1144, and
comprises the hardware and as necessary, software and or firmware,
required to accomplish the extraction task, including as necessary
decoding tasks to convert the raw data of the image to the
information encoded in the encoded indicium.
[0124] More particularly, processor 1142 is preferably a general
purpose, off-the-shelf VLSI integrated circuit microprocessor which
has overall control of the circuitry of FIG. 7a, but which devotes
most of its time to decoding image data stored in RAM 1146 in
accordance with program data stored in EROM 1147. Processor 1144,
on the other hand, is preferably a special purpose VLSI integrated
circuit, such as a programmable logic array or gate array that is
programmed to devote its time to functions other than decoding
image data, and thereby relieves processor 1142 from the burden of
performing these functions.
[0125] The actual division of labor between processors 1142 and
1144 will naturally depend on the type of off-the-shelf
microprocessors that are available, the type of image sensor which
is used, the rate at which image data is output by imaging assembly
1130, etc. There is nothing in principle, however, that requires
that any particular division of labor be made between processors
1142 and 1144, or even that such a division be made at all. This is
because special purpose processor 1144 may be eliminated entirely
if general purpose processor 1142 is fast enough and powerful
enough to perform all of the functions contemplated by the present
invention. It will, therefore, be understood that neither the
number of processors used, nor the division of labor there between,
is of any fundamental significance for purposes of the present
invention.
[0126] With processor architectures of the type shown in FIG. 7a, a
typical division of labor between processors 1142 and 1144 will be
as follows. Processor 1142 is preferably devoted primarily to such
tasks as decoding image data, once such data has been stored in RAM
1146, recognizing characters represented in stored image data
according to an optical character recognition (OCR) scheme,
handling menuing options and reprogramming functions, processing
commands and data received from control/data input unit 1139 which
may comprise such elements as trigger 1174 (see FIG. 7f) and
keyboard 1178 (see FIG. 7g) and providing overall system level
coordination.
[0127] Processor 1144 is preferably devoted primarily to
controlling the image acquisition process, the A/D conversion
process and the storage of image data, including the ability to
access memories 1146 and 1147 via a DMA channel. The A/D conversion
process can include converting analog signals to digital signals
represented as 8-bit (or gray scale) quantities. As A/D converter
technology improves, digital signals may be represented using more
that 8 bits. Processor 1144 may also perform many timing and
communication operations. Processor 1144 may, for example, control
the illumination of LEDs 1122, the timing of image sensor 1132 and
an analog-to-digital (A/D) converter 1136, the transmission and
reception of data to and from a processor external to reader 1110,
through an RS-232, a network such as an Ethernet or other
packet-based communication technology, a serial bus such as USB,
and/or a wireless communication link (or other) compatible I/O
interface 1137. Processor 1144 may also control the outputting of
user perceptible data via an output device 1138, such as a beeper,
a good read LED and/or a display monitor which may be provided by a
liquid crystal display such as display 1182 (see FIGS. 7e and 7g).
Control of output, display and I/O functions may also be shared
between processors 1142 and 1144, as suggested by bus driver I/O
and output/display devices 1137'' and 1138' or may be duplicated,
as suggested by microprocessor serial I/O ports 1142A and 1142B and
I/O and display devices 1137' and 1138'. As explained earlier, the
specifics of this division of labor is of no significance to the
present invention.
[0128] Some or all of the above optical and electronic components
may be incorporated in an imaging module as are described in
commonly assigned U.S. patent application Ser. No. 09/411,936,
incorporated herein by reference in its entirety. An imaging module
2110 as described in the incorporated by reference U.S. patent
application Ser. No. 09/411,936 application is shown in FIG. 11. A
representation of a preferred illumination pattern projected by the
illumination system of module 1210 is shown in FIG. 12. In FIG. 12,
area 1272 represents the region of a target area T illuminated by
illumination LEDs of the module, while area 1274 represents the
region of a target area highlighted by the module's aiming LEDs and
their associated optics. It is seen that the aiming LEDs of the
module and their associated optics preferably project a solitary
horizontal line onto a target area. LEDs of imaging module 2110 can
be substituted for by such light sources as laser diodes, filament
based lamps, other solid state light sources, and fiber optic
illumination devices.
[0129] FIGS. 7b-7g show examples of types of housings in which the
2D imager of the present invention may be incorporated. FIGS. 7b-7g
show 1D/2D optical readers 1110-1, 1110-2 and 1110-3. Housing 1112
of each of the optical readers 1110-1 through 1110-3 is adapted to
be graspable by a human hand and has incorporated therein at least
one trigger switch 1174 for activating image capture and decoding
and/or image capture and character recognition operations. Readers
1110-1 and 1110-2 include hard-wired communication links 1179 for
communication with external devices such as other data collection
devices or a host processor, while reader 1110-3 includes an
antenna 1180 for providing wireless communication to an external
device or a host processor.
[0130] In addition to the above elements, readers 1110-2 and 1110-3
each include a display 1182 for displaying information to a user
and a keyboard 1178 for enabling a user to input commands and data
into the reader. Control circuit 1140 may cause a graphical user
interface (GUI) to be displayed on display 1182. A pointer on the
GUI may be moved by an actuator or actuators protruding from
housing 1112.
[0131] Any one of the readers described with reference to FIGS.
7b-7g may be mounted in a stationary position as is illustrated in
FIG. 7h showing a generic optical reader 1110 docked in a scan
stand 1190. Scan stand 1190 adapts portable optical reader 1110 for
presentation mode scanning In a presentation mode, reader 1110 is
held in a stationary position and an indicium-bearing article is
moved across the field of view of reader 1110. By comparison, in a
hand-held mode, the reader 1110 is manually positioned so that the
2D imager can view an encoded indicium within a target area of the
reader.
[0132] As will become clear from the ensuing description, the
invention need not be incorporated in a portable optical reader.
The invention may also be incorporated, for example, in association
with a control circuit for controlling a non-portable fixed mount
imaging assembly that captures image data representing image
information formed on articles transported by an assembly line, or
manually transported across a checkout counter at a retail
point-of-sale location. Further, in portable embodiments of the
invention, the reader need not be hand held. The reader may part or
wholly hand worn, finger worn, waist worn or head worn for
example.
[0133] Referring again to particular aspects of the invention,
control circuit 140 in the example of FIG. 6a executes a partial
frame capture mode in order to clock out and capture pixel data
illustrated by valid zone 1012-1. Reading the pixel values of valid
zone 1012-1 is effective to decode 1D symbol 1016-1 in the reader's
full field of view. Given that clocking out and capturing image
data of valid zone 1012-1 consumes less time than clocking out and
capturing a full frame of image data, it is seen that execution of
a partial frame capture mode decreases the decode time of the
reader. In prior art 2D optical readers, electrical signals
corresponding to full frame 1010 are clocked out in order to decode
a single 1D symbol 1016-1. The pixels of valid zone 1012-1 may
comprise a single row of pixels (a scan line) or a plurality of
rows.
[0134] In the example of FIG. 6b, control circuit 1140 executes a
partial frame capture mode in order to capture data defining valid
zones 1012-2, 1012-3 and 1012-4 of a full frame of image data
corresponding to a full field of view of a 2D image sensor. Valid
zones 1012-2, 1012-3 and 1012-4 are line patterns of image data at
various angular orientations. Reading of pixels of linear valid
zones arranged at various angular orientations is effective to
decode a 1D symbol which may be located at an oblique angle in a
field of view. It is seen that reading of pixels of linear valid
zone 1012-3 will result in the successful decoding of 1D bar code
symbol 1016-2. Zones 1012-2, 1012-3 and 1012-4 may be one or more
pixels wide.
[0135] In the example of FIG. 6c, control circuit 1140 executes a
partial frame capture mode in order to clock out and capture image
data defining valid zones 1012-5 through 1012-9. Valid zones 1012-5
to 1012-9 form a plurality of horizontal parallel lines. The
pattern of valid zones shown in FIG. 6c clocked out and captured in
a partial frame capture mode is effective for decoding
substantially horizontally oriented 1D symbols which are at an
unknown height in a full field of view. It is seen that the reading
of image data of valid zone 1012-8 will not result in the decoding
of symbol 1016-3 because symbol 1016-3 is not a 1D symbol.
Nevertheless, because valid zone 1012-8 intersects symbol bullseye
1016b, reading of an image data of valid zone 1012-8 may be
effective to determine that a 2D symbol is likely present in the
full field of view of image sensor 1132. In one aspect of the
invention, reader 1110 may be configured to switch out of a partial
frame capture mode and into a full frame capture mode when reading
of image data captured in the partial frame capture mode reveals
that a 2D symbol is likely to be represented in the image data
corresponding to the image sensor's full field of view.
[0136] The states of operation of reader 1110 operating in
accordance with the invention are normally selected by actuating
appropriate buttons of keyboard 1178, or control of a GUI, or by
the reading of menuing symbols, as are explained in commonly
assigned U.S. Pat. No. 5,929,418 incorporated herein by reference.
In alternative embodiments, software can be used to control which
states of operation will be active at different times. For example,
it is possible to program a computer to begin operation of the
reader device in a default state, such as a partial frame capture
mode of the 2D image sensor. It is possible to write computer code
that will switch the operation to a second partial frame imaging
mode if a sensor module senses the presence of one or more finder
patterns. It is possible to write computer code that will switch
the operation to a full frame imaging mode if an analysis module
reveals the presence of a 2D encoded indicium.
[0137] It should be apparent that several operating states of the
invention are possible. In a first operating state, reader 1110 is
made to operate only in a partial frame capture mode until the time
the first operating state is deactivated.
[0138] In a second operating state, as is alluded to in the example
of FIG. 6c, the reader operates in a partial frame capture mode
until the time that reading of image data captured in the partial
frame capture mode reveals that a 2D symbol is likely to be
included in the full frame field of view of image sensor 1132. The
revelation that a 2D symbol is likely to be included in the full
frame field of view of image sensor 1132 is accomplished using an
analysis module that analyses the features of the partial frame of
image data. When reading of the partial frame of image data reveals
that a 2D symbol is likely to be included in a full frame field of
view, control circuit 1140 captures at least one full frame of
image data from sensor 1132 and attempts to decode for the 2D
symbol determined likely to be represented in the full frame of
image data. A reader operating in the second operating state may
also be made to switch to a full frame operating mode on the
condition that a symbol is not successfully decoding during
operation of the reader in the partial frame operating mode.
[0139] A third operating state of a reader operating in accordance
with the invention is described with reference to FIGS. 6d and 6e.
Operating in accordance with a third operating state, a reader
operates in a partial frame capture mode to clock out and capture
image data of valid zone 1012-10 which corresponds to a
predetermined pattern and position in field of view 10. It is seen
that reading of image data of zone 1012-10 will not be effective to
decode symbol 1016-4 because symbol 1016-4 is of a type of 2D
symbol known as a stacked linear bar code. Control circuit 1140 may
nevertheless detect that symbol is a 2D symbol given that valid
zone 1012-10 intersects a finder pattern 1016f of symbol 1016-4.
Sensing with a sensing module that a 2D symbol is likely present in
the field of view when reading the partial frame image data
corresponding to valid zone 1012-10, the reader operating in the
third operating state then continues to operate in a partial frame
mode to clock out and capture image data that defines a second
valid zone 1012-11 of pixel positions as seen in FIG. 6e. The
second valid zone 1012-11 is not of a predetermined size and
position, but rather is of an adaptive position whose position, and
possibly size, orientation and shape depends on the result of the
reading of the image data corresponding to the first valid zone
1012-10. Specifically, the second valid zone 1012-11 is normally at
least of a size and position that is likely to encompass the symbol
1016-4 detected to be present when reading of the image data of
first valid zone 1012-10. It is seen that the third operating state
is likely to be operative to further reduce the clocking out and
capture of irrelevant image data, and therefore is likely to
further increase decoding speed. In the third operating state,
additional adaptive position valid zones may be clocked out and
captured if the reading of image data of first adaptive valid zone
1012-11 does not result in a symbol being decoded.
[0140] In the example of FIGS. 6f and 6g valid zones 1012-12 and
1012-13 correspond to nonlinear groupings of pixels. Capturing of
the valid zone patterns 1012-12 and 1012-13 of FIGS. 6f and 6g is
particularly useful for decoding symbol image data in the case that
a symbol is likely to be at a certain position in relation to an
image sensor's full frame field of view such as in the center of an
image sensor's field of view as shown in FIG. 6f.
[0141] In the example of FIG. 6f control circuit 1140 can
successfully decode symbol 1016-6 because symbol 1016-6 is located
entirely within valid zone 1012-12.
[0142] In the example of FIG. 6g, control circuit 1140 cannot
decode symbol 1016-7 if operating in the first operating state
since symbol 1016-7 is a 2D symbol and is not entirely located
within valid zone 1012-13. If operating in the second operating
state, then a reader capturing image data within valid zone 1012-13
may successfully decode symbol 1016-7 by reading the image data of
zone 1012-13 to determine that a 2D symbol is present, switching
operation to a full frame capture mode to capture a full frame 1010
of image data, and processing the full frame of image data to
decode symbol 1016-7. A reader operating in the third operating
state described hereinabove may decode symbol 1016-7, in the
example of FIG. 6g, by reading image data within valid zone
1012-13, capturing image data within an adaptively defined valid
zone (not shown) of sufficient size and position to encompass
symbol 1016-7, and then processing the image data within the
adaptively defined valid zone to decode symbol 1016-7.
[0143] FIG. 8 is a flow diagram 1300 showing an illustrative
process in which a partial frame of an image of an encoded indicium
is processed to extract encoded information. The process begins as
indicated in the oval 1310 labeled "START." The reader images an
encoded indicium using the 2D image sensor operating in a partial
frame mode, as indicated at box 1320. The control module causes a
partial frame of the image to be captured or clocked out, as
indicated at box 1330. The processing module processes the partial
frame of image data to extract information encoded in the encoded
indicium, as indicated at box 1340. The result of the processing by
the processing module is examined to determine whether information
has indeed been extracted, and a test is performed as indicated by
diamond 1350. If the result of the test is positive, as indicated
by the arrow labeled "YES," the information is provided, as
indicated by box 1360. The process is then completed, as indicated
by oval 1370, labeled "END." However, if the result of the test
performed at step 1350 is negative, as indicated by the arrow
labeled "NO," the control module switches to a full frame mode of
operation, as indicated at box 1355. The result of processing a
full frame of the image is then provided at box 1360, and the
process ends at oval 1370. The process 1300 can be repeated as many
times as required to extract information from a plurality of
encoded indicia.
[0144] FIG. 9 is another flow diagram 1400 showing an illustrative
process in which a partial frame of an image of an encoded indicium
is processed to extract encoded information. The process begins as
indicated in the oval 1410 labeled "START." The reader images an
encoded indicium using the 2D image sensor operating in a first
partial frame mode, as indicated at box 1420. The control module
causes a first partial frame of the image to be captured or clocked
out, as indicated at box 1430. The processing module processes the
first partial frame of image data to extract information encoded in
the encoded indicium, as indicated at box 1440. The result of the
processing by the processing module is examined to determine
whether information has indeed been extracted, and a test is
performed as indicated by diamond 1450. If the result of the test
is positive, as indicated by the arrow labeled "YES," the
information is provided, as indicated by box 1460. The process is
then completed, as indicated by oval 1470, labeled "END." However,
if the result of the test performed at step 1450 is negative, as
indicated by the arrow labeled "NO," the control module switches to
a second partial frame mode of operation, as indicated at box 1455.
The second partial frame is not necessarily of a predetermined size
and position, but rather is of an adaptive position whose position,
and possibly size, orientation and shape depends on the result of
the reading of the image data corresponding to the first partial
frame. For example, the second partial frame may be determined by
the sensor module, using such information as one or more finder
patterns, or one or more characteristics of known symbologies that
suggest or define a size, an orientation, and/or a shape of a
likely region to use as the second partial frame. The result of
processing the second partial frame of the image is then provided
at box 1460, and the process ends at oval 1470. The process 1400
can be repeated as many times as required to extract information
from a plurality of encoded indicia.
[0145] Yet another mode of operation is possible, in which the
region that is examined is incrementally increased. In brief, in
this operating mode, a first partial frame of image data is clocked
out and analyzed. If the data provides information, the result is
presented. However, if the first partial frame does not provide
decoded information, the operation of the system can be switched to
a second partial frame mode, and if that mode of operation also
fails to provide information, the operation can be switched to a
third mode, such a full frame operating mode. As many incrementally
larger partial frames as appear useful can be successively clocked
out and analyzed in an effort to search for decodable information.
However, one must also consider as a limitation that if the total
operating time to obtain and examine a succession of incrementally
larger partial frames equals or exceeds the time required to clock
out and analyze a full frame of data, there is no improvement in
processing time to be gained. Accordingly, depending on partial
frame clock out time, and depending on the processing speed of the
analysis module, one or more sequences of incrementally increasing
partial frame regions can be defined beyond which it is more
efficient to simply examine the full frame of image data. An
illustrative example is given in the flow chart depicted in FIG.
10, in which a second partial frame mode is used before the full
frame mode is activated.
[0146] FIG. 10 is another flow diagram 1500 showing an illustrative
process in which a partial frame of an image of an encoded indicium
is processed to extract encoded information. The process begins as
indicated in the oval 1510 labeled "START." The reader images an
encoded indicium using the 2D image sensor operating in a first
partial frame mode, as indicated at box 1520. The control module
causes a first partial frame of the image to be captured or clocked
out, as indicated at box 1530. The processing module processes the
first partial frame of image data to extract information encoded in
the encoded indicium, as indicated at box 1540. The result of the
processing by the processing module is examined to determine
whether information has indeed been extracted, and a test is
performed as indicated by diamond 1550. If the result of the test
is positive, as indicated by the arrow labeled "YES," the
information is provided, as indicated by the path of arrows labeled
"YES" from diamond 1555 through diamond 1560 to box 1570, labeled
"PROVIDE INFORMATION." The process is then completed, as indicated
by oval 1580, labeled "END." However, if the result of the test
performed at step 1550 is negative, as indicated by the arrow
labeled "NO," the control module switches to a second partial frame
mode of operation, as indicated at box 1555. The second partial
frame is not necessarily of a predetermined size and position, but
rather is of an adaptive position whose position, and possibly
size, orientation and shape depends on the result of the reading of
the image data corresponding to the first partial frame. For
example, the second partial frame may be determined by the sensor
module, using such information as one or more finder patterns, or
one or more characteristics of known symbologies that suggest or
define a size, an orientation, and/or a shape of a likely region to
use as the second partial frame. In the second partial frame mode,
additional information corresponding to the additional pixels that
are to be interrogated is clocked out and the resulting partial
frame of image data is analyzed. A test of the result of processing
the second partial frame of the image is performed at diamond 1560,
labeled "INFORMATION EXTRACTED?" If the result of the test is
positive, as indicated by the arrow labeled "YES," the information
is provided, as indicated by box 1570. The process is then
completed, as indicated by oval 1580, labeled "END." However, if
the result of the test performed at step 1560 is negative, as
indicated by the arrow labeled "NO," the control module switches to
a full frame mode of operation, as indicated at box 1565. The
result of processing a full frame of the image is then provided at
box 1570, and the process ends at oval 1580. The process 1500 can
be repeated as many times as required to extract information from a
plurality of encoded indicia.
[0147] Those of ordinary skill will recognize that many functions
of electrical and electronic apparatus can be implemented in
hardware (for example, hard-wired logic), in software (for example,
logic encoded in a program operating on a general purpose
processor), and in firmware (for example, logic encoded in a
non-volatile memory that is invoked for operation on a processor as
required). The present invention contemplates the substitution of
one implementation of hardware, firmware and software for another
implementation of the equivalent functionality using a different
one of hardware, firmware and software. To the extent that an
implementation can be represented mathematically by a transfer
function, that is, a specified response is generated at an output
terminal for a specific excitation applied to an input terminal of
a "black box" exhibiting the transfer function, any implementation
of the transfer function, including any combination of hardware,
firmware and software implementations of portions or segments of
the transfer function, is contemplated herein.
[0148] [Beginning of Section Excerpted from U.S. patent application
Ser. No. 09/766,922]
[0149] According to its major aspects and broadly stated, the
present invention relates to a method and apparatus for controlling
an optical reader to reduce the reader's parameter determination
delay. According to the invention, in one embodiment an image
sensor is adapted to clock out image data from an image sensor
according to two modes of operation, a "low resolution" clock out
mode of operation and a "normal resolution" clock out mode of
operation.
[0150] In a low resolution mode, some pixels of the reader's image
sensor pixel array can be clocked out at a normal clock out speed
sufficient to develop electrical signals that accurately represent
the intensity of light incident on the pixel array, while other
pixels of the array are either not clocked out or are clocked out
at a higher clock out rate which is insufficient to allow
development of electrical signals that accurately represent the
intensity of light at the respective pixels but which nevertheless,
result in an increase in the overall frame clock out rate of the
frame of image data. In a normal resolution mode of operation the
image sensor can be caused to clock out electrical signals
corresponding to each pixel of the array at a constant "normal
mode" speed which is a speed sufficient to ensure that the
electrical signal corresponding to each pixel accurately represents
the intensity of light incident on the pixel.
[0151] An optical reader according to the invention, in one
embodiment operates an image sensor in a low resolution mode of
operation in order to clock out and capture a parameter-determining
frame of image data at high speed, reads pixel data from the
parameter determination frame to determine an operation parameter
based on actual illumination conditions, then utilizes the
operation parameter in operating an image sensor according to high
resolution mode in the clocking out of a succeeding frame of image
data that is captured and subjected to comprehensive image data
processing which may include image data searching, decoding, and/or
recognition processing. Clocking out some of the pixels of an array
at high speed during execution of the low resolution mode
significantly decreases the reader's parameter determination
delay.
[0152] These parameters determined by reading pixel values from a
low resolution parameter determination frame of image data
according to the invention may include an exposure time parameter,
an amplification parameter for controlling amplification of an
electrical signal prior to its analog to digital conversion, an
illumination level parameter (intensity or period of illumination),
a dark or light level adjustment parameter and an analog-to-digital
converter reference voltage parameter for adjusting the high and/or
low reference voltages of the reader's analog to digital
converter.
[0153] In the present invention, an optical reader image sensor is
adapted to clock out image data from an image sensor according to
"low resolution" mode of operation in order to reduce a parameter
determination delay of the reader. In a low resolution mode, some
pixels of the readers image sensor array are clock out at normal
clock out speed sufficient to develop electrical signals accurately
reflecting the intensity of light at the respective pixel
positions, while other pixels of the array are either not clocked
out or are clocked out at a higher clock out rate which may be
insufficient to allow development of electrical signals that
accurately represent light incident on the image sensor's sensor
array but which nevertheless, results in a reduction of the overall
frame clock out rate of the frame of image data. An optical reader
according to the invention operates in a low resolution frame clock
out mode to capture a low resolution parameter determining frame of
image data at high speed, reads pixel data from the parameter
determination frame to determine an operation parameter based on
actual illumination conditions, then utilizes the operation
parameter in operating an optical reader.
[0154] [End of Section Excerpted from U.S. patent application Ser.
No. 09/766,922]
[0155] [Beginning of Section Excerpted from U.S. patent application
Ser. No. 09/766,806]
[0156] The invention is a method for configuring an optical reader
having a 2D image sensor so the reader captures and processes image
data at higher speeds.
[0157] According to the invention, a control circuit of an optical
reader equipped with a 2D image sensor is configured to operate in
a partial frame operating mode. In a partial frame operating mode,
the control circuit clocks out and captures less than a full frame
of image data and processes that image data. The control circuit
may process the image data of the partial frame, for example, by
reading the image data from memory and outputting the image data to
an output location such as a display device or a processor system
in communication with the reader, by reading and attempting to
decode decodable symbols which may be recorded in the partial
frame, or by reading and performing optical character recognition
on characters represented in the partial frame of image data.
[0158] In one embodiment, the partial frame operating mode is
employed to clock out and capture image data corresponding to at
least one linear pattern sufficient so that a 1D symbol in the
field of view of the image sensor may be decoded without clocking
out and capturing an entire frame of image data. The partial frame
of image data that is clocked out from the image sensor during the
partial frame capture operating mode may be, for example, a row of
pixels at or near the center of the image sensor or a limited
number of lines of image data corresponding to pixel locations of
the image sensor, possibly at varying angular orientations. The
control circuit may be configured so that if the control circuit
cannot decode a 1D symbol during the course of operating in the
partial frame capture mode, or detects that a 2D symbol is
represented in the captured image data, the control circuit
switches operation to a full frame capture mode.
[0159] In another embodiment, the partial frame operating mode is
employed to clock out and capture pixel values corresponding to a
grouping of pixels at or near a center of an image sensor other
than a linear pattern of pixels. This embodiment may be
advantageously employed in cases where decodable symbols are
expected to be concentrated proximate a center of an image sensor's
field of view. A control circuit may be configured so that if the
control circuit cannot decode a symbol represented in the partial
frame, or determines that a symbol is represented partially or
entirely outside the image data of the partial frame, the control
circuit automatically switches operation to a full frame image
capture mode.
[0160] The invention is an optical reader having a 2D image sensor
that is configured to operate in a partial frame capture mode. In a
partial frame operating mode, the reader clocks out and captures at
least one partial frame of image data having image data
corresponding to less than all of the pixels of an image sensor
pixel array. In one embodiment, the reader operating in a partial
frame operating mode captures image data corresponding to a linear
pattern of pixels of the image sensor, reads the image data,
attempts to decode for a decodable 1D symbol which may be
represented in the image data, and captures a full frame of image
data if the image data reading reveals a 2D symbol is likely to be
present in a full field of view of the 2D image sensor.
[0161] [End of Section Excerpted from U.S. patent application Ser.
No. 09/766,806]
[0162] While the present invention has been explained with
reference to the structure disclosed herein, it is not confined to
the details set forth and this invention is intended to cover any
modifications and changes as may come within the spirit and scope
of the following claims.
* * * * *