U.S. patent application number 16/992937 was filed with the patent office on 2022-02-17 for beverage dispense monitoring with camera.
The applicant listed for this patent is PepsiCo, Inc.. Invention is credited to Thore Mainart BUCKING, Joseph Albert DOLPHIN, Samuel KAROL, Timothy Charles KING, Roger Bradley MILLINGTON, Anthony ROMANO.
Application Number | 20220048753 16/992937 |
Document ID | / |
Family ID | 1000005022117 |
Filed Date | 2022-02-17 |
United States Patent
Application |
20220048753 |
Kind Code |
A1 |
KAROL; Samuel ; et
al. |
February 17, 2022 |
BEVERAGE DISPENSE MONITORING WITH CAMERA
Abstract
A beverage dispenser includes a nozzle to dispense a beverage.
The beverage dispenser further includes a camera to capture an
image of the beverage as the beverage is dispensed from the nozzle.
The camera has a field of view that includes the beverage. The
beverage dispenser further includes a light source that illuminates
the field of view of the camera. The beverage dispenser further
includes a computer. The computer analyzes the image of the
beverage and determines a characteristic of the beverage.
Inventors: |
KAROL; Samuel; (Hawthorne,
NY) ; ROMANO; Anthony; (West Dundee, IL) ;
BUCKING; Thore Mainart; (Hitchin, GB) ; KING; Timothy
Charles; (Cambridge, GB) ; DOLPHIN; Joseph
Albert; (Cambridge, GB) ; MILLINGTON; Roger
Bradley; (Huntingdon, GB) |
|
Applicant: |
Name |
City |
State |
Country |
Type |
PepsiCo, Inc. |
Purchase |
NY |
US |
|
|
Family ID: |
1000005022117 |
Appl. No.: |
16/992937 |
Filed: |
August 13, 2020 |
Current U.S.
Class: |
1/1 |
Current CPC
Class: |
G06T 7/90 20170101; B67D
1/0888 20130101; B67D 1/0022 20130101; G06V 10/56 20220101; B67D
1/0875 20130101; G01N 21/29 20130101; G01N 21/293 20130101; G06V
20/68 20220101; G01N 2021/1765 20130101 |
International
Class: |
B67D 1/08 20060101
B67D001/08 |
Claims
1.-7. (canceled)
8. A method of monitoring a beverage dispensed from a beverage
dispenser comprising: dispensing the beverage from a nozzle of the
beverage dispenser; capturing, while dispensing the beverage, an
image of the beverage as the beverage is dispensed from the nozzle
using a camera of the beverage dispenser; and analyzing the image
by performing a linear unmixing analysis to determine a
characteristic of an additive ingredient relative to other
ingredients in the beverage.
9. (canceled)
10. The method of monitoring the beverage dispensed from the
beverage dispenser of claim 8, wherein the additive ingredient
comprises at least one a flavoring, an enhancer, a sweetener, and a
coloring.
11. The method of monitoring the beverage dispensed from the
beverage dispenser of claim 8, wherein the other ingredients
comprise at least one of a base ingredient and a supplemental base
ingredient.
12. The method of monitoring the beverage dispensed from the
beverage dispenser of claim 11, wherein the base ingredient
comprises a consumable liquid and the supplemental base ingredient
comprises a consumable gas.
13. The method of monitoring the beverage dispensed from the
beverage dispenser of claim 8, further comprising analyzing the
image to determine a presence of carbonation.
14. The method of monitoring the beverage dispensed from the
beverage dispenser of claim 8, further comprising analyzing the
image to determine a presence of water.
15. The method of monitoring the beverage dispensed from the
beverage dispenser of claim 8, further comprising determining an
error in the dispensing of the beverage based upon the
characteristic of the beverage.
16. A beverage dispenser comprising: a nozzle configured to
dispense a beverage; a visual-light camera configured to capture a
color image of the beverage as the beverage is dispensed from the
nozzle, the camera disposed inside a dispense bay of the beverage
dispenser and arranged to have a field of view that is
perpendicular to a dispensing direction of the beverage; a
computer; and a non-transitory computer readable medium operatively
connected to the computer, the non-transitory computer readable
medium comprising instructions that when executed by the computer
cause the computer to analyze the image of the beverage and
determine a characteristic of the beverage.
17. The beverage dispenser according to claim 16, wherein the
instructions when executed by the computer cause the computer to
determine an error in dispensing of the beverage based upon the
characteristic of the beverage.
18. The beverage dispenser according to claim 17, wherein the
characteristic is an additive ingredient characteristic comprising
a concentration or ratio of an additive ingredient of the beverage
relative to other ingredients of the beverage.
19. The beverage dispenser according to claim 16, wherein analyzing
the image includes a linear unmixing analysis that determines the
characteristic of the beverage by comparing a calibrated image to
the image.
20. The method of monitoring a beverage dispensed from a beverage
dispenser of claim 8, further comprising: analyzing the image using
a morphological analysis to determine a second characteristic of
the beverage.
21. The beverage dispenser of claim 16, wherein the instructions
further comprise a second analysis step that uses a morphological
analysis to determine a second characteristic of the beverage.
Description
FIELD
[0001] Embodiments described herein generally relate to beverage
dispensing. Specifically, embodiments described herein relate to
beverage dispense monitoring with a camera.
BACKGROUND
[0002] Beverage dispensers may dispense beverages that are made
within the beverage dispenser by mixing two or more ingredients,
such as water, an additive ingredient (e.g., syrup), and optionally
carbonation. The ingredients may be stored in canisters and a
single dispenser may contain multiple canisters, each associated
with various beverages or flavors. Improper mixing of the two or
more ingredients can lead to poor taste and customer
dissatisfaction.
BRIEF SUMMARY OF THE INVENTION
[0003] Some embodiments described herein relate to a beverage
dispenser including a nozzle configured to dispense a beverage, a
camera configured to capture an image of the beverage as the
beverage is dispensed from the nozzle, the camera having a field of
view that includes the beverage. The beverage dispenser also
including a light source that is configured to illuminate the field
of view of the camera.
[0004] In any of the various embodiments discussed herein, the
nozzle is configured to dispense a plurality of beverages, and the
beverage is one of the plurality of beverages.
[0005] In any of the various embodiments discussed herein, the
image includes optical data.
[0006] In any of the various embodiments discussed herein, the
camera is a RGB camera.
[0007] In any of the various embodiments discussed herein, the
field of view of the camera extends perpendicular to a direction
along which the beverage is configured to be dispensed.
[0008] In any of the various embodiments discussed herein, the
beverage dispenser includes a dispense bay, and the camera is
angularly mounted outside of the dispense bay above and lateral to
the nozzle.
[0009] In any of the various embodiments discussed herein, the
light source opposes the field of view of the camera.
[0010] Some embodiments described herein relate to a method of
monitoring a beverage dispensed from a beverage dispenser including
dispensing the beverage from a nozzle of the beverage dispenser,
capturing, while dispensing the beverage, an image of the beverage
as the beverage is dispensed from the nozzle using a camera of the
beverage dispenser, and analyzing the image to determine a
characteristic of the beverage.
[0011] In any of the various embodiments discussed herein, the
characteristic is an additive ingredient characteristic comprising
a concentration or ratio of an additive ingredient of the beverage
relative to other ingredients of the beverage.
[0012] In any of the various embodiments discussed herein, the
additive ingredient comprises at least one a flavoring, an
enhancer, a sweetener, and a coloring.
[0013] In any of the various embodiments discussed herein, the
other ingredients comprise at least one of a base ingredient and a
supplemental base ingredient.
[0014] In any of the various embodiments discussed herein, the base
ingredient comprises a consumable liquid and the supplemental base
ingredient comprises a consumable gas.
[0015] In any of the various embodiments discussed herein, the
characteristic is a presence of carbonation.
[0016] In any of the various embodiments discussed herein, the
characteristic is a presence of water.
[0017] In any of the various embodiments discussed herein, the
method includes determining an error in the dispensing of the
beverage based upon the characteristic of the beverage.
[0018] Some embodiments described herein relate to a beverage
dispenser including a nozzle configured to dispense a beverage, a
camera configured to capture an image of the beverage as the
beverage is dispensed from the nozzle, a computer, and a
non-transitory computer readable medium operatively connected to
the computer, the non-transitory computer readable medium
comprising instructions that when executed by the computer cause
the computer to analyze the image of the beverage and determine a
characteristic of the beverage.
[0019] In any of the various embodiments discussed herein, the
instructions when executed by the computer cause the computer to
determine an error in dispensing of the beverage based upon the
characteristic of the beverage.
[0020] In any of the various embodiments discussed herein, the
characteristic is an additive ingredient characteristic comprising
a concentration or ratio of an additive ingredient of the beverage
relative to other ingredients of the beverage.
[0021] In any of the various embodiments discussed herein, the
analyze the image includes a linear unmixing analysis.
BRIEF DESCRIPTION OF THE DRAWINGS
[0022] The accompanying drawings, which are incorporated herein and
form a part of the specification, illustrate the present disclosure
and, together with the description, further serve to explain the
principles thereof and to enable a person skilled in the pertinent
art to make and use the same.
[0023] FIG. 1 shows a perspective view of an exemplary beverage
dispenser according to an embodiment.
[0024] FIG. 2 shows a schematic view of an exemplary beverage
dispenser according to an embodiment.
[0025] FIGS. 3A and 3B show the field of view of cameras of the
beverage dispenser of FIG. 1.
[0026] FIG. 4 shows an exemplary computer of the beverage dispenser
according to an embodiment.
[0027] FIG. 5 shows an exemplary process of monitoring a dispensed
beverage according to an embodiment.
[0028] FIG. 6A shows a heat map of estimated concentration
percentage of an additive ingredient of a first dispensed beverage
using calibrated optical data for the first beverage according to
an embodiment.
[0029] FIG. 6B shows a heat map of error associated with the
estimated concentration of FIG. 6A.
[0030] FIG. 7A shows a heat map of estimated concentration
percentage of an additive ingredient of a first dispensed beverage
using calibrated optical data for a second beverage according to an
embodiment.
[0031] FIG. 7B shows a heat map of error associated with the
estimated concentration of FIG. 7A.
[0032] FIG. 8 shows an exemplary process of determining whether
there is a dispense error using a combination of linear unmixing
analysis and morphological analysis according to an embodiment.
[0033] FIG. 9A shows images of carbonated and flat beverage streams
according to an embodiment.
[0034] FIG. 9B shows edge detection analysis performed on the
images of FIG. 9A.
DETAILED DESCRIPTION
[0035] Reference will now be made in detail to representative
embodiments illustrated in the accompanying drawings. It should be
understood that the following descriptions are not intended to
limit the embodiments to one preferred embodiment. To the contrary,
it is intended to cover alternatives, modifications, and
equivalents as can be included within the spirit and scope of the
described embodiments as defined by the claims.
[0036] Beverage dispensing systems can mix two or more ingredients,
e.g., a base ingredient and an additive ingredient, to form a
beverage. For example, many beverage dispensers have a water line
to supply water as a base ingredient and one or more containers
that hold flavorings as additive ingredients. The ingredients can
be dispensed from a single nozzle capable of dispensing a plurality
of different beverages. Multiple nozzles, which may dispense a
single beverage per nozzle, can be also be employed.
[0037] Ensuring that ingredients are dispensed in accordance with
prescribed beverage recipes is critical to beverage quality. For
example, if too little additive ingredient is used, the dispensed
beverage can be diluted and will not achieve the desired flavor
profile for the beverage. Similarly, for carbonated beverages too
much or too little gas can alter the carbonation of the dispensed
beverage.
[0038] Beverage dispenser operators ensure that ingredients are
supplied in accordance with the prescribed beverage recipes.
Beverage manufacturers can have limited control over operators,
particularly when operators are managed by third-party employers
such as restaurants, movie, theatres, or other locations at which
food and beverages are commonly sold. Dispense issues can degrade
consumers' impression of the dispensed beverage. Negative consumer
experiences with beverage dispensers can adversely impact future
sales. Accordingly, there exists a need for low cost automation of
the monitoring of the dispensed beverage to ensure consistent
quality of dispensed beverages.
[0039] Some embodiments described herein relate to a beverage
dispenser that can include a nozzle configured to dispense a
beverage. The beverage dispenser can also include a camera
configured to capture an image of the beverage as the beverage is
dispensed from the nozzle. The camera can have a field of view that
includes the nozzle. The beverage dispenser can also include a
light source that is configured to illuminate the field of view of
the camera.
[0040] In embodiments, the beverage dispenser can include a
computer and a non-transitory computer readable medium operatively
connected to the computer. The non-transitory computer readable
medium can include instructions that when executed by the computer
cause the computer to analyze the image of the beverage and
determine a characteristic of the beverage.
[0041] Some embodiments described herein relate to a method of
monitoring a beverage dispensed from a beverage dispenser. The
method can include dispensing the beverage from a nozzle of the
beverage dispenser. The method can include capturing, while
dispensing the beverage, an image of the dispensed beverage as the
beverage is dispensed from the nozzle using a camera of the
beverage dispenser. The method can include analyzing the image to
determine a characteristic of the dispensed beverage.
[0042] Embodiments of the disclosure address the need for efficient
automation of monitoring of the dispensed beverage and improve
consistent quality of dispensed beverages. For example, embodiments
of the disclosure can detect improper ingredient ratios or amounts
in the dispensed beverage.
[0043] FIG. 1 shows a perspective view of an exemplary beverage
dispenser 100 in accordance with aspects of the disclosure. FIG. 2
shows a schematic view of beverage dispenser 100. In embodiments,
beverage dispenser 100 includes a nozzle 102 that dispenses a
beverage 104. As used herein, the term "beverage" may refer to a
base ingredient 106, with or without a supplemental base ingredient
108, and alone or in combination with one or more additive
ingredient 110. The beverage 104 may be dispensed in a cup 112.
[0044] As used herein, the term "base ingredient" may refer to any
free-flowing consumable liquid, such as water, or dairy-based
beverages, such as milk, among others.
[0045] As used herein, the term "supplemental base ingredient" may
refer to any consumable gas, such as carbon dioxide, pressurized
nitrogen, or other suitable gas, that can be infused or dissolved
into base ingredient 106. Reference to "carbonate" or "carbonation"
as used herein includes infusing or dissolving carbon dioxide or
any other supplemental base ingredient 108 into base ingredient
106.
[0046] As used herein, the term "additive ingredient" may refer to
a particular flavoring, such as cola, grape, orange, lemon-lime,
cherry, or vanilla, among others, or may refer to an enhancer
(e.g., multi-vitamin complexes, minerals, and energy boosters),
sweetener, or coloring, whether in the form of a liquid, syrup, or
concentrate, or other form.
[0047] In embodiments, beverage dispenser 100 may include one or a
plurality of nozzles 102. Each of the plurality of nozzles 102 may
dispense one dedicated beverage 104. As used herein, reference to
"each" encompasses embodiments of beverage dispenser 100 including
any number of the named structure. For example, reference to each
nozzle 102 encompasses embodiments of beverage dispenser 100
including any number of nozzles 102, including only a single nozzle
102.
[0048] In embodiments, each nozzle 102 may dispense a plurality of
different beverages 104. That is, a single nozzle 102 may be
configured to dispense a plurality of different beverages 104.
[0049] In alternative embodiments, beverage dispenser 100 can
include only one nozzle 102. The single nozzle 102 may be
configured to dispense a plurality of different beverages.
[0050] In embodiments, beverage dispenser 100 can include one or
more base ingredient supply 114 that supplies one or more base
ingredient 106 to nozzle 102. Base ingredient supply 114 can supply
at least one base ingredient 106 (e.g., water, milk, etc., as
previously described) to each nozzle 102. Base ingredient supply
114 can be a water line connected to a local water supply. The
water line can include a filter. Base ingredient supply 114 can be
one or more container containing base ingredient 106. Base
ingredient supply 114 can include a pump to pump base ingredient
106 through an ingredient pathway 120, as discussed further
herein.
[0051] In embodiments, base ingredient supply 114 can supply a
single base ingredient 106 to each nozzle 102. In alternative
embodiments, base ingredient supply 114 can supply more than one
base ingredient 106 to each nozzle 102.
[0052] In some embodiments having more than one nozzle 102, base
ingredient supply 114 can supply one base ingredient 106 to one or
more nozzle 102 and another different base ingredient 106 to one or
more different nozzle 102. In embodiments, base ingredient 106 can
be supplied to nozzle 102 with or without supplemental base
ingredient 108.
[0053] In embodiments, beverage dispenser 100 can include one or
more supplemental base ingredient supply 116 that supplies one or
more supplemental base ingredient 108 for infusion or dissolution
with base ingredient 106. Supplemental base ingredient supply 116
can supply at least one supplemental base ingredient 108 (e.g.,
carbon dioxide, as previously described) to each base ingredient
106. Supplemental base ingredient supply 116 can be a container
containing supplemental base ingredient 108.
[0054] In embodiments, supplemental base ingredient supply 116 can
store supplemental base ingredient 108 at a pressure greater than
atmospheric pressure.
[0055] In embodiments, supplemental base ingredient supply 116 can
store supplemental base ingredient 108 at a pressure sufficient to
maintain supplemental base ingredient 108 in a liquid phase in the
container. Supplemental base ingredient 108 can transition from a
liquid to a gas phase after leaving supplemental base ingredient
supply 116.
[0056] In embodiments, supplemental base ingredient supply 116 can
include a pump to pump supplemental base ingredient 108 through
ingredient pathway 120. Supplemental base ingredient 108 can be
infused with or dissolved into base ingredient 106 at any point of
ingredient pathway 120.
[0057] In embodiments, beverage dispenser 100 may include no
supplemental base ingredient supply 116. For example, supplemental
base ingredient 108 may be infused with or dissolved into base
ingredient 106 and supplied with base ingredient 106 from base
ingredient supply 114.
[0058] In embodiments, beverage dispenser 100 can include one more
additive ingredient supply 118 that supplies one or more additive
ingredient 110 to nozzle 102. Additive ingredient supply 118 can
supply at least one additive ingredient 110 (e.g., flavoring,
enhancer, sweetener, coloring, etc., as previously described) to
each nozzle 102. Additive ingredient supply 118 can be one or more
container containing an additive ingredient 110. Additive
ingredient supply 118 can include a pump to pump additive
ingredient 110 through the ingredient pathway 120.
[0059] In embodiments, additive ingredient supply 118 can supply a
single additive ingredient 110 to each nozzle 102.
[0060] In alternative embodiments, additive ingredient supply 118
can supply more than one additive ingredient 110 to each nozzle 102
such that each nozzle 102 may dispense more than one beverage
104.
[0061] In some embodiments having more than one nozzle 102,
additive ingredient supply 118 can supply one additive ingredient
110 to one or more nozzle 102 and another different additive
ingredient 110 to one or more different nozzle 102 such that each
nozzle 102 may supply a dedicated beverage 104.
[0062] In embodiments, base ingredient 106 can be supplied to
nozzle 102 with or without additive ingredient 110. Additive
ingredient 110 can be infused with or dissolved into base
ingredient 106 at any point of ingredient pathway 120.
[0063] As discussed previously, in embodiments beverage dispenser
100 can include ingredient pathway 120 that connects base
ingredient, supplemental base ingredient, or additive ingredient
supplies 114, 116, 118 to nozzle 102. Ingredient pathway 120 can
fluidly connect base ingredient, supplemental base ingredient, or
additive ingredient supplies 114, 116, 118 to one or more nozzle
102 of beverage dispenser 100. Ingredient pathway 120 can include
hoses, pipes, connectors, or the like. Ingredient pathway 120 may
include valves to control flow base ingredient 106, supplemental
base ingredient 108, or additive ingredient 110. Valves may be
mechanically or electromechanically controlled.
[0064] In embodiments, beverage dispenser 100 can include a camera
122 that can capture an image of the dispensed beverage 104 during
dispensing and in real time. Camera 122 can capture an image of
beverage 104 during dispensing from nozzle 102. The image may
include optical data. Camera 122 may include an imaging system
configured to separately receive different color ranges.
[0065] In embodiments, camera 122 may separately receive a
plurality of color ranges, including for example red, green, and
blue color ranges. Camera 122 may be an affordable, commercially
available camera 122.
[0066] In embodiments, camera 122 may be an RGB camera.
[0067] In embodiments, camera 122 may be a rolling shutter
camera.
[0068] In embodiments, camera 122 may be a global shutter
camera.
[0069] In embodiments, camera 122 may image at a standard Super
Extended Graphics Array resolution, i.e., a resolution of
1280.times.1024 pixels.
[0070] Beverage dispenser 100 can include one or more camera 122.
In embodiments, a single camera 122 can be provided for each nozzle
102.
[0071] In embodiments, multiple cameras 122 (e.g., two cameras)
mounted at different positions may be provided for each nozzle
102.
[0072] Camera 122 can be mounted relative to nozzle 102 such that
nozzle 102, dispensed beverage 104, and/or cup 112 is within the
field of view of camera 122.
[0073] In embodiments, camera 122 may be mounted such that the
field of view of camera 122 includes portions of each of nozzle
102, dispensed beverage 104, and cup 112.
[0074] As shown in FIG. 1, in embodiments beverage dispenser 100
can include a first camera 122a and a second camera 122b. First
camera 122a may be mounted to the side (e.g., perpendicularly) of
nozzle 102 and cup 112. FIG. 3A shows the field of view of first
camera 122a of FIG. 1, which includes nozzle 102, cup 112, and
dispensed beverage 104. The field of view of first camera 122a can
extend perpendicular to a direction along which beverage 104 can be
dispensed.
[0075] In embodiments, first camera 122a may include a suitable
lens such that a part of the field of view can be effectively
perpendicular to the direction along which beverage 104 can be
dispensed, while a different part of the field of view can be more
down-ward facing.
[0076] Second camera 122b may be angularly mounted above and to a
side of nozzle 102 such that nozzle 102, dispensed beverage 104,
and cup 112 are each within the field of view. FIG. 3B shows the
field of view of second camera 122b of FIG. 1, which includes
nozzle 102, cup 112, and dispensed beverage 104.
[0077] In embodiments, camera 122 may be mounted outside of a
dispense bay 124 of beverage dispenser 100. For example, second
camera 122b may be angularly mounted outside of dispense bay 124 at
a position above and lateral to nozzle 102.
[0078] In embodiments, camera 122 may be mounted inside of dispense
bay 124. For example, first camera 122a may be mounted inside of
the dispense bay 124.
[0079] Although FIG. 1 includes first and second cameras 122a,
122b, in embodiments beverage dispenser 100 may include only one
camera 122 (e.g., only first camera 122a).
[0080] In embodiments, camera 122 may be mounted with a universal
bracket that may mount a plurality of different types of
cameras.
[0081] According to embodiments, the field of view of camera 122
can provide a view of dispensed beverage 104 while also allowing
sufficient field of view into cup 112 for, e.g., determining fill
level of cup 112.
[0082] In embodiments, beverage dispenser 100 can include a light
source 126 that can illuminate a field of view of camera 122,
including while beverage 104 is dispensed from nozzle 102. Light
source 126 may provide lighting for beverage dispenser 100, or
alternatively may be distinct from a separate light source 127 of
beverage dispenser 100. Light source 126 can be fluorescent,
incandescent, LED, OLED, or any other suitable light source.
[0083] In embodiments, light source 126 may selectively illuminate,
such as when camera 122 is in use or when a user is at beverage
dispenser 100. Light source 126 may illuminate while beverage 104
is dispensed from nozzle 102.
[0084] As shown in FIG. 1, beverage dispenser 100 can include a
first light source 126a and a second light source 126b.
[0085] In embodiments, light source 126 (e.g., first light source
126a) can oppose and face camera 122 (e.g., first camera 122a) to
illuminate the field of view.
[0086] Light source 126 may selectively illuminate with wavelengths
in the range of 300 nm-1100 nm. In such embodiments, image
analysis, such as linear unmixing analysis discussed in further
detail herein, can be improved by increasing spectral information
content.
[0087] Alternatively, light source 126 may illuminate within a
particular wavelength range, such as wavelength ranges
corresponding to white light. Such embodiments allow for analysis
(e.g., spectral decomposition) of a single image and real time
analysis of the dispensed beverage 104.
[0088] In embodiments, beverage dispenser 100 can include a
computer 600 to analyze the image of beverage 104 and determine a
characteristic of beverage 104. FIG. 4 illustrates an exemplary
computer 600 in which embodiments, or portions thereof, may be
implemented as computer-readable code. For example, aspects of the
process 500 or process 800, as discussed further herein, may be
implemented via computer 600.
[0089] If programmable logic is used, such logic may execute on a
commercially available processing platform or a special purpose
device. One of ordinary skill in the art may appreciate that
embodiments of the disclosed subject matter can be practiced with
various computer configurations, including multi-core
multiprocessor systems, minicomputers, and mainframe computers,
computer linked or clustered with distributed functions, as well as
pervasive or miniature computers that may be embedded into
virtually any device.
[0090] For instance, at least one processor device and a memory may
be used to implement the above described embodiments. A processor
device may be a single processor, a plurality of processors, or
combinations thereof. Processor devices may have one or more
processor "cores."
[0091] Various embodiments of the inventions may be implemented in
terms of this example computer 600. After reading this description,
it will become apparent to a person skilled in the relevant art how
to implement one or more of the inventions using other computers or
computer architectures. Although operations may be described as a
sequential process, some of the operations may in fact be performed
in parallel, concurrently, or in a distributed environment, and
with program code stored locally or remotely for access by single
or multiprocessor machines. In addition, in some embodiments the
order of operations may be rearranged without departing from the
spirit of the disclosed subject matter.
[0092] Processor 604 may be a special purpose or a general purpose
processor device. As will be appreciated by persons skilled in the
relevant art, processor 604 may also be a single processor in a
multi-core/multiprocessor system, such system operating alone, or
in a cluster of computing devices operating in a cluster or server
farm. Processor 604 is connected to a communication infrastructure
606, for example, a bus, message queue, network, or multi-core
message-passing scheme.
[0093] Computer 600 can include a main memory 608, for example,
random access memory (RAM), and may also include a secondary memory
610. Secondary memory 610 may include, for example, a hard disk
drive 612, or removable storage drive 614. Removable storage drive
614 may include a floppy disk drive, a magnetic tape drive, an
optical disk drive, a flash memory, a Universal Serial Bus (USB)
drive, or the like. The removable storage drive 614 reads from or
writes to a removable storage unit 618 in a well-known manner.
Removable storage unit 618 may include a floppy disk, magnetic
tape, optical disk, etc. which is read by and written to by
removable storage drive 614. As will be appreciated by persons
skilled in the relevant art, removable storage unit 618 includes a
computer usable storage medium having stored therein computer
software or data.
[0094] Computer 600 may include a display interface 602 (which can
include input and output devices such as keyboards, mice, etc.)
that forwards graphics, text, and other data from communication
infrastructure 606 (or from a frame buffer not shown) for display
on a display unit 630.
[0095] In implementations, secondary memory 610 may include other
similar means for allowing computer programs or other instructions
to be loaded into computer 600. Such means may include, for
example, a removable storage unit 622 and an interface 620.
Examples of such means may include a program cartridge and
cartridge interface (such as that found in video game devices), a
removable memory chip (such as an EPROM, or PROM) and associated
socket, and other removable storage units 622 and interfaces 620
which allow software and data to be transferred from the removable
storage unit 622 to computer 600.
[0096] Computer 600 may also include a communication interface 624.
Communication interface 624 allows software and data to be
transferred between computer 600 and external devices, such as
camera 122. Communication interface 624 may include a modem, a
network interface (such as an Ethernet card), a communication port,
a PCMCIA slot and card, or the like. Software and data transferred
via communication interface 624 may be in the form of signals,
which may be electronic, electromagnetic, optical, or other signals
capable of being received by communication interface 624. These
signals may be provided to communication interface 624 via a
communication path 626. Communication path 626 carries signals and
may be implemented using wire or cable, fiber optics, a phone line,
a cellular phone link, an RF link or other communication
channels.
[0097] In this document, the terms "non-transitory computer
readable medium" "computer program medium" and "computer usable
medium" can refer to media such as removable storage unit 618,
removable storage unit 622, and a hard disk installed in hard disk
drive 612. Computer program medium and computer usable medium may
also refer to memories, such as main memory 608 and secondary
memory 610, which may be memory semiconductors (e.g. DRAMs,
etc.).
[0098] Computer programs (also called computer control logic) or
databases are stored in main memory 608 or secondary memory 610.
Computer programs may also be received via communication interface
624. Such computer programs, when executed, enable computer 600 to
implement the embodiments as discussed herein. In particular, the
computer programs, when executed, enable processor 604 to implement
the processes of the embodiments discussed here. Accordingly, such
computer programs represent controllers of computer 600. Where the
embodiments are implemented using software, the software may be
stored in a computer program product and loaded into computer 600
using removable storage drive 614, interface 620, and hard disk
drive 612, or communication interface 624.
[0099] Embodiments of the inventions also may be directed to
computer program products comprising software stored on any
computer useable medium. Such software, when executed in one or
more data processing device, causes a data processing device(s) to
operate as described herein. Embodiments of the inventions may
employ any computer useable or readable medium. Examples of
computer useable mediums include, but are not limited to, primary
storage devices (e.g., any type of random access memory), secondary
storage devices (e.g., hard drives, floppy disks, CD ROMS, ZIP
disks, tapes, magnetic storage devices, and optical storage
devices, MEMS, nanotechnological storage device, etc.).
Monitoring of Dispensed Beverage
[0100] The following describes monitoring computer 600 can perform
based upon one or more image of the dispensed beverage 104. In
embodiments, computer 600 can implement instructions stored on a
non-transitory computer readable medium that cause computer 600 to
implement a process 500 of monitoring beverage 104 dispensed from
beverage dispenser 100. Beverage dispenser 100 can be any of the
embodiments of beverage dispenser 100 discussed previously.
[0101] The process 500 can include, at step 501, dispensing
beverage 104 from beverage dispenser 100. For example, a customer
or operator can approach beverage dispenser 100 and select a
particular beverage 104 (herein after "selected" beverage 104) for
dispensing.
[0102] In embodiments, computer 600 can control beverage dispenser
100 to dispense selected beverage 104 according to a recipe of the
selected beverage 104. Computer 600 may store a recipe of each
beverage 104 that beverage dispenser 100 is configured to dispense.
For example, computer 600 can control flow of ingredients from the
ingredient supplies, through ingredient pathway 120, and out nozzle
102 to dispense the selected beverage 104. Computer 600 can
automatically detect a presence of cup 112, for example using a
motion detector (not shown) that activates camera 122, and initiate
dispensing of beverage 104 without any physical user interaction
beyond placing cup 112 on dispense bay 124 of beverage dispenser
100. The process 500 can include a user placing cup 112 on dispense
bay 124 of beverage dispenser 100 and the dispensing can be
automatically initiated by computer 600 based upon the automatic
detection of cup 112.
[0103] In embodiments, one or more aspects of beverage dispenser
100 may be mechanically controlled, e.g., a user may press cup 112
against a lever (not shown) to initiate dispensing or a user may
push a button (not shown) to initiate dispensing.
[0104] At step 502, process 500 can include capturing one or more
images of dispensed beverage 104. Computer 600 can control camera
122 to capture images. Computer 600 can automatically control
camera 122 to capture images in response to an initiation of
dispensing. Computer 600 can automatically control camera 122 to
capture one or more images prior to, during, or after
dispensing.
[0105] At step 503, process 500 can include analyzing the captured
image or images to determine a characteristic of dispensed beverage
104. The characteristic of dispensed beverage 104 may be, alone or
in combination, an additive ingredient characteristic, a
supplemental base ingredient characteristic, or a base ingredient
characteristic.
[0106] In embodiments, the characteristic may be an additive
ingredient characteristic. Computer 600 may analyze the image of
beverage 104 to determine an additive ingredient characteristic in
a number of ways, including evaluating colors or entropy of the
image of dispensed beverage 104, as discussed further herein.
[0107] In embodiments, the characteristic may be a supplemental
base ingredient characteristic, such as the presence or absence of
supplemental base ingredient 108. For example, computer 600 may
determine a presence of carbonation, which includes both
determining the presence or the absence of carbonation.
[0108] In embodiments, the characteristic may be a base ingredient
characteristic, such as the presence or absence of base ingredient
106. For example, computer 600 may determine a presence of water,
which includes both situations in which water is present and water
is absent.
[0109] In embodiments, the characteristic may be a quality of the
flow of the beverage. The quality may be represented by morphology
of the beverage such as a turbulence of the beverage.
[0110] At step 504, the process can include determining whether
there is a detectable error i.e., a dispense error, in the
dispensing of beverage 104 at step 501 based on the characteristic
of beverage 104 determined at step 503.
[0111] In embodiments, the dispense error can be an additive
ingredient dispense error. For example, the additive ingredient
dispense error can be a determination that the dispensed beverage
104 includes inappropriate concentrations of one or more additive
ingredient 110. In embodiments, computer 600 may store target
concentrations for each beverage 104 that beverage dispenser 100 is
configured to dispense. Estimated concentrations of the dispensed
beverage 104 may be compared to the target concentrations for the
particular beverage 104. Computer 600 may determine that the
dispensed beverage 104 includes an inappropriate concentration of
additive ingredient 110 if the estimated concentrations is outside
of a predetermined range (e.g., +/-5%) of the target concentration
for beverage 104.
[0112] Additionally or alternatively, the dispense error can be a
determination that the wrong additive ingredient 110 is dispensed.
For example, for beverage dispenser 100 embodiments that can
dispense different beverages from the same nozzle 102, a user may
select one of a plurality of beverages 104 for dispensing. Computer
600 can determine an additive ingredient dispense error when
beverage dispenser 100 dispenses a beverage 104 other than the
selected beverage 104 at step 501.
[0113] In embodiments, computer 600 can determine base ingredient
or supplemental base ingredient dispense errors, such as gross
failures in the quantity of supplemental base ingredient 108
dispensed. One example of detectable gross error of supplemental
base ingredient 108 is a failure to carbonate a beverage 104 that
requires carbonation.
[0114] If computer 600 determines that there is a dispense error at
step 504, the process 500 can proceed to step 505, at which the
dispense error may be addressed.
[0115] In embodiments, addressing the dispense error may include
disseminating an alert that the dispense error occurred.
[0116] In embodiments, the alert can be displayed on a display of
beverage dispenser 100.
[0117] In embodiments, the alert can be sent on a network for to an
operator that may be designated for further diagnosis or
repair.
[0118] In embodiments, the alert can include automatically
re-ordering of a product associated with the dispense error.
[0119] If computer 600 determines that there is no detected
dispense error at step 504, the process 500 may conclude or repeat
step 501 with a new dispense.
[0120] Linear Unmixing Analysis
[0121] In embodiments, steps 503 and 504 can involve a linear
unmixing analysis. Linear unmixing analysis can be particularly
accurate for beverage 104 that includes an additive ingredient 110
having a color that is substantially different from a color of base
ingredient 106 (herein after a "high contrast additive
ingredient"). For example, linear unmixing analysis can be
particularly accurate for monitoring a dispensed cola beverage 104,
which contains an additive ingredient 110 syrup having a color
substantially different from a color of base ingredient 106, i.e.,
carbonated water.
[0122] Linear unmixing analysis can utilize measured optical data y
of the dispensed beverage 104 as well as calibrated optical data M
of the selected beverage 104 to quantitatively solve for an
estimated concentration c of additive ingredient 110 relative to
base ingredient 106 along with an associated error E of the linear
unmixing analysis. Linear unmixing analysis can involve using
calibrated optical data M collected from constituent ingredients of
the dispensed beverage 104 in a model to recreate measured optical
data y of the dispensed beverage 104 while minimizing error E
associated with the model. The linear unmixing analysis can be
performed on a per pixel basis.
[0123] In embodiments, the measured optical data y can be
decomposed optical data from the image of the dispensed beverage
104. Computer 600 can decompose the optical data from the image of
the dispensed beverage 104 into pixels. Decomposed optical data can
include RGB values contained within one more pixels of an image of
the dispense. For example:
y = ( R pix G pix B pix ) ##EQU00001##
[0124] Base ingredient 106 as used at least in reference to the
linear unmixing analysis can include base ingredient 106 with or
without supplemental base ingredient 108 (e.g., carbonation)
depending on the recipe for particular dispensed beverage 104. In
embodiments in which a recipe includes base ingredient 106 with
supplemental base ingredient 108 such as carbonation, the
calibrated optical data M includes supplemental base ingredient 108
such as carbonation mixed together with base ingredient 106 but
without additive ingredient 110.
[0125] Reference to additive ingredient 110 as used at least in
reference to the linear unmixing analysis can include one or more
additive ingredient 110 depending on the recipe for the particular
dispensed beverage 104. In embodiments in which a recipe includes
more than one additive ingredient 110, the calibrated optical data
M includes information of all additive ingredients required for the
beverage recipe dispensed together plus base ingredient 106.
[0126] The calibrated optical data M can be collected for each
beverage 104 that beverage dispenser 100 is configured to dispense.
The calibrated optical data M can be stored by computer 600 for use
in linear unmixing analysis. For example, in embodiments computer
600 can store calibrated optical data M.sub.1 for a first beverage
104a and calibrated optical data M.sub.2 for a second beverage
104b. The calibrated optical data M.sub.1 for first beverage 104a
and calibrated optical data M.sub.2 for second beverage 104b can be
different.
[0127] In embodiments, collecting the calibrated optical data M can
include independently dispensing additive ingredient 110 of
beverage 104 and base ingredient 106 of beverage 104. In
embodiments, calibrated optical data M can be collected only once
for each beverage 104.
[0128] In embodiments, calibrated optical data M can be collected
intermittently, for example after scheduled maintenance of beverage
dispenser 100 or after ingredient supplies are changed or
replenished.
[0129] Calibrated optical data M can include color values, such as
red, green, and blue (RGB) values, of additive ingredient 110 and
base ingredient 106. For example, computer 600 can determine the
average color values contained within the pixels of an image of the
independent dispense of additive ingredient 110 and average color
values contained within the pixels of an image of the independent
dispense of base ingredient 106. Calibrated optical data M can be a
matrix of the average color values of additive ingredient 110 and
base ingredient 106 for beverage 104. For example:
M = ( R add G add B add R base G base B base ) ##EQU00002##
where
( R add G add B add ) ##EQU00003##
represents the average RGB values contained within the pixels of an
image of the independent dispense of additive ingredient 110,
and
( R base G base B base ) ##EQU00004##
represents the average RGB values contained within pixels of an
image of the independent dispense of base ingredient 106.
[0130] Calibrated optical data M may be unique for each beverage
104 dispensed by beverage dispenser 100. In embodiments, calibrated
optical data M.sub.1 for first beverage 104a and calibrated optical
data M.sub.2 for second beverage 104b can be matrices of average
RGB color values. The average RGB color values for calibrated
optical data M.sub.1 for the first beverage 104a can be different
from the average RGB color values calibrated optical data M.sub.2
for second beverage 104b.
[0131] In embodiments, linear unmixing analysis can include
computer 600 quantitatively solving for an estimated concentration
c of additive ingredient 110 relative to base ingredient 106 while
minimizing associated error E using the equation [1].
y=Mc+E [1]
Estimated concentration c may be the characteristic of additive
ingredient 110 determined at step 503 of process 500.
[0132] FIGS. 6A and 6B illustrate heat maps of solutions to
equation [1] using an image of a dispensed beverage 104 (e.g.,
first beverage 104a) that matches beverage 104 selected at step
501, i.e., the selected beverage 104. FIG. 6A shows the estimated
concentration c on a per pixel basis of the selected beverage 104.
FIG. 6B shows the associated error E of the linear unmixing
analysis on a per pixel basis for the selected beverage 104.
[0133] When the selected beverage 104 (e.g., first beverage 104a)
is dispensed, computer 600 is able to solve equation [1] for
estimated concentration c of dispensed beverage 104 and with an
acceptable associated error E (e.g., within +/-5% of the measured
optical data y as shown in FIG. 6B) using optical data M.sub.1 for
first beverage 104a. In such embodiments, computer 600 may
determine that no dispense error occurred at step 504. FIGS. 6A and
6B demonstrate that linear unmixing analysis can quantitatively
estimate concentration c of dispensed beverage 104 with low
associated error using optical data M for the selected beverage
104.
[0134] FIGS. 7A and 7B illustrate heat maps of solutions to
equation [1] using an image of a dispensed beverage 104 (e.g.,
second beverage 104b) that does not match beverage 104 selected at
step 501, i.e., an unintended beverage 104. FIG. 7A shows the
estimated concentration c on a per pixel basis of the unintended
beverage 104. FIG. 7B shows the associated error E of the linear
unmixing analysis on a per pixel basis for the unintended beverage
104.
[0135] For the unintended beverage 104, computer 600 is able to
solve equation [1] for estimated concentration c of the dispensed
beverage 104 using the optical data M.sub.1 for the selected
beverage 104 (e.g., first beverage 104a). Nevertheless, the
associated error E required for the solution is unacceptable (e.g.,
outside a range of +/-5% of the measured optical data y, as shown
in FIG. 7B) because the optical data M.sub.1 for the selected
beverage (e.g. first beverage 104a) does not correspond to the
dispensed unintended beverage 104 (e.g., second beverage 104b). In
such embodiments, computer 600 may determine that a dispense error
occurred at step 504, since the associated error is unacceptable.
FIGS. 7A and 7B demonstrate that linear unmixing analysis can be
used to detect dispensing of an unintended beverage 104.
[0136] Morphological Analysis
[0137] In embodiments, steps 503 and 504 can include a
morphological analysis. Morphological analysis can be particularly
useful for beverage 104 having additive ingredient 110 with a color
that is substantially similar to a color of base ingredient 106
(herein after a "low contrast additive ingredient"). For example,
linear unmixing analysis can be particularly useful for monitoring
a dispensed lemon-flavored soft drink, which contains additive
ingredient 110 (i.e., syrup) having a color substantially similar
to a color of base ingredient 106 (i.e., carbonated water).
[0138] In embodiments, morphological analysis can be qualitative.
For example, morphological analysis can determine the presence or
absence of additive ingredient 110 in dispensed beverage 104.
[0139] In embodiments, morphological analysis can include measuring
an entropy (e.g., an optical entropy) of dispensed beverage 104.
The measured entropy can be the additive ingredient characteristic
determined at step 503. The entropy of dispensed beverage 104 can
be compared to an expected entropy. The expected entropy may be
experimentally determined from a correct dispense of each beverage
104 and may be stored by computer 600 for use in the morphological
analysis. If the measured entropy is outside of an acceptable range
(e.g., +/-5% of the expected entropy), computer 600 may determine
that there is a dispense error at step 504. The expected entropy
may be unique to each beverage 104.
[0140] Combined Linear Unmixing and Morphological Analysis
[0141] FIG. 8 shows a process 800 of determining whether there is a
dispense error using a combination of linear unmixing analysis and
morphological analysis. Process 800 can be a sub-process of process
500. For example, process 800 can be a sub-process of determining
whether there is a dispense error at step 504. Alternatively
process 800 can be performed independently from process 500.
[0142] Process 800 can be particularly useful for beverage
dispenser 100 embodiments that are configured to dispense more than
one beverage 104 including at least one beverage 104 having a high
contrast additive ingredient and at least one beverage 104 having a
low contrast additive ingredient. In such embodiments, linear
unmixing analysis alone may be insufficient for distinguishing
between certain types of dispense errors. For example, if selected
beverage 104 (e.g., cola) includes a high contrast additive
ingredient and an unintended beverage 104 (e.g., a lemon-flavored
soft drink) having a low contrast additive ingredient is dispensed,
linear unmixing analysis may solve equation [1] for a low estimated
concentration c of additive ingredient 110 of the selected beverage
104 (e.g., cola) and with low associate error E. In such
circumstances, linear unmixing analysis may determine that there is
a dispense error because the estimated concentration c is lower
than the expected concentration for selected beverage 104.
Nevertheless, linear unmixing analysis alone may not be able to
determine that the dispense error was actually the result of
dispensing an unintended beverage 104 (e.g., a lemon-flavored soft
drink) having a low contrast additive ingredient. In such
circumstances, process 800 may improve the diagnostic capability of
beverage dispenser 100 by determining the dispense error with
greater specificity.
[0143] Process 800 can include, at step 801, performing linear
unmixing analysis of the image of dispensed beverage 104 to
determine an estimated concentration c and an associated error E,
as previously described.
[0144] At step 802, the process 800 can include determining whether
associated error E of the linear unmixing analysis performed in
step 801 is acceptable (e.g., within a range of +/-5% of the
measured optical data y). If computer 600 determines that
associated error E required for the solution is unacceptable (e.g.,
outside a range of +/-5% of the measured optical data y), the
process may proceed to step 803 and determine that an unintended
beverage dispense error occurred, i.e., that a beverage 104 other
than the selected beverage 104 was dispensed from beverage
dispenser 100. In embodiments in which process 800 is a sub-process
of process 500, process 500 can proceed from step 504 to step 505
of process 500 and address the dispense error.
[0145] If computer 600 determines that the associated error E is
acceptable (e.g., within a range of +/-5% of the measured optical
data y), process 800 may proceed to step 804.
[0146] At step 804, process 800 can include evaluating whether
selected beverage 104 includes a low contrast additive ingredient.
A contrast classification of the additive ingredients for each
beverage 104 that beverage dispenser 100 is configured to dispense
may be stored in computer 600. The contrast classification may
classify each beverage 104 as a low contrast additive ingredient or
a high contrast additive ingredient. Step 804 can include computer
600 determining whether the selected beverage 104 includes a low
contrast additive ingredient based upon the classification. If it
is determined that the selected beverage 104 includes a low
contrast additive ingredient, the process 800 may proceed to step
807. If it is determined that the selected beverage 104 does not
include a low contrast ingredient, process 800 may proceed to step
805.
[0147] At step 805, process 800 can evaluate whether the estimated
concentration c is acceptable. Computer 600 may store a range of
acceptable concentrations of additive ingredient 110 for each
beverage 104 dispensed. Computer 600 may compare the estimated
concentration c to the range of acceptable concentrations of
additive ingredient 110 for the selected beverage 104. If computer
600 determines that the estimated concentration c is within the
range of acceptable concentrations of additive ingredient 110 for
the selected beverage 104, process 800 may proceed to step 810, at
which computer 600 may determine that there is no detected dispense
error. In embodiments in which process 800 is a sub-process of
process 500, process 500 can proceed from step 810 to step 501
restarting the process 500.
[0148] If computer 600 determines that the estimated concentration
c is outside of the range of acceptable concentrations of additive
ingredient 110 for the selected beverage 104, process 800 may
proceed to step 806 at which computer 600 may determine that there
is an additive ingredient dispense error. In embodiments, the
additive ingredient dispense error can be a determination that the
concentration of additive ingredient 110 is too low. In embodiments
in which process 800 is a sub-process of process 500, process 500
can proceed from step 806 to step 505 of process 500 and address
the dispense error.
[0149] Process 800 can include, at step 807, performing a
morphological analysis of the image of the dispensed beverage 104
to determine an entropy of the dispensed beverage 104, as
previously described.
[0150] At step 808, the process 800 can evaluate whether the
entropy of the dispensed beverage 104 determined at step 807 is
within a range of acceptable entropy values for selected beverage
104. The acceptable range may be +/-5% of the expected entropy of
the dispensed beverage 104. The range of acceptable entropy values
for each beverage 104 may be stored in computer 600. If computer
600 determines that the entropy is within the range of acceptable
entropy values for the selected beverage 104, the process 800 may
proceed to step 810.
[0151] If computer 600 determines that the entropy of dispensed
beverage 104 is outside of the range of acceptable entropy values
for the selected beverage 104, process 800 may proceed to step 809
at which computer 600 may determine that there is an additive
ingredient dispense error. In embodiments, the additive ingredient
dispense error can be a determination that the supply of additive
ingredient 110 is too low, e.g., that beverage dispenser 100 is
failing to supply additive ingredient 110. In embodiments in which
process 800 is a sub-process of process 500, process 500 can
proceed from step 809 to step 505 of process 500 and address the
dispense error.
[0152] Supplemental Base Ingredient Characteristic Analysis
[0153] In embodiments, computer 600 may analyze images of dispensed
beverage 104 to determine a supplemental base ingredient
characteristic. As discussed above, the supplemental base
ingredient characteristic may be the characteristic determined at
step 503 of process 500. For example, computer 600 may analyze
images of the dispensed beverage 104 to determine whether
carbonation is present or absent in the dispensed beverage 104.
[0154] In embodiments, computer 600 can analyze images of the
dispensed beverage 104 to detect edges of dispensed beverage 104.
Based upon the detected edges of dispensed beverage 104, computer
600 can determine whether carbonation is present or absent in
dispensed beverage 104. For example, the computer may analyze the
distance between detected edges of dispensed beverage 104, the
number of detected edges of dispensed beverage 104, the shape of
detected edges of dispensed beverage 104, or other characteristic
quality of detected edges of dispensed beverage 104.
[0155] In embodiments, computer 600 can analyze images of dispensed
beverage 104 to detect color of dispensed beverage 104. Based upon
the color (e.g., how light or dark dispensed beverage 104 is),
computer 600 can determine whether carbonation is present or absent
in dispensed beverage 104.
[0156] In embodiments, computer 600 can analyze images of dispensed
beverage 104 to detect the presence or absence of droplets outside
of the main body of dispensed beverage 104. Depending on whether
droplets are detected outside of the main body of dispensed
beverage 104, computer 600 can determine whether carbonation is
present or absent in dispensed beverage 104.
[0157] FIG. 9A shows images of two dispensed beverages 104. A
carbonated dispensed beverage 104c and a flat dispensed beverage
104d, i.e., a dispensed beverage 104 without carbonation. FIG. 9B
shows images of edges 128 of the carbonated dispensed beverage 104c
and edges 130 of the flat dispensed beverage 104d detected by
computer 600 from images shown in FIG. 9A. The detected edges can
be compared to expected edges for the selected beverage 104. The
expected edges may be beverage 104 specific and may be stored in
computer 600. If t the detected edges deviate significantly from
the expected edges for the selected beverage 104, computer 600 may
determine at dispense error occurred at step 504 of process 500,
e.g., that beverage dispenser 100 is failing to supply carbonation
to the dispensed beverage 104. If the detected edges of the
dispensed beverage 104 do not deviate significantly from the
expected edges, computer 600 may determine that there is no
detected carbonation dispense error (e.g., at step 504 of process
500).
Fill Level Analysis
[0158] In embodiments, computer 600 may analyze images taken from
camera 122 of beverage dispenser 100 to determine the fill level of
the dispensed beverage 104 in cup 112. Computer 600 may control
camera 122 to take a series of consecutive images as beverage 104
is dispensed into cup 112. Each image in the series of images may
be timestamped. Computer 600 may analyze the images, in real time,
and may detect an edge of the top of beverage 104 in each
image.
[0159] In embodiments of beverage dispenser 100 including camera
122 (e.g., second camera 122b) mounted with an at least partial
top-down view into cup 112, computer 600 may detect an edge of the
top of beverage 104 against the interior of cup 112.
[0160] In embodiments of beverage dispenser 100 having camera 122
(e.g., first camera 122a) with a side view of cup 112, computer 600
may detect an edge of the top of beverage 104 through cup 112 based
upon a change of color of light passing through cup 112.
[0161] For each image in the series of images, computer 600 may
determine the percent fill of cup 112 based upon measurements of
the detected edge of the top of beverage 104 and a detected edge of
the top of cup 112. Using the timestamps for the images and the
determined percent fill of cup 112 for each image, computer 600 can
estimate a rate of fill of cup 112. Based upon the rate of fill of
cup 112 and the determined percent fill of cup 112, computer 600
can anticipate when cup 112 will be full and can control beverage
dispenser 100 to terminate dispensing of beverage 104 to prevent
overfill of cup 112.
[0162] It is to be appreciated that the Detailed Description
section, and not the Summary and Abstract sections, is intended to
be used to interpret the claims. The Summary and Abstract sections
may set forth one or more but not all exemplary embodiments of the
present invention(s) as contemplated by the inventors, and thus,
are not intended to limit the present invention(s) and the appended
claims in any way.
[0163] The present invention has been described above with the aid
of functional building blocks illustrating the implementation of
specified functions and relationships thereof. The boundaries of
these functional building blocks have been arbitrarily defined
herein for the convenience of the description. Alternate boundaries
can be defined so long as the specified functions and relationships
thereof are appropriately performed.
[0164] The foregoing description of the specific embodiments will
so fully reveal the general nature of the invention(s) that others
can, by applying knowledge within the skill of the art, readily
modify or adapt for various applications such specific embodiments,
without undue experimentation, and without departing from the
general concept of the present invention(s). Therefore, such
adaptations and modifications are intended to be within the meaning
and range of equivalents of the disclosed embodiments, based on the
teaching and guidance presented herein. It is to be understood that
the phraseology or terminology herein is for the purpose of
description and not of limitation, such that the terminology or
phraseology of the present specification is to be interpreted by
the skilled artisan in light of the teachings and guidance
herein.
[0165] The breadth and scope of the present invention(s) should not
be limited by any of the above-described exemplary embodiments, but
should be defined only in accordance with the following claims and
their equivalents.
* * * * *