U.S. patent application number 14/610589 was filed with the patent office on 2016-03-10 for systems and method for monitoring an individual's compliance with a weight loss plan.
The applicant listed for this patent is Vision Service Plan. Invention is credited to Richard Chester Klosinski, JR., Meghan Kathleen Murphy, Jay William Sales, Matthew David Steen, Matthew Allen Workman.
Application Number | 20160071423 14/610589 |
Document ID | / |
Family ID | 55436366 |
Filed Date | 2016-03-10 |
United States Patent
Application |
20160071423 |
Kind Code |
A1 |
Sales; Jay William ; et
al. |
March 10, 2016 |
SYSTEMS AND METHOD FOR MONITORING AN INDIVIDUAL'S COMPLIANCE WITH A
WEIGHT LOSS PLAN
Abstract
A computer-implemented method, and related system, for
monitoring the wellbeing of an individual by providing eyewear that
includes at least one sensor for monitoring the motion of the user.
In various embodiments, the system receives data generated by the
at least one sensor, uses the data to determine the user's
movements using the received data, and compares the user's
movements to previously established movement patterns of the user.
If the system detects one or more inconsistencies between the
user's current movements as compared to the previously established
movement patterns of the user, the system may notify the user or a
third party of the detected one or more inconsistencies. The system
may similarly monitor a user's compliance with a medical regime and
notify the user or a third party of the user's compliance with the
regime.
Inventors: |
Sales; Jay William; (Citrus
Heights, CA) ; Klosinski, JR.; Richard Chester;
(Sacramento, CA) ; Workman; Matthew Allen;
(Sacramento, CA) ; Murphy; Meghan Kathleen;
(Davis, CA) ; Steen; Matthew David; (Sacramento,
CA) |
|
Applicant: |
Name |
City |
State |
Country |
Type |
Vision Service Plan |
Rancho Cordova |
CA |
US |
|
|
Family ID: |
55436366 |
Appl. No.: |
14/610589 |
Filed: |
January 30, 2015 |
Related U.S. Patent Documents
|
|
|
|
|
|
Application
Number |
Filing Date |
Patent Number |
|
|
62046406 |
Sep 5, 2014 |
|
|
|
Current U.S.
Class: |
434/127 |
Current CPC
Class: |
A61B 5/1176 20130101;
A61B 5/4266 20130101; G06K 9/00597 20130101; G06K 9/6201 20130101;
G08B 21/0476 20130101; A61B 5/1114 20130101; A61B 5/4884 20130101;
G16H 20/40 20180101; A61B 5/117 20130101; G06K 9/00664 20130101;
A61B 5/4076 20130101; G06K 9/00348 20130101; G02C 11/10 20130101;
G06K 9/00617 20130101; G16H 40/63 20180101; G08B 21/02 20130101;
G09B 5/00 20130101; G16H 50/20 20180101; A61B 5/0002 20130101; A61B
5/0816 20130101; A61F 2002/7695 20130101; A61B 2576/00 20130101;
A61F 2/76 20130101; A61B 5/0077 20130101; A61B 5/112 20130101; A61B
5/1032 20130101; A61B 2562/0219 20130101; H04L 63/0861 20130101;
A61B 5/0022 20130101; A61B 5/0476 20130101; A61B 3/112 20130101;
A61B 5/7246 20130101; A61B 5/14552 20130101; A61B 5/7282 20130101;
G07C 9/37 20200101; G08B 21/0461 20130101; A61B 5/0402 20130101;
G16H 40/67 20180101; A61B 2560/0475 20130101; A61B 5/165 20130101;
G09B 5/06 20130101; A63B 24/0062 20130101; G06K 9/00604 20130101;
G06F 21/35 20130101; A61B 5/0205 20130101; A61B 5/0531 20130101;
A61B 5/1118 20130101; A61B 2562/0223 20130101; A61B 5/1116
20130101; A61B 5/7278 20130101; A61B 2562/0257 20130101; G08B
21/0423 20130101; A61B 5/443 20130101; A61B 5/486 20130101; A61B
7/04 20130101; A61B 5/024 20130101; A61B 5/6803 20130101; G09B
19/0092 20130101; A61B 5/1103 20130101; A61B 5/1128 20130101 |
International
Class: |
G09B 5/06 20060101
G09B005/06; A63B 24/00 20060101 A63B024/00; G09B 19/00 20060101
G09B019/00 |
Claims
1. A computer-implemented method of monitoring compliance with a
weight loss plan by a wearer of computerized eyewear, the method
comprising: a. receiving, by at least one processor, at least one
signal generated by one or more sensors operatively coupled to the
computerized eyewear; b. at least partially in response to
receiving the at least one signal from the one or more sensors,
determining, by at least one processor, an identity of a food that
the wearer is preparing to ingest based on the received at least
one signal generated by the one or more sensors; c. determining, by
at least one processor, a quantity of the food that the wearer is
preparing to ingest based on the received at least one signal
generated by the one or more sensors; d. tracking, by at least one
processor, the identity and the quantity of the food that the
wearer is preparing to ingest; e. comparing, by at least one
processor, the identity and the quantity of the food that the
wearer is preparing to ingest to a predetermined weight loss plan;
and f. at least partially in response to comparing the identity and
the quantity of the food to the predetermined weight loss plan, at
least one of: i. updating, by at least one processor, a database to
indicate whether the wearer is compliant with the weight loss plan;
ii. calculating, by at least one processor, one or more
recommendations for the wearer associated with the wearer's
compliance with the weight loss plan; iii. notifying, by at least
one processor, the wearer of the wearer's compliance with the
weight loss plan; iv. notifying, by at least one processor, a
third-party of the wearer's compliance with the weight loss plan;
v. sending, by at least one processor, an alert to the wearer; or
vi. sending, by at least one processor, an alert to the wearer
regarding the calculated one or more recommendations.
2. The computer-implemented method of claim 1, wherein the one or
more sensors comprises at least one sensor selected from a group
consisting of: a. a forward facing camera; b. a global positioning
system unit; c. an olfactory sensor; and d. a microphone.
3. The computer-implemented method of claim 1, wherein determining
the identity of the food further comprises: a. capturing, by at
least one processor, an image by a forward facing camera of a
packaging associated with the food; b. at least partially in
response to capturing the image, detecting, by at least one
processor, a barcode contained on the packaging; and c. searching,
by at least one processor, a database of barcodes to determine a
nutritional value associated with the food.
4. The computer-implemented method of claim 3, wherein determining
a quantity of the food further comprises, at least partially in
response to capturing the image, estimating, by at least one
processor, the quantity of food selected by the wearer.
5. The computer-implemented method of claim 3, wherein determining
a quantity of the food further comprises: a. detecting, by at least
one processor, in the captured image a vessel used by the wearer to
measure the quantity of the food that the wearer is preparing to
ingest; and b. detecting, by at least one processor, at least one
marking on the vessel that indicates the quantity of the food
placed in the vessel.
6. The computer-implemented method of claim 3, wherein determining
a quantity of the food further comprises: a. receiving, by at least
one processor, a signal from a measuring device that is used by the
wearer to measure the quantity of the food; and b. at least
partially in response to receiving the signal from the measuring
device, determining, by at least one processor, the quantity of the
food.
7. The computer-implemented method of claim 6, wherein the
measuring device is a wireless scale.
8. The computer-implemented method of claim 1, wherein tracking the
identity and the quantity of the food that the wearer is preparing
to ingest further comprises: a. determining, by at least one
processor, a date and a time that the wearer ingests the food; b.
calculating, by at least one processor, a number of calories
associated with the food; c. determining, by at least one
processor, a nutritional value associated with the food; and d.
storing the date and time that the wearer ingests the food, the
number of calories associated with the food and the nutritional
value associated with the food in memory operatively coupled to the
computerized eyewear.
9. The computer-implemented method of claim 1, wherein the
predetermined weight loss plan further comprises one or more values
selected from a group consisting of: a. a total daily calorie
intake value; b. a total daily fat intake value; c. a total daily
protein intake value; d. a total daily carbohydrate intake value;
e. one or more prohibited foods; f. one or more prohibited
nutrients; g. a weekly weight loss value; h. a total daily calorie
burned value; i. a total daily amount of sleep value; and j. one or
more daily physical activities
10. The computer-implemented method of claim 9, further comprising:
a. at least partially in response to comparing the identity and the
quantity of the food that the wearer is preparing to ingest to a
predetermined weight loss plan, calculating, by at least one
processor, one or more recommendations to assist the wearer in
complying with the predetermined weight loss plan; and b.
notifying, by at least one processor, the wearer of the one or more
recommendations.
11. The computer-implemented method of claim 10, wherein
calculating one or more recommendations to assist the wearer in
complying with the predetermined weight loss plan further
comprises: a. determining, by at least one processor, one or more
physical activity recommendations; b. accessing, by at least one
processor, one or more daily caloric intake recommendations; c.
comparing, by at least one processor, the one or more physical
activity recommendations to the one or more daily caloric intake
recommendations; d. at least partially in response to comparing the
one or more physical activity recommendations to the one or more
daily caloric intake recommendations, calculating, by at least one
processor, a recommended combination of at least one physical
activity recommendation and at least one daily caloric intake
recommendation to assist the wearer in complying with the
predetermined weight loss plan; and e. notifying, by at least one
processor, the wearer of the recommended combination of the at
least one physical activity recommendation and the at least one
daily caloric intake recommendation.
12. The computer-implemented method of claim 2, wherein the at
least one signal generated by one or more sensors is an audio
signal received by the microphone, the method further comprising:
a. converting, by at least one processor, the audio signals to text
using speech recognition techniques; b. at least partially based on
the converted text, searching, by at least one processor, a
database of food items using the text; and c. matching, by at least
one processor, the converted text to at least one food item in the
database of food items to identify the food item the wearer is
preparing to ingest.
13. The computer-implemented method of claim 2, further comprising:
a. receiving, by at least one processor, a signal from the global
positioning system unit; b. determining, by at least one processor,
the location of the wearer at least partially based on the received
signal; and c. using, by at least one processor, the location of
the wearer in determining the identity of the food that the wearer
is preparing to ingest.
14. A system for monitoring compliance with a weight loss plan by a
wearer of computerized eyewear, comprising: a. one or more
processors; b. memory operatively coupled to the one or more
processors; wherein the one or more processors is configured to: i.
receive at least one signal generated by one or more sensors
operatively coupled to the computerized eyewear; ii. at least
partially in response to receiving the at least one signal from the
one or more sensors, determine an identity of a food that the
wearer is preparing to ingest; iii. determine a quantity of the
food that the wearer is preparing to ingest; iv. track the identity
and the quantity of the food that the wearer is preparing to
ingest; v. identify the date and time that the food is ingested by
the wearer; vi. compare the identity and the quantity of the food
that the wearer ingests to a predetermined weight loss plan; and
vii. at least partially in response to comparing the identity and
the quantity of the food to the predetermined weight loss plan, at
least one of: (a) update a database to indicate whether the wearer
is compliant with the weight loss plan; (b) calculate one or more
recommendations for the wearer associated with the wearer's
compliance with the weight loss plan; (c) notify the wearer of the
wearer's compliance with the weight loss plan; (d) notify a
third-party of the wearer's compliance with the weight loss plan;
(e) send an alert to the wearer; or (f) send an alert to the wearer
regarding the calculated one or more recommendations.
15. The system of claim 14, wherein the one or more sensors
comprises at least one sensor selected from a group consisting of:
a. a forward facing camera; b. a global positioning system unit; c.
an olfactory sensor; and d. a microphone.
16. The system of claim 14, wherein the one or more processors is
further configured to: a. receive a signal from a global
positioning system unit; b. determine the location of the wearer at
least partially based on the received signal; and c. use the
location of the wearer to determine the identity of the food that
the wearer is preparing to ingest.
17. The system of claim 14, wherein the one or more processors is
further configured to: a. capture one or more images by a
forward-facing camera of medicine ingested by the wearer; b. detect
one or more pills in the one or more images; c. compare the one or
more detected pills found in the one or more images to one or more
known images of pills stored in memory; d. at least partially in
response to comparing the one or more detected pills to one or more
known images of pills stored in memory, determine data selected
from a group consisting of one or more: i. types of medicine taken
by the user; ii. times the medicine is taken by the user; and iii.
doses of medicine taken by the user; e. determine, at least
partially based on the data, if the medicine ingested by the wearer
causes a side effect that can affect the wearer's ability to lose
weight; and f. notify either the wearer or a third party of the
side effect.
18. The system of claim 17, wherein the one or more processors is
further configured to: a. detect, by a processor, a level of one or
more medicines in the wearer's bloodstream based on a signal
received from a blood testing sensor operatively coupled to the
system; b. compare the level of the one or medicines in the user's
bloodstream to a predefined level for each of the one or more
medicines stored in a database for the wearer; and c. at least
partially in response to comparing the level of the one or
medicines in the wearer's bloodstream, notify one of the wearer or
the third party when the level of the one or more medicines is
below the predefined level for each of the one or more
medicines.
19. The system of claim 18, wherein the one or more medicines is
selected from a group consisting of: a. a prescription drug; b. a
nutritional supplement; c. a prescription weight loss drug; and d.
an over-the-counter weight loss drug.
20. A computer-implemented method of monitoring compliance with a
weight loss plan by a wearer of computerized eyewear, the method
comprising: a. receiving, by at least one processor, at least one
signal generated by one or more sensors operatively coupled to the
computerized eyewear; b. at least partially in response to
receiving the at least one signal from the one or more sensors,
determining, by at least one processor, an identity of a food that
the wearer is preparing to ingest; c. determining, by at least one
processor, a quantity of the food that the wearer is preparing to
ingest; d. comparing, by at least one processor, the identity and
the quantity of the food that the wearer is preparing to ingest to
a predetermined weight loss plan; e. at least partially in response
to comparing the identity and the quantity of the food that the
wearer is preparing to ingest to the predetermined weight loss
plan, calculating, by at least one processor, one or more
recommendations to assist the wearer in complying with the
predetermined weight loss plan; and f. notifying, by at least one
processor, the wearer of the one or more recommendations.
21. The computer-implemented method of claim 20, wherein the one or
more sensors comprises at least one sensor selected from a group
consisting of: a. a forward facing camera; b. a global positioning
system unit; c. an olfactory sensor; and d. a microphone.
22. The computer-implemented method of claim 21, wherein
determining the identity of the food further comprises: a.
capturing, by at least one processor, an image by the forward
facing camera of a packaging associated with the food; b. at least
partially in response to capturing the image, detecting, by at
least one processor, a barcode contained on the packaging; and c.
searching, by at least one processor, a database of barcodes to
determine the nutritional value associated with the food.
23. The computer-implemented method of claim 22, wherein
determining a quantity of the food further comprises: a. detecting,
by at least one processor, in the captured image a vessel used by
the wearer to measure the quantity of the food that the wearer is
preparing to ingest; and b. detecting, by at least one processor,
at least one marking on the vessel that indicates the quantity of
the food placed in the vessel.
24. The computer-implemented method of claim 20, wherein the
predetermined weight loss plan further comprises one or more values
selected from a group consisting of: a. a total daily calorie
intake value; b. a total daily fat intake value; c. a total daily
protein intake value; d. a total daily carbohydrate intake value;
e. one or more prohibited foods; f. one or more prohibited
nutrients; g. a weekly weight loss value; h. a total daily amount
of sleep value; i. a total daily calorie burned value; and j. one
or more daily physical activities.
25. The computer-implemented method of claim 24, wherein
calculating one or more recommendations to assist the wearer in
complying with the predetermined weight loss plan further
comprises: a. determining, by at least one processor, one or more
physical activity recommendations; b. determining, by at least one
processor, one or more daily caloric intake recommendations; c. at
least partially in response to determining the one or more physical
activity recommendations and the one or more daily caloric intake
recommendations, calculating, by at least one processor, a
recommended combination of at least one physical activity
recommendation and at least one daily caloric intake
recommendation; and d. notifying, by at least one processor, the
wearer of the recommended combination of the at least one physical
activity recommendation and the at least one daily caloric intake
recommendation to assist the wearer in complying with the
predetermined weight loss plan.
26. The computer-implemented method of claim 24, wherein
calculating one or more recommendations to assist the wearer in
complying with the predetermined weight loss plan further
comprises: a. determining, by at least one processor, one or more
total daily amounts of sleep recommendations; b. determining, by at
least one processor, one or more daily caloric intake
recommendations; c. comparing, by at least one processor, the one
or more total daily amounts of sleep recommendations to the one or
more daily caloric intake recommendations; d. at least partially in
response to comparing the one or more total daily amounts of sleep
recommendations to the one or more daily caloric intake
recommendations, calculating, by at least one processor, a
recommended combination of at least one total daily amount of sleep
recommendation and at least one daily caloric intake
recommendation; and e. notifying, by at least one processor, the
wearer of the recommended combination of the at least one total
daily amount of sleep recommendation and the at least one daily
caloric intake recommendation to assist the wearer in complying
with the predetermined weight loss plan.
Description
CROSS-REFERENCE TO RELATED APPLICATION
[0001] This application claims the benefit of U.S. Provisional
Patent Application No. 62/046,406, filed Sep. 5, 2014, and
entitled, "Wearable Health Computer Apparatus, Systems, and Related
Methods," which is hereby incorporated herein by reference in its
entirety.
BACKGROUND
[0002] Public health officials concur that Americans are not
adhering to current healthful lifestyle recommendations. Only one
in five of the US population follows recommendations for fruit and
vegetable consumption. Only one in four adheres to the
recommendations for exercise, and three of four adhere to
recommendations not to smoke. Possibly, the most telling statistic
is that only three of every 100 US adults follow all
recommendations to consume five fruits and vegetables daily, get
regular physical activity, maintain a healthy weight, and not
smoke.
[0003] Being able to monitor an individual's compliance with weight
loss recommendations is advantageous for the individual, for health
care providers and for insurance companies. Accordingly, there is a
need for improved systems and methods for monitoring an
individual's compliance with a weight loss regime. Various
embodiments of the present systems and methods recognize and
address the foregoing considerations, and others, of prior art
systems and methods.
SUMMARY OF THE VARIOUS EMBODIMENTS
[0004] A computer-implemented method of monitoring compliance with
a weight loss plan by a wearer of computerized eyewear, the method
comprising (1) receiving, by at least one processor, at least one
signal generated by one or more sensors operatively coupled to the
computerized eyewear; (2) at least partially in response to
receiving the at least one signal from the one or more sensors,
determining, by at least one processor, an identity of a food that
the wearer is preparing to ingest; (3) determining, by at least one
processor, a quantity of the food that the wearer is preparing to
ingest; (4) tracking, by at least one processor, the identity and
the quantity of the food that the wearer is preparing to ingest;
and (5) comparing, by at least one processor, the identity and the
quantity of the food that the wearer is preparing to ingest to a
predetermined weight loss plan. In various embodiments, determining
the identity of the food further comprises capturing an image by
the forward facing camera of a packaging associated with the food,
at least partially in response to capturing the image, detecting a
barcode contained on the packaging, and searching a database of
barcodes to determine the nutritional value associated with the
food. In other embodiments, determining a quantity of the food
further comprises detecting in the captured image a vessel used by
the wearer to measure the quantity of the food that the wearer is
preparing to ingest, and detecting at least one marking on the
vessel that indicates the quantity of the food placed in the
vessel.
[0005] A system for monitoring compliance with a weight loss plan
by a wearer of computerized eyewear comprises one or more
processors and memory operatively coupled to the one or more
processors. In various embodiments, the one or more processors is
configured to (1) receive at least one signal generated by one or
more sensors operatively coupled to the computerized eyewear; (2)
at least partially in response to receiving the at least one signal
from the one or more sensors, determine an identity of a food that
the wearer is preparing to ingest; (3) determine a quantity of the
food that the wearer is preparing to ingest; (4) track the identity
and the quantity of the food that the wearer is preparing to
ingest; (5) identify the date and time that the food is ingested by
the wearer; and (6) compare the identity and the quantity of the
food that the wearer ingests to a predetermined dietary plan.
[0006] A computer-implemented method of monitoring compliance with
a weight loss plan by a wearer of computerized eyewear comprising
the steps of (1) receiving, by at least one processor, at least one
signal generated by one or more sensors operatively coupled to the
computerized eyewear; (2) at least partially in response to
receiving the at least one signal from the one or more sensors,
determining, by at least one processor, an identity of a food that
the wearer is preparing to ingest; (3) determining, by at least one
processor, a quantity of the food that the wearer is preparing to
ingest; (4) comparing, by at least one processor, the identity and
the quantity of the food that the wearer is preparing to ingest to
a predetermined weight loss plan; (5) at least partially in
response to comparing the identity and the quantity of the food
that the wearer is preparing to ingest to a predetermined dietary
plan, calculating, by at least one processor, one or more
recommendations to assist the wearer in complying with the
predetermined dietary plan; and (6) notifying, by at least one
processor, the wearer of the one or more recommendations.
BRIEF DESCRIPTION OF THE DRAWINGS
[0007] Various embodiments of systems and methods for monitoring an
individual's compliance with a weight loss plan are described
below. In the course of this description, reference will be made to
the accompanying drawings, which are not necessarily drawn to scale
and wherein:
[0008] FIG. 1 is a block diagram of a weight loss compliance system
in accordance with an embodiment of the present system.
[0009] FIG. 2 is a block diagram of the compliance server of FIG.
1.
[0010] FIG. 3 is an exemplary wearable health monitoring device for
use in the weight loss compliance system of FIG. 1
[0011] FIG. 4 illustrates a flowchart that generally illustrates
various steps executed by a Weight Loss Compliance Module according
to a particular embodiment.
DETAILED DESCRIPTION OF SOME EMBODIMENTS
[0012] Various embodiments will now be described more fully
hereinafter with reference to the accompanying drawings. It should
be understood that the invention may be embodied in many different
forms and should not be construed as limited to the embodiments set
forth herein. Rather, these embodiments are provided so that this
disclosure will be thorough and complete, and will fully convey the
scope of the invention to those skilled in the art. Like numbers
refer to like elements throughout.
Overview
[0013] A weight loss compliance system, according to various
embodiments, may include a suitable wearable device that is
configured to monitor one or more of a wearer's (e.g., a user) food
consumption, physical activities, sleep patterns, and/or compliance
with a medicine regime (e.g., weight loss medicine/supplement). In
particular embodiments, the system is configured to gather data,
for example, using one or more sensors, about the wearer (e.g.,
such as the wearer's body temperature, heart rate, level of
physical activity, geographic location, distance traveled, diet
(e.g., food consumed, calories for each meal, total calories,
etc.), compliance with a prescribed medical regimen (e.g.,
medications recently taken, dose, side effects), sleeping patterns
(e.g., hours slept, type of sleep, quality of sleep), etc.). In
various embodiments, the system is configured to, for example: (1)
identify a food and quantity of the food that the wearer is
preparing to ingest; (2) track the identity and the quantity of
food (e.g., the nutritional value, the calories associated with the
food, the date and time the food is ingested, etc.); (3) compare
the identity and quantity of the food to a predetermined weight
loss plan (e.g., a dietary plan); (4) calculate one or more
recommendations to assist the wearer in complying with the
predetermined weight loss plan; and/or (5) notify the wearer of the
one or more recommendations.
[0014] In particular embodiments, the wearable device is adapted to
facilitate the transmission of the data captured by the one or more
sensors to a remote computing device (e.g., a handheld computing
device, a central server, or any other suitable smart device that
may, in various embodiments, contain a wireless communications
device that can connect to the wearable computing device) that
analyzes the information to determine whether the wearer is
complying with the predetermined weight loss plan (e.g., a dietary
plan, an exercise plan, a medicine plan, a sleep plan, or a
combination of one or more of the proceeding). As the system tracks
the wearer's food intake (e.g., calories, nutritional values,
etc.), physical activities, sleep patterns, and/or medicine intake,
the system may provide the wearer feedback, warnings, and/or
recommendations on (1) how to better comply with the weight plan
(e.g., eat more green vegetables or fruit, don't eat fast food, you
should eat smaller portions, etc.), (2) how a particular food or
quantity will impact the weight loss plan (e.g., if you eat this,
you must perform a particular physical activity to offset the
calories, etc.), and/or (3) how a medicine can impact the wearer's
ability to lose weight (e.g., a particular side effect of the
medicine is weight gain/loss, etc.).
[0015] Suitable wearable devices may include, for example: (1) a
pair of eyewear (e.g., goggles or eyeglasses); (2) one or more
contact lenses; (3) a wristwatch; (4) an article of clothing (e.g.,
such as a suitable shirt, pair of pants, undergarment, compression
sleeve, etc.); (5) footwear; (6) a hat; (7) a helmet; (8) an
adhesive strip or other tag that may be selectively attached to an
individual or the individual's clothing; (9) a computing device
that is embedded into a portion of an individual's body (e.g.,
under the individual's skin, or within a medical device, such as a
pacemaker); (10) an orthopedic cast; or (11) any other suitable
wearable item.
[0016] In various embodiments, the wearable device comprises one or
more sensors that are configured to sense the wearer's food intake,
physical activities, sleep patterns, and medicine intake (e.g.,
prescription weight loss drugs, over-the-counter weight loss drugs,
nutritional supplements, prescription drugs, etc.). The one or more
sensors may include, for example: (1) one or more forward facing
cameras; (2) one or more global positioning sensors; (3), one or
more olfactory sensors; (4) one or more pedometers; (5) one or more
microphones; (6) one or more accelerometers; (7) one or more blood
pressure sensors; (8) one or more pulse oximeters; (9) one or more
respiratory rate sensors; (10) one or more near-field communication
chips; (11) one or more gyroscopes; (12) one or more geomagnetic
sensors; (13) one or more global positioning system chips; and/or
(14) any other suitable one or more sensors.
[0017] In a particular implementation, the system's wearable device
includes a pair of computerized eyewear that comprises the one or
more sensors for monitoring the wearer's compliance with a weight
loss plan. In particular embodiments, the one or more sensors are
coupled to (e.g., connected to, embedded in, etc.) the pair of
glasses, which may be, for example, a pair of computerized or
non-computerized eyeglasses. In particular embodiments, the wearer
is a person trying to lose weight, become more physically active,
under orders of a doctor to lose weight for medical reasons or any
other person trying to live a more active and healthy life.
Exemplary Technical Platforms
[0018] As will be appreciated by one skilled in the relevant field,
the present systems and methods may be, for example, embodied as a
computer system, a method, or a computer program product.
Accordingly, various embodiments may be entirely hardware, entirely
software, or a combination of hardware and software. Furthermore,
particular embodiments may take the form of a computer program
product stored on a computer-readable storage medium having
computer-readable instructions (e.g., software) embodied in the
storage medium. Various embodiments may also take the form of
Internet-implemented computer software. Any suitable
computer-readable storage medium may be utilized including, for
example, hard disks, compact disks, DVDs, optical storage devices,
and/or magnetic storage devices.
[0019] Various embodiments are described below with reference to
block diagram and flowchart illustrations of methods, apparatuses,
(e.g., systems), and computer program products. It should be
understood that each block of the block diagrams and flowchart
illustrations, and combinations of blocks in the block diagrams and
flowchart illustrations, respectively, can be implemented by a
computer executing computer program instructions. These computer
program instructions may be loaded onto a general purpose computer,
a special purpose computer, or other programmable data processing
apparatus that can direct a computer or other programmable data
processing apparatus to function in a particular manner such that
the instructions stored in the computer-readable memory produce an
article of manufacture that is configured for implementing the
functions specified in the flowchart block or blocks.
[0020] The computer instructions may execute entirely on the user's
computer, partly on the user's computer, as a stand-alone software
package, partly on a user's computer and partly on a remote
computer, or entirely on the remote computer or server. In the
latter scenario, the remote computer may be connected to the user's
computer through any type of network, including but not limited to:
(1) a local area network (LAN); (2) a wide area network (WAN); (3)
a cellular network; or (4) the connection may be made to an
external computer (for example, through the Internet using an
Internet Service Provider).
[0021] These computer program instructions may also be stored in a
computer-readable memory that can direct a computer or other
programmable data processing apparatus to function in a particular
manner such that the instructions stored in the computer-readable
memory produce an article of manufacture that is configured for
implementing the function specified in the flowchart block or
blocks. The computer program instructions may also be loaded onto a
computer or other programmable data processing apparatus to cause a
series of operational steps to be performed on the computer or
other programmable apparatus to produce a computer-implemented
process (e.g., method) such that the instructions that execute on
the computer or other programmable apparatus provide steps for
implementing the functions specified in the flowchart block or
blocks.
Example System Architecture
[0022] FIG. 1 is a block diagram of a weight loss compliance system
100 according to particular embodiments. As may be understood from
this figure, the weight loss compliance system 100 includes one or
more networks 115, one or more third party servers 50, a compliance
server 120 that includes a weight loss compliance module 400, a
dietary information database 140, an exercise information database
142, a medicine database 144, a sleep information database 146, one
or more remote computing devices 154 (e.g., such as a smart phone,
a tablet computer, a wearable computing device, a laptop computer,
a desktop computer, a Bluetooth device, an automated dialing
apparatus, etc.), and one or more health monitoring devices 156,
which may, for example, be embodied as one or more of eyewear,
headwear, clothing, a watch, a hat, a helmet, a cast, an adhesive
bandage, a piece of jewelry (e.g., a ring, earring, necklace,
bracelet, etc.), or any other suitable wearable device. In
particular embodiments, the one or more computer networks 115
facilitate communication between the one or more third party
servers 50, the compliance server 120, the dietary information
database 140, the exercise information database 142, the medicine
database 144, the sleep information database 146, the one or more
remote computing devices 154, and/or the one or more health
monitoring devices 156.
[0023] The one or more networks 115 may include any of a variety of
types of wired or wireless computer networks such as the Internet,
a private intranet, a mesh network, a public switch telephone
network (PSTN), or any other type of network (e.g., a network that
uses Bluetooth or near field communications to facilitate
communication between computing devices). The communication link
between the one or more remote computing devices 154 and the
compliance server 120 may be, for example, implemented via a Local
Area Network (LAN) or via the Internet.
[0024] FIG. 2 illustrates a diagrammatic representation of the
architecture for the compliance server 120 that may be used within
the weight loss compliance system 100. It should be understood that
the computer architecture shown in FIG. 2 may also represent the
computer architecture for any one of the one or more remote
computing devices 154, one or more third party servers 50, and one
or more health monitoring devices 156, shown in FIG. 1. In
particular embodiments, the compliance server 120 may be suitable
for use as a computer within the context of the weight loss
compliance system 100 that is configured for monitoring the
compliance of the wearer with a weight loss plan (e.g., food
intake, physical activities, sleeping habits and medicine regimes,
etc.).
[0025] In particular embodiments, the compliance server 120 may be
connected (e.g., networked) to other computing devices in a LAN, an
intranet, an extranet, and/or the Internet as shown in FIG. 1. As
noted above, the compliance server 120 may operate in the capacity
of a server or a client computing device in a client-server network
environment, or as a peer computing device in a peer-to-peer (or
distributed) network environment. The compliance server 120 may be
a desktop personal computing device (PC), a tablet PC, a set-top
box (STB), a Personal Digital Assistant (PDA), a cellular
telephone, a web appliance, a network router, a switch or bridge,
or any other computing device capable of executing a set of
instructions (sequential or otherwise) that specify actions to be
taken by that computing device. Further, while only a single
computing device is illustrated, the term "computing device" shall
also be interpreted to include any collection of computing devices
that individually or jointly execute a set (or multiple sets) of
instructions to perform any one or more of the methodologies
discussed herein.
[0026] An exemplary compliance server 120 includes a processing
device 202, a main memory 204 (e.g., read-only memory (ROM), flash
memory, dynamic random access memory (DRAM) such as synchronous
DRAM (SDRAM) or Rambus DRAM (RDRAM), etc.), a static memory 206
(e.g., flash memory, static random access memory (SRAM), etc.), and
a data storage device 218, which communicate with each other via a
bus 232.
[0027] The processing device 202 represents one or more
general-purpose or specific processing devices such as a
microprocessor, a central processing unit (CPU), or the like. More
particularly, the processing device 202 may be a complex
instruction set computing (CISC) microprocessor, reduced
instruction set computing (RISC) microprocessor, very long
instruction word (VLIW) microprocessor, or processor implementing
other instruction sets, or processors implementing a combination of
instruction sets. The processing device 202 may also be one or more
special-purpose processing devices such as an application specific
integrated circuit (ASIC), a field programmable gate array (FPGA),
a digital signal processor (DSP), network processor, or the like.
The processing device 202 may be configured to execute processing
logic 226 for performing various operations and steps discussed
herein.
[0028] The compliance server 120 may further include a network
interface device 208. The compliance server 120 may also include a
video display unit 210 (e.g., a liquid crystal display (LCD) or a
cathode ray tube (CRT)), an alpha-numeric input device 212 (e.g., a
keyboard), a cursor control device 214 (e.g., a mouse), and a
signal generation device 216 (e.g., a speaker).
[0029] The data storage device 218 may include a non-transitory
computing device-accessible storage medium 230 (also known as a
non-transitory computing device-readable storage medium or a
non-transitory computing device-readable medium) on which is stored
one or more sets of instructions (e.g., the weight loss compliance
module 400) embodying any one or more of the methodologies or
functions described herein. The one or more sets of instructions
may also reside, completely or at least partially, within the main
memory 204 and/or within the processing device 202 during execution
thereof by the compliance server 120--the main memory 204 and the
processing device 202 also constituting computing device-accessible
storage media. The one or more sets of instructions may further be
transmitted or received over a network 115 via a network interface
device 208.
[0030] While the computing device-accessible storage medium 230 is
shown in an exemplary embodiment to be a single medium, the term
"computing device-accessible storage medium" should be understood
to include a single medium or multiple media (e.g., a centralized
or distributed database, and/or associated caches and servers) that
store the one or more sets of instructions. The term "computing
device-accessible storage medium" should also be understood to
include any medium that is capable of storing, encoding, or
carrying a set of instructions for execution by the computing
device and that causes the computing device to include any one or
more of the methodologies of the present invention. The term
"computing device-accessible storage medium" should accordingly be
understood to include, but not be limited to, solid-state memories,
optical and magnetic media, etc.
Structure of the Eyewear
[0031] As shown in FIG. 3, eyewear 300, according to various
embodiments, includes: (1) an eyewear frame 310; (2) a first temple
312; and (3) a second temple 314, as described below.
[0032] Eyewear Frame
[0033] Referring still to FIG. 3, eyewear 300, in various
embodiments, includes any suitable eyewear frame 310 configured to
support one or more lenses 318, 320. In the embodiment shown in
this figure, the eyewear frame 310 has a first end 302 and a second
end 304. The eyewear frame 310 may be made of any suitable material
such as metal, ceramic, polymers or any combination thereof. In
particular embodiments, the eyewear frame 310 is configured to
support the first and second lenses 318, 320 about the full
perimeter of the first and second lenses 318, 320. In other
embodiments, the eyewear frame 310 may be configured to support the
first and second lenses 318, 320 about only a portion of each
respective lens. In various embodiments, the eyewear frame 310 is
configured to support a number of lenses other than two lenses
(e.g., a single lens, a plurality of lenses, etc.). In particular
embodiments, the lenses 318, 320 may include prescription lenses,
sunglass lenses, or any other suitable type of lens (e.g., reading
lenses, non-prescription lenses), which may be formed from glass or
polymers.
[0034] The eyewear frame 310 includes a first and second nose pad
322 (not shown in figures), 324, which may be configured to
maintain the eyewear 300 adjacent the front of a wearer's face such
that the lenses 318, 320 are positioned substantially in front of
the wearer's eyes while the wearer is wearing the eyewear 300. In
particular embodiments, the nose pads 322, 324 may comprise a
material that is configured to be comfortable when worn by the
wearer (e.g., rubber, etc.). In other embodiments, the nose pads
may include any other suitable material (e.g., plastic, metal,
etc.). In still other embodiments, the nose pads may be integrally
formed with the frame 310.
[0035] The eyewear frame 310 includes a first and second hinge 326,
328 that attach the first and second temples 312, 314 to the frame
first and second ends 302, 304, respectively. In various
embodiments, the hinges may be formed by any suitable connection
(e.g., tongue and groove, ball and socket, spring hinge, etc.). In
particular embodiments, the first hinge 326 may be welded to, or
integrally formed with, the frame 310 and the first temple 312 and
the second hinge 328 may be welded to, or integrally formed with,
the frame 310 and the second temple 314.
[0036] First and Second Temples
[0037] Still referring to FIG. 4, the first temple 312, according
to various embodiments, is rotatably connected to the frame 310 at
a right angle to extend the first temple 312 substantially
perpendicular, substantially parallel, or anywhere in between the
right angle to the frame 310. The first temple 312 has a first and
second end 312a, 312b. Proximate the first temple second end 312b,
the first temple 312 includes an earpiece 313 configured to be
supported by a wearer's ear. Similarly, the second temple 314,
according to various embodiments, is rotatably connected to the
frame 310 at a right angle to extend the second temple 314
substantially perpendicular, substantially parallel, or anywhere in
between the right angle to the frame 310. The second temple 314 has
a first and second end 314a, 314b. Proximate the second temple
second end 314b, the second temple 314 includes an earpiece 315
configured to be supported by a wearer's ear.
[0038] Sensors
[0039] In various embodiments, the second temple 314 has one or
more sensors 330 connected to the second temple 314. In various
embodiments, the one or more sensors 330 may be coupled to the
frame 310, the first and second temples 312, 314, the first and
second lenses 318, 310, the nose piece 324, or any other portion of
the eyewear 300 in any suitable way. For instance, the one or more
sensors 330 may be embedded into the eyewear 300, coupled to the
eyewear 300, and/or operatively coupled to the eyewear 300. In
various embodiments, the one or more sensors may be formed at any
point along the eyewear 300. For instance, a fingerprint reader may
be disposed adjacent the first temple of the eyewear 300. In
various embodiments, the one or more sensors may be formed in any
shape. In addition, the one or more sensors may be formed on the
inner (back) surface of the frame 310, the first and second temples
312, 414, the first and second lenses 318, 310, or any other
portion of the eyewear 300. In other embodiments, the one or more
sensors may be formed on the outer (front) surface of the frame
310, the first and second temples 312, 314, the first and second
lenses 318, 310, or any other portion of the eyewear 300.
[0040] In various embodiments, the one or more sensors 330 that are
coupled to the eyewear (or other wearable device) are adapted to
detect the identity of a food, the quantity of a food, the identity
of a medicine, the dose of the medicine, one or more physical
activities performed by the wearer, the length of the physical
activity, etc. In various embodiments, the one or more sensors
coupled to the eyewear or other health monitoring device may
include, for example, one or more of the following: a near-field
communication chip, a gyroscope, a Bluetooth chip, a GPS unit, a
forward facing camera, an olfactory sensor, a heart rate monitor,
an electrocardiogram (EKG), an electroencephalogram (EEG), a
pedometer, a thermometer, a microphone, an accelerometer, a
magnetometer, a blood pressure sensor, a pulse oximeter, a skin
conductance response sensor, a blood sensor, or any other suitable
sensor. In particular embodiments, the sensors coupled to the
eyewear may include one or more electronic communications devices
such as a near field communication chip, a Bluetooth chip, a
forward facing camera, a microphone and a GPS unit.
[0041] In various embodiments, the one or more sensors are coupled
to a computing device that is associated with (e.g., embedded
within, attached to) the eyewear or other wearable device. In
particular embodiments, the eyewear or other wearable device
comprises at least one processor, computer memory, suitable
wireless communications components (e.g., a Bluetooth chip) and a
power supply for powering the wearable device and/or the various
sensors. In some such embodiments, the one or more sensors may be
coupled to a Bluetooth device that is configured to transmit the
one or more signals to a handheld wireless device.
[0042] In particular embodiments, the system is configured to
receive input from a user (e.g., a wearer of the eyewear) via one
or more gestures, for example, using at least one of the sensors
described above. In various embodiments, the system may, for
example, be configured to: (1) identify a gesture performed by the
user; and (2) at least partially in response to identifying the
gesture, perform a function associated with the gesture. In
particular embodiments, the system may be configured to perform a
particular function in response to identifying a particular
gesture, where the particular gesture is associated with the
particular function. In particular embodiments, the system may be
configured to enable the user to provide one or more gestures for
performing a particular function. In such embodiments, the system
may, for example: (1) receive a selection of a particular function
from the user; (2) receive input of one or more gestures from the
user; and (3) associate the particular function with the one or
more gestures.
[0043] In various embodiments, the one or more gestures may
include, for example: (1) one or more hand gestures (e.g., a thumbs
up, a wave, two thumbs up, holding up any particular number of
fingers, making one or more fists, performing a particular movement
with one or more hands, etc.); (2) one or more head movements
(e.g., shaking of the user's head, a nod, etc.); (3) one or more
eye movements (e.g., looking in a particular direction for a
particular period of time, a wink, blinking, blinking in a
particular pattern, etc.); (4) one or more facial movements (e.g.,
a smile, a frown, sticking out of a tongue, etc.); and/or (5) any
suitable combination of these or any other suitable gestures.
[0044] In particular embodiments, the system is configured to
identify the one or more gestures, for example, using a suitable
imaging device (e.g., camera) that is part of the system. In
particular embodiments, the imaging device may be directed toward
an area in front of the user while the user is wearing the eyewear
300 and configured to identify gestures performed by the user's
hands, arms, feet, legs, etc. In other embodiments, the system may
include an imaging device directed toward the user's face and/or
eyes while the user is wearing the eyewear 300 that is configured
to identify gestures performed by the user's face and/or eyes.
[0045] In other embodiments, the system comprises one or more
gyroscopes and/or accelerometers configured to determine a position
or change in position of the eyewear 300 while the user is wearing
the eyewear. In such embodiments, the one or more gyroscopes and/or
accelerometers are configured to identify one or more gestures
performed by the user that include one or more gestures that
include movement of the user's head. In still other embodiments,
the system comprises one or more gyroscopes and/or one or more
accelerometers, disposed on any other portion of the user's body,
configured to identify any gesture performed by the user using the
other portion of the user's body (e.g., arm, hand, leg, foot,
etc.). In various embodiments, the system comprises any other
suitable sensor for identifying one or more gestures performed by
the user.
[0046] In particular embodiments, one or more of the sensors may be
detachable from the eyewear. For instance, if a wearer does not
need a temperature sensor or other particular sensor, the sensor
may be removed from the eyewear. In still other embodiments, some
of the one or more sensors may be coupled to the handheld wireless
device, while other of the one or more sensors may be coupled to
the wearable device.
Exemplary System Platform
[0047] As noted above, a system, according to various embodiments,
is adapted to monitor a wearer's compliance with a weight loss
plan. Various aspects of the system's functionality may be executed
by certain system modules, including the weight loss compliance
module 400, which is discussed in greater detail below.
[0048] Weight Loss Compliance Module
[0049] FIG. 4 is a flow chart of operations performed by an
exemplary weight loss compliance module 400, which may, for
example, run on the compliance server 120, or any suitable
computing device (such as the one or more health monitoring devices
156, a handheld computing device coupled to communicate with the
one or more health monitoring devices 156 or a suitable mobile
computing device). In particular embodiments, the weight loss
compliance module 400 may assess a wearer's compliance with a
weight loss plan (e.g., a dietary plan, an exercise plan, a sleep
plan, and/or a medicine regime) and provide recommendations,
feedback and/or supportive messages on how the wearer can improve
their compliance with the weight loss plan.
[0050] The system begins, in various embodiments, at Step 405 where
the system receives, by at least one processor, at least one signal
generated by one or more sensors operatively coupled to the
computerized eyewear. In various embodiments, the at least one
signal received may include one or more images taken by a forward
facing camera coupled to the health monitoring device 156. In other
embodiments, the at least one signal received may include one or
more signals from a global positioning system unit that are
associated with the location of the wearer of the health monitoring
device 156. In still other embodiments, the at least one signal
received may include one or more signals from an olfactory sensor
that may be used to determine the smell associated with one or more
foods being prepared for ingestion by the wearer of the health
monitoring device 156. In yet other embodiments, the at least one
signal received may include one or more audio signals received by a
microphone coupled to the health monitoring device 156.
[0051] In various embodiments, the system receives the signals
substantially automatically after the sensor generates the signal.
In some embodiments, the system may receive the signal periodically
(e.g., by the second, by the minute, hourly, daily, etc.). For
example, the system may receive the signal every thirty seconds
throughout the day. In other embodiments, the system may receive
the signal after receiving an indication from the wearer or a third
party that the system should receive the signal. For instance, the
wearer may speak a voice command to the wearable device requesting
that the device track the food being prepared by the wearer. In
various embodiments, the system may receive an indication from the
wearer or a third party of when to have the system receive the
signal. In particular embodiments, the system may receive an
indication from the wearer or a third party to have particular data
received from a particular sensor at the same time that the system
receives second particular data from a second particular sensor.
For example, when the system receives one or more images, the
system may at least partially in response to receiving the one or
more images, also obtain global position data of the wearer,
olfactory data associated with food being prepared by the wearer,
etc.
[0052] In particular embodiments, the system may store data
associated with the received signal in memory (e.g., local memory,
remote memory, etc.). In various embodiments, the system may store
the data substantially automatically after receiving the signal. In
other embodiments, the system may store the data after receiving
manual input from the wearer or a third party requesting that the
system store the data. In various embodiments, the system may store
the data for a specified period of time. For instance, the system
may store the data for a day, a month, a year, etc., in, for
example, the dietary information database 140, the exercise
information database 142, the medicine database 144, and/or the
sleep information database 146. In some embodiments, the system may
store the data on any suitable server, database, or device. In
other embodiments, the system may store the data on the compliance
server 120. In still other embodiments, the system may store data
in an account associated with the wearer. In various embodiments,
the system may store the data with a timestamp of when the data was
received.
[0053] At Step 410, the system, at least partially in response to
receiving the at least one signal from the one or more sensors,
determines, by at least one processor, an identity of a food that
the wearer is preparing to ingest. In various embodiments, the at
least one signal may be an image that is captured by a forward
facing camera. In other embodiments, the at least one signal may be
a signal received from a GPS chip that provides the current
location of the wearer. In still other embodiments, the at least
one signal may be an audio signal received from a microphone. In
yet other embodiments, the signal may be a smell captured by the
olfactory sensor.
[0054] In embodiments, where the at least one signal is one or more
captured images, the system may capture an image of packaging
associated with a food that is being prepared by the wearer. In
some such embodiments, the system may analyze the image to detect a
barcode located on the packaging associated with the food. Once the
system detects the barcode, the system may decipher the bar code
and search the dietary information database 140 of barcodes to find
a matching barcode. Once the system identifies the food associated
with the barcode, the system may also obtain from the dietary
information database 140 nutritional information (e.g., calories,
fat content, protein content, etc.) that is associated with the
matching barcode.
[0055] In other embodiments, the system may analyze the captured
one or more images to identify a food located in the captured one
or more images. For example, the system may capture an image of a
hamburger that the wearer is preparing to eat. The system may
search the dietary information database 140 of images of food to
find a matching image of a hamburger that is similar (e.g., the
same, substantially similar, etc.) to the hamburger that the wearer
is preparing. Once a match is determined by the system, the system
can identify the food and obtain the nutritional information
associated with matching image stored in the dietary information
database 140. In various embodiments, the system may capture a
series of images that show the wearer preparing the hamburger.
Thus, in some embodiments, the system may first capture an image of
the hamburger as the wearer barbecues the hamburger. From the first
image, the system may identify the hamburger by finding a matching
image of a hamburger in the dietary information database 140. Next,
the system may capture one or more images of the user removing a
hamburger roll from a package of hamburger rolls. The system may
detect a barcode from the image of the packaging of the hamburger
rolls and identify the roll and the nutritional information
associated with the roll from the barcode associated with the one
or more images by searching the dietary information database 140
for a matching barcode. The system may continue to identify various
other condiments that the wearer places on the hamburger in a
similar fashion.
[0056] In still other embodiments, the system may capture an image
of a food that the wearer is preparing to ingest while the system
simultaneously receives a GPS signal from a GPS chip contained in
the computerized eyewear worn by the wearer. In some such
embodiments, the system may determine the location of the wearer
from the GPS signal, determine if a restaurant or similar food
establishment is located at the location, and simultaneously
analyze one or more captured images to identify the food that the
wearer is preparing to ingest by, for example, one of the methods
described above. In some of these embodiments, the wearer's
location and a determination of a particular restaurant or similar
food establishment may assist the system in identifying the food
that the wearer is preparing to ingest. For example, if the system
cannot positively identify the exact food item the wearer is
preparing to ingest, the system may display a list of one or more
food items associated with the restaurant or similar food
establishment on a display associated with the computerized eyewear
(e.g., a display coupled to the computerized eyewear, a display on
a handheld computing device, etc.) and allow the wearer to select
the particular food item from the displayed list of one or more
food items.
[0057] In still other embodiments, the system may receive an audio
signal from one or more microphones coupled to the computerized
eyewear. In some embodiments, the system may convert the received
audio signal to text and use the text to search the dietary
information database 140 for matching text words to identify the
food that the wearer is preparing to ingest. In some embodiments,
the dietary information database 140 may also contain nutritional
information associated with each word in the database. For example,
the wearer may place the computerized eyewear in a state where it
is ready to accept voice input. The wearer may, for example, say
"hamburger". The system may convert the received voice command to
text and search the dietary information database 140 for a matching
word. Each word in the database may contain associated nutritional
information. Thus, if the system finds a match for the word
"hamburger", the system identifies the food item as a "hamburger"
and obtains nutritional information associated with the word
"hamburger." In some embodiments, once the system converts the
received audio signal into text, the system may seek confirmation
of the converted word by the wearer before searching the database
of food items.
[0058] As noted above, in various embodiments, the system may
determine a wearer's location using a signal received from the GPS
chip in the computerized eyewear or from a GPS chip on a handheld
computing device coupled to the computerized eyewear. In some such
embodiments, if the system detects that the user is located in a
restaurant or other food establishment, the system may begin to
monitor the wearer's speech in order to detect one or more food
items ordered by the wearer. As the system detects the wearer's
speech, the system may convert the speech to text and search the
dietary information database 140 based on one or more of: (1) the
location of the wearer, (2) the associated name of the restaurant
or other similar food establishment, or (3) a detected name of a
food item ordered by the wearer. In various embodiments, the system
may automatically detect the ordered food item. In other
embodiments, once the system identifies an ordered item, the system
may request confirmation that the detected item is accurate prior
to making a final identification of the food item that the wearer
is preparing to ingest.
[0059] In various embodiments, confirmation of the identity of the
food item may be made by the wearer orally using the microphone on
the computerized eyewear. In other embodiments, the system may
request confirmation by displaying the identified food item on a
display associated with the computerized eyewear. For example, the
computerized eyewear may contain a built in display that the wearer
can view while wearing the computerized eyewear. In other
embodiments, the computerized eyewear may be coupled (e.g.,
wirelessly, wired, etc.) to a handheld computing device that
displays the selected food item. In some such embodiments, the
system may be configured to allow the user to select a "confirm" or
"deny" button displayed on the handheld computing device.
[0060] At Step 415, the system determines, by at least one
processor, a quantity of the food that the wearer is preparing to
ingest. In various embodiments where the system detects and reads a
barcode located in one or more captured images, the system may
determine the serving size associated with the barcode by searching
the dietary information database 140 for a matching barcode and
nutritional information, which may also include a serving size for
the food item. For example, in some instances where the wearer is
eating prepackaged food, the matching barcode may indicate that the
serving size associated with the packaged food is a single serving
(e.g., a candy bar, a frozen meal, etc.). In other embodiments, the
matching barcode may indicate that the serving size is a teaspoon,
a tablespoon, a cup, etc.
[0061] In various embodiments where the serving size is not a
single serving, the system may calculate an estimated volume from
the captured one or more image. In other embodiments, the system
may capture and analyze one or more images of the food and
calculate an estimate of the quantity of the food that the wearer
is preparing to ingest. For example, in some embodiments, the
system may analyze the captured one or more images to count the
number of teaspoons, tablespoons or cups of a food that the wearer
selects. In other embodiments, the wearer may input the quantity of
food using an input device (e.g, a food scale) coupled to the
computerized eyewear or a handheld computing device coupled to the
computerized eyewear or the wearer may input the quantity using an
audio input via the one or more microphones coupled to the
computerized eyewear.
[0062] In other embodiments, the system may analyze the captured
one or more images to detect a vessel (e.g., bowl, measuring cup,
container, etc.) that the wearer is using to measure a quantity of
food. In some embodiments, the system may determine the quantity of
the selected food based on the identity of the vessel. For example,
a set of measuring cups and/or spoons may be color coded based on
the size of each cup or spoon. In these embodiments, the system may
analyze the captured one or more images to detect the particular
measuring cup and/or spoon being used. In other embodiments, the
system may analyze the captured one or more images to detect one or
more markings located on the vessel that would allow the system to
determine an accurate measurement of the food based on the identity
of the vessel and/or the one or more markings on the vessel. In yet
other embodiments, the system may be configured to operatively
couple (e.g. via Bluetooth, Wi-Fi, physical wiring, etc.) to a
measuring device such as a scale, an electronic measuring cup,
etc., and use a received signal from the measuring device to
determine the quantity of the selected food.
[0063] At Step 420, the system tracks, by at least one processor,
the identity and the quantity of the food that the wearer is
preparing to ingest. In various embodiments, the system may store
the identity and quantity of a food that a wearer prepares to
ingest in an account associated with the wearer on the system. In
some embodiments, the system may allow the user to input when the
wearer plans on eating the prepared food (e.g., for breakfast,
lunch, dinner, midmorning snack, late afternoon snack, etc.). In
other embodiments, the system may determine a date and time that
the wearer ingests the prepared food. For example, the system may
determine the date, time, and associated meal (e.g., breakfast,
lunch, dinner, etc.) and stored the information in a database
(e.g., dietary information database 140) or an account on the
system associated with the wearer. In still other embodiments, the
system may track the number of calories associated with the
prepared food, the nutritional information (e.g., amount of fat,
protein, carbohydrates, vitamins, minerals, etc.) associated with
the prepared food, and also store this information in the database
or account associated with the wearer.
[0064] At step 425, the system compares, by at least one processor,
the identity and quantity of the food that the wearer is preparing
to ingest to a predetermined weight loss plan. In various
embodiments, the weight loss plan may contain one or more of a
dietary plan, an exercise plan, a medicine regime, or a sleep plan.
In some embodiments, the weight loss plan may be prepared by the
wearer. In other embodiments, the weight loss plan may be prepared
by a third-party (e.g., a doctor, a trainer, a nutritionist,
etc.).
[0065] In various embodiments, the dietary plan for the wearer may
consist of at least one of: (A) one or more daily values for: (1)
total calorie intake, (2) total fat intake, (3) total protein
intake, (4) total carbohydrate intake; (B) one or more prohibited
foods; (C) one or more prohibited vitamins; (D) one or more
prohibited minerals; (E) a daily expected weight loss value; (F) a
weekly expected weight loss value; (G) a recommended amount of
daily sleep; (H) etc. In various embodiments, the system may
compare the amount and quantity of food and its associated
nutritional information to the dietary plan values in order to
determine if the wearer is complying with the dietary plan. In some
embodiments, the system may compare the actual consumed total daily
calorie intake to the planned total daily calorie intake. In other
embodiments, the system may, in addition to the total daily calorie
intake also compare one or more of the actual daily protein intake,
daily fat intake or daily carbohydrate intake to the planned daily
values.
[0066] In various embodiments, the exercise plan may consist of at
least one of: (A) a weight loss goal; (B) a target daily calories
to burn in order to lose a particular amount of weight per week;
(C) various suggested exercises to achieve the desired weight loss
goal; or (D) one or more recommended daily physical activities
(e.g., walking, stretching, etc.). In some such embodiments, the
system may be configured to track one or more of the wearer's (1)
movements, (2) heart rate, or (3) respiration rate to determine the
amount of calories burned by the wearer and the type of exercise
performed by the wearer.
[0067] In various embodiments, the system may use signals received
from the one or more sensors (e.g., gyroscope, accelerometer, GPS
unit, heart rate sensor, etc.) to determine the wearer's movements
and calories burned. In some embodiments, the system may determine
the wearer's current movements by tracking the distance traveled by
the wearer for a particular day. In still other embodiments, the
system may determine the wearer's current movements by tracking the
orientation of the wearer using the gyroscope. In particular
embodiments, the current movements of the wearer may include
actions such as running, jumping, bicycling, weight lifting,
sitting, standing, etc. In various embodiments, the system may be
configured to determine a total calories burned by the wearer for
any particular activity based on one or more of (1) the movements
associated with the wearer during the activity, (2) the amount of
elapsed time during which the activity is performed, (3) the
wearer's heart rate (actual, average, mean, etc.) during the time
the activity is performed and/or after completion of the activity,
or (4) the wearer's respiration rate during and/or after the
activity is performed by the wearer.
[0068] In various embodiments, the system determines the wearer's
current movements, heart rate, and/or respiration rate
substantially automatically after receiving the signals from the
one or more sensors. In various embodiments, the system may
determine the wearer's current movements, heart rate, and/or
respiration rate periodically (e.g., by the second, by the minute,
hourly, daily, etc.). For example, the system may determine the
wearer's current movements, heart rate, and/or respiration rate
every thirty seconds throughout the day. In other embodiments, the
system may determine the wearer's current movements, heart rate,
and/or respiration rate after receiving an indication from the
wearer that the system should analyze the signals received from the
one or more sensors. For instance, the wearer may speak a voice
command to the computerized eyewear requesting that the device
analyze the wearer's steps taken, heart rate and/or respiration
rate. In other embodiments, the wearer may indicate to the system
using a handheld computing device operatively coupled to the
computerized eyewear that the system should capture the wearer's
current movements, heart rate, and/or respiration rate.
[0069] In various embodiments, the weight loss plan may contain a
medicine regime that is designed to support the wearer's weight
loss goals. For example, the medicine regime may comprise at least
one of (A) one or more prescription weight loss medicines; (B) one
or more over the counter weight loss medicines; or (C) one or more
over the counter supplements (e.g. Chitosan, Chromium Picolinate,
etc.). In various embodiments, the medicine regime may also
comprise tracking one or more prescription medicines that the
wearer is already taking to determine any weight loss or weight
gain side effects that may be caused by the one or prescribed
medications taken by the wearer. For example, if the wearer is
diabetic, the medicine regime may track the wearer's use of insulin
in conjunction with the wearer's food intake, physical activity,
and glucose levels to determine any weight loss or weight gain
effects on the wearer.
[0070] In some embodiments, the wearer or a third-party (e.g., the
wearer's physician, etc.) may manually input a medicine regime into
an account associated with the wearer on the system. For example,
where a physician prescribes one or more weight loss medicines or
supplements as part of the wearer's weight loss plan, the
prescribed medicines or supplements may be entered into the
wearer's weight loss plan. In other embodiments where the wearer is
already taking prescription medications, the wearer may manually
enter one or more prescription medicines into the wearer's account
on the system or the wearer's account may be linked to a medical
records database so that prescribed medicines are automatically
linked to the wearer's weight loss plan.
[0071] In still other embodiments, the one or more sensors on the
computerized eyewear may capture one or more images of the one or
more medicines/supplements that the wearer is preparing to ingest.
The system may be configured to analyze the captured image to
detect the presence of a label on a medicine/supplement bottle to
identify the medicine/supplement and dose being ingested by the
wearer. In some embodiments the system may perform optical
character recognition techniques on the label to identify the type
of medicine/supplement and the dose taken by the wearer. Once the
medicine/supplement and/or dose is identified, the system may add
the medicine/supplement to the wearer's medicine regime and perform
a look-up of the medicine/supplement in a medicine database 144 to
determine if the medicine/supplement has any positive or negative
side effect on weight loss. Once the system receives or identifies
all medicines/supplements taken by the wearer, the system may track
the wearer's compliance with the medicine regime.
[0072] In various embodiments, the system may capture one or more
images throughout the day and analyze the images to determine one
or more of (1) a type of medicine/supplement taken by the wearer;
(2) the time the medicine/supplement is ingested by the wearer; and
(3) the dose of medicine/supplement ingested by the wearer. For
example, in some embodiments, the system may detect one or more
pills in the captured one or more images, compare the one or more
detected pills found in the captured one or more images to known
images of pills stored in the medicine database 144, identify the
one or more pills by matching the one or more pills from the
captured one or more images to the known images of pills stored in
the medicine database 144, and detect the time that the captured
one or more images was taken. Based on this information, the system
is able to determine if the wearer is complying with the medicine
regime prescribed by the wearer's physician in addition to
monitoring the potential side effects of medicine/supplements that
the wearer takes while following the weight loss plan.
[0073] In various embodiments, the weight loss plan may include a
sleep plan that is designed to support the wearer's weight loss
goals. In some such embodiments, the sleep plan for the wearer may
consist of at least one of: (1) a recommended amount of sleep; (2)
a recommended time for the wearer to go to sleep; (3) a recommended
time for the wearer to wake up; and/or (4) a recommended nap time.
In various embodiments, the sleep plan may include a position for
the wearer to sleep in, a temperature for the room where the wearer
is sleeping, and/or a lighting condition for the room where the
wearer is sleeping. In particular embodiments, the sleep plan may
include advice for the wearer on avoiding certain types of light.
In other embodiments, the sleep plan for the wearer may include
suggestions for relaxation techniques. In various embodiments, the
system may track the amount and quality of sleep the wearer is
obtaining to determine if the wearer is complying with the sleep
plan. The system may do this, for example, using one or more of the
sensors (e.g., motion sensors) described herein. In some
embodiments, the system may compare the actual daily sleep of the
wearer to the prescribed sleep plan. In particular embodiments, the
system may, in addition to tracking the wearer's sleep patterns,
track the wearer's hormone levels (e.g., through perspiration), the
wearer's glucose levels, and the wearer's activity levels.
[0074] At step 430, at least partially in response to comparing the
identity and the quantity of the food that the wearer is preparing
to ingest to a predetermined weight loss plan, the system
calculates, using at least one processor, one or more
recommendations to assist the wearer in complying with the
predetermined weight loss plan. In various embodiments, the system
may analyze the wearer's calorie intake, compare the current
calorie intake to the predetermined weight loss plan, analyze the
wearer's current calories burned and calculate one or more
activities that would allow the wearer meet the daily goals for the
predetermined weight loss plan. In some embodiments, for example,
the system may determine that the wearer is preparing to ingest a
500 calorie hamburger. In some such embodiments, the system may
recommend that the wearer run for 45 minutes to offset the
additional 500 calories.
[0075] In other embodiments, the system may determine that the
wearer is preparing to ingest a food item that contains 1500 mg of
sodium. If the predetermined weight loss plan contains a
restriction on sodium, the system may recommend that the wearer not
eat the food item since the food item contains too much sodium. In
still other embodiments, the system may be configured to recommend
an alternative food item that is substantially similar (e.g., the
same, in the same category as the food item, etc.) as the food item
that the wearer is preparing to ingest. In still other embodiments,
the system may be configured to identify a particular food item,
its associated nutritional information and then question the
wearer's desire to ingest the particular food item. For example,
the wearer may visit his local eating establishment and order "the
heart attack" hamburger off the menu. Once the system identifies
the food item and its associated nutritional information (e.g.,
calories, sodium content, fat content, etc.), the system may
recommend to the wearer that he choose a more nutritional food item
since "the heart attack" does not comply with the wearer's weight
loss plan.
[0076] In various embodiments, the weight loss plan may also
include allergy information associated with the wearer. For
example, the wearer's predetermined weight loss plan may include
information relating to the wearer's allergy to soy. Thus, once the
system identifies that the wearer is ordering "the Heart Attack"
hamburger, which based on the associated nutritional information
indicates that it contains soy products, the system may send a
recommendation to the wearer that states "the heart attack burger
contains soy--you're allergic to soy--don't eat it!
[0077] In other embodiments, the system may be configured to
monitor the wearer's exercise routine to determine whether the
wearer is complying with daily exercise requirements. For example,
the system may determine by mid-afternoon that that the wearer has
only completed 50 percent of the steps required by the wearer's
predetermined weight loss plan. In some such embodiments, the
system may calculate additional exercise recommendations that the
wearer may perform in order to meet the daily recommended steps set
forth in the wearer's weight loss plan. In other embodiments, if
the system detects that the wearer has been sitting for a large
portion of the day, the system may calculate recommended activities
that lessens the amount of time that the wearer is in the seated
position.
[0078] In other embodiments, if the wearer's is engaging in a
physical activity, the system may monitor whether the wearer is
exercising at the proper intensity based on at least one of the
wearer's movements, the wearer's heart rate, the wearer's
respiration rate or the weight loss plan. If the system detects
that the wearer is not exercising at a predetermined intensity
established in the weight loss plan, the system may recommend that
the wearer increase the pace of the wearer's movements.
[0079] In various embodiments, the system may monitor the wearer's
compliance with the medicine regime and calculate recommendations
to help the wearer comply with the medicine regime. For example, in
some embodiments, the system may calculate reminders for the wearer
to assist the wearer in taking medicine/supplements. In other
embodiments, the system may identify a side effect of a medicine
that the wearer is taking and recommend that the wearer monitor any
weight gain since a common side effect of the medicine is weight
gain.
[0080] In various embodiments, the system may be configured to
monitor the wearer's compliance with the sleep plan to determine
whether the wearer is complying with the sleep plan. For example,
the system may use one or more sensors described herein (e.g.,
motion sensors) to determine by that the wearer has only slept a
total of five hours for a particular day when the wearer's sleep
plan called for seven hours per day. In some such embodiments, the
system may calculate an additional nap time for the wearer in order
to meet the daily recommended hours of sleep set forth in the
wearer's weight loss plan. In other embodiments, if the system
detects that the wearer has been sleeping for a large portion of
the day, the system may calculate recommended activities that
lessen the amount of time that the wearer is sleeping during the
day. In still other embodiments, if the system determines that the
wearer's sleep cycles are getting interrupted while the wearer is
sleeping, for instance by sleep apnea, the system may recommend
that wearer monitor any weight gain and comply with the wearer's
dietary, exercise, and medicinal regimes since sleep apnea is a
common side effect of gaining weight.
[0081] At Step 435, the system notifies the wearer of one or more
recommendations regarding the wearer's compliance with the
predetermined weight loss plan. In various embodiments, the system
notifies the wearer and/or a third-party of the one or more
recommendations calculated by the system by sending a notification
to the wearer's and/or the third-party's handheld computing
devices. In particular embodiments, the system may notify the
wearer and/or the third-party of the one or more recommendations by
email or text message. In yet other embodiments, the system
notifies the user of the one or more inconsistencies by
communicating through a speaker coupled to the computerized
eyewear.
[0082] In various embodiments, the system may notify the wearer
and/or the third-party of a recommendation substantially
immediately (e.g., immediately) after the system calculates the
recommendation. In yet other embodiments, the system may notify the
wearer and/or the third-party of all recommendations at the end of
that day. In still other embodiments, the system may notify the
wearer of an exercise recommendation when the wearer provides an
indication to the system that the wearer is beginning to
exercise.
[0083] In various embodiments, the third-party may be a relative or
friend of the wearer so that the third-party may assist the wearer
in meeting the requirements of the predetermined weight loss plan.
In other embodiments, the third-party may be the wearer's
nutritionist and/or physician to allow the nutritionist and/or
physician to monitor the wearer's compliance with the predetermined
weight loss plan. In still other embodiments, the third-party may
be an insurance company that may adjust the wearer's life/health
insurance rate(s) based on the wearer's compliance with the
predetermined weight loss plan.
[0084] In various embodiments, the system, when executing the
Behavior Pattern Analysis Module 400, may omit particular steps,
perform particular steps in an order other than the order presented
above, or perform additional steps not discussed directly
above.
[0085] Exemplary User Experience
[0086] Independent Living of Elderly
[0087] In a particular example of a wearer using the health
monitoring device 156 (in the form of computerized eyewear) and the
system 100 to monitor the wearer's compliance with a weight loss
plan, the wearer may put on the computerized eyewear in the morning
and continue to wear the device throughout the day. In various
embodiments, the computerized eyewear may be operatively coupled
(e.g., via a suitable wireless or wired connection) to a smart
phone, a laptop, a desktop computer, or any other computing device
that can receive signals from the computerized eyewear and either
transmit the signals to a central system (e.g., via a wireless or
wired telephone network, the Internet, etc.) or analyze the signals
and make decisions based on the received signals (e.g., identify a
food, a quantity of the food, calculate recommendations, etc.).
During this time, the system (1) identifies a food item and a
quantity of the food item that the wearer is preparing to ingest
using the forward facing camera, the GPS unit, the microphone,
etc., (2) tracks the food item and quantity, (3) compares the food
item and quantity to a predetermined weight loss plan, (4) tracks
the movements of the wearer using the motion sensor, the
accelerometer, the global positioning sensor, the gyroscope, and
the front-facing camera, (5) tracks the wearer's compliance with a
medicine regime, as described in detail above, and/or (6) tracks
the wearer's compliance with a sleep plan, as also described in
detail above.
[0088] In this example, the wearer may be under doctor's orders to
lose weight. Thus, by wearing the computerized eyewear throughout
the day, the device is able to capture one or more images of one or
more food items that the wearer is preparing to ingest, identify
the one or more food items, and compare the nutritional information
for the one or more food items to a predetermined weight loss plan
set by the doctor. Continuing with this example, if the wearer goes
out to eat, the system may receive a GPS signal that can be used to
determine the location of the wearer. In addition to determining
the location of the wearer, the system may also determine that the
wearer is at a particular food establishment (e.g., a restaurant, a
food store, etc.) located at the geographical location. Thus, based
on the captured one or more images of the food item that the wearer
is preparing to eat, the location of the wearer and the name of the
food establishment, the system can identify the food item and the
nutritional information associated with the food item by comparing
the one or more captured images of the food item to images of food
items available at the food establishment. Once the system
determines a match and identifies the food item, the system may
also identify nutritional information associated with the food item
from a food information database accessed by the system.
[0089] In various embodiments, the system tracks the nutritional
information associated with the food item and compares this
information to the weight loss program. For example, the system may
add the calories associated with the food item to a "total
calories" consumed for the day value. In some embodiments, if the
system determines that the food item will cause the wearer to
exceed the total calories allocated to the wearer for the day under
the weight loss program, the system may calculate one or more
recommendations for the wearer. For example, the one or more
recommendations may include a statement to the wearer that says "if
you eat this food item, you must perform one or more of the
following exercises for 40 minutes to offset the excess calories
due to the food item." Another recommendation may be "Instead of
eating the `Blue Bomber hamburger` why not have the Chicken Caesar
Salad?" In various embodiments, if the system determines that the
wearer ingests the food item, the system may continue to remind the
wearer that the wearer must perform additional physical activity to
offset the excess calories consumed during the day.
CONCLUSION
[0090] Many modifications and other embodiments of the invention
will come to mind to one skilled in the art to which this invention
pertains, having the benefit of the teaching presented in the
foregoing descriptions and the associated drawings. Therefore, it
is to be understood that the invention is not to be limited to the
specific embodiments disclosed and that modifications and other
embodiments are intended to be included within the scope of the
appended claims. Although specific terms are employed herein, they
are used in a generic and descriptive sense only and not for the
purposes of limitation.
* * * * *