U.S. patent application number 14/566977 was filed with the patent office on 2015-06-11 for voice-recognition home automation system for speaker-dependent commands.
This patent application is currently assigned to EchoStar Technologies L.L.C.. The applicant listed for this patent is EchoStar Technologies L.L.C.. Invention is credited to Dave Kummer.
Application Number | 20150162006 14/566977 |
Document ID | / |
Family ID | 53270607 |
Filed Date | 2015-06-11 |
United States Patent
Application |
20150162006 |
Kind Code |
A1 |
Kummer; Dave |
June 11, 2015 |
VOICE-RECOGNITION HOME AUTOMATION SYSTEM FOR SPEAKER-DEPENDENT
COMMANDS
Abstract
Systems and method for controlling a device in a home automation
system based on a speaker-dependent command may include receiving a
voice command for controlling the device connected to the home
automation system, performing a voice recognition analysis to
determine a speaker identity of the received voice command, and
performing a speech recognition analysis to identify the device in
the home automation system that is intended to be controlled. The
systems and methods may include determining a permission status to
control the identified device, whereby the determined permission
status is based on the determined speaker identity and the
identified device. The systems and methods may include controlling
the identified device in the home automation system based on the
determined status.
Inventors: |
Kummer; Dave; (Englewood,
CO) |
|
Applicant: |
Name |
City |
State |
Country |
Type |
EchoStar Technologies L.L.C. |
Englewood |
CO |
US |
|
|
Assignee: |
EchoStar Technologies
L.L.C.
Englewood
CO
|
Family ID: |
53270607 |
Appl. No.: |
14/566977 |
Filed: |
December 11, 2014 |
Related U.S. Patent Documents
|
|
|
|
|
|
Application
Number |
Filing Date |
Patent Number |
|
|
61914856 |
Dec 11, 2013 |
|
|
|
Current U.S.
Class: |
704/275 |
Current CPC
Class: |
H04N 21/47217 20130101;
H04N 21/43615 20130101; H04N 21/6143 20130101; H04L 12/2803
20130101; H04N 21/4126 20130101; H04N 21/4263 20130101; H04L
12/2825 20130101; Y10T 292/096 20150401; G07C 9/00571 20130101;
E05B 2047/0094 20130101; G10L 17/22 20130101; H04L 12/2838
20130101; G07C 2209/62 20130101; H04L 12/2816 20130101; H04N
21/43637 20130101; H04N 21/422 20130101; E05B 2047/0069 20130101;
H04N 21/454 20130101; H04N 21/4131 20130101; H04N 21/4532 20130101;
E05B 2047/0068 20130101; H04N 21/235 20130101; H04N 21/42202
20130101; H04N 21/435 20130101; H04N 21/478 20130101; H04W 4/12
20130101; G05B 15/02 20130101; H04L 51/00 20130101; G05B 11/01
20130101; G05B 2219/2642 20130101 |
International
Class: |
G10L 17/22 20060101
G10L017/22 |
Claims
1. A method for controlling a device in a home automation system
based on a speaker-dependent command, comprising: receiving, by a
television receiver, a voice command for controlling the device
connected to the home automation system; performing, by the
television receiver, a voice recognition analysis to determine a
speaker identity of the received voice command; performing, by the
television receiver, a speech recognition analysis to identify the
device in the home automation system that is intended to be
controlled by the received voice command; determining, by the
television receiver, a permission status to control the identified
device, wherein the determined permission status is based on the
determined speaker identity and the identified device; and
controlling, by the television receiver, the identified device in
the home automation system based on the determined permission
status.
2. The method for controlling the device in the home automation
system based on the speaker-dependent command of claim 1,
comprising: detecting, by the television receiver, the voice
command at a microphone on the television receiver.
3. The method for controlling the device in the home automation
system based on the speaker-dependent command of claim 1,
comprising: receiving, by the television receiver, the voice
command from a remote control in operative communication with the
television receiver, wherein the voice command is detected by a
microphone on the remote control and is wirelessly relayed from the
remote control to the television receiver.
4. The method for controlling the device in the home automation
system based on the speaker-dependent command of claim 1,
comprising: receiving, by the television receiver, the voice
command from a home automation device in operative communication
with the television receiver, wherein the voice command is detected
by a microphone provided on the home automation device and is
relayed from the home automation device to the television
receiver.
5. The method for controlling the device in the home automation
system based on the speaker-dependent command of claim 1,
comprising: wherein performing the voice recognition analysis to
determine the speaker identity comprises comparing, by the
television receiver, at least a portion of the received voice
command to a voice database comprising one or more voice samples,
wherein each of the one or more voice samples are associated with
one or more speaker identities.
6. The method for controlling the device in the home automation
system based on the speaker-dependent command of claim 1,
comprising: receiving, by the television receiver, one or more
voice samples during an initial setup; receiving, by the television
receiver, a speaker identity during the initial setup; associating,
by the television receiver, at least a portion of the one or more
voice samples with the speaker identity; and storing, by the
television receiver, the associated one or more voice samples and
the speaker identity in a voice database.
7. The method for controlling the device in the home automation
system based on the speaker-dependent command of claim 6,
comprising: receiving, by the television receiver, one or more
access settings associated with the speaker identity; and storing,
by the television receiver, the one or more access settings
associated with the speaker identity in a settings database.
8. The method for controlling the device in the home automation
system based on the speaker-dependent command of claim 1,
comprising: wherein performing the speech recognition analysis to
identify the device to be controlled comprises: detecting, by the
television receiver, one or more control phrases in the received
voice command; and comparing, by the television receiver, the one
or more control phrases to a controls database comprising a
plurality of control phrases, wherein each of the one or more
control phrases is associated with one or more home automation
devices.
9. The method for controlling the device in the home automation
system based on the speaker-dependent command of claim 1,
comprising: receiving, by the television receiver, one or more
control phrases in a one-time setup, wherein each of the one or
more control phrases comprises at least a word or a string of
words; associating, by the television receiver, each of the one or
more control phrases with a home automation device; and storing, by
the television receiver, the associated control phrases and home
automation devices in a controls database.
10. The method for controlling the device in the home automation
system based on the speaker-dependent command of claim 9,
comprising: wherein the control phrases comprise user-configured
control phrases.
11. The method for controlling the device in the home automation
system based on the speaker-dependent command of claim 1,
comprising: determining, by the television receiver, a plurality of
home automation devices to control based on the speech recognition
analysis.
12. The method for controlling the device in the home automation
system based on the speaker-dependent command of claim 1,
comprising: determining, by the television receiver, the permission
status is at least one of an access granted status and an access
denied status.
13. The method for controlling the device in the home automation
system based on the speaker-dependent command of claim 12,
comprising: transmitting, by the television receiver, an
operational command to the identified device based on the access
granted permission status.
14. The method for controlling the device in the home automation
system based on the speaker-dependent command of claim 12,
comprising: generating, by the television receiver, the operational
command based on a communication protocol specific to the
identified device; and transmitting, by the television receiver,
the operational command to the identified device through a home
automation network.
15. The method for controlling the device in the home automation
system based on the speaker-dependent command of claim 12,
comprising: outputting, by the television receiver, a confirmation
notification that indicates a new state of the identified device,
wherein the new state is based on the voice command.
16. The method for controlling the device in the home automation
system based on the speaker-dependent command of claim 12,
comprising: outputting, by the television receiver, a notification
based on the access denied status; and maintaining, by the
television receiver, a current state of the identified device.
17. The method for controlling the device in the home automation
system based on the speaker-dependent command of claim 1,
comprising: receiving, by the television receiver, a code word,
wherein the received code word is detected by a microphone;
associating, by the television receiver, the code word with a
speaker identity; and detecting, by the television receiver, the
code word immediately preceding the voice command.
18. The method for controlling the device in the home automation
system based on the speaker-dependent command of claim 1,
comprising: in response to receiving the voice command, outputting,
by the television receiver, an additional query for additional
information related to the voice command.
19. A system for controlling a device in a home automation system
based on a speaker-dependent commands, comprising: one or more
processors; and a memory communicatively coupled with and readable
by the one or more processors and having stored therein
processor-readable instructions that, when executed by the one or
more processors, cause the one or more processors to: receive, by a
television receiver, a voice command for controlling the device
connected to the home automation system; perform, by the television
receiver, a voice recognition analysis to determine a speaker
identity of the received voice command; perform, by the television
receiver, a speech recognition analysis to identify the device in
the home automation system that is intended to be controlled by the
received voice command; determine, by the television receiver, a
permission status to control the identified device, wherein the
determined permission status is based on the determined speaker
identity and the identified device; and control, by the television
receiver, the identified device in the home automation system based
on the determined status.
20. A computer-readable medium having stored thereon a series of
instructions which, when executed by a processor, cause the
processor to control a device in a home automation system based on
a speaker-dependent command by: receiving, by a television
receiver, a voice command for controlling the device connected to
the home automation system; performing, by the television receiver,
a voice recognition analysis to determine a speaker identity of the
received voice command; performing, by the television receiver, a
speech recognition analysis to identify the device in the home
automation system that is intended to be controlled by the received
voice command; determining, by the television receiver, a
permission status to control the identified device, wherein the
determined permission status is based on the determined speaker
identity and the identified device; and controlling, by the
television receiver, the identified device in the home automation
system based on the determined status.
Description
CROSS-REFERENCES TO RELATED APPLICATIONS
[0001] This application claims priority to U.S. Provisional Patent
Application No. 61/914,856, filed on Dec. 11, 2013, and entitled,
"METHODS AND SYSTEMS FOR HOME AUTOMATION," the entire contents of
which are incorporated herein by reference.
BACKGROUND
[0002] Home automation systems are becoming increasingly prevalent.
Such systems may incorporate a variety of electronic devices, such
as "smart" electronics that allow end-users to control and/or view
status information of those devices, and other traditional
electronics. With the growing popularity of home automation
systems, there is a need for a controls infrastructure that can
operate with the variety of different electronic devices, and at
the same time, be user-friendly, secure, and simple to implement.
This application is intended to address such needs and to provide
related advantages.
SUMMARY
[0003] In general, this application is directed to home automation
systems, and more specifically, to controlling home automation
systems with speaker-dependent commands.
[0004] In one aspect of the present disclosure, a method for
controlling a device in a home automation system based on a
speaker-dependent command is provided. The method may include
receiving, by a television receiver, a voice command for
controlling the device connected to the home automation system. The
method may include performing, by the television receiver, a voice
recognition analysis to determine a speaker identity of the
received voice command, and/or performing, by the television
receiver, a speech recognition analysis to identify the device in
the home automation system that is intended to be controlled by the
received voice command. Further, the method may include
determining, by the television receiver, a permission status to
control the identified device, wherein the determined permission
status is based on the determined speaker identity and the
identified device. The method may include controlling, by the
television receiver, the identified device in the home automation
system based on the determined status.
[0005] Various embodiments of the method may include one or more of
the following features. The method may include detecting, by the
television receiver, the voice command at a microphone on the
television receiver. The method may include receiving, by the
television receiver, the voice command from a remote control in
operative communication with the television receiver, wherein the
voice command is detected by a microphone on the remote control and
is wirelessly relayed from the remote control to the television
receiver. In another aspect, the method may include receiving, by
the television receiver, the voice command from a home automation
device in operative communication with the television receiver,
wherein the voice command is detected by a microphone provided on
the home automation device and is relayed from the home automation
device to the television receiver.
[0006] The method may include, in the step of performing the voice
recognition analysis to determine the speaker identity, comparing,
by the television receiver, at least a portion of the received
voice command to a voice database comprising one or more voice
samples, wherein each of the one or more voice samples are
associated with one or more speaker identities. The method may
include receiving, by the television receiver, one or more voice
samples during an initial setup, receiving, by the television
receiver, a speaker identity during the initial setup, associating,
by the television receiver, at least a portion of the one or more
voice samples with the speaker identity, and/or storing, by the
television receiver, the associated one or more voice samples and
the speaker identity in a voice database.
[0007] The method may further include receiving, by the television
receiver, one or more access settings associated with the speaker
identity, and/or storing, by the television receiver, the one or
more access settings associated with the speaker identity in a
controls database. In other aspects, the method may include, in
performing the speech recognition analysis to identify the device
to be controlled, one or more steps of detecting, by the television
receiver, one or more control phrases in the received voice
command, and/or comparing, by the television receiver, the one or
more control phrases to a controls database comprising a plurality
of control phrases. Each of the one or more control phrases may be
associated with one or more home automation devices. In further
examples, the method may include receiving, by the television
receiver, one or more control phrases in a one-time setup, wherein
each of the one or more control phrases comprises at least a word
or a string of words, associating, by the television receiver, each
of the one or more control phrases with a home automation device,
and/or storing, by the television receiver, the associated control
phrases and home automation devices in a controls database.
[0008] In some examples, the control phrases may include
user-configured control phrases. In another example, the method may
include determining, by the television receiver, a plurality of
home automation devices to control based on the speech recognition
analysis. In still other examples, the method may include
determining, by the television receiver, the permission status is
at least one of an access granted status and an access denied
status. The method may include transmitting, by the television
receiver, an operational command to the identified device based on
the access granted permission status. In another example, the
method may include generating, by the television receiver, the
operational command based on a communication protocol specific to
the identified device, and/or transmitting, by the television
receiver, the operational command to the identified device through
a home automation network. In other examples, the method may
include outputting, by the television receiver, a confirmation
notification that indicates a new state of the identified device,
wherein the new state is based on the voice command.
[0009] In still other examples, the method may include outputting,
by the television receiver, a notification based on the access
denied status, and/or maintaining, by the television receiver, a
current state of the identified device. The method may include
receiving, by the television receiver, a code word, wherein the
received code word is detected by a microphone, associating, by the
television receiver, the code word with a speaker identity, and/or
detecting, by the television receiver, the code word immediately
preceding the voice command. In some cases, the method may include,
in response to receiving the voice command, outputting, by the
television receiver, an additional query for additional information
related to the voice command. Other examples are possible.
[0010] In another aspect of the present disclosure, a system for
controlling a device in a home automation system based on a
speaker-dependent command is provided. The system may include one
or more processors and/or a memory communicatively coupled with and
readable by the one or more processors and having stored therein
processor-readable instructions. When executed, the
processor-readable instructions may cause the one or more
processors to receive, by a television receiver, a voice command
for controlling the device connected to the home automation system,
perform, by the television receiver, a voice recognition analysis
to determine a speaker identity of the received voice command,
and/or perform, by the television receiver, a speech recognition
analysis to identify the device in the home automation system that
is intended to be controlled by the received voice command. The
processor-readable instructions may cause the one or more
processors to determine, by the television receiver, a permission
status to control the identified device, wherein the determined
permission status is based on the determined speaker identity and
the identified device. In another example, the processor-readable
instructions may cause the one or more processors to control, by
the television receiver, the identified device in the home
automation system based on the determined status. Other examples
are possible.
[0011] In yet another aspect of the present disclosure, a
computer-readable medium having stored thereon a series of
instructions is provided. When executed by a processor, the series
of instructions may cause the processor to control a device in a
home automation system based on a speaker-dependent command. For
example, the series of instructions may include receiving, by a
television receiver, a voice command for controlling the device
connected to the home automation system, performing, by the
television receiver, a voice recognition analysis to determine a
speaker identity of the received voice command, and/or performing,
by the television receiver, a speech recognition analysis to
identify the device in the home automation system that is intended
to be controlled by the received voice command. The series of
instructions may further include determining, by the television
receiver, a permission status to control the identified device,
wherein the determined permission status is based on the determined
speaker identity and the identified device, and/or controlling, by
the television receiver, the identified device in the home
automation system based on the determined status. Other examples
are possible.
BRIEF DESCRIPTION OF THE DRAWINGS
[0012] FIG. 1 shows an embodiment of a television service provider
system;
[0013] FIG. 2 shows an embodiment of a home automation system
hosted by a television receiver;
[0014] FIG. 3 shows an embodiment of a television receiver
configured to host a home automation system;
[0015] FIG. 4 shows an example method for controlling a device in a
home automation system based on a speaker-dependent command;
[0016] FIG. 5 shows a block diagram of example modules in a voice
command engine for controlling a device in a home automation system
based on a speaker-dependent command;
[0017] FIG. 6 shows another example method for controlling a device
in a home automation system based on a speaker-dependent command;
and
[0018] FIG. 7 shows an embodiment of a computer system upon which
various aspects of the present disclosure may be implemented.
[0019] It is noted that any of the elements and/or steps provided
in the block diagrams, flow diagrams, method diagrams, and other
illustrations of the figures may be optional, replaced, and/or
include additional components, such as combined and/or replaced
with other elements and/or steps from other figures and text
provided herein. Various embodiments of the present invention are
discussed below, and various combinations or modifications thereof
may be contemplated.
DETAILED DESCRIPTION
[0020] In general, the systems and methods disclosed herein are
directed to controlling a device, such as a home automation or
"smart" device, of a home automation system based on a
speaker-dependent command. For example, a microphone, such as a
microphone on a television receiver, a television remote control,
and/or on one or more devices in the home automation system, may
detect a spoken voice command and transmit the voice command to a
television receiver having a voice command recognition system. The
television receiver may perform a voice recognition analysis for
speaker verification and/or speaker identification. Additionally,
the television receiver may perform a speech recognition analysis
to determine which device(s) connected to the home automation
system should be controlled, e.g. which device(s) the voice command
is intended to command. Based on the determined speaker's identity
and the determined device(s) to control, the television receiver
may allow for certain commands to be completed and/or prohibited in
the home automation system.
[0021] Merely by way of example, an adult user identity may be
permitted to perform certain functions that a child user identity
cannot, e.g., unlocking doors. In another example, a speaker may
state a command without naming a particular device, e.g. "Lower the
heat by five degrees." The television receiver may determine, based
at least in part on speech recognition, which home automation
device is intended, and therefore which device to transmit an
operational signal to, e.g. relaying the command to lower the heat
by five degrees to a thermostat. In yet another example, the
television receiver may respond to a user-defined code word that
precedes and/or follows a spoken command. For instance, the
television receiver may detect the code word "Sesame" followed by a
spoken command such as "Turn on the living room lights." Such
user-defined code words may activate the television receiver to
capture and analyze the subsequently spoken home automation
command. Other examples are possible. It is contemplated that the
present systems and methods provide for a user-friendly, secure and
simple controls infrastructure that may be used to operate a
variety of different electronic devices in the home automation
system, as described in further detail below.
[0022] FIG. 1 illustrates an embodiment of a satellite television
distribution system 100. While a home automation system may be
incorporated with various types of television receivers, various
embodiments may be part of a satellite-based television
distribution system. Cable, IP-based, wireless and broadcast
focused systems are also possible. Satellite television
distribution system 100 may include: television service provider
system 110, satellite transmitter equipment 120, satellites 130,
satellite dish 140, television receiver 150, system credit
management engine 112, and display device 160. Alternate
embodiments of satellite television distribution system 100 may
include fewer or greater numbers of components. While only one
satellite dish 140, television receiver 150, and display device 160
(collectively referred to as "user equipment") are illustrated, it
should be understood that multiple (e.g., tens, thousands, millions
of) instances and types of user equipment may receive data and
television signals from television service provider system 110 via
satellites 130.
[0023] As shown in FIG. 1, television service provider system 110
and satellite transmitter equipment 120 may be operated by a
television service provider. A television service provider may
distribute television channels, on-demand programming, programming
information, and/or other content/services to users. Television
service provider system 110 may receive feeds of one or more
television channels and content from various sources. Such
television channels may include multiple television channels that
contain at least some of the same content (e.g., network
affiliates). To distribute television channels for presentation to
users, feeds of the television channels may be relayed to user
equipment via multiple television distribution satellites. Each
satellite may relay multiple transponder streams. Satellite
transmitter equipment 120 may be used to transmit a feed of one or
more television channels from television service provider system
110 to one or more satellites 130. While a single television
service provider system 110 and satellite transmitter equipment 120
are illustrated as part of satellite television distribution system
100, it should be understood that multiple instances of transmitter
equipment may be used, possibly scattered geographically, to
communicate with satellites 130. Such multiple instances of
satellite transmitting equipment may communicate with the same or
with different satellites. Different television channels may be
transmitted to satellites 130 from different instances of
transmitting equipment. For instance, a different satellite dish of
satellite transmitter equipment 120 may be used for communication
with satellites in different orbital slots.
[0024] Still referring to FIG. 1, satellites 130 may be configured
to receive signals, such as streams of television channels, from
one or more satellite uplinks such as satellite transmitter
equipment 120. Satellites 130 may relay received signals from
satellite transmitter equipment 120 (and/or other satellite
transmitter equipment) to multiple instances of user equipment via
transponder streams. Different frequencies may be used for uplink
signals 170 from downlink signals 180. Satellites 130 may be in
geosynchronous orbit. Each of the transponder streams transmitted
by satellites 130 may contain multiple television channels
transmitted as packetized data. For example, a single transponder
stream may be a serial digital packet stream containing multiple
television channels. Therefore, packets for multiple television
channels may be interspersed. Further, information used by
television receiver 150 for home automation functions may also be
relayed to television receiver via one or more transponder streams.
For instance, home automation functions may be requested by and/or
pushed to the television receiver 150 from the television service
provider system 110.
[0025] As shown in FIG. 1, multiple satellites 130 may be used to
relay television channels from television service provider system
110 to satellite dish 140. Different television channels may be
carried using different satellites. Different television channels
may also be carried using different transponders of the same
satellite; thus, such television channels may be transmitted at
different frequencies and/or different frequency ranges. As an
example, a first and second television channel may be relayed via a
first transponder of satellite 130-1. A third, fourth, and fifth
television channel may be relayed via a different satellite or a
different transponder of the same satellite relaying the
transponder stream at a different frequency. A transponder stream
transmitted by a particular transponder of a particular satellite
may include a finite number of television channels, such as seven.
Accordingly, if many television channels are to be made available
for viewing and recording, multiple transponder streams may be
necessary to transmit all of the television channels to the
instances of user equipment. Further, it is contemplated that
multiple home automation functions may be transmitted in similar
fashion.
[0026] Still in reference to FIG. 1, satellite dish 140 may be a
piece of user equipment that is used to receive transponder streams
from one or more satellites, such as satellites 130. Satellite dish
140 may be provided to a subscriber for use on a subscription basis
to receive television channels and/or home automation functions
provided by the television service provider system 110 and/or
specifically, the home automation service server 112 of the
provider system 110, satellite transmitter equipment 120, and/or
satellites 130. Satellite dish 140, which may include one or more
low noise blocks (LNBs), may be configured to receive transponder
streams from multiple satellites and/or multiple transponders of
the same satellite. Satellite dish 140 may be configured to receive
television channels via transponder streams on multiple
frequencies. Based on the characteristics of television receiver
150 and/or satellite dish 140, it may only be possible to capture
transponder streams from a limited number of transponders
concurrently. For example, a tuner of television receiver 150 may
only be able to tune to a single transponder stream from a
transponder of a single satellite at a given time. The tuner can
then be re-tuned to another transponder of the same or a different
satellite. A television receiver 150 having multiple tuners may
allow for multiple transponder streams to be received at the same
time. Merely by way of example, multiple television channels and/or
multiple home automation functions may be received
concurrently.
[0027] FIG. 1 further illustrates one or more television receivers
in communication with satellite dish 140. Television receivers may
be configured to decode signals received from satellites 130 via
satellite dish 140 for output and presentation via a display
device, such as display device 160. Similarly, such television
receivers may decode signals received for any home automation
devices. For instance, a home automation engine 311, as described
further below, may decode such signals. A television receiver may
be incorporated as part of a television or may be part of a
separate device, commonly referred to as a set-top box (STB).
Television receiver 150 may decode signals received via satellite
dish 140 and provide an output to display device 160. On-demand
content, such as PPV content, may be stored to a computer-readable
storage medium. FIG. 2 described below provides additional detail
of various embodiments of a television receiver. A television
receiver is defined to include set-top boxes (STBs) and also
circuitry having similar functionality that may be incorporated
with another device. For instance, circuitry similar to that of a
television receiver may be incorporated as part of a television. As
such, while FIG. 1 illustrates an embodiment of television receiver
150 as separate from display device 160, it should be understood
that, in other embodiments, similar functions may be performed by a
television receiver integrated with display device 160. Television
receiver 150 may include the home automation engine 311, as
detailed in relation to FIG. 3.
[0028] Referring again to FIG. 1, display device 160 may be used to
present video and/or audio decoded and output by television
receiver 150. Television receiver 150 may also output a display of
one or more interfaces to display device 160, such as an electronic
programming guide (EPG). In many embodiments, display device 160 is
a television. Display device 160 may also be a monitor, computer,
or some other device configured to display video and, possibly,
play audio.
[0029] As further illustrated in FIG. 1, uplink signal 170-1
represents a signal between satellite transmitter equipment 120 and
satellite 130-1. Uplink signal 170-2 represents a signal between
satellite transmitter equipment 120 and satellite 130-2. Each of
uplink signals 170 may contain streams of one or more different
television channels and/or home automation functions. For example,
uplink signal 170-1 may contain a first group of television
channels and/or home automation functions, while uplink signal
170-2 contains a second group of television channels and/or home
automation functions. Each of these television channels and/or home
automation functions may be scrambled such that unauthorized
persons are prevented from accessing the television channels.
[0030] As shown in FIG. 1, downlink signal 180-1 represents a
signal between satellite 130-1 and satellite dish 140. Downlink
signal 180-2 represents a signal between satellite 130-2 and
satellite dish 140. Each of the downlink signals 180 may contain
one or more different television channels and/or home automation
functions, which may be at least partially scrambled. A downlink
signal may be in the form of a transponder stream. A single
transponder stream may be tuned to at a given time by a tuner of a
television receiver. For example, downlink signal 180-1 may be a
first transponder stream containing a first group of television
channels and/or home automation functions, while downlink signal
180-2 may be a second transponder stream containing a different
group of television channels and/or home automation functions. In
addition to or instead of containing television channels, a
transponder stream can be used to transmit on-demand content to
television receivers, including PPV content (which may be stored
locally by the television receiver until output for
presentation).
[0031] FIG. 1 further illustrates downlink signal 180-1 and
downlink signal 180-2, being received by satellite dish 140 and
distributed to television receiver 150. For a first group of
television channels and/or home automation functions, satellite
dish 140 may receive downlink signal 180-1 and for a second group
of channels and/or home automation functions, downlink signal 180-2
may be received. Television receiver 150 may decode the received
transponder streams. As such, depending on which television
channels and/or home automation functions are desired to be
presented or stored, various transponder streams from various
satellites may be received, descrambled, and decoded by television
receiver 150.
[0032] Further shown in FIG. 1, network 190, which may include the
Internet, may allow for bidirectional communication between
television receiver 150 and television service provider system 110,
such as for home automation related services provided by home
automation service server 112. In addition or in alternate to
network 190, a telephone (e.g., landline) or cellular connection
may be used to enable communication between television receiver 150
and television service provider system 110.
[0033] Turning now to FIG. 2, an embodiment of a home automation
system 200 hosted by a television receiver is illustrated.
Television receiver 150 may represent the television receiver of
FIG. 1. While television receiver 150 may be configured to receive
television programming from a satellite-based television service
provider, it should be understood that in other embodiments, other
forms of television service provider networks may be used, such as
an IP-based network (e.g., fiber network), a cable based network, a
wireless broadcast-based network, etc.
[0034] As shown in FIG. 2, television receiver 150 may be
configured to communicate with multiple in-home home automation
devices. The devices with which television receiver 150
communicates may use different communication standards or
protocols. For instance, one or more devices may use a ZigBee.RTM.
communication protocol while one or more other devices communicate
with the television receiver using a Z-Wave.RTM. communication
protocol. Other forms of wireless communication may be used by
devices and the television receiver 150. For instance, television
receiver 150 and one or more devices may be configured to
communicate using a wireless local area network, which may use a
communication protocol such as 802.11.
[0035] Referring to FIG. 2, in some embodiments, a separate device
may be connected with television receiver 150 to enable
communication with home automation devices. For instance,
communication device 252 may be attached to television receiver
150. Communication device 252 may be in the form of a dongle.
Communication device 252 may be configured to allow for
Zigbee.RTM., Z-Wave.RTM., and/or other forms of wireless
communication. The communication device may connect with television
receiver 150 via a USB port or via some other type of (wired)
communication port. Communication device 252 may be powered by the
television receiver 150 or may be separately coupled with a power
source. In some embodiments, television receiver 150 may be enabled
to communicate with a local wireless network and may use
communication device 252 in order to communicate with devices that
use a ZigBee.RTM. communication protocol, Z-Wave.RTM. communication
protocol, and/or some other home wireless communication
protocols.
[0036] Still referring to FIG. 2, communication device 252 may also
serve to allow additional components to be connected with
television receive 150. For instance, communication device 252 may
include additional audio/video inputs (e.g., HDMI), component,
and/or composite input to allow for additional devices (e.g.,
Blu-ray players) to be connected with television receiver 150. Such
connection may allow video from such additional devices to be
overlaid with home automation information. Merely by way of
example, whether home automation information is overlaid onto video
may be triggered based on a user's press of a remote control
button.
[0037] As shown in FIG. 2, regardless of whether television
receiver 150 uses communication device 252 to communicate with home
automation devices, television receiver 150 may be configured to
output home automation information for presentation to a user via
display device 160. Such information may be presented
simultaneously with television programming received by television
receiver 150, such as via system 100 of FIG. 1 described above.
Television receiver 150 may also, at a given time, output only
television programming or only home automation information based on
a user's preference. The user may be able to provide input to
television receiver 150 to control the home automation system
hosted by television receiver 150 or by overlay device 251, as
detailed below.
[0038] Still referring to FIG. 2, in some embodiments, television
receiver 150 may not be used as a host for a home automation
system. Rather, a separate device may be coupled with television
receiver 150 that allows for home automation information to be
presented to a user via display device 160. This separate device
may be coupled with television receiver 150. In some embodiments,
the separate device is referred to as overlay device 251. Overlay
device 251 may be configured to overlay information, such as home
automation information, onto a signal to be visually presented via
display device 160, such as a television. In some embodiments,
overlay device 251 may be coupled between television receiver 150,
which may be in the form of a set top box, and display device 160,
which may be a television. In such embodiments, television receiver
150 may receive, decode, descramble, decrypt, store, and/or output
television programming and/or home automation functions. Television
receiver 150 may output a signal, such as in the form of an HDMI
signal. Rather than be directly input to display device 160, the
output of television receiver 150 may be input to overlay device
251. Overlay device 251 may receive the video and/or audio output
from television receiver 150. Overlay device 251 may add additional
information to the video, audio and/or home automation function
signal received from television receiver 150. The modified video
and/or audio signal may be output to display device 160 for
presentation. In some embodiments, overlay device 251 has an HDMI
input and an HDMI output, with the HDMI output being connected to
display device 160. To be clear, while FIG. 2 illustrates lines
illustrating communication between television receiver 150 and
various devices, it should be understood that such communication
may exist, in addition or in alternate via communication device 252
and/or with overlay device 251.
[0039] Referring again to FIG. 2, in some embodiments, television
receiver 150 may be used to provide home automation functionality
while overlay device 251 may be used to present information via
display device 160. It should be understood that the home
automation functionality detailed herein in relation to a
television receiver may alternatively be provided via overlay
device 251. In some embodiments, overlay device 251 may provide
home automation functionality and be used to present information
via display device 160. Using overlay device 251 to present
automation information via display device 160 may have additional
benefits. For instance, multiple devices may provide input video to
overlay device 251. For instance, television receiver 150 may
provide television programming to overlay device 251, a DVD/Blu-Ray
player may provide video overlay device 251, and a separate
internet-TV device may stream other programming to overlay device
251. Regardless of the source of the video/audio, overlay device
251 may output video and/or audio that has been modified to include
home automation information, such as a pop-up overlay with a prompt
message, and output to display device 160. As such, in such
embodiments, regardless of the source of video/audio, overlay
device 251 may modify the audio/video to include home automation
information and, possibly, solicit for user input. For instance, in
some embodiments overlay device 251 may have four video inputs
(e.g., four HDMI inputs) and a single video output (e.g., an HDMI
output). In other embodiments, such overlay functionality may be
part of television receiver 150. As such, a separate device, such
as a Blu-ray player may be connected with a video input of
television receiver 150, thus allowing television receiver 150 to
overlay home automation information when content from the Blu-Ray
player is being output to display device 160.
[0040] Still referring to FIG. 2, regardless of whether television
receiver 150 is itself configured to provide home automation
functionality and output home automation input for display via
display device 160 or such home automation functionality is
provided via overlay device 251, home automation information may be
presented by display device 160 while television programming is
also being presented by display device 160. For instance, home
automation information may be overlaid or may replace a portion of
television programming (e.g., broadcast content, stored content,
on-demand content, etc.) presented via display device 160. Merely
by way of example, while television programming is being presented
(e.g., a television show on scuba diving), the display is augmented
with information related to home automation. This television show
may represent broadcast programming, recorded content, on-demand
content, or some other form of content. In one example, the
presented home automation information is related to motion being
detected by a camera at a front door of a location. Such
augmentation of the television programming may be performed
directly by television receiver 150 (which may or may not be in
communication with communication device 252) or overlay device 251
connected with television receiver 150 and display device 160. Such
augmentation may result in solid or partially transparent graphics
being overlaid onto television programming (or other forms of
video) output by television receiver 150. Overlay device 251 or
television receive 150 may be configured to add or modify sound to
television programming. For instance, in response to a doorbell
ring, a sound may be played through the display device (or
connected audio system). In addition or in alternate, a graphic may
be displayed. In other embodiments, camera data (e.g., nanny camera
data) and/or associated sound or motion sensors may be integrated
in the system and overlaid or otherwise made available to a user.
For example, detection of a crying baby from a nanny camera may
trigger an on-screen alert to a user watching television.
[0041] Still in reference to FIG. 2, such presented home automation
information may request user input. For instance, a user, via
controls of television receiver 150 (e.g., a remote control) or
controls of overlay device 251, can specify whether video from a
camera at the front door should be presented, not presented, or if
future notifications related to such motion such be ignored. If
ignored, this may be for a predefined period of time, such as an
hour, or until the television receiver 150 or overlay device 251 is
powered down and powered back on. Ignoring of video may be
particularly useful if motion or some other event is triggering the
presentation of video that is not interesting to a viewer of
display device 160 (or a wireless device), such as children playing
on the lawn or snow falling.
[0042] As shown in FIG. 2, television receiver 150 or overlay
device 251 may be configured to communicate with one or more
wireless devices, such as wireless device 216. Wireless device 216
may represent a tablet computer, cellular phone, laptop computer,
remote computer, or some other device through which a user may
desire to control home automation settings and view home automation
information. Such a device also need not be wireless, such as a
desktop computer. Television receiver 150, communication device
252, or overlay device 251 may communicate directly with wireless
device 216, or may use a local wireless network, such as network
270. Wireless device 216 may be remotely located and not connected
with a same local wireless network. Via the internet, television
receiver 150 or overlay device 251 may be configured to transmit a
notification to wireless device 216 regarding home automation
information. For instance, in some embodiments, a third-party
notification server system, such as the notification server system
operated by Apple.RTM., may be used to send such notifications to
wireless device 216.
[0043] Further shown in FIG. 2, in some embodiments, a location of
wireless device 216 may be monitored. For instance, if wireless
device 216 is a cellular phone, when its position indicates it has
neared a door, the door may be unlocked. A user may be able to
define which home automation functions are controlled based on a
position of wireless device 216. Other functions could include
opening and/or closing a garage door, adjusting temperature
settings, turning on and/or off lights, opening and/or closing
shades, etc. Such location-based control may also take into account
the detection of motion via one or more motion sensors that are
integrated into other home automation devices and/or stand-alone
motion sensors in communication with television receiver 150.
[0044] Still referring to FIG. 2, in some embodiments, little to no
setup of network 270 may be necessary to permit television receiver
150 to stream data out to the Internet. For instance, television
receiver 150 and network 270 may be configured, via a service such
as Sling.RTM. or other video streaming service, to allow for video
to be streamed from television receiver 150 to devices accessible
via the Internet. Such streaming capabilities may be "piggybacked"
to allow for home automation data to be streamed to devices
accessible via the Internet. For example, U.S. patent application
Ser. No. 12/645,870, filed on Dec. 23, 2009, entitled "Systems and
Methods for Remotely Controlling a Media Server via a Network",
which is hereby incorporated by reference, describes one such
system for allowing remote access and control of a local device.
U.S. Pat. No. 8,171,148, filed Apr. 17, 2009, entitled "Systems and
Methods for Establishing Connections Between Devices Communicating
Over a Network", which is hereby incorporated by reference,
describes a system for establishing connection between devices over
a network. U.S. patent application Ser. No. 12/619,192, filed May
19, 2011, entitled "Systems and Methods for Delivering Messages
Over a Network", which is hereby incorporated by reference,
describes a message server that provides messages to clients
located behind a firewall
[0045] Still referring to FIG. 2, as an example of how wireless
device 216 may be used in conjunction with television receiver 150
or overlay device 251 for controlling a home automation system, a
wireless device 216 may be in communication with television
receiver 150 serving as the host of a home automation system. At
approximately a same time that the home automation information is
presented via display device 160 (assuming it is turned on),
similar information may be sent to wireless device 216, such as via
a third-party notification server or directly from television
receiver 150 or overlay device 251 via a local wireless network. A
user of wireless device 216 can specify whether video from a camera
at the front door should be presented by wireless device 216, not
presented, or if future notifications related to such motion such
be ignored. If ignored, this may be for a predefined period of
time, such as an hour or some other predefined or user-selected
period of time. In this way, a user interface of the wireless
device 216 may correspond to an overlay of the home automation
information and/or prompt appearing on the display device 160.
[0046] Referring again to FIG. 2, wireless device 216 may serve as
an input device for television receiver 150. For instance, wireless
device 216 may be a tablet computer that allows text to be typed by
a user and provided to television receiver 150. Such an arrangement
may be useful for text messaging, group chat sessions, or any other
form of text-based communication. Other types of input may be
received for the television receiver from a tablet computer or
other device as shown in the attached screenshots, such as lighting
commands, security alarm settings and door lock commands. While
wireless device 216 may be used as the input device for typing
text, television receiver 150 may output for display text to
display device 160.
[0047] Still referring to FIG. 2, wireless device 216 may be
configured to store a software model of home automation system
intended to mirror the software model stored by television receiver
150, which is hosting the home automation system. For instance,
such a software model may allow wireless device 216 to view,
communicate with, and/or interact with various home automation
devices. Such a software model may indicate the state of various
home automation devices. When wireless device 216 is not in
communication with television receiver 150, changes to the home
automation model made at television receiver 150 may not be known
to wireless device 216. A history list maintained by television
receiver 150 and/or a synchronization point numerical value,
whereby each change to the home automation model by television
receiver 150 is assigned a value and synchronized at a later point
with the wireless device 216, may be implemented. In another
aspect, the wireless device 216 may be utilized by a user for
entering and/or confirming rules and other settings of the home
automation system, and such settings may be synchronized or
otherwise communicated with the television receiver 150.
[0048] Further shown in FIG. 2, in some embodiments, a cellular
modem 253 may be connected with either overlay device 251 or
television receiver 150. Cellular modem 253 may be useful if a
local wireless network is not available. For instance, cellular
modem 253 may permit access to the internet and/or communication
with a television service provider. Communication with a television
service provider, such as television service provider system 110 of
FIG. 1, may also occur via a local wireless or wired network
connected with the Internet. In some embodiments, information for
home automation purposes may be transmitted by television service
provider system 110 to television receiver 150 or overlay device
251 via the television service provider's distribution network,
which may include the use of satellites 130.
[0049] As shown in FIG. 2, various home automation devices may be
in communication with television receiver 150 or overlay device
251. Such home automation devices may use disparate communication
protocols. Such home automation devices may communicate with
television receiver 150 directly or via communication device 252.
Such home automation devices may be controlled by a user and/or
have a status viewed by a user via display device 160 and/or
wireless device 216. Such home automation device may include one or
more of the following, as discussed below.
[0050] As shown in FIG. 2, one or more cameras, such as camera 212.
Camera 212 may be either indoors or outdoors and may provide a
video and, possibly, audio stream which can be presented via
wireless device 216 and/or display device 160. Video and/or audio
from camera 212 may be recorded by overlay device 251 or television
receiver 150 upon an event occurring, such as motion being detected
by camera 212. Video and/or audio from camera 212 may be
continuously recorded such as in the form of a rolling window, thus
allowing a period of time of video/audio to be reviewed by a user
from before a triggering event and after the triggering event.
Video may be recorded on a storage local to overlay device 251 or
television receiver 150, or may be recorded and or storage on
external storage devices, such as a network attached storage
device. In some embodiments, video may be transmitted across the
local and/or wide area network to other storage devices upon
occurrence of a trigger event for later playback. For initial
setup, a still from camera 212 may be captured by and stored by
television receiver 150 for subsequent presentation as part of a
user interface via display device 160 such that the user can
determine which camera (if multiple cameras are present) is being
set up and/or later accessed. For example a user interface may
display a still image from a front door camera (which is easily
recognized by the user because it shows a scene in front of the
house's front door) to allow a user to select the front door camera
for viewing.
[0051] For instance, as shown in FIG. 2, video and, possibly, audio
from camera 212 may be available live for viewing by a user via
overlay device 251 or television receiver 150. Such video may be
presented simultaneously with television programming being
presented. In some embodiments, video may only be presented if
motion is detected by camera 212, otherwise video from camera 212
may not be presented by the display device presenting television
programming. Also, such video (and, possibly, audio) from camera
212 may be recorded by television receiver 150 or overlay device
251. Such video may be recorded based upon a timer configured by a
user. For instance, camera 212 may be incorporated into an
electronic programming guide (EPG) output for display by television
receiver 150. For instance, camera 212 may be presented as a
"channel" as part of the EPG along with other television
programming channels. A user may be permitted to select the channel
associated with camera 212 for presentation via display device 160
(or wireless device 216). The user may also be permitted to set a
timer to record the channel of camera 212 for a user-defined period
of time on a user-defined date. Such recording may not be
constrained by the rolling window associated with a triggering
event being detected. For instance, recording camera 212 based on a
timer may be useful if a babysitter is going to be watching a child
and the parents want to later review the babysitter's behavior in
their absence. In some embodiments, video from camera 212 may be
backed up to a remote storage device, such as cloud-based storage
hosted by home automation service server 112. Other data may also
be cached to the cloud, such as configuration settings. Thus, if
the television receiver 150 or overlay device 251 malfunctions,
then a new device may be installed and the configuration data
loaded onto the device from the cloud.
[0052] Further shown in FIG. 2, window sensor 210 and door sensor
208 may transmit data to television receiver 150 (possibly via
communication device 252) or overlay device 251 that indicates the
status of a window or door, respectively. Such status may indicate
open or closed. When a status change occurs, the user may be
notified as such via wireless device 216 or display device 160.
Further, a user may be able to view a status screen to view the
status one or more window sensors and/or one or more door sensors
throughout the location. Window sensor 210 and/or door sensor 208
may have integrated glass break sensors to determine if glass has
been broken.
[0053] Still shown in FIG. 2, one or more smoke and/or CO.sub.2
detectors 209 may be integrated as part of a home automation
system. As such, alerts as to whether a fire or CO.sub.2 has been
detected can be sent to television receiver 150, wireless device
216, and/or emergency first responders. Further, television
receiver 150 and/or wireless device 216 may be used to disable
false alarms. One or more sensors may be integrated or separate to
detect gas leaks, radon, or various other dangerous situations.
[0054] Still referring to FIG. 2, pet door and/or feeder 211 may
allow for pet related functionality to be integrated with
television receiver 150. For instance, a predefined amount of food
may be dispensed at predefined times to a pet. A pet door may be
locked and/or unlocked. The pet's weight or presence may trigger
the locking or unlocking of the pet door. For instance, a camera
located at the pet door may be used to perform image recognition of
the pet or a weight sensor near the door may identify the presence
of the pet and unlock the door. A user may also lock/unlock a pet
door via wireless device 150 and/or wireless device 216.
[0055] Still shown in FIG. 2, weather sensor 206 may allow
television receiver 150 or overlay device 251 to receive, identify,
and/or output various forms of environmental data, including
temperature, humidity, wind speed, barometric pressure, etc.
Television receiver 150 or overlay device 251 may allow for control
of one or more shades, such as window, door, and/or skylight
shades, within a house. Shade controller 204 may respond to
commands from television receiver 150 or overlay device 251 and may
provide status updates (e.g., shade up, shade 50% up, shade down,
etc.).
[0056] As shown in FIG. 2, in some embodiments, television receiver
150 may receive and notify a user of the status of electrical
appliances such as refrigerators and dishwashers within the house.
The television receiver 150 may be linked to the appliances and
presents a notification message to the user through whatever device
the user is using at the time, such as a tablet computer, mobile
phone or thin client. U.S. patent application Ser. No. 12/700,310,
filed Feb. 4, 2010, entitled "Electronic Appliance Status
Notification via a Home Entertainment System", which is hereby
incorporated by reference, describes such techniques in further
detail.
[0057] Also shown in FIG. 2, utility monitor 202 may serve to
provide television receiver 150 or overlay device 251 with utility
information, such as electricity usage, gas usage, water usage,
wastewater usage, irrigation usage, etc. A user may view a status
page or may receive notifications upon predefined events occurring,
such as electricity usage exceeding a defined threshold within a
month, or current kilowatt usage exceeding a threshold.
[0058] FIG. 2 further shows a health sensor 214 that may permit a
user's vital characteristics to be monitored, such as a heart rate.
In some embodiments, additionally or alternatively, health sensor
214 may contain a button or other type of actuator that a user can
press to request assistance. As such, health sensor 214 may be
mounted to a fixed location, such as bedside, or may be carried by
a user, such as on a lanyard. Such a request may trigger a
notification to be presented to other users via display device 160
and/or wireless device 216. Additionally or if the notification is
not cleared by another user within a predefined period of time, a
notification may be transmitted to emergency first responders to
request help. In some embodiments, a home automation service
provider may first try contacting the user, such as via phone, to
determine if an emergency is indeed occurring. Such a health sensor
214 may have additional purposes, such as for notification of
another form of emergency, such as a break-in, fire, flood, theft,
disaster, etc. In some examples, the health sensor 214 may receive
signals from various cameras, temperature sensors, and other
monitoring equipment in connection with the home automation system,
analyze such signals, and store or report such signals as
necessary.
[0059] Still referring to FIG. 2, in some embodiments, health
sensor 214 may be used as a medical alert pendant that can be worn
or otherwise carried by a user. It may contain a microphone and/or
speaker to allow communication with other users and/or emergency
first responders. Television receiver 150 or overlay device 251 may
be preprogrammed to contact a particular phone number (e.g.,
emergency service provider, relative, caregiver, etc.) based on an
actuator of health sensor 214 being activated by a user. The user
may be placed in contact with a person via the phone number and the
microphone and/or speaker of health sensor 214. Camera data may be
combined with such alerts in order to give a contacted relative
more information regarding the medical situation. For example,
health sensor 214, when activated in the family room, may generate
a command which is linked with security camera footage from the
same room. In some embodiments, health sensor 214 may be able to
monitor vitals of a user, such as a blood pressure, temperature,
heart rate, blood sugar, etc. In some embodiments, an event, such
as a fall or exiting a structure can be detected. Further, parallel
notifications may be sent by the health sensor 214 to multiple user
devices at approximately the same time. As such, multiple people
can be made aware of the event at approximately the same time (as
opposed to serial notification). Which users are notified for which
type of event may be customized by a user of television receiver
150.
[0060] Further in reference to FIG. 2, in addition to such parallel
notifications being based on data from health sensor 214, data from
other devices may trigger such parallel notifications according to
various rules within the home automation system. For instance, a
mailbox open, a garage door open, an entry/exit door open during
wrong time, an unauthorized control of specific lights during
vacation period, a water sensor detecting a leak or flow, a
temperature of room or equipment is outside of defined range,
and/or motion detected at front door are examples of possible
events which may trigger parallel notifications. A configuring user
may be able to select from a list of users provided by the home
automation system to notify and method of notification to enable
such parallel notifications. The configuring user may prioritize
which systems and people are notified, and specify that the
notification may continue through the list unless acknowledged
either electronically or by human interaction. For example, the
user could specify that they want to be notified of any light
switch operation in their home during their vacation. Notification
priority could be 1) SMS Message, 2) push notification, 3)
electronic voice recorder places call to primary number, and 4)
electronic voice recorder places call to spouse's number. The
second notification may never happen if the user replies to the SMS
message with an acknowledgment. Or, the second notification would
automatically happen if the SMS gateway cannot be contacted.
[0061] Referring again to FIG. 2, intercom 218 may permit a user in
one location to communicate with a user in another location, who
may be using wireless device 216, display device 160 or some other
device, such another television receiver within the structure.
Intercom 218 may be integrated with camera 212 or may use a
dedicated microphone/speaker, such as a Bluetooth.RTM. microphone.
Microphones/speakers of wireless device 216, display device 160,
communication device 252, overlay device 251 may also or
alternatively be used. A multimedia over coax (MOCA) network or
other appropriate type of network may be used to provide audio
and/or video based intercom via television receiver 150 with other
television receivers and/or wireless devices in communication with
television receiver 150. Similarly, video and/or audio conferencing
can be provided, such that communication with persons via the
Internet is possible. Therefore, one possible use would be video
and/or audio conferencing within a structure using each television
receiver (and associated connected display devices) in the
structure that are in communication, or allowing each television
receiver to perform video/audio conferencing with other devices
external to the structure or local area network.
[0062] Referring to FIG. 2, to enable intercom 218, a microphone
may be placed in a location where a user would typically be using
intercom 218. For instance, a microphone may be placed near display
device 160. In some embodiments, a microphone may be integrated
into a remote control of television receiver 150. As such, if a
user is using television receiver 150 via remote control, the user
would have access to a microphone. In at least one embodiment, a
user can leverage the wireless device 216, such as a mobile phone
or tablet computer, as the microphone for the home automation
system.
[0063] Referring again to FIG. 2, doorbell sensor 223 may permit an
indication of when a doorbell has been rung to be sent to multiple
devices, such as television receiver 150 and/or wireless device
216. In some embodiments, doorbell sensor 223 detecting a doorbell
ring may trigger video to be recorded by camera 212 of the area
near the doorbell and the video to be stored until deleted by a
user (or stored for predefined period of time).
[0064] Further, as shown in FIG. 2, such a microphone, or a
microphone on one or more other home automation devices, may allow
for voice recognition to be performed by television receiver 150.
Voice recognition may allow for a particular user to be determined
and for commands to be completed based on a user speaking such
commands. For instance, an adult user may be permitted to perform
certain functions that a child user cannot; such as unlocking
doors. Each user may provide a voice sample which is used by
television receiver 150 to distinguish users from each other.
Further, users may be able to speak commands, such as "lower heat 5
degrees," to control home automation devices. Based on the command
received, television receiver 150 may determine to which home
automation device the command is intended and may transmit an
appropriate command (such as, in this example, a command to lower
the heat setting by five degrees to thermostat 222). In at least
one embodiment, a user may use a user-defined code word that
precedes or follows a command, such as "sesame," then speaking a
command such as "turn on the living room lights." In some
embodiments, in addition or in alternate to voice identification,
fingerprint identification may be used to determine an identify of
a user. Specific functions of television receiver 150 may require
that a user log in, such as via a fingerprint scanner, before being
able to view and/or modify such functions.
[0065] Referring to FIG. 2, light controller 220 may permit a light
to be turned on, off, and/or dimmed by television receiver 150 or
overlay device 251 (such as based on a user command received via
wireless device 216 or directly via television receiver 150 or
overlay device 251). Light controller 220 may control a single
light. As such, multiple different light controllers 220 may be
present within a house. In some embodiments, a physical light
switch (which opens and closes a circuit of the light) may be left
in the on position such that light controller 220 can be used to
control whether the light is on or off. Light control 220 may be
integrated into a light bulb or into a circuit (such as between the
light fixture and the power source) to control whether the light is
on or off. The user, via television receiver 150 or overlay device
251 may be permitted to view a status of all light controllers 220
within a location. Since television receiver 150 or overlay device
251 may communicate using different home automation protocols,
different light controllers 220 (and, more generally, different
home automation devices) within a location may use disparate
communication protocols, but may all still be controlled by
television receiver 150 or overlay device 251. In some embodiments,
wireless light switches may be used that communicate with
television receiver 150 or overlay device 251. Such switches may
use a different communication protocol than light controllers 220.
Such a difference may not affect functionality because television
receiver 150 or overlay device 251 can serve as a hub for multiple
disparate communication protocols and perform any necessary
translation and/or bridging functions. For example, a tablet
computer may transmit a command over a WiFi connection and
television receiver 150 or overlay device 251 may translate the
command into an appropriate Zigbee or Zwave command for a wireless
light bulb. In some embodiments, the translation may occur for a
group of disparate devices. For example, a user decides to turn off
all lights in a room and selects a lighting command on the tablet
computer. The overlay device 251 identifies the lights in the room
and outputs appropriate commands to all devices over different
protocol, such as a Zigbee wireless lightbulb and a Zwave table
lamp. Television receiver 150 may permit timers and/or dimmer
settings to be set for lights via light controller 220. For
instance, lights can be configured to turn on/off at various times
during a day according to a schedule (and/or events being detected
by the home automation system).
[0066] Referring again to FIG. 2, thermostat 222 may communicate
with television receiver 150 or overlay device 251. Thermostat 222
may provide heating/cooling updates on the location to television
receiver 150 or overlay device 251 for display via display device
160 and/or wireless device 216. Further, control of thermostat 222
may be effectuated via television receiver 150 or overlay device
251. Zone control within a structure using multiple thermostats may
also be possible.
[0067] Leak detection sensor 224 of FIG. 2 may be in communication
with television receiver 150 or overlay device 251 and may be used
to determine when a water leak as occurred, such as in pipes
supplying water-based fixtures with water. Leak detection sensor
224 may be configured to attach to the exterior of a pipe and
listen for a sound of water moving within a pipe. In other
embodiments, sonar, temperature sensors or ion infused water with
appropriate sensors may be used to detect moving water. As such,
cutting or otherwise modifying plumbing may not be necessary to use
leak detection sensor 224. If water movement is detected for
greater than a threshold period of time, it may be determined a
leak is occurring. Leak detection sensor 224 may have a component
that couples over an existing valve such that the flow of water
within one or more pipes can be stopped. For instance, if leak
detection sensor 224 determines a leak may be occurring, a
notification may be provided to a user via wireless device 216
and/or display device 160 by television receiver 150 or overlay
device 251. If a user does not clear the notification, the flow of
water may be shut off by leak detection sensor 224 after a
predefined period of time. A user may also be able to provide input
to allow the flow of water to continue or to immediately interrupt
the flow of water.
[0068] In FIG. 2, the home automation system may utilize various
rules to determine whether a leak is occurring. For example, a
measurement threshold may be utilized in the event that water is
flowing to an ice machine. The amount of water typically drawn by
such a device may be known, if the flow rate and/or flow time
significantly exceeds normal operating parameters, it may be
determined that a leak is occurring. In some embodiments, the home
automation system may communicate with appliances to determine
whether water is flowing to the device. For example, a home
automation system may communicate with a washing machine in
operation to determine that water is flowing to the appliance, and
thus, determine that a water leak is not occurring. If no appliance
is using water (and, possibly, it is known that no user is home) it
may be determined that a leak is occurring. In other embodiments,
data from various motion sensors may be utilized. For example, if
the system identifies that users have left the home, but a large
flow of water is occurring, then the system may determine that a
leak is occurring and notify a user or take remedial steps
accordingly.
[0069] Further shown in FIG. 2, VoIP (voice over IP) controller 225
may permit television receiver 150 to serve as a hub for a home
phone system. One or more conventional telephones may be connected
with television receiver 150. Calls may be converted to IP by
television receiver 150 and allow for calls to be received and
placed via network 270, which is connected with the Internet. The
need for a dedicated home phone line may thus be eliminated. In
some embodiments, a cellular back channel (e.g., via a cellular
modem) may be utilized as a backup to other types of internet
connections, such as DSL, cable modems or satellite internet.
[0070] Appliance controller 226 of FIG. 2 may permit a status of an
appliance to be retrieved and commands to control operation to be
sent to an appliance by television receiver 150 or overlay device
251. For instance, appliance controller 226 may control a washing
machine, a dryer, a dishwasher, an oven, a microwave, a
refrigerator, a toaster, a coffee maker, a hot tub, or any other
form of appliance. Appliance controller 226 may be connected with
the appliance or may be integrated as part of the appliance.
[0071] Appliances and other electronic devices may also be
monitored for electricity usage. For instance, US Pat. Pub. No.
2013/0318559, filed Nov. 19, 2012, to Crabtree, entitled "Apparatus
for Displaying Electrical Device Usage Information on a Television
Receiver," which is hereby incorporated by reference, may allow for
information regarding the electricity usage of one or more devices
(e.g., other home automation devices or circuits within a home that
are monitored) to be determined. Control of one or more home
automation devices may be dependent on electrical usage and stored
electrical rates. For instance, a washing machine may be activated
in the evening when rates are lower. Additionally or alternatively,
operation of devices may be staggered to help prevent consuming too
much power at a given time. For instance, an electric heater may
not be activated until a dryer powered via the same circuit is
powered down.
[0072] Garage door controller 228 of FIG. 2 may permit a status of
a garage door to be checked and the door to be opened or closed by
a user via television receiver 150 or overlay device 251. In some
embodiments, based on a location of wireless device 216, the garage
door may be controlled. For instance, if wireless device 216 is a
cellular phone and it is detected to have moved a threshold
distance away from a house having a garage door controller 228
installed, a notification may be sent to wireless device 216. If no
response is received within a threshold period of time, the garage
may be automatically shut. If wireless device 216 moves within a
threshold distance of garage door controller 228, the garage may be
opened.
[0073] Lock controller 230 of FIG. 2 may permit a door to be locked
and unlocked and/or monitored by a user via television receiver 150
or overlay device 251. In some embodiments, lock controller 230 may
have an integrated door sensor 208 to determine if the door is
open, shut, or partially ajar. Being able to only determine if a
door is locked or unlocked may not be overly useful--for instance,
a lock may be in a locked position, but if the door is ajar, the
lock may not prevent access to the house. Therefore, for security,
a user may benefit from knowing both that a door is closed (or
open) and locked (or unlocked). To accomplish such notification and
control, lock controller 230 may have an integrated door sensor 208
that allows for the single lock controller 230 to lock/unlock a
door and provide a status as to whether the door is open or shut.
Therefore, a single device may control a lock and determine whether
the associated door is shut or open. No mechanical or electrical
component may need to be integrated separately into a door or
doorframe to provide such functionality. Such a single device may
have a single power source that allows for sensing of the lock
position, sensing of the door position, and for
engagement/disengagement of the lock. Lock controller 230 may have
an integrated door sensor that includes a reed switch or proximity
sensor that detects when the door is in a closed position, with a
plate of the lock in proximity to a plate on the door frame of the
door. For instance, a plate of the lock may have an integrated
magnet or magnetized doorframe plate. When in proximity to the
magnet, a reed switch located in lock controller 230 may be used to
determine that the door is closed; when not in proximity to the
magnet, the reed switch located in lock controller 230 may be used
to determine that the door is at least partially ajar. Rather than
using a reed switch, other forms of sensing may also be used, such
as a proximity sensor to detect a doorframe. In some embodiments,
the sensor to determine the door is shut may be integrated directly
into the deadbolt or other latching mechanism of lock controller
230. When the deadbolt is extended, a sensor may be able to
determine if the distal end of the deadbolt is properly latched
within a door frame based on a proximity sensor or other sensing
means.
[0074] A home security system 207 of FIG. 2 may be integrated with
a home automation system. The home security system 207 may detect
motion, when a user has armed/disarmed the home security system
207, when windows/doors are opened or broken, etc. Television
receiver 150 may adjust settings based of home automation devices
based on home security system 207 being armed or disarmed. A
virtual control and alarm panel may be presented to a user via a
display device 160 and television receiver 150. The functions of a
wall mounted panel alarm can be integrated in the graphical user
interface of the TV viewing experience such as a menu system with
an underlying tree structure. The virtual control and alarm panel
can appear in a full screen or Picture-in-Picture (PiP) with TV
content. Alarms and event notification can be in the form of
scrolling text overlays, popups, flashing icons, etc. Camera video
(e.g., from camera 212) can be integrated with the standard DVR
content of television receiver 150 with additional search, zoom,
time-line capabilities. The camera's video stream can be displayed
full screen, PiP with TV content, or as a tiled mosaic to display
multiple camera's streams at a same time. In some embodiments, the
display can switch between camera streams at fixed intervals.
Television receiver 150 may perform video scaling, adjust frame
rate and transcoding on video received from camera 212. In
addition, television receiver 150 may adaptively transcode the
camera content to match an Internet connection.
[0075] Irrigation controller 232 of FIG. 2 may allow for a status
and control of an irrigation system (e.g., sprinkler system) to be
controlled by a user via television receiver 150 and/or overlay
device 251. Irrigation controller 232 may be used in conjunction
with weather sensor 206 to determine whether and/or for how long
irrigation controller 232 should be activated for watering.
Further, a user, via television receiver 150 and/or overlay device,
may turn on, turn off, or adjust settings of irrigation controller
232.
[0076] One or more motion sensors can be incorporated into one or
more of the previously detailed home automation devices or as a
stand-alone device. Such motion sensors may be used to determine if
a structure is occupied. Such information may be used in
conjunction with a determined location of one or more wireless
devices. If some or all users are not present in the structure,
home automation settings may be adjusted, such as by lowering a
temperature of thermostat 222, shutting off lights via light
controller 220, and determining if one or more doors are closed by
door sensor 208. In some embodiments, a user-defined script may be
run when it is determined that no users or other persons are
present within the structure.
[0077] Additional forms of sensors not illustrated in FIG. 2 may
also be incorporated as part of a home automation system. For
instance, a mailbox sensor may be attached to a mailbox to
determine when mail is present and/or has been picked up. The
ability to control one or more showers, baths, and/or faucets from
television receiver 150 and/or wireless device 216 may also be
possible. Pool and/or hot tub monitors may be incorporated into a
home automation system. Such sensors may detect whether or not a
pump is running, water temperature, pH level, a splash/whether
something has fallen in, etc. Further, various characteristics of
the pool and/or hot tub may be controlled via the home automation
system. In some embodiments, a vehicle dashcam may upload or
otherwise make video/audio available to television receiver 150
when within range. For instance, when a vehicle has been parked
within range of a local wireless network with which television
receiver 150 is connected, video and/or audio may be transmitted
from the dashcam to the television receiver for storage and/or
uploading to a remote server.
[0078] The home automation functions detailed herein that are
attributed to television receiver 150 may alternatively or
additionally be incorporated into overlay device 251. As such, a
separate overlay device 251 may be connected with display device
160 to provide home automation functionality.
[0079] Turning now to FIG. 3, an embodiment of a television
receiver 300, which may represent television receiver 150 of FIG. 1
and/or FIG. 2, is illustrated. Television receiver 300 may be
configured to function as a host for a home automation system
either alone or in conjunction with a communication device, such as
communication device 252 of FIG. 2. Television receiver 300 may be
in the form of a separate device configured to be connected with a
display device, such as a television. Embodiments of television
receiver 300 can include set top boxes (STBs). In addition to being
in the form of an STB, a television receiver may be incorporated as
part of another device, such as a television, other form of display
device, video game console, computer, mobile phone or tablet or the
like. For example, a television may have an integrated television
receiver (which does not involve an external STB being coupled with
the television).
[0080] As shown in FIG. 3, television receiver 300 may be
incorporated as part of a television, such as display device 160 of
FIG. 1. Television receiver 300 may include: processors 310 (which
may include control processor 310-1, tuning management processor
310-2, and possibly additional processors), tuners 315, network
interface 320, non-transitory computer-readable storage medium 325,
electronic programming guide (EPG) database 330, television
interface 335, digital video recorder (DVR) database 345 (which may
include provider-managed television programming storage and/or
user-defined television programming), on-demand programming
database 327, home automation settings database 347, home
automation script database 348, remote control interface 350,
security device 360, and/or descrambling engine 365. In other
embodiments of television receiver 300, fewer or greater numbers of
components may be present. It should be understood that the various
components of television receiver 300 may be implemented using
hardware, firmware, software, and/or some combination thereof.
Functionality of components may be combined; for example, functions
of descrambling engine 365 may be performed by tuning management
processor 310-2. Further, functionality of components may be spread
among additional components.
[0081] In FIG. 3, processors 310 may include one or more
specialized and/or general-purpose processors configured to perform
processes such as tuning to a particular channel, accessing and
displaying EPG information from EPG database 330, and/or receiving
and processing input from a user. It should be understood that the
functions performed by various modules of FIG. 3 may be performed
using one or more processors. As such, for example, functions of
descrambling engine 365 may be performed by control processor
310-1.
[0082] Control processor 310-1 of FIG. 3 may communicate with
tuning management processor 310-2. Control processor 310-1 may
control the recording of television channels based on timers stored
in DVR database 345. Control processor 310-1 may also provide
commands to tuning management processor 310-2 when recording of a
television channel is to cease. In addition to providing commands
relating to the recording of television channels, control processor
310-1 may provide commands to tuning management processor 310-2
that indicate television channels to be output to decoder module
333 for output to a display device. Control processor 310-1 may
also communicate with network interface 320 and remote control
interface 350. Control processor 310-1 may handle incoming data
from network interface 320 and remote control interface 350.
Additionally, control processor 310-1 may be configured to output
data via network interface 320.
[0083] Control processor 310-1 of FIG. 3 may include the home
automation engine 311. Home automation engine 311 may permit
television receiver 300 and control processor 310-1 to provide home
automation functionality. Home automation engine 311 may have a
JSON (JavaScript Object Notation) command interpreter or some other
form of command interpreter that is configured to communicate with
wireless devices via network interface 320 and a message server
(possibly via a message server client). Such a command interpreter
of home automation engine 311 may also communicate via a local area
network with devices (without using the Internet). Home automation
engine 311 may contain multiple controllers specific to different
protocols; for instance, a ZigBee.RTM. controller, a Z-Wave.RTM.
controller, and/or an IP camera controller (wireless LAN, 802.11)
may be present. Home automation engine 311 may contain a media
server configured to serve streaming audio and/or video to a remote
devices (on a local area network or the Internet). Television
receiver may be able to serve such devices with recorded content,
live content, and/or content recorded using one or more home
automation devices, such as camera 212.
[0084] Tuners 315 of FIG. 3 may include one or more tuners used to
tune to transponders that include broadcasts of one or more
television channels. Such tuners may be used also to receive for
storage on-demand content and/or credit-earning television
commercials and/or home automation functions. In some embodiments,
two, three, or more than three tuners may be present, such as four,
six, or eight tuners. Each tuner contained in tuners 315 may be
capable of receiving and processing a single transponder stream
from a satellite transponder (or from a cable network) at a given
time. As such, a single tuner may tune to a single transponder
stream at a given time. If tuners 315 include multiple tuners, one
tuner may be used to tune to a television channel on a first
transponder stream for display using a television, while another
tuner may be used to tune to a television channel on a second
transponder for recording and viewing at some other time. If
multiple television channels transmitted on the same transponder
stream are desired, a single tuner of tuners 315 may be used to
receive the signal containing the multiple television channels for
presentation and/or recording. Tuners 315 may receive commands from
tuning management processor 310-2. Such commands may instruct
tuners 315 to which frequencies are to be tuned.
[0085] Network interface 320 of FIG. 3 may be used to communicate
via an alternate communication channel with a television service
provider, if such communication channel is available. A
communication channel may be via satellite (which may be
unidirectional to television receiver 300) and the alternate
communication channel (which may be bidirectional) may be via a
network, such as the Internet. Data may be transmitted from
television receiver 300 to a television service provider system and
from the television service provider system to television receiver
300. Information may be transmitted and/or received via network
interface 320. For instance, instructions from a television service
provider may also be received via network interface 320, if
connected with the Internet. Besides the primary communication
channel being satellite, cable network, an IP-based network, or
broadcast network may be used. Network interface 320 may permit
wireless communication with one or more types of networks,
including using home automation network protocols and wireless
network protocols. Also, wired networks may be connected to and
communicated with via network interface 320. Device interface 321
may represent a USB port or some other form of communication port
that permits communication with a communication device.
[0086] Storage medium 325 of FIG. 3 may represent one or more
non-transitory computer-readable storage mediums. Storage medium
325 may include memory and/or a hard drive. Storage medium 325 may
be used to store information received from one or more satellites
and/or information received via network interface 320. Storage
medium 325 may store information related to on-demand programming
database 327, EPG database 330, DVR database 345, home automation
settings database 347, and/or home automation script database 348.
Recorded television programs may be stored using storage medium 325
as part of DVR database 345. Storage medium 325 may be partitioned
or otherwise divided (such as into folders) such that predefined
amounts of storage medium 325 are devoted to storage of television
programs recorded due to user-defined timers and stored television
programs recorded due to provider-defined timers.
[0087] Home automation settings database 347 of FIG. 3 may allow
configuration settings of home automation devices and user
preferences to be stored. Home automation settings database 347 may
store data related to various devices that have been set up to
communicate with television receiver 300. For instance, home
automation settings database 347 may be configured to store
information on which types of events should be indicated to users,
to which users, in what order, and what communication methods
should be used. For instance, an event such as an open garage may
only be notified to certain wireless devices (e.g., a cellular
phone associated with a parent, not a child), notification may be
by a third-party notification server, email, text message, and/or
phone call. In some embodiments, a second notification method may
only be used if a first fails. For instance, if a notification
cannot be sent to the user via a third-party notification server,
an email may be sent.
[0088] Home automation settings database 347 of FIG. 3 may store
information that allows for the configuration and control of
individual home automation devices which may operate using Z-wave
and Zigbee--specific protocols. To do so, home automation engine
311 may create a proxy for each device that allows for settings for
the device to be passed through a UI (e.g., presented on a
television) to allow for settings to be solicited for and collected
via a user interface presented by television receiver or overlay
device. The received settings may then be handled by the proxy
specific to the protocol, allowing for the settings to be passed on
to the appropriate device. Such an arrangement may allow for
settings to be collected and received via a UI of the television
receiver or overlay device and passed to the appropriate home
automation device and/or used for managing the appropriate home
automation device.
[0089] Home automation script database 348 of FIG. 3 may store
scripts that detail how home automation devices are to function
based on various events occurring. For instance, if stored content
starts being played back by television receiver 300, lights in the
vicinity of display device 160 may be dimmed and shades may be
lowered by shade controller 204. As another example, when a user
shuts programming off late in the evening, there may be an
assumption the user is going to bed. Therefore, the user may
configure television receiver 300 to lock all doors via lock
controller 230, shut the garage door via garage controller 228,
lower a heat setting of thermostat 222, shut off all lights via
light controller 220, and determine if any windows or doors are
open via window sensor 210 and door sensor 208 (and, if so, alert
the user). Such scripts or programs may be predefined by the home
automation/television service provider and/or may be defined by a
user.
[0090] In some embodiments, home automation script database 248 of
FIG. 3 may allow for various music profiles to be implemented. For
instance, based on home automation settings within a structure,
appropriate music may be played. For instance, if the lights are
dimmed, romantic music may be played. Conversely, based on the
music being played, settings of home automation devices may be
determined. If television programming, such as a movie, is output
for playback by television receiver 150, a particular home
automation script may be used to adjust home automation settings
(e.g., lower lights, raise temperature, and lock doors).
[0091] EPG database 330 of FIG. 3 may store information related to
television channels and the timing of programs appearing on such
television channels. EPG database 330 may be stored using storage
medium 325, which may be a hard drive or solid-state drive.
Information from EPG database 330 may be used to inform users of
what television channels or programs are popular and/or provide
recommendations to the user. Information from EPG database 330 may
provide the user with a visual interface displayed by a television
that allows a user to browse and select television channels and/or
television programs for viewing and/or recording. Information used
to populate EPG database 330 may be received via network interface
320, via satellite, or some other communication link with a
television service provider (e.g., a cable network). Updates to EPG
database 330 may be received periodically. EPG database 330 may
serve as an interface for a user to control DVR functions of
television receiver 300, and/or to enable viewing and/or recording
of multiple television channels simultaneously. EPG database 340
may also contain information about on-demand content or any other
form of accessible content.
[0092] Decoder module 333 of FIG. 3 may serve to convert encoded
video and audio into a format suitable for output to a display
device. For instance, decoder module 333 may receive MPEG video and
audio from storage medium 325 or descrambling engine 365 to be
output to a television. MPEG video and audio from storage medium
325 may have been recorded to DVR database 345 as part of a
previously-recorded television program. Decoder module 333 may
convert the MPEG video and audio into a format appropriate to be
displayed by a television or other form of display device and audio
into a format appropriate to be output from speakers, respectively.
Decoder module 333 may have the ability to convert a finite number
of television channel streams received from storage medium 325 or
descrambling engine 365, simultaneously. For instance, decoders
within decoder module 333 may be able to only decode a single
television channel at a time. Decoder module 333 may have various
numbers of decoders.
[0093] Television interface 335 of FIG. 3 may serve to output a
signal to a television (or another form of display device) in a
proper format for display of video and playback of audio. As such,
television interface 335 may output one or more television
channels, stored television programming from storage medium 325
(e.g., television programs from DVR database 345, television
programs from on-demand programming 330 and/or information from EPG
database 330) to a television for presentation. Television
interface 335 may also serve to output a CVM.
[0094] Still referring to FIG. 3, digital Video Recorder (DVR)
functionality may permit a television channel to be recorded for a
period of time. DVR functionality of television receiver 300 may be
managed by control processor 310-1. Control processor 310-1 may
coordinate the television channel, start time, and stop time of
when recording of a television channel is to occur. DVR database
345 may store information related to the recording of television
channels. DVR database 345 may store timers that are used by
control processor 310-1 to determine when a television channel
should be tuned to and its programs recorded to DVR database 345 of
storage medium 325. In some embodiments, a limited amount of
storage medium 325 may be devoted to DVR database 345. Timers may
be set by the television service provider and/or one or more users
of television receiver 300.
[0095] DVR database 345 of FIG. 3 may also be used to record
recordings of service provider-defined television channels. For
each day, an array of files may be created. For example, based on
provider-defined timers, a file may be created for each recorded
television channel for a day. For example, if four television
channels are recorded from 6-10 PM on a given day, four files may
be created (one for each television channel). Within each file, one
or more television programs may be present. The service provider
may define the television channels, the dates, and the time periods
for which the television channels are recorded for the
provider-defined timers. The provider-defined timers may be
transmitted to television receiver 300 via the television
provider's network. For example, in a satellite-based television
service provider system, data necessary to create the
provider-defined timers at television receiver 150 may be received
via satellite.
[0096] Still referring to FIG. 3, as an example of DVR
functionality of television receiver 300 being used to record based
on provider-defined timers, a television service provider may
configure television receiver 300 to record television programming
on multiple, predefined television channels for a predefined period
of time, on predefined dates. For instance, a television service
provider may configure television receiver 300 such that television
programming may be recorded from 7 to 10 PM on NBC, ABC, CBS, and
FOX on each weeknight and from 6 to 10 PM on each weekend night on
the same channels. These channels may be transmitted as part of a
single transponder stream such that only a single tuner needs to be
used to receive the television channels. Packets for such
television channels may be interspersed and may be received and
recorded to a file. If a television program is selected for
recording by a user and is also specified for recording by the
television service provider, the user selection may serve as an
indication to save the television program for an extended time
(beyond the time which the predefined recording would otherwise be
saved). Television programming recorded based on provider-defined
timers may be stored to a portion of storage medium 325 for
provider-managed television programming storage.
[0097] On-demand programming database 327 of FIG. 3 may store
additional television programming. On-demand programming database
327 may include television programming that was not recorded to
storage medium 325 via a timer (either user- or provider-defined).
Rather, on-demand programming may be programming provided to the
television receiver directly for storage by the television receiver
and for later presentation to one or more users. On-demand
programming may not be user-selected. As such, the television
programming stored to on-demand programming database 327 may be the
same for each television receiver of a television service provider.
On-demand programming database 327 may include pay-per-view (PPV)
programming that a user must pay and/or use an amount of credits to
view. For instance, on-demand programming database 327 may include
movies that are not available for purchase or rental yet.
Typically, on-demand programming is presented commercial-free.
[0098] Referring back to tuners 315 of FIG. 3, television channels
received via satellite (or cable) may contain at least some
scrambled data. Packets of audio and video may be scrambled to
prevent unauthorized users (e.g., nonsubscribers) from receiving
television programming without paying the television service
provider. When a tuner of tuners 315 is receiving data from a
particular transponder of a satellite, the transponder stream may
be a series of data packets corresponding to multiple television
channels. Each data packet may contain a packet identifier (PID),
which can be determined to be associated with a particular
television channel. Particular data packets, referred to as
entitlement control messages (ECMs), may be periodically
transmitted. ECMs may be associated with another PID and may be
encrypted; television receiver 300 may use decryption engine 361 of
security device 360 to decrypt ECMs. Decryption of an ECM may only
be possible if the user has authorization to access the particular
television channel associated with the ECM. When an ECM is
determined to correspond to a television channel being stored
and/or displayed, the ECM may be provided to security device 360
for decryption.
[0099] When security device 360 of FIG. 3 receives an encrypted
ECM, security device 360 may decrypt the ECM to obtain some number
of control words. In some embodiments, from each ECM received by
security device 360, two control words are obtained. In some
embodiments, when security device 360 receives an ECM, it compares
the ECM to the previously received ECM. If the two ECMs match, the
second ECM is not decrypted because the same control words would be
obtained. In other embodiments, each ECM received by security
device 360 is decrypted; however, if a second ECM matches a first
ECM, the outputted control words will match; thus, effectively, the
second ECM does not affect the control words output by security
device 360. Security device 360 may be permanently part of
television receiver 300 or may be configured to be inserted and
removed from television receiver 300, such as a smart card, cable
card or the like.
[0100] Tuning management processor 310-2 of FIG. 3 may be in
communication with tuners 315 and control processor 310-1. Tuning
management processor 310-2 may be configured to receive commands
from control processor 310-1. Such commands may indicate when to
start/stop receiving and/or recording of a television channel
and/or when to start/stop causing a television channel to be output
to a television. Tuning management processor 310-2 may control
tuners 315. Tuning management processor 310-2 may provide commands
to tuners 315 that instruct the tuners which satellite,
transponder, and/or frequency to tune to. From tuners 315, tuning
management processor 310-2 may receive transponder streams of
packetized data.
[0101] Descrambling engine 365 of FIG. 3 may use the control words
output by security device 360 in order to descramble video and/or
audio corresponding to television channels and/or home automation
functions for storage and/or presentation. Video and/or audio data
contained in the transponder data stream received by tuners 315 may
be scrambled. Video and/or audio data may be descrambled by
descrambling engine 365 using a particular control word. Which
control word output by security device 360 to be used for
successful descrambling may be indicated by a scramble control
identifier present within the data packet containing the scrambled
video or audio. Descrambled video and/or audio may be output by
descrambling engine 365 to storage medium 325 for storage (in DVR
database 345) and/or to decoder module 333 for output to a
television or other presentation equipment via television interface
335.
[0102] In some embodiments, the television receiver 300 of FIG. 3
may be configured to periodically reboot in order to install
software updates downloaded over the network 190 or satellites 130.
Such reboots may occur for example during the night when the users
are likely asleep and not watching television. If the system
utilizes a single processing module to provide television receiving
and home automation functionality, then the security functions may
be temporarily deactivated. In order to increase the security of
the system, the television receiver 300 may be configured to reboot
at random times during the night in order to allow for installation
of updates. Thus, an intruder is less likely to guess the time when
the system is rebooting. In some embodiments, the television
receiver 300 may include multiple processing modules for providing
different functionality, such as television receiving functionality
and home automation, such that an update to one module does not
necessitate reboot of the whole system. In other embodiments,
multiple processing modules may be made available as a primary and
a backup during any installation or update procedures.
[0103] For simplicity, television receiver 300 of FIG. 3 has been
reduced to a block diagram; commonly known parts, such as a power
supply, have been omitted. Further, some routing between the
various modules of television receiver 300 has been illustrated.
Such illustrations are for exemplary purposes only. The state of
two modules not being directly or indirectly connected does not
indicate the modules cannot communicate. Rather, connections
between modules of the television receiver 300 are intended only to
indicate possible common data routing. It should be understood that
the modules of television receiver 300 may be combined into a fewer
number of modules or divided into a greater number of modules.
Further, the components of television receiver 300 may be part of
another device, such as built into a television. Television
receiver 300 may include one or more instances of various
computerized components, such as disclosed in relation to computer
system 700 of FIG. 7.
[0104] While the television receiver 300 has been illustrated as a
satellite-based television receiver, it is to be appreciated that
techniques below may be implemented in other types of television
receiving devices, such a cable receivers, terrestrial receivers,
IPTV receivers or the like. In some embodiments, the television
receiver 300 may be configured as a hybrid receiving device,
capable of receiving content from disparate communication networks,
such as satellite and terrestrial television broadcasts. In some
embodiments, the tuners may be in the form of network interfaces
capable of receiving content from designated network locations. The
home automation functions of television receiver 300 may be
performed by an overlay device. If such an overlay device,
television programming functions may still be provided by a
television receiver that is not used to provide home automation
functions. In another aspect, one or more home automations
functions may be performed by a voice command engine 370, which may
be incorporated in the home automation engine 311 as shown and/or
in the storage medium 325. For example, the voice command engine
370 may provide for speaker-dependent commands to be implemented in
the home automation system, as described in further detail in the
following paragraphs.
[0105] Turning now to FIG. 4, an example method 400 for controlling
a device in a home automation system, such as the home automation
system 200, based on a speaker-dependent command is provided. The
method 400 may be implemented by the voice command engine 370,
which may be incorporated in the home automation engine 311 that is
found in the television receiver 150 and/or the overlay device 251.
The method 400 shown, and any other methods disclosed herein, may
include additional and/or alternative steps in relation to the
steps being shown. Further, any steps may be optional, rearranged,
and/or combined. Numerous variations are possible.
[0106] As shown in FIG. 4, the method 400 may include receiving a
voice command 402. The voice command 402 may be a spoken voice
command provided by a user, e.g. a speaker on the premises having
the home automation system 200, and directed to adjusting a state
of one or more devices in the home automation system 200. Merely by
way of example, the speaker may be an adult located in a living
room of a house equipped with the home automation system 200 and
the spoken voice command from the adult may include, "Lower the
heat by five degrees." Such spoken voice commands may be detected
by one or more microphones in operative communication with the
voice command engine 370. For example, the microphone(s) utilized
by the voice command engine 370 may be found on any television
receiver, a television remote control, and/or any of the home
automation devices in the home automation system 200, such as the
intercom 218, display device 160, home security 207, camera 212,
health sensor 214, or any other device shown in FIG. 2. The voice
command may be communicated to the voice command engine 370 via a
local wireless area network, a wired network, a home automation
network, and/or any other type of communications network. Other
examples are possible.
[0107] In another example, the voice command received by the voice
command engine 370 may be provided for by the speaker via a mobile
device, such as the wireless device 216, which may represent a
tablet computer, cellular phone, laptop computer, remote computer,
or some other device through which a user may desire to control
home automation settings and view home automation information.
Voice commands may be detected by a microphone of the wireless
device 216, which may further encode and/or transmit the detected
voice command to the voice command engine 370 via a communications
network. In this case, the voice command engine 370 may receive the
voice command from a remotely-located microphone, e.g. a mobile
device and speaker not located on the premises having the home
automation system 200, and further decode the voice command signal.
In some cases, the wireless device 216 may support a mobile
application or app that is configured to detect, encode and/or and
transmit the voice command to the voice command engine 370. In
another example, the voice command engine 370 connects to a VoIP
platform and receives voice commands via VoIP, or traditional phone
calls via a cellular or landline network. Still, other examples are
possible. Further, other sensors for detecting the voice command
may be possible.
[0108] In some cases, the received voice command may be preceded by
a spoken code-word that is received by the voice command engine 370
in a similar manner as described above. It is contemplated that
such code-words, or phrases, such as code-word "Sesame" preceding
the command, "Lower the heat by five degrees," may be user-defined
and/or pre-programmed. In some cases, a code-word may be directed
to activating or otherwise indicating to the voice command engine
370 an incoming voice command. In other cases, the code-word may be
user-specific and indicate a speaker identity and/or speaker
verification to the voice command engine 370. The code-word may
serve as a password or passcode for controlling any devices in the
home automation system 200, and may be device-specific,
alternatively and/or additionally to being user-specific.
[0109] In still other examples, the code-word may be utilized to
alter operational settings of other modules or devices in operation
with the voice command engine 370 to implement one or more settings
for receiving the voice command. Merely by way of example, various
or all components of the voice command engine 370 may be in a sleep
mode until the code-word is detected at the engine 370 and/or a
television receiver, whereupon the voice command engine 370 may be
activated by an activation module therein and/or by a signal from
the television receiver. This may prepare the voice command engine
370 for receiving the voice command and for performing subsequent
steps thereafter. In another example, a volume level of a
television or other speaker may be lowered in preparation for
receiving the voice command at the voice command engine 370.
[0110] In still further examples, the voice command engine 370 may
acknowledge the code-word and/or the speaker identity prior to
receiving the voice command. For example, the voice command engine
370, upon activation in response to the spoken code-word, may
output in speech and/or text format on a display screen, "Yes,
Sam?" to indicate the voice command engine 370 is active and/or to
indicate a determined speaker identity of the code-word. Following
that responsive prompt, the voice command engine 370 may activate
one or more microphones to receive the voice command and/or provide
further prompts and receive further responses to clarify the
speaker identity and/or clarify the intentions of the voice
command. It is noted that activating one or more microphones may
include determining if a microphone is in closer proximity to the
speaker, turning that microphone on and switching an original
microphone that picked up the code-word to an off state. This may
ensure quality and accuracy of the voice detection and subsequent
voice recognition process.
[0111] In yet another example, the voice command engine 370 may
determine that more than one speaker is giving voice commands at
any given time. In that case, if the voice commands include
conflicting orders, the voice command engine 370 may determine the
plurality of speaker identities involved and determine which
speaker identity has the higher level of permission, e.g. adult or
child, and implement the voice command of the higher-ranked speaker
in remaining steps of the method 400. In some cases, the voice
command engine 370 may confirm denial of certain voice commands
and/or output a reason for denying such commands. Similarly, the
voice command engine 370 may confirm reception of the voice
command, and/or repeat the received voice command as a confirmation
to the speaker immediately after receiving the voice command.
Still, other examples are possible.
[0112] As further shown in FIG. 4, the method 400 may include
determining a speaker identity 404. In some cases, the voice
command engine 370 may perform a voice recognition analysis to
determine a speaker identity of the received voice command. For
instance, the voice command engine 370 may analyze a speech
pattern, voice pitch, speaking style, accent, and/or other aspects
of speech to determine an identity of the speaker. In some cases,
the received voice command, and/or portions thereof, is compared
against one or more voice samples in a database of voices, e.g. a
voice database of the voice command engine 370 as shown in FIG. 5.
The voice database may include one or more voice samples associated
with one or more speaker identities. When a match is determined by
the voice command engine 370 in comparing the voice command to the
voice sample(s), the speaker identity may be determined, and/or
tentatively determined and output for final confirmation from the
speaker.
[0113] Additionally and/or alternatively, the voice command engine
370 may perform the voice recognition analysis to verify that a
speaker is who they say they are. For instance, the voice command
engine 370 may detect that the speaker has identified herself in
the voice command and/or code-word, or otherwise. In that case, the
voice command engine 370 may treat the speaker-provided
identification as a tentative identity, and perform further voice
recognition analysis to verify the identity. Such analysis may be
performed utilizing the voice database as described above. It is
contemplated that such features may enhance secure access to the
controls for the home automation system 200. For instance, further
prompts and/or denial of access to the home automation system 200
may be implemented by the voice command engine 370 in response to
determining a false speaker verification.
[0114] Still referring to FIG. 4, the method 400 may include
determining a device for control 406. In some cases, the voice
command engine 370 may perform a speech recognition analysis to
identify one or more devices in the home automation system 200 that
are intended to be controlled by the received command. For
instance, the voice command engine 370 may convert the spoken voice
command to a digitally stored set of words. In some cases, all or a
portion of the set of words are compared to one or more device
names, such as device IDs, which may be stored in a database of
device names, e.g. a controls database of the voice command engine
370 as shown in FIG. 5. In that case, the voice command engine 370
may identify one or more words in the set of words that match one
or more device names in the controls database. The matched device
name(s) may indicate the intended device(s) for control.
[0115] In another example, the voice command engine 370 may utilize
speech recognition to determine one or more words or phrases in the
spoken voice command that may be related to a function of a device,
and determine the device to be controlled based on the function
revealed in the voice command. Merely by way of example, the voice
command engine 370 may determine that in the received voice command
for "Lower the heat by five degrees," no particular device was
verbally identified by the speaker. Additionally and/or
alternatively, the voice command engine 370 may determine that
certain portions of the voice command include command phrases, such
as the phrase "lower the heat" and/or the word "degrees". The
combination of the identified command phrases, and/or a command
phrase taken alone, may be sufficient for the voice command engine
370 to determine the device(s) to control. For instance, the voice
command engine 370 may compare one or more of the control phrases
to a database of control phrases, e.g. controls database of the
voice command engine 370 as shown in FIG. 5, whereby one or more
control phrases may each be associated with one or more device
names, e.g. device IDs. In this way, the voice command engine 370
may look-up or otherwise determine the intended device based on a
match of the identified command phrase(s) with one or a grouping of
control phrases that are associated with a device ID. In the
example voice command for "Lower the heat by five degrees," the
voice command engine 370 may determine that the device intended for
control is a thermostat, e.g. thermostat 222.
[0116] It is contemplated that such control phrases may be
determined based on a plurality of voice commands. For instance,
the voice command engine 370 may prompt the speaker for additional
voice commands and/or other input if an initially received command
was determined insufficient for determining a device. In another
aspect, the voice command engine 370 may determine a list of
possible device IDs indicating devices to control based on the
control phrase(s), and prompt the user for more information or
voice commands in order to narrow down the list of device IDs to
the determined device ID. It is further contemplated that other
cues may be captured by the voice command engine 370 via various
devices in the home automation system 200. For instance, a speaker
location may be detected by the one or devices and transmitted to
the voice command engine 370 to be utilized for determination of
the device to control. Merely by way of example, the camera 212 in
a living room may notify the voice command engine 370, via the home
automations network or other communications network, that the
speaker is located in the living room, as detected by the camera
212. Based on the additional information, the voice command engine
370 may lower the thermostat that controls the living room by five
degrees, while other thermostats in other parts of the house are
unaffected, e.g. the voice command engine 370 does not send the
command signal to other thermostats. In some examples, the voice
command engine 370 may query other devices, such as the camera 212,
for such additional information in order to determine the intended
device.
[0117] In still another aspect, the voice command engine 370 may
implement speech recognition to determine a new state or status
being requested. For example, the voice command engine 370 may
determine "five degrees" to be a magnitude or unit of change for
the determined device, based on the example received voice command
of "Lower the heat by five degrees." In another example, the voice
command engine 370 may determine that "on" is a new state in an
example received voice command of "Turn the light on." In another
aspect, control phrases may be user-defined and/or pushed from a
satellite to the controls database during periodic updates from,
for example, the home automation service server 112 via satellite
connections and/or the network 190, as shown in FIG. 1. In this
way, it is contemplated that the controls database stays current
and relevant to the devices connected to the home automation system
200. Still, other examples are possible.
[0118] Referring again to FIG. 4, the method 400 may include
determining a permission of the speaker to control the identified
device(s) 408. In some cases, the voice command engine 370 may
determine a permission status to control the identified device(s).
The permission status may be based on the determined speaker
identity and/or the identified device(s) to control. It is
contemplated that the permission status enhances safety and
security of the home automation system 200 by having the voice
command engine 370 by prohibit otherwise undesirable controls from
being implemented. In another aspect, the permission status allows
the voice command engine 370 to provide greater flexibility for
user(s), who may set when certain commands are forbidden and when
certain commands are allowable.
[0119] Merely by way of example, the permission status determined
by the voice command engine 370 may include an access granted
status and/or an access denied status. The permission status may be
determined based on one or more variables, such as the speaker
identity, access settings associated with the speaker identity such
as parental controls settings, the identified control phrases in
the voice command, the device for control, the code words, voice
samples, a current status of the device to control or other devices
in the home automation system, and so on. In another example, other
variables, such as time of day, may be considered by the voice
command engine 370 in determining the permission status. In some
cases where the voice command engine 370 determines that a
plurality of devices are intended for control, the voice command
engine 370 may determine a plurality of permission statuses. For
example, the voice command engine 370 may determine that some of
the plurality of identified devices have a granted status, while
others of the same plurality of identified devices have an access
denied status. In other examples, the voice command engine 370 may
determine the permission status that none of the plurality of
devices are permitted for control. In still other examples, the
voice command engine 370 may determine the access granted status
for the permission status of all of the plurality of determined
devices.
[0120] Referring yet again to FIG. 4, in some examples, the method
400 may include transmitting a control signal, e.g. operational
command, to the determined device 410. For instance, the voice
command engine 370 may control the identified device(s) in the home
automation system 200 based on the determined permission status. In
one example, the voice command engine 370 may transmit an
operational command signal to the identified device based on the
access granted permission status. In another example, the voice
command engine 370 may generate the operational command based on a
communication protocol, e.g. Zigbee.RTM., Z-Wave.RTM., specific to
the identified device and/or transmit the generated operational
command to the device using the communication protocols in the home
automation network 200. Further examples may be possible. For
instance, the method 400 may further include outputting a
confirmation notification that indicates a new state of the
identified device, whereby the new state is based on the received
voice command. It is noted that step 410 is optional and may be
dependent on the permission status being determined as an access
granted status. Additionally, it is noted that any of the steps in
the method 400 may be optional. Further, it is noted that a
plurality of control signals may be delivered to a plurality of
identified devices when necessary.
[0121] In another example, the voice command engine 370 may output,
after determining an access denied permission status, a
notification to inform the speaker that the desired control was not
implemented. Such notifications may include speech notifications,
sounds, text on display screens, and so on. In that case, the voice
command engine 370 may maintain a current state of the identified
device and/or not transmit any control signal to the identified
device. Other examples are possible.
[0122] Turning now to FIG. 5, example modules of the voice command
engine 370 that may provide the method 400, and/or any other
features disclosed herein, is shown. The voice command engine 370
may be incorporated in the home automation engine 311 that is found
in the television receiver 150 and/or the overlay device 251. In
one example, the voice command engine 370 is provided for in the
control processor 310-1 and/or the storage medium 325 of the
television receiver 300 as shown in FIG. 3. It is contemplated that
various modules of the voice command engine 370 can be provided for
by different parts of the television receiver 300, and/or any
computer system such as the disclosed computer system 700 in FIG.
7. It is noted that the modules may be arranged in any manner and
in operative communication with one another. Further, it is noted
that any of the modules may be rearranged, optional, and/or
additional modules may be included in the voice command engine 370.
In general, it is contemplated that the voice command engine 370
may identify a user, e.g. a speaker, and push an operational
command to a home automation device if access for the user is
authorized.
[0123] As shown in the schematic block diagram of the voice command
engine 370 of FIG. 5, the voice command engine 370 may include a
database 502 that may be divided into, or otherwise include, a
voice database 504, a settings database 506, and/or a controls
database 508. The voice database 504 may include stored voice
samples 510 and/or code words 512. The settings database 506 may
include speaker identities 514 and/or access settings 516. The
controls database 508 may include control phrases 518 and/or device
identifications 520. It is noted that any of the data type modules
may be commonly shared among the databases 504,506,508, and that
any of the modules may be optional and/or mapped to associate with
each other. In one example, the speaker identities 514 may be
stored in the voice database and the code words 512 may be stored
in the settings database 506. Other examples are possible.
[0124] Voice samples 510 may be gathered and stored for each user
of the voice command engine 370 during an initial setup. For
example, the voice command engine 370 may receive one or more voice
samples during the initial setup, and/or associate such voice
samples with speaker identities 514 for each user. Such voice
samples may be captured by a microphone in communication with the
voice command engine 370 and/or consist of certain voice commands,
predetermined phrases, and/or personalized phrases. Merely by way
of example, a training session may be initiated during the initial
setup to train the voice command engine 370 to a speaker's voice by
collecting audio samples of the speaker and associating the audio
samples with the speaker's identity. The associated one or more
voice samples with the speaker's identity may be stored in the
voice database 504, and/or the database 502 in general.
[0125] Code words 512 may be received by the voice command engine
370 during an initial setup and upon detection by a microphone
connected thereto. In some cases, the code-word may be user
configured and assigned to a specific speaker, e.g. specific
speaker identity. In other examples, a code-word may be assigned to
multiple speaker identities. In still other examples, the code-word
may be a general code-word that precedes any voice command to be
received by the voice command engine 370, and is not associated
with a particular speaker. Such code-words may be use-configured
and/or preprogrammed, and may consist of a word or a phrase. In
still other examples, specific code-words may be associated with
particular locations or rooms containing certain devices. For
instance, a speaker in a living room may use "Sesame" as a
code-word preceding a voice command, "Lower the heat by five
degrees," to indicate to the voice command engine 370 that the
device to control is in the living room. On the other hand, the
speaker may use a different code-word, e.g. "Genie, lower the heat
by five degrees," to indicate to the voice command engine 370 that
the speaker is in a different room, such as a kitchen, and
therefore the kitchen thermostat is intended for control. In this
way, it is contemplated that the voice command engine 370 may
utilize the code-word to distinguish particular device(s) to
control.
[0126] In another example, the code words 512 may be utilized to
start up one or more components of the voice command engine 370
upon detection thereof. For example, specific words may be spoken
by a user to get attention from the voice command engine 370. In
that case, the voice command engine 370 and/or a device in
operative communication with, or containing, the engine 370 may
continuously search for an activation-type code word. For instance,
the voice command engine 370 may continuously search for and
identify a set of words and/or unique inflections to determine that
the voice command engine 370 is about to receive a voice command.
In another aspect, the code words may serve as authentication
phrases or passwords to access the controls of the voice command
engine 370, and/or as identifying phrases to determine a speaker
identity, device identity, locations, and so on.
[0127] Speaker identities 514 may be received through text and/or
captured by a microphone during an initial set-up phase of the
voice command engine 370. The speaker identity may be
user-configured and/or include a speaker's first name, last name,
and/or nickname. In practice, a speaker may identify herself by
stating her speaker identity, whereupon the voice command engine
370 may use voice recognition analysis to further verify that the
speaker is not providing a false identity. Upon detection of a
false identity, the voice command engine 370 may output a
notification regarding denied access, a prompt to restate the
speaker identity, and/or notify other recipient devices, e.g.
mobile devices of other users, of the attempted access.
[0128] It is contemplated that the voice command engine 370 may
look up one or more voice samples associated with the speaker
identity to verify the speaker. In another example, the speaker
provide a voice command, and the voice command engine 370 may
analyze the voice command for a match with one or more of the voice
samples 510, which are further mapped to one or more speaker
identities. In that case, the voice command engine 370 may
determine the speaker identity based on voice recognition. In still
other examples, the database 502 may provide a list of unavailable
speaker identities. For example, a speaker may not be able to
select, during the initial setup, a name that is also a device
name, e.g. device identity. Other unavailable speaker identities
may be user configured and/or preprogrammed. Further, in some
examples, the voice command engine 370 may prohibit device
identities to overlap with speaker identities.
[0129] Access settings 516 may be user-configurable and associated
with one or more speaker identities. For example, the voice command
engine 370 may store the one or more access settings associated
with the speaker identity as a user profile. In one example, a user
profile is a child's profile with parental control access settings
implemented. Such access settings may be user-configured, e.g.
configured by a parent, and include, merely by way of example,
denying voice commands related to altering operation of a
thermostat, unlocking a front door, using the television based on a
user-specified time of day, and so on. The access settings, upon
lookup by the voice command engine 370, may allow and/or prevent
operational signals to be transmitted to certain determined
devices. In another example, the access settings may be associated
with particular device identities and/or code words. In still other
examples, access settings may include storing a user's mobile
device identification and communications information, so that the
user may communicate with the voice command engine 370 from a
remote location. Other examples are possible.
[0130] Control phrases 518 may be received during the initial
setup, downloaded, and/or otherwise pushed to the voice command
engine 370 upon installation of a device to the home automation
system 200 and/or from the home automation service server 112 as
shown in FIG. 1. Each control phrase may include a word and/or a
string of words that may indicate operational settings and/or
changes thereof, e.g. "turn on," "lower heat," "degrees" and so on.
In some cases, the control phrases are associated with a device
identity, and/or any other type of module shown in FIG. 5. In that
case, the control phrases 518 include functions based on the
device(s) connected to the home automation system 200. In other
cases, the control phrases 518 may include user-configured
commands. It is contemplated that the control phrases 518 includes
a master library of permissible commands that may be altered and
built without an internet connection, e.g. pushed via a television
distribution system and/or satellite. Further examples of control
phrases may include, "show me," e.g. for a voice command "Show me
the front door;" "record", e.g. for a voice command "Record channel
2 from 8 pm to 10 pm;" "call," e.g. for a voice command "Call 911."
As in the latter example, further processes, e.g.
restriction-related authorizations, may be implemented by the voice
command engine 370 prior transmitting an operational signal to a
device, e.g. telephone. In another aspect, it is contemplated that
control phrases may be detected by a microphone and processed using
speech recognition by the voice command engine 370, and
subsequently added to the database 502.
[0131] In a different aspect, a control phrase may simply include a
device identity or nickname. For instance, if a device
operationally toggles between two settings, e.g. on/off, the
control phrase for operation of the device may be the device name
itself. Upon detection of the device name as the control phrase,
the voice command engine 370 may transmit signals to the device to
toggle between two or more functions. Merely by way of example,
instead of speaking "Turn on the living room lights," a speaker may
simply state the device itself, "Living room lights." The voice
command engine 370 may transmit a signal to the living room lights
to turn the lights on, or off if the lights are already determined
to be in an on state by the voice command engine 370. The voice
command engine 370 may first detect additional conditions via other
devices in the home automation system 200 that may further
facilitate which control setting to transmit to the device. For
instance, the voice command engine 370 may detect that user has
entered a location, e.g. the living room, and/or determine a state
of the device, e.g. that the living room lights are off. In that
case, the voice command engine 370 detects the location of the user
and a condition of the identified device, and generates and/or
transmits an operational signal to render a second possible
condition at the device.
[0132] Device identities 520 may include one or more device names
or nicknames for devices in the home automation system 200 that are
controllable via the voice command engine 370. The device identity
may be user-configured, via detection by a microphone and
subsequent speech recognition analysis by the voice command engine
370, and/or by a textual input from the user. The device identity
may be linked to other data, such as voice samples, code words,
and/or access settings, such that the voice command engine 370 may
use the database 502 to look up which device should be implemented
based on any other received data. In some cases, if a device is not
recognized or otherwise found to be in the database 502 after
detection of a voice command, the voice command engine 370 may
prompt the speaker to set up the device for voice recognition
controls. In other cases, the voice command engine 370 may notify
the speaker that no device is available for operation in the home
automation system 200.
[0133] Further shown in FIG. 5, the voice command engine 370 may
include a speech recognition analyzer 522. The speech recognition
analyzer 522 may determine one or more words or phrases in the
received voice command that may be related to a function of a
device, and determine the device to be controlled based on the
function revealed in the voice command. The speech recognition
analyzer 522 may further be utilized in identifying one or more
devices in the home automation system 200 that are intended to be
controlled by the received command. If detected speech is not
recognized, the voice recognition engine 370 may prompt the speaker
to repeat spoken voice command(s) and/or other responses, and/or
enter the command via another medium, e.g. by textual input. It is
contemplated that functions of the speech recognition analyzer 522
may be updated via a television distribution system and/or
satellite system. Merely by way of example, the speech recognition
analyzer 522 may be a multilingual platform, whereby a user may
select one or more languages to implement for speech
recognition.
[0134] Still referring to FIG. 5, the voice command engine 370 may
include a voice recognition analyzer 524 to perform voice
recognition analysis as described above. The voice recognition
analyzer 524 may also include multilingual functions, and include
features that are updated via a television distribution system
and/or satellite system. It is contemplated that the voice
recognition analyzer 524, and/or the speech recognition analyzer
522, may be trained during initial setup and/or user profile setup
via the voice command engine 370.
[0135] Referring again to FIG. 5, the voice command engine 370 may
include a permissions status analyzer 528 to determine if a voice
command is permissible and if an operational signal based on the
voice command should be generated and/or transmitted to the
intended device. For example, the permissions status analyzer 528
may utilize the determined speaker identity, device identity,
access settings, code words, and other determined data for the
voice command to determine if an operational signal should be
generated. The permissions status analyzer 528 may determine if
additional prompts and information should be provided prior to
transmission of such operational signals. Further, the permissions
status analyzer 528 may determine the access granted or access
denied status, as described previously.
[0136] Still referring to FIG. 5, the voice command engine 370 may
include a home automation systems interface 526. The home
automations systems interface 526 may ensure communications between
the voice command engine 370 and various different devices having
different protocols in the home automation system 370 are
seamlessly integrated. For example, the home automation systems
interface 526 may implement device-specific communications
protocols to ensure that signals transmitted to the devices from
the engine 370, and/or received by the engine 370, comply with one
another. In one example, the voice command engine 370 may detect a
channel change at a remote control and prompt the user with a
request to "Identify yourself," prior to sending an operational
signal for changing to a certain channel. In that case, the voice
command engine 370 may provide an intermediary control between a
device and its dedicated controller, e.g. the television and the
remote control. In another aspect, the home automations system
interface 526 may permit the voice command engine 370 to signal to
a television to lower or mute a volume level while audio output
from the voice command engine 370 is underway, for example, through
an intercom system. After a voice command sequence is completed,
the home automation systems interface 526 may resume volume levels
back to previous settings. Other examples are possible.
[0137] As further shown in FIG. 5, the voice command engine 370 may
include a microphone interface 530 to receive voice input detected
by one or more microphones that may be scattered about the home
automation system 200. The microphone interface 530 may be
configured to encode and/or decode any signals operatively
communicated with the microphones. In one example, a microphone may
be located at a remote control having one or more features of the
voice command engine 370. The remote control may process and
analyze the voice command to decrease data processing requirements
at a television receiver, which may provide additional features of
the voice command engine 370. In another example, the microphone
interface 530 may be in operative communication with a microphone
located in each room of house.
[0138] As shown in FIG. 5, the voice command engine 370 may further
provide a conversations module 532. The conversations module 532
may be responsible for disambiguation processes, including carrying
conversations and/or additional queries directed to receiving
additional information related to a received voice command. For
example, the voice command engine 370 may receive a voice command
for "Close the windows in the living room" and the conversations
module 532 may instruct the engine 370 to further inquire, "All
windows?" for clarification. In general, the conversations module
532 may be utilized to interact with the speaker for further
information at any point when such information is needed. The
conversations module 370, and any other modules shown herein, may
be in sync and operatively connected with any other modules of the
voice command engine 370. It is noted that the conversations module
532, and/or any other modules shown herein, may be multilingual to
facilitate multilingual operations of the voice command engine 370.
Other examples are possible.
[0139] As further shown in FIG. 5, the voice command engine 370 may
include a notifications module 534, which may be responsible for
various audio, textual, or other notifications output by the voice
command engine 370. Such notifications may relay when a trigger is
detected, such as when an access is denied, when a new status
change based on the voice command has been successfully implemented
at the device, and so on. In another example, mass notifications
may be transmitted from the voice command engine 370 to a plurality
of recipients and their various devices. For example, the voice
command engine may notify, via one or more communications networks,
a plurality of mobile devices based on detection of an unauthorized
voice command or other trigger. In still another aspect, the
notifications module 534 may initiate communications with law
enforcement and/or emergency responders, directly and/or via other
devices in the home automation system 200. Other examples are
possible.
[0140] Turning now to FIG. 6, another method 600 for controlling
home automation systems with speaker-dependent commands is shown.
The method 600 may include the steps shown in any order and any
additional steps. Further, any steps may be optional. It is
contemplated that the method 600 is provided for by the voice
command engine 370 of FIG. 5.
[0141] As shown in FIG. 6, the method 600 may include receiving a
code word (step 602), which may include a user-configured or
predefined code word. After receiving the code word, the voice
command engine 370 may receive a voice command directed to a device
in the home automation system (step 604). In some examples, the
voice command engine 370 may prompt the speaker for additional
input, such as additional instructions to clarify the voice command
(step 606). Based on the received voice command and subsequent
inputs, the voice command engine 370 may determine one or more
device(s) to control, and/or a speaker identity (step 608). It is
contemplated that with some voice commands, the speaker identity
may not be required in order for the voice command engine 370 to
implement an intended control at an intended device. Such special
settings may be defined by the user during setup.
[0142] Still referring to FIG. 6, the method 600 may include
determining if control according to the received voice command is
permitted (step 610). In some examples where control is not
permitted, e.g. the access is denied based on the permissions
status analyzer 528, the voice command engine 370 may maintain a
current state of the intended device (step 618) by not generating
or otherwise transmitting an operational signal to the intended
device. The voice command engine 370 may further output
notification of the denied command. Such notifications may include
audio, visual, and/or textual notification to the speaker via
various devices in the home automation system 200.
[0143] Referring again to FIG. 6, in another example, the voice
command engine 370 may determine that a voice command is permitted
for altering a state of the intended device. In that case, the
voice command engine 370 may generate a protocol-specific
operational command (step 612) according to requirements of the
intended device, and transmit the operational command to the
intended device via the communications protocol. In further
examples, the voice command engine 370 may output notification
relaying the new state of the device (step 616). Merely by way of
example, after transmitting the operational command to the device,
the voice command engine 370 may provide a follow-up query to the
device for an update in order to determine if the changed operation
has been implemented. After implementation is detected, the voice
command engine may provide one or more notifications of the change
to the user, and/or to other devices in the home automation system
200. Such notifications may include audio, visual, and/or textual
notifications to the speaker via various devices in the home
automation system 200.
[0144] Referring now to FIG. 7, a computer system as illustrated in
FIG. 7 may be incorporated as part of the previously described
computerized devices, such as the wireless devices, television
receivers, overlay devices, communication devices, any of the home
automation devices, the television service provider system, the
voice command engine 370, etc. FIG. 7 provides a schematic
illustration of one embodiment of a computer system 700 that can
perform various steps of the methods provided by various
embodiments. It should be noted that FIG. 7 is meant only to
provide a generalized illustration of various components, any or
all of which may be utilized as appropriate. FIG. 7, therefore,
broadly illustrates how individual system elements may be
implemented in a relatively separated or relatively more integrated
manner.
[0145] The computer system 700 is shown comprising hardware
elements that can be electrically coupled via a bus 705 (or may
otherwise be in communication, as appropriate). The hardware
elements may include one or more processors 710, including without
limitation one or more general-purpose processors and/or one or
more special-purpose processors (such as digital signal processing
chips, graphics acceleration processors, video decoders, and/or the
like); one or more input devices 715, which can include without
limitation a mouse, a keyboard, remote control, and/or the like;
and one or more output devices 720, which can include without
limitation a display device, a printer, and/or the like.
[0146] The computer system 700 may further include (and/or be in
communication with) one or more non-transitory storage devices 725,
which can comprise, without limitation, local and/or network
accessible storage, and/or can include, without limitation, a disk
drive, a drive array, an optical storage device, a solid-state
storage device, such as a random access memory ("RAM"), and/or a
read-only memory ("ROM"), which can be programmable,
flash-updateable and/or the like. Such storage devices may be
configured to implement any appropriate data stores, including
without limitation, various file systems, database structures,
and/or the like.
[0147] The computer system 700 might also include a communications
subsystem 730, which can include without limitation a modem, a
network card (wireless or wired), an infrared communication device,
a wireless communication device, and/or a chipset (such as a
Bluetooth.TM. device, an 802.11 device, a WiFi device, a WiMax
device, cellular communication device, etc.), and/or the like. The
communications subsystem 730 may permit data to be exchanged with a
network (such as the network described below, to name one example),
other computer systems, and/or any other devices described herein.
In many embodiments, the computer system 700 will further comprise
a working memory 735, which can include a RAM or ROM device, as
described above.
[0148] The computer system 700 also can comprise software elements,
shown as being currently located within the working memory 735,
including an operating system 740, device drivers, executable
libraries, and/or other code, such as one or more application
programs 745, which may comprise computer programs provided by
various embodiments, and/or may be designed to implement methods,
and/or configure systems, provided by other embodiments, as
described herein. Merely by way of example, one or more procedures
described with respect to the method(s) discussed above might be
implemented as code and/or instructions executable by a computer
(and/or a processor within a computer); in an aspect, then, such
code and/or instructions can be used to configure and/or adapt a
general purpose computer (or other device) to perform one or more
operations in accordance with the described methods.
[0149] A set of these instructions and/or code might be stored on a
non-transitory computer-readable storage medium, such as the
non-transitory storage device(s) 725 described above. In some
cases, the storage medium might be incorporated within a computer
system, such as computer system 700. In other embodiments, the
storage medium might be separate from a computer system (e.g., a
removable medium, such as a compact disc), and/or provided in an
installation package, such that the storage medium can be used to
program, configure, and/or adapt a general purpose computer with
the instructions/code stored thereon. These instructions might take
the form of executable code, which is executable by the computer
system 700 and/or might take the form of source and/or installable
code, which, upon compilation and/or installation on the computer
system 700 (e.g., using any of a variety of generally available
compilers, installation programs, compression/decompression
utilities, etc.), then takes the form of executable code.
[0150] It will be apparent to those skilled in the art that
substantial variations may be made in accordance with specific
requirements. For example, customized hardware might also be used,
and/or particular elements might be implemented in hardware,
software (including portable software, such as applets, etc.), or
both. Further, connection to other computing devices such as
network input/output devices may be employed.
[0151] As mentioned above, in one aspect, some embodiments may
employ a computer system (such as the computer system 700) to
perform methods in accordance with various embodiments of the
invention. According to a set of embodiments, some or all of the
procedures of such methods are performed by the computer system 700
in response to processor 710 executing one or more sequences of one
or more instructions (which might be incorporated into the
operating system 740 and/or other code, such as an application
program 745) contained in the working memory 735. Such instructions
may be read into the working memory 735 from another
computer-readable medium, such as one or more of the non-transitory
storage device(s) 725. Merely by way of example, execution of the
sequences of instructions contained in the working memory 735 might
cause the processor(s) 710 to perform one or more procedures of the
methods described herein.
[0152] The terms "machine-readable medium," "computer-readable
storage medium" and "computer-readable medium," as used herein,
refer to any medium that participates in providing data that causes
a machine to operate in a specific fashion. These mediums may be
non-transitory. In an embodiment implemented using the computer
system 700, various computer-readable media might be involved in
providing instructions/code to processor(s) 710 for execution
and/or might be used to store and/or carry such instructions/code.
In many implementations, a computer-readable medium is a physical
and/or tangible storage medium. Such a medium may take the form of
a non-volatile media or volatile media. Non-volatile media include,
for example, optical and/or magnetic disks, such as the
non-transitory storage device(s) 725. Volatile media include,
without limitation, dynamic memory, such as the working memory
735.
[0153] Common forms of physical and/or tangible computer-readable
media include, for example, a floppy disk, a flexible disk, hard
disk, magnetic tape, or any other magnetic medium, a CD-ROM, any
other optical medium, any other physical medium with patterns of
marks, a RAM, a PROM, EPROM, a FLASH-EPROM, any other memory chip
or cartridge, or any other medium from which a computer can read
instructions and/or code.
[0154] Various forms of computer-readable media may be involved in
carrying one or more sequences of one or more instructions to the
processor(s) 710 for execution. Merely by way of example, the
instructions may initially be carried on a magnetic disk and/or
optical disc of a remote computer. A remote computer might load the
instructions into its dynamic memory and send the instructions as
signals over a transmission medium to be received and/or executed
by the computer system 700.
[0155] The communications subsystem 730 (and/or components thereof)
generally will receive signals, and the bus 705 then might carry
the signals (and/or the data, instructions, etc. carried by the
signals) to the working memory 735, from which the processor(s) 710
retrieves and executes the instructions. The instructions received
by the working memory 735 may optionally be stored on a
non-transitory storage device 725 either before or after execution
by the processor(s) 710.
[0156] It should further be understood that the components of
computer system 700 can be distributed across a network. For
example, some processing may be performed in one location using a
first processor while other processing may be performed by another
processor remote from the first processor. Other components of
computer system 700 may be similarly distributed. As such, computer
system 700 may be interpreted as a distributed computing system
that performs processing in multiple locations. In some instances,
computer system 700 may be interpreted as a single computing
device, such as a distinct laptop, desktop computer, or the like,
depending on the context.
[0157] The methods, systems, and devices discussed above are
examples. Various configurations may omit, substitute, or add
various procedures or components as appropriate. For instance, in
alternative configurations, the methods may be performed in an
order different from that described, and/or various stages may be
added, omitted, and/or combined. Also, features described with
respect to certain configurations may be combined in various other
configurations. Different aspects and elements of the
configurations may be combined in a similar manner. Also,
technology evolves and, thus, many of the elements are examples and
do not limit the scope of the disclosure or claims.
[0158] Specific details are given in the description to provide a
thorough understanding of example configurations (including
implementations). However, configurations may be practiced without
these specific details. For example, well-known circuits,
processes, algorithms, structures, and techniques have been shown
without unnecessary detail in order to avoid obscuring the
configurations. This description provides example configurations
only, and does not limit the scope, applicability, or
configurations of the claims. Rather, the preceding description of
the configurations will provide those skilled in the art with an
enabling description for implementing described techniques. Various
changes may be made in the function and arrangement of elements
without departing from the spirit or scope of the disclosure.
[0159] Also, configurations may be described as a process which is
depicted as a flow diagram or block diagram. Although each may
describe the operations as a sequential process, many of the
operations can be performed in parallel or concurrently. In
addition, the order of the operations may be rearranged. A process
may have additional steps not included in the figure. Furthermore,
examples of the methods may be implemented by hardware, software,
firmware, middleware, microcode, hardware description languages, or
any combination thereof. When implemented in software, firmware,
middleware, or microcode, the program code or code segments to
perform the necessary tasks may be stored in a non-transitory
computer-readable medium such as a storage medium. Processors may
perform the described tasks.
[0160] Having described several example configurations, various
modifications, alternative constructions, and equivalents may be
used without departing from the spirit of the disclosure. For
example, the above elements may be components of a larger system,
wherein other rules may take precedence over or otherwise modify
the application of the invention. Also, a number of steps may be
undertaken before, during, or after the above elements are
considered.
* * * * *