U.S. patent application number 17/533501 was filed with the patent office on 2022-03-17 for user action remote control.
The applicant listed for this patent is Computime Ltd.. Invention is credited to Wai-Leung Ha, Kairy Kai Lei, Gordon Qian.
Application Number | 20220083155 17/533501 |
Document ID | / |
Family ID | 1000005996985 |
Filed Date | 2022-03-17 |
United States Patent
Application |
20220083155 |
Kind Code |
A1 |
Ha; Wai-Leung ; et
al. |
March 17, 2022 |
User Action Remote Control
Abstract
The present invention supports the control of a plurality of
controlled devices. With three dimensional accelerometer
components, detection of a user action on a remote controller and
the orientation of the remote controller are viable through small
electronic devices. Aspects of the invention are based on the three
dimensional accelerometer components to provide a remote controller
that can detect the user action. Based on the user action, the
remote controller transmits a signal to the controlled device which
conveys the corresponding command. A selected controlled device may
be matched to the remote controller. The remote controller and
controlled device may also support a learning mode, in which the
controlled device sends a list of supported commands to the remote
controller. The remote controller then matches an associated action
with each command in the command list.
Inventors: |
Ha; Wai-Leung; (Hong Kong,
CN) ; Lei; Kairy Kai; (Shen Zhen City, CN) ;
Qian; Gordon; (Shen Zhen City, CN) |
|
Applicant: |
Name |
City |
State |
Country |
Type |
Computime Ltd. |
New Territories |
|
HK |
|
|
Family ID: |
1000005996985 |
Appl. No.: |
17/533501 |
Filed: |
November 23, 2021 |
Related U.S. Patent Documents
|
|
|
|
|
|
Application
Number |
Filing Date |
Patent Number |
|
|
15370777 |
Dec 6, 2016 |
11209913 |
|
|
17533501 |
|
|
|
|
12051618 |
Mar 19, 2008 |
9513718 |
|
|
15370777 |
|
|
|
|
Current U.S.
Class: |
1/1 |
Current CPC
Class: |
G06F 3/0346 20130101;
G08C 2201/10 20130101; H04N 21/42208 20130101; G06F 3/038 20130101;
G06F 3/017 20130101; H04N 21/42222 20130101; G08C 2201/32 20130101;
H04N 21/42204 20130101 |
International
Class: |
G06F 3/0346 20060101
G06F003/0346; G06F 3/01 20060101 G06F003/01; H04N 21/422 20060101
H04N021/422; G06F 3/038 20060101 G06F003/038 |
Claims
1. A method involving a remote control configured to wireless
transmit a command and comprising a memory configured to store a
plurality of mapping of motions, the method comprising:
determining, by the remote control, a physical orientation of the
remote control from among a plurality of predefined orientations;
selecting, by the remote control, a first mapping of motions from
among the plurality of mappings of motions based on the physical
orientation of the remote control, wherein the first mapping of
motions comprises motions each corresponding to a command;
receiving, by the remote control, an indication of a motion of the
remote control; selecting, by the remote control, the command from
the first mapping of motions based on the indication of the motion
of the remote control; and wirelessly transmitting, by the remote
control, the command for receipt by a first controlled device,
wherein the first mapping of motions corresponds to the first
controlled device, and a second mapping of motions corresponds to a
second controlled device, and wherein the first mapping of motions
and the second mapping of motions are not identical.
2. The method of claim 1, wherein selecting the command is further
based on a direction of the motion, and wherein the physical
orientation of the remote control is one of vertical and
horizontal, and wherein a first physical orientation is where an
X-axis of the remote control is facing upward relative to
ground.
3. The method of claim 1, wherein the indication of the motion of
the remote control is received from an accelerometer associated
with the remote control.
4. The method of claim 1, wherein the wirelessly transmitting the
command is performed via one or more of: infrared or radio
frequency.
5. The method of claim 1, wherein the command is associated with
one or more of: a volume of the first controlled device, a channel
displayed by the first controlled device, or a light level of the
second controlled device.
6. The method of claim 1, wherein the remote control comprises one
or more input keys, and wherein the selecting the command is
further based on a first input key of the one or more input keys
being pressed.
7. The method of claim 1, wherein the motion comprises a rotation
of the remote control.
8. A method involving a hand-held device, a first device, and a
second device, the method comprising: determining, by an
accelerometer associated with the hand-held device, a physical
orientation of the hand-held device from among a plurality of
predefined orientations comprising a first orientation where an
X-axis of the hand-held device is facing upward relative to ground;
selecting, by the hand-held device, a first mapping of motions from
among the plurality of mappings of motions based on the physical
orientation of the hand-held device, wherein the first mapping of
motions comprises motions each corresponding to a command;
receiving, from the accelerometer associated with the hand-held
device, an indication of a motion of the hand-held device, wherein
the motion is in a direction; selecting, by the hand-held device,
the command from the first mapping of motions based on the
indication of the motion of the hand-held device; and wirelessly
transmitting the command for receipt by the first device, wherein
the first mapping of motions corresponds to the first device, and a
second mapping of motions corresponds to the second device, and
wherein the first mapping of motions and the second mapping of
motions are not identical, and wherein the command is changed when
the physical orientation of the remote control is changed.
9. The method of claim 8, wherein the physical orientation of the
hand-held device is one of vertical and horizontal.
10. The method of claim 8, wherein the wirelessly transmitting the
command is performed via one or more of: infrared or radio
frequency.
11. The method of claim 8, wherein the command is associated with
one or more of: a volume of the second device, a channel displayed
by the second device, or a light level of the second device.
12. The method of claim 8, wherein the hand-held device comprises
one or more input keys, and wherein the selecting the command is
further based on a first input key of the one or more input keys
being pressed.
13. The method of claim 8, wherein the motion comprises a rotation
of the hand-held device, and wherein the selecting the command is
further based on the rotation.
14. A remote control comprising: one or more processors, and memory
storing instructions that, when executed by the one or more
processors, cause the remote control to: determine a physical
orientation of the remote control from among a plurality of
predefined orientations; selecting first mapping of motions from
among a plurality of mappings of motions based on the physical
orientation of the remote control, wherein the first mapping of
motions comprises motions each corresponding to a command;
receiving an indication of a motion of the remote control;
selecting the command from the first mapping of motions based on
the indication of the motion of the remote control; and wirelessly
transmitting the command for receipt by a first controlled device,
wherein the first mapping of motions corresponds to the first
controlled device, and a second mapping of motions corresponds to a
second controlled device, and wherein the first mapping of motions
and the second mapping of motions are not identical.
15. The remote control of claim 14, wherein the plurality of
predefined orientations of the remote control comprises vertical
and horizontal.
16. The remote control of claim 15, wherein the command
corresponding to the first controlled device is changed to a
command corresponding to the second controlled device when the
physical orientation of the remote control is changed.
17. The remote control of claim 14, wherein wirelessly transmitting
the command is performed via one or more of: infrared or radio
frequency.
18. The remote control of claim 14, wherein the command for the
first controlled device is associated with one or more of: a volume
of the first device, a channel displayed by the first device, or a
light level of the first device.
19. The remote control of claim 14, wherein the remote control
comprises one or more input keys, and wherein selecting the command
for the first device is further based on a first input key of the
one or more input keys being pressed.
20. The remote control of claim 14, wherein the motion comprises a
rotation of the remote control, and wherein selecting the command
for the first device is further based on its rotation.
Description
RELATED APPLICATIONS
[0001] This application is a Continuation of U.S. patent
application Ser. No. 15/370,777 (Attorney Docket No. 011398.00117),
filed on Dec. 6, 2016, which is a Continuation of U.S. patent
application Ser. No. 12/051,618 (Attorney Docket No. 011398.00047)
filed on Mar. 19, 2008 and granted as U.S. Pat. No. 9,513,718 on
Dec. 6, 2016. All of the aforementioned patent applications are
herein incorporated by reference in their entireties for all
purposes.
BACKGROUND OF THE INVENTION
[0002] Remote controllers for video and audio devices and home
appliances are very popular. Remote controllers typically use a
using key pad for input. With newly developed touch technologies,
input may be entered through a touch pad with a sliding or circular
input. However, end users still need to control the device with the
user's fingers. Moreover, having a dedicated remote controller for
each controlled device is not desirable when there are a plurality
of controlled devices. Consequently, a remote controller often
controls a plurality of devices.
[0003] There is a real market need to facilitate controlling a
plurality of controlled devices through a remote controller by a
user.
SUMMARY OF THE INVENTION
[0004] The present invention provides methods, computer readable
media, and apparatuses for remotely controlling a plurality of
controlled devices. With three dimensional accelerometer
components, detection of a user action on a remote controller and
the orientation of the remote controller are viable through small
electronic devices. Aspects of the invention are based on the three
dimensional accelerometer components to design a remote controller
that can detect the action of the user, e.g., flipping up, down, or
rotating the remote controller. Based on the user action, the
remote controller transmits a signal to the controlled device which
conveys the corresponding command. Targeted controlled devices
include, but are not limit to, window blinds, window shades,
projector screens, lighting fixtures, fans, air-conditioning
systems, audio and video equipment.
[0005] With another aspect of the invention, a remote controller
senses motion on the remote controller through an accelerometer.
Accelerometer information is processed to determine the orientation
of the remote controller in order to control a selected controlled
device from a plurality of controlled devices. Also, user actions
on the remote controller are determined from the accelerometer
information. A user action is converted to a command, and a signal
is transmitted to the selected device that conveys the command.
[0006] With another aspect of the invention, a user action is
matched to a plurality of predetermined actions. The matched action
is mapped to the corresponding command.
[0007] With another aspect of the invention, a selected controlled
device is matched to the remote controller. The selected controlled
device may be matched through preprogramming or by a user pressing
a match key on the controlled device.
[0008] With another aspect of the invention, a remote controller
and controlled device support a learning mode. The controlled
device sends the remote controller a list of supported commands.
The remote controller than matches an associated action with each
command in the command list.
[0009] With another aspect of the invention, when a remote
controller is essentially stationary, the remote controller enters
a standby mode in order to reduce power consumption.
BRIEF DESCRIPTION OF THE DRAWINGS
[0010] The foregoing summary of the invention, as well as the
following detailed description of exemplary embodiments of the
invention, is better understood when read in conjunction with the
accompanying drawings, which are included by way of example, and
not by way of limitation with regard to the claimed invention.
[0011] FIG. 1 shows a remote controller controlling a plurality of
controlled devices in accordance with an embodiment of the
invention.
[0012] FIG. 2 shows a block diagram of a remote controller in
accordance with an embodiment of the invention.
[0013] FIG. 3 shows a block diagram of a remote controller in
accordance with an embodiment of the invention.
[0014] FIG. 4 shows a block diagram of a controlled device in
accordance with an embodiment of the invention.
[0015] FIG. 5 shows different user actions that may be imposed on a
remote controller to control different controlled devices in
accordance with an embodiment of the invention.
[0016] FIG. 6 shows different user actions that may be imposed on a
remote controller to control different groups of lighting devices
in accordance with an embodiment of the invention.
[0017] FIG. 7 shows a flow diagram for a remote controller in
accordance with an embodiment of the invention.
DETAILED DESCRIPTION
[0018] With three dimensional accelerometer components, detection
of action and orientation are viable through small electronic
devices. Aspects of the invention are based on the three
dimensional accelerometer components to provide a remote control
that can detect the action of the user, e.g., flipping up, down, or
rotating the remote controller. Based on the user action, the
remote controller transmits a signal to the controlled device to
convey the corresponding command. Controlled devices include, but
are not limited to, window blinds, window shades, projector
screens, lighting fixtures, fans, air-conditioning systems, and
audio and video (A/V) equipment.
[0019] FIG. 1 shows system 100 in which remote controller 101
controls a plurality of controlled devices (e.g., controlled
devices 103-107) in accordance with an embodiment of the invention.
Controlled devices may be different types of devices, including a
television, window blinds, lighting fixture, audio/visual
equipment, and heating/air-conditioning (HVAC) system.
[0020] With an embodiment of the invention, remote controller 101
sends signals to controlled devices 103-107 over communications
channels 151-153, respectively. As shown in the exemplary
embodiment in FIG. 1, communications channels 151-153 are one-way
(from remote controller 101 to controlled device 103 or 105) so
that a command can be conveyed to the controlled device. Moreover,
communications channel 155 is two-way so that controlled device 107
can also send configuration information (e.g., the command list
supported by the controlled device) to remote controller 101 as
will be further discussed.
[0021] FIG. 2 shows block diagram 200 of remote controller 101 in
accordance with an embodiment of the invention. Remote controller
101 includes processor 201 that obtains accelerometer information
from accelerometer 203. Processor 201 processes the accelerometer
information to determine the orientation of remote controller 101
and to determine the user action (e.g., linearly up, linearly down,
or circular) that is imposed on remote controller 101. The user
action is subsequently mapped to a predetermined action, which
corresponds to a command for the controlled device. Processor 201
then instructs transceiver 205 to transmit a signal, which contains
command information, to the controlled device.
[0022] Remote controller 101 recognizes an action from the end user
that is applied to the remote controller. Exemplary actions that
can be detected from accelerometer 203 include: [0023] up swing
[0024] up swing with return [0025] down swing [0026] down swing
with return [0027] left swing [0028] left swing with return [0029]
right swing [0030] right swing with return [0031] clockwise circle
[0032] anti-clockwise circle [0033] slant up from left to right
[0034] slant up from right to left [0035] slant down from left to
right [0036] slant down from right to left
[0037] The user action is mapped to a predefined action, which
corresponds to a command. For example, remote controller 101 may
command a television to change to the next channel when moved with
an up swing with a return movement.
[0038] Referring to FIG. 1, remote controller 101 may control a
plurality of controlled devices. An output signal from remote
controller 101 can match a command with a user action recognized
for different devices. For example, when controlling the light
level of electric lamp, the user swings remote controller 101 up or
up with return. The action matches with the light level up command.
The light level of the lamp consequently will increase. The level
can also be proportional to the acceleration of the swing movement
by the user. The faster the acceleration, the brighter will be the
level. When the user swings remote controller 101 down or down with
return, the light level dims according to the acceleration
detected.
[0039] The user can swing remote controller 101 upward or up with a
return movement in order to move the window blinds upward. Remote
controller 101 consequently sends a signal to the window blinds
with a contained command to move the blinds upward. In order to
stop the upward action, the user can impose a clockwise or
anti-clockwise circular motion on remote controller 101.
[0040] Transceiver 205 may operate at different frequencies,
corresponding to radio frequency, infrared, and visible light.
Transceiver 205 typically comprises a transmitter portion and a
receiver portion that operate from a common frequency source so
that the transmit frequency and the receive frequency are related
by a constant frequency offset. If only one-way communication is
supported, transceiver 205 may be replaced with a transmitter
without a corresponding receiver.
[0041] Processor 201 may utilize display 207 to indicate the
selected controlled device being controlled for the corresponding
orientation of remote controller 101. For example, in the vertical
position, remote controller 101 may control a fan, while in the
vertical position remote controller 101 may control a lighting
system.
[0042] When remote controller 101 is resting at a predefined
orientation, e.g., horizontal or vertical, remote controller 101
enters the standby or sleep mode to reduce battery consumption.
Based on the application and the characteristics of a typical user,
one can experimentally determine an acceleration threshold below
which remote controller 101 is considered essentially stationary.
Also, when remote controller 101 is positioned at a certain
orientation for long time, remote controller 101 may enter into the
standby or sleep mode.
[0043] Referring to FIG. 1, one approach for matching the devices
103-107 and remote controller 101 is through preprogramming in
remote controller 101 and controlled devices 103-107.
[0044] Another approach is to use two-way transceiver for both
remote controller 101 and controlled devices 103-107. An input key
at a controlled device can be used as a matching key. When the
matching key of a selected controlled device is pressed by the
user, remote controller 101 can be moved to the corresponding
orientation and swing with a predefined pattern, e.g.,
Up.fwdarw.Down.fwdarw.Up.fwdarw.Down.fwdarw.Up for confirming with
the device.
[0045] The selected controlled device can have at least one key as
the "Matching" key to match the orientation of the remote to the
device. With other embodiments, an additional "Learning" key is
needed to enter both the selected controlled device and remote
controller 101 into the learning mode. In the learning mode, remote
controller 101 receives the command list from the selected
controller device. The user is consequently instructed to perform
appropriate actions for learning.
[0046] When remote controller 101 receives the command from the
selected controlled device with a list of commands for learning
corresponding actions, remote controller 101 enters into the action
learning mode. The corresponding command may be displayed either on
a light emitting diode (LED) indicator or a liquid crystal display
(LCD). The end user can teach remote controller 101 different
actions in order to control the selected controlled device.
[0047] FIG. 3 shows a block diagram 300 of remote controller 101 in
accordance with an embodiment of the invention. Processor 301
receives accelerometer information from accelerometer 303.
Processor 301 processes the accelerometer information in accordance
with computer-executable instructions from memory 311. Memory 311
may include different forms of computer-readable media that can be
accessed by processor 301. Computer-readable media may comprise
storage media and communication media. Storage media include
volatile and nonvolatile, removable and non-removable media
implemented in any method or technology for storage of information
such as computer-readable instructions, object code, data
structures, program modules, or other data. Communication media
include any information delivery media and typically embody data in
a modulated data signal such as a carrier wave or other transport
mechanism.
[0048] When processor 301 determines the user action imposed on
remote controller 101, processor 301 then converts the user action
into a command and inserts the command in the signal sent to the
controlled device through transceiver 305. Transceiver 305 includes
both transmitter 307 and receiver 309. However, if only one-way
communication is supported, transceiver 305 may be replaced with
transmitter 307.
[0049] FIG. 4 shows block diagram 400 of a controlled device (e.g.
controlled device 107) in accordance with an embodiment of the
invention. Processor 401 receives a signal through transceiver 405
in order to control the controlled device. Transceiver 405 includes
both transmitter 407 and receiver 409. However, if only one-way
communication is supported in which the controlled device only
receives a signal from controlled device 101, then transceiver 405
may be replaced with receiver 409.
[0050] Once processor 401 determines the command from the received
signal, processor 401 instructs the controlled device to execute
the command through control interface 413. For example, processor
401 may instruct a lighting fixture to increase the level of
intensity by increasing the duty cycle of the provided power signal
to a light.
[0051] The controlled device may also include input device 403 to
provide a key input when matching the controlled device to remote
controller 101 or to support the learning mode.
[0052] Processor 401 processes the signal from transceiver 405 in
accordance with computer-executable instructions from memory 411.
Memory 411 may include different forms of computer-readable media
that can be accessed by processor 401. Computer-readable media may
comprise storage media and communication media. Storage media
include volatile and nonvolatile, removable and non-removable media
implemented in any method or technology for storage of information
such as computer-readable instructions, object code, data
structures, program modules, or other data. Communication media
include any information delivery media and typically embody data in
a modulated data signal such as a carrier wave or other transport
mechanism.
[0053] FIG. 5 shows different user actions that may be imposed on
remote controller 500 to control different controlled devices in
accordance with an embodiment of the invention. Remote controller
500 may assume different physical shapes including a square,
rectangle, circular, eclipse, or sphere. The user can rotate remote
control 500 to a predefined orientation in order to control a
controlled device from a plurality of controlled devices. For
example, for rectangle remote control 500 as shown in FIG. 5: When
remote controller 500 is lifted with Y direction 503 upward, remote
controller 500 is used to control the fan speed of a fan. When
remote controller 500 is lifted with X direction 501 upward, remote
controller 500 is used to control light level 505.
[0054] FIG. 6 shows different user actions that may be imposed on
remote controller 600 to control different groups of lighting
devices in accordance with an embodiment of the invention. Remote
controller 600 has a circular shape remote control for multiple
lighting controls based on orientations 601-615. Remote controller
600 can control eight sets/groups of the lighting in any location.
For example, when remote controller 600 is rotated with arrow 4
pointing upward (corresponding to orientation 607, group 4 lighting
can be controlled by remote controller 600. In order to control
another group of lighting, the user can simply rotate remote
controller 600 with the corresponding orientation pointing
upward.
[0055] A corresponding indicator (e.g., LED display or LCD 207 as
shown in FIG. 2) may be used to indicate which device or device
group that remote controller 600 is currently controlling as
feedback to the end user.
[0056] Referring to FIG. 2, accelerometer 203 may provide
accelerometer information to three dimensions (X, Y, and Z).
Consequently, remote controller 101 can control numerous controller
devices.
[0057] FIG. 7 shows flow diagram 700 for a remote controller in
accordance with an embodiment of the invention. In step 701,
accelerometer information is obtained from accelerometer 203
(referring to FIG. 2). From the accelerometer information,
processor 101 determines the orientation of the remote controller
(e.g., whether the remote controller is positioned with vertically
or horizontally) in step 703. The selected controlled device is
determined from the orientation in step 705. If the user has
imposed an action on the controlled device (e.g., moving the remote
controller up or circularly), processor 201 determines the type of
user action in step 707. Processor 201 compares the user action to
the set of predefined actions and determines the corresponding
predefined action in step 709. The following Table illustrates a
set of predefined actions. If the user action matches one of the
predefined actions in step 711, processor 201 converts the user
action to the corresponding command and inserts the command in a
signal that is transmitted to the selected controlled device in
step 713. If the user action does not match one of the predefined
actions in step 711, then processor 201 generates an error
indication on display 207 in step 715. (For example, if the user
action is slant up left to right when controlling the window
blinds, then the user action is deemed to be in error.)
Alternatively, processor 201 may ignore the user command and wait
for the next valid user command.
TABLE-US-00001 TABLE MAPPING OF USER ACTIONS TO COMMANDS Predefined
Action Controlled Device Command Up swing Television Power on Down
swing Television Power off Right swing Television Channel up Left
swing Television Channel down Clockwise circle Television Volume up
Counter-clockwise circle Television Volume down Slant up left to
right Television Mute Slant down right to left Television Unmute Up
swing with return Window blinds Open blinds Up swing Window blinds
Open blinds Down swing with return Window blinds Close blinds Down
swing Window blinds Close blinds Clockwise circle Window blinds
Stop motion of blinds Counter-clockwise circle Window blinds Stop
motion of blinds
[0058] As can be appreciated by one skilled in the art, a computer
system with an associated computer-readable medium containing
instructions for controlling the computer system can be utilized to
implement the exemplary embodiments that are disclosed herein. The
computer system may include at least one computer such as a
microprocessor, digital signal processor, and associated peripheral
electronic circuitry.
[0059] Although the subject matter has been described in language
specific to structural features and/or methodological acts, it is
to be understood that the subject matter defined in the appended
claims is not necessarily limited to the specific features or acts
described above. Rather, the specific features and acts described
above are disclosed as example forms of implementing the
claims.
* * * * *