U.S. patent application number 11/927517 was filed with the patent office on 2009-04-30 for system and method for alternative communication.
This patent application is currently assigned to The Boeing Company. Invention is credited to William A. Harkness, Heidi J. Kneller, Calsee N. Robb, James P. Schalla, Buddy L. Sharpe.
Application Number | 20090109036 11/927517 |
Document ID | / |
Family ID | 40582134 |
Filed Date | 2009-04-30 |
United States Patent
Application |
20090109036 |
Kind Code |
A1 |
Schalla; James P. ; et
al. |
April 30, 2009 |
System and Method for Alternative Communication
Abstract
A system for alternative communication between at least one
passenger onboard a mobile platform (such as a train, marine
vessel, aircraft or automobile) and at least one system onboard the
mobile platform is provided. The system includes a camera that
acquires an image of the at least one passenger, and a camera
control module that generates gesture data that includes at least
one gesture recognized in the acquired image of the at least one
passenger. The system also includes an activation control module
that determines a function for the at least one system onboard the
mobile platform to perform based on the gesture data. The function
is selected from the group comprising: activation of a light,
notification of a crew member of the mobile platform, activation of
a ventilation fan, activation of a window shade, activation of an
entertainment system and combinations thereof.
Inventors: |
Schalla; James P.; (Seattle,
WA) ; Robb; Calsee N.; (Seattle, WA) ;
Harkness; William A.; (Everett, WA) ; Sharpe; Buddy
L.; (Mill Creek, WA) ; Kneller; Heidi J.;
(Bellevue, WA) |
Correspondence
Address: |
HARNESS DICKEY & PIERCE, PLC
P.O. BOX 828
BLOOMFIELD HILLS
MI
48303
US
|
Assignee: |
The Boeing Company
Chicago
IL
|
Family ID: |
40582134 |
Appl. No.: |
11/927517 |
Filed: |
October 29, 2007 |
Current U.S.
Class: |
340/573.1 ;
382/100; 382/209 |
Current CPC
Class: |
B64D 2011/0053 20130101;
B64D 11/0626 20141201; B64D 11/0015 20130101; G06F 3/017 20130101;
G06K 9/00335 20130101; B64D 45/0053 20190801 |
Class at
Publication: |
340/573.1 ;
382/100; 382/209 |
International
Class: |
G08B 23/00 20060101
G08B023/00; G06K 9/00 20060101 G06K009/00 |
Claims
1. A system for alternative communication between at least one
passenger onboard a mobile platform and at least one system onboard
the mobile platform comprising: a camera that acquires an image of
the at least one passenger; a camera control module that generates
gesture data that includes at least one gesture recognized in the
acquired image of the at least one passenger; and an activation
control module that determines a function for the at least one
system onboard the mobile platform to perform based on the gesture
data, the function selected from the group comprising: activation
of a light, notification of a crew member of the mobile platform,
activation of a gasper, activation of a window shade, activation of
an entertainment system and combinations thereof.
2. The system of claim 1, wherein the camera control module further
comprises: a gesture data store that stores a plurality of
gestures; and a camera module that generates the gesture data based
on a comparison between the acquired image and the plurality of
gestures stored in the gesture data store.
3. The system of claim 1, wherein the at least one gesture
comprises at least one hand gesture made by the at least one
passenger onboard the mobile platform.
4. The system of claim 1, wherein the activation control module
further comprises: a function data store that stores a plurality of
functions that correspond to each of the plurality of gestures; and
an activation module that generates function data that includes the
function for the at least one system onboard the mobile platform to
perform based on a comparison between the gesture data and the
plurality of functions stored in the function data store.
5. The system of claim 4, wherein the activation control module
further comprises: a call control module that receives the function
data and notifies the crew member of the mobile platform; a light
control module that receives the function data and activates or
deactivates the light associated with the at least one passenger; a
gasper control module that receives the function data and
activates, deactivates or adjusts a volume of air provided by the
gasper associated with the at least one passenger; a shade control
module that receives the function data and signals a motor coupled
to the window shade to raise or lower the window shade associated
with the at least one passenger; and an entertainment control
module that receives the function data and activates or deactivates
the entertainment system associated with the at least one
passenger.
6. A method of alternative communication between at least one
passenger onboard a mobile platform and at least one system onboard
the mobile platform comprising: acquiring an image of the at least
one passenger onboard the mobile platform; determining from the
acquired image if the at least one passenger made a gesture; and
activating the at least one system onboard the mobile platform
based on the gesture with the at least one system selected from a
group including a light, an attendant call button, a gasper, a
window shade, an entertainment system, and combinations
thereof.
7. The method of claim 6, wherein activating the at least one
system further comprises at least one of: activating the attendant
call button to notify a crew member that assistance is needed for
the at least one passenger; activating the light positioned over
the at least one passenger; activating the gasper positioned over
the at least one passenger; activating the window shade positioned
adjacent to the at least one passenger; activating the
entertainment system associated with the at least one passenger;
and activating combinations thereof.
8. The method of claim 7, wherein activating the light further
comprises: activating or deactivating the light based on the
gesture.
9. The method of claim 7, wherein activating the ventilation fan
further comprises: transmitting a signal to a motor coupled to the
gasper to rotate a housing of the ventilation fan into an opened or
a closed position based on the gesture.
10. The method of claim 9, wherein transmitting the signal to the
motor further comprises: transmitting a signal to the motor to
rotate the housing of the gasper into a position between the opened
and the closed position to adjust a volume of air provided by the
gasper based on the gesture.
11. The method of claim 7, wherein activating the window shade
further comprises: transmitting a signal to a motor coupled to the
window shade to raise or lower the window shade based on the
gesture.
12. The method of claim 7, wherein activating the entertainment
system further comprises: activating or deactivating entertainment
system the based on the gesture.
13. An aircraft comprising: a fuselage that includes at least one
passenger seating area, with the at least one passenger seating
area including an entertainment system and a passenger service unit
that includes a means for notifying a crew member onboard the
aircraft that the at least one passenger needs assistance, with
communication between at least one passenger seated in the at least
one passenger seating area, the entertainment system and passenger
service unit controlled by a communication system including: a
camera that acquires an image of the at least one passenger; and a
communication control module that determines, based on the acquired
image, if the at least one passenger has made a gesture to activate
a function of the entertainment system or the passenger service
unit, or if the at least one passenger has made a gesture that the
at least one passenger needs assistance.
14. The aircraft of claim 13, wherein the communication control
module further comprises: a camera control module that generates
gesture data that includes the gesture recognized in the acquired
image of the at least one passenger; and an activation control
module that determines, based on the gesture data, which function
of the entertainment system and the passenger service unit to
activate.
15. The aircraft of claim 14, wherein the camera control module
further comprises: a gesture data store that stores a plurality of
gestures; and a camera module that generates the gesture data based
on a comparison between the acquired image and the plurality of
gestures stored in the gesture data store.
16. The aircraft of claim 13, wherein the gesture comprises at
least one hand gesture made by the at least one passenger onboard
the aircraft.
17. The aircraft of claim 13, wherein the activation control module
further comprises: a function data store that stores a plurality of
functions that correspond to each of the plurality of gestures; and
an activation module that generates function data that includes
which function of the entertainment system or the passenger service
unit to activate based on a comparison between the gesture data and
the plurality of functions stored in the function data store.
18. The aircraft of claim 17, wherein the activation control module
further comprises: a call control module that receives the function
data and notifies the crew member of the aircraft; a light control
module that receives the function data and activates or deactivates
a light on the passenger service unit associated with the at least
one passenger; a gasper control module that receives the function
data and activates, deactivates or adjusts a volume of air provided
by a gasper on the passenger service unit associated with the at
least one passenger; and an entertainment control module that
receives the function data and activates or deactivates the
entertainment system associated with the at least one
passenger.
19. The aircraft of claim 13, wherein the fuselage further
comprises at least one window that has a shade coupled to a motor,
and the communication control module transmits a signal to the
motor to raise or lower the shade based on the gesture.
20. A system for alternative communication between at least one
passenger onboard an aircraft and at least one system onboard
aircraft, the that aircraft including a fuselage with at least one
passenger seating area, the system comprising: an entertainment
system disposed adjacent to the at least one passenger seating
area, the entertainment system including a display and at least one
user input device; a passenger service unit that includes a means
for notifying a crew member onboard the aircraft that the at least
one passenger needs assistance: a camera that acquires an image of
the at least one passenger; and a graphical user interface manager
control module that receives at least one user input from the user
input device, and based on the user input outputs a graphical user
interface to enable the at least one passenger to enter a desired
gesture for at least one of the entertainment system and the
passenger service unit.
21. A method of alternative communication between at least one
passenger onboard an aircraft and at least one system onboard the
aircraft comprising: providing at least one user input device;
receiving a user input from the at least one user input device;
acquiring an image of the at least one passenger onboard the
aircraft; determining from the acquired image if the at least one
passenger made a gesture; and associating the gesture made by the
at least one passenger with at least one of a function of a
passenger service unit and a function of an entertainment system
based on the received user input.
Description
FIELD
[0001] The present disclosure relates generally to communication
systems onboard a mobile platform, and more particularly to a
system and method for alternative communication between passengers
and systems onboard a mobile platform.
BACKGROUND
[0002] The statements in this section merely provide background
information related to the present disclosure and may not
constitute prior art.
[0003] Many mobile platforms (such as trains, ships, aircraft and
automobiles) employ stowage compartments in a cabin of the mobile
platform to enable stowage of passenger items, such as carry-on
baggage. With regard to commercial passenger aircraft, increased
baggage stowage demands have required the stowage compartments to
increase in size and load capacity. In addition, there is a drive
to increase passenger's "personal space" (i.e., headroom) in the
cabin of the aircraft. The desire for increased "personal space" in
the cabin has resulted in higher ceilings and the placement of
storage compartments higher in the cabins.
[0004] With the placement of stowage compartments higher in the
cabin, some aircraft systems that the passenger must interface
with, such as the reading light, gasper air fan and attendant or
crew call button will also be placed at a higher location above the
floor of the passenger cabin to further provide increased "personal
space". Due to the distance between the passenger and these
aircraft systems, it may be difficult for the passenger to
communicate with or interface with these systems.
SUMMARY
[0005] A system for alternative communication between at least one
passenger onboard a mobile platform and at least one system onboard
the mobile platform is provided. The system includes a camera that
acquires an image of the at least one passenger, and a camera
control module that generates gesture data that includes at least
one gesture recognized in the acquired image of the at least one
passenger. The system also includes an activation control module
that determines a function for the at least one system onboard the
mobile platform to perform based on the gesture data. The function
is selected from the group comprising: activation of a light,
notification of a crew member of the mobile platform, activation of
a ventilation fan, activation of a window shade, activation of an
entertainment system and combinations thereof.
[0006] In one implementation, a method of alternative communication
between at least one passenger onboard a mobile platform and at
least one system onboard the mobile platform is provided. The
method includes acquiring an image of the at least one passenger
onboard the mobile platform, and determining from the acquired
image if the at least one passenger made a gesture correlated to
settings associated with the passenger. The method also includes
activating the at least one system onboard the mobile platform
based on the gesture with the at least one system selected from a
group including a light, a crew call button, a ventilation fan, a
window shade, an entertainment system, and combinations thereof.
The present teachings also provide an aircraft. The aircraft
includes a fuselage. The fuselage includes at least one passenger
seating area. The at least one passenger seating area includes an
entertainment system and a passenger service unit that includes a
means for notifying a crew member onboard the aircraft that the at
least one passenger needs assistance. Communication between at
least one passenger seated in the at least one passenger seating
area, the entertainment system and passenger service unit is
controlled by a communication system. The system includes a camera
that acquires an image of the at least one passenger, and a
communication control module that determines, based on the acquired
image, if the at least one passenger has made a gesture to activate
a function of the entertainment system or the passenger service
unit, or if the at least one passenger has made a gesture that the
at least one passenger needs assistance.
[0007] A system for alternative communication between at least one
passenger onboard an aircraft and at least one system onboard
aircraft is also provided. The aircraft includes a fuselage with at
least one passenger seating area. The system includes an
entertainment system disposed adjacent to the at least one
passenger seating area. The entertainment system includes a display
and at least one user input device. The system comprises a
passenger service unit that includes a means for notifying a crew
member onboard the aircraft that the at least one passenger needs
assistance. The system also includes a camera that acquires an
image of the at least one passenger, and a graphical user interface
manager control module. The graphical user interface manager
control module receives at least one user input from the user input
device, and based on the user input outputs a graphical user
interface to enable the at least one passenger to enter a desired
gesture for at least one of the entertainment system and the
passenger service unit.
[0008] Also provided is a method of alternative communication
between at least one passenger onboard an aircraft and at least one
system onboard the aircraft. The method includes providing at least
one user input device. The method also includes receiving a user
input from the at least one user input device. The method includes
acquiring an image of the at least one passenger onboard the
aircraft, and determining from the acquired image if the at least
one passenger made a gesture. The method further includes
associating the gesture made by the at least one passenger with at
least one of a function of a passenger service unit and a function
of an entertainment system based on the received user input.
[0009] Further areas of applicability will become apparent from the
description provided herein. It should be understood that the
description and specific examples are intended for purposes of
illustration only and are not intended to limit the scope of the
present disclosure.
BRIEF DESCRIPTION OF THE DRAWINGS
[0010] The present disclosure will become more fully understood
from the detailed description and the accompanying drawings,
wherein:
[0011] FIG. 1 is a schematic illustration of a mobile platform
incorporating the system and method for alternative communication
according to the principles of the present disclosure;
[0012] FIG. 2 is schematic illustration of a passenger onboard the
mobile platform interacting with an in-flight entertainment system
and positioned under an exemplary passenger service unit;
[0013] FIG. 3 is a dataflow diagram illustrating an exemplary
alternative communication control system of the present
disclosure;
[0014] FIG. 4 is a schematic illustration of a passenger onboard
the mobile platform interacting with the passenger service unit via
the alternative communication system;
[0015] FIG. 5 is a dataflow diagram illustrating an exemplary
camera control system of the present disclosure;
[0016] FIG. 6 is a dataflow diagram illustrating an exemplary
activation system according to the principles of the present
disclosure;
[0017] FIG. 7A is an exemplary graphical user interface that
enables a passenger onboard the mobile platform to interact with
the alternative communication control system;
[0018] FIG. 7B is an exemplary graphical user interface that
enables a passenger onboard the mobile platform to interact with
the alternative communication control system;
[0019] FIG. 7C is an exemplary graphical user interface that
enables a passenger onboard the mobile platform to interact with
the alternative communication control system;
[0020] FIG. 7D is an exemplary graphical user interface that
enables a passenger onboard the mobile platform to interact with
the alternative communication control system;
[0021] FIG. 7E is an exemplary graphical user interface that
enables a passenger onboard the mobile platform to interact with
the alternative communication control system;
[0022] FIG. 7F is an exemplary graphical user interface that
enables a passenger onboard the mobile platform to interact with
the alternative communication control system;
[0023] FIG. 7G is an exemplary graphical user interface that
enables a passenger onboard the mobile platform to interact with
the alternative communication control system;
[0024] FIG. 7H is an exemplary graphical user interface that
enables a passenger onboard the mobile platform to interact with
the alternative communication control system;
[0025] FIG. 7I is an exemplary graphical user interface that
enables a passenger onboard the mobile platform to interact with
the alternative communication control system;
[0026] FIG. 7J is an exemplary graphical user interface that
enables a passenger onboard the mobile platform to interact with
the alternative communication control system; and
[0027] FIG. 8 is a flowchart illustrating an operational sequence
for the alternative communication control system of FIG. 3.
DETAILED DESCRIPTION
[0028] The following description is merely exemplary in nature and
is not intended to limit the present disclosure, application, or
uses. Although the following description is related generally to a
system and method for alternative communication onboard a mobile
platform (such as an aircraft, ship, spacecraft, train or
land-based motor vehicle), it will be understood that the system
and method for alternative communication, as described and claimed
herein, may be used with any appropriate application where it would
be desirable for an individual to interface with a system without
requiring direct physical contact with the system, such as a home
entertainment system. Therefore, it will be understood that the
following discussion is not intended to limit the scope of the
appended claims to only mobile platforms and mobile platform based
systems.
[0029] With reference to FIGS. 1 and 2, a schematic illustrates an
exemplary mobile platform 8 that employs a system and a method for
alternative communication through an alternative communication
control module 10. The mobile platform, in this example, is a
passenger aircraft 8 that includes a cockpit 14, a cabin 16 and at
least one window 18. The cabin 16 includes at least one crew area
20, at least one passenger seat 22, a passenger service unit 24
(FIG. 2) and optionally, an in-flight entertainment (IFE) system 26
(FIG. 2). The cabin 16 may also include a controller 27 (FIG.
1).
[0030] With reference to FIG. 1, the at least one crew area 20 may
include a control panel 28 that can enable the crew to interface
with the alternative communication control module 10. Thus, the
control panel 28 may include at least one user input device and
display means (not specifically shown), such as a GUI, for example,
however, any suitable user input device and display means may be
employed, such as, without limitations, button(s), a touch screen
and/or a display screen. With reference to FIG. 2, the passenger
service unit 24 may include at least one reading light 30, at least
one attendant call button 32, at least one air vent or gasper 34,
and a camera 36. Each of the reading light 30, attendant call
button 32, air vent or gasper 34 and camera 36 may be in
communication with and responsive to the controller 27 through
either a wired or wireless connection (not specifically shown). The
reading light 30, when activated by the controller 27, may
illuminate the associated passenger seat 22. The attendant call
button 32, when activated by the controller 27, transmits a signal
to the control panel 28 in the crew area 20 that assistance is
needed at the particular passenger seat 22. The vent or gasper 34
may be generally rotatable between an open and a closed position to
enable, disable, or control a flow of cabin air. Thus, the vent or
gasper 34 may act as a climate control for the associated passenger
seat 22. The vent or gasper 34 includes a housing 34a rotatable
between an open and a closed position by a motor 34b (may be
functionally similar to the aperture setting on a camera) in
communication with and responsive to the controller 27. Upon
receipt of a signal from the controller 27, the motor 34b moves the
housing 34a into a desired position. The camera 36 may comprise any
suitable device capable of acquiring an image of the passenger in
the passenger seat 22 and transmitting that acquired image to the
controller 27, as generally known in the art.
[0031] The in-flight entertainment (IFE) system 26 may be coupled
to the passenger seat 22, and may be responsive to and in
communication with the controller 27 through a wired or a wireless
connection (not specifically shown). The IFE system 26 enables the
passenger to remain entertained throughout the duration of the
flight of the aircraft 8, as is generally known. The IFE system 26
may include an input device 29, such as, without limitations, a
GUI, a touch screen, a button, a touch pen, a keyboard, a joystick,
a mouse or any other suitable user input device to enable the
passenger to interface with the IFE system 26. In addition, the
alternative communication control module 10 may be used by the
passenger to interface with the IFE system 26. For example, the
communication control module 10 may be used to turn the IFE system
26 off or on, to control the selection of a menu on the IFE system
26, to control the starting or stopping of a feature displayed on
the IFE system 26, such as a movie, or to fast forward or reverse
the feature displayed on the IFE system 26, or to control volume,
select a song list, etc. The controller 27 may comprise a computer
and/or processor, and memory to hold instruction and data related
to the alternative communication control module 10.
[0032] The window 18 of the aircraft 8 may include a shade 18a or
an adjustable tinting system 18b (not shown). The shade 18a may
have a motor 31 that is in communication with and responsive to the
controller 27 to raise or lower the shade 18a. For example, the
window 18 of the aircraft 8 may include a shade 18a similar to the
shade detailed in U.S. Pat. No. 5,515,898, however, any suitable
device could be employed to raise or lower the window shade 18a.
The adjustable tinting system 18b is in communication with and
responsive to the controller 27 to adjust the opacity of the window
18 upon receipt of a signal from the controller 27. An exemplary
window tinting system 18b is described in commonly assigned U.S.
Patent Publication No. 2005/0200934, hereby incorporated by
reference in its entirety.
[0033] With reference to FIG. 3, the alternative communication
control module 10 for the aircraft 8 is illustrated in accordance
with the teachings of the present disclosure. The alternative
communication control module 10 enables the passengers onboard the
aircraft 8 to interact with the window 18, passenger service unit
24 and the IFE system 26. In this regard, the alternative
communication control module 10 operates to control the functions
associated with the window 18, the passenger service unit 24 and
the IFE system 26 without requiring passengers to strain to reach
the window 18 or the user input devices (reading light 30, call
button 32, vent or gasper 34, user input device 29) on either the
passenger service unit 24 or the IFE system 26. This enables
passengers who are unable to reach or control these systems to
interface with the window 18, passenger service unit 24 and the IFE
system 26 without disrupting surrounding passengers, which improves
the overall passenger experience.
[0034] As used herein, the term "module" refers to an application
specific integrated circuit (ASIC), an electronic circuit, a
processor (shared, dedicated, or group) and memory that executes
one or more software or firmware programs, to a combinational logic
circuit, and/or to other suitable components that provide the
described functionality. In FIG. 3, a dataflow diagram illustrates
various components of an alternative communication system that is
embedded within the alternative communication control module 10.
Various embodiments of the alternative communication control module
10 may include any number of sub-modules embedded within the
alternative communication control module 10. The sub-modules shown
in FIG. 3 may be combined and/or further partitioned to similarly
control the alternative communication of the passengers onboard the
aircraft 8. Inputs to the alternative communication control module
10 are received from other control modules (not shown) within the
aircraft 8, and/or determined by other sub-modules (not shown)
within the alternative communication control module 10 (not shown).
In FIG. 3, the alternative communication control module 10 includes
a camera control module 40, an activation control module 42 and a
graphical user interface (GUI) manager control module 43.
[0035] The camera control module 40 receives as input image data 44
and gesture preference data 47. The image data 44 comprises an
image of the passenger in the passenger seat 22. The gesture
preference data 47 comprises data received from the user input
device 29 that identifies a particular image data 44 as a gesture
45. Based on the image data 44 and the gesture preference data 47,
the camera control module 40 sets gesture data 46 for the
activation control module 42. The gesture data 46 comprises at
least one hand signal, hand motion or gesture 45 made by the
passenger in the passenger seat 22, as shown in FIG. 4.
[0036] With reference to FIG. 5, a dataflow diagram illustrates an
exemplary camera control system that may be embedded within the
camera control module 40. The camera control module 40 includes a
camera module 50 and a gesture data store 52. The camera module 50
receives as input the image data 44 and the gesture preference data
47. Based on the image data 44 and the gesture preference data 47,
the camera module 50 may identify if a gesture 45 (FIG. 4) was made
by the passenger in the passenger seat 22. It should be noted that
the camera control module 40 may comprise any suitable gesture
recognition software, such as GestureTek.TM. commercially available
from GestureTek, Incorporated of Sonnyvale, Calif. The camera
module 50 determines if a gesture was made by comparing the image
data 44 to one or more recognized gestures stored in the gesture
data store 52. Thus, based on the image data 44, the camera module
50 queries the gesture data store 52 for the gesture data 46 that
corresponds with the image data 44. The gesture data store 52 may
comprise one or more data storage devices and may be at least one
of random access memory (RAM), read only memory (ROM), a cache, a
stack, or the like which may temporarily or permanently store
electronic data. The gesture data store 52 stores electronic data
associated with recognized hand signals or hand gestures that may
be made by a passenger to interface with either the window 18, the
passenger service unit 24 or the IFE system 26 as will be
discussed, In addition, the gesture data store 52 may comprise
electronic data associated with hand signal or gesture 45 specified
by the passenger through the gesture preference data 47. Thus, the
gesture data store 52 may comprise electronic data that includes
images of particular recognized hand signals or gestures so that
the camera module 50 may determine the gesture made by the
passenger in the image data 44. Based on the image data 44 and the
gesture preference data 47, the camera module 50 outputs the
gesture data 46.
[0037] With reference back to FIG. 3, the activation control module
42 receives the gesture data 46 and function preference data 49 as
input. The function preference data 49 comprises data received from
the user input device 29 that associates a gesture 45 with a
desired function specific to the passenger. The activation control
module 42 determines from the gesture data 46 and the function
preference data 49, which desired function of the passenger service
unit 24 and/or the IFE system 26 the passenger wishes to activate
or deactivate. In this regard, the passenger may interact with the
passenger service unit 24 and/or the IFE system 26 by using hand
signals or gestures (FIG. 4). Thus, based on the gesture data 46,
the activation control module 42 outputs call data 54, light data
56, gasper data 58, shade data 60 and entertainment data 62. The
call data 54 comprises a signal to activate the attendant call
button 32 to notify the crew that assistance is needed at that
particular passenger seat 22. The light data 56 comprises a signal
to turn the reading light 30 on or off. The gasper data 58
comprises a signal to turn the vent or gasper 34 on or off, or to
increase or decrease the speed of the vent or gasper 34. The shade
data 60 comprises a signal to raise or lower the shade 18a or to
adjust the opacity of the window 18, depending upon the
configuration of the window 18. The entertainment data 62 comprises
a signal to control various features of the IFE system 26, such as
the same features that are commonly controlled through on-screen
touch commands or remote buttons, for example, but not limited to,
power, menu select, start, stop, fast forward and rewind.
[0038] With reference to FIG. 6, a dataflow diagram illustrates an
exemplary activation system that may be embedded within the
activation control module 42. The activation control module 42 may
include an activation module 64, a function data store 66, a call
control module 68, a light control module 70, a gasper control
module 72, a shade control module 74 and an entertainment control
module 76. The activation module 64 receives as input the gesture
data 46 and the function preference data 49. Given the gesture data
46 and the function preference data 49, the activation module 64
queries the function data store 66 for function data 78 that
corresponds with the gesture data 46. The function data store 66
may comprise one or more data storage devices and may be at least
one of random access memory (RAM), read only memory (ROM), a cache,
a stack, or the like which may temporarily or permanently store
electronic data. The function data store 66 stores electronic data
that indicates which function corresponds with the particular
recognized gesture made by the passenger. In this regard, based on
the gesture 45 made by the passenger, the activation module 64
determines, based on the data in the function data store 66, which
of the window 18, passenger service unit 24 or IFE system 26 the
passenger is trying to communicate with using hand signals or
gestures 45. It should be noted that the function data store 66 may
also store electronic data that includes user defined functions
(i.e. function preference data 49) for given gesture data 46, based
on input received from the user input device 29. In addition, if
the passenger decides to calibrate the camera control module 40,
then the passenger could specify which hand in the image data 44
comprises a dominant hand or the alternative communication control
module 10 select a default hand to monitor, such as a right hand,
for example. Based on the gesture data 46, the activation control
module 42 sets the function data 78 for the call control module 68,
light control module 70, gasper control module 72, shade control
module 74 and the entertainment control module 76. Exemplary
function data 78 for a particular hand gesture or gesture data 46
is shown in Table 1.
TABLE-US-00001 TABLE 1 Exemplary Gesture Data 46 Exemplary Function
Data78 Hand Palm Down on Lap IFE On Hand Palm Up on Lap IFE Off
Index Finger Pointing Ahead - Up or IFE Menu Select Down Sweep of
Hand IFE Selected Item Start Fist IFE Selected Item Stop Index
Finger Pointing Right IFE Fast Forward Index Finger Pointing Left
IFE Reverse Index Finger and Thumb Extended Reading Light On into
an "L" Shape Index Finger and Thumb Brought Reading Light Off
Together Palm Lowered from Shoulder Height Dimmable Window Darkens
Palm Raised from Lap Dimmable Window Lightens Form Hand into a "C"
Shape Activate Attendant Call Button Palm by Side of Face
Ventilation Fan On Fist by Side of Face Ventilation Fan Off Index
Finger Circular Motion Increase/Decrease Ventilation Fan Speed
[0039] In addition, it will be understood that these gestures are
merely exemplary, and further, the passenger may interact with the
IFE system 26 to program the alternative communication control
module 10 to associate particular user defined gestures with
functions of the passenger service unit 24 and the IFE system 26
(not specifically shown). For example, the passenger could use the
user input device 29 to interface with one or more graphical user
interfaces (not shown) define specific hand gestures for desired
functions of the passenger service unit 24 and IFE system 26.
[0040] With continuing reference to FIG. 6, the call control module
68 receives as input the function data 78. If the function data 78
comprises a signal to activate the attendant call button 32, then
the call control module 68 outputs the call data 54 in the form of
a signal at the location the call was made (i.e., activation of a
light source coupled to the passenger service unit 24, not
specifically shown) or through the control panel 28 in the crew
area 20.
[0041] The light control module 70 receives as input the function
data 78. If the function data 78 comprises a signal to turn the
reading light 30 on or off, or up or down, then the light control
module 70 outputs the corresponding light data 56. The gasper
control module 72 receives as input the function data 78. If the
function data 78 comprises a signal to turn the vent or gasper 34
on or off, or to increase or decrease the speed of the vent or
gasper 34, then the gasper control module 72 outputs the gasper
data 58. The shade control module 74 receives as input the function
data 78. If the function data 78 comprises a signal to raise or
lower the shade 18a, or to increase or decrease the opacity of the
window 18, then the shade control module 74 outputs the shade data
60. The entertainment control module 76 receives as input the
function data 78. If the function data 78 comprises a signal to
activate or deactivate the IFE system 26 or activate any of the
many internal controls of the IFE 26, then the entertainment
control module 76 outputs the entertainment data 62.
[0042] With reference back to FIG. 3, the GUI manager control
module 43 receives as input user input data 51. The user input data
51 comprises a request to enable or disable the alternative
communication control module 10, to learn more about the
alternative communication control module 10 and to specify
particular movements as gestures 45 that activate desired
functions. Based on the user input data 51, the GUI manager control
module 43 outputs a GUI 53, and sets the gesture preference data 47
and the function preference data 49. For example, with reference to
FIG. 7A, the GUI 53 may comprise a first GUI 53a that includes one
or more selectors 57 to enable the passenger to select whether to
enable (selector 57a), disable (selector 57b) or learn more
(selector 57c) about the alternative communication control module
10. If the passenger selects the enable selector 57a, and the
passenger does not have a stored user profile, then the GUI manager
control module 43 outputs a second GUI 53b, as illustrated in FIG.
7B. The second GUI 53b informs the passenger that they have no
profile, and includes hand selectors 57d to enable the passenger to
specify a dominant hand. In addition, with reference to FIG. 7C, if
the passenger has a stored user profile, then the GUI manager
control module 43 outputs a third GUI 53c that is customized to the
passenger, while also providing hand selectors 57d to enable the
passenger to choose a dominant hand.
[0043] After the passenger has selected a dominant hand from the
hand selectors 57d, or if the passenger has a stored dominant hand,
then based on the user input data 51, the GUI manager control
module 43 outputs a fourth GUI 53d, as illustrated in FIG. 7D. The
fourth GUI 53c prompts the user to indicate that it is appropriate
to proceed, and includes a selector 57e.
[0044] With reference to FIG. 7E, if the passenger selects the
disable selector 57b, then the GUI manager control module 43
outputs a fourth GUI 53d. The fifth GUI 53e instructs the passenger
that the alternative communication control module 10 may be later
enabled, if desired, and includes a selector 57f to verify that the
passenger has received and/or read this information. With reference
to FIG. 7F, if the passenger selects the learn more selector 57c,
then the GUI manager control module 43 outputs a sixth GUI 53f. The
sixth GUI 53f may include text to explain the alternative
communication control module 10 to the passenger, and a selector
57g to enable the passenger to verify that the passenger has read
and/or received this information.
[0045] With reference to FIG. 7G, the GUI manager control module 43
may also output a seventh GUI 53g to enable the passenger to
customize specific gestures for specific functions, so that the
passenger may generate gesture preference data 45 and function
preference data 47 via the seventh GUI 53g. The seventh GUI 53g may
include a list of function selectors 57g to which function
preference data 47 may be created, such as "Attendant Call" or
attendant call button 32, "Reading Light" or reading light 30,
"Fan," or gasper 34, "Windowshade" or shade 18, and "Entertainment
Controls" or controls for the IFE system 26. The seventh GUI 53g
also includes a next selector 57h so that when the passenger has
made their selections, the GUI manager control module 43 may output
an eight GUI 53h. In one example, with reference to FIG. 7H, if the
"Entertainment Controls" selector 57g is selected, the GUI manager
control module 43 may output a GUI 53h that includes a list of
specific function selectors 61 to enable the passenger to choose
one of several functions to record gesture preference data 45 for.
The GUI 53h may also include a next selector 61b so that the
passenger may advance to another GUI 53 after making a desired
selection.
[0046] With reference to FIG. 7I, the eighth GUI 531 records the
dominant hand of the passenger so that the alternative
communication control module 10 may acquire image data 44 to
calibrate the alternative communication control module 10 to the
passenger. The eighth GUI 531 may include a record selector 57i, a
next selector 57j and instructional text. The record selector 57i
enables the passenger to record a desired gesture or generate
gesture preference data 45. The next selector 57j enables the
passenger to go to the next GUI. Thus, if the passenger selects the
next selector 57j, the GUI manager control module 43 outputs a
ninth GUI 53j, as illustrated in FIG. 7J.
[0047] The ninth GUI 53j enables the passenger to control the
generation of the gesture preference data 45 for the desired
function. In one example, the ninth GUI 53j enables the passenger
to set gesture preference data 45 for activating the attendant call
button 32. The ninth GUI 53j may include appropriate controls to
enable the passenger to record the gesture preference data 45, such
as a "Delete" selector 59a, a "Done" selector 59b. a "Save"
selector 59c, a "Record" selector 59d, a "Play/Pause" selector 59e
and a "Stop" selector 59f.
[0048] With reference to FIG. 8, a process flow diagram illustrates
an exemplary operational sequence 100 performed by the alternative
communication control module 10. At operation 102, the method
performs a start-up test and start-up calibration. Start up and
calibration may be performed by a crew member through the control
panel 28 or automatically at startup of the alternate control
module to establish the default settings for the alternative
communication control module 10. At operation 103, the method
determines if a request to learn more about the alternative
communication control module 10 has been received via the user
input device 29. If a request has been received, then the method
goes to operation 105, at which the method outputs the GUI 53 that
describes how the alternative communication control module 10
operates. At operation 107, the method determines if a request has
been received from the user input device 29 to enable the
alternative communication control module 10. If a request has been
received to enable the alternative communication control module 10,
the method outputs the GUI 53 to enable the passenger to calibrate
the alternative communication control module 10 at operation 101,
and then the method goes to operation 104. Otherwise, the method
ends.
[0049] At operation 104, the method acquires image data 44 of the
passenger from the camera 36. At operation 109, the method
determines if the passenger has a user profile stored in the
gesture data store 52. The user profile may be generated from the
passenger's prior use of the alternative communication control
module 10, or the passenger may generate a user profile prior to
traveling on the aircraft 8, which may then be input to the
alternative communication control module 10 from a portable storage
device, if desired. If the passenger has a stored profile in the
gesture data store 52, then the method goes to operation 113.
[0050] If the passenger 52 does not have a stored user profile,
then the method determines at operation 111 if the passenger has
input a desired dominant hand to which the camera control module 40
may observe for image data 44. Then, the method goes to operation
113, in which the method correlates the image data 44 to the
selected dominant hand, with the dominant hand selected based on
either data retrieved from the user profile, or from the user input
data 47.
[0051] At operation 106, the method determines if the image in the
image data 44 comprises a gesture. The method may determine if the
image in the image data 44 comprises a gesture 45 by comparing the
image data 44 to the recognized gestures 45 queried from the
gesture data store 52. If the method determines that the image data
44 does not include a gesture 45, then the method goes to operation
108. At operation 108, the method determines if a power down shut
down or gesture recognition capability deactivation request has
been received. If a shut down or gesture recognition capability
deactivation request has been received, then the method ends.
Otherwise, the method loops to operation 104.
[0052] If the method determines that the image data 44 comprises a
gesture 45, then the method goes to operation 110. At operation
110, the method determines the function data 78 based on the
gesture data 46. The method determines the function data 78 by
querying the function data store 66 for the function that
corresponds with the given gesture data 46. Then, at operation 112,
the method determines if the function data 78 is for activating the
reading light 30. If the function data 78 is for activating the
reading light 30, then the light control module 70, at operation
114, outputs the light data 56 that either turns the reading light
30 on or off. If the function data 78 does not comprise a signal to
activate the reading light 30, then the method goes to operation
116. At operation 116, the method determines if the function data
78 is for activating the attendant call button 32. If the function
data 78 is for activating the attendant call button 32, then the
call control module 68, at operation 118, outputs the call data 54
to activate the attendant call button 32. If the function data 78
does not comprise a signal to activate the attendant call button
32, then the method goes to operation 117.
[0053] At operation 117, the method determines if the function data
78 is for deactivating the attendant call button 32. If the
function data 78 is for deactivating the attendant call button 32,
then the call control module 68, at operation 119, outputs the call
data 54 to deactivate the attendant call button 32. If the function
data 78 does not comprise a signal to deactivate the attendant call
button 32, then the method goes to operation 120.
[0054] At operation 120, the method determines if the function data
78 is for activating the vent or gasper 34. If the function data 78
is for activating the vent or gasper 34, then the gasper control
module 72, at operation 122, outputs the gasper data 58 to activate
the vent or gasper 34. If the function data 78 does not comprise a
signal to activate the vent or gasper 34, then the method goes to
operation 124. At operation 124, the method determines if the
function data 78 is for increasing or decreasing the speed of the
vent or gasper 34. If the function data 78 is for increasing or
decreasing the speed of the vent or gasper 34, then the gasper
control module 72, at operation 126, outputs the gasper data 58 to
increase or decrease the speed of the vent or gasper 34. If the
function data 78 does not comprise a signal to increase or decrease
the speed of the vent or gasper 34, then the method goes to
operation 128.
[0055] At operation 128, the method determines if the function data
78 is for adjusting the window 18. If the function data 78 is for
adjusting the window 18, then the shade control module 74, at
operation 130, outputs the shade data 60 to lower or raise the
shade 18a or change the opacity of the window 18 with the tinting
system 18b. If the function data 78 does not comprise a signal to
adjust the window 18, then the method goes to operation 132. At
operation 132, the method activates the appropriate IFE system 26
control for the given function data 78, such as to turn the IFE 26
on or off, activate a menu, start, stop, reverse or fast forward
through a feature (such as a movie) displayed on the IFE 26. Then,
the method loops to operation 108.
[0056] While specific examples have been described in the
specification and illustrated in the drawings, it will be
understood by those of ordinary skill in the art that various
changes may be made and equivalents may be substituted for elements
thereof without departing from the scope of the present disclosure
as defined in the claims. Furthermore, the mixing and matching of
features, elements and/or functions between various examples is
expressly contemplated herein so that one of ordinary skill in the
art would appreciate from this disclosure that features, elements
and/or functions of one example may be incorporated into another
example as appropriate, unless described otherwise, above.
Moreover, many modifications may be made to adapt a particular
situation or material to the teachings of the present disclosure
without departing from the essential scope thereof. Therefore, it
is intended that the present disclosure not be limited to the
particular examples illustrated by the drawings and described in
the specification as the best mode presently contemplated for
carrying out this disclosure, but that the scope of the present
disclosure will include any embodiments falling within the
foregoing description and the appended claims.
* * * * *