U.S. patent application number 14/180563 was filed with the patent office on 2015-03-19 for interactive vehicle window display system with vehicle function control.
The applicant listed for this patent is Toyota Motor Sales, U.S.A., Inc.. Invention is credited to James T. Pisz, Jason A. Schulz.
Application Number | 20150081167 14/180563 |
Document ID | / |
Family ID | 52667494 |
Filed Date | 2015-03-19 |
United States Patent
Application |
20150081167 |
Kind Code |
A1 |
Pisz; James T. ; et
al. |
March 19, 2015 |
INTERACTIVE VEHICLE WINDOW DISPLAY SYSTEM WITH VEHICLE FUNCTION
CONTROL
Abstract
A system for a vehicle includes an interactive display subsystem
operable to generate output for display on a vehicle window, the
display visible from inside the vehicle, outside the vehicle, or
both. The system also includes a control subsystem operable to
enable a user to control at least one vehicle function through the
interactive display subsystem. A method of controlling a vehicle
function includes receiving instructions for controlling the
vehicle function through an interactive display subsystem operable
to generate output for display on a vehicle window and executing
the instructions using a control subsystem.
Inventors: |
Pisz; James T.; (Huntington
Beach, CA) ; Schulz; Jason A.; (Redondo Beach,
CA) |
|
Applicant: |
Name |
City |
State |
Country |
Type |
Toyota Motor Sales, U.S.A., Inc. |
Torrance |
CA |
US |
|
|
Family ID: |
52667494 |
Appl. No.: |
14/180563 |
Filed: |
February 14, 2014 |
Related U.S. Patent Documents
|
|
|
|
|
|
Application
Number |
Filing Date |
Patent Number |
|
|
61878898 |
Sep 17, 2013 |
|
|
|
Current U.S.
Class: |
701/36 ;
715/771 |
Current CPC
Class: |
B60K 2370/741 20190501;
G02B 2027/014 20130101; B60W 50/08 20130101; G06F 3/0484 20130101;
B60R 1/00 20130101; G02B 27/01 20130101; G02B 2027/0187 20130101;
B60K 35/00 20130101; B60K 2370/334 20190501; B60Q 1/268 20130101;
G01C 21/3688 20130101; G06F 3/017 20130101; G07C 9/22 20200101;
B60Q 1/503 20130101; B60K 37/00 20130101; G01C 21/3697 20130101;
B60K 2370/785 20190501; G06K 9/00221 20130101; G01C 21/365
20130101; B60K 2370/1529 20190501 |
Class at
Publication: |
701/36 ;
715/771 |
International
Class: |
B60W 50/08 20060101
B60W050/08; B60H 1/00 20060101 B60H001/00; G06F 3/0484 20060101
G06F003/0484 |
Claims
1. A system for a vehicle, comprising: an interactive display
subsystem operable to generate output for display on a vehicle
window; and a control subsystem operable to enable a user to
control at least one vehicle function through the interactive
display subsystem.
2. The system as recited in claim 1, wherein the vehicle function
is a navigation function.
3. The system as recited in claim 1, wherein the vehicle function
is an audio/video function.
4. The system as recited in claim 1, wherein the vehicle function
is a climate control function.
5. The system as recited in claim 1, wherein the vehicle function
is an internet access function.
6. The system as recited in claim 1, wherein the interactive
display subsystem comprises motion sensors.
7. The system as recited in claim 1, further comprising a vehicle
head unit in communication with the interactive display
subsystem.
8. The system as recited in claim 1, further comprising: a user
location subsystem operable to detect a location of the user and in
communication with the control subsystem, the control subsystem
further operable to control user access to a vehicle head unit
based on the location of the user.
9. The system as recited in claim 8, further comprising: a user
identification subsystem operable to identify the user and in
communication with the control subsystem, the control subsystem
further operable to control user access to a vehicle head unit
based on the identity of the user.
10. The system as recited in claim 9, wherein the user
identification subsystem includes one or more user profiles, each
user profile associated with at least one user.
11. The system as recited in claim 10, wherein each user profile
includes user access information.
12. The system as recited in claim 11, wherein the user access
information indicates full access or restricted access.
13. The system as recited in claim 10, wherein the user access
information is based on both the user location and the identity of
the user.
14. A method of controlling a vehicle function, comprising:
receiving instructions for controlling the vehicle function through
an interactive display subsystem operable to generate output for
display on a vehicle window; and executing the instructions using a
control subsystem.
15. The method as recited in claim 14, further comprising:
determining a user location; and regulating user access to
controlling the vehicle function based on the user location.
16. The method as recited in claim 15, further comprising:
determining a user identity; and regulating user access to
controlling the vehicle function based on the user identity.
17. The method as recited in claim 14, wherein the vehicle function
is a navigation function.
18. The method as recited in claim 14, wherein the vehicle function
is an audio/video function.
19. The method as recited in claim 14, wherein the vehicle function
is a climate control function.
20. The method as recited in claim 14, wherein the vehicle function
is an internet access function.
21. The method as recited in claim 14, wherein the interactive
display subsystem comprises an interactive touch screen with touch
sensors.
22. The method as recited in claim 14, wherein the interactive
display subsystem comprises a projection display.
23. The method as recited in claim 14, wherein the interactive
display subsystem comprises motion sensors.
24. A system for a vehicle, comprising: an interactive display
subsystem including a projection display, the interactive display
subsystem operable to enable a vehicle rear-seat passenger to
control at least one vehicle function.
Description
CROSS-REFERENCE TO RELATED APPLICATIONS
[0001] The present disclosure claims priority to U.S. Provisional
Patent Disclosure Ser. No. 61/878,898, filed 17 Sep. 2013.
BACKGROUND
[0002] The present disclosure relates to a vehicle and more
particularly to systems and methods therefor.
[0003] Vehicles often include various systems such as infotainment
and navigation systems. These systems are generally provided with a
display around which mechanical control elements are arranged to
provide a user interface mounted in a dashboard of a vehicle cabin
for driver and front passenger access. Alternatively, the display
combines at least some of the control elements into a touch panel
display.
[0004] Conventionally, a vehicle head unit is a hardware interface
located in the vehicle dash board and enabling user control of
vehicle systems including, but not limited to, the vehicle's
entertainment media such as AM/FM radio, satellite radio, CDs,
MP3s, video; navigations systems such as GPS navigation; climate
controls; communication systems such a cellular phones, text,
email; and vehicle control functions such as lights, door chimes,
speed control and others. As used herein, the term vehicle head
unit refers to such a hardware interface, or to any control module
configured to control vehicular systems.
[0005] Due to the numerous functions typically available, operation
may require a relatively substantial amount of time, e.g. to find
the desired mechanical control element or to browse through menus
and submenus to access a desired function. Further, the dashboard
mount location may limit display size and restrict the
functionality thereof.
[0006] Although effective, such display and control elements
necessarily require the user to be within the vehicle to operate
the system and thereby increase total travel time in the vehicle.
In particular, the multitude of control options presented to a
driver can result in significant distraction from the driver's
primary task of safely operating the vehicle. Such driver
distraction can lengthen travel times and decrease the safety of
the driver and any passengers. Various regulatory agencies may also
require lock out of the system to prevent driver interaction when
the vehicle is in motion.
SUMMARY
[0007] A system for a vehicle according to one disclosed
non-limiting embodiment of the present disclosure includes an
interactive display subsystem which can generate output for display
on a vehicle window and a control subsystem which can enable a user
to control at least one vehicle function through the interactive
display subsystem.
[0008] A method of controlling a vehicle function in a non-limiting
embodiment of the present disclosure includes receiving
instructions for controlling the vehicle function through an
interactive display subsystem operable to generate output for
display on a vehicle window and executing the instructions using a
control subsystem.
[0009] A system for a vehicle according to another disclosed
non-limiting embodiment of the present disclosure includes an
interactive display subsystem. The interactive display subsystem
includes a projection display and is operable to enable a vehicle
rear-seat passenger to control at least one vehicle function.
[0010] The foregoing features and elements may be combined in
various combinations without exclusivity, unless expressly
indicated otherwise. These features and elements as well as the
operation thereof will become more apparent in light of the
following description and the accompanying drawings. It should be
understood, however, the following description and drawings are
intended to be exemplary in nature and non-limiting.
BRIEF DESCRIPTION OF THE DRAWINGS
[0011] Various features will become apparent to those skilled in
the art from the following detailed description of the disclosed
non-limiting embodiment. The drawings that accompany the detailed
description can be briefly described as follows:
[0012] FIG. 1 is a pictorial representation of an example vehicle
for use with an interactive vehicle window display system;
[0013] FIG. 2 is a schematic block diagram of the interactive
vehicle window display system according to one non-limiting
embodiment;
[0014] FIG. 3 is a partial interior view of the vehicle with the
interactive vehicle window display system;
[0015] FIG. 4 is a top view of the vehicle illustrating an exterior
user identification subsystem of the interactive vehicle window
display system;
[0016] FIG. 5 is a pictorial representation of the vehicle
illustrating user identification via a skeletal joint relationship,
key fob and/or user gesture;
[0017] FIG. 6 is a schematic block diagram of an algorithm for
operation of the system according to one non-limiting
embodiment;
[0018] FIG. 7 is a pictorial representation of an example skeletal
joint relationship recognizable by the system;
[0019] FIG. 8 is an illustration of an example user gesture
recognizable by the system;
[0020] FIG. 9 is an example landing page displayed by the
interactive vehicle window display system;
[0021] FIG. 10 is an example route page displayed by the
interactive vehicle window display system;
[0022] FIG. 11 is an example calendar page displayed by the
interactive vehicle window display system;
[0023] FIG. 12 is an example weather page displayed by the
interactive vehicle window display system;
[0024] FIG. 13 is an example vehicle status page displayed by the
interactive vehicle window display system;
[0025] FIG. 14 is an example to-do page displayed by the
interactive vehicle window display system;
[0026] FIG. 15 is a partial interior view of a vehicle cabin
illustrating an interactive environment for the driver and/or
passengers to utilize functionalities of a vehicle head unit;
[0027] FIG. 16 is a partial interior view of the vehicle cabin
illustrating discrimination of a driver and/or passenger to
selectively permit utilization of functionalities of a vehicle head
unit during vehicle operation;
[0028] FIG. 17 is a pictorial representation of a vehicle passenger
facial map for use with the system to track occupant location;
and
[0029] FIG. 18 is an overhead interior view of the vehicle
illustrating a sensor arrangement to track occupant location within
the vehicle cabin.
DETAILED DESCRIPTION
[0030] FIG. 1 schematically illustrates a vehicle 20 with a window
22 and an interactive vehicle window display system 30. Although
the window 22 is here shown as a driver's side passenger window of
a minivan type vehicle in the disclosed, non-limiting embodiment,
it should be appreciated that various vehicle types and windows
will also benefit herefrom.
[0031] With reference to FIG. 2, selected portions of the system 30
are schematically illustrated. The system 30 generally includes an
interactive display subsystem 32, a control subsystem 34, a user
input subsystem 36, a user identification subsystem 38, and a user
location subsystem 39. It should be appreciated that although
particular subsystems are separately defined, each or any of the
subsystems may be combined or segregated via hardware and/or
software of the system 30. Additionally, each or any of the
subsystems can be implemented using one or more computing devices
including conventional central processing units or other devices
capable of manipulating or processing information.
[0032] The interactive display subsystem 32 can include any device
or devices capable of displaying images on a vehicle window 22
under the control of system 30, and can be adapted for viewing from
outside the vehicle, inside the vehicle, or both. In one
non-limiting example the interactive display subsystem 32 can
include a display device integral to the window 22, such as an LCD.
Such a display can be illuminated by ambient light or by one or
more light sources under the control of system 30. Such light
sources can be mounted at any operable locations enabling light
emission onto a window from inside or outside the vehicle,
depending on whether the display is to be viewed by a user located
outside or inside the vehicle. Examples of such mounting locations
can include in the floor, in the vehicle headliner, within the
vehicle door structure, or in the exterior door panel.
[0033] In another non-limiting example, the interactive display
subsystem 32 can include a coating 40 and a projector 42. The
coating 40, for example, may be a polymer dispersed liquid crystal
(PDLC) film, applied to the window 22 to provide both transparency
when inactive and partial or complete opacity when active. The
window 22 treated with the coating 40 is thereby operable to
display content as a projection page visible from outside and/or
inside the vehicle 20 (FIG. 1). The projector 42 can be mounted in
the floor (FIG. 3) or other locations within the vehicle 20, such
as the vehicle headliner or within the vehicle door structure as
well as in locations on the vehicle exterior such as in an exterior
door panel. The illustrated shaded area extending from the
projector 42 toward the window 22 schematically represents the
projection of output in the form of content pages provided by the
projector 42. In response to the approach of a recognized user, the
coating 40 changes from transparent to opaque so that the projector
42 may project the output onto the window 22.
[0034] As will be further described, the displayed content can
include personalized information or entertainment content such as
videos, games, maps, navigation, vehicle diagnostics, calendar
information, weather information, vehicle climate controls, vehicle
entertainment controls, email, internet browsing, or any other
interactive applications associated with the recognized user,
whether the information originates onboard and/or off board the
vehicle 20.
[0035] The control subsystem 34 generally includes a control module
50 with a processor 52, a memory 54, and an interface 56. The
processor 52 may be any type of microprocessor having desired
performance characteristics. The memory 54 may include any type of
computer readable medium which stores the data and control
algorithms described herein such as a user support system algorithm
58. The functions of the algorithm 58 are disclosed in terms of
functional block diagrams (FIG. 6) and representative pages (FIGS.
9-14), and it should be understood by those skilled in the art with
the benefit of this disclosure that these functions may be enacted
in either dedicated hardware circuitry or programmed software
routines capable of execution in a microprocessor based electronics
control embodiment.
[0036] With continued reference to FIG. 2, the control module 50
may be a portion of a central vehicle control, a stand-alone unit,
or other system such as a cloud-based system. Other operational
software for the processor 52 may also be stored in the memory 54.
The interface 56 facilitates communication with other subsystems
such as the interactive display subsystem 32, the user input
subsystem 36, the user identification subsystem 38, and the user
location subsystem 39. It should be understood that the interface
56 may also communicate with other onboard vehicle systems and
offboard vehicle systems. Onboard systems include but are not
limited to, a vehicle head unit 300 which communicates with vehicle
sensors that provide, for example, vehicle tire pressure, fuel
level and other vehicle diagnostic information. Offboard vehicle
systems can provide information which includes but is not limited
to, weather reports, traffic, and other information which may be
provided via cloud 70.
[0037] The user input subsystem 36 can include one or more input
sensors including onboard input sensors 60, offboard input devices,
or both. Onboard input sensors 60 can include one or more motion
cameras or other light sensors configured to detect gesture
commands, one or more touch sensors configured to detect touch
commands, one or more microphones configured to detect voice
commands, or other onboard devices configured to detect user input.
The user input subsystem can also include offboard input devices
such as a key fob 62 and/or a personal electronic device 63 of the
user, e.g. a tablet, smart phone, or other mobile device.
[0038] In some instances, at least one onboard input sensor 60 or
offboard input device can be integrated into, or operate in
conjunction with, the interactive display subsystem 32. In one
non-limiting example, the interactive display subsystem 32 includes
an LCD display integrated into a window 22 and can operate in
conjunction with one or more touch sensors integrated into the
window 22, causing the window to function as a touchscreen. In
another non-limiting example, the interactive display subsystem 32
includes a projector 42 and coating 40 on the window 22 and can
operate in conjunction with one or more motion detectors configured
to detect user gesture commands, causing the window to operate as a
gesture-based interactive display. Subsystem combinations involving
the interactive display subsystem 32 and the user input subsystem
and enabling user interaction with a display on a vehicle window 22
will be referred to herein as an interactive window display.
[0039] The user identification subsystem 38 includes one or more
identification sensors 64 such as a closed-circuit television
(CCTV) camera, infrared, thermal or other sensor mounted to the
vehicle 20 to provide a desired field of view external to the
vehicle 20 as shown in FIG. 4, internal to the vehicle, or both.
One example user identification subsystem 38 can recognize the
driver and/or passenger based on image data captured by
identification sensors 64, e.g. a skeletal joint relationship 66
and/or other user form data (FIG. 5), separate from, or along with,
wireless devices such as the key fob 62 associated with that
particular driver and/or passenger. Based at least in part on this
identification, the system 30 provides access to interactive
interfaces on the interactive display subsystem 32 associated with
the particular driver and/or passenger.
[0040] The system 30 can store user profiles of known users, the
user profiles including identification information relevant to
individual users. For example, a user profile can contain skeleton
joint relationship data or facial recognition data useable by the
user identification subsystem 38 to identify or authenticate a
user. A user profile can additionally contain personal interest
information, such as personal calendar and event information,
driving/destination history, web browsing history, entertainment
preferences, climate preferences, etc. In some variations, any or
all information contained in a user profile can be stored on or
shared with a personal electronic device 63, remote server, or
other cloud 70 based system. Such offboard storage or sharing of
user profile data can facilitate utilization of user profile data
in other vehicles such as any additional vehicles owned by the
user, rental vehicles, etc. Such user profile data can be secured
by being accessible through a password protected application
running on the cloud 70 based system, by biometric authentication,
or by other effective means.
[0041] In some instances, a user profile can additionally contain
user access information; data pertaining to whether the user is
allowed to control a given vehicle function. For example, the user
profile associated with a user can indicate full user access, or
function control rights for that user. This can be analogous to the
control rights of the administrator of a personal computer. A user
profile can alternatively indicate restricted user access. For
example, the user profile associated with a child can be set to
block the user from accessing certain audio or video controls, the
navigation system, altering user profiles, or the like.
[0042] Registration of various user profiles with the system 30 can
be completed in any manner, for example, over the internet or with
a direct vehicle interface. User profiles can be based on the
identities of individual users known to or registered with the
system, or to user categories, such as "unknown user", or "valet".
In different variations, a default user category such as "unknown
user" or "valet" can be associated with limited, default access, or
can be associated with no access, i.e. complete prohibition of
access to the system 30.
[0043] The user location subsystem 39, operable to determine the
location of one or more users inside or outside the vehicle,
includes one or more location sensors 66 such as a pressure sensor,
temperature sensor, or camera deployed inside or outside the
vehicle. In some cases, a device can serve as both an
identification sensor 64 and a location sensor 66. For example, a
camera mounted within the vehicle can provide information on a
user's specific identity, by means described above, and on the
user's location within the vehicle, such as the driver's seat or
the front-row passenger's seat. In some cases, elements of the
interactive display subsystem 32 can also operate as location
sensors 66 within the user location subsystem 39. For example,
pressure sensors within a smartscreen or motion detectors operating
as part of an interactive display can be used to obtain user
location information.
[0044] In some instances, user access can be based on user location
as determined by the user location subsystem 39. For example,
second or third row passengers can be allowed or disallowed access
to various vehicle functions such as the navigation system.
Optionally, a user with a user profile that is associated with
unlimited access per the access information associated with the
user profile can specify such settings. In some instances, user
access can be based on a combination of the user profile as applied
by the user identification subsystem 38, and the user location as
detected by the user location subsystem 39. For example, a user
with unlimited access as specified by the applied user profile can
nonetheless be blocked from accessing certain vehicle functions
when occupying the driver's seat of a moving vehicle.
[0045] With reference to FIG. 6, operation of the system 30
according to one disclosed non-limiting embodiment generally
includes a sleeper mode 100, a watcher mode 102 and a user mode
104. It should be appreciated that other modes may additionally or
alternatively be provided.
[0046] If the system 30 is active but has yet to detect a user, the
system 30 will be in sleeper mode 100 until awakened by the user
identification subsystem 38. After detection but prior to
identification by the system 30, the watcher mode 102 may be
utilized to interact with authenticated as well as un-authenticated
persons. For example, when a person approaches the vehicle 20, the
system 30 recognizes the direction from which the person has
approached then activates the interactive display subsystem 32 to
display an avatar, eyes or other graphic. The graphic may be
directed specifically toward the direction from which the person
approaches, e.g., the graphical eyes "look" toward their approach.
Alternatively, an audio capability allows the system 30 to respond
to commands and initiate interaction from a blind side of the
vehicle 20, i.e., a side without the interactive display subsystem
32. The watcher mode 102 utilizes the user identification subsystem
38 to discriminate between authenticated and un-authenticated
persons.
[0047] The user mode 104 allows a user with a known operator and/or
passenger user profile in the system 30 to make decisions on
approach to the vehicle 20 so that so that certain vehicle
interactions need not await entry into the vehicle 20. The user
mode 104 reduces distractions through the reduction of
travel-associated decisions from the driver's cognitive, visual and
manual workload streams once within the vehicle 20. In furtherance
of this, the user is presented with an overview of information to
include, for example, weather, traffic, calendar events and vehicle
health. As will be further described, predictive functions of the
system 30 identify likely actions, and offer optimal paths to
completion, such as planning an efficient route.
[0048] A maximum range of content provision by the interactive
display subsystem 32 may be associated with a maximum distance at
which that content can be effectively interacted with by the user.
In one disclosed non-limiting embodiment, the maximum range of each
content feature is prioritized with respect to legibility range of
content displayed by the interactive display subsystem 32. This
range metric facilitates the determination of the order in which
content appears in the walkup experience. Access to prioritized
content with greater maximum range allows the walkup experience to
begin further from the vehicle 20 to provide the user with more
overall time to interact with the system 30.
[0049] In one disclosed non-limiting embodiment, the system 30
utilizes a multi-factor authentication for security and
authorization. Example multi-factor authentication may include the
key fob 62, skeleton joint relationship recognition (FIG. 5),
and/or a gesture password (FIG. 8). The user may be provisionally
identified with one of these factors, but may require a total of at
least two factors to authenticate the user prior to display of
certain content. That is, the user will not be granted access to
all the features in user mode 104 until a multi-factor
authentication is passed and the user is within a predetermine
range of the vehicle 20. This authentication process ensures the
security of the vehicle and the personal information embedded in
the system 30. In one disclosed non-limiting embodiment, the first
authentication factor is the key fob 62 and the second is the
skeleton joint relationship (FIG. 7) of the user. If the user does
not have their key fob 62, the skeleton joint relationship may
become the first authentication factor and a gesture password such
as a wave or particular arm movement (FIG. 8) becomes the
second.
[0050] The key fob 62 in one disclosed non-limiting embodiment may
be encrypted to uniquely identify each user to the system 30.
Additional security protocols such as a rolling time key to ensure
that even the encrypted key cannot be intercepted and re-used by
unauthorized devices may additionally be utilized.
[0051] Once the key fob 62 is recognized, the user will be welcomed
and pre-authenticated to allow limited access to selected content
in the user mode 104. This will provide the user with enough time
to cycle through multiple content features during the walkup
experience, yet maintain security with respect to other content
features e.g., a destination. Once the user has been fully
authenticated, all content features, e.g. destination made during
the pre-authenticated state, are validated for display. If the
authentication fails, the user will not be granted access to the
vehicle 20 or any sensitive information. The system 30 in this
disclosed non-limiting embodiment allows pre-authenticated access
at about 30-40 feet and full access at about 15-25 feet from the
vehicle.
[0052] With respect to FIG. 7, to provide further authentication,
the system 30 is operable to recognize a user by his skeleton joint
relationships. Skeleton joint relationships in this disclosed
non-limiting embodiment facilitate pre-authentication but not full
authentication that grants full access to the vehicle 20. However,
if the user has been pre-authenticated via the key fob 62, a
matching skeleton joint relationship will fully authenticate the
user. That is, the user identification subsystem 38 may utilize
skeleton joint relationships as the second point of
identification.
[0053] With reference to FIG. 9, once authenticated, the "landing"
or "home" page 200 provides a summary of alerts and important
information to the user. The landing page 200 provides the user
with a readily reviewable overview of the status of the vehicle and
how it may affect his schedule and activities. In this example, the
content includes time information, vehicle diagnostic information,
and personal calendar information. Here shown, a low fuel warning
is provided in addition to a traffic-based route update for use by
the vehicle navigation system and a calendar event reminder to
"Pick up Kids in 20 minutes." In another example, the system 30
will include a fuel station as a stop during route guidance if the
destination is a distance greater than the available fuel range.
Notably, preferred fuel stations or other stops may be predefined
in the user profile.
[0054] The landing page 200 further displays a plurality of icons
to indicate additional content pages that can be viewed by the
authorized user. The landing page 200 itself may be accessed on
each content page as an icon such as a vehicle manufacturer mark
icon on each content page. The landing page 200 allows the
authorized user to understand what vehicle systems or personal user
profile items may require further attention and provides access to
additional content feature details with regard to these items in
the form of navigable icons that lead to additional content pages.
The landing page 200 can additionally or alternatively integrate an
interactive display, for example, a smart page or video game. Other
interactive vehicle display page configurations are also
possible.
[0055] Selection of content is accomplished with, for example, the
key fob 62, user gestures, voice commands, touch inputs, etc. In
one example, the user utilizes the key fob 62 to cycle through
various pages displayed by the interactive display subsystem 32. In
one example, the key fob 62 may include a four button directional
pad and two auxiliary buttons. Alternatively, hand gestures may be
used to "swipe" between pages. It should be appreciated that
although particular pages are illustrated in the disclosed
non-limiting embodiment, various alternative or additional pages
may be provided.
[0056] With reference to FIG. 10, a route page 202 defaults to the
predicted best route for the user with respect to an explicit or
inferred next destination. Any alternate destinations or routes
that can be explicit or inferred with confidence from, for example,
a user personal electronic device, are presented to permit user
selection by scrolling through the options. The suggested route
screen is here shown accessed using the folded-map icon, however,
other icons may be utilized.
[0057] With reference to FIG. 11, a calendar page 204 displays the
user's calendar. In this example, the view is near-term, and shows
only the next 2-3 upcoming appointments. If the event includes
location information the user is also given the option to use the
event for destination selection. Here shown, the calendar page 204
provides content with respect to the next appointment highlighted
for the user and provides a reminder to "Pick Up Kids." The
calendar screen is here shown accessed using a flip calendar icon,
however, other icons may be utilized.
[0058] With reference to FIG. 12, a weather page 206 leverages
information about the route to provide relevant weather
information--this may be especially effective when the user is
travelling away from home. For example, the system 30 determines
whether it is more valuable to present the user with local weather
information, destination weather information, or both, depending on
the settings selected by the user or the type of weather
information available. Here shown, the weather forecast is
chronological. The weather page 206 can be accessed with a sun
icon, however, other icons may be utilized. In addition, weather
conditions can be utilized to generate a reminder for display on
the landing screen 200 that, for example, suggests an umbrella be
placed in the vehicle if rain is forecasted.
[0059] With reference to FIG. 13, a vehicle status page 208
provides the user with a view of impending vehicle maintenance
needs that requires attention. Notifications can include source
details of the notification, severity, and options to resolve the
potential issue. For example, given the notification of "Low Fuel,"
the system 30 can suggest a route to a nearby fuel station within
the range of the vehicle. The vehicle status page 208 is here shown
accessed with a vehicle icon, however, other icons may be
utilized.
[0060] With reference to FIG. 14, a to-do list page 210 presents
the authorized user with information from any associated to-do list
available on, for example, that user's personal electronic device
63, remote device, or web service. Here shown, the recognized user
is tasked to "Send Package," "Submit Taxes," and "Renew Car
Registration," among other items. The to-do list page 210 can
alternatively be integrated into the route selection page if
location information is included in a given list item in the
personal electronic device to-do list. An example of this
integration includes the provision of route details to a dry
cleaner if the dry cleaning pickup is on the to-do list and the
current route is proximate to the location of the dry cleaner
location. The to-do list page is here shown accessed using a
check-mark icon, however, other icons may be utilized.
[0061] As noted above, information of this nature, which can be
included in a user profile, can in some variations be stored on or
shared with a personal electronic device 63, remote server, or
other cloud 70 based system, facilitating utilization in more than
one vehicle. Any such information can be secured by being
accessible through a password protected application running on the
cloud 70 based system, by biometric authentication, or by other
effective means. In some such variations, a first user can be
granted partial or complete access to a second user's profile by
password sharing, for example. Such sharing of access could enable
a first user to write reminders or tasks from a remote location to
the user profile of a second user, such as a family member, such
that the reminders or tasks written by the first user will be
displayed on a window when the second user approaches or enters the
vehicle, or any vehicle equipped with system 30 enabled to access
the user profile of the second user.
[0062] With reference to FIG. 15, user access to various vehicle
functions can include direct or remote access to utilize
functionalities of a vehicle head unit 300.
[0063] With the interactivity between the vehicle head unit 300 and
the system 30, and in particular between the vehicle head unit 300
and various interactive window displays, passengers can make
selections with regard to vehicle systems typically performed by
driver and in some cases only when the vehicle is stationary.
Allowing only passengers to interact with certain vehicle systems
while the vehicle is in motion increases safety by minimization of
driver distraction. Passenger interaction can also enable greater
functionality for the system 30. For example, a front-seat
passenger can be offered more menu selections than the driver,
while 2nd and 3rd row passengers can be offered even greater menu
selections than the front-seat passenger. In these embodiments, the
passengers can take over portions of the driver workload.
[0064] The vehicle passengers may, for example, interact with the
system 30 and thereby the vehicle head unit 300 via an interactive
window display or through a personal electronic device such as a
smart phone or tablet which communicates therewith, through
Bluetooth, RFID or other wireless technology standards to exchange
data. Further, the system 30 may permit the formation of personal
area networks (PANs) for vehicle passengers to share information.
For example, a passenger's personal electronic device may include a
mapping app operable to communicate with the vehicle navigation
system on the vehicle head unit 300 with no features locked out
such that the passenger can search destinations and selectively
send to the vehicle navigation system via the vehicle head unit
300.
[0065] Interaction of the system 30 with the vehicle head unit 300
also allows the driver and/or passengers to select content for
other vehicle passengers and/or the driver. For example, one of the
passengers can select a destination to display on the navigation
system for the driver while the vehicle is in motion. In another
example, the driver can select entertainment content for display to
child passengers. In yet another example, the passenger can control
infotainment or climate control features controlled by the vehicle
head unit 300.
[0066] With reference to FIG. 16, and in one non-limiting example
of the operation of the user location subsystem 39, to still
further increase safety through driver distraction minimization,
the system 30, by utilizing user location subsystem 39, is operable
to track the location or position of the vehicle occupants within
the vehicle cabin 400 (FIG. 18) through skeletal position (FIG.
16), facial map data (FIG. 17), pressure sensors, interactive
window display input sensors, or others. For a three row vehicle,
for example, three distinct areas are tracked--front row, middle
row and rear row. Typically, at least two sensors 402 per row are
required to track a state of each occupant within the vehicle 20.
In some instances, each individual seat in the vehicle 20 can be
tracked. The data from all sensors 402 may alternatively or
additionally be combined to create one central map (2D or 3D) for
use by the system 30. It should be appreciated that the sensors 402
may communicate with, or be a portion of, the user identification
subsystem 38, the user location subsystem 39, or both.
[0067] Given that the vehicle occupants are typically seated and
belted, the multi-point skeletal joint relationship and facial
recognition map data provides a relatively accurate position of
each occupant captured on an XYZ axis map that can track, to a
desired level of precision, the state of each occupant at a
specific snapshot in time. The state of each occupant facilitates
further tailored operations for various vehicle functions. For
example, the user location subsystem 39 detects and discriminates
between a driver's hand from that of a vehicle front row passenger
hand to selectively unlock various head unit functionality such as
navigation route selection (FIG. 16). Dependent, for example, on
which user (driver or passenger) is attempting to access the system
30 and whether the vehicle is in motion, content menu items of the
vehicle head unit 300 are selectively displayed. For example,
certain content such as route selection may be color coded for only
passenger access, while other content such as zooming and scrolling
may always be available regardless of user.
[0068] Upon approach to the vehicle, the system 30 beneficially
recognizes a user with a first and second point of identification
to display information for that particular, authorized user. This
authentication process ensures the security of the vehicle and the
personal information embedded in the system 30 yet permits vehicle
interaction prior to user entry into the vehicle cabin. The system
30 also beneficially discriminates passengers from the driver to
selectively permit access to personalized content or specific
vehicle system interfaces.
[0069] The use of the terms "a" and "an" and "the" and similar
references in the context of description (especially in the context
of the following claims) are to be construed to cover both the
singular and the plural, unless otherwise indicated herein or
specifically contradicted by context. The modifier "about" used in
connection with a quantity is inclusive of the stated value and has
the meaning dictated by the context (e.g., it includes the degree
of error associated with measurement of the particular quantity).
All ranges disclosed herein are inclusive of the endpoints. It
should be appreciated that relative positional terms such as
"forward," "aft," "upper," "lower," "above," "below," and the like
are with reference to the normal operational attitude of the
vehicle and should not be considered otherwise limiting.
[0070] Although the different non-limiting embodiments have
specific illustrated components, the embodiments of this invention
are not limited to those particular combinations. It is possible to
use some of the components or features from any of the non-limiting
embodiments in combination with features or components from any of
the other non-limiting embodiments.
[0071] It should be appreciated that like reference numerals
identify corresponding or similar elements throughout the several
drawings. It should also be appreciated that although a particular
component arrangement is disclosed in the illustrated embodiment,
other arrangements will benefit herefrom.
[0072] Although particular step sequences are shown, described, and
claimed, it should be understood that steps may be performed in any
order, separated or combined unless otherwise indicated and will
still benefit from the present disclosure.
[0073] The foregoing description is exemplary rather than defined
by the limitations within. Various non-limiting embodiments are
disclosed herein, however, one of ordinary skill in the art would
recognize that various modifications and variations in light of the
above teachings will fall within the scope of the appended claims.
It is therefore to be appreciated that within the scope of the
appended claims, the disclosure may be practiced other than as
specifically described. For that reason the appended claims should
be studied to determine true scope and content.
* * * * *