U.S. patent application number 15/446320 was filed with the patent office on 2017-06-22 for in-vehicle device, control method thereof, and remote control system.
This patent application is currently assigned to Clarion Co., Ltd.. The applicant listed for this patent is Clarion Co., Ltd.. Invention is credited to Takayuki HIROTA, Takashi MATSUMOTO, Yasushi NAGAI, Yuji OOHARA, Atsushi SHIMIZU, Takashi YAMAGUCHI.
Application Number | 20170180546 15/446320 |
Document ID | / |
Family ID | 47843045 |
Filed Date | 2017-06-22 |
United States Patent
Application |
20170180546 |
Kind Code |
A1 |
NAGAI; Yasushi ; et
al. |
June 22, 2017 |
IN-VEHICLE DEVICE, CONTROL METHOD THEREOF, AND REMOTE CONTROL
SYSTEM
Abstract
An input/output limitation information storage unit stores
input/output limitation information in which limitation processing
for limiting operation input to the application and display output
from the application is prescribed by associating the limitation
processing with the application. A determination unit acquires a
vehicle state of a vehicle, and determines the limitation
processing to be applied to the operation input to the application
and the display output from the application on the basis of the
application running on the terminal device, the vehicle state, and
the input/output limitation information. The limitation unit
performs the limitation processing determined by the determination
unit for the operation input detected by the input control unit and
transmitted to the communication control unit, and the display
output received by the communication control unit and transmitted
to the output control unit.
Inventors: |
NAGAI; Yasushi; (Yokohama,
JP) ; SHIMIZU; Atsushi; (Yokohama, JP) ;
MATSUMOTO; Takashi; (Kawasaki, JP) ; HIROTA;
Takayuki; (Saitama, JP) ; YAMAGUCHI; Takashi;
(Saitama, JP) ; OOHARA; Yuji; (Saitama,
JP) |
|
Applicant: |
Name |
City |
State |
Country |
Type |
Clarion Co., Ltd. |
Saitama-shi |
|
JP |
|
|
Assignee: |
Clarion Co., Ltd.
Saitama-shi
JP
|
Family ID: |
47843045 |
Appl. No.: |
15/446320 |
Filed: |
March 1, 2017 |
Related U.S. Patent Documents
|
|
|
|
|
|
Application
Number |
Filing Date |
Patent Number |
|
|
15183358 |
Jun 15, 2016 |
|
|
|
15446320 |
|
|
|
|
14669237 |
Mar 26, 2015 |
9392105 |
|
|
15183358 |
|
|
|
|
13764381 |
Feb 11, 2013 |
9020695 |
|
|
14669237 |
|
|
|
|
Current U.S.
Class: |
1/1 |
Current CPC
Class: |
H04M 2250/56 20130101;
H04W 4/027 20130101; H04L 67/125 20130101; H04L 67/12 20130101;
G06F 17/00 20130101; H04M 1/72527 20130101; H04M 1/72577 20130101;
H04M 1/7253 20130101; B60K 35/00 20130101; B60K 2370/11
20190501 |
International
Class: |
H04M 1/725 20060101
H04M001/725; H04L 29/08 20060101 H04L029/08 |
Foreign Application Data
Date |
Code |
Application Number |
Mar 30, 2012 |
JP |
2012-078637 |
Claims
1. An in-vehicle device comprising: a telecommunication interface
connectable with a terminal device which performs an application
program; a vehicle state determination unit configured to determine
a state of a vehicle; a storage unit storing input/output
limitation information configured to limit display of display data
received from the terminal device or limiting operation; and a
control unit configured to perform various processings, wherein the
control unit is configured to: control to display a result of a
process that the terminal device performed the application program
when the state of the vehicle determined by the vehicle state
determination unit is a first state, and control to display an icon
of the application program being performed based on the
input/output limitation information stored in the storage unit when
the state of the vehicle determined by the vehicle state
determination unit is a second state different from the first
state.
2. The in-vehicle device according to claim 1, wherein the control
unit is configured to control to display the icon of the
application program being performed based on the input/output
limitation information instead of the result of the process of the
application.
3. The in-vehicle device according to claim 1, wherein the first
state is a state that a parking brake is ON, and the second state
is a state that the parking brake is OFF.
4. The in-vehicle device according to claim 2, wherein the first
state is a state that a parking brake is ON, and the second state
is a state that the parking brake is OFF.
5. An in-vehicle device comprising: a telecommunication interface
connectable with a terminal device which performs an application
program; a vehicle state determination unit configured to determine
a state of a vehicle; a storage unit storing input/output
limitation information configured to limit display of display data
received from the terminal device or limiting operation; and a
control unit performing various processings, wherein the control
unit is configured to: control to display a result of a process
that the terminal device performed the application program when the
state of the vehicle determined by the vehicle state determination
unit is a first state, and control to reduce a display size of the
result of the process that the terminal device performed the
application program to a size defined in input/output limitation
information and to display the result reduced in display size.
6. The in-vehicle device according to claim 5, wherein the first
state is a state that a parking brake is ON, and the second state
is a state that the parking brake is OFF.
7. A controlling method for displaying, on a screen of an
in-vehicle device, a result of a process performed by a terminal
device connected to the in-vehicle device, wherein the method
comprising: storing input/output limitation information for
limiting display of display data received from the terminal device
or limiting operation; determining a state of a vehicle;
controlling to display a result of a process that the terminal
device performed an application program when the state of the
vehicle is a first state, and controlling to display an icon or a
screen reduced in size of the application program being performed
based on the input/output limitation information when the state of
the vehicle is a second state different from the first state.
Description
CROSS-REFERENCE TO RELATED PATENT APPLICATIONS
[0001] Japan Priority Application 2012-078637, filed Mar. 30, 2012
including the specification, drawings, claims and abstract, is
incorporated herein by reference in its entirety. This application
is a Continuation of U.S. application Ser. No. 15/183,358 filed
Jun. 15, 2016, which is a Continuation of U.S. application Ser. No.
14/669,237, filed Mar. 26, 2015, now U.S. Pat. No. 9,392,105, which
is a Continuation of U.S. application Ser. No. 13/764,381, filed
Feb. 11, 2013, now U.S. Pat. No. 9,020,695, all of which are
incorporated herein by reference in their entirety.
BACKGROUND OF THE INVENTION
[0002] 1. Field of the Invention
[0003] The present invention relates to an in-vehicle device that
is installed in a vehicle, and provides a driver with various
service functions, and a control method thereof.
[0004] 2. Description of the Related Art
[0005] In-vehicle devices (car navigation devices, air conditioner
operation devices, car audio devices, back monitor devices, and the
like) that are installed in vehicles, provide drivers with various
information associated with map information or maps in the
vehicles, and provide the drivers with various service functions
such as navigation to a destination, operation of an air
conditioner, a radio, or a music player, image display of an
in-vehicle camera are generally utilized. Recently, mobile phones
(smart phones) developed based on personal computers and having
high functionality are utilized. It is becoming possible for the
mobile phones to provide users with services equivalent to those of
the in-vehicle devices. For example, it is becoming possible that
the in-vehicle device and the mobile phone are connected in a wired
or wireless manner, and a screen of an application of the mobile
phone is displayed on the in-vehicle device, or a user operates the
in-vehicle device to control the application on the mobile
phone.
[0006] In the abstract of Japanese Patent Application Laid-open No.
2010-44458, a remote-control system that controls a remote-control
target terminal from a control instruction terminal is disclosed.
By utilizing the technique disclosed in Japanese Patent Application
Laid-open No. 2010-44458, it becomes possible to utilize an
application of a mobile phone (remote-control target terminal) with
a large screen of an in-vehicle device (control instruction
terminal) suitable for utilization in a vehicle. Additionally, it
becomes also possible to integrate screens of various terminal
devices such as the mobile phone and to display the screens on the
in-vehicle device, for example.
[0007] Generally, since the in-vehicle device is mounted on the
vehicle, and integrated with the vehicle, a frequency of update of
internal data or a program is low. For example, the internal data
or the program of the in-vehicle device is not relatively
frequently updated, and is often continued to be used for a long
period of time, such as seven to ten years. Although the program of
the in-vehicle device can be updated at an automobile dealer, a
user needs to bring the vehicle with the in-vehicle device
installed therein all the way into the dealer, which is
troublesome.
[0008] As compared with this, the mobile phone is often replaced
around every two years, and an old mobile phone is not often
continued to be used over a long period of time. Additionally,
since the mobile phone with high functionality is often always
connected to a network, and easily updated by acquiring information
or a program from a server, the mobile phone is often maintained in
a state where new information and new functions can be always
utilized.
[0009] If an application of a mobile phone can be utilized from an
in-vehicle device, it is convenient because a large screen can be
used. However, there are the following problems.
[0010] A driver needs to direct his attention to the front of a
vehicle at every moment while the vehicle is moving, and has to
avoid watching of the screen of the in-vehicle device for a long
time. Particularly, in a case where the vehicle moves at a high
speed, since a moving distance of the vehicle for a constant time
is long, and a visual field of the driver becomes narrow, it is
extremely dangerous that the driver removes his gaze from the view
of the front of the vehicle for a long time.
[0011] However, general applications of the mobile phone, which are
designed for general purposes without assuming utilization of the
driver during driving, may not be adequate to be utilized with the
in-vehicle device by the driver. Therefore, in a case where the
applications of the mobile phone are utilized with the in-vehicle
device, a screen is difficult to be visually recognized, or the
applications are difficult to be operated, and hence the time for
removing the driver's gaze from the view of the front of the
vehicle may tend to be increased.
[0012] Particularly, for example, when a screen including operation
buttons, small characters, moving images, and the like, at which a
user tends to fixedly look, is displayed on the in-vehicle device,
the attention of the driver directs to the in-vehicle device, and
attentiveness to the outside world tends to be decreased.
Additionally, also in a case where operation is required a
plurality of times until the application is changed to a desired
state, the attention of the driver directs to the in-vehicle
device, and attentiveness to the outside world tends to be
decreased.
SUMMARY OF THE INVENTION
[0013] An object of the present invention is to provide a technique
enabling limitation of display or operation for safely utilizing,
on an in-vehicle device, an application on a terminal device, in a
case of utilization of the application on the in-vehicle
device.
[0014] An in-vehicle device according to an aspect of the present
invention is an in-vehicle device installed in a vehicle, connected
to a terminal device, and enabling operation and display of an
application running on the terminal device, the in-vehicle device
having an input control unit detecting operation input, an output
control unit controlling display output, a communication control
unit receiving display output from the terminal device connected,
and transmitting operation input to the terminal device, an
input/output limitation information storage unit storing
input/output limitation information in which limitation processing
for limiting operation input to the application and display output
from the application is prescribed by associating the limitation
processing with the application, a determination unit acquiring a
vehicle state of the vehicle, and determining the limitation
processing to be applied to the operation input to the application
and the display output from the application on the basis of the
application running on the terminal device, the vehicle state, and
the input/output limitation information, and a limitation unit
performing the limitation processing determined by the
determination unit for the operation input detected by the input
control unit and transmitted to the communication control unit, and
the display output received by the communication control unit and
transmitted to the output control unit.
[0015] The present invention enables limitation of display or
operation for safe utilization on the in-vehicle device in a case
where the application on the terminal device is utilized on the
in-vehicle device.
[0016] The above and other objects, features, and advantages of the
present invention will become apparent from the following
description with references to the accompanying drawings which
illustrate examples of the present invention.
BRIEF DESCRIPTION OF THE DRAWINGS
[0017] FIG. 1 is a block diagram showing a remote control system
according to the present embodiment;
[0018] FIG. 2 is a figure illustrating a hardware configuration of
a remote control system according to an in-vehicle device of the
present practical example;
[0019] FIG. 3 is a function configuration diagram of the remote
control system according to the in-vehicle device of the present
practical example;
[0020] FIG. 4 is a figure showing a table of limitation condition
information;
[0021] FIG. 5 is a figure showing a table of limitation method
information;
[0022] FIG. 6 is a figure showing an example of a screen where
display and operation are limited when an application of a mobile
phone is remote-controlled with the in-vehicle device;
[0023] FIG. 7 is a figure showing an example of a table for
managing limitation conditions of display and operation according
to a predetermined vehicle state;
[0024] FIG. 8 is a figure showing a configuration of a table for
managing limitation parts of predetermined display and operation,
and a limitation method;
[0025] FIG. 9 is a figure showing an example of a table
configuration managing input/output limitation information
delivered from a server;
[0026] FIG. 10 is an example of sequence activating such that the
application of the mobile phone is remote-controlled with the
in-vehicle device; and
[0027] FIG. 11 is a flowchart showing an operation example of a
vehicle state determination unit.
DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0028] Basic embodiment of the present invention will be now
described.
[0029] FIG. 1 is a block diagram showing a remote control system
according to the present embodiment. The remote control system
according to the present embodiment has an in-vehicle device 10 and
a mobile phone 19.
[0030] The mobile phone 19 is a highly functional mobile phone
terminal that runs an application and provides a user with a
service function.
[0031] The in-vehicle device 10 is a device such as a navigation
device, an air conditioner operation device, a car audio device,
and aback monitor device, which is installed in a vehicle such as
an automobile, is connected to the mobile phone 19 in a wired or
wireless manner, and is capable of operating and displaying the
application running on the mobile phone 19.
[0032] The in-vehicle device 10 has an input control unit 11, an
output control unit 12, a communication control unit 13, a
determination unit 14, a limitation unit 15, and an input/output
limitation information storage unit 16.
[0033] The input control unit 11 detects operation input by touch
operation to a touch panel or pressing of an operation button.
[0034] The output control unit 12 controls display output of an
application screen to a liquid crystal display or the like.
[0035] The communication control unit 13 is connected to the mobile
phone 19, receives display output from the mobile phone 19, and
transmits operation input to the mobile phone 19.
[0036] The input/output limitation information storage unit 16
stores input/output limitation information, in which limitation
processing to input/output to the application, which is running on
the mobile phone 19, by the in-vehicle device 10 is prescribed by
association with the application.
[0037] While the applications running on the mobile phone 19 are
basically designed on the assumption of display and operation with
the mobile phone 19, in the remote control system according to the
present embodiment, the applications are displayed and operated
with the in-vehicle device 10. The in-vehicle device 10 generally
has a larger screen than that of the mobile phone 19, and therefore
is convenient as long as the user does not drive and only utilizes
the application.
[0038] However, it is dangerous that the user operates the
in-vehicle device 10 while driving a vehicle. According to the
present embodiment, at least a part of the applications is applied
to the limitation processing associated with the application, and
the application screen is not displayed on the in-vehicle device
10, or operation from the in-vehicle device 10 is not accepted. For
example, while the vehicle is moving, video contents are not
displayed on the in-vehicle device 10, or operation buttons become
inactivated.
[0039] The input/output limitation information includes first
input/output limitation information, in which the limitation
processing with respect to a combination of the application and the
in-vehicle device 10 is prescribed, and second input/output
limitation information to be applied to the combination of the
application and the in-vehicle device 10, which is not prescribed
in the first input/output limitation information.
[0040] In the first input/output limitation information, such
limitation processing as not to limit operation or display as much
as possible while ensuring safety of driving, and as to enhance
convenience is prescribed as dedicated information with respect to
the combination of the application and the in-vehicle device 10. On
the other hand, the second input/output limitation information is
applied to the combination of the application and the in-vehicle
device 10, which is not prescribed in the first input/output
limitation information, for general purposes, and therefore such
limitation processing as to ensure safety with respect to various
combinations even when operation or display is strictly limited is
prescribed.
[0041] The determination unit 14 acquires a vehicle state of the
vehicle, and determines limitation processing, which is applied to
operation input to the application and display output from the
application, on the basis of the application running on the mobile
phone 19, the vehicle state, and the input/output limitation
information.
[0042] At this time, when the combination of the application
running on the mobile phone 19 and the in-vehicle device 10 itself
is prescribed in the first input/output limitation information, the
determination unit 14 determines the limitation processing to the
application on the basis of the first input/output limitation
information. When the combination of the application and the
in-vehicle device 10 itself is not prescribed in the first
input/output limitation information, the determination unit 14
determines the limitation processing to the application on the
basis of the second input/output limitation information.
[0043] The limitation unit 15 performs the limitation processing
determined by the determination unit 14 for operation input
detected by the input control unit 11 and transmitted to the
communication control unit 13, and display output received by the
communication control unit 13 and transmitted to the output control
unit 12.
[0044] According to the present embodiment, display or operation
can be limited so as to be suitable for utilization in the
in-vehicle device 10 in a case where various applications for the
mobile phone are utilized with the in-vehicle device 10.
[0045] Furthermore, according to the present embodiment, when the
communication control unit 13 is connected to the mobile phone 19,
the communication control unit 13 notifies the mobile phone 19 of
identification information identifying a model of the in-vehicle
device 10 itself, acquires, from the mobile phone 19, first
input/output limitation information corresponding to the
combination of the application running on the mobile phone 19 and
the in-vehicle device, and records the same in the input/output
limitation information storage unit 16.
[0046] At this time, when the mobile phone 19 holds the first
input/output limitation information for the combination of the
application running on the mobile phone 19 itself and the
in-vehicle device 10 by itself, the mobile phone 19 transmits the
same to the in-vehicle device 10. When the mobile phone 19 does not
hold the first input/output limitation information for the
combination of the application running on the mobile phone 19
itself and the in-vehicle device 10 by itself, the mobile phone 19
acquires the same from a server (not shown), and notifies the
in-vehicle device 10 of the same. According to this, even when the
application on the mobile phone 19 is not updated, limitation
information for a new combination of the application and the
in-vehicle device 10 can be notified to the in-vehicle device 10
even afterwards.
[0047] According to the present embodiment, while an example of
displaying and operating the application running on the mobile
phone with the in-vehicle device 10 is shown, a terminal device
connected to the in-vehicle device 10 in the present invention may
not be the mobile phone. As the terminal device connected to the
in-vehicle device 10, any information processing device including a
communication interface may be employed. As another example, a
personal computer or a game machine having a wireless LAN interface
or a USB interface may be employed.
[0048] Examples of the vehicle according to the present embodiment
widely include vehicles for movement such as automobiles,
motorcycles, and bicycles.
Practical Example
[0049] Hereinafter, a practical example will be described with
reference to the figures.
[0050] FIG. 2 is a figure illustrating a hardware configuration of
a remote control system of an in-vehicle device of the present
practical example. The remote control system of the in-vehicle
device includes the in-vehicle device, a vehicle state sensor, a
mobile phone, a network, and a server.
[0051] In this figure, reference numeral 101 denotes the in-vehicle
device, reference numeral 102 denotes the vehicle state sensor,
reference numeral 103 denotes the mobile phone, reference numeral
104 denotes the network, the reference numeral 105 denotes the
server, reference numeral 106 denotes a central processing unit
(CPU), reference numeral 107 denotes a nonvolatile memory,
reference numeral 108 denotes a random access memory (RAM),
reference numeral 109 denotes a vehicle interface (IF), reference
numeral 110 denotes an input device, reference numeral 111 denotes
a display device, reference numeral 112 denotes a vehicle interior
communication IF, reference numeral 113 denotes a CPU, reference
numeral 114 denotes a nonvolatile memory, reference numeral 115
denotes a RAM, reference numeral 116 denotes a vehicle interior
communication IF, reference numeral 117 denotes an input device,
reference numeral 118 denotes a display device, and reference
numeral 119 denotes a vehicle exterior communication IF.
[0052] The in-vehicle device 101 includes the CPU 106, the
nonvolatile memory 107, the RAM 108, the vehicle IF 109, the input
device 110, the display device 111, and the vehicle interior
communication IF 112.
[0053] The CPU 106 runs a program stored in the nonvolatile memory
107 by utilizing the RAM 108 as a working memory. The nonvolatile
memory 107 stores a program of the in-vehicle device run by the CPU
106. The RAM 108 is a memory utilized for work by the CPU 106. The
vehicle IF 109 is an interface for acquiring a state of a parking
brake, a state of a brake, and a state of the vehicle such as
vehicle speed, acceleration, latitude and longitude by the vehicle
state sensor 102. The input device 110 is an input device such as a
key, a dial, and a touch panel. The display device 111 is a display
device such as a liquid crystal display, displaying a program
running result by the CPU 106. The vehicle interior communication
IF 112 is a wired or wireless communication interface, and can be
connected to a mobile phone or a personal computer.
[0054] The vehicle state sensor 102 is various sensors acquiring
the state of the parking brake, the state of the brake, the vehicle
speed, the acceleration, the latitude, and the longitude. While an
example, in which the vehicle state sensor 102 is outside the
in-vehicle device 101, is shown here, the vehicle state sensor 102
may be inside the in-vehicle device 101.
[0055] The mobile phone 103 includes the CPU 113, the nonvolatile
memory 114, the RAM 115, the vehicle interior communication IF 116,
the input device 117, the display device 118, and the vehicle
exterior communication IF 119.
[0056] The CPU 113 runs a program stored in the nonvolatile memory
114 by utilizing the RAM 115 as a working memory. The nonvolatile
memory 114 stores a program of the mobile phone run by the CPU 113.
The RAM 115 is a memory utilized for work by the CPU 113. The
vehicle interior communication IF 116 is a wired or wireless
communication interface, and can be connected to the in-vehicle
device, or the personal computer. The input device 117 is an input
device such as a key, a dial, and a touch panel. The display device
118 is a display device such as a liquid crystal display,
displaying a program running result by the CPU 113. The vehicle
exterior communication IF 119 is a communication interface
configured such that the mobile phone 103 can be connected to the
server 105 through the network 104.
[0057] The in-vehicle device 101 remote-controls the mobile phone
103 through the vehicle interior communication IF 112. The mobile
phone 103 runs an application program in accordance with operation
of the in-vehicle device 101 through the vehicle interior
communication IF 116, and displays the result on the display device
111 of the in-vehicle device 101. Then, the in-vehicle device 101
acquires the vehicle state such as the parking brake and the
vehicle speed with the vehicle state sensor 102, and performs
limitation of display and limitation of transmission of the
operation of the in-vehicle device 101 to the mobile phone 103
according to the vehicle state in accordance with input/output
limitation information stored in the nonvolatile memory 107.
[0058] Thus, allowable operation or display contents of
general-purpose applications of the mobile phone can be limited
depending on the vehicle state such as the vehicle speed.
[0059] The mobile phone 103 can hold the input/output limitation
information inherent in the application. In this case, before start
of remote control of the mobile phone 103 by the in-vehicle device
101, the mobile phone 103 transmits the input/output limitation
information inherent in the application to the in-vehicle device
101 through the vehicle interior communication IF 112. Then, the
in-vehicle device 101 performs the limitation of the display of a
moving image or small characters, and the limitation of
transmission of the operation of the in-vehicle device 101 to the
mobile phone 103, in accordance with the received input/output
limitation information inherent in the application and the vehicle
state acquired by the vehicle state sensor 102.
[0060] Thus, even the application of the mobile phone 103 produced
after production of the in-vehicle device 101 can perform
limitation of display of a moving image or small characters
inherent in the application or limitation of operation of a button
or an input form displayed on the screen.
[0061] The mobile phone 103 is connected to the server 105 through
the network 104. The mobile phone 103 transmits, to the server 105,
in-vehicle device model identification information received from
the in-vehicle device 101 (the identification information is
hereinafter referred to as an ID), and an ID (mobile phone app ID)
of an application program to be run, and downloads, from the server
105, the input/output limitation information required for the
limitation of the remote control of the application program of the
mobile phone 103 by the in-vehicle device 101, and passes the same
to the in-vehicle device 101. Then, the in-vehicle device 101
performs the limitation of the display of the moving image or the
small characters, and the limitation of the transmission of the
operation of the in-vehicle device 101 to the mobile phone 103, in
accordance with the received input/output limitation information
and the vehicle state acquired by the vehicle state sensor 102.
[0062] Thus, even the in-vehicle device 101 produced after
development of the application of the mobile phone 103 can perform
the limitation of the display of the moving image or the small
characters inherent in the application or the limitation of the
operation of the button or the input form displayed on the
screen.
[0063] FIG. 3 is a function configuration diagram of the remote
control system of the in-vehicle device of the present practical
example.
[0064] In this figure, in the remote control system of the
in-vehicle device in FIG. 2, configurations denoted by the same
reference numerals as those shown in FIG. 2 already described, and
portions having the same functions are not repeatedly
described.
[0065] In the in-vehicle device 101, reference numeral 201 denotes
an in-vehicle device application unit, reference numeral 202
denotes an in-vehicle device input/output switching unit, reference
numeral 203 denotes an input/output limitation information storage
unit, reference numeral 204 denotes an input limitation unit,
reference numeral 205 denotes an output limitation unit, reference
numeral 206 denotes a vehicle state determination unit, reference
numeral 207 denotes an in-vehicle device input control unit,
reference numeral 208 denotes an in-vehicle device display control
unit, and reference numeral 209 denotes an in-vehicle device
vehicle-interior communication control unit. These processing units
are embodied by utilizing the RAM 108 as the working memory and
running the program stored in the nonvolatile memory 107 with the
CPU 106.
[0066] The in-vehicle device 101 according to the present practical
example differs from conventional devices in that the in-vehicle
device 101 includes the input/output limitation information storage
unit 203, the input limitation unit 204, the output limitation unit
205, and the vehicle state determination unit 206.
[0067] In the input/output limitation information storage unit 203,
reference numeral 220 denotes predetermined input/output limitation
information, and reference numeral 221 denotes an input/output
limitation information region.
[0068] In the mobile phone 103, reference numeral 210 denotes a
mobile phone application unit, reference numeral 211 denotes a
mobile phone input/output switching unit, reference numeral 212
denotes a mobile phone input control unit, reference numeral 213
denotes a mobile phone output control unit, reference numeral 214
denotes a mobile phone vehicle-interior communication control unit,
and reference numeral 215 denotes a mobile phone vehicle-exterior
communication control unit. These processing units are embodied by
utilizing the RAM 115 as the working memory and running the program
stored in the nonvolatile memory 114 with the CPU 113.
[0069] The mobile phone 103 according to the present practical
example differs from conventional devices in that the mobile phone
application unit 210 includes the input/output limitation
information 216. In the input/output limitation information 216,
reference numeral 217 denotes limitation condition information,
reference numeral 218 denotes limitation method information, and
reference numeral 219 denotes compatible in-vehicle device
information.
[0070] In the server 105, reference numeral 222 denotes a delivery
unit, and reference numeral 223 denotes an input/output limitation
information management table. The delivery unit 222 is embodied by
utilizing a RAM (not shown) of the server as the working memory and
running a program stored in a nonvolatile memory (not shown) of the
server with a CPU (not shown) of the server.
[0071] The input/output limitation information 216 is limitation
information in which limitation contents of display and operation
according to the vehicle state are prescribed, and is configured
from the limitation condition information 217, the limitation
method information 218, and the compatible in-vehicle device
information 219.
[0072] The limitation condition information 217 is a table
illustrated in FIG. 4, and a part where display on the screen is
limited (display limitation part), a method of limitation thereof,
and a part where operation is limited (operation limitation part)
can be specified from the parking brake state and the vehicle speed
obtained from the vehicle state sensor 102.
[0073] The limitation method information 218 is a table illustrated
in FIG. 5, and as to each display limitation part and each
operation limitation part identified in the table of the FIG. 4, a
limited region, a display method in a limited state, and synthetic
data utilized for the display can be specified.
[0074] The compatible in-vehicle device information 219 is a list
of an in-vehicle device model ID identifying the model of the
in-vehicle device 101 capable of utilizing the limitation condition
information 217 and the limitation method information 218.
[0075] The predetermined input/output limitation information 220 is
information having the same configuration as that of the
input/output limitation information 216 previously stored by the
in-vehicle device 101, and is utilized in a case where the
input/output limitation information 216 is not obtained from the
mobile phone 103 or the server 105. The predetermined input/output
limitation information 220 is configured from limitation condition
information defined by a table illustrated in FIG. 7, and
limitation method information defined by a table illustrated in
FIG. 8.
[0076] The input/output limitation information region 221 is a
region where the predetermined input/output limitation information
220 or the input/output limitation information 216 sent from the
mobile phone 103 or the server 105 is stored, and the in-vehicle
device 101 limits display of an image sent from the mobile phone,
and information of operation by a user, which is sent from the
in-vehicle device to the mobile phone, in accordance with the
input/output limitation information stored in this region.
[0077] The in-vehicle device application unit 201 receives input
information from the in-vehicle device input/output switching unit
202, and outputs display and the like through the in-vehicle device
input/output switching unit 202.
[0078] The in-vehicle device input/output switching unit 202 is
controlled by the vehicle state determination unit 206, and selects
whether information received from the in-vehicle device input
control unit 207 is passed to the mobile phone 103 through the
input limitation unit 204 and the in-vehicle device
vehicle-interior communication control unit 209 or to the
in-vehicle device application unit 201.
[0079] The in-vehicle device input/output switching unit 202
alternatively switches between display of an image from the
in-vehicle device application unit 201 and display of an image of
the mobile phone 103 received through the output limitation unit
205 and the in-vehicle device vehicle-interior communication
control unit 209, or displays an image synthesizing the image of
the in-vehicle device application unit 201 and the image of the
mobile phone 103.
[0080] For example, it is considered that when the image of the
mobile phone 103 is displayed, information received from the
in-vehicle device input control unit 207 is passed to the mobile
phone 103, and when the image from the in-vehicle device
application unit 201 is displayed, information from the in-vehicle
device input control unit 207 is passed to the in-vehicle device
application unit 201.
[0081] The in-vehicle device input control unit 207 controls to
pass, to the in-vehicle device input/output switching unit 202,
input data received from the input device 110, the information
received from the vehicle state sensor 102 through the vehicle IF
109, or the information such as a map held in the in-vehicle device
101.
[0082] The in-vehicle device display control unit 208 controls to
display data received from the output limitation unit 205 on the
display device 111.
[0083] The in-vehicle device vehicle-interior communication control
unit 209 passes display data received from the mobile phone 103 to
the in-vehicle device input/output switching unit 202, passes input
data received from the input limitation unit 204 to the mobile
phone 103, and records the input/output limitation information 216
received from the mobile phone 103 in the input/output limitation
information storage unit 203.
[0084] The input/output limitation information storage unit 203
previously stores the predetermined input/output limitation
information 220, and stores, in the input/output limitation
information region 221, the input/output limitation information 216
sent from the mobile phone 103 or the server 105 through the
vehicle interior communication IF 112.
[0085] The predetermined input/output limitation information 220 is
information having the same format as the input/output limitation
information 216, and defines existence or non-existence of
limitation with respect to operation and display of a full screen
so as to be capable of corresponding to various applications of
various mobile phones.
[0086] In a case where the input/output limitation information 216
is sent from the mobile phone 103 or the server 105 through the
vehicle interior communication IF 112, the input/output limitation
information region 221 stores the received input/output limitation
information 216. In a case where the input/output limitation
information 216 is not received, the input/output limitation
information region 221 stores the predetermined input/output
limitation information 220.
[0087] The input limitation unit 204 controls whether or not input
sent from the input device 110 of the in-vehicle device 101 through
the in-vehicle device input control unit 207 and the in-vehicle
device input/output switching unit 202 is sent to the mobile phone
103 through the in-vehicle device vehicle-interior communication
control unit 209 in accordance with the instruction of the vehicle
state determination unit 206.
[0088] The output limitation unit 205 processes display contents,
which are received from the mobile phone 103 through the in-vehicle
device vehicle-interior communication control unit 209 and the
in-vehicle device input/output switching unit 202, to display
contents with limitation in accordance with the instruction of the
vehicle state determination unit 206, and displays the display
contents with limitation on the display device 111 of the
in-vehicle device 101 through the in-vehicle device display control
unit 208.
[0089] The vehicle state determination unit 206 acquires the
vehicle state such as the parking brake, the brake, the vehicle
speed, the acceleration, the latitude and the longitude from the
vehicle state sensor 102, determines a limitation method and a
limitation region of input/output in accordance with the
input/output limitation information 216 or the predetermined
input/output limitation information 220 stored in the input/output
limitation information region 221 of the input/output limitation
information storage unit 203, and instructs the input limitation
unit 204, the output limitation unit 205, and the in-vehicle device
input/output switching unit 202 on the limitation method and the
limitation region.
[0090] The mobile phone application unit 210 receives input
information from the mobile phone input/output switching unit 211,
performs processing according to the service function of the
application, and outputs an image and the like through the mobile
phone input/output switching unit 211. When the in-vehicle device
101 and the mobile phone 103 are connected to each other, the
mobile phone application unit 210 performs communication between
the vehicle interior communication IF 116 of the mobile phone 103
and the vehicle interior communication IF 112 of the in-vehicle
device 101 through the mobile phone input/output switching unit 211
and the mobile phone vehicle-interior communication control unit
214, and passes the input/output limitation information 216 to the
in-vehicle device 101.
[0091] The mobile phone input/output switching unit 211 passes, to
the mobile phone application unit 210, information received from
the mobile phone input control unit 212, or input information of
the in-vehicle device 101 received through the mobile phone
vehicle-interior communication control unit 214.
[0092] The mobile phone input control unit 212 controls to pass, to
the mobile phone input/output switching unit 211, data received
from the input device 117 of the mobile phone 103.
[0093] The mobile phone output control unit 213 controls to display
data received from the mobile phone input/output switching unit 211
on the display device 118 of the mobile phone 103.
[0094] The mobile phone vehicle-interior communication control unit
214 is connected to the vehicle interior communication IF 112 of
the in-vehicle device 101 through the vehicle interior
communication IF 116 of the mobile phone 103, and controls to
transmit/receive data of the in-vehicle device vehicle-interior
communication control unit 209.
[0095] The mobile phone vehicle-exterior communication control unit
215 controls the vehicle exterior communication IF 119 of the
mobile phone 103 in accordance with the instruction of the mobile
phone application unit 210, and controls communication with the
server 105 through the network 104.
[0096] The delivery unit 222 of the server 105 specifies
input/output limitation information suitable for a combination of
the in-vehicle device 101 instructing operation remotely and the
mobile phone 103 receiving and performing the remote operation in
reference to the input/output limitation information management
table 223 from the in-vehicle device model ID and the mobile phone
app ID received from the mobile phone 103, and passes the same to
the mobile phone 103.
[0097] The input/output limitation information management table 223
is a table illustrated in FIG. 9, and the input/output limitation
information suitable for the combination is stored for each
combination of the in-vehicle device model ID and the mobile phone
app ID.
[0098] FIG. 4 is a figure showing a table of the limitation
condition information. This is a table for managing the display
limitation part and the operation limitation part on the screen for
each state of the vehicle installed with in-vehicle device 101
therein. In this example, as the state of the vehicle, the parking
brake state and the vehicle speed are utilized.
[0099] In a "parking brake state" 301, the parking brake state
acquired by the vehicle state sensor 102 is listed.
[0100] In a "vehicle speed" 302, the vehicle speed acquired by the
vehicle state sensor 102 is listed.
[0101] In a "display limitation part" 303, the ID of the display
limitation part is listed.
[0102] In an "operation limitation part" 304, the ID of the
operation limitation part is listed.
[0103] On a line 305, it is described that in a case where the
"parking brake state" is "ON", and the "vehicle speed" is "vehicle
speed=0 km/h", the "display limitation part" is "none", and the
"operation limitation part" is "none". On a line 306, it is
described that in a case where the "parking brake state" is "OFF",
and the "vehicle speed" is "0 km/h.ltoreq.vehicle speed.ltoreq.30
km/h", the "display limitation part" is a "display part A", and the
"operation limitation part" is "none". On a line 307, it is
described that in a case where the "parking brake state" is "OFF",
and the "vehicle speed" is "0 km/h<vehicle speed.ltoreq.30
km/h", the "display limitation part" is a "display part B", and the
"operation limitation part" is an "input part a". On a line 308, it
is described that in a case where the "parking brake state" is
"OFF", and the "vehicle speed" is "20 km/h<vehicle
speed.ltoreq.30 km/h", the "display limitation part" is a "display
part C", and the "operation limitation part" is an "input part b".
On a line 309, it is described that in a case where the "parking
brake state" is "OFF", and the "vehicle speed" is "30
km/h<vehicle speed.ltoreq.40 km/h", the "display limitation
part" is a "full screen A", and the "operation limitation part" is
"all input". On a line 310, it is described that in a case where
the "parking brake state" is "OFF", and the "vehicle speed" is "40
km/h<vehicle speed.ltoreq.50 km/h", the "display limitation
part" is a "full screen B", the "operation limitation part" is "all
input". On a line 311, it is described that in a case where the
"parking brake state" is "OFF", and the "vehicle speed" is "50
km/h<vehicle speed", the "display limitation part" is a "full
screen C", and the "operation limitation part" is "all input".
[0104] The vehicle state determination unit 206 receives this table
from the input/output limitation information region 221 of the
input/output limitation information storage unit 203. Furthermore,
the vehicle state determination unit 206 compares the "parking
brake state" and the "vehicle speed" received from the vehicle
state sensor 102 with conditions of the "parking brake state" and
the "vehicle speed" of each line of this table, and extracts the
"display limitation part" and the "operation limitation part" of a
line meeting the conditions of the vehicle state.
[0105] For example, in a case where the "parking brake state" is
"ON", and the "vehicle speed" is "vehicle speed=0 km/h", the
vehicle states meet only the conditions of the line 305. Therefore,
the vehicle state determination unit 206 extracts the information
that the "display limitation part" is "none", and the "operation
limitation part" is "none".
[0106] In a case where the "parking brake state" is "OFF", and the
"vehicle speed" is "vehicle speed=0 km/h", the vehicle states meet
only the conditions of the line 306. Therefore, the information
that the "display limitation part" is the "display part A", and the
"operation limitation part" is "none" is extracted.
[0107] In a case where the "parking brake state" is "OFF", and the
"vehicle speed" is "0 km/h<vehicle speed=20 km/h", the vehicle
states meet the conditions of the line 306 and the line 307, and
the information that the "display limitation part" is the "display
part A" and the "display part B", and the "operation limitation
part" is "none" and the "input part a" is extracted.
[0108] In a case where the "parking brake state" is "OFF", and the
"vehicle speed" is "20 km/h<vehicle speed=30 km/h", the vehicle
states meet the conditions of the line 306, and the line 307 and
the line 308, the information that the "display limitation part" is
the "display part A", the "display part B" and the "display part
C", and the "operation limitation part" is "none", the "input part
a" and the "input part b" is extracted.
[0109] In a case where the "parking brake state" is "OFF", and the
"vehicle speed" is "30 km/h<vehicle speed=40 km/h", the vehicle
states meet only the conditions of the line 309, and the
information that the "display limitation part" is the "full screen
A", and the "operation limitation part" is "all input" is
extracted.
[0110] In a case where the "parking brake state" is "OFF", and the
"vehicle speed" is "40 km/h<vehicle speed=50 km/h", the vehicle
states meet only the conditions of the line 310, and the
information that the "display limitation part" is the "full screen
B", and the "operation limitation part" is "all input" is
extracted.
[0111] In a case where the "parking brake state" is "OFF", and the
"vehicle speed" is "50 km/h<vehicle speed", the vehicle states
meet only the conditions of the line 311, and the information that
the "display limitation part" is the "full screen C", and the
"operation limitation part" is "all input" is extracted.
[0112] FIG. 5 is a figure showing a table of the limitation method
information. This is a table for managing a limitation display
method and a limitation region of display and operation, designated
by the "display limitation part" 303 or the "operation limitation
part" 304 of the limitation condition information table. In this
example, while a case where the screen configuration of the
application of the mobile phone is not changed is covered, the
limitation display method and the limitation region may be defined
for each screen configuration in a case where the screen
configuration is changed.
[0113] In a "part" 401, an ID of the "display limitation part" 303
or the "operation limitation part" 304 of the limitation condition
information table is listed.
[0114] In a "limitation region" 402, a region or a part limiting
display or operation corresponding to the ID of the "display
limitation part" or the "operation limitation part" is listed.
[0115] In a "limitation display method" 403, a method of limiting
display is listed.
[0116] In a "synthetic data" 404, data utilized for the limitation
of display is listed.
[0117] On a line 405, it is described that in a case where the
selected "part" is the "display part A", the "limitation region" is
a "rectangular region (x1, y1)-(x2, y2)", and the "limitation
display method" is "superposition", and the "synthetic data" is
"image data A".
[0118] On a line 406, it is described that in a case where the
selected "part" is the "display part B", the "limitation region" is
a "rectangular region (x3, y3)-(x4, y4)", the "limitation display
method" is "superposition", and the "synthetic data" is "image data
B".
[0119] On a line 407, it is described that in a case where the
selected "part" is the "display part B", the "limitation region" is
a "rectangular region (x5, y5)-(x6, y6)", the "limitation display
method" is "superposition", and the "synthetic data" is "gray".
[0120] On a line 408, it is described that in a case where the
selected "part" is the "display part C", the "limitation region" is
a "rectangular region (x7, y7)-(x8, y8)", the "limitation display
method" is "superposition", and the "synthetic data" is "gray".
[0121] On a line 409, it is described that in a case where the
selected "part" is the "input part a", the "limitation region" is a
"rectangular region (x5, y5)-(x6, y6)", the "limitation display
method" is "none", and the "synthetic data" is "none".
[0122] On a line 410, it is described that in a case where the
selected "part" is the "input part b", the "limitation region" is a
"rectangular region (x7, y7)-(x8, y8)", the "limitation display
method" is "none", and the "synthetic data" is "none".
[0123] On a line 411, it is described that in a case where the
selected "part" is the "input part b", the "limitation region" is a
"selection key", the "limitation display method" is "none", and the
"synthetic data" is "none".
[0124] On a line 412, it is described that in a case where the
selected "part" is the "full screen A", the "limitation region" is
a "full screen region", the "limitation display method" is "reduced
size 1/5 display", and the "synthetic data" is an "in-vehicle
device screen for reduced size 1/5 and mobile phone screen for
reduced size 1/5".
[0125] On a line 413, it is described that in a case where the
selected "part" is the "full screen B", the "limitation region" is
a "full screen region", the "limitation display method" is "icon
display", and the "synthetic data" is an "in-vehicle device screen
for icon and icon data".
[0126] On a line 414, it is described that in a case where the
selected "part" is the "full screen C", the "limitation region" is
the "full screen region", the "limitation display method" is
"in-vehicle device screen display", and the "synthetic data" is an
"in-vehicle device screen".
[0127] On a line 415, it is described that in a case where the
selected "part" is "all input", the "limitation region" is a "full
screen region and all keys", the "limitation display method" is
"none", and the "synthetic data" is "none".
[0128] For example, in a case where the vehicle state determination
unit 206 extracts the "display part A", and the display of the
"display part A" is limited, when the line 405 is read out, the
"limitation region" is the "rectangular region (x1, y1)-(x2, y2)",
the "limitation method" is the "superposition", and the "synthetic
data" used for the superposition is the "image data A". The
"rectangular region (x1, y1)-(x2, y2)" represents a rectangular
region in which coordinates (x1, y1) and coordinates (x2, y2) of
display of the mobile phone are apexes of opposite angles. In this
case, the vehicle state determination unit 206 instructs the output
limitation unit 205 to superimpose the "image data A" on the
"rectangular region (x1, y1)-(x2, y2)" of the display of the mobile
phone 103 for displaying, and to limit the display of the mobile
phone 103 to the display device 111 of the in-vehicle device
101.
[0129] In a case where the display of the "display part B" is
limited, when the line 406 and the line 407 are read out, the
"limitation regions" are the "rectangular region (x3, y3)-(x4, y4)"
and the "rectangular region (x5, y5)-(x6, y6)". The "limitation
display method" of the "rectangular region (x3, y3)-(x4, y4)" is
the "superposition", and the "synthetic data" is the "image data
B", while the "limitation display method" of the "rectangular
region (x5, y5)-(x6, y6)" is the "superposition", and the
"synthetic data" is the "gray".
[0130] In a case where the display of the "display part C" is
limited, when the line 408 is read out, the "limitation region" is
the "rectangular region (x7, y7)-(x8, y8)", the "limitation display
method" is the "superposition", and the "synthetic data" is the
"gray". In this case, a "gray" rectangle is superimposed on the
"rectangular region (x7, y7)-(x8, y8)" in the display of the mobile
phone 103 for displaying, and the display of the mobile phone 103
to the display device 111 of the in-vehicle device 101 is
limited.
[0131] In a case where the input of the "input part a" is limited,
when the line 409 is read out, the "limitation region" is the
"rectangular region (x5, y5)-(x6, y6)". In this case, the vehicle
state determination unit 206 instructs the input limitation unit
204 not to output the input to the "rectangular region (x5,
y5)-(x6, y6)" to the in-vehicle device vehicle-interior
communication control unit 209.
[0132] In a case where the input of the "input part b" is limited,
when the line 410 and the line 411 are read out, the "limitation
regions" are the "rectangular region (x7, y7)-(x8, y8)" and the
"selection key". In this case, the vehicle state determination unit
206 instructs the input limitation unit 204 not to output the input
of the "rectangular region (x7, y7)-(x8, y8)" and the "selection
key" to the in-vehicle device vehicle-interior communication
control unit 209.
[0133] In a case where the display of the "full screen A" is
limited, when the line 412 is read out, the "limitation region" is
the "full screen region", the "limitation display methods" are the
"reduced size 1/5 display", and the "in-vehicle device screen for
reduced size 1/5 and mobile phone screen for reduced size 1/5". The
"reduced size 1/5 display" means that the whole display of the
mobile phone 103 is reduced in size to 1/5, and superimposed on the
screen of the in-vehicle device for displaying. In this case, the
vehicle state determination unit 206 instructs the in-vehicle
device input/output switching unit 202 to process the display data
of the in-vehicle device application unit 201 to the in-vehicle
device screen for reduced size 1/5, to reduce the display data of
the mobile phone 103 received from the in-vehicle device
vehicle-interior communication control unit 209 to 1/5, and to pass
the same to the output limitation unit 205. Furthermore, the
vehicle state determination unit 206 instructs the output
limitation unit 205 to superimpose the display data of the mobile
phone 103, which is reduced in size to 1/5 and received from the
in-vehicle device input/output switching unit 202 on the display
data of the in-vehicle device application unit 201, which is
processed to the in-vehicle device screen for reduced size 1/5, to
pass the same to the in-vehicle device display control unit 208 for
displaying.
[0134] In a case where the display of the "full screen B" is
limited, when the line 413 is read out, the "limitation region" is
the "full screen region", the "limitation display method" is the
"icon display", and the "synthetic data" is the "in-vehicle device
screen for icon and icon data". The "icon display" means that the
display of the mobile phone 103 is not performed, and the "icon
data" of the application run by the mobile phone 103 is
superimposed on the screen of the in-vehicle device. In this case,
the vehicle state determination unit 206 passes the icon data to
the in-vehicle device input/output switching unit 202, and
instructs the in-vehicle device input/output switching unit 202 to
process the display data of the in-vehicle device application unit
201 to the in-vehicle device screen for icon, and to pass the same
together with the icon data to the output limitation unit 205.
Furthermore, the vehicle state determination unit 206 instructs the
output limitation unit 205 to superimpose the icon data on the
display data of the in-vehicle device application unit 201, which
is processed to the in-vehicle device screen for icon received from
the in-vehicle device input/output switching unit 202, and to pass
the same to the in-vehicle device display control unit 208 for
displaying.
[0135] In a case where the display of the "full screen C" is
limited, when the line 414 is read out, the "limitation region" is
the "full screen region", the "limitation display method" is the
"in-vehicle device screen display", and the "synthetic data" is the
"in-vehicle device screen". The "in-vehicle device screen display"
means that the display of the mobile phone 103 is not performed,
and the screen of the application run by the mobile phone 103 is
displayed. In this case, the vehicle state determination unit 206
instructs the in-vehicle device input/output switching unit 202 to
pass the display data of the in-vehicle device application unit 201
to the output limitation unit 205. Furthermore, the vehicle state
determination unit 206 instructs the output limitation unit 205 to
pass the display data of the in-vehicle device application unit 201
received from the in-vehicle device input/output switching unit 202
to the in-vehicle device display control unit 208 for
displaying.
[0136] In a case where the "all input" is limited, when the line
415 is read out, the "limitation region" is the "full screen region
and all keys". In this case, the vehicle state determination unit
206 instructs the input limitation unit 204 not to output all input
to the in-vehicle device vehicle-interior communication control
unit 209.
[0137] FIG. 6 is an example of a screen in which display and
operation are limited during the application of the mobile phone is
remote-controlled with the in-vehicle device.
[0138] Reference numeral 501 denotes an example of a screen of a
certain application in a case where the parking brake is ON, and
the vehicle speed is 0 km/h. Reference numeral 502 denotes an
example of a screen of the application in a case where the parking
brake is OFF, and the vehicle speed is 0 km/h. Reference numeral
503 denotes an example of a screen of the application in a case
where the parking brake is OFF, and the vehicle speed exceeds 0
km/h and is 20 km/h or less. Reference numeral 504 denotes an
example of a screen of the application in a case where the parking
brake is OFF, and the vehicle speed exceeds 20 km/h and is 30 km/h
or less. Reference numeral 505 denotes an example of a screen of
the application in a case where the parking brake is OFF, and the
vehicle speed exceeds 30 km/h and is 40 km/h or less. Reference
numeral 506 denotes an example of a screen of the application in a
case where the parking brake is OFF, and the vehicle speed exceeds
40 km/h and is 50 km/h or less. Reference numeral 507 denotes an
example of a screen of the application in a case where the parking
brake is OFF, and the vehicle speed exceeds 50 km/h.
[0139] Reference numeral 508 denotes a full screen region of the
display device 111 included in the in-vehicle device 101. Reference
numeral 509 denotes a selection key of the input device 110
included in the in-vehicle device 101. Reference numeral 510
denotes a return key of the input device 110 included in the
in-vehicle device 101. Reference numeral 511 denotes a rectangular
region (x1, y1)-(x2, y2) of the display device 111 included in the
in-vehicle device 101. Reference numeral 512 denotes a rectangular
region (x3, y3)-(x4, y4) of the display device 111 included in the
in-vehicle device 101. Reference numeral 513 denotes a rectangular
region (x5, y5)-(x6, y6) of the display device 111 included in the
in-vehicle device 101. Reference numeral 514 denotes a rectangular
region (x7, y7)-(x8, y8) of the display device 111 included in the
in-vehicle device 101. Reference numeral 515 denotes a display
region of a mobile phone screen reduced in size to 1/5 of the
display device 111 included in the in-vehicle device 101. Reference
numeral 516 denotes a display region of a mobile phone application
icon of the display device 111 included in the in-vehicle device
101.
[0140] In the case where the parking brake is ON, and the vehicle
speed is 0 km/h, only the conditions of the line 305 of the table
of FIG. 4 are met, and hence the vehicle state determination unit
206 extracts "none" as the "display limitation part" and "none" as
the "operation limitation part" from the table of FIG. 4. Since the
"display limitation part" is "none", and hence the vehicle state
determination unit 206 instructs the in-vehicle device input/output
switching unit 202 to pass the input received from the in-vehicle
device input control unit 207 to the input limitation unit 204
without any change, and to pass the display data of the mobile
phone 103 received from the in-vehicle device vehicle-interior
communication control unit 209 to the output limitation unit 205
without any change. Furthermore, the vehicle state determination
unit 206 instructs the input limitation unit 204 to pass the input
received from the in-vehicle device input/output switching unit 202
to the mobile phone 103 through the in-vehicle device
vehicle-interior communication control unit 209 without any change,
and instructs the output limitation unit 205 to pass the display
data of the mobile phone 103 received from the in-vehicle device
input/output switching unit 202 to the in-vehicle device display
control unit 208 without any change, and to display the same on the
display device 111 of the in-vehicle device 101. Therefore, a
screen of the example 501 of the screen in the case where the
parking brake is ON, and the vehicle speed is 0 km/h is the same
display as the screen of the mobile phone application unit 210 of
the mobile phone 103, and operation to any region of the screen is
transmitted to the mobile phone 103.
[0141] In the case where the parking brake is OFF, and the vehicle
speed is 0 km/h, only the conditions of the line 306 of the table
of FIG. 4 are met, and hence the vehicle state determination unit
206 extracts the "display part A" as the "display limitation part"
and "none" as the "operation limitation part" from the table of
FIG. 4. Then, the line 405, the "part" of which is the "display
part A", is extracted from the table of FIG. 5, and the "limitation
region" is the "rectangular region (x1, y1)-(x2, y2)", the
"limitation method" is the "superposition", the "synthetic data"
used for the superposition is the "image data A". The "rectangular
region (x1, y1)-(x2, y2)" represents a rectangular region in which
coordinates (x1, y1) and coordinates (x2, y2) in the screen of the
mobile phone 103 are apexes of opposite angles. In this case, the
vehicle state determination unit 206 instructs the output
limitation unit 205 to superimpose the "image data A" on the
"rectangular region (x1, y1)-(x2, y2)" of the screen of the mobile
phone 103 for displaying, and to limit the display of the mobile
phone 103 to the display device 111 of the in-vehicle device 101.
Therefore, in the example 502 of the screen in the case where the
parking brake is OFF, and the vehicle speed is 0 km/h, the image
data A of the display of the mobile phone application unit 210 of
the mobile phone 103 is displayed on the rectangular region (x1,
y1)-(x2, y2) 511. However, operation to any region of the screen is
transmitted to the mobile phone 103.
[0142] In the case where the parking brake is OFF, and the vehicle
speed exceeds 0 km/h and is 20 km/h or less, only the conditions of
the line 306 and the line 307 of the table of FIG. 4 are met, and
hence the vehicle state determination unit 206 extracts the
"display part A" and the "display part B" as the "display
limitation part", and "none" and the "input part a" as the
"operation limitation part" from the table of FIG. 4. Then, the
line 405, the line 406, the line 407 and the line 409, the "parts"
of which are the "display part A", the "display part B", and the
"input part a", are extracted from the table of FIG. 5. The vehicle
state determination unit 206 instructs the output limitation unit
205 to limit the display of the rectangular region (x1, y1)-(x2,
y2) 511, the rectangular region (x3, y3)-(x4, y4) 512, and the
rectangular region (x5, y5)-(x6, y6) 513. Furthermore, the vehicle
state determination unit 206 instructs the input limitation unit
204 to limit the input of the rectangular region (x5, y5)-(x6, y6)
513. Therefore, in the example 503 of the screen in the case where
the parking brake is OFF, and the vehicle speed exceeds 0 km/h and
is 20 km/h or less, of the display of the mobile phone application
unit 210 of the mobile phone 103, the image data A is displayed on
the rectangular region (x1, y1)-(x2, y2) 511, the image data B is
displayed on the rectangular region (x3, y3)-(x4, y4) 512, the gray
rectangle is displayed on the rectangular region (x5, y5)-(x6, y6)
513, and the input to the rectangular region (x5, y5)-(x6, y6) 513
is not transmitted to the mobile phone 103.
[0143] In the case where the parking brake is OFF, and the vehicle
speed exceeds 20 km/h and is 30 km/h or less, the conditions of the
line 306, the line 307 and the line 308 of the table of FIG. 4 are
met, and hence the vehicle state determination unit 206 extracts
the "display part A", the "display part B", and the "display part
C" as the "display limitation part", and "none" and the "input part
a" and the "input part b" as the "operation limitation part" from
the table of FIG. 4. Furthermore, the line 405, the line 406, the
line 407, the line 408, the line 409, the line 410 and the line
411, the "parts" of which are the "display part A", the "display
part B", the "display part C", the "input part a" and the "input
part b", are extracted from the table of FIG. 5. Then, the vehicle
state determination unit 206 instructs the output limitation unit
205 to limit the display of the rectangular region (x1, y1)-(x2,
y2) 511, the rectangular region (x3, y3)-(x4, y4) 512, the
rectangular region (x5, y5)-(x6, y6) 513, and the rectangular
region (x7, y7)-(x8, y8) 514. Furthermore, the vehicle state
determination unit 206 instructs the input limitation unit 204 to
limit the input of the rectangular region (x5, y5)-(x6, y6) 513,
the rectangular region (x7, y7)-(x8, y8) 514, and the selection
key. Therefore, in the example 504 of the screen in the case where
the parking brake is OFF, and the vehicle speed exceeds 20 km/h and
is 30 km/h or less, of the display of the mobile phone application
unit 210 of the mobile phone 103, the image data A is displayed on
the rectangular region (x1, y1)-(x2, y2) 511, the image data B is
displayed on the rectangular region (x3, y3)-(x4, y4) 512, the gray
rectangle is displayed on the rectangular region (x5, y5)-(x6, y6)
513, the gray rectangle is displayed on the rectangular region (x7,
y7)-(x8, y8) 514, and the input to the rectangular region (x5,
y5)-(x6, y6) 513, the rectangular region (x7, y7)-(x8, y8) 514, and
the selection key is not transmitted to the mobile phone 103.
[0144] In the case where the parking brake is OFF, and the vehicle
speed exceeds 30 km/h and is 40 km/h or less, only the conditions
of the line 309 of the table of FIG. 4 are met, and hence the
vehicle state determination unit 206 extracts the "full screen A"
as the "display limitation part", and the "all input" as the
"operation limitation part" from the table of FIG. 4. Furthermore,
the line 412 and the line 415, the "parts" of which are the "full
screen A" and the "all input" are extracted from the table of FIG.
5. Then, the vehicle state determination unit 206 instructs the
in-vehicle device input/output switching unit 202 to process the
display data of the in-vehicle device application unit 201 to the
in-vehicle device screen for reduced size 1/5, to reduce the
display data of the mobile phone 103 received from the in-vehicle
device vehicle-interior communication control unit 209 to 1/5, and
to pass the same to the output limitation unit 205. Furthermore,
the vehicle state determination unit 206 instructs the output
limitation unit 205 to superimpose the display data of the mobile
phone 103, which is reduced in size to 1/5 and received from the
in-vehicle device input/output switching unit 202, on the display
data of the in-vehicle device application unit 201, which is
processed to the in-vehicle device screen for reduced size 1/5, and
to pass the same to the in-vehicle device display control unit 208
for displaying, and instructs the input limitation unit 204 not to
output all of the input to the in-vehicle device vehicle-interior
communication control unit 209. Therefore, in the example 505 of
the screen in the case where the parking brake is OFF, and the
vehicle speed exceeds 30 km/h and is 40 km/h or less, the
in-vehicle device screen for reduced size 1/5 is displayed on the
full screen region 508 of the display device 111 of the in-vehicle
device 101, and the display data of the mobile phone 103, which is
reduced in size to 1/5, is displayed on the display region 515 of
the mobile phone screen for reduced size 1/5, and all of the input
is not transmitted to the mobile phone 103.
[0145] In the case where the parking brake is OFF, and the vehicle
speed exceeds 40 km/h and is 50 km/h or less, only the conditions
of the line 310 of the table of FIG. 4 are met, and hence the
vehicle state determination unit 206 extracts the "full screen B"
as the "display limitation part", and the "all input" as the
"operation limitation part" from the table of FIG. 4. Furthermore,
the line 413 and the line 415, the "parts" of which are the "full
screen B" and the "all input" are extracted from the table of FIG.
5. Then, the vehicle state determination unit 206 passes the icon
data to the in-vehicle device input/output switching unit 202, and
instructs the in-vehicle device input/output switching unit 202 to
process the display data of the in-vehicle device application unit
201 to the in-vehicle device screen for icon, and to pass the same
together with the icon data to the output limitation unit 205.
Furthermore, the vehicle state determination unit 206 instructs the
output limitation unit 205 to superimpose the icon data on the
display data of the in-vehicle device application unit 201, which
is processed to the in-vehicle device screen for icon received from
the in-vehicle device input/output switching unit 202, and to pass
the same to the in-vehicle device display control unit 208 for
displaying. Moreover, the vehicle state determination unit 206
instructs the input limitation unit 204 not to output all of the
input to the in-vehicle device vehicle-interior communication
control unit 209. Therefore, in the example 506 of the screen in
the case where the parking brake is OFF, and the vehicle speed
exceeds 40 km/h and is 50 km/h or less, the in-vehicle device
screen for icon is displayed on the full screen region 508 of the
display device 111 of the in-vehicle device 101, and the icon is
displayed on the display region 516 of the mobile phone application
icon, and all of the input is not transmitted to the mobile phone
103.
[0146] In the case where the parking brake is OFF, and the vehicle
speed exceeds 50 km/h, only the conditions of the line 311 of the
table of FIG. 4 are met, and hence the vehicle state determination
unit 206 extracts the "full screen C" as the "display limitation
part", and "all input" as the "operation limitation part" from the
table of FIG. 4. Furthermore, the vehicle state determination unit
206 extracts the line 414 and the line 415, the "parts" of which
are the "full screen C" and the "all input", from the table of FIG.
5. Then, the vehicle state determination unit 206 instructs the
in-vehicle device input/output switching unit 202 to pass the
display data of the in-vehicle device application unit 201 to the
output limitation unit 205, instructs the output limitation unit
205 to pass the display data of the in-vehicle device application
unit 201, which is received from the in-vehicle device input/output
switching unit 202, to the in-vehicle device display control unit
208 for displaying, and instructs the input limitation unit 204 not
to output all of the input to the in-vehicle device
vehicle-interior communication control unit 209. Therefore, in the
example 507 of the screen in the case where the parking brake is
OFF, and the vehicle speed exceeds 50 km/h, the in-vehicle device
screen is displayed on the full screen region 508 of the display
device 111 of the in-vehicle device 101, and all of the input is
not transmitted to the mobile phone 103.
[0147] FIG. 7 is a figure showing an example of a table for
managing limitation conditions of display and operation according
to a predetermined vehicle state. A configuration thereof is
similar to that of the table of the limitation condition
information of FIG. 4. Configurations denoted by the same reference
numerals as those shown in FIG. 4, which are already described, and
portions having the same functions are not repeatedly
described.
[0148] On a line 601, it is described that in a case where the
"parking brake state" is "ON", and the "vehicle speed" is "vehicle
speed=0 km/h", the "display limitation part" is "none", and the
"operation limitation part" is "none". On a line 602, it is
described that in a case where the "parking brake state" is "OFF",
and the "vehicle speed" is "vehicle speed=0 km/h", the "display
limitation part" is a "display part B", and the "operation
limitation part" is "all input". On a line 603, it is described
that in a case where the "parking brake state" is "OFF", and the
"vehicle speed" is "0 km/h<vehicle speed", the "display
limitation part" is a "display part C", and the "operation
limitation part" is "all input".
[0149] Thus, it is possible to correspond to various applications
for general purposes without being influenced by the display
contents of the applications of the mobile phone by setting an item
entered in the "display limitation part" as "none" or the
limitation parts to the whole display of the mobile phone 103, and
setting an item entered in the "operation limitation part" as
"none" or the parts to all input.
[0150] FIG. 8 is a figure showing a configuration of a table for
managing limitation parts of predetermined display and operation,
and a limitation method. The configuration thereof is similar to
that of the table of the limitation method information of FIG. 5.
Configurations denoted by the same reference numerals as those
shown in FIG. 5, which are already described, and portions having
the same functions are not repeatedly described.
[0151] On a line 701, it is described that in a case where the
"part" is the "full screen B", the "limitation region" is the "full
screen region", the "limitation display method" is the "icon
display", and the "synthetic data" is the "in-vehicle device screen
for icon and icon data". On a line 702, it is described that in a
case where the selected "part" is "full screen C", the "limitation
region" is the "full screen region", the "limitation display
method" is the "in-vehicle device screen display", and the
"synthetic data" is the "in-vehicle device screen". On a line 703,
it is described that in a case where the selected "part" is the
"all input", the "limitation region" is the "full screen region and
all keys", the "limitation display method" is "none", and the
"synthetic data" is "none".
[0152] As in the table of FIG. 8, it is determined that the "full
screen B" and the "full screen C" used in FIG. 7 are limitation
parts to the whole display of the mobile phone 103, and it is
determined that the "all input" is a method of not transmitting all
of the input to the mobile phone 103, thereby enabling input and
output to be limited to various applications for general purposes
without being influenced by the display contents of the
applications of the mobile phone.
[0153] FIG. 9 shows an example of a configuration of a table for
managing input/output limitation information delivered from the
server.
[0154] An "in-vehicle device model ID" 801 is an ID inherent in the
model of the in-vehicle device. A "mobile phone app ID" 802 is an
ID inherent in the individual application run by the mobile phone
103. An "input/output limitation information" 803 is input/output
limitation information delivered by the server 105, and has the
same configuration as the input/output limitation information
216.
[0155] On a line 804, it is described that "input/output limitation
information" delivered in a case where the "in-vehicle device model
ID" is an "in-vehicle device A", and the "mobile phone app ID" is a
"mobile phone app a" is "input/output limitation information Aa".
On a line 805, it is described that "input/output limitation
information" delivered in a case where the "in-vehicle device model
ID" is an "in-vehicle device A", and the "mobile phone app ID" is a
"mobile phone app b" is "input/output limitation information Ab".
On a line 806, it is described that "input/output limitation
information" delivered in a case where the "in-vehicle device model
ID" is an "in-vehicle device B", and the "mobile phone app ID" is
the "mobile phone app a" is "input/output limitation information
Ba". On a line 807, it is described that "input/output limitation
information" delivered in a case where the "in-vehicle device model
ID" is the "in-vehicle device B", and the "mobile phone app ID" is
the "mobile phone app b" is "input/output limitation information
Bb".
[0156] FIG. 10 is an example of sequence activating such that the
application of the mobile phone is remote-controlled with the
in-vehicle device.
[0157] Here, reference numeral 901 denotes a server, reference
numeral 902 denotes a user, reference numeral 903 denotes a mobile
phone, and reference numeral 904 denotes an in-vehicle device.
[0158] First, the user 902 make an instruction of mobile phone app
start-up 905 to the mobile phone 903. The mobile phone 903 makes
connection 906 to the in-vehicle device 904. The in-vehicle device
904 makes a limitation information inquiry (in-vehicle device model
ID) 907 to the mobile phone 903, and passes the in-vehicle device
model ID to the mobile phone 903.
[0159] A case where an in-vehicle device model ID list of the
compatible in-vehicle device information 219 of the input/output
limitation information 216 of the in-vehicle device application
unit 201 includes the in-vehicle device model ID of the limitation
information inquiry (in-vehicle device model ID) 907, and
input/output limitation information suitable for the in-vehicle
device 904 exists will be considered.
[0160] First, input/output limitation information transmission 908
is performed to the in-vehicle device 904, and the input/output
limitation information 216 is passed to the in-vehicle device
904.
[0161] The in-vehicle device 904 performs input/output limitation
information setting 909. That is, the input/output limitation
information 216 received by the in-vehicle device vehicle-interior
communication control unit 209 is passed to the input/output
limitation information storage unit 203, and is written in the
input/output limitation information region 221.
[0162] In a case where the in-vehicle device model ID list of the
compatible in-vehicle device information 219 of the input/output
limitation information 216 of the in-vehicle device application
unit 201 does not include the in-vehicle device model ID of the
limitation information inquiry (in-vehicle device model ID) 907,
and the input/output limitation information suitable for the
in-vehicle device 904 does not exist, the mobile phone 903 makes a
limitation information inquiry (an in-vehicle device model ID and a
mobile phone app ID) 910 to the server 901, and the in-vehicle
device model ID and the mobile phone app ID are passed to the
server 901.
[0163] In a case where the combination of the in-vehicle device
model ID and the mobile phone app ID received by the server 901
exists in the input/output limitation information management table,
and input/output limitation information suitable for the
combination of the applications run by the in-vehicle device 904
and the mobile phone 903 exists in the server 901, the delivery
unit 222 extracts the input/output limitation information from the
input/output limitation information management table 223, performs
input/output limitation information transmission 911 to the mobile
phone 903, and passes the input/output limitation information 216
to the mobile phone 903.
[0164] The mobile phone 903 performs input/output limitation
information transmission 912, and passes the input/output
limitation information 216 received from the server 901 to the
in-vehicle device 904.
[0165] The in-vehicle device 904 performs input/output limitation
information setting 913, and writes the input/output limitation
information 216 received from the server 901 in the input/output
limitation information region 221.
[0166] In a case where the combination of the in-vehicle device
model ID and the mobile phone app ID received by the server 901
does not exist in the input/output limitation information
management table, and input/output limitation information suitable
for the combination of the applications run by the in-vehicle
device 904 and the mobile phone 903 does not exist in the server
901, the server 901 sends a notification of no input/output
limitation information 914 to the mobile phone 903.
[0167] The mobile phone 903 sends a notification of no input/output
limitation information 915 to the in-vehicle device 904. The
in-vehicle device 904 performs predetermined input/output
limitation information setting 916. The input/output limitation
information storage unit 203, which receives the notification of no
input/output limitation information through the in-vehicle device
vehicle-interior communication control unit 209, writes the
contents of the predetermined input/output limitation information
220 in the input/output limitation information region 221.
[0168] During linkage operation, input 917 from the user 902 to the
in-vehicle device 904, input 918 from the in-vehicle device 904 to
the mobile phone 903, output 919 from the mobile phone 903 to the
in-vehicle device 904, output 920 from the in-vehicle device 904 to
the user 902 are repeated. At this time, the vehicle state
determination unit 206 acquires a vehicle state from the vehicle
state sensor 102, performs control of the in-vehicle device
input/output switching unit 202, the input limitation unit 204, and
the output limitation unit 205 in accordance with the input/output
limitation information 216 or the predetermined input/output
limitation information 220, which is written in a input/output
limitation information storage region, controls whether or not the
input 917 received by the in-vehicle device input control unit 207
is passes to the mobile phone 903 as the input 918 through the
in-vehicle device vehicle-interior communication control unit 209,
processes display data of the output 919 received by the in-vehicle
device vehicle-interior communication control unit 209, displays
the same on the display device 111 through the in-vehicle device
display control unit 208, and passes the same as the output 920 to
the user 902.
[0169] Finally, disconnection 921 is notified by the in-vehicle
device 904 to the mobile phone 903, and remote control of the
mobile phone 903 by the in-vehicle device 904 is terminated.
[0170] FIG. 11 is an example of a flow of a vehicle state
determination unit.
[0171] First, the vehicle state determination unit 206 acquires a
vehicle state with the vehicle state sensor 102 in Step 1001. In
Step 1002, the input/output limitation information storage unit 203
reads in input/output limitation information stored in the
input/output limitation information region 221. In Step 1003, the
vehicle state determination unit 206 acquires a "display limitation
part" and a "operation limitation part" applied to the vehicle
state, which are acquired from the table (FIG. 4 or FIG. 7) for
managing the limitation conditions of display and operation in Step
1001.
[0172] In Step 1004, a "limitation region", a "limitation display
method" and "synthetic data" corresponding to the "display
limitation part" and the "operation limitation part" acquired in
Step 1003 are acquired from the table (FIG. 5 or FIG. 8) for
managing the limitation region of display and operation and the
limitation display method.
[0173] In Step 1005, in accordance with the "limitation region",
the "limitation display method" and the "synthetic data" acquired
in Step 1004, the in-vehicle device input/output switching unit
202, the input limitation unit 204, and the output limitation unit
205 are controlled to limit display and operation.
[0174] According to the present practical example, in a case where
display or operation is performed with the in-vehicle device 101
even when the parking brake is OFF, the application on the mobile
phone 103 previously holds the input/output limitation information
216 for limitation according to the vehicle state. Before start of
the display of the application with the in-vehicle device 101, the
in-vehicle device 101 acquires the input/output limitation
information 216 from the application, and changes transmission
ranges of display and operation according to the vehicle state.
[0175] According to the present practical example, in order to
address a case where the application on the mobile phone 103
previously does not have the input/output limitation information,
the input/output limitation information is held in the server 105
of a center. Before the start of the display of the application
with the in-vehicle device 101, the in-vehicle device 101 acquires
the input/output limitation information from the center, and
changes the transmission ranges of display and operation according
to the vehicle state.
[0176] According to an aspect of the present practical example, in
a case where an input/output device of the in-vehicle device is
used, and the application of the mobile phone is utilized, in
various combinations of the in-vehicle device and the mobile phone,
active and inactive of display and operation of the general-purpose
application of the mobile phone by the in-vehicle device 101 can be
controlled according to the vehicle state. Furthermore, a method of
controlling active and inactive of operation and the screen of the
in-vehicle device 101 can be changed for each application by
changing the input/output limitation information of the center, and
various applications can be safely utilized.
[0177] According to an aspect of the present practical example,
when the display or the operation of the application with the
in-vehicle device 101 is started, the input/output limitation
information is incorporated in the in-vehicle device 101, and hence
the user can easily apply limitation information easily enabling
safe display or operation by preparing the mobile phone 103 serving
as a control target device and the in-vehicle device 101 serving as
a control instruction device, even in a case of utilizing a new
mobile phone 103 or a new application with the in-vehicle device
101.
[0178] The aforementioned embodiment and practical example of the
present invention are exemplification for explanation of the
present invention, and the scope of the present invention is not
limited to these embodiment and practical example. A person in
skilled in the art can practice the present invention in various
aspects without departing the spirit and scope of the present
invention.
[0179] For example, while the region where operation is limited is
displayed in gray in the present practical example, the present
invention is not limited to this. The region where operation is
limited may be displayed in color other than gray. Alternatively,
the region may be configured that the user can set the color to be
displayed.
* * * * *