U.S. patent application number 16/098616 was filed with the patent office on 2019-11-07 for multi-screen interaction touch display method, apparatus, storage medium and terminal.
The applicant listed for this patent is ZTE CORPORATION. Invention is credited to Zhanting Wei.
Application Number | 20190339854 16/098616 |
Document ID | / |
Family ID | 62892358 |
Filed Date | 2019-11-07 |
![](/patent/app/20190339854/US20190339854A1-20191107-D00000.png)
![](/patent/app/20190339854/US20190339854A1-20191107-D00001.png)
![](/patent/app/20190339854/US20190339854A1-20191107-D00002.png)
![](/patent/app/20190339854/US20190339854A1-20191107-D00003.png)
![](/patent/app/20190339854/US20190339854A1-20191107-D00004.png)
![](/patent/app/20190339854/US20190339854A1-20191107-D00005.png)
![](/patent/app/20190339854/US20190339854A1-20191107-D00006.png)
United States Patent
Application |
20190339854 |
Kind Code |
A1 |
Wei; Zhanting |
November 7, 2019 |
MULTI-SCREEN INTERACTION TOUCH DISPLAY METHOD, APPARATUS, STORAGE
MEDIUM AND TERMINAL
Abstract
A method for multi-screen interactive touch display, applied to
an electronic device, the electronic device including at least two
screens; the method including: determining at least one screen as
an auxiliary screen, and at least one screen other than the
auxiliary screen as a main screen; acquiring a touch operation on
the auxiliary screen, and determining a position on the main screen
corresponding to the touch operation based on a preset
correspondence relationship of touch coordinates; and responding to
an instruction corresponding to the touch operation at the
determined position on the main screen, and displaying a response
result on the main screen.
Inventors: |
Wei; Zhanting; (Shenzhen,
CN) |
|
Applicant: |
Name |
City |
State |
Country |
Type |
ZTE CORPORATION |
Shenzhen |
|
CN |
|
|
Family ID: |
62892358 |
Appl. No.: |
16/098616 |
Filed: |
July 24, 2017 |
PCT Filed: |
July 24, 2017 |
PCT NO: |
PCT/CN2017/094149 |
371 Date: |
November 2, 2018 |
Current U.S.
Class: |
1/1 |
Current CPC
Class: |
G06F 3/14 20130101; G06F
3/0416 20130101; G06F 3/04883 20130101; G06F 3/0414 20130101; G06F
3/0488 20130101 |
International
Class: |
G06F 3/0488 20060101
G06F003/0488; G06F 3/14 20060101 G06F003/14; G06F 3/041 20060101
G06F003/041 |
Foreign Application Data
Date |
Code |
Application Number |
Jan 18, 2017 |
CN |
201710040538.9 |
Claims
1.-17. (canceled)
18. A method for multi-screen interactive touch display, applied to
an electronic device, the electronic device comprising at least two
screens; the method comprising: determining at least one screen as
an auxiliary screen, and at least one screen other than the
auxiliary screen as a main screen; acquiring a touch operation on
the auxiliary screen, and determining a touch position on the main
screen corresponding to the touch operation based on a preset
correspondence relationship of touch coordinates; and responding to
an instruction corresponding to the touch operation at the
determined position on the main screen, and displaying a response
result on the main screen.
19. The method according to claim 18, wherein the displaying a
response result on the main screen comprises displaying the
response result at the determined position on the main screen.
20. The method according to claim 18 wherein the auxiliary screen
is configured to at least implement control of the main screen
according to an external touch operation; and the main screen is
configured to at least display according to the control of the
auxiliary screen.
21. The method according to claim 18, wherein when the touch
operation is a single touch on the auxiliary screen, displaying a
response result on the main screen comprising at least one of:
displaying a preset indication graphic at a position on the main
screen corresponding to the touch position on the auxiliary screen;
and popping up corresponding function prompt information at a
position on the main screen corresponding to the touch position on
the auxiliary screen.
22. The method according to claim 19, wherein when the touch
operation is a single touch on the auxiliary screen, displaying a
response result on the main screen comprising at least one of:
displaying a preset indication graphic at a position on the main
screen corresponding to the touch position on the auxiliary screen;
and popping up corresponding function prompt information at a
position on the main screen corresponding to the touch position on
the auxiliary screen.
23. The method of claim 21, wherein after at least one of the
displaying of the preset indication graphic and the popping-up
corresponding function prompt information, the method further
comprises: determining whether the touch operation has ended; if it
is determined that the touch operation has ended, providing a
corresponding instruction or responding to the function prompt
information at the indication graphic.
24. The method of claim 22, wherein after at least one of the
displaying of the preset indication graphic and the popping-up
corresponding function prompt information, the method further
comprises: determining whether the touch operation has ended; if it
is determined that the touch operation has ended, providing a
corresponding instruction or responding to the function prompt
information at the indication graphic.
25. The method of claim 18, wherein when the touch operation is
multi-touching the auxiliary screen at multiple touch points, and
the main screen supports only a single touch, the method further
comprises: acquiring a touch parameter of each of the multiple
touch points, comparing the touch parameter with a preset
condition, and determining an effective touch point according to
the comparison result; or when only one of the multiple touch
points is moving, and the remaining touch points are stationary,
determining the moving touch point as an effective touch point; or
determining a touch point that starts moving from a preset position
as an effective touch point, and tracking a movement trajectory of
the effective touch point; if the effective touch point is
stationary, and there is a new touch point other than the effective
touch point that starts to move from the preset position,
determining that the new touch point is an effective touch point,
and tracking the new effective touch point instead.
26. The method of claim 25, wherein acquiring a touch parameter of
each of the multiple touch points, comparing the touch parameter
with a preset condition, and determining an effective touch point
according to the comparison result comprises: acquiring a moving
speed of each touch point; if the moving speed of only one touch
point is greater than a first threshold value, determining that the
touch point is an effective touch point; or if the moving speed of
each touch point is greater than the first threshold value,
determining that the touch point with the largest moving speed is
an effective touch point; and tracking the movement trajectory of
the determined effective touch point, if the effective touch point
is stationary, and the moving speed of another touch point other
than the effective touch point is greater than the first threshold,
determining that the other touch point is an effective touch point,
and tracking the new effective touch point instead.
27. The method of claim 25, wherein acquiring a touch parameter of
each of the multiple touch points, comparing the touch parameter
with a preset condition, and determining an effective touch point
according to the comparison result comprises: when each touch point
is stationary, acquiring a pressure value of each stationary touch
point; if the pressure value of only one touch point is greater
than a second threshold, determining the touch point to be an
effective touch point, and tracking the movement trajectory of the
determined effective touch point; or if the pressure value of more
than one touch point is greater than the second threshold,
determining that the touch point with the largest pressure value is
an effective touch point, and tracking the movement trajectory of
the effective touch point; and if the effective touch point is
stationary, and the pressure value of the new touch point other
than the effective touch point is greater than the second
threshold, determining that the new touch point is an effective
touch point, and tracking the new effective touch points
instead.
28. The method of claim 25, wherein acquiring a touch parameter of
each of the multiple touch points, comparing the touch parameter
with a preset condition, and determining an effective touch point
according to the comparison result comprises: determining the
movement trajectory of each touch point; if the movement trajectory
of the touch point is a preset movement trajectory, determining the
touch point to be an effective touch point; or determining a touch
fingerprint corresponding to each touch point; if the touch
fingerprint corresponding to the touch point is a preset touch
fingerprint, determining the touch point to be an effective touch
point.
29. The method according to claim 18, wherein at the same time when
determining at least one screen as the auxiliary screen and at
least one screen as the main screen, or before determining at least
one screen as the auxiliary screen and at least one screen as the
main screen, the method further comprises: setting a display mode
of the screen, wherein the display mode comprises: a single screen
display and a multi-screen display.
30. The method of claim 18, wherein the at least two screens have
the same size or different sizes; an angle between the at least two
screens is greater than 0 degrees and less than or equal to 360
degrees.
31. The method of claim 18, wherein the at least one screen is an
ink screen or a flexible screen. display.
32. A storage medium storing a computer program, the computer
program being executed by a processor to implement: determining at
least one screen as an auxiliary screen, and at least one screen
other than the auxiliary screen as a main screen; acquiring a touch
operation on the auxiliary screen, and determining a position on
the main screen corresponding to the touch operation based on a
preset correspondence relationship of touch coordinates; and
responding to an instruction corresponding to the touch operation
at the determined position on the main screen, and displaying a
response result on the main screen.
33. A terminal comprising a memory, a processor, and a computer
program stored on the memory and operative on the processor, the
processor executing the computer program to implement: determining
at least one screen as an auxiliary screen, and at least one screen
other than the auxiliary screen as a main screen; acquiring a touch
operation on the auxiliary screen, and determining a position on
the main screen corresponding to the touch operation based on a
preset correspondence relationship of touch coordinates; and
responding to an instruction corresponding to the touch operation
at the determined position on the main screen, and displaying a
response result on the main screen.
Description
CROSS-REFERENCE TO RELATED APPLICATION
[0001] The present application is a continuing application of
International Application No. PCT/CN2017/094149, filed on Jul. 24,
2017, which is based upon and claims priority to Chinese Patent
Application No. 201710040538.9, filed on Jan. 18, 2017, and the
entire contents thereof are incorporated herein by reference.
TECHNICAL FIELD
[0002] The present application relates to, but is not limited to,
the field of multi-screen display technology, and in particular, to
a method, a device, a storage medium and a terminal for
multi-screen interactive touch display.
BACKGROUND
[0003] A resistive touch screen may be understood as a sensor,
usually a combination of film and glass. The adjacent side of the
film and glass is coated with a coating of ITO (Indium Tin Oxides)
with excellent conductivity and transparency. When the touch
operation is performed, the ITO coating on the lower layer of the
film contacts the ITO coating on the upper layer of the glass, and
the corresponding electrical signal is transmitted through the
inductor, sent to the processor via the conversion circuit, and
converted into X, Y values on the screen through calculation, thus
completing the action of clicking and presenting on the screen.
With the continuous development of mobile phones, dual-screen and
folding screen mobile phones, as well as stretch screen mobile
phones, have emerged. Therefore, while expanding the size of the
display screen, there is a further demand for ease of operation and
flexibility of display.
[0004] This section provides background information related to the
present disclosure which is not necessarily prior art.
SUMMARY
[0005] The following is an overview of the topics detailed in this
document. This Summary is not intended to limit the scope of the
claims.
[0006] The embodiment of the present application provides a method,
a device, a storage medium, and a terminal for multi-screen
interactive touch display.
[0007] An embodiment of the present application provides a method
for multi-screen interactive touch display, applied to an
electronic device, the electronic device including at least two
screens; the method including:
[0008] determining at least one screen as an auxiliary screen, and
at least one screen other than the auxiliary screen as a main
screen;
[0009] acquiring a touch operation on the auxiliary screen, and
determining a position on the main screen corresponding to the
touch operation based on a preset correspondence relationship of
touch coordinates; and
[0010] responding to an instruction corresponding to the touch
operation at the determined position on the main screen, and
displaying a response result on the main screen.
[0011] In an exemplary embodiment, the displaying a response result
on the main screen may include displaying the response result at
the determined location on the main screen.
[0012] In an exemplary embodiment, the auxiliary screen may be
configured to at least implement control of the main screen
according to an external touch operation; and
[0013] the main screen may be configured to at least display
according to the control of the auxiliary screen.
[0014] In an exemplary embodiment, when the touch operation is a
single touch on the auxiliary screen, displaying a response result
on the main screen may include at least one of:
[0015] displaying a preset indication graphic at a position on the
main screen corresponding to the touch position on the auxiliary
screen; and
[0016] popping up corresponding function prompt information at a
position on the main screen corresponding to the touch position on
the auxiliary screen.
[0017] In an exemplary embodiment, after at least one of the
displaying of the preset indication graphic and the popping-up
corresponding function prompt information, the method may further
include:
[0018] determining whether the touch operation has ended; if it is
determined that the touch operation has ended, providing a
corresponding instruction or responding to the function prompt
information at the indication graphic.
[0019] In an exemplary embodiment, when the touch operation is
multi-touching the auxiliary screen, and the main screen supports
only a single touch, the method may further include:
[0020] acquiring a touch parameter of each of the multiple touch
points, comparing the touch parameter with a preset condition, and
determining an effective touch point according to the comparison
result; or
[0021] when only one of the multiple touch points is moving, and
the remaining touch points are stationary, determining the moving
touch point as an effective touch point; or
[0022] determining a touch point that starts moving from a preset
position as an effective touch point, and tracking a movement
trajectory of the effective touch point; if the effective touch
point is stationary, and there is a new touch point other than the
effective touch point that starts to move from the preset position,
determining that the new touch point is an effective touch point,
and tracking the new effective touch point instead.
[0023] In an exemplary embodiment, acquiring a touch parameter of
each of the multiple touch points, comparing the touch parameter
with a preset condition, and determining an effective touch point
according to the comparison result may include:
[0024] acquiring a moving speed of each touch point; if the moving
speed of only one touch point is greater than a first threshold,
determining that the touch point is an effective touch point; or if
the moving speed of each touch point is greater than the first
threshold value, determining that the touch point with the largest
moving speed is an effective touch point; and
[0025] tracking the movement trajectory of the determined effective
touch point, if the effective touch point is stationary, and the
moving speed of another touch point other than the effective touch
point is greater than the first threshold, determining that the
other touch point is an effective touch point, and tracking the new
effective touch point instead.
[0026] In an exemplary embodiment, acquiring a touch parameter of
each of the multiple touch points, comparing the touch parameter
with a preset condition, and determining an effective touch point
according to the comparison result may include:
[0027] when each touch point is stationary, acquiring a pressure
value of each stationary touch point; if the pressure value of only
one touch point is greater than a second threshold, determining the
touch point to be an effective touch point, and tracking the
movement trajectory of the determined effective touch point; or if
the pressure value of more than one touch point is greater than the
second threshold, determining that the touch point with the largest
pressure value is an effective touch point, and tracking the
movement trajectory of the effective touch point; and
[0028] if the effective touch point is stationary, and the pressure
value of the new touch point other than the effective touch point
is greater than the second threshold, determining that the new
touch point is an effective touch point, and tracking the new
effective touch points instead.
[0029] In an exemplary embodiment, acquiring a touch parameter of
each of the multiple touch points, comparing the touch parameter
with a preset condition, and determining an effective touch point
according to the comparison result may include:
[0030] determining the movement trajectory of each touch point; if
the movement trajectory of the touch point is a preset movement
trajectory, determining the touch point to be an effective touch
point; or
[0031] determining a touch fingerprint corresponding to each touch
point; if the touch fingerprint corresponding to the touch point is
a preset touch fingerprint, determining the touch point to be an
effective touch point.
[0032] In an exemplary embodiment, at the same time when
determining at least one screen as the auxiliary screen and at
least one screen as the main screen, or before determining at least
one screen as the auxiliary screen and at least one screen as the
main screen, the method may further include:
[0033] setting a display mode of the screen, wherein the display
mode includes: a single screen display and a multi-screen
display.
[0034] In an exemplary embodiment, the at least two screens may
have the same size or different sizes; the angle between the at
least two screens may be greater than 0 degrees and less than or
equal to 360 degrees.
[0035] In an exemplary embodiment, the at least one screen is an
ink screen or a flexible screen.
[0036] An embodiment of the present application also provides a
device for multi-screen interactive touch display, applied to an
electronic device, the electronic device including at least two
screens; and the device including:
[0037] a screen determining module configured to determine that at
least one screen is an auxiliary screen, and at least one screen
other than the auxiliary screen is a main screen;
[0038] an acquiring module configured to acquire a touch operation
on the auxiliary screen, and determine a position on the main
screen corresponding to the touch operation based on the preset
correspondence relationship of touch coordinates; and
[0039] a processing module configured to respond to an instruction
corresponding to the touch operation at the determined position on
the main screen, and display the response result on the main
screen.
[0040] In an exemplary embodiment, the device may further include:
a touch point determining module configured to:
[0041] when the touch operation is multi-touching the auxiliary
screen, and the main screen supports only a single touch,
[0042] acquire a touch parameter of each of the multiple touch
points, compare the touch parameter with a preset condition, and
determine an effective touch point according to the comparison
result; or
[0043] when only one of the multiple touch points is moving, and
the remaining touch points are stationary, determine the moving
touch point as an effective touch point; or
[0044] determine a touch point that starts moving from a preset
position as an effective touch point, and track a movement
trajectory of the effective touch point; if the effective touch
point is stationary, and there is a new touch point other than the
effective touch point that starts to move from the preset position,
determine that the new touch point is an effective touch point, and
track the new effective touch point instead.
[0045] In an exemplary embodiment, the device may further include:
a setting module configured to, at the same time when the screen
determining module determines at least one screen as the auxiliary
screen and at least one screen as the main screen, or before the
screen determining module determines at least one screen as the
auxiliary screen and at least one screen as the main screen, set a
display mode of the screen, wherein the display mode includes: a
single screen display and a multi-screen display.
[0046] An embodiment of the present application also provides a
storage medium storing a computer program, the computer program
being executed by a processor to implement:
[0047] determining at least one screen as an auxiliary screen, and
at least one screen other than the auxiliary screen as a main
screen;
[0048] acquiring a touch operation on the auxiliary screen, and
determining a position on the main screen corresponding to the
touch operation based on a preset correspondence relationship of
touch coordinates; and
[0049] responding to an instruction corresponding to the touch
operation at the determined position on the main screen, and
displaying a response result on the main screen.
[0050] An embodiment of the present application also provides a
terminal including a memory, a processor, and a computer program
stored on the memory and operative on the processor, the processor
executing the computer program to implement:
[0051] determining at least one screen as an auxiliary screen, and
at least one screen other than the auxiliary screen as a main
screen;
[0052] acquiring a touch operation on the auxiliary screen, and
determining a position on the main screen corresponding to the
touch operation based on a preset correspondence relationship of
touch coordinates; and
[0053] responding to an instruction corresponding to the touch
operation at the determined position on the main screen, and
displaying a response result on the main screen.
[0054] The method, the device, the storage medium and the terminal
for multi-screen interactive touch display provided by the
embodiment of the present application are applied to an electronic
device including at least two screens, including: determining at
least one screen as an auxiliary screen, and at least one screen
other than the auxiliary screen as a main screen; acquiring a touch
operation on the auxiliary screen, and determining a position on
the main screen corresponding to the touch operation based on a
preset correspondence relationship of touch coordinates; and
responding to an instruction corresponding to the touch operation
at the determined position on the main screen, and displaying a
response result on the main screen. In the embodiment of the
present application, based on the corresponding relationship
between the main screen and the auxiliary screen, the touch
operation on the determined auxiliary screen realizes response and
display the touch operation result on the main screen, thereby
satisfying the requirements of convenience of operation and the
flexibility of display for the multi-screen and the large-size
screen.
[0055] Other aspects will be apparent upon reading and
understanding the drawings and
DETAILED DESCRIPTION
[0056] This section provides a summary of various implementations
or examples of the technology described in the present disclosure,
and is not a comprehensive disclosure of the full scope or all
features of the disclosed technology.
BRIEF DESCRIPTION OF DRAWINGS
[0057] FIG. 1 is a schematic flowchart of a method for multi-screen
interactive touch display according to an embodiment of the present
application;
[0058] FIG. 2 is a schematic structural diagram of a device for
multi-screen interactive touch display according to an embodiment
of the present application;
[0059] FIG. 3 is a schematic structural diagram of a processing
module of FIG. 2;
[0060] FIG. 4 is a second schematic structural diagram of a device
for multi-screen interactive touch display according to an
embodiment of the present application;
[0061] FIG. 5 is a third schematic structural diagram of a device
for multi-screen interactive touch display according to an
embodiment of the present application;
[0062] FIG. 6 is a first flowchart of a method for determining an
effective touch point when a screen is touched at multiple points
according to an embodiment of the present application;
[0063] FIG. 7 is a second flowchart of a method for determining an
effective touch point when a screen is touched at multiple points
according to an embodiment of the present application;
[0064] FIG. 8 is a third flowchart of a method for determining an
effective touch point when a screen is touched at multiple points
according to an embodiment of the present application; and
[0065] FIG. 9 is a fourth flowchart of a method for determining an
effective touch point when a screen is touched at multiple points
according to an embodiment of the present application.
DETAILED DESCRIPTION
[0066] The present application will be described in detail below
with reference to the embodiments.
[0067] FIG. 1 is a schematic flowchart diagram of a method for
multi-screen interactive touch display according to an embodiment
of the present application. The method provided in this embodiment
is applied to an electronic device, and the electronic device
includes at least two screens. As shown in FIG. 1, the method
provided in this embodiment includes the following steps.
[0068] In Step 101, at least one screen is determined as an
auxiliary screen, and at least one screen other than the auxiliary
screen is determined as a main screen.
[0069] In Step 102, a touch operation on the auxiliary screen is
acquired, and a position on the main screen corresponding to the
touch operation is determined based on a preset correspondence
relationship of touch coordinates.
[0070] In Step 103, an instruction corresponding to the touch
operation at the determined position on the main screen is
responded to, a response result is displayed on the main
screen.
[0071] The auxiliary screen is used to implement a touch function,
and the main screen is at least used to implement a display
function. The electronic device may be a dual-screen mobile phone,
or may be a multi-faceted screen including two or more screens, a
folding screen or a stretch screen and so on.
[0072] In this embodiment, based on the corresponding relationship
between the main screen and the auxiliary screen, the touch
operation on the determined auxiliary screen realizes response and
displays the touch operation result on the main screen, thereby
satisfying the requirements of convenience of operation and the
flexibility of display for the multi-screen and the large-size
screen.
[0073] In this embodiment, the displaying the response result on
the main screen may include: displaying the response result at the
determined location on the main screen.
[0074] In an exemplary embodiment, after the determining the main
screen and the auxiliary screen, and before the acquiring the touch
operation on the auxiliary screen, the method of the embodiment
further includes: setting a touch coordinate correspondence
relationship. Setting the touch coordinate correspondence
relationship may include:
[0075] determining position coordinates of each point on the main
screen and the auxiliary screen;
[0076] determining the mapping relationship between the position
coordinates of each point on the main screen and the position
coordinates of each point on the auxiliary screen.
[0077] In an exemplary embodiment, when the electronic device
includes two screens, the determining at least one screen as an
auxiliary screen, and the remaining screen as a main screen, may
include:
[0078] with gravity sensing technology, the main screen and the
auxiliary screen are determined according to the positions of the
screens, such as: the upward screen is the main screen, and the
downward screen is the auxiliary screen.
[0079] For example, the main screen and the auxiliary screen may be
determined by a sensing device such as a gravity sensor or a
gyroscope.
[0080] In an exemplary embodiment, the auxiliary screen may be used
at least for controlling the main screen with an external touch
operation; the main screen may be at least used for displaying
according to the control of the auxiliary screen.
[0081] In an exemplary embodiment, when the touch operation is a
single touch on the auxiliary screen, the displaying the response
result on the main screen may include at least one of the
following:
[0082] displaying a preset indication graphic at a position on the
main screen corresponding to the touch position on the auxiliary
screen;
[0083] popping up corresponding function prompt information at a
position on the main screen corresponding to the touch position on
the auxiliary screen.
[0084] Here, the preset indication graphic may include: a dot, a
meteor line or an animation effect, and the like. For example, when
a finger clicks on a certain point on the auxiliary screen, a dot
is displayed on the corresponding point of the main screen; long
pressing on the auxiliary screen causes displaying a circle on the
corresponding point of the main screen; sliding on the auxiliary
screen causes displaying a meteor line on the main screen; pressing
on the auxiliary screen causes displaying an animation effect that
a ring gradually becomes larger on the main screen.
[0085] The touch operation may include at least one of the
following: a click, a long press, a slide on the screen, a
multi-touch, a gesture, a pressure, and the like.
[0086] In an exemplary embodiment, after at least one of the
displaying of the preset indication graphic and the popping-up
corresponding function prompt information, the method of the
embodiment may further include:
[0087] determining whether the touch operation has ended; if it is
determined that the touch operation has ended, providing a
corresponding instruction or responding to the function prompt
information at the indication graphic; otherwise, continuing the
current processing.
[0088] For example, when the auxiliary screen is touched, the
function prompt information corresponding to the point may pop up
at the corresponding point on the main screen. If the function
prompt information is an operation required by the user, the finger
may leave the screen and respond to the instruction corresponding
to the function prompt information. If the function prompt
information is not the operation required by the user, the finger
does not leave the screen and does not respond to the
operation.
[0089] In an exemplary embodiment, when the touch operation is
multi-touching the auxiliary screen, and the main screen supports
only a single touch, the method in this embodiment may further
include:
[0090] determining an effective touch point from the multiple touch
points.
[0091] In an exemplary embodiment, the determining an effective
touch point from the multiple touch points may include:
[0092] acquiring a touch parameter of each of the multiple touch
points, comparing the touch parameter with a preset condition, and
determining an effective touch point according to the comparison
result.
[0093] Here, the touch parameter may include: a moving speed, a
pressure value or a moving trajectory, and the like.
[0094] In an exemplary embodiment, the acquiring a touch parameter
of each of the multiple touch points, comparing the touch parameter
with a preset condition, and determining an effective touch point
according to the comparison result may include:
[0095] determining the moving speed of each touch point; if the
moving speed of only one touch point is greater than a first
threshold, determining that the touch point is an effective touch
point; or if the moving speed of each touch point is greater than
the first threshold value, determining that the touch point with
the largest moving speed is an effective touch point;
[0096] tracking the movement trajectory of the determined effective
touch point, if the effective touch point is stationary, and the
moving speed of another touch point other than the effective touch
point is greater than the first threshold, determining that the
other touch point is an effective touch point, and tracking the new
effective touch point instead.
[0097] Here, if the moving speed of each touch point is less than
the first threshold, the touch operation is not responded.
[0098] In an exemplary embodiment, the determining an effective
touch point from the multiple touch points may include:
[0099] when only one of the multiple touch points is moving, and
the remaining touch points are stationary, determining the moving
touch point as an effective touch point.
[0100] In an exemplary embodiment, the acquiring a touch parameter
of each of the multiple touch points, comparing the touch parameter
with a preset condition, and determining an effective touch point
according to the comparison result may include:
[0101] when each touch point is stationary, acquiring a pressure
value of each stationary touch point; if the pressure value of only
one touch point is greater than a second threshold, determining the
touch point to be an effective touch point, and tracking the
movement trajectory of the determined effective touch point; or if
the pressure value of more than one touch point is greater than the
second threshold, determining that the touch point with the largest
pressure value is an effective touch point, and tracking the
movement trajectory of the effective touch point;
[0102] if the effective touch point is stationary, and the pressure
value of the new touch point other than the effective touch point
is greater than the second threshold, determining that the new
touch point is an effective touch point, and tracking the new
effective touch points instead.
[0103] Here, when it is determined that the pressure value of each
of the stationary touch points is less than the second threshold,
the touch operation is not responded.
[0104] For example, after the effective touch point leaves the
screen, the effective touch point is determined again based on the
pressure value of each touch point.
[0105] In an exemplary embodiment, the determining an effective
touch point from the multiple touch points may include:
[0106] determining a touch point that starts moving from a preset
position as an effective touch point, and tracking the movement
trajectory of the effective touch point; if the effective touch
point is stationary, and there is a new touch point other than the
effective touch point that starts to move from the preset position,
determining that the new touch point is an effective touch point,
and tracking the new effective touch point instead.
[0107] For example, after the effective touch point leaves the
screen, the effective touch point is re-determined.
[0108] Here, the preset position may be: a screen edge or a certain
fixed point.
[0109] In an exemplary embodiment, the acquiring a touch parameter
of each of the multiple touch points, comparing the touch parameter
with a preset condition, and determining an effective touch point
according to the comparison result may include:
[0110] determining the movement trajectory of each touch point; if
the movement trajectory of the touch point is a preset movement
trajectory, the touch point is determined to be an effective touch
point.
[0111] Here, the preset movement trajectory may be a circle or an
ellipse, or other preset shapes, and the like.
[0112] For example, in the above solution, after the effective
touch point leaves the screen, an effective touch point is
determined again according to the preset movement trajectory.
[0113] In an exemplary embodiment, the acquiring a touch parameter
of each of the multiple touch points, comparing the touch parameter
with a preset condition, and determining an effective touch point
according to the comparison result may include:
[0114] determining a touch fingerprint corresponding to each touch
point; if the touch fingerprint corresponding to the touch point is
a preset touch fingerprint, determining the touch point to be an
effective touch point.
[0115] In an exemplary embodiment, when the touch operation is
multi-touching the auxiliary screen, and the main screen supports
single-touch and multi-touch, the acquiring the touch on the
auxiliary screen includes: acquiring a touch operation
corresponding to each touch point on the auxiliary screen.
[0116] Here, for the main screen supporting single touch and
multi-touch, it is determined that all the touch points are
effective touch points, and the touch operation of multi-touch
points is responded.
[0117] For example, at the same time when determining at least one
screen as the auxiliary screen and at least one screen as the main
screen, or before determining at least one screen as the auxiliary
screen and at least one screen as the main screen, the method of
the embodiment may further include:
[0118] setting a display mode of the screen, wherein the display
mode includes: a single screen display and a multi-screen display.
If it is set to single screen display, a valid screen is determined
from a plurality of screens.
[0119] For example, one or more switches may be set. When it is
determined to be a single screen display, only one screen is turned
on (valid), and other screens are turned off.
[0120] In an exemplary embodiment, the at least two screens may
have the same size or different sizes; the angle between the at
least two screens may be greater than 0 degrees and less than or
equal to 360 degrees.
[0121] Being equal to 360 degrees may be: the two screens are
respectively located on the front and back of the terminal (for
example, a mobile phone).
[0122] For example, the at least one screen may be an ink screen or
a flexible screen.
[0123] In an exemplary embodiment, when the sizes of the at least
two screens are different, the determining a position on the main
screen corresponding to the touch operation based on a preset
correspondence relationship of touch coordinates may include:
[0124] determining that a length ratio and a width ratio of the
large screen to the small screen in the two screens are a:1 and
b:1, respectively;
[0125] If the small screen is an auxiliary screen, and the position
of the touch operation is (X, Y), it is determined that the
position on the corresponding main screen is (.+-.aX, bY).
[0126] If the large screen is an auxiliary screen, and the position
of the touch operation is (X, Y), it is determined that the
position on the corresponding main screen is (.+-.X/a, Y/b).
[0127] Where, X, Y are positive integers, and the determination
rules of the origin positions of the two screens are the same.
[0128] The embodiment of the present application further provides a
computer readable storage medium, where the storage medium stores a
computer program. The program code that implements the steps
described above when the computer program is executed by a
processor.
[0129] In this embodiment, the foregoing storage medium may
include, but not limited to, a USB flash drive, a Read-Only Memory
(ROM), a Random Access Memory (RAM), a mobile hard disk, a magnetic
disk, or an optical disk, and a variety of media that may store
program codes.
[0130] The embodiment of the present application further provides a
device for multi-screen interactive touch display, which is applied
to an electronic device including at least two screens for
implementing the above embodiments and exemplary embodiments,
repeated description will be omitted. As used hereinafter, the term
"module" may be implemented in software, hardware, or a combination
of software and hardware for a predetermined function. Although the
devices described in the following embodiments are preferably
implemented in software, hardware, or a combination of software and
hardware is also possible and contemplated. As shown in FIG. 2, the
device provided in this embodiment includes:
[0131] a screen determining module 201 configured to determine that
at least one screen is an auxiliary screen, and at least one screen
other than the auxiliary screen is a main screen; wherein the
auxiliary screen is used to implement a touch function, and the
main screen is used at least to implement display function;
[0132] an acquiring module 203 configured to acquire a touch
operation on the auxiliary screen, and determine a position on the
main screen corresponding to the touch operation based on the
preset correspondence relationship of touch coordinates;
[0133] a processing module 204 configured to respond to an
instruction corresponding to the touch operation at the determined
position on the main screen, and display the response result on the
main screen.
[0134] The auxiliary screen is used to implement a touch function,
and the main screen is at least used to implement a display
function. The electronic device may be a dual-screen mobile phone,
or may be a multi-faceted screen including two or more screens, a
folding screen or a stretch screen and so on.
[0135] In this embodiment, based on the corresponding relationship
between the main screen and the auxiliary screen, the touch
operation on the determined auxiliary screen realizes response and
displays the touch operation result on the main screen, thereby
satisfying the requirements of convenience of operation and the
flexibility of display for the multi-screen and the large-size
screen.
[0136] In an exemplary embodiment, the device of this embodiment
may further include: a location determining module 202 configured
to, after the screen determining module 201 determines the main
screen and the auxiliary screen, and before the acquiring module
203 acquires the touch operation on the auxiliary screen, determine
position coordinates of each point on the main screen and the
auxiliary screen; and determine the mapping relationship between
the position coordinates of each point on the main screen and the
position coordinates of each point on the auxiliary screen.
[0137] In an exemplary embodiment, when the electronic device
includes two screens, the screen determining module 201 is
configured to determine that the at least one screen is an
auxiliary screen and the remaining screen is a main screen by the
following manner
[0138] With the gravity sensing technology, the main screen and the
auxiliary screen are determined according to the positions of the
screens, such as the upward screen is the main screen, and the
downward screen is the auxiliary screen.
[0139] For example, the main screen and the auxiliary screen may be
determined by a sensing device such as a gravity sensor or a
gyroscope.
[0140] In an exemplary embodiment, the auxiliary screen is
configured to at least control the main screen with an external
touch operation; the main screen is at least used for displaying
according to the control of the auxiliary screen.
[0141] In an exemplary embodiment, as shown in FIG. 3, the
processing module 204 may include:
[0142] a response unit 2041 configured to respond to an instruction
corresponding to the touch operation at the determined position on
the main screen;
[0143] a display unit 2042 is configured to display the response
result on the main screen.
[0144] In an exemplary embodiment, when the touch operation is a
single touch of the auxiliary screen, the display unit 2042 is
configured to perform at least one of the following:
[0145] displaying a preset indication graphic at a position on the
main screen corresponding to the touch position on the auxiliary
screen;
[0146] popping up corresponding function prompt information at a
position on the main screen corresponding to the touch position on
the auxiliary screen.
[0147] Here, the preset indication graphic may include: a dot, a
meteor line or an animation effect, and the like. For example, when
a finger clicks on a certain point on the auxiliary screen, a dot
is displayed on the corresponding point of the main screen; long
pressing on the auxiliary screen causes displaying a circle on the
corresponding point of the main screen; sliding on the auxiliary
screen causes displaying a meteor line on the main screen; pressing
on the auxiliary screen causes displaying an animation effect that
a ring gradually becomes larger on the main screen.
[0148] The touch operation may include: a click, a long press, a
slide on the screen, a multi-touch, a gesture, a pressure, and the
like.
[0149] In an exemplary embodiment, after the display unit 2042
displays at least one of the preset indication graphic and pops up
corresponding function prompt information, the display unit 2042
may further be configured to determine whether the touch operation
has ended, and notify the determination result to the response unit
2041.
[0150] Correspondingly, the response unit 2041 may be further
configured to: after receiving the notification that the touch
operation has ended, provide a corresponding instruction or respond
to the function prompt information at the indication graphic;
otherwise, continue the current processing.
[0151] For example, when the auxiliary screen is touched, the
function prompt information corresponding to the point may pop up
at the corresponding point on the main screen. If the function
prompt information is an operation required by the user, the finger
leaves the screen and responds to the instruction corresponding to
the function prompt information. If the function prompt information
is not an operation required by the user, the finger does not leave
the screen and does not respond to the operation.
[0152] In an exemplary embodiment, as shown in FIG. 4, the device
in this embodiment may further include: a touch point determining
module 205 configured to, when the touch operation is
multi-touching the auxiliary screen, and the main screen supports
only a single touch, determine an effective touch point from the
multiple touch points.
[0153] The touch point determining module 205 may be configured to
determine an effective touch point from the multiple touch points
by:
[0154] acquiring a touch parameter of each of the multiple touch
points, comparing the touch parameter with a preset condition, and
determining an effective touch point according to the comparison
result; or
[0155] when it is determined that only one of the multiple touch
points is moving, and the remaining touch points are stationary,
determining the moving touch point as an effective touch point;
or
[0156] determining a touch point that starts moving from a preset
position as an effective touch point, and tracking the movement
trajectory of the effective touch point; if the effective touch
point is stationary, and there is a new touch point other than the
effective touch point that starts to move from the preset position,
determining that the new touch point is an effective touch point,
and tracking the new effective touch point instead.
[0157] Here, the preset position may be: a screen edge or a certain
fixed point.
[0158] For example, the touch point determining module 205 may be
configured to acquire a touch parameter of each of the multiple
touch points, compare the touch parameter with a preset condition,
and determine an effective touch point according to the comparison
result by:
[0159] determining the moving speed of each touch point; if the
moving speed of only one touch point is greater than a first
threshold, determining that the touch point is an effective touch
point; or if the moving speed of each touch point is greater than
the first threshold value, determining that the touch point with
the largest moving speed is an effective touch point;
[0160] tracking the movement trajectory of the determined effective
touch point, if the effective touch point is stationary, and the
moving speed of another touch point other than the effective touch
point is greater than the first threshold, determining that the
other touch point is an effective touch point, and tracking the new
effective touch point instead.
[0161] Here, if the moving speed of each touch point is less than
the first threshold, the touch operation is not responded.
[0162] For example, the touch point determining module 205 may be
configured to acquire a touch parameter of each of the multiple
touch points, compare the touch parameter with a preset condition,
and determine an effective touch point according to the comparison
result by:
[0163] when each touch point is stationary, acquiring a pressure
value of each stationary touch point; if the pressure value of only
one touch point is greater than a second threshold, determining the
touch point to be an effective touch point, and tracking the
movement trajectory of the determined effective touch point; or if
the pressure value of more than one touch point is greater than the
second threshold, determining that the touch point with the largest
pressure value is an effective touch point, and tracking the
movement trajectory of the effective touch point;
[0164] if the effective touch point is stationary, and the pressure
value of the new touch point other than the effective touch point
is greater than the second threshold, determining that the new
touch point is an effective touch point, and tracking the new
effective touch points instead.
[0165] Here, when it is determined that the pressure value of each
of the stationary touch points is less than the second threshold,
the touch operation is not responded.
[0166] For example, the touch point determining module 205 may be
configured to acquire a touch parameter of each of the multiple
touch points, compare the touch parameter with a preset condition,
and determine an effective touch point according to the comparison
result by:
[0167] determining the movement trajectory of each touch point; if
the movement trajectory of the touch point is a preset movement
trajectory, determining the touch point to be an effective touch
point;
[0168] or,
[0169] determining a touch fingerprint corresponding to each touch
point; if the touch fingerprint corresponding to the touch point is
a preset touch fingerprint, determining the touch point to be an
effective touch point.
[0170] Here, the preset movement trajectory may include a circle or
an ellipse, or other preset shapes, and the like.
[0171] In an exemplary embodiment, when the touch operation is
multi-touching the auxiliary screen, and the main screen supports
single touch and multi-touch,
[0172] the acquiring module 203 may be configured to acquire a
touch operation corresponding to each touch point on the auxiliary
screen, and determine a position on the main screen corresponding
to the touch operation corresponding to each touch point based on
the position coordinates of the touch operation corresponding to
each touch point on the auxiliary screen and a mapping relationship
between position coordinates of each point on each main screen and
the position coordinates of each point on the auxiliary screen
[0173] In an exemplary embodiment, as shown in FIG. 5, the device
of this embodiment may further include:
[0174] a setting module 206 configured to, at the same time when
the screen determining module 201 determines at least one screen as
the auxiliary screen and at least one screen as the main screen, or
before the screen determining module 201 determines at least one
screen as the auxiliary screen and at least one screen as the main
screen, set a display mode of the screen, wherein the display mode
includes: a single screen display and a multi-screen display. If it
is set to single screen display, a valid screen is determined from
a plurality of screens.
[0175] For example, one or more switches may be set. When it is
determined to be a single screen display, only one screen is turned
on (valid), and other screens are turned off.
[0176] In practical applications, the modules in the above devices
may all be implemented by the same processor; or, the above modules
are respectively implemented by multiple processors.
[0177] The embodiment of the present application further provides a
terminal, including a memory, a processor, and a computer program
stored on the memory and operable on the processor, the processor
executing the computer program to implement the following
steps:
[0178] determining at least one screen as an auxiliary screen, and
determining at least one screen other than the auxiliary screen as
a main screen.
[0179] acquiring a touch operation on the auxiliary screen, and
determining a position on the main screen corresponding to the
touch operation based on a preset correspondence relationship of
touch coordinate; and
[0180] responding to an instruction corresponding to the touch
operation at the determined position on the main screen, and
displaying a response result on the main screen.
[0181] The present application is described in detail below in
conjunction with the scenario embodiments.
[0182] Embodiment 1: A touch display method of a symmetric
double-sided screen.
[0183] In this embodiment, the front and back sides of the mobile
phone are respectively configured with one screen, the main screen
is a liquid screen, and the auxiliary screen is an ink screen. The
two screens are completely symmetrical, and the center point of the
main screen may be determined as A (0, 0), the center point of the
auxiliary screen is B (0, 0).
[0184] For example, a point (X, Y) on the auxiliary screen is
symmetrically mapped to a corresponding point (-X, Y) on the main
screen.
[0185] When a finger touches a point on the auxiliary screen, an
indication point is displayed at the corresponding point on the
main screen.
[0186] When the finger touches a point (X, Y) on the auxiliary
screen, the phone responds to the function instruction at the
symmetry point (-X, Y) on the main screen.
[0187] For example, when a touch point, a long press, a screen
sliding, a multi-touch, a gesture, a pressure, etc. are touched at
a certain point on the auxiliary screen, an instruction
corresponding to the point is popped up at the corresponding point
on the main screen. When the instruction is an operation required
by the user, the finger leaves the screen, and the corresponding
function prompt information corresponding to the click, long press,
screen sliding, multi-touch, gesture, pressure, etc. is responded;
otherwise, the finger does not leave the screen and the operation
is not responded.
[0188] For example, when the finger clicks at a certain point on
the auxiliary screen, a dot may be displayed at the corresponding
point of the main screen. When the auxiliary screen is long
pressed, a circle may be displayed at the corresponding point of
the main screen. When the finger slides on the auxiliary screen, a
meteor line may be displayed at the corresponding position on the
main screen. When the finger presses on the auxiliary screen, an
animation effect in which the ring gradually becomes larger may be
displayed at the corresponding position of the main screen.
[0189] For example, one or more switches may be provided for
controlling single screen operation or dual screen operation.
[0190] For example, after setting a single screen operation, the
current running screen is selected.
[0191] Embodiment 2: A touch display method for symmetric double
screens of an equal size.
[0192] In this embodiment, two identical screens are arranged on
the front and back sides of the mobile phone, and the main and
auxiliary screens are determined according to the principle of
gravity sensing. The upward side is determined as the main screen,
and the downward side is determined as the auxiliary screen. The
main screen is used for both of the display and touch functions,
and the auxiliary screen is only used for touch function. The two
screens are completely symmetrical, the center point (0, 0) of the
main screen is determined, and the center point (0, 0) of the
auxiliary screen is determined. The lines of the two center points
are perpendicular to the two screens.
[0193] For example, a point (X, Y) on the auxiliary screen is
symmetrically mapped to a corresponding point (-X, Y) on the main
screen.
[0194] When the finger touches a point (X, Y) on the auxiliary
screen, the phone responds to a function instruction at a point
(-X, Y) on the main screen.
[0195] When a finger clicks, long presses, slides, gestures, etc.
at a certain point (X, Y) on the auxiliary screen, the
corresponding point (-X, Y) on the main screen of the mobile phone
responds to the corresponding operation of click, long press, and
screen sliding, etc.
[0196] The finger performs a gesture operation on the auxiliary
screen, and the main screen responds to the function instruction
corresponding to the gesture. For example, when a click, a long
press, a screen sliding, a multi-touch, a gesture, a pressure, etc.
are touched at a certain point on the auxiliary screen, an
instruction corresponding to the point is popped up on the
corresponding point on the main screen. When the instruction is an
operation required by the user, the finger leaves the screen, and
the corresponding function prompt information corresponding to the
click, long press, screen sliding, multi-touch, gesture, pressure,
etc. is responded; otherwise, the finger does not leave the screen
and the operation is not responded.
[0197] For example, when the finger clicks at a certain point on
the auxiliary screen, a dot may be displayed at the corresponding
point of the main screen. When the auxiliary screen is long
pressed, a circle may be displayed at the corresponding point of
the main screen. When the finger slides on the auxiliary screen, a
meteor line may be displayed at the corresponding position on the
main screen. When the finger presses on the auxiliary screen, an
animation effect in which the ring gradually becomes larger may be
displayed at the corresponding position of the main screen.
[0198] For example, one or more switches may be provided for
controlling single screen operation or dual screen operation.
[0199] For example, after setting a single screen operation, the
current running screen is selected.
[0200] Embodiment 3: A touch display method with two screens of
different sizes.
[0201] In this embodiment, two screens are arranged on the front
and back sides of the mobile phone, and the main and auxiliary
screens are determined according to the principle of gravity
sensing. The upward side is determined as the main screen, and the
downward side is determined as the auxiliary screen. The planes of
the two screens are parallel to each other and have the same shape,
but the screen sizes are not equal. The length and width of the
screens are a:1 and b:1, respectively. The center point (0, 0) of
the main screen may be determined and the center point (0, 0) of
the auxiliary screen may be determined.
[0202] For example, when the small screen is an auxiliary screen, a
point (x, y) on the auxiliary screen is symmetrically mapped to a
corresponding point on the main screen (-ax, by). When the finger
touches a point (x, y) on the auxiliary screen, the phone responds
to the function instructions at the point (-ax, by) on the main
screen.
[0203] The finger clicks, long presses, slides, gestures, etc. at a
certain point (x, y) on the auxiliary screen. The corresponding
point (-ax, by) on the main screen of the mobile phone responds to
the click, long press, and sliding, gesture, etc.
[0204] For example, when a click, a long press, a screen sliding, a
multi-touch, a gesture, a pressure, etc. are touched at a certain
point on the auxiliary screen, an instruction corresponding to the
point is popped up at the corresponding point on the main screen.
When the instruction is an operation required by the user, the
finger leaves the screen, and the corresponding function prompt
information corresponding to the click, long press, screen sliding,
multi-touch, gesture, pressure, etc. is responded; otherwise, the
finger does not leave the screen and the operation is not
responded.
[0205] For example, when the large screen is the auxiliary screen,
a point (x, y) on the auxiliary screen is symmetrically mapped to a
corresponding point on the main screen (-x/a, y/b); the finger
touches the point on the auxiliary screen (x, y), the phone
responds to the function instructions at the points (-x/a, y/b) on
the main screen.
[0206] The finger clicks, long presses, slides, etc. at a certain
point (x, y) on the auxiliary screen, and the mobile phone responds
to operation of the click, the long press, the sliding, etc. of the
point at the corresponding point (-x/a, y/a) of on the main
screen.
[0207] For example, when a click, a long press, a screen sliding, a
multi-touch, a gesture, a pressure, etc. are touched at a certain
point on the auxiliary screen, an instruction corresponding to the
point is popped up on the corresponding point on the main screen.
When the instruction is an operation required by the user, the
finger leaves the screen, and the corresponding function prompt
information corresponding to the click, long press, screen sliding,
multi-touch, gesture, pressure, etc. is responded; otherwise, the
finger does not leave the screen and the operation is not
responded.
[0208] For example, when the finger clicks at a certain point on
the auxiliary screen, a dot may be displayed at the corresponding
point of the main screen. When the auxiliary screen is long
pressed, a circle may be displayed at the corresponding point of
the main screen. When the finger slides on the auxiliary screen, a
meteor line may be displayed at the corresponding position on the
main screen. When the finger presses on the auxiliary screen, an
animation effect in which the ring gradually becomes larger may be
displayed at the corresponding position of the main screen.
[0209] For example, one or more switches may be provided for
controlling single screen operation or dual screen operation.
[0210] For example, after setting a single screen operation, the
current running screen is selected.
[0211] Embodiment 4: A touch display method with two screens of
different sizes.
[0212] In this embodiment, two screens are arranged on the front
and back sides of the mobile phone, and the main and auxiliary
screens are determined according to the principle of gravity
sensing. The upward side is determined as the main screen, and the
downward side is determined as the auxiliary screen. The two
screens have the same shape. The length and width of the screens
are a:1 and b:1, respectively.
[0213] When the large screen is the main screen, it is displayed by
pixel A. When the small screen is the main screen, it is displayed
by pixel B. The center point (0, 0) of the main screen may be
determined and the center point (0, 0) of the auxiliary screen may
be determined.
[0214] For example, when the small screen is an auxiliary screen, a
point (x, y) on the auxiliary screen is symmetrically mapped to a
corresponding point on the main screen (-ax, by). When the finger
touches a point (x, y) on the auxiliary screen, the phone responds
to the function instructions at the point (-ax, by) on the main
screen.
[0215] The finger clicks, long presses, slides, gestures, etc. at a
certain point (x, y) on the auxiliary screen. The corresponding
point (-ax, by) on the main screen of the mobile phone responds to
the click, long press, and sliding, etc.
[0216] When the finger performs a gesture operation on the
auxiliary screen, the function instruction corresponding to the
gesture on the main screen is responded.
[0217] For example, when the large screen is the auxiliary screen,
each point (x, y) on the auxiliary screen is symmetrically mapped
to a corresponding point on the main screen (-x/a, y/b); the finger
touches the point on the auxiliary screen (x, y), the phone
responds to the function instructions at the points (-x/a, y/b) on
the main screen.
[0218] The finger clicks, long presses, slides, etc. at a certain
point (x, y) on the auxiliary screen, and the mobile phone responds
to operation of the click, the long press, the sliding, etc. of the
point at the corresponding point (-x/a, y/a) of on the main
screen.
[0219] For example, when a click, a long press, a screen sliding, a
multi-touch, a gesture, a pressure, etc. are touched at a certain
point on the auxiliary screen, an instruction corresponding to the
point is popped up on the corresponding point on the main screen.
When the instruction is an operation required by the user, the
finger leaves the screen, and the corresponding function prompt
information corresponding to the click, long press, screen sliding,
multi-touch, gesture, pressure, etc. is responded; otherwise, the
finger does not leave the screen and the operation is not
responded.
[0220] For example, when the finger clicks at a certain point on
the auxiliary screen, a dot may be displayed at the corresponding
point of the main screen. When the auxiliary screen is long
pressed, a circle may be displayed at the corresponding point of
the main screen. When the finger slides on the auxiliary screen at
a point corresponding to the main screen, a meteor line may be
displayed at the corresponding position on the main screen. When
the finger presses on the auxiliary screen, an animation effect in
which the ring gradually becomes larger may be displayed at the
corresponding position of the main screen.
[0221] For example, one or more switches may be provided for
controlling single screen operation or dual screen operation.
[0222] For example, after setting a single screen operation, the
current running screen is selected.
[0223] Embodiment 5: Folding multi-screen display method,
applicable for wristwatches and super large screens.
[0224] In this embodiment, the terminal is configured with multiple
screens A, B, C, D, and E; and the plurality of screens are
transparent and foldable.
[0225] For example, the multiple screens, when being spread, may be
on the same plane.
[0226] For example, after the multiple screens are spread, the
multiple screens may be tiled together.
[0227] In the application, the content may be presented on the A,
B, C, D, E screens according to the total size of the screens of A,
B, C, D, E for example, and the pixel position of each point on the
screen. The processing method may be referred to the processing
method for the double screens, and will not be described here.
[0228] For example, the user may perform a touch operation on the
screen to complete operations such as clicking, long pressing,
sliding, gesture, and the like.
[0229] Embodiment 6: Display method of a stretch screen.
[0230] In this embodiment, the mobile phone is configured with a
stretch screen. The screen is stretched, the screen becomes large,
and each point on the screen has its own relative position (X,
Y).
[0231] The screen shrinks and each point on the screen has its own
relative position (X, Y).
[0232] In the application, the content may be presented on the
screens according to the total size of the screens and the pixel
position (X, Y) of each point. For the related processing manner,
refer to the processing mode of the double screens, and therefore
no further details are provided herein.
[0233] For example, the user may perform a touch operation on the
screen to complete operations such as clicking, long pressing,
sliding, gesture, and the like.
[0234] Embodiment 7: 360-degree full-screen interactive touch and
display method.
[0235] In this embodiment, the mobile phone is configured with a
full screen of 360 degrees; the main and auxiliary screens are
determined according to gravity sensing, the upward screen is the
main screen, and the downward screen is the auxiliary screen. The
two screens are completely symmetrical, and the center point of the
main screen may be determined as A (0, 0), the center point of the
auxiliary screen is B (0, 0).
[0236] For example, a point (X, Y) on the auxiliary screen is
symmetrically mapped to a corresponding point (-X, Y) on the main
screen. When a finger touches a point on the auxiliary screen, and
an indication point is displayed on the corresponding point on the
main screen. When the finger touches the point (X, Y) on the
auxiliary screen, and the phone responds to the function
instruction at the point (-X, Y) on the main screen.
[0237] The finger clicks, long presses, slides, gestures, etc. at a
certain point (X, Y) on the auxiliary screen, and the corresponding
point (-X, Y) on the main screen of the mobile phone responds to
the click, long press, slide, gestures, etc. at the point.
[0238] For example, when a click, a long press, a screen sliding, a
multi-touch, a gesture, a pressure, etc. are touched at a certain
point on the auxiliary screen, an instruction corresponding to the
point is popped up on the corresponding point on the main screen.
When the instruction is an operation required by the user, the
finger leaves the screen, and the corresponding function prompt
information corresponding to the click, long press, screen sliding,
multi-touch, gesture, pressure, etc. is responded; otherwise, the
finger does not leave the screen and the operation is not
responded.
[0239] For example, when the finger clicks at a certain point on
the auxiliary screen, a dot may be displayed at the corresponding
point of the main screen. When the auxiliary screen is long
pressed, a circle may be displayed at the corresponding point of
the main screen. When the finger slides on the auxiliary screen, a
meteor line may be displayed at the corresponding position on the
main screen. When the finger presses on the auxiliary screen, an
animation effect in which the ring gradually becomes larger may be
displayed at the corresponding position of the main screen.
[0240] For example, when there is a multi-touch screen, the
ineffective touch points are excluded, and the effective touch
points are determined, which may include the following
solutions.
[0241] In solution 1, the touch point moving speed threshold is set
to 500 PPI (Pixels Per Inch)/S. For a function interface that only
supports single touch, when more than two touch points move, and
the moving speeds of the touch points are all less than the
threshold, the operation is not responded. When only the moving
speed of one touch point is larger than a threshold, it is
confirmed that the point is an effective touch point. When the
moving speeds of the touch points are all greater than the
threshold, the point with the maximum speed is determined as the
effective touch point, and the movement trajectory of the point is
tracked. Until the touch point is stationary, and there are other
touch point having a moving speed larger than the threshold, the
new touch point is tracked instead. The relevant processing flow is
shown in FIG. 6.
[0242] For example, for a multi-touch function interface, all touch
points are determined as effective touch points and multi-touch
functions are responded. The relevant processing flow is shown in
FIG. 8.
[0243] In solution 2, for a function interface that only supports
single-touch, when multi-touch is operated, only one point is
moved, and other points are stationary, it is determined that the
moving point is an effective touch point, and the movement
trajectory of the effective touch point is tracked. The relevant
processing flow is shown in FIG. 6.
[0244] For example, for a multi-touch functional interface, all
touch points are determined as effective touch points, consistent
with single-sided screen processing techniques.
[0245] In solution 3, when multi-touch are conducted and the
multiple touch points are stationary, the touch point with pressure
larger than the threshold is determined as an effective touch
point. The movement trajectory of the effective touch point is
tracked. When the point is stationary and pressures of the other
points are greater than the threshold, the movement trajectory of
new effective touch point is tracked instead. The relevant
processing flow is shown in FIG. 9.
[0246] For example, the pressure value of each touch point at the
time when the mobile phone is held may be collected, a daily touch
pressure value is determined, and the pressure threshold is
determined based on the pressure value.
[0247] In solution 4, the touch point that starts moving from the
edge of the screen or a fixed point is determined as an effective
touch point, and the movement trajectory of the effective touch
point is tracked. When a touch point, a long press, a screen
sliding, a multi-touch, a gesture, a pressure, etc. are touched at
a certain point on the auxiliary screen, an instruction
corresponding to the point is popped up at the corresponding point
on the main screen. When the instruction is an operation required
by the user, the finger leaves the screen, and the corresponding
function prompt information corresponding to the click, long press,
screen sliding, multi-touch, gesture, pressure, etc. is responded;
otherwise, the finger does not leave the screen and the operation
is not responded. The relevant processing flow is shown in FIG.
7.
[0248] For example, the above solutions may be applied and executed
independently, in parallel, or in a crossing manner.
[0249] For example, one or more switches may be provided for
controlling single screen operation or dual screen operation.
[0250] For example, after setting a single screen operation, the
current running screen is selected.
[0251] For example, a user of a 360 degree screen may customize the
functions that need to be displayed, and display the content on a
flat surface according to each screen size and pixel bit.
[0252] Those skilled in the art will appreciate that embodiments of
the present application may be provided as a method, system, or
computer program product. Accordingly, the application may take the
form of a hardware embodiment, a software embodiment, or an
embodiment in combination with software and hardware. Moreover, the
application may take the form of a computer program product
embodied on one or more computer-usable storage media (including
but not limited to disk storage and optical storage, etc.) in which
computer usable program code is embodied.
[0253] The present application is described with reference to
flowchart illustrations and/or block diagrams of methods, devices
(systems), and computer program products according to embodiments
of the present application. It will be understood that each flow
and/or block of the flowcharts and/or block diagrams, and
combinations of flows and/or blocks in the flowcharts and/or block
diagrams can be implemented by computer program instructions. These
computer program instructions may be provided to a processor of a
general purpose computer, special purpose computer, embedded
processor, or other programmable data processing device to produce
a machine for the execution of instructions for execution by a
processor of a computer or other programmable data processing
device. Means for implementing the functions specified in one or
more flows of the flowchart or in a block or blocks of the
flowchart.
[0254] The computer program instructions may also be stored in a
computer readable memory that may direct a computer or other
programmable data processing device to operate in a particular
manner, such that the instructions stored in the computer readable
memory produce an article of manufacture comprising the instruction
device. The apparatus implements the functions specified in one or
more blocks of a flow or a flow and/or block diagram of the
flowchart.
[0255] These computer program instructions may also be loaded onto
a computer or other programmable data processing device such that a
series of operational steps are performed on a computer or other
programmable device to produce computer-implemented processing for
execution on a computer or other programmable device. The
instructions provide steps for implementing the functions specified
in a block or blocks of a flow or a flow and/or a block diagram of
a flowchart.
[0256] Those of ordinary skill in the art will appreciate that all
or some of the steps, systems, and functional blocks/units of the
methods disclosed above may be implemented as software, firmware,
hardware, and suitable combinations thereof. In a hardware
implementation, the division between functional modules/units
mentioned in the above description does not necessarily correspond
to the division of physical components; for example, one physical
component may have multiple functions, or one function or step may
be composed of several physical components work together. Some or
all of the components may be implemented as software executed by a
processor, such as a digital signal processor or microprocessor, or
as hardware, or as an integrated circuit, such as an application
specific integrated circuit. Such software may be distributed on a
computer readable medium, which may include computer storage media
(or non-transitory media) and communication media (or transitory
media). As is well known to those of ordinary skill in the art, the
term computer storage medium includes both volatile and
nonvolatile, removable and non-removable media implemented in any
method or technology for storing information, such as computer
readable instructions, data structures, program modules or other
data. Computer storage media includes, but is not limited to, RAM,
ROM, EEPROM, flash memory or other memory technology, CD-ROM,
digital versatile disc (DVD) or other optical disc storage,
magnetic cassette, magnetic tape, magnetic disk storage or other
magnetic storage device, or may be any other medium used to store
the desired information and that may be accessed by a computer.
Moreover, it is well known to those of ordinary skill in the art
that communication media typically comprise computer readable
instructions, data structures, program modules, or other data in a
modulated data signal, such as a carrier wave or other transport
mechanism, and may include any information delivery media.
[0257] The above is only an exemplary embodiment of the present
application, and is not intended to limit the scope of the present
application.
INDUSTRIAL APPLICABILITY
[0258] The embodiment of the present disclosure provides a method
and a device for multi-screen interactive touch display, which
meets the requirements of multi-screen and large-size screen for
operation convenience and display flexibility.
* * * * *