U.S. patent application number 17/190660 was filed with the patent office on 2021-07-08 for display device and coordinate notification method.
This patent application is currently assigned to NEC CORPORATION. The applicant listed for this patent is NEC CORPORATION. Invention is credited to Masaki MIYAHARA.
Application Number | 20210208727 17/190660 |
Document ID | / |
Family ID | 1000005475990 |
Filed Date | 2021-07-08 |
United States Patent
Application |
20210208727 |
Kind Code |
A1 |
MIYAHARA; Masaki |
July 8, 2021 |
DISPLAY DEVICE AND COORDINATE NOTIFICATION METHOD
Abstract
When an application displays image straddling display units
(110-1 and 110-2), a coordinate conversion unit (120) uses a
predetermined operation to transform the physical coordinates
indicating the position at which a display unit (110-1 or 110-2)
senses contact to virtual coordinates and supplies the virtual
coordinates. A coordinate notification unit (130) notifies an
application (140) of the physical coordinates at which contact was
sensed when the application is displaying the image on one of the
display units (110-1 or 110-2) and notifies the application (140)
of the virtual coordinates supplied by the coordinate conversion
unit (120) when the one application is displaying the image
straddling the display units (110-1 and 110-2).
Inventors: |
MIYAHARA; Masaki; (Tokyo,
JP) |
|
Applicant: |
Name |
City |
State |
Country |
Type |
NEC CORPORATION |
Tokyo |
|
JP |
|
|
Assignee: |
NEC CORPORATION
Tokyo
JP
|
Family ID: |
1000005475990 |
Appl. No.: |
17/190660 |
Filed: |
March 3, 2021 |
Related U.S. Patent Documents
|
|
|
|
|
|
Application
Number |
Filing Date |
Patent Number |
|
|
16669617 |
Oct 31, 2019 |
10969900 |
|
|
17190660 |
|
|
|
|
13809525 |
Jan 10, 2013 |
10503289 |
|
|
PCT/JP2011/069166 |
Aug 25, 2011 |
|
|
|
16669617 |
|
|
|
|
Current U.S.
Class: |
1/1 |
Current CPC
Class: |
G06F 3/1423 20130101;
G06F 3/0416 20130101; G06F 3/041 20130101; G06F 3/0481
20130101 |
International
Class: |
G06F 3/041 20060101
G06F003/041; G06F 3/0481 20060101 G06F003/0481 |
Foreign Application Data
Date |
Code |
Application Number |
Sep 24, 2010 |
JP |
2010-213794 |
Claims
1.-2. (canceled)
3. A display device comprising: a plurality of display units with a
touch panel function and that display an image comprising
information; a coordinate conversion unit that, when an application
is displaying said image straddling said plurality of display
units, uses a predetermined operation to convert physical
coordinates that indicate a position at which one display unit of
said plurality of display units senses contact to virtual
coordinates; and a coordinate notification unit that, when the
application is displaying said image straddling said plurality of
display units and the display device is rotated, the coordinate
notification unit uses the predetermined operation in accordance
with a degree of the rotation.
4. The display device as set forth in claim 3, wherein said
coordinate conversion unit converts the physical coordinates on,
from among said plurality of display units, a display unit other
than a primary display unit that includes the coordinates of an
origin that said application recognizes, to said virtual
coordinates.
5. The display device as set forth in claim 4, wherein said
coordinate conversion unit converts, from among said physical
coordinates, a coordinate of a direction along which said primary
display unit and the display unit other than the primary display
unit are aligned.
6. The display device as set forth in claim 5, wherein said
coordinate conversion unit carries out conversion to said virtual
coordinates by adding a coordinate portion that accords with a size
of said primary display unit to physical coordinates on display
units other than said primary display unit.
7. The display device as set forth in claim 3, wherein said
coordinate conversion unit carries out conversion of said physical
coordinates to said virtual coordinates according to movement of
physical coordinates with respect to an origin that said
application recognizes that is caused by rotation of the length and
width of the display device.
8. The display device as set forth in claim 3, wherein the
coordinate notification unit reports said virtual coordinates to
the application.
Description
TECHNICAL FIELD
[0001] The present invention relates to a display device that
displays information, a coordinate notification method in a display
device, and a program, and more particularly to a display device
that displays information on a plurality of displays, a coordinate
notification method in a display device, and a program.
BACKGROUND ART
[0002] In recent years, technique are being considered in which a
plurality of display units (displays) are arranged in a row and
then, by linking and controlling the aligned plurality of displays,
using the displays as if the display sire were much larger.
[0003] In this technique, when the displays are provided with a
touch panel function, the physical coordinates on each of the
displays are notified to an application that is displaying an image
after being converted to virtual coordinates of the entire aligned
plurality of displays (for example, see Patent Document 1).
LITERATURE OF THE PRIOR ART
Patent Documents
[0004] Patent Document 1: Japanese Unexamined Patent Application
Number H11-161426
SUMMARY OF THE INVENTION
Problem to be Solved by the Invention
[0005] When implementing display by using only one display among a
plurality of displays, converting from physical coordinates to
virtual coordinates is unnecessary.
[0006] Nevertheless, the conversion from physical coordinates to
virtual coordinates is required in the above-described technique,
and the problem therefore arises in which resources are wasted due
to unnecesary processing.
[0007] It is an object of the present invention to provide a
display device, a coordinate notification method, and a program
that solve that above-described problem.
Means for Solving the Problem
[0008] The display device of the present invention includes:
[0009] a plurality of display units that are equipped with a touch
panel function and that display an image that is information;
[0010] a coordinate conversion unit that when one application is
displaying the image straddling the plurality of display units,
uses a predetermined operation to convert physical coordinates that
indicate the position at which a display unit senses contact to
virtual coordinates; and
[0011] a coordinate notification unit that, when one application is
displaying the image on one display unit among the plurality of
display units, reports the physical coordinates at which the
display unit senses contact to the application, and when one
application is displaying the image straddling the plurality of
display units, reports the virtual coordinates to the
application.
[0012] The coordinate notification method of the present invention
is a coordinate notification method in a device that is equipped
with a plurality of displays having a touch panel function and
includes steps of:
[0013] sensing contact to the plurality of displays;
[0014] judging whether one application is displaying the image
straddling the plurality of displays;
[0015] when one application is displaying the image straddling the
plurality of displays, using a predetermined operation to convert
the physical coordinates that indicate the position at which the
contact is sensed to virtual coordinates;
[0016] when one application is displaying the image on one display
among the plurality of displays, reporting the physical coordinates
at which the contact is sensed to the application; and
[0017] when one application is displaying the image straddling the
plurality of displays, reporting the virtual coordinates to the
application.
[0018] The program of the present invention is a program for
causing a device that is equipped with a plurality of displays that
have a touch panel function and that display an image that is
information to execute:
[0019] a procedure of sensing contact to the plurality of
displays;
[0020] a procedure of judging whether one application is displaying
the image straddling the plurality of displays;
[0021] a procedure of, when one application is displaying the image
straddling the plurality of displays, using a predetermined
operation to convert physical coordinates that indicate the
position at which contact is sensed to virtual coordinates;
[0022] a procedure of, when one application is displaying the image
on one display among the plurality of displays, reporting the
physical coordinates at which the contact is sensed to the
application, and
[0023] a procedure of, when one application is displaying the image
straddling the plurality of displays, reporting the virtual
coordinates to the application.
Effect of the Invention
[0024] As described hereinabove, in the present invention,
coordinates can be effectively reported to an application in a
device that is equipped with a plurality of displays.
BRIEF DESCRIPTION OF THE DRAWINGS
[0025] FIG. 1 shows an exemplary embodiment of the display device
of the present invention.
[0026] FIG. 2 is a flow chart for describing the coordinate
notification method in the display device shown in FIG. 1.
[0027] FIG. 3 is a view for describing an example of coordinates
that are reported by the coordinate notification unit when an
application that is currently active displays an image on only one
display unit and contact is sensed on that display unit.
[0028] FIG. 4 is a view for describing an example of coordinates
that are reported by the coordinate notification unit when an
application that is currently active displays an image on only one
display unit and contact is sensed on that display unit.
[0029] FIG. 5 is a view for describing an example of the
notification of coordinates when contact is sensed on a display
unit that includes the coordinates of an origin recognized by the
application.
[0030] FIG. 6 is a view for describing an example of notification
of coordinates when contact is sensed on a display unit that does
not include the coordinates of an origin recognized by the
application.
[0031] FIG. 7 is a view for describing an example of the conversion
of coordinates when there are three display units.
[0032] FIG. 8 is a view for describing an example of the conversion
of coordinates when there are four display units.
[0033] FIG. 9 is a view for describing another example of the
conversion of coordinates when there are four display units.
[0034] FIG. 10 shows an example of coordinate conversion when the
directions of length and width of a display device are rotated
clockwise 90.degree..
[0035] FIG. 11 shows an example of coordinate conversion when the
directions of length and width of a display device are rotated
clockwise 180.degree..
[0036] FIG. 12 shows an example of coordinate conversion when the
directions of length and width of a display device are rotated
clockwise 270.degree..
[0037] FIG. 13 is a table showing the formulas of coordinate
conversion resulting from rotation of the vertical and horizontal
directions of the above-described display device.
BEST MODE FOR CARRYING OUT THE INVENTION
[0038] An exemplary embodiment of the present invention is next
described with reference to the accompanying drawings.
[0039] FIG. 1 shows an exemplary embodiment of the display device
of the present invention.
[0040] As shown in FIG. 1, display device 100 in the present
exemplary embodiment is provided with a plurality of display units
110-1 and 110-2, coordinate conversion unit 120, and coordinate
notification unit 130. Display device 100 is further equipped with
application 140 that operates in display device 100. In FIG. 1, a
case is shown in which display device 100 is equipped with one
application, but it goes without saying that display device 100 may
be equipped with two or more applications.
[0041] Display units 110-1 and 110-2 are displays that are equipped
with a touch panel function and that display images that are
information. In FIG. 1, a form is shown in which there are two
display units, but three or more display units may be provided.
[0042] Coordinate conversion unit 120 uses a predetermined
operation to convert the physical coordinates that indicate a
position at which display units 110-1 and 110-2 sense contact to
virtual coordinates when application 140 is displaying an image
straddling display unit 110-1 and display unit 110-2.
[0043] At this time, when display unit 110-1 displays an image that
includes the coordinates of an origin recognized by application
140, coordinate conversion unit 120 converts the physical
coordinates on display unit 110-2 to virtual coordinates. When
display unit. 110-2 displays an image that contains the coordinates
of an origin recognized by application 140, coordinate conversion
unit 120 converts the physical coordinates on display unit 110-1 to
virtual coordinates.
[0044] At this time, coordinate conversion unit 120 converts, from
among the physical coordinates, the coordinate in the direction
along which display unit 110-1 and display unit 110-2 are aligned.
In other words, when display unit 110-1 and display unit 110-2 are
aligned in a horizontal direction, coordinate conversion unit 120
converts the coordinates of the horizontal direction. For example,
when the horizontal direction is the X-axis, coordinate conversion
unit 120 converts the X coordinates. Alternatively, when display
unit 110-1 and display unit 110-2 are aligned in the vertical
direction, coordinate conversion unit 120 converts the coordinates
of the vertical direction. For example, when the vertical direction
is the Y-axis, coordinate conversion unit 120 converts the Y
coordinates.
[0045] At this time, when display unit 110-1 includes the
coordinates of an origin that is recognized by application 140,
coordinate conversion unit 120 carries out conversion to virtual
coordinates by adding a coordinate portion that accords with the
size of display unit 110-1 to the physical coordinates on display
unit 110-2. Alternatively, when display unit 110-2 includes the
coordinates of an origin that is recognized by application 140,
coordinate conversion unit 120 carries out conversion to virtual
coordinates by adding a coordinate portion that accords with the
size of display unit 110-2 to the physical coordinates on display
unit 110-1.
[0046] In addition, coordinate conversion unit. 120 converts
physical coordinates to virtual coordinates in accordance with the
movement of the physical coordinates that correspond to the origin
that application 140 recognizes resulting from the rotation of the
length and width of display device 100.
[0047] Coordinate conversion unit 120 further supplies the
converted virtual coordinates to coordinate notification unit
130.
[0048] Coordinate notification unit 130 reports the physical
coordinates at which display unit 110-1 senses contact to
application 140 when application 140 is displaying an image on only
display unit 110-1. When application 140 is displaying an image on
only display unit 110-2, coordinate notification unit. 130 reports
the physical coordinates at which display unit 110-2 senses contact
to application 140. When virtual coordinates are supplied from
coordinate conversion unit 120, coordinate notification unit 130
reports the virtual coordinates to application 140.
[0049] The coordinate notification method in display device 100
shown in FIG. 1 is next described.
[0050] FIG. 2 is a flow chart for describing the coordinate
notification method in display device 100 shown in FIG. 1.
[0051] When application 140 that is installed in display device 100
is first activated in Step 1, it is first judged in Step 2 whether
contact was sensed in display unit 110-1 or display unit 110-2.
[0052] This operating method of application 140 may be a typical
method such as is realized by carrying out predetermined input and
no particular stipulations are imposed here.
[0053] In addition, in judging whether contact is sensed in display
unit 110-1 or display unit 110-2, judgment is made using the touch
panel function provided in display units 110-1 and 110-2.
[0054] When it is judged that contact is sensed in display unit
110-1 or display unit 110-2, coordinate conversion unit 120 next
judges in Step 3 whether application 140 that is currently
operating is displaying an image straddling display unit 110-1 and
display unit 110-2. No particular stipulation is imposed regarding
this judgment method. In addition, the component that makes this
judgment need not be coordinate conversion unit 120. For example,
this judgment may be carried out by a control unit (not shown) that
controls the entirety of display device 100.
[0055] When it is judged that application 140 that is currently
operating is not displaying an image straddling display unit 110-1
and display unit 110-2, i.e., when application 140 that is
currently operating is displaying an image only on display unit
110-1 or is displaying an image only on display unit 110-2, the
physical coordinates at which contact is sensed are communicated
from coordinate notification unit 130 to application 140 in Step
4.
[0056] To describe this operation by offering an actual example,
when application 140 that is currently operating is displaying an
image on only display unit 110-1 and contact is sensed on display
unit 110-1, the physical coordinates on display unit 110-1 at which
contact is sensed are communicated from coordinate notification
unit 130 to application 140 without alteration. When application
140 that is currently operating is displaying an image on only
display unit 110-2 and contact is sensed on display unit 110-2, the
physical coordinates on display unit 110-2 at which contact is
sensed are communicated from coordinate notification unit 130 to
application 140 without alteration.
[0057] FIG. 3 is a view for describing an example of coordinates
that coordinate notification unit 130 reports when application 140
that is currently operating is displaying an image on only display
unit 110-1 and contact is sensed on display unit 110-1. Here, the
physical coordinates of the upper left corner of display unit 110-1
are (0, 0) (origin), the X-axis being the horizontal direction and
the Y-axis being the vertical direction. In addition, the physical
coordinates of the lower right corner are (w, h). The size of
display unit 110-2 is the same as the size of display unit 110-1,
and the coordinates of the origin and the coordinate axis is the
same as for display unit 110-1.
[0058] As shown in FIG. 3, when contact is sensed at the physical
coordinates (x, y) on display unit 10-1, these physical coordinates
(x, y) are reported to application 140 from coordinate notification
unit 130 without alteration. In other words, conversion from
physical coordinates to virtual coordinates is not implemented in
coordinate conversion unit 120.
[0059] FIG. 4 is a view for describing an example of coordinates
that are reported by coordinate notification unit 130 when
application 140 that is currently operating is displaying an image
on only display unit 110-2 and contact is sensed on display unit
110-2. The origin and coordinate axes on display units 110-1 and
110-2 are the same as shown in FIG. 3. In addition, display unit
110-1 and display unit 110-2 have the same size.
[0060] As shown in FIG. 4, when contact is sensed at physical
coordinates (x, y) on display unit 110-2, these physical
coordinates (x, y) are communicated from coordinate notification
unit 130 to application 140 without alteration, in other words,
conversion from physical coordinates to virtual coordinates is not
carried out at coordinate conversion unit 120.
[0061] When physical coordinates are communicated from coordinate
notification unit 130 to application 140, processing that accords
with the physical coordinates is carried out in application 140 in
Step 5.
[0062] On the other hand, when it is determined in Step 3 that
application 140 that is currently operating is displaying an image
straddling display unit 110-1 and display unit. 110-2, coordinate
conversion unit 120 judges in Step 6 whether the display unit at
which contact is sensed in Step 2 includes the coordinates of the
origin (origin on application 140) that is recognized by
application 140.
[0063] In order for application 140 that is operating to display an
image, there are coordinates of an origin that are recognized by
application 140. When the coordinates of this origin are included
in the display unit in which contact is sensed, i.e., when the
origin of the physical coordinates on the display unit and the
origin recognized by application 140 are the same, conversion of
the physical coordinates is not necessary.
[0064] For example, when contact is sensed on display unit 110-1 in
Step 2, coordinate conversion unit 120 judges whether the
coordinates of the origin recognized by application 140 are
contained in display unit 110-1 the origin in display unit 110-1
and the origin recognized by application 140 are the same). When
contact is sensed on display unit. 110-2 in Step 2, coordinate
conversion unit 120 judges whether the coordinates of the origin
recognized by application 140 are contained on display unit 110-2
(the origin on display unit 110-2 and the origin recognized by
application 140 are the same).
[0065] When it is determined in Step 6 that the display unit on
which contact is sensed in Step 2 is the unit that includes the
coordinates of the origin that are recognized by application 140,
the physical coordinates at which contact is sensed are
communicated from coordinate notification unit 130 to application
140 in Step 4.
[0066] FIG. 5 is a view for describing an example of the
notification of coordinates when contact is sensed in display unit
110-1 that includes the coordinates of the origin that are
recognized by application 140. Here, application 140 that is
currently operating is displaying an image straddling display unit
110-1 that is the primary display and display unit 110-2 that is
the secondary display, and the coordinates of the origin that are
recognized by application 140 are the origin of the physical
coordinates on display unit 110-1.
[0067] As shown in FIG. 5, when contact is sensed at physical
coordinates (x, y) on display unit 110-1, these physical
coordinates (x, y) are reported from coordinate notification unit
130 to application 140 without alteration. This is because, as
described hereinabove, the origin of the physical coordinates on
display unit 110-1 and the origin that is recognized by application
140 are identical, and the conversion from physical coordinates to
virtual coordinates is therefore unnecessary.
[0068] On the other hand, when it is judged in Step 6 that the
display unit on which contact is sensed in Step 2 is not the unit
that includes the coordinates of the origin that is recognized by
application 140, a predetermined operation is used by coordinate
conversion unit 120 to convert the physical coordinates to virtual
coordinates in Step 7.
[0069] FIG. 6 is a view for describing an example of the
notification of coordinates when contact is sensed on display unit
110-2 that does not include the coordinates of the origin that is
recognized by application 140. Here, application 140 that is
currently operating is displaying an image straddling display unit
110-1 that is the primary display and display unit 110-2 that is
the secondary display and the coordinates of the origin that
application 140 recognizes are the origin of the physical
coordinates on display unit 110-1.
[0070] As shown in FIG. 6, when contact is sensed at physical
coordinates (x, y) on display unit 110-2, these physical
coordinates (x, y) are converted to virtual coordinates by
coordinate conversion unit 120.
[0071] In the example shown in FIG. 6, display unit 110-1 and
display unit 110-2 are arranged in a horizontal direction (X-axis
direction), and "w" is the coordinate that accords with the size of
display unit 110-1 in the X-axis direction. As a result, the
formula for converting from physical coordinates to virtual
coordinates for X coordinates is as shown in Formula 1.
x(physical coordinates)+w(the size of display unit 110-1 in the
X-axis direction)=(x+w) (Formula 1)
[0072] Coordinate conversion unit. 120 thus finds the virtual
coordinates by adding the size of display unit 110-1 to the
physical coordinates.
[0073] Because display unit 110-1 and display unit 110-2 are not
arranged in a vertical direction (Y-axis direction), conversion of
the Y coordinate is not carried out.
[0074] Accordingly, physical coordinates (x, y) are converted by
coordinate conversion unit 120 to virtual coordinates (x+w, y).
[0075] In Step 7, when conversion from physical coordinates to
virtual coordinates has been carried out by coordinate conversion
unit 120, the virtual coordinates that have been converted are
supplied from coordinate conversion unit 120 to coordinate
notification unit 130.
[0076] In Step 8, the virtual coordinates from coordinate
notification unit 130 are communicated to application 140, and
processing that accords with the virtual coordinates is carried out
in application 140 in Step 5.
[0077] The above-described processing can be applied to cases in
which the number of display units is three, four, or more.
[0078] FIG. 7 is a view for describing an example of the conversion
of coordinates when them are three display units.
[0079] In the example shown in FIG. 7, display device 100 is
equipped with three display units 110-1-110-3, display unit 110-1
that is the primary display, display unit 110-2 that is the
secondary display, and display unit 110-3 that is the tertiary
display being arranged in a horizontal direction (X-axis
direction).
[0080] In addition, the coordinates of the origin that application
140 recognizes are the same as the origin (upper left corner) of
the physical coordinates on display unit 110-1.
[0081] The size of each of the three display units 110-1-110.3 is
(w.times.h) when indicated by coordinates.
[0082] As shown in FIG. 7, when display device 100 is equipped with
display units 110-1-10-3, the coordinates that are communicated
when contact is sensed on display unit 110-1 or display unit 110-2
are the same as for a case in which two displays are provided as
described hereinabove. In other words, as previously described,
when contact is sensed on display unit 110-1, the physical
coordinates at which contact is sensed are reported by coordinate
notification unit 130 to application 140 without alteration. When
contact is sensed on display unit 110-2, coordinate conversion unit
120 uses Formula 1 to convert the physical coordinates at which the
contact is sensed to virtual coordinates, following which
coordinate notification unit 130 communicates the virtual
coordinates to application 140.
[0083] When contact is sensed at physical coordinates (x, y on
display unit 110-3, the conversion from physical coordinates to
virtual coordinates for the X coordinate is carried out in
coordinate conversion unit 120.
[0084] More specifically, conversion is carried out using the
following Formula 2:
x(physical coordinate)+w(the size of display unit 110-1 in the
X-axis direction)+w(the size of display unit 110-2 in the X-axis
direction)=(x+w+w) Formula 2
[0085] This (x+w+w) is the X coordinate of the virtual
coordinates.
[0086] In addition, because display unit 110-1, display unit 110-2,
and display unit 110-3 are not aligned in the vertical direction
(Y-axis direction), conversion is not carried out for the Y
coordinate.
[0087] Accordingly, the virtual coordinates that are communicated
from coordinate notification unit 130 to application 140 are
(x+w+w, y). Application 140 carries out processing according to
these coordinates (x+w+w, y).
[0088] FIG. 8 is a view for describing an example of the conversion
of coordinates when there are four display units.
[0089] In the example shown in FIG. 8, four display units
110-1-110-4 are mounted in display device 100, display unit 110-1
that is the primary display and display unit 110-2 that is the
secondary display being mounted arranged in a horizontal direction
(X-axis direction). Further, display unit 110-3 that is the
tertiary display and display unit 110-4 that is the fourth display
are mounted aligned in a horizontal direction (X-axis direction).
In addition, display unit 110-1 that is the primary display and
display unit 110-3 that is the tertiary display are mounted aligned
in a vertical direction (Y-axis direction). Still further, display
unit 110-2 that is the secondary display and display unit 110-4
that is the fourth display are mounted aligned in a vertical
direction (Y-axis direction).
[0090] The coordinates of the origin recognized by application 140
are the same as the origin of the physical coordinates (upper left
corner) on display unit 110-1.
[0091] The size of each of the four display units 110-1-110-4 is
(w.times.h) when indicated by coordinates.
[0092] As shown in FIG. 8, when display device 100 is equipped with
display units 110-1-110-4, the coordinates that are reported when
contact is sensed in display unit 110-1 or display unit 110-2 are
the same as for a display device that is equipped with two displays
as described hereinabove. In other words, as previously described,
when contact is sensed on display unit 110-1, the physical
coordinates at which contact is sensed are reported by coordinate
notification unit 130 to application 140 without alteration. When
contact is sensed on display unit 10-2, coordinate conversion unit
120 uses Formula 1 to convert the physical coordinates at which
contact is sensed to virtual coordinates, following which
coordinate notification unit. 130 notifies application 140.
[0093] When contact is sensed at physical coordinates (x, y) on
display unit 110-3, conversion from the physical coordinates to
virtual coordinates is carried out for the Y coordinate in
coordinate conversion unit 120.
[0094] More specifically, conversion is carried out using the
following Formula 3:
y(physical coordinate)+h(size of display unit 110-1 in the Y-axis
direction)=(y+h) Formula 3
[0095] This (y+h) is the Y coordinate of the virtual
coordinates.
[0096] In addition, because display unit 110-1 and display unit
110-3 are not aligned in a horizontal direction (X-axis direction),
conversion is not carried out for the X coordinate.
[0097] Accordingly, the virtual coordinates that are reported from
coordinate notification unit 130 to application 140 are (x, y+h).
Application 140 carries out processing according to these
coordinates (x, y+h),
[0098] FIG. 9 is a view for describing another example of the
conversion of coordinates when there are four display units.
[0099] In the example shown in FIG. 9, the arrangement and size of
display units 110-1-110-4 is the same as shown in FIG. 8.
[0100] In addition, the coordinates of the origin that are
recognized by application 140 are the same as the origin of the
physical coordinates (upper left corner) on display unit 110-1.
[0101] As shown in FIG. 9, when display device 100 is equipped with
display units 110-1-110-4, the coordinates that are reported when
contact is sensed on display unit 110-1 or display unit 110-2 are
the same as for a display device that is equipped with two displays
as described hereinabove. In other words, as previously described,
when contact is sensed on display unit 110-1, the physical
coordinates at which contact is sensed are reported by coordinate
notification unit 130 to application 140 without alteration. When
contact is sensed on display unit 110-2, coordinate conversion unit
120 uses Formula 1 to convert the physical coordinates at which
contact is sensed to virtual coordinates, following which
coordinate notification unit 130 notifies application 140.
[0102] When contact is sensed at physical coordinates (x, y) on
display unit 110-4 conversion from physical coordinates to virtual
coordinates is carried out in coordinate conversion unit 120 for
each of the X coordinate and the Y coordinate.
[0103] More specifically, the following Formula 4 and Formula 5 are
used to carry out conversion.
[0104] First, for the X coordinate:
x(physical coordinate)+w(the size of display unit 110-1 in the
X-axis direction)=(x+w) Formula 4
[0105] This (x+w) is the X coordinate of the virtual
coordinates.
[0106] For the Y coordinate:
y(physical coordinate)+h(the size of display unit 110-2 in the
Y-axis direction)=(y+h) Formula 5
[0107] This (y+h) is the Y coordinate of the virtual
coordinates.
[0108] Accordingly, the virtual coordinates that are reported from
coordinate notification unit 130 to application 140 are (x+w, y+h).
Application 140 carries out processing in accordance with these
coordinates (x+w, y+h).
[0109] The notification of coordinates resulting from rotation of
the directions of length and width of display device 100 is next
described.
[0110] In recent years, display devices are increasingly provided
with the capability of rotating the directions of length and width
of display and switching the vertical orientation in accordance
with the orientation of the display device in which the displays
are mounted.
[0111] The display device of the present invention is also equipped
with this capability.
[0112] In display device 100 shown in FIG. 1, the notification of
the coordinates resulting from the rotation of the length and width
of display device 100 when application 140 is displaying an image
on one of display unit 110-1 and display unit 110-2 is the same as
in a typically used display device.
[0113] When application 140 is displaying an image straddling
display unit 110-1 and display unit 110-2, the physical coordinates
for the origin that application 140 recognizes in some cases moves
across display units 110-1 and 110-2 and thus necessitates
conversion of coordinates for this movement.
[0114] FIG. 10 shows an example of the conversion of coordinates
when the directions of width and length of display device 100
rotate clockwise 90 degrees.
[0115] Physical coordinates (x, y) on display unit 110-1 shown in
FIG. 10 are reported by coordinate notification unit 130 to
application 140 without alteration if display device 100 is not
rotated.
[0116] However, as shown in the lower portion of FIG. 10, if
display device 100 is rotated clockwise 90 degrees, the physical
coordinates corresponding to the origin that application 140
recognizes move from display unit 110-1 to display unit 110-2,
whereupon physical coordinates (x, y) and the physical coordinates
that correspond to the origin that application 140 recognizes are
contained in display units that differ from each other.
[0117] With this change, the physical coordinates (x, y) on display
unit 110-1 are converted to virtual coordinates by coordinate
conversion unit 120.
[0118] More specifically, regarding Y coordinates, the physical
coordinate (y) on display unit 110-1 becomes the X coordinate of
the virtual coordinates
[0119] Further, coordinate conversion unit 120 uses Formula 6 to
carry out conversion for Y coordinates.
w(size of display unit 110-1 in the X-axis direction)-x(physical
coordinate)+w(size of display unit 110-2 in the X-axis
direction)=(w-x+w) Formula 6
[0120] This (w-x+w) becomes the Y coordinate of the virtual
coordinates.
[0121] Accordingly, the virtual coordinates that are reported from
coordinate notification unit 130 to application 140 are (y, w-x+w).
Application 140 carries out processing in accordance with these
coordinates (y, w-x+w).
[0122] FIG. 11 shows an example of the conversion of coordinates
when the directions of length and width of display device 100
rotate clockwise 180 degrees.
[0123] The physical coordinates (x, y) on display unit 110-1 shown
in FIG. 11 are reported by coordinate notification unit. 130 to
application 140 without alteration if display device 100 is not
rotated.
[0124] However, as shown in the lower portion of FIG. 11, if
display device 100 is rotated clockwise 180 degrees, i.e., if the
vertical orientation of display device 100 is switched, the
physical coordinates corresponding to the origin that application
140 recognizes move from display unit 110-1 to display unit 110-2,
whereupon the physical coordinates (x, y) and the physical
coordinates that correspond to the origin that application 140
recognizes are contained in display units that differ from each
other.
[0125] With this change, the physical coordinates (x, y) on display
unit 110-1 are converted to virtual coordinates by coordinate
conversion unit 120.
[0126] More specifically, coordinate conversion unit 120 uses
Formula 7 to convert X coordinates.
w(size of display unit 110-1 in the X-axis direction)-x(physical
coordinate)+w(size of display unit 110-2 in the X-axis
direction)=(w-x+w) Formula 7
[0127] This (w-x+w) becomes the X coordinate of the virtual
coordinates.
[0128] Further, coordinate conversion unit 120 uses Formula 8 to
convert Y coordinates.
h(size of display unit 110-1 in the Y-axis direction)-y(physical
coordinate)=(h-y) Formula 8
[0129] This (h-y) becomes the Y coordinate of the virtual
coordinates.
[0130] Accordingly, the virtual coordinates that are reported from
coordinate notification unit 130 to application 140 are (w-x+w,
h-y). Application 140 carries out processing in accordance with
these coordinates (w-x+w, h-y).
[0131] FIG. 12 shows an example of the conversion of coordinates
when the directions of length and width of display device 100 are
rotated clockwise 270 degrees.
[0132] When display device 100 is rotated clockwise 270 degrees,
the physical coordinates (x, y) on display unit 110-2 shown in FIG.
12 are converted to virtual coordinates by coordinate conversion
unit 120.
[0133] More specifically, coordinate conversion unit 120 uses
Formula 9 to carry out conversion for the X coordinates.
h(size of display unit 110-1 in the Y-axis direction)-y(physical
coordinate)=(h-y) Formula 9
[0134] This (h-y) becomes the X coordinate of the virtual
coordinates.
[0135] Coordinate conversion unit 124) further uses Formula 10 to
carry out conversion for the Y coordinates.
w(size of display unit 110-1 in the X-axis direction)+x(physical
coordinate)=(w+x) Formula 10
[0136] This (w+x) becomes the Y coordinate of the virtual
coordinates.
[0137] Accordingly, the virtual coordinates that are reported from
coordinate notification unit 130 to application 140 are (h-y, w+x).
Application 140 carries out processing in accordance with these
coordinates (h-y, w+x).
[0138] FIG. 13 is a table showing the formulas of coordinate
conversion resulting from rotation of the directions of length and
width of the above-described display device 100. In FIG. 13, the
virtual coordinates following conversion are shown by (x, y').
[0139] As shown in FIG. 13, the conversion from physical
coordinates to virtual coordinates differs for a case of displaying
on one display (either display unit 110-1 or display unit 110-2)
and a case of displaying on two displays (straddling display unit
110-1 and display unit 110-2). In addition, even when displaying on
two displays, the conversion from physical coordinates to virtual
coordinates differs depending on the origin of the occurrence of an
event (the display unit on which contact was sensed). The
conversion process is therefore carried out depending on the
display.
[0140] In addition, conversion to virtual coordinates may be
carried out by first conferring, to each display, display
identification information (such as identifying ID) that can
distinguish each of a plurality of displays and then using the
display identification information and the physical coordinates of
the position at which contact is sensed.
[0141] In the present invention as described hereinabove,
coordinates for an application can be effectively communicated in a
display device having a plurality of display units by converting
physical coordinates to virtual coordinates only when an
application displays an image straddling a plurality of display
units.
[0142] The processing that is carried out by each constituent
element provided in the above-described display device 100 may be
implemented by logic circuits that are each fabricated according to
their purpose. In addition, a program that describes the processing
content may be recorded on a recording medium that can be read in
display device 100, the program that has been recorded on this
recording medium then read in display device 100, and the
processing thus executed. The recording medium that can be read in
display device 100 refers, for example, to a removable recording
medium such as a floppy (registered trademark) disk, a
magnet-optical disk, a DVD, a CD, or additionally, to an HDD or
memory such as ROM and RAM that is incorporated in display device
100. The program that is recorded on this recording medium is read
by a CPU (not shown) that is provided in display device 100, and
processing equivalent to the above-described processing is then
carried out under the control of the CPU. Here, the CPU is a
component that operates as a computer that executes the program
that has been read from the recording medium on which the program
was recorded.
[0143] Although the invention of the present application has been
described hereinabove with reference to an exemplary embodiment,
the invention of the present application is not limited to the
above-described exemplary embodiment. The configuration and details
of the invention of the present application are open to various
modifications within the scope of the invention of the present
application that will be clear to one of ordinary skill in the
an.
[0144] This application claims the benefits of priority based on
Japanese Patent Application No. 2010-213794 for which application
was submitted on Sep. 24, 2010 and incorporates by citation all of
the disclosures of these applications.
* * * * *