U.S. patent application number 13/212663 was filed with the patent office on 2011-12-08 for identification of devices on touch-sensitive surface.
This patent application is currently assigned to MICROSOFT CORPORATION. Invention is credited to Neal Bangerter, Victor Drake, Nigel Keam, Kevin Kennedy, Craig McFarlane, Cyra Richardson, Dana L. Silverstein.
Application Number | 20110298589 13/212663 |
Document ID | / |
Family ID | 39706233 |
Filed Date | 2011-12-08 |
United States Patent
Application |
20110298589 |
Kind Code |
A1 |
McFarlane; Craig ; et
al. |
December 8, 2011 |
IDENTIFICATION OF DEVICES ON TOUCH-SENSITIVE SURFACE
Abstract
The identification of a data storage device detected on a
touch-sensitive display surface of a display device is described.
In one embodiment, the presence and location of the data storage
device is detected on the display surface and the data storage
device is detected on a wireless communications channel. It is then
confirmed that the data storage device detected on the wireless
communications channel is the data storage device detected on the
surface of the display device by communicating with the data
storage device over a second communications channel.
Inventors: |
McFarlane; Craig; (Kirkland,
WA) ; Silverstein; Dana L.; (Duvall, WA) ;
Drake; Victor; (Clyde Hill, WA) ; Kennedy; Kevin;
(Kirkland, WA) ; Richardson; Cyra; (Bellevue,
WA) ; Keam; Nigel; (Redmond, WA) ; Bangerter;
Neal; (Palo Alto, CA) |
Assignee: |
MICROSOFT CORPORATION
Redmond
WA
|
Family ID: |
39706233 |
Appl. No.: |
13/212663 |
Filed: |
August 18, 2011 |
Related U.S. Patent Documents
|
|
|
|
|
|
Application
Number |
Filing Date |
Patent Number |
|
|
11708400 |
Feb 20, 2007 |
|
|
|
13212663 |
|
|
|
|
Current U.S.
Class: |
340/10.1 |
Current CPC
Class: |
G06F 3/0421
20130101 |
Class at
Publication: |
340/10.1 |
International
Class: |
H04Q 5/22 20060101
H04Q005/22 |
Claims
1. In a mobile device, a method of communicating with an
interactive display device, the method comprising: connecting to
the interactive display device via a first wireless communications
channel; conducting an identification confirmation communication
with the interactive display device over a second wireless
communications channel via a radiofrequency field received from the
interactive display device; and after conducting the identification
confirmation communication, sending data stored on the mobile
device to the interactive display device via the first wireless
communication channel.
2. The method of claim 1, wherein connecting to the interactive
display device via the first wireless communications channel
comprises connecting to the interactive display device via an
802.11 communications channel.
3. The method of claim 1, further comprising receiving power for
conducting the identification confirmation communication over the
second wireless communications channel from the radiofrequency
field.
4. The method of claim 1, further comprising receiving power for
conducting the identification confirmation communication from an
on-board power supply of the mobile device.
5. The method of claim 1, wherein communicating over a second
wireless communications channel comprises communicating over an
RFID channel.
6. The method of claim 1, wherein the data comprises image
data.
7. The method of claim 1, wherein the mobile device comprises a
mobile computing device.
8. The method of claim 1, wherein the mobile device comprises an
object having an RFID tag.
9. A mobile device, comprising: a first wireless communications
device comprising a first wireless transmitter/receiver operable to
communicate via an 802.11 protocol; a second wireless
communications device comprising a second wireless
transmitter/receiver operable to communicate via a radiofrequency
field emitted by another device; a processor; and a computer
readable storage medium comprising instructions stored thereon that
are executable by the processor to conduct an identification
confirmation communication with an interactive display device via
the second wireless communications device; and after conducting the
identification confirmation communication with the interactive
display device, send data stored on the mobile device to the
interactive display device via the first wireless communications
device.
10. The mobile device of claim 9, wherein the second radiofrequency
transmitter/receiver is configured to receive operating power from
the radiofrequency field.
11. The mobile device of claim 9, wherein the second radiofrequency
transmitter/receiver is configured to receive power from an
on-board power supply.
12. The mobile device of claim 9, wherein the instructions are
executable not to send the data to the interactive display device
if the mobile device connects to the interactive display device via
the first radiofrequency transmitter/receiver but does not conduct
the identification confirmation communication with the interactive
display device via the second radiofrequency
transmitter/receiver.
13. The mobile device of claim 9, wherein the second radiofrequency
transmitter/receiver comprises an RFID tag.
14. In an interactive display device comprising a touch-sensitive
surface, a method of identifying from a plurality of detected data
storage devices a selected data storage device, the method
comprising: detecting the plurality of data storage devices on a
wireless communications channel; detecting the selected data
storage device on a radiofrequency communications channel
comprising a radiofrequency field emitted by the interactive
display device, the radiofrequency communications channel being
different than the wireless communications channel; distinguishing
the selected data storage device from other data storage devices of
the plurality of data storage devices by communicating with the
selected data storage device over the radiofrequency communications
channel; after distinguishing the selected data storage device,
receiving data from the selected data storage device; and
displaying on the display device the data received from the data
storage device.
15. The method of claim 14, wherein the radiofrequency
communications channel comprises an RFID channel.
16. The method of claim 14, wherein distinguishing the selected
data storage device comprises sending a request to the selected
data storage device to emit or receive an identifying signal over
the identification communications channel.
17. The method of claim 14, wherein the data comprises image
data.
18. The method of claim 14, wherein displaying the data comprises
displaying the data at a location adjacent to a location of the
data storage device.
Description
CROSS-REFERENCE TO RELATED APPLICATIONS
[0001] This application is a continuation of U.S. patent
application Ser. No. 11/708,400, filed Feb. 20, 2007 and titled
"Identification of Devices on Touch-Sensitive Surface," the entire
disclosure of which is hereby incorporated by reference.
BACKGROUND
[0002] The sharing of photographic and other data stored on mobile
data storage devices, such as cell phones, cameras, personal
digital assistants, etc., currently poses various difficulties. For
example, currently a mobile device user may share such data by
first transferring the data to a computer and then sharing the data
by email, by uploading to a network server, etc. However, such
sharing processes may take many user steps, and may be difficult to
perform while a user is away from a home computer, for example,
when on vacation, while at a restaurant, etc. Therefore, in these
settings, photos are often shared by passing the mobile data
storage device from person to person to view the photos on the
device display. Due to the small size of such displays, it may be
difficult for more than one or two people to simultaneously view a
photograph.
[0003] Some mobile devices, such as cellular phones, may be
equipped to send photographs and other such data to other devices
over a cellular network. However, per transaction costs may be high
for sending such data. Additionally, each transaction may involve
multiple user steps. Further, the generally small sizes of mobile
device displays may limit the number of persons who can view the
data on the receiving device, and therefore may reduce user
satisfaction with the sharing experience.
[0004] Likewise, some mobile data storage devices equipped with
wireless communications technologies such as Bluetooth (IEEE
802.15.1) and WiFi (IEEE 802.11x) may be configured to allow the
sharing of data with other similarly-equipped devices. However,
sharing content via such technology also may involve many user
steps to connect to and transfer content between devices.
Eliminating steps to improve the user experience may pose problems
where more than one data storage device is detected within
communication range, as it may be difficult for each device to
identify which device of the detected devices data is to be
transferred to or from without user input steps.
SUMMARY
[0005] Accordingly, the automatic identification of a data storage
device by a touch-sensitive interactive display device, to which
data in the data storage device may be transferred for display to a
plurality of users, is described below in the Detailed Description.
For example, in one embodiment, a data storage device detected on a
touch-sensitive surface of a display device is identified by
detecting the data storage device on a wireless communications
channel, and then confirming that the data storage device detected
on the wireless communications channel is the data storage device
detected on the surface of the display device by communicating with
the data storage device over a second communications channel. This
may allow the display device to identify the data storage device
from among multiple data storage devices detected on the wireless
communications channel, and thereby to receive data only from the
identified data storage device.
[0006] This Summary is provided to introduce a selection of
concepts in a simplified form that are further described below in
the Detailed Description. This Summary is not intended to identify
key features or essential features of the claimed subject matter,
nor is it intended to be used to limit the scope of the claimed
subject matter. Furthermore, the claimed subject matter is not
limited to implementations that solve any or all disadvantages
noted in any part of this disclosure.
BRIEF DESCRIPTION OF THE DRAWINGS
[0007] FIG. 1 shows an embodiment of an interactive display device
according to the present disclosure.
[0008] FIG. 2 shows a process flow of an embodiment of a method for
identifying a data storage device placed on the surface of an
interactive display device.
[0009] FIG. 3 shows a schematic diagram of another embodiment of an
interactive display device.
[0010] FIG. 4 shows a schematic diagram of yet another embodiment
of an interactive display device.
[0011] FIG. 5 shows a process flow of another embodiment of a
method for identifying a data storage device placed on the surface
of an interactive display device.
[0012] FIG. 6 shows a block diagram of an embodiment of a
radiofrequency identification (RFID) tag comprising a secondary
communications device.
[0013] FIG. 7 shows a block diagram of an alternative embodiment of
an RFID tag comprising a secondary communications device.
[0014] FIG. 8 shows a schematic depiction of another embodiment of
an RFID tag comprising an optical emitter and a plurality of other
optically readable elements.
[0015] FIG. 9 shows a block diagram of an embodiment of a software
architecture of a mobile data storage device.
[0016] FIG. 10 shows a process flow of another embodiment of a
method for identifying a data storage device placed on the surface
of an interactive display device.
DETAILED DESCRIPTION
[0017] FIG. 1 shows an embodiment of an interactive display device
100 configured to receive data from a mobile data storage device
and to display the data to a plurality of users. Data that may be
shared via interactive display device 100 may include, but is not
limited to, photographic data, video data, music and other audio
data, graphical data, documents, spreadsheets, presentations, and
any other suitable type of data. Interactive display device 100 may
also be configured to allow various operations to be performed on
displayed data, including but not limited to editing, sending via
email, uploading to other mobile data storage devices, printing,
ordering printed copies over a network, etc.
[0018] Interactive display device 100 may be configured to receive
data from and/or to transfer data to any suitable type of mobile
data storage device. Examples of such mobile data storage devices
include, but are not limited to, mobile computing devices such as
laptop computers, hand-held devices, cellular phones, portable
media players, personal digital assistants, cameras, video cameras,
and other microprocessor-based or microcontroller-based
programmable consumer electronics and/or appliances. As used
herein, the term "computing device" may include any device that
electronically executes one or more programs, and "data storage
device" may include any device with a computer-readable storage
medium capable of storing computer-readable data and/or other
content. The embodiments described herein may be implemented on
such devices, for example, via computer-executable instructions or
code, such as programs, stored on a computer-readable storage
medium and executed by the computing device. Generally, programs
include routines, objects, components, data structures, and the
like that perform particular tasks or implement particular abstract
data types. The term "program" as used herein may connote a single
program or multiple programs acting in concert, and may be used to
denote applications, services, or any other type or class of
program. Interactive display device 100 may also be configured to
receive data from devices other than computing devices, including
but not limited to data storage devices such as flash drives, etc.
having communications capabilities.
[0019] Turning again to FIG. 1, the depicted interactive display
device 100 comprises a horizontal table-like top surface having a
touch-sensitive display screen 102. As described in more detail
below, a user may transfer data to interactive display device 100
from a suitably enabled mobile data storage device 104 simply by
placing mobile data storage device 104 on touch-sensitive display
screen 102. Interactive display device 100 detects the presence and
location of mobile data storage device 104 on touch-sensitive
display screen 102, connects to mobile data storage device 104 via
a wireless communications channel 106, receives data from mobile
data storage device 104 over the wireless communications channel,
and displays the data on touch-sensitive display screen 102. The
data then may be viewed, and in some embodiments, manipulated, via
touch-sensitive display screen 102 by a group of persons seated
around interactive display device 100. In this manner, photographs
and other data stored on mobile data storage device 104 may be
shared by a group of users in a simple and intuitive manner. While
described herein in the context of an interactive display device
having a horizontal, table-like display surface, it will be
appreciated that interactive display device 100 may include a
display having any other suitable orientation, including but not
limited to vertical and diagonal orientations.
[0020] At times, more than one mobile data storage device may be
placed on touch-sensitive display screen 102, as shown in FIG. 1 at
104' Likewise, at times, one or more mobile data storage devices
108 may be detected on wireless communications channel 106 but not
located on touch-sensitive display screen 102. In order for
interactive display device 100 to determine the identities of those
data storage devices from which to receive data as well as the
appropriate location and orientation on interactive display device
100 to display the data, interactive display device 100 may be
configured to distinguish mobile data storage devices 104, 104'
that are placed on touch-sensitive display screen 102 from devices
108 not placed on touch-sensitive display screen 102. Interactive
display device 100 may also be configured to identify the specific
locations on touch-sensitive display screen 102 at which each
mobile data storage device 104, 104' is placed. This may allow
interactive display device 100 to display data received from each
device 104, 104' in a location associated with the transferor
device, and also not to download and/or display data from devices
108 that are detected on wireless communication channel 106 but not
placed on touch-sensitive surface 102.
[0021] FIG. 2 shows a process flow depicting an embodiment of a
method 200 for identifying one or more data storage device(s) 104
placed on touch-sensitive display screen 102. Method 200 first
includes detecting, at 202, a presence and location of a mobile
data storage device 104 on touch-sensitive display screen 102, and
detecting, at 204, the mobile data storage device 104 on a wireless
communications channel 106. In some embodiments, mobile data
storage device 104 may be detected on the wireless network before
being placed on touch-sensitive display screen. In other
embodiments, interactive display device 100 may be configured to
detect devices on wireless network 106 only when an object is
detected on touch-sensitive display screen 102.
[0022] Next, method 200 includes confirming, at 206, that the
mobile data storage device 104 detected on the wireless
communications channel 106 is the data storage device 104 detected
on the surface of the display device by communicating with the data
storage device over a second communications channel. Once
interactive display device 100 has confirmed that the data storage
device detected on the wireless communications channel is the data
storage device 104 detected on the touch-sensitive display, data
may be transferred from mobile data storage device 104 to the
interactive display device 100 for display on display surface
102.
[0023] The presence and location of mobile data storage device 104
on the touch-sensitive display may be determined in any suitable
manner. For example, in some embodiments, touch-sensitive display
screen 102 may include an electrically sensitive touch sensitive
mechanism (for example, a capacitive or resistive mechanism)
capable of locating an object placed on touch-sensitive display
screen 102. In other embodiments, interactive display device 100
may include an image capture device configured to capture an image
of touch-sensitive display screen 102 to detect infrared or visible
light reflected from objects placed on touch-sensitive display
screen 102. In these embodiments, motion of an object on
touch-sensitive screen 102 may be detected by capturing images of
touch-sensitive display screen 102 at a suitably high sample rate,
for example, between 20 and 100 Hz, to track object motion on
screen 102. Various embodiments of interactive display device 100
are described in more detail below.
[0024] Likewise, the presence of mobile data storage device 104 on
the wireless communications channel 106 may be detected in any
suitable manner. For example, interactive display device 100 may
send an intermittent and/or periodic beacon over wireless
communications channel 106 to alert mobile data storage devices
within range of its presence, and devices receiving the beacon may
connect to interactive display device 100 in response to the
beacon. Alternatively, interactive display device 100 may send a
beacon over wireless communications channel 106 only when an object
is detected on touch-sensitive surface 102. In either these
embodiments, display 102 (as well as other electronic systems) may
remain dormant until activity is detected by the wireless
communications channel or the touch-screen interface. This may
allow interactive display device 100 to assume a deeper power-save
mode during periods of inactivity, such as during the night. It
will be appreciated that interactive display device 100 may be
configured to communicate with and receive data from mobile data
storage device 104 via any suitable wireless communications
technology. Examples include, but are not limited to,
radiofrequency technologies such as 802.11x technologies, Bluetooth
technologies, active or passive radiofrequency identification
(RFID) technologies, etc.
[0025] Continuing with FIG. 2, interactive display device 100 may
confirm at 206 the identification of the mobile data storage device
104 via communication with mobile data storage device 104 over any
suitable second communications channel. Suitable channels include
those channels that are sensitive to a position of mobile data
storage device 104 on touch-sensitive display screen 102. Specific
examples include, but are not limited to, optical and
electromagnetic second communications channels such as the touch
sensitive mechanism of touch-sensitive display screen 102. For
example, where interactive display device 100 utilizes a
capacitive, resistive, or other electrical touch-sensing mechanism,
the electrical touch-sensing mechanism may be used to detect a
modulated electrical signal emitted by mobile data storage device
104. Likewise, where interactive display device 100 utilizes an
image capture device to implement the touch sensitivity of display
surface 102 by detecting images of objects on display surface, the
image capture device may also be used as a second communications
channel to receive an optical communication signal from mobile data
storage device 104.
[0026] FIG. 3 shows a schematic depiction of an embodiment of an
interactive display device 300 utilizing an optical touch sensing
mechanism. Interactive display device 300 comprises a projection
display system having an image source 302, optionally one or more
mirrors 304 for increasing an optical path length and image size of
the projection display, and a display screen 306 onto which images
are projected.
[0027] Image source 302 includes an optical or light source 308
such as the depicted lamp, an LED array, or other suitable light
source. Image source 302 also includes an image-producing element
310 such as the depicted LCD (liquid crystal display), an LCOS
(liquid crystal on silicon) display, a DLP (digital light
processing) display, or any other suitable image-producing element.
Display screen 306 includes a clear, transparent portion 312, such
as sheet of glass, and a diffuser screen layer 314 disposed on top
of the clear, transparent portion 312. In some embodiments, an
additional transparent layer (not shown) may be disposed over
diffuser screen layer 314 to provide a smooth look and feel to the
display surface.
[0028] Continuing with FIG. 3, interactive display device 300
further includes an electronic controller 316 comprising memory 318
and a microprocessor 320. Further, controller 316 may include a
wireless transmitter and receiver 322 configured to conduct two-way
communication with mobile data storage devices. Wireless
transmitter and receiver 322 may be configured to conduct wireless
communications with mobile data storage device in any suitable
manner, including but not limited to via 802.11x, Bluetooth, RFID
or other radiofrequency communications technologies. While shown as
part of controller 316, it will be appreciated that wireless
transmitter and receiver 322 may also be provided as a separate
device in electrical communication with controller 316.
[0029] To sense objects placed on display screen 306, interactive
display device 300 includes an image capture device 324 configured
to capture an image of the entire backside of display screen 306,
and to provide the image to electronic controller 316 for the
detection of objects appearing in the image. Diffuser screen layer
314 helps to avoid the imaging of objects that are not in contact
with or positioned within a few millimeters of display screen 306,
and therefore helps to ensure that only objects that are touching
display screen 306 are detected by image capture device 324.
[0030] Image capture device 324 may include any suitable image
sensing mechanism. Examples of suitable image sensing mechanisms
include but are not limited to CCD and CMOS image sensors. Further,
the image sensing mechanisms may capture images of display screen
306 at a sufficient frequency to detect motion of an object across
display screen 306. Display screen 306 may alternatively or further
include an optional capacitive, resistive or other electromagnetic
touch-sensing mechanism, as illustrated by dashed-line connection
325 of screen 306 with controller 316.
[0031] Image capture device 324 may be configured to detect
reflected or emitted energy of any suitable wavelength, including
but not limited to infrared and visible wavelengths. To assist in
detecting objects placed on display screen 306, image capture
device 324 may further include an additional optical source or
emitter such as one or more light emitting diodes (LEDs) 326
configured to produce infrared or visible light. Light from LEDs
326 may be reflected by objects placed on display screen 306 and
then detected by image capture device 324. The use of infrared LEDs
as opposed to visible LEDs may help to avoid washing out the
appearance of projected images on display screen 306.
[0032] LEDs 326 may be positioned at any suitable location within
interactive display device 300. In the depicted embodiment, a
plurality of LEDs 326 are placed along a side of display screen
306. In this location, light from the LEDs can travel through
display screen 306 via internal reflection, while some can escape
from display screen 306 for reflection by an object on the display
screen 306. In alternative embodiments, one or more LEDs may be
placed beneath display screen 306 so as to pass emitted light
through display screen 306.
[0033] FIG. 3 also depicts a mobile data storage device 330 that
has been placed on display screen 306. Mobile data storage device
330 includes a wireless transmitter and receiver 332 configured to
communicate with wireless transmitter and receiver 322 on
interactive display device 300, and also includes an electrical
and/or optical emitter 334 configured to emit an electrical and/or
optical signal that is detectable by display screen 306 and/or
image capture device 324. In alternative embodiments, mobile data
storage device 330 comprises an optical detector, as described in
more detail below.
[0034] FIG. 4 shows a schematic depiction of another embodiment of
an interactive display device 400 that utilizes an optical touch
sensing mechanism. Interactive display device 400 comprises a
projection display system having a wide angle image source 402 and
a display screen 406 onto which images are projected. Image source
402 includes a light source 408 and an image-producing element 410.
Display screen 406 includes a transparent glass structure 412 and a
diffuser screen layer 414 disposed thereon.
[0035] Continuing with FIG. 4, interactive display device 400
includes an electronic controller 416 comprising memory 418 and a
microprocessor 420. Further, interactive display device 400
includes a wireless transmitter and receiver 422 configured to
conduct two-way communication with mobile data storage devices,
such as device 430 via wireless transmitter and receiver 432 on
device 430.
[0036] Interactive display device further includes a plurality of
image capture devices, depicted as 424a-424e, and an optical
emitter such as an LED array 426 configured to illuminate a
backside of display screen 406 with infrared or visible light.
Image capture devices 424a-e are each configured to capture an
image of a portion of display screen 406 and provide the image to
controller 416, and to assemble a composite image of the entire
display screen 406 from the images. In the depicted embodiment,
image capture devices 424a-d are positioned generally beneath the
corners of display screen 406, while image capture device 424e is
positioned in a location such that it does not pick up glare from
LED array 426 reflected by display screen 406 that may be picked up
by image capture devices 424a-d. In this manner, images from image
capture devices 424a-e may be combined by controller 416 to produce
a complete, glare-free image of the backside of display screen 406.
This allows detection of an object such as a mobile data storage
device 430 placed on display screen 406. Display screen 406 may
alternatively or further include an optional capacitive, resistive
or other electromagnetic touch-sensing mechanism, as illustrated by
dashed-line connection 425 of screen 406 with controller 416.
[0037] In the embodiments of FIGS. 3 and 4, image capture devices
324 and 424a-e, and/or an electronically sensitive touch sensing
mechanism disposed within touch-sensitive display screen 306, may
act as a second communications channel between mobile data storage
devices and interactive display device 300. Either of these
mechanisms may be capable of communicating with the depicted
interactive display devices 300 and 400 in a manner that expresses
the position of the devices on the display screen. This enables the
interactive display devices 300 and 400 to conduct a locating
communication session with a mobile data storage device in which
the mobile data storage device sends or receives a specific message
across the second communications channel in response to a specific
request for that message sent by the interactive display device
across the wireless communications channel.
[0038] FIG. 5 shows a process flow depicting another embodiment of
a method 500 for identifying one or more data storage device placed
on touch-sensitive display screen of an interactive display device.
While described herein in the context of interactive display device
400, it will be appreciated that method 500 may be performed by any
of the embodiments disclosed herein, including devices 100 and 300,
400, and/or by any other suitable device.
[0039] Method 500 first includes detecting, at 502, an object
placed on display screen 406, and detecting, at 504, a data storage
device on a wireless communications channel via wireless
communications transmitter and receiver 422. Next, to determine
whether the object detected on display screen 406 is the data
storage device detected on the wireless communications channel,
interactive display device 400 sends, at 506, a request over the
wireless communications channel to the data storage device for the
data storage device to send a locating message over the second
communications channel.
[0040] If the object detected on display screen 406 is the data
storage device to which the request was sent, then interactive
display device 400 receives, at 508, the locating message. On the
other hand, if the object on display screen 406 is not the data
storage device detected on the wireless communications channel,
then interactive display device 400 will not receive the locating
message due to the position-sensitive nature of the second
communications channel. In this manner, interactive display device
400 determines, at 510, the identity of a data storage device on
the surface of the display screen 406 based on receipt of the
locating message. Data may then be downloaded from the data storage
device for display on display screen 406.
[0041] The locating message sent by the data storage device over
the second communications channel may take any suitable form. For
example, in some embodiments, the data storage device includes an
infrared emitter. Upon receipt of a request to send a locating
message, the data storage device emits infrared light via the
infrared light emitter. The emitted infrared light may be received
by image capture devices 424a-e and detected in the images from
image capture devices 424a-e by controller 416. In alternative
embodiments, the data storage device includes a second
electromagnetic modulator. Upon receipt of a request to send a
locating message, the data storage device emits a modulated
electromagnetic signal, which may be detected by a suitable
detection mechanism associated with display screen 406.
[0042] Method 500 may also be used to locate and identify a
plurality of mobile data storage devices placed on display screen
406. For example, where four users each place a mobile data storage
device on display screen 406, interactive display device 400 may
determine which mobile data storage device is located at which
position on touch-sensitive display screen by requesting each
mobile data storage device to send a locating message that is
distinguishable from the locating message sent by the other data
storage devices. For example, in some embodiments, the mobile data
storage device may be requested to send a locating message at
different times. In other embodiments, each mobile data storage
device may be asked to send a different locating message, for
example, a different number or pattern of emitted signals. In this
manner, each mobile data storage device that is detected on
interactive display device 400 may be distinguished from other
mobile data storage devices located on interactive display device
400, as well as mobile data storage devices that are within
wireless detection range but are not located on interactive display
device 400.
[0043] Further, as described above, image capture device 424a-e may
acquire images of display screen 406 at a sufficient frequency to
allow the motion of objections on display screen 406 to be tracked.
Therefore, once a mobile data storage device has been identified
and located on display screen 406, movements of the device on
display screen 406 may be tracked, thereby allowing the device to
be moved without having to repeat the identification process. If
the mobile data storage device is not successfully tracked or is
lifted from display screen 406 during movement, the locating
process may be again performed to identify and locate the device on
display screen 406. Alternatively, interactive display device 400
may be configured to periodically and/or continuously renew device
identifications, or to renew identifications whenever a device is
moved.
[0044] The wireless and second communications mechanisms described
above may be implemented in any suitable manner on mobile data
storage devices. Some mobile data storage devices may be
manufactured with suitable communications mechanisms build into the
devices. For example, wireless technologies such as 802.11x and
Bluetooth are integrated into many portable data storage devices,
including but not limited to cell phones, PDAs, and cameras.
Likewise, many portable data storage devices also include infrared
data ports. Therefore, such devices may be configured, via software
or hardware for example, to conduct a locating communication with
interactive display device 400 using standard included equipment.
On the other hand, some devices may not include standard equipment
that may be used for communicating over the wireless and second
communications channels. Therefore, a simple communications tag may
be attached to or incorporated into these devices to enable these
devices to be located on and identified by interactive display
device 400.
[0045] FIG. 6 shows a block diagram of an embodiment of an
identification tag system 600 that may be attached to or
incorporated into an object to allow the object to be identified by
interactive display device 400. Tag system 600 comprises an RFID
tag 602 with a microcontroller 603, memory 604 on which a unique
identifier is stored, an RF modulator 605, an RF antenna 606, and a
second modulation device 608 configured to emit a modulated
electromagnetic or optical signal. Tag system 600 may be read by an
RFID interrogator incorporated into wireless transmitter and
receiver 422 of interactive display device 400 to transfer a unique
identification of the mobile data storage device to interactive
display device 400. Further, microcontroller 603 may be configured
to cause second modulation device 608 to emit an optical,
electrical or electromagnetic locating signal so that interactive
display device 400 can locate and identify the device with tag
system 600 on touch-sensitive display screen 406. In this manner,
tag system 600 may support a large number of unique identification
numbers via RFID capabilities (including 128-bit identification
numbers), while second modulation device may allow a specific
tagged device to be located on display screen 406.
[0046] In some embodiments, tag system 600 is electronically
passive and acquires all operating power from an interrogating RF
field. In alternative embodiments, tag system 600 is electronically
active in that it includes a power supply. Where tag system 600 is
an active tag, it may include an on-board power supply (i.e. on the
tag itself), or may be connected to a power supply on the device on
which tag system 600 is included.
[0047] Any suitable event may be used to trigger microcontroller
603 to cause second modulation device 608 to send a locating signal
at any suitable time. For example, in some embodiments,
microcontroller 603 may be configured to receive a request from
interactive display device 400 to send the modulating signal, and
then may direct second modulation device 608 to emit the signal
upon receipt of the request. In alternative embodiments,
microcontroller 603 may be configured to alert interactive display
device 400, via the RF identification channel, that it will send a
specific locating message via second modulator 608, and then may
send the locating message after sending the alert. In either case,
the locating operation is performed by two-way communication via
the wireless communications channel and one-way communication from
tag system 600 to interactive display device 400 via the second
communications channel.
[0048] It will be appreciated that tag system 600 may include both
an optical or electrical emitter and an optical or electrical
receiver. In these embodiments, tag system 600 and interactive
display device 400 may conduct a two-way locating communication in
which each device both sends and receives a locating signal.
Various embodiments of mobile devices with optical receivers are
described in more detail below.
[0049] In some embodiments, tag system 600 may be used to transfer
more information to interactive display device 400 than a unique
identification number. For example, in some embodiments, tag system
600 may be configured to transfer data such as photographic data,
video data, etc. for display on interactive display device 400 via
the RFID communications channel.
[0050] Further, it will be appreciated that tag system 600 may have
applicability beyond identifying a mobile data storage device on
touch-sensitive display screen 400. For example, tag system 600 may
be placed on any desired object to allow interactive display device
to identify and interact with that object. As one example, tag
system 600 may be included on a card issued to and linked
specifically to a guest at a resort, amusement park, or other such
entertainment facility. While the user is at the entertainment
facility, photographs may be taken of the guest performing various
activities, such as riding rides, participating in sports
activities, etc., and may be displayed at a kiosk to the user for
selection after the activity has included. As a specific example, a
roller coaster may include a camera configured to photograph all of
the riders as the roller coaster cars pass by the camera.
[0051] Upon conclusion of the ride, a rider may view the
photographs at a kiosk, scan the card to alert the kiosk of the
identity of the person making the selection, and then select
photographs in which the rider and/or the rider's friends and/or
family appear. Then, at a later time and/or different location, for
example, in a hotel lobby, or in a coffee house or restaurant
affiliated with the resort, the rider may place the card on the
surface of an interactive display device 400. The device may
determine the identity of the holder of the card by receiving the
unique ID of the card holder via RFID tag 602, query a database to
determine those photos previously selected by the rider, and then
download those photos for display on display screen 406.
[0052] Furthermore, where multiple cards are placed on the table,
interactive display device 400 may determine where each detected
card is located on display screen 406 via second modulator 608, and
then display the downloaded photos in locations and orientations
based upon the location of the cards on the table. It will be
appreciated that tag system 600 may be used to allow interactive
display device 400 to uniquely identify any other suitable object,
such as drinks, glasses or plates placed on display screen 406 for
enabling drink or food ordering through touch-sensitive display
screen 400, etc. Further, other indication indicia may be included
on tag system 600 (or elsewhere on an object) to allow an
orientation of an object to be determined. FIG. 7 shows a schematic
depiction of a tag system 700 having a second modulator 708, and a
plurality of other optical indicators 710. For example, the
relative locations of the signal from second modulator 708 and the
detected positions of other optical indicators 710 may be detected
by interactive display device 400. The orientation of the object
may then be determined by comparing the positions of second
modulator 708 and other optical indicators 710 to a database
containing information on the location of optical indicators on
tags.
[0053] Optical indicators 710 may also serve to identify the device
on which tag system 700 is located as one including a second
optical or electrical communications channel. This allows the
display device to ignore objects that do not possess such a
communications channel. Further, optical indicators 710 also may be
used to locate the secondary communications channel on large and/or
complex devices, so the display surface does not have to know the
location of the secondary communications channel for all present
and future devices. Additionally, optical indicators 710 can act as
a visual cue to a user in that the optical indicators may indicate
to the user which surface of the object, such as a surface having a
camera lens, should be placed in contact with the display
surface.
[0054] Additionally, optical indicators 710 may simplify the
tracking of devices moved on the display surface. For example, once
the identity of a device has been determined and associated with
the optical indicators 710 located on that device, the device may
be identified at any location on the display surface simply by
reading optical indicators 710. Further, changes in the orientation
of tag system 700 may be detected by tracking the changes in the
positions of optical indicators 710 and/or second modulator 708.
This may allow the rotation of an object including tag system 600
on display screen 406 to be used as an input to interactive display
device 400. Such an input could be used, for example, to trigger a
change in a displayed image, to cause a scrolling menu displayed on
touch-sensitive display screen to scroll, or to trigger any other
desired functionality in interactive display device 400.
[0055] Any suitable optically readable symbol or arrangement of
symbols may be used as optical indicators 710. For example, in one
embodiment, optical indicators 710 may take the form of a barcode.
In alternative embodiments, optical indicators 710 may comprise
optically reflecting or absorbing shapes such as circles,
triangles, rectangles, etc. Different sizes and/or arrangements of
shapes may be used to identify various objects. Furthermore, in
other alternative embodiments, more than one second modulator 708
may be provided, thereby allowing tag orientation and/or object
orientation to be determined via the signals from the plurality of
second modulators.
[0056] Depending upon the configuration of optical indicators 710,
optical indicators 710 may provide sufficient bit depth to be able
to uniquely identify objects within a selected environment, and may
thereby be able to represent both an identity and a location of an
object placed on interactive display device 400. This may allow for
the unique identification of an object via an optically reflective
passive tag, without the use of any RFID or optical emitters
located on the tag. For example, upon reading such an optically
reflective passive tag, interactive display device 400 may query a
database containing records linking each unique optical tag pattern
to a specific device and/or device owner to determine the device
and/or owner linked to that specific tag. In this manner,
interactive display device 400 may uniquely identify a device
detected on display screen 406 from the passive tag alone, without
any optical or electrical signal emitted by the tag.
[0057] An identification tag may also be configured to receive a
locating signal from interactive display device 400 via a second
communications channel. FIG. 8 shows a block diagram of another
embodiment of an identification tag system 800 configured to
receive a locating signal sent by interactive display device 400.
Tag system 800 comprises an RFID tag 802 with a microcontroller
803, memory 804 on which a unique identifier is stored, an RF
modulator 805, an RF antenna 806, and an optical detector 808
configured to detect an optical signal emitted by interactive
display device 400. As described above for tag system 600, tag
system 800 may be a passive device powered by an interrogating
field, or may be an active device with an on-board power
supply.
[0058] Any suitable optically sensitive structure may be used as
optical detector 808, and optical detector 808 may be configured to
receive any suitable optical signal from interactive display device
400. For example, in some embodiments, optical detector 808 may
comprise a simple color-sensitive or light-sensitive detector. In
these embodiments, interactive display device 400 may be configured
to display a selected color on display screen 406 in a location
adjacent to tag system 800, to request tag system 800 to acquire an
optical data sample from optical detector 808, and then to send the
optical data sample to interactive display device 400 via RFID tag
802 and antenna 806 (or via another wireless communications
channel). Interactive display device 400 may then compare the
optical sample to the color displayed on display screen 406 to
determine the presence and location of tag system 800 on display
screen 406. Alternatively, interactive display device 400 may
modulate a color or shades of color displayed on display screen
406, and receive an optical sample of the modulated color from tag
system 800.
[0059] Some mobile data storage devices may include an optical
detector built into the device. For example, many cell phones and
PDAs include cameras configured to capture photographic images
and/or video segments. Therefore, such a device may include
programming that allows the devices to connect wirelessly to
interactive display device 400, and to receive a locating
communication from interactive display device 400 via the use of
the on-board camera as a second communications channel.
[0060] FIG. 9 shows a block software architecture diagram 900 of an
example mobile data storage device, such as a cell phone. Software
architecture 900 includes an operating system 902, device drivers
904 which allow the operating system to interact with the hardware
components of the mobile device, and applications 906 which
interact with operating system 902 via application programming
interfaces 908.
[0061] Further, software architecture 900 includes a sharing
service 910 that allows the mobile data storage device to transfer
data to and/or from interactive display device 400. Sharing service
910 also may be configured to communicate with interactive display
device 400 via a camera or other optical detector on the mobile
data storage device.
[0062] FIG. 10 shows a process flow of an embodiment of a method
1100 for identifying a mobile data storage device 1000 detected on
a wireless network 1002 and placed on the surface of an interactive
display device 400 via a camera 1004 provided on mobile data
storage device 1000. Processes performed by interactive display
device applications 1006 are shown in a left-most portion of FIG.
10; communications between interactive display device applications
1006 and sharing service via wireless network 1002 are shown in a
left-center portion of FIG. 10; processes performed by sharing
service 910 running on device 1000 are shown in a right-center
portion of FIG. 10; and processes performed by camera 1004 are
shown in a right-most portion of FIG. 10.
[0063] Method 1100 begins at 1102 with the interactive display
device application 1006 finding all mobile data storage devices
enabled to share data with interactive display device 400.
Application 1006 may find these devices by periodically sending a
beacon over wireless network 1002, or by sending a beacon over
wireless network 1002 when an object is detected on interactive
display device 400. Next, as indicated at 1104, if sharing service
910 is enabled on a mobile device detecting the beacon, the mobile
device returns a message to display application at 1106 alerting
the display application of its presence. Processes 1102-1106 are
performed for each mobile data storage device that receives the
beacon and that has its sharing service enabled.
[0064] Next, at each detected object on the display screen 406,
interactive display device may display a unique color or image
beneath the object, as indicated at 1108. Next, as indicated at
1110, display application 1006 may direct each mobile data storage
device detected on wireless network 1002 to send a locating message
by capturing an image and sending a message related to the captured
image to the display application 1006.
[0065] Upon receipt of this instruction, sharing service 910 on
each mobile data storage device directs camera 1004 on that device
to collect an optical sample by taking a picture, as indicated at
1112. Next, as shown at 1114, camera 1004 then takes the picture
and returns the picture to sharing service 910. In some
embodiments, sharing service 910 may perform some processing of the
optical sample or may acquire data from the optical sample, such as
an average of the colors in the image, as shown at 1116.
[0066] Next, sharing service 910 sends the image, data acquired
from the image, or another such locating message related to the
image, back to display application 1006 over wireless network 1002,
as shown at 1118. Finally, as indicated at 1120, display
application 1006 can then match the image (or data acquired from
the image) to the image that was displayed under the detected
object to determine which, if any, of the mobile data storage
devices detected on wireless network 1002 corresponds to the
detected object. Where more than one object is detected on
interactive display device 400, method 1100 may also be used to
identify and locate each mobile data storage device that is placed
on interactive device and distinguish those devices from other
objects detected on interactive display device 400.
[0067] In some embodiments, interactive display device 400 may
display a timed sequence of colors under the detected object,
rather than a single color. As another alternative, interactive
display device 400 may be configured to modulate the output from
LEDs 326 and/or 426, and mobile data storage device 1000 may detect
the modulated LED output with camera 1004. Furthermore, display
application 1006 may use different techniques for choosing and
displaying the color beneath the device to determine if a color
works best for a selected device. Additionally, sharing service 910
may be configured to process the image acquired by camera 1004 to
facilitate the identification of the color displayed beneath it.
For example, such processing may include, but is not limited to,
ignoring blown highlights, ignoring areas with no color, or
clamping the color values to a specific set of colors. Likewise,
sharing service 910 may be configured to return an error message or
no response if camera 1004 is unable to see a uniform enough color.
Additionally, in some embodiments, a user may be provided with the
option of disabling the secondary communications channel to prevent
unauthorized or unintentional communication with the interactive
display device. This may provide a user with more control over
whether content from the user's device is downloaded to the
interactive display device. Furthermore, while the above-described
embodiments utilize automatic location and identification processes
to create a smooth user experience, it will be appreciated that
either a portable data storage device and/or an interactive display
device may be configured to require acknowledgement and/or
confirmation from a user before initiating a transfer of data to
the interactive display device. For example, a portable data
storage device with a passive tag, with or without a secondary
communications channel, may be configured to transmit a "confirm"
signal to the display device over a radio frequency communications
channel. This "confirm" signal may be generated in response to a
specific device action by the user (i.e. pressing a specific
button) in response to a prompt by the display device (i.e. "Press
confirm to transmit your pictures"). In this manner, data from a
user's device would be transferred to the interactive display
device only upon specific authorization by the user.
[0068] It will be appreciated that the configurations and/or
approaches described herein are exemplary in nature, and that these
specific embodiments or examples are not to be considered in a
limiting sense, because numerous variations are possible. For
example, while described herein in the context of an interactive
display device having a horizontal, table-like display surface, it
will be appreciated that the concepts described herein may also be
used with displays of any other suitable orientation, including
vertically arranged displays. Additionally, a portable data storage
device may include more than one secondary communications device.
For example, a device may include a passive optically readable tag,
an active optical or electromagnetic secondary communications
channel, and/or an on-board camera.
[0069] Furthermore, the specific routines or methods described
herein may represent one or more of any number of processing
strategies such as event-driven, interrupt-driven, multi-tasking,
multi-threading, and the like. As such, various acts illustrated
may be performed in the sequence illustrated, in parallel, or in
some cases omitted. Likewise, the order of any of the
above-described processes is not necessarily required to achieve
the features and/or results of the exemplary embodiments described
herein, but is provided for ease of illustration and
description.
[0070] The subject matter of the present disclosure includes all
novel and nonobvious combinations and subcombinations of the
various processes, systems and configurations, and other features,
functions, acts, and/or properties disclosed herein, as well as any
and all equivalents thereof.
* * * * *