U.S. patent application number 14/227605 was filed with the patent office on 2014-07-31 for interactive display system and method.
This patent application is currently assigned to Ketab Technologies Limited. The applicant listed for this patent is Ketab Technologies Limited. Invention is credited to Khaled A. Kalaldeh, Tawfeeq A. Saad Eddin.
Application Number | 20140210799 14/227605 |
Document ID | / |
Family ID | 38558181 |
Filed Date | 2014-07-31 |
United States Patent
Application |
20140210799 |
Kind Code |
A1 |
Kalaldeh; Khaled A. ; et
al. |
July 31, 2014 |
Interactive Display System and Method
Abstract
The present disclosure describes an interactive display system,
method and computer readable medium. In one embodiment, an
interactive display surface having one or more computer generated
patterns printed thereon may be utilized in conjunction with an
electronic pen in order to identify the absolute position of the
pen relative to the interactive display surface. In one embodiment,
the absolute position of the electronic pen may be transmitted to a
computer system and utilized to control one or more programs
running on the computer system. In one embodiment, the visual
output of the computer system may be superimposed upon the
interactive display surface using one or more projectors. The
computer generated patterns may have a predefined association with
a control operation of the computer system such that placing the
electronic pen in proximity to the associated generated pattern
causes the computer system to execute the associated control
operation.
Inventors: |
Kalaldeh; Khaled A.; (Amman,
JO) ; Saad Eddin; Tawfeeq A.; (Amman, JO) |
|
Applicant: |
Name |
City |
State |
Country |
Type |
Ketab Technologies Limited |
|
|
|
|
|
Assignee: |
Ketab Technologies Limited
|
Family ID: |
38558181 |
Appl. No.: |
14/227605 |
Filed: |
March 27, 2014 |
Related U.S. Patent Documents
|
|
|
|
|
|
Application
Number |
Filing Date |
Patent Number |
|
|
12314707 |
Dec 15, 2008 |
8723791 |
|
|
14227605 |
|
|
|
|
PCT/IB2007/052299 |
Jun 15, 2007 |
|
|
|
12314707 |
|
|
|
|
60804969 |
Jun 16, 2006 |
|
|
|
Current U.S.
Class: |
345/179 |
Current CPC
Class: |
G06F 3/03545 20130101;
G06F 3/0321 20130101; G06F 3/0317 20130101 |
Class at
Publication: |
345/179 |
International
Class: |
G06F 3/03 20060101
G06F003/03; G06F 3/0354 20060101 G06F003/0354 |
Claims
1. A computer implemented interactive display method comprising:
identifying an absolute position of an electronic pen relative to
an interactive display surface having one or more computer
generated patterns imprinted thereon, the electronic pen having an
infrared camera for reading the computer generated patterns upon
the interactive display surface and a processor for decoding the
patterns read by the infrared camera upon the interactive display
surface, wherein the decoded patterns indicate the absolute
position of the electronic pen with respect to the interactive
display surface; and wherein the electronic pen further comprises
an inkless stylus.
2. The computer implemented method of claim 1, wherein one or more
of the computer generated patterns imprinted on the interactive
display surface have a predefined association with a control
operation of a computer system in communication with the electronic
pen such that placing the electronic pen in proximity to the
associated generated pattern causes the computer system to execute
the associated control operation.
3. The computer implemented method of claim 2, further comprising:
generating a hyperlink between the computer generated pattern and
the associated control operation; and activating the hyperlink to
execute the associated control operation.
4. The computer implemented method of claim 2, further comprising
superimposing a visual output of the computer system upon the
interactive display surface using one or more projectors.
5. The computer implemented method of claim 1, wherein the
interactive display surface is substantially transparent.
6. The computer implemented method of claim 1, wherein the
interactive display surface is substantially flexible.
7. The computer-implemented method of claim 1, wherein the
interactive display surface further comprises a substantially
transparent anti-reflective layer.
8. An interactive display system comprising: a computer processor
operative to: identify an absolute position of an electronic pen
relative to an interactive display surface having one or more
computer generated patterns imprinted thereon, the electronic pen
having an infrared camera for reading the computer generated
patterns upon the interactive display surface and a processor for
decoding the patterns read by the infrared camera upon the
interactive display surface, wherein the decoded patterns indicate
the absolute position of the electronic pen with respect to the
interactive display surface; and wherein the interactive display
surface further comprises a magnetic adhesive.
9. The system of claim 8, wherein one or more of the computer
generated patterns imprinted on the interactive display surface
have a predefined association with a control operation of a
computer system in communication with the electronic pen such that
placing the electronic pen in proximity to the associated generated
pattern causes the computer system to execute the associated
control operation.
10. The system of claim 9, wherein the processor is operative to
superimpose a visual output of the computer system upon the
interactive display surface using one or more projectors.
11. The system of claim 10, wherein the processor is operative to
identify a scale of the computer system visual output and adjust
the scale of the interactive display surface to substantially match
the scale of the computer system visual output.
12. The system of claim 10, wherein the processor is operative to
identify dimensions of the computer system visual output and adjust
the dimensions of the interactive display surface to substantially
match the dimensions of the computer system visual output.
13. The system of claim 8, wherein the electronic pen further
comprises a microphone for capturing audio information.
14. The system of claim 8, wherein the electronic pen further
comprises an audio receiver for transmitting audio information.
15. A non-transitory computer readable medium for providing an
interactive display comprising instructions which, when executed,
cause a computing device to: identify an absolute position of an
electronic pen relative to an interactive display surface having
one or more computer generated patterns imprinted thereon, the
electronic pen having an infrared camera for reading the computer
generated patterns upon the interactive display surface and a
processor for decoding the patterns read by the infrared camera
upon the interactive display surface, wherein the decoded patterns
indicate the absolute position of the electronic pen with respect
to the interactive display surface; and wherein the interactive
display surface further comprises a magnetic adhesive.
16. The computer readable medium of claim 15, wherein one or more
of the computer generated patterns imprinted on the interactive
display surface have a predefined association with a control
operation of a computer system in communication with the electronic
pen such that placing the electronic pen in proximity to the
associated generated pattern causes the computer system to execute
the associated control operation.
17. The computer readable medium of claim 16, wherein the
interactive display surface is shaped to resemble a keyboard and
wherein the control operation comprises one or more keyboard
functions.
18. The computer readable medium of claim 17, wherein the
interactive display surface further comprises one or more thumbnail
images, each thumbnail image resembling a keyboard button.
19. The computer readable medium of claim 16, wherein the
interactive display surface is shaped to resemble a mouse pad and
wherein the control operation comprises one or more mouse
functions.
20. The computer readable medium of claim 16, wherein the
interactive display surface is shaped to resemble a color palette
and wherein the control operation comprises one or more color
palette functions.
Description
CROSS REFERENCE TO RELATED APPLICATIONS
[0001] This application claims priority upon and is a continuation
of co-pending U.S. Patent Application No. 2009/0213070, Ser. No.
12/314,707, filed on Dec. 15, 2008; which is a continuation-in-part
of PCT Application Number PCT/1B2007/052299, filed on Jun. 15,
2007; which claims priority upon U.S. Provisional Patent
Application No. 60/804,969, filed on Jun. 16, 2006. The entire
contents of the above applications are incorporated by reference
herein.
BACKGROUND
[0002] This disclosure relates to the field of micro-processor
based interactive display systems and to such systems which utilize
position coded patterns and position sensing devices in association
with projection based display apparatus to facilitate user
interaction with computer based applications and programs.
[0003] `Whiteboards` have become commonplace visual communication
aids which may be found in school classrooms, presentation theaters
and work places. Standard whiteboards may comprise a rigid surface
which is readily available for writing on with erasable marker pens
termed `dry-wipe` markers.
[0004] In recent years, the introduction of so called `interactive
whiteboards` has provided a link between the visual based
presentation of information using the standard whiteboard and the
functionality of the ubiquitous personal computer. Consequently,
interactive whiteboards are the natural successors to standard
whiteboards and can provide a powerful communication tool which can
serve as a gateway for any environment, including the workplace and
also for learning ecosystems worldwide known as e-learning in which
digital mediums are heavily employed for enhanced learning and
communication.
[0005] FIG. 1 illustrates an example interactive whiteboard whereby
a projection screen combined with spatial interaction becomes an
interactive whiteboard when operating with a projector.
[0006] Known interactive whiteboard display systems make use of a
specially manufactured surface which acts as the means for
detecting the position of special interactive whiteboard pens,
erasers, stylus, pointers and associated visual presentation aid
tools (collectively referred to hereinafter as `interactive
whiteboard pens`), which may be used in association with an
interactive whiteboard for instructing, presenting, teaching,
writing, pointing, selecting, activating and drawing.
[0007] Due to the `interactive whiteboard pen` position sensing
technology employed by known interactive whiteboard systems, they
may be referred to generally in the art as `touch based,` and may
include a display or screen arrangement having a touch sensitive
surface on which contacts are made using an interactive whiteboard
pen.
[0008] A projector arrangement may be connected to a host personal
computer (`PC`) and used to project an image taken from a program
running on the host PC, thereafter the interaction between the
inputs and movements made using the interactive whiteboard pen and
the PC may be conducted via connection between the interactive
whiteboard itself and the PC. Such connections may include wired
and/or wireless communication arrangements.
[0009] The special construction and surface of the interactive
whiteboard may ultimately provide the link between the relative
movements of an interactive whiteboard pen and the associated
functions which are to be controlled or activated on a host PC.
[0010] Pointer contact with such a touch surface may be detected
and used to generate corresponding output depending on areas of the
touch surface where the contacts are made. It is this surface based
coordinate-detecting technology that characterizes the
functionality of interactive whiteboard systems and inherently
dictates their physical and functional limitations.
[0011] Such interactive whiteboard surfaces may utilize analog
resistive, electromagnetic, capacitive, acoustic or machine vision
properties to identify the relative position of contact of the
interactive whiteboard pen on the surface of the whiteboard, and
thereafter the required positional information may be transmitted
to the host PC thereby providing the required association between
an image projected from the host PC on to the surface of the
interactive whiteboard and the function(s) associated with the
interactive whiteboard pen (i.e., color, erasing capacity,
selection of particular icon based functions, etc).
[0012] Consequently, due to the available technology employed by
known systems, the associated physical dimensions of interactive
whiteboards such as that offered under the trademark
Smartboard.TM., can reach circa 30 mm in thickness, and in addition
require dedicated interactive whiteboard pens to provide the
functionality required to represent different colors when writing
`electronically` on the interactive whiteboard surface.
[0013] The physical limitations of known interactive whiteboard
systems relate to the specific requirement to use a dedicated
interactive whiteboard display surface that is fixed to a solid
wall or other surface (i.e., presentation theater, etc.) or
alternately mounted on a moveable frame system for transportation
between classrooms, offices, etc.
[0014] Consequently, by their very nature, such systems are not
readily moveable or transportable due to the weight and physical
size associated with the pointer detection technology comprised
therein.
[0015] Other limitations of known interactive whiteboard systems
relate to the requirement to use front illumination based methods
to project images onto the surface of the whiteboard due to the
thickness and non-transparent nature of the surface based sensing
technology comprising the underlying pointer detection apparatus.
This limitation thereby introduces the possibility of shadows being
cast across the projected image on the interactive whiteboard
surface by those using the system.
[0016] Hand writing may be digitally stored in a computer via
special pens that transcribe hand motion, usually called automatic
transcription, and the resulting image transferred into the
computer for handwriting recognition and archiving
applications.
[0017] This functionality may be achieved using enabling
technologies comprised in a holding, writing and/or pointing pen
arrangement (hereinafter referred to as `electronic pens`), in
which displacement of the electronic pen tip is detected and
measured accordingly. The enabling technologies utilized in known
`electronic pens` for detecting and measuring pen movement include,
but are not limited to, mechanical accelerometers, gyroscopes and
optical pattern recognition apparatus and ultrasound transducers,
all configured to detect displacement of the electronic pen, and
typically the tip of said pen.
[0018] Technology employed for the automatic recognition and
computer based storage of handwriting may utilize a special pen
equipped with a vision based sensor, and paper typically known in
the art as `digital paper,` the surface of which is covered with a
position coded pattern (hereinafter referred to as a `PCP`), that
can provide unique respective (x, y) positions on the paper. When
an electronic pen equipped with such a vision based sensor and a
processor passes above such paper, a processor may be utilized to
decode the captured image of the pattern on the paper, and
thereafter the associated system can determine the resulting
coordinates, translate them into a specific location in an
electronic document via the transmission of data to a computer via
a wired and/or wireless connection.
SUMMARY
[0019] The present disclosure describes a novel interactive
whiteboard system utilizing an electronic reading pen to interact
with a host PC via an image from the host PC projected onto any
surface, the surface may include a position coded pattern to
provide specific location information and an associated host PC for
providing information relating to the position of the electronic
reading pen relative to the projected image.
[0020] The present disclosure describes a method of controlling an
interactive display system utilizing a processor and an electronic
reading pen in conjunction with position coded pattern surface
technology.
[0021] In one embodiment, the system described herein enables a
user to view the image of a host computer screen projected onto any
surface comprising a position coded pattern (PCP), and thereafter
to interact with the various functions and programs available and
on the host computer via the use of an `electronic reading pen` by
using the pen in the manner of a touch screen device on the PCP
surface onto which said image is projected.
[0022] Accordingly, in one embodiment, a desktop icon projected
from a host PC onto a PCP surface can thereafter be selected by
using an `electronic reading pen,` and the particular functions or
programs associated with the icon on the computer screen can be
selected and ultimately activated. By utilizing this novel
functionality, a multitude of computer applications can be opened
and manipulated via the interaction of an electronic reading pen
with any surface comprising a PCP.
[0023] The application software in the personal computer may be
designed to interpret and perform operations in accordance with
inputs received from the electronic pen and accordingly the action
of pointing and/or touching the electronic reading pen on the PCP
display surface, the host personal computer can be controlled to
perform all of its operational functions, including but not limited
to opening and display menus, activating programs, dragging icons,
writing, executing, operating and interacting with software.
[0024] In one embodiment, the system may utilize an electronic
reading pen, and a PCP (position coded pattern) projection surface
which can be fixedly or releasably attached onto a surface such as
a wall, board, whiteboard or other suitable screen arrangement. The
electronic reading pen may comprise a position decoding device in
association with other functional elements and embodiments, a
camera arrangement such a CCD device or any other visual
recognition arrangement capable of recognizing the PCP employed,
and an embedded processor capable of interpreting the PCP beneath
the pen head when the projection surface is at a finite distance
from the engaging head.
[0025] The PCP surface may be comprised of a suitably durable
projection material capable of conveying information about a unique
position encoded in the printed pattern, of which the recognition,
interpretation, processing and subsequent transmission to a host PC
may be carried out by the systems onboard the electronic reading
pen.
[0026] Accordingly the actual tip position of an electronic pen on,
or over, a PCP display surface can be established by an electronic
recording pen in accordance with the invention. The relative (x, y)
coordinates of the electronic pen tip may thereby be established
with reference to the display image on the host computer, and
thereafter the electronic reading pen can be used to interact with
projected images provided by the host computer.
[0027] To acquire the pen tip position from the PCP surface, it is
appreciated that when the pen tip touches the surface such event
enables a special sensing device such as infrared charge-coupled
device camera (CCD) in the pen head to read the PCP surface for
subsequent interpretation.
[0028] An electronic recording pen may be equipped with a real-time
processor to decode the information contained in the PCP surface
pattern to establish sets of predetermined (x, y) coordinates
embedded within the pattern itself.
[0029] Further, a real-time processor may work simultaneously to
decode the (x, y) coordinates which are sent via wireless
communication or the like to a host PC which may be attached to a
projector.
[0030] To facilitate the coordination and calibration of the
projected image with that of the image displayed in the host PC, a
user may be required to point to and/or touch the electronic
recording pen on to predetermined points on the PCP display
surface. These actions may provide for the calibration of the
relative coordinates of the image projected on the PCP display
surface with that of the image on the host PC to ensure that the
dimensions and scale of projected image are in proportion to the
image on the associated host PC screen and are thereby understood
by the electronic recording pen to host PC interface program. Any
suitable position dependent automatic transcription technology may
be utilized by the system.
[0031] After proper calibration the electronic recording pen-to-PCP
system operation may indicate the exact position as the electronic
recording pen-tip position on the projected view on the surface to
be the same as that of the mouse cursor on the host PC display
screen.
[0032] According to a further embodiment, there is provided an
interactive display system that can be produced by printing a
position-coded pattern on a suitable substrate.
[0033] An object of the present disclosure is to provide an
interactive display system for transforming PCP projection surface
locations into interactive areas with an electronic reading
pen.
[0034] Another object is to provide an interactive display system
that provides an interactive display surface to work in conjunction
with a projector.
[0035] Another object is to provide an interactive display system
that has a display surface that is easily manufactured with regular
wide-format printers or other printing facilities.
[0036] Another object is to provide an interactive display system
that utilizes the streaming of real-time wireless location data via
an electronic reading pen.
[0037] Another object is to provide an interactive display system
that is capable of transforming various sizes, styles and types of
surfaces/display screens into interactive facades.
[0038] Another object is the provision of an interactive display
system that employs physical shortcuts that can be used to access
computer applications via the use of PCP media separate from the
PCP display arrangement for which functions on the host PC have
been pre-assigned.
[0039] Another object is to provide an interactive display system
that is lightweight, portable and compact.
[0040] Another object is to provide an interactive display system
that does not interfere with rear projection light due to the
possibility to utilize a transparent PCP substrate.
[0041] Another object is to provide an interactive touch screen
that utilizes a transparent PCP surface and an invisible pattern
like UV or other invisible ink type.
[0042] Another object is to provide a wireless mouse pad comprised
of a regular size mouse pad having PCP on its surface and functions
with an electronic reading pen.
[0043] Another object is to provide an interactive display system
that may be utilized as a sticker roll or as a rigid projection
surface and may be provided with a releasable contact medium such
as adhesive tape or glue, magnets, fastening surfaces such as
Velcro.TM. and the like.
BRIEF DESCRIPTION OF THE DRAWINGS
[0044] A more complete appreciation of the invention and many of
the attendant advantages thereof will be readily obtained as the
same becomes better understood by reference to the following
detailed description when considered in connection with the
accompanying drawings; it being understood that the drawings
contained herein are not necessarily drawn to scale; wherein:
[0045] FIG. 1 is an explanatory diagram of the concept of
interactive whiteboards.
[0046] FIG. 2 is a workflow diagram illustrating the operation of
interactive whiteboards.
[0047] FIG. 3A is a side view of an example classroom operation
setup in front projection mode.
[0048] FIG. 3B is a front view of an example classroom operation
setup using front projection.
[0049] FIG. 4A is a side view of a rear projection example.
[0050] FIG. 4B is a front view of a rear projection example.
[0051] FIG. 5A is a bisection and front perspective view of a
projection layer of an example PCP surface using rear
projection.
[0052] FIG. 5B is a bisection and front perspective view of a
projection layer of an example PCP surface using front
projection.
[0053] FIG. 6 is a sticker roll version of an example PCP
interactive whiteboard.
[0054] FIG. 7 is an example packaging configuration.
[0055] FIG. 8 is a set view of various example pattern types.
[0056] FIG. 9A is a diagram illustrating the main components of an
example electronic reading pen.
[0057] FIG. 9B is an exploded view of the internal anatomy of an
example electronic reading pen.
[0058] FIG. 10A is an illustration of a digital pen evaluation
kit.
[0059] FIG. 10B is a snapshot of a computer desktop showing an
example software driver.
[0060] FIG. 11A illustrates an example set of physical
shortcuts.
[0061] FIG. 11B shows an example pen utilized in conjunction with a
physical shortcut.
[0062] FIG. 11C is an example painting and drawing palette physical
shortcut.
[0063] FIG. 11D illustrates an example portable PCP mouse pad.
[0064] FIG. 11E illustrates an example set of physical
shortcuts.
[0065] FIG. 12 is an example PCP printed keyboard physical
shortcut.
[0066] FIG. 13A illustrates an example pen where the stylus head
has been removed from the pen nozzle.
[0067] FIG. 13B illustrates a stainless stylus pen head 1 and an
ink cartridge ball-point pen head 2.
[0068] FIG. 14A illustrates an example PCP surface.
[0069] FIG. 14B illustrates a user writing on an example PCP
surface with an example electronic pen.
DESCRIPTION
[0070] An interactive display system, an interactive display method
and a computer readable medium for providing an interactive display
is described herein. In one embodiment, an interactive display
system is provided which comprises a PCP projection surface and an
electronic reading pen capable of reading the PCP from the display
screen.
[0071] The projection surface may be comprised of a suitable
projection material capable of displaying the projector images when
a projector is placed at suitable distance away from the
screen.
[0072] The electronic reading pen may comprise a CCD infrared
camera that can capture details of the PCP (up to 70 frames/second
for example). Thereafter, the electronic reading pen may be capable
of passing image shots to a decoding processor inside the pen that
decodes the pattern image information and outputs absolute (x, y)
position data, that is without a (0, 0) reference relevant to the
image the pen camera is observing from the pattern.
[0073] When using a front projection interactive whiteboard display
system in accordance with the invention, an example setup is shown
in FIGS. 3A and 3B. Such a setup may include a host PC for
controlling the display process and operating applications and a
front projector for projecting images from the host PC to the PCP
encoded display screen with which the user will interact using an
electronic reading pen.
[0074] Similarly, when adopting a rear projection setup as shown in
FIGS. 4A and 4B, the projector may be located behind a
semi-transparent PCP encoded printed surface. When utilizing a rear
projection based display setup, it is known in the art of rear
projection film projectors and the like project the image via the
use of reflecting mirrors. Previously such a system has not been
possible when utilizing known interactive display systems due to
the requirement for the interaction between the electronic pen and
the whiteboard to be controlled via touch based sensing technology
which is inherently opaque.
[0075] The use of a rear projection setup provides a unique benefit
due to the fact that the functionality of an interactive whiteboard
display can be utilizing with the added benefit for user experience
since the user cannot interfere with the projected incident light
projecting the image onto the screen which is coming usually from a
front position projector.
[0076] An example of the construction of a PCP surface is shown in
FIG. 5B. This diagram illustrates the composition constructed of
three layers, the base layer providing a supporting substrate, the
middle layer carrying the PCP surface and the top or front layer
providing a protective layer for the assembly.
[0077] A similar arrangement for a rear PCP surface is shown in
FIG. 5A, with the distinction being that the supporting substrate
may be a perimeter frame or transparent rigid surface with the PCP
surface printed onto a semitransparent surface material.
[0078] The writing surface may be in the form, but not limited to,
a contact paper-like substrate which can be provided with a
sticker-like, self-adhesive, or magnetic property on its front or
back surface for simple adherence to a surface of choice.
[0079] The electronic reading pen tip (e.g., a sensor), can be made
pressure sensitive to confirm that the pen tip is actually in touch
with the surface and to therefore initiate the reading, storage and
processing of respective (x, y) coordinates from the PCP display
surface.
[0080] By decoding the position of the pen tip in substantially
real time, a moving electronic reading pen tip in touch with the
display surface will generate a sequence of (x, y) coordinates
indicative of the instantaneous pen tip location on the PCP
surface. The read coordinates are thereafter passed in real-time to
the host PC, in effect the pen acting as a typical interactive
computer mouse.
[0081] As such the electronic reading pen can be configured to send
control signals such as `double clicking,` `right and left clicks,`
and such commands can be initiated either from buttons positioned
upon the pen body, or alternatively by double click sensing signals
being received by and processed by appropriate sensors integrated
into the pen tip.
[0082] Such commands can therefore be used to control computer
applications on the host PC in a manner substantially identical to
that associated with the use of a standard computer mouse.
[0083] In a further embodiment of the invention, the electronic
reading pen may be designed to capture audio inputs and transmit
them via wired and/or wireless communication to the host PC wherein
the audio inputs may be processed and recognized by the host PC as
inputs or commands in relation to a computer program such as a word
processing application or the like. Accordingly, a user can utilize
the electronic reading pen to interact with applications running on
a host PC to input words, letters or commands such that the words,
letters or commands may to be displayed on the screen, display,
writing surface and/or other surface. Further, the captured audio
inputs may be processed by processor(s) within or connected to the
electronic reading pen and thereafter transmitted to said host
PC.
[0084] The electronic reading pen may be equipped with a microphone
and wireless Internet adapter (e.g., 802.11a/b or Wi-Fi), which
would enable the pen, with some particular software installed on
it, to transfer spoken voice in real time using for example, Voice
over Internet Protocol (VoIP) technology, without the need for
storing the voice in the pen's memory.
[0085] Matching calibration of the position coded pattern (PCP)
display screen with the actual computer screen scale may be
undertaken so that inputs received from the electronic reading pen
when the pen's tip is pointing at a specific location on the PCP
surface (e.g., double clicking on a save button), may be
interpreted as a command that matches an action initiated due to
pointing on the region of interest on the computer application
screen.
[0086] Calibration commands may take place at the intended
respective location of the pen tip superimposed on the application
being projected on the PCP screen to enable command actions to be
executed.
[0087] FIG. 8 illustrates example position coding patterns to be
printed on the projection surface and FIGS. 9A and 9B illustrate
example electronic pens.
[0088] Any suitable PCP may be utilized as illustrated in FIG. 8.1.
The PCP pattern may be comprised of small dots placed in a pattern
that follows a certain algorithmic theme which, when decoded,
reveals unique information about absolute position in (x, y)
coordinates as shown in FIG. 8.2.
[0089] Other PCP patterns capable of being printed or deposited
onto any display surface may be employed, including, but not
limited to the Xerox data glyph pattern shown at FIGS. 8.3 and 8.4,
and other patterns, such as those produced by Microsoft.RTM. shown
at FIGS. 8.5 and 8.6.
[0090] Such position coding pattern families may utilize an
algorithm that can generate and distribute a pattern in a way that
decodes position information over the surface on which the pattern
is to be applied or printed.
[0091] As to the processes used to decode PCP encoded information,
FIG. 9A shows an example of a reading pen produced by Anoto.RTM..
This electronic reading pen has the function of decoding the
encoded position information embedded in an Anoto.RTM. PCP pattern.
To perform this function, the pen comprises two functional
principles which in a sense function as the eyes and brain of the
pen. The two functions are accomplished through the use of an
infrared CCD camera to read the dot pattern of the PCP, and a
processor to decode the images being read by this camera.
[0092] The decoded (x, y) position information may be sent in
real-time (i.e. simultaneously whilst being decoded), to a computer
via wireless transmission.
[0093] FIG. 9A shows the streaming `data sending` light flickering
on an example Maxell.RTM. DP-201 R4.1 electronic reading pen which
indicates that the pen is in action while operating on a physical
shortcut defined by a user. FIG. 9B shows a semi exploded view of
an example Anoto.RTM. compatible electronic reading pen, namely the
DP-201 R 4.1 streaming pen.
[0094] FIG. 10A illustrates another electronic reading pen, such as
those produced by Maxell.RTM. or Logitech.RTM., which supports
additional functional components, including a pressure sensitive
pen tip, storing memory chip, a vibrator to provide physical
shaking feedback to a user, and a Bluetooth.RTM. antenna for
wireless data transmission and reception.
[0095] In FIG. 10B, the driver software associated with the
Maxell.RTM. DP-201 R 4.1 is shown. The example driver software
contains a reading port for SPP Bluetooth.RTM. service to enable
connection to the electronic reading pen via Bluetooth.RTM. (FIG.
10B). In addition, the driver contains a task bar for performing
functions such as calibration, onscreen reading and mode switching
(FIG. 10B).
[0096] Another embodiment provides at least one physical shortcut
virtual button shown in FIGS. 11A-11E. These may be provided by
utilizing small areas of PCP printed on paper, or any appropriate
surface) with a desired thumbnail picture printed thereon.
[0097] The driver software may be configured to recognize specific
addresses allocated by programming for these physical shortcuts to
linking them to specific functions inside applications or to run
whole applications when selected (i.e. by clicking) using the
electronic reading pen.
[0098] FIG. 11D shows a mouse pad that can be used to remotely
control a PC screen projected on a wide PCP surface or any other
surface. In FIG. 11C, a color palette may be utilized as a set of
physical shortcuts to brush colors in host PC based programs and
applications such as Microsoft Paint.RTM..
[0099] An additional extension to the concept of physical shortcuts
is that relating a real physical entity to cyberspace items by
hyper-linking the two. One example of this principle is illustrated
as a printed keyboard shown in FIG. 12.
[0100] In FIGS. 14A and 14B, an embodiment is shown affixed to a
wall with the words `position coded pattern` written with the
electronic reading pen on the PCP surface using the program
Smart.TM. Notebook running on the host PC.
[0101] Although the invention has been described with reference to
specific embodiments, this description is not meant to be construed
in a limited sense. Various modifications of the disclosed
embodiments, as well as alternative embodiments of the invention,
will become apparent to persons skilled in the art upon reference
to the description of the invention. It is, therefore, contemplated
that the appended claims will cover such modifications that fall
within the scope of the invention.
* * * * *