U.S. patent application number 13/525614 was filed with the patent office on 2013-11-14 for audio feedback.
The applicant listed for this patent is Paul Henry Dietz, Moshe R. Lutz. Invention is credited to Paul Henry Dietz, Moshe R. Lutz.
Application Number | 20130300590 13/525614 |
Document ID | / |
Family ID | 49548213 |
Filed Date | 2013-11-14 |
United States Patent
Application |
20130300590 |
Kind Code |
A1 |
Dietz; Paul Henry ; et
al. |
November 14, 2013 |
Audio Feedback
Abstract
Audio feedback techniques are described. In one or more
implementations, a signal is received from a pressure sensitive key
of an input device and audio feedback is determined, from the
signal, which is to be output as corresponding to the pressure
sensitive key. The determined audio feedback is then caused to be
output.
Inventors: |
Dietz; Paul Henry; (Redmond,
WA) ; Lutz; Moshe R.; (Bellevue, WA) |
|
Applicant: |
Name |
City |
State |
Country |
Type |
Dietz; Paul Henry
Lutz; Moshe R. |
Redmond
Bellevue |
WA
WA |
US
US |
|
|
Family ID: |
49548213 |
Appl. No.: |
13/525614 |
Filed: |
June 18, 2012 |
Related U.S. Patent Documents
|
|
|
|
|
|
Application
Number |
Filing Date |
Patent Number |
|
|
61646799 |
May 14, 2012 |
|
|
|
Current U.S.
Class: |
341/34 |
Current CPC
Class: |
G06F 3/04886 20130101;
G06F 1/1669 20130101; G06F 11/3051 20130101; G06F 13/4068 20130101;
G06F 2203/04809 20130101; Y02D 10/151 20180101; G06F 13/4291
20130101; G06F 1/3296 20130101; G06F 9/4415 20130101; G06F 11/328
20130101; G06F 3/167 20130101; Y02D 10/00 20180101; G06F 3/0202
20130101; Y02D 10/14 20180101 |
Class at
Publication: |
341/34 |
International
Class: |
H03M 11/00 20060101
H03M011/00 |
Claims
1. A method comprising: receiving a signal from a pressure
sensitive key of an input device; determining audio feedback, from
the signal, that is to be output as corresponding to the pressure
sensitive key; and causing output of the determined audio
feedback.
2. A method as described in claim 1, wherein the input device
includes a plurality of said pressure sensitive keys and the
determining is performed such that audio feedback that is
determined as corresponding to a first said key is different than
audio feedback that is determined as corresponding to a second said
key.
3. A method as described in claim 2, wherein the first said key
corresponds to a letter or number and the second said key does
not.
4. A method as described in claim 1, wherein the determining is
based at least in part on an amount of pressure indicated by the
signal to select a volume or timbre for the audio feedback.
5. A method as described in claim 1, wherein the causing of the
output of the determined audio feedback is performed such that
sound of the determined audio feedback appears to originate from a
location of the pressure sensitive key on the input device to a
user that pressed the pressure sensitive key.
6. A method as described in claim 5, wherein the causing takes into
account a likely position of the user with respect to the pressure
sensitive key.
7. A method as described in claim 6, wherein the likely position of
the user is detected dynamically using one or more sensors.
8. A method as described in claim 1, wherein the determining is
performed such that audio feedback is based at least in part on
which part of the pressure sensitive key is pressed.
9. A method as described in claim 8, wherein audio feedback that is
determined for a press that is proximal to a center of the pressure
sensitive key is different than audio feedback that is determined
for a press that is proximal to an edge of the pressure sensitive
key.
10. A method as described in claim 1, wherein the determining is
based at least in part on an environment in which the input device
is located.
11. A method as described in claim 10, wherein the determining is
based on a detected ambient noise level in the environment.
12. A method as described in claim 1, wherein the determining is
based at least in part on characteristics of an application that is
executed on a computing device that is communicatively coupled to
the input device.
13. A system comprising one or more modules implemented at least
partially in hardware and configured to cause output of audio
feedback that is determined based on a location at which a key of a
keyboard is pressed.
14. A system as described in claim 13, wherein the keyboard is a
pressure sensitive keyboard.
15. A system as described in claim 13, wherein the one or more
modules are configured to determine audio feedback for a press at a
first location of the key that is different than audio feedback
that is determined for a press at a second location of the key that
is different than the first location of the key.
16. A system as described in claim 13, wherein the one or more
modules are configured to further provide audio feedback that is
indicative of location of one or more fingers of a user's hand on a
home row of a keyboard that includes a plurality of said keys.
17. A keyboard comprising a plurality of keys, each configured to
be selected using one or more fingers of a user's hand and to cause
output of audio feedback responsive to the selection, the output of
the audio feedback configured to appear to the user as originating
from a location of a respective said key.
18. A keyboard as described in claim 17, wherein the output of the
audio feedback is performed using a plurality of audio output
devices that are not positioned at the location of the respective
said key.
19. A keyboard as described in claim 17, wherein the output of the
audio feedback is caused to be performed by a computing device that
is communicatively coupled to the keyboard.
20. A keyboard as described in claim 17, wherein the output of the
audio feedback is modeled according to a head transfer function.
Description
RELATED APPLICATIONS
[0001] This application claims priority under 35 U.S.C. Section
119(e) to U.S. Provisional Patent Application No. 61/646,799, filed
May 14, 2012, the disclosure of which is hereby incorporated by
reference in its entirety, this application also incorporates the
following applications by reference in their entirety: U.S. patent
application Ser. No. 13/470,633, filed May 14, 2012, Attorney
Docket Number 336554.01, and titled "Flexible Hinge and Removable
Attachment;" and U.S. patent application Ser. No. 13/471,186, filed
May 14, 2012, Attorney Docket Number 336563.01, and titled "Input
Device Layers and Nesting."
BACKGROUND
[0002] Mobile computing devices have been developed to increase the
functionality that is made available to users in a mobile setting.
For example, a user may interact with a mobile phone, tablet
computer, or other mobile computing device to check email, surf the
web, compose texts, interact with applications, and so on. However,
traditional mobile computing devices often employed a virtual
keyboard that was accessed using touchscreen functionality of the
device. This was generally employed to maximize an amount of
display area of the computing device.
[0003] Use of the virtual keyboard, however, could be frustrating
to a user that desired to provide a significant amount of inputs,
such as to enter a significant amount of text to compose a long
email, document, and so forth. Thus, conventional mobile computing
devices were often perceived to have limited usefulness for such
tasks, especially in comparison with ease at which users could
enter text using a conventional keyboard, e.g., of a conventional
desktop computer. Use of the conventional keyboards, though, with
the mobile computing device could decrease the mobility of the
mobile computing device and thus could make the mobile computing
device less suited for its intended use in mobile settings.
SUMMARY
[0004] Audio feedback techniques are described. In one or more
implementations, a signal is received from a pressure sensitive key
of an input device and audio feedback is determined, from the
signal, which is to be output as corresponding to the pressure
sensitive key. The determined audio feedback is then caused to be
output.
[0005] In one or more implementations, a keyboard comprises a
plurality of keys, each configured to be selected using one or more
fingers of a user's hand and to cause output of audio feedback
responsive to the selection, the output of the audio feedback
configured to appear to the user as originating from a location of
a respective key.
[0006] In one or more implementations, a system comprises one or
more modules implemented at least partially in hardware and
configured to cause output of audio feedback that is determined
based on a location at which a key of a keyboard is pressed.
[0007] This Summary is provided to introduce a selection of
concepts in a simplified form that are further described below in
the Detailed Description. This Summary is not intended to identify
key features or essential features of the claimed subject matter,
nor is it intended to be used as an aid in determining the scope of
the claimed subject matter.
BRIEF DESCRIPTION OF THE DRAWINGS
[0008] The detailed description is described with reference to the
accompanying figures. In the figures, the left-most digit(s) of a
reference number identifies the figure in which the reference
number first appears. The use of the same reference numbers in
different instances in the description and the figures may indicate
similar or identical items. Entities represented in the figures may
be indicative of one or more entities and thus reference may be
made interchangeably to single or plural forms of the entities in
the discussion.
[0009] FIG. 1 is an illustration of an environment in an example
implementation that is operable to employ the techniques described
herein.
[0010] FIG. 2 depicts an example implementation of an input device
of FIG. 1 as showing a flexible hinge in greater detail.
[0011] FIG. 3 depicts an example implementation showing a
perspective view of a connecting portion of FIG. 2 that includes
mechanical coupling protrusions and a plurality of communication
contacts.
[0012] FIG. 4 depicts an example of a cross-sectional view of a
pressure sensitive key of a keyboard of the input device of FIG.
2.
[0013] FIG. 5 depicts an example of a pressure sensitive key of
FIG. 4 as having pressure applied at a first location of a flexible
contact layer to cause contact with a corresponding first location
of a sensor substrate.
[0014] FIG. 6 depicts an example of the pressure sensitive key of
FIG. 4 as having pressure applied at a second location of the
flexible contact layer to cause contact with a corresponding second
location of the sensor substrate.
[0015] FIG. 7 depicts an example of the input device and computing
device of FIG. 1 as leveraging an audio feedback module.
[0016] FIG. 8 depicts an example of FIG. 8 depicts an example
implementation showing one of more fingers of a user's hands as
interacting with an input device of FIG. 2, thereby initiating
output of audio feedback.
[0017] FIG. 9 depicts an example of showing presses at different
locations of a key that may be used to cause output of different
audio feedback.
[0018] FIG. 10 is a flow diagram depicting a procedure in an
example implementation in which a determination is made as to which
audio feedback is to be output responsive to receipt of a signal
from a pressure sensitive key.
[0019] FIG. 11 illustrates an example system including various
components of an example device that can be implemented as any type
of computing device as described with reference to FIGS. 1-10 to
implement embodiments of the techniques described herein.
DETAILED DESCRIPTION
Overview
[0020] Input devices used by a mobile device may be difficult to
interact with due to compromises made in configuring the input
device to support the mobile form factor of the device. For
example, pressure sensitive keys may be used as part of an input
device to support a relatively thin form factor, such as
approximately less than three and a half millimeters. However,
pressure sensitive keys may not provide a degree of feedback that
is common with conventional mechanical keyboards and therefore may
result in missed hits and partial hits to intended keys of the
keyboard. In another example, a virtual keyboard that is displayed
by a display device of the computing device may have similar
difficulties.
[0021] Audio feedback techniques are described. These techniques
may be used to provide audio feedback responsive to user
interaction with an input device. For example, these techniques may
be used to output different sounds for different keys, sounds
dependent on where a key is pressed, sounds that appear to
originate from a key that is being pressed, adjustment based on
environment, adjustment based on how hard the key is pressed (e.g.,
timbre, volume), support themes that are user selectable for
different sounds, provide audio feedback to indicate when one or
more fingers of the user's hand are positioned at a home row of a
keyboard, and so on. Thus, the audio feedback techniques may
support a variety of functionality for a variety of different input
device, such as pressure sensitive keyboards, virtual keyboards,
mechanically switched keyboards, and other input devices, further
discussion of which may be found in relation to the following
figures.
[0022] In the following discussion, an example environment is first
described that may employ the techniques described herein. Example
procedures are then described which may be performed in the example
environment as well as other environments. Consequently,
performance of the example procedures is not limited to the example
environment and the example environment is not limited to
performance of the example procedures.
Example Environment
[0023] FIG. 1 is an illustration of an environment 100 in an
example implementation that is operable to employ the techniques
described herein. The illustrated environment 100 includes an
example of a computing device 102 that is physically and
communicatively coupled to an input device 104 via a flexible hinge
106. The computing device 102 may be configured in a variety of
ways. For example, the computing device 102 may be configured for
mobile use, such as a mobile phone, a tablet computer as
illustrated, and so on. Thus, the computing device 102 may range
from full resource devices with substantial memory and processor
resources to a low-resource device with limited memory and/or
processing resources. The computing device 102 may also relate to
software that causes the computing device 102 to perform one or
more operations.
[0024] The computing device 102, for instance, is illustrated as
including an input/output module 108. The input/output module 108
is representative of functionality relating to processing of inputs
and rendering outputs of the computing device 102. A variety of
different inputs may be processed by the input/output module 108,
such as inputs relating to functions that correspond to keys of the
input device 104, keys of a virtual keyboard displayed by the
display device 110 to identify gestures and cause operations to be
performed that correspond to the gestures that may be recognized
through the input device 104 and/or touchscreen functionality of
the display device 110, and so forth. Other input devices are also
contemplated, such as a mouse, track pad, camera to detect
gestures, and so on. Thus, the input/output module 108 may support
a variety of different input techniques by recognizing and
leveraging a division between types of inputs including key
presses, gestures, and so on.
[0025] In the illustrated example, the input device 104 is
configured as a keyboard having a QWERTY arrangement of keys
although other arrangements of keys are also contemplated. Further,
other non-conventional configurations are also contemplated, such
as a game controller, configuration to mimic a musical instrument,
and so forth. Thus, the input device 104 and keys incorporated by
the input device 104 may assume a variety of different
configurations to support a variety of different functionality.
[0026] As previously described, the input device 104 is physically
and communicatively coupled to the computing device 102 in this
example through use of a flexible hinge 106. The flexible hinge 106
is flexible in that rotational movement supported by the hinge is
achieved through flexing (e.g., bending) of the material forming
the hinge as opposed to mechanical rotation as supported by a pin,
although that embodiment is also contemplated. Further, this
flexible rotation may be configured to support movement in one
direction (e.g., vertically in the figure) yet restrict movement in
other directions, such as lateral movement of the input device 104
in relation to the computing device 102. This may be used to
support consistent alignment of the input device 104 in relation to
the computing device 102, such as to align sensors used to change
power states, application states, and so on.
[0027] The flexible hinge 106, for instance, may be formed using
one or more layers of fabric and include conductors formed as
flexible traces to communicatively couple the input device 104 to
the computing device 102 and vice versa. This communication, for
instance, may be used to communicate a result of a key press to the
computing device 102, receive power from the computing device,
perform authentication, provide supplemental power to the computing
device 102, and so on. The flexible hinge 106 may be configured in
a variety of ways, further discussion of which may be found in
relation to the following figure.
[0028] FIG. 2 depicts an example implementation 200 of the input
device 104 of FIG. 1 as showing the flexible hinge 106 in greater
detail. In this example, a connection portion 202 of the input
device is shown that is configured to provide a communicative and
physical connection between the input device 104 and the computing
device 102. In this example, the connection portion 202 has a
height and cross section configured to be received in a channel in
the housing of the computing device 102, although this arrangement
may also be reversed without departing from the spirit and scope
thereof.
[0029] The connection portion 202 is flexibly connected to a
portion of the input device 104 that includes the keys through use
of the flexible hinge 106. Thus, when the connection portion 202 is
physically connected to the computing device the combination of the
connection portion 202 and the flexible hinge 106 supports movement
of the input device 104 in relation to the computing device 102
that is similar to a hinge of a book.
[0030] For example, rotational movement may be supported by the
flexible hinge 106 such that the input device 104 may be placed
against the display device 110 of the computing device 102 and
thereby act as a cover. The input device 104 may also be rotated so
as to be disposed against a back of the computing device 102, e.g.,
against a rear housing of the computing device 102 that is disposed
opposite the display device 110 on the computing device 102.
[0031] Naturally, a variety of other orientations are also
supported. For instance, the computing device 102 and input device
104 may assume an arrangement such that both are laid flat against
a surface as shown in FIG. 1. In another instance, a typing
arrangement may be supported in which the input device 104 is laid
flat against a surface and the computing device 102 is disposed at
an angle to permit viewing of the display device 110, e.g., such as
through use of a kickstand disposed on a rear surface of the
computing device 102. Other instances are also contemplated, such
as a tripod arrangement, meeting arrangement, presentation
arrangement, and so forth.
[0032] The connecting portion 202 is illustrated in this example as
including magnetic coupling devices 204, 206, mechanical coupling
protrusions 208, 210, and a plurality of communication contacts
212. The magnetic coupling devices 204, 206 are configured to
magnetically couple to complementary magnetic coupling devices of
the computing device 102 through use of one or more magnets. In
this way, the input device 104 may be physically secured to the
computing device 102 through use of magnetic attraction.
[0033] The connecting portion 202 also includes mechanical coupling
protrusions 208, 210 to form a mechanical physical connection
between the input device 104 and the computing device 102. The
mechanical coupling protrusions 208, 210 are shown in greater
detail in the following figure.
[0034] FIG. 3 depicts an example implementation 300 shown a
perspective view of the connecting portion 202 of FIG. 2 that
includes the mechanical coupling protrusions 208, 210 and the
plurality of communication contacts 212. As illustrated, the
mechanical coupling protrusions 208, 210 are configured to extend
away from a surface of the connecting portion 202, which in this
case is perpendicular although other angles are also
contemplated.
[0035] The mechanical coupling protrusions 208, 210 are configured
to be received within complimentary cavities within the channel of
the computing device 102. When so received, the mechanical coupling
protrusions 208, 210 promote a mechanical binding between the
devices when forces are applied that are not aligned with an axis
that is defined as correspond to the height of the protrusions and
the depth of the cavity.
[0036] For example, when a force is applied that does coincide with
the longitudinal axis described previously that follows the height
of the protrusions and the depth of the cavities, a user overcomes
the force applied by the magnets solely to separate the input
device 104 from the computing device 102. However, at other angles
the mechanical coupling protrusion 208, 210 are configured to
mechanically bind within the cavities, thereby creating a force to
resist removal of the input device 104 from the computing device
102 in addition to the magnetic force of the magnetic coupling
devices 204, 206. In this way, the mechanical coupling protrusions
208, 210 may bias the removal of the input device 104 from the
computing device 102 to mimic tearing a page from a book and
restrict other attempts to separate the devices.
[0037] The connecting portion 202 is also illustrated as including
a plurality of communication contacts 212. The plurality of
communication contacts 212 is configured to contact corresponding
communication contacts of the computing device 102 to form a
communicative coupling between the devices. The communication
contacts 212 may be configured in a variety of ways, such as
through formation using a plurality of spring loaded pins that are
configured to provide a consistent communication contact between
the input device 104 and the computing device 102. Therefore, the
communication contact may be configured to remain during minor
movement of jostling of the devices. A variety of other examples
are also contemplated, including placement of the pins on the
computing device 102 and contacts on the input device 104.
[0038] FIG. 4 depicts an example of a cross-sectional view of a
pressure sensitive key 400 of a keyboard of the input device 104 of
FIG. 2. The pressure sensitive key 400 in this example is
illustrated as being formed using a flexible contact layer 402
(e.g., Mylar) that is spaced apart from the sensor substrate 404
using a spacer layer 406, 408, which may be formed as another layer
of Mylar or other bendable material, formed on the sensor substrate
404, and so on. In this example, the flexible contact layer 402
does not contact the sensor substrate 404 absent application of
pressure against the flexible contact layer 402.
[0039] The flexible contact layer 402 in this example includes a
force sensitive ink 410 disposed on a surface of the flexible
contact layer 402 that is configured to contact the sensor
substrate 404. The force sensitive ink 410 is configured such that
an amount of resistance of the ink varies directly in relation to
an amount of pressure applied. The force sensitive ink 410, for
instance, may be configured with a relatively rough surface that is
compressed against the sensor substrate 404 upon an application of
pressure against the flexible contact layer 402. The greater the
amount of pressure, the more the force sensitive ink 410 is
compressed, thereby increasing conductivity and decreasing
resistance of the force sensitive ink 410. Other conductors may
also be disposed on the flexible contact layer 402 without
departing from the spirit and scope therefore, including other
types of pressure sensitive and non-pressure sensitive
conductors.
[0040] The sensor substrate 404 includes one or more conductors 412
disposed thereon that are configured to be contacted by the force
sensitive ink 410 of the flexible contact layer 402. When
contacted, an analog signal may be generated for processing by the
input device 104 and/or the computing device 102, e.g., to
recognize whether the signal is likely intended by a user to
provide an input for the computing device 102. A variety of
different types of conductors 412 may be disposed on the sensor
substrate 404, such as formed from a variety of conductive
materials (e.g., silver, copper), disposed in a variety of
different configurations such as inter-digitated trace fingers, and
so on.
[0041] FIG. 5 depicts an example 500 of the pressure sensitive key
400 of FIG. 4 as having pressure applied at a first location of the
flexible contact layer 402 to cause contact of the force sensitive
ink 410 with a corresponding first location of the sensor substrate
404. The pressure is illustrated through use of an arrow in FIG. 5
and may be applied in a variety of ways, such as by a finger of a
user's hand, stylus, pen, and so on. In this example, the first
location at which pressure is applied as indicated by the arrow is
located generally near a center region of the flexible contact
layer 402 that is disposed between the spacer layers 406, 408. Due
to this location, the flexible contact layer 402 may be considered
generally flexible and thus responsive to the pressure.
[0042] This flexibility permits a relatively large area of the
flexible contact layer 402, and thus the force sensitive ink 410,
to contact the conductors 412 of the sensor substrate 404. Thus, a
relatively strong signal may be generated. Further, because the
flexibility of the flexible contact layer 402 is relatively high at
this location, a relatively large amount of the force may be
transferred through the flexible contact layer 402, thereby
applying this pressure to the force sensitive ink 410. As
previously described, this increase in pressure may cause a
corresponding increase in conductivity of the force sensitive ink
and decrease in resistance of the ink. Thus, the relatively high
amount of flexibility of the flexible contact layer at the first
location may cause a relatively stronger signal to be generated in
comparison with other locations of the flexible contact layer 402
that are located closer to an edge of the key, an example of which
is described in relation to the following figure.
[0043] FIG. 6 depicts an example 600 of the pressure sensitive key
400 of FIG. 4 as having pressure applied at a second location of
the flexible contact layer 402 to cause contact with a
corresponding second location of the sensor substrate 404. In this
example, the second location of FIG. 6 at which pressure is applied
is located closer to an edge of the pressure sensitive key (e.g.,
closer to an edge of the spacer layer 406) than the first location
of FIG. 5. Due to this location, the flexible contact layer 402 has
reduced flexibility when compared with the first location and thus
less responsive to pressure.
[0044] This reduced flexibility may cause a reduction in an area of
the flexible contact layer 402, and thus the force sensitive ink
410, that contacts the conductors 412 of the sensor substrate 404.
Thus, a signal produced at the second location may be weaker than a
signal produced at the first location of FIG. 5.
[0045] Further, because the flexibility of the flexible contact
layer 402 is relatively low at this location, a relatively low
amount of the force may be transferred through the flexible contact
layer 402, thereby reducing the amount of pressure transmitted to
the force sensitive ink 410. As previously described, this decrease
in pressure may cause a corresponding decrease in conductivity of
the force sensitive ink and increase in resistance of the ink in
comparison with the first location of FIG. 5. Thus, the reduced
flexibility of the flexible contact layer 402 at the second
location in comparison with the first location may cause a
relatively weaker signal to be generated. Further, this situation
may be exacerbated by a partial hit in which a smaller portion of
the user's finger is able to apply pressure at the second location
of FIG. 6 in comparison with the first location of FIG. 5.
[0046] However, as previously described techniques may be employed
to provide feedback and thus promote consistency of the contact of
the flexible contact layer 402 with the sensor substrate 404 as
well as other features, further discussion of which may be found in
relation to the following section.
Example Audio Feedback
[0047] FIG. 7 depicts an example 700 of the input device 104 and
computing device 102 as leveraging an audio feedback module 702.
The audio feedback module 702 is representative of functionality to
provide audio feedback responsive to user interface with a device,
e.g., the computing device 102 and/or the input device 104.
Although the audio feedback module 702 is illustrated as part of
the input device, the functionality of the audio feedback module
702 may be implemented in a variety of ways. For example, the audio
feedback module 702 may be implemented exclusively on the input
device 104 itself, such as to perform processing and output of the
audio feedback, such as through the use of an amplifier and one or
more speakers.
[0048] In another example, functionality of the audio feedback
module 702 may be implemented in part by both the input device 104
and the computing device 102. For instance, audio feedback module
702 functionality of the input device 104 may be used to detect and
determine audio feedback that is to be output and then cause the
computing device 102 to perform this output. This may be performed
through interaction with an operating system, directly to an
amplifier and speakers 704, 706 of the computing device 102
(thereby reducing latency), and so on.
[0049] In a further example, the functionality of the audio
feedback module 702 may be substantially implemented by the
computing device 102, e.g., as part of the input/output module 108.
For instance, audio feedback module 702 functionality of the
input/output module 108 may receive a signal from the input device
104. The signal may then be processed to determine audio feedback
that is to be output, which may then be performed by the computing
device 102 itself. Thus, the audio feedback module 702 may be
implemented in a variety of different ways to provide the
functionality described herein and therefore the following
discussion is not to be taken as limited to any particular said
implementation unless stated otherwise.
[0050] The audio feedback module 702 may leverage audio data 708 to
provide a wide variety of feedback. For example, the audio data 708
may support themes (e.g., collections of sounds) that are user
selectable, e.g., via a menu in a user interface. These themes may
also be selected automatically based on an input device attached to
the computing device, based on applications that are being executed
by the computing device 102, and so forth. For instance, a first
set of sounds may be utilized as audio feedback for a word
processing application while a second set of sounds may be utilized
as audio feedback for a video game. In another example, sounds may
be associated with a key and/or group of keys. Therefore, when a
key is pressed a sound from a set of sounds may be selected, e.g.,
via round robin, random, by pressure, and so on. In another
example, sounds may be associated with key groups, e.g., letters,
numbers, modifier keys (shift, control), navigation keys (arrows,
page up, page down), function keys, and so on.
[0051] Audio feedback may be output in a variety of ways. In the
illustrated example, speaker 704, 706 are disposed within a housing
of the computing device 102, although other examples are also
contemplated as previously described, such as incorporated as part
of the input device 104. Further, the audio feedback module 702 may
be configured to support a variety of different techniques
regarding how this output is performed.
[0052] The audio feedback module 702, for instance, may leverage
techniques such that audio feedback appears to be output from a
location at which interaction with a device occurred. The audio
feedback module 702, for instance, may be configured to leverage
the speakers 704, 706 to give an impression to a user of the input
device 104 that the feedback occurred at a particular key that was
pressed by the user. This may include use of stereophonic
techniques, head transfer function models, and so on that may give
an indication of origination of the audio feedback that is
different from where the output actually occurs.
[0053] This may include alteration of a left to right and even up
or down appearance of a point of origination of the audio feedback
to a user such that that point appears to correspond to a location
at which the input occurred. Further, this may also be based on a
likely location of a user. This location, for instance, may be
modeled statically based on a likely head position of a user when
typing. The location may also be determined dynamically, such as
through use of one or more sensors, e.g., a forward facing image
capture device, microphone, and so on.
[0054] The audio feedback module 702 may be configured to provide a
wide range of audio feedback based on the audio data 708. In the
illustrated example, for instance, the audio feedback module 702
may be configured to provide audio feedback that is dependent on
which key of a keyboard is pressed. The audio data 708, for
instance, may be configured to model a keystroke of individual keys
of a keyboard. The audio feedback module 702 may then determine
which key was pressed and provide audio feedback that corresponds
to that key. A variety of other examples are also contemplated,
such as feedback for alphabetic and/or numeric keys being different
from feedback for non-alphanumeric keys, e.g., a carriage return or
"enter" key. A variety of other examples are also contemplated,
further instances of which may be found in relation to the
following discussion of the next figure.
[0055] FIG. 8 depicts an example implementation 800 showing one of
more fingers of a user's hands as interacting with the input device
104, thereby initiating output of audio feedback. In this example,
left and right hands 802, 804 of a user are shown as being
positioned to press keys of the input device 104. Although not
shown, the input device 104 may be communicatively coupled to the
computing device 102 as previously described and shown in relation
to FIG. 1.
[0056] As previously described, conventional input devices
configured to mobile use may provide insufficient feedback and thus
may make it increasingly difficult for a user to interact with the
device. Accordingly, audio feedback techniques may be leveraged to
aid this interaction. For example, an audio feedback technique may
be supported by the audio feedback module 702 to aid a user in
locating a home row of keys of a keyboard. This may include output
of sounds that get increasingly more harmonious the closer a user's
fingers are initially located to the home row. This feedback may
cease once the home row is located, after a defined period of time,
responsive to removal of the user's fingers from a surface of the
input device 104, and so on.
[0057] In another example, an output of audio feedback may be
adjusted based on an environment in which the input device 104 is
located. For instance, the input device 104 and/or computing device
102 may leverage one or more sensors (e.g., a microphone) to
determine an ambient noise level of an environment and adjust a
volume or other characteristic of the audio feedback accordingly,
such as to be just above the ambient noise level. This
determination may be performed automatically such that the audio
feedback does not intrude upon the user's experience, such as when
changing from a noisy to a quiet environment and vice versa.
[0058] In a further example, the output of the audio feedback may
be adjusted based on an amount of pressure that is detected for a
press of the key. This may be performed using the pressure
sensitive keys described earlier, a contact area for a capacitive
touchscreen, and so on. Further, the adjusting may be performed in
a variety of ways, which may include adjusting volume, timbre, or
other audio characteristics of the audio feedback. A variety of
other examples are also contemplated which may be used to aid a
user in locating key of the input device, an example of which is
described as follows.
[0059] FIG. 9 depicts an example implementation 900 showing keys of
the input device 104 of FIG. 1 in greater detail. In the
illustrated example, a flexible surface of the input device 104 is
shown that includes indications of keys for the letters "u," "i,"
"o," "j," "k," and "l." The indications may be formed using
embossing, printing, laser cutting, and so forth.
[0060] First and second key presses 902, 904 are shown through
circles that are illustrated in phantom for the same key, which is
the "i" key in the illustrated example. In this example, the first
key press 902 is positioned proximal to a center of the key while a
second key press 904 is positioned proximal to an edge of the key.
As described in relation not FIGS. 4-6, however, in some instances
this may cause a decrease in an ability to detect the press of the
key.
[0061] The audio feedback module 702 may therefore be configured to
provide audio feedback that is dependent on where a key is pressed.
This may include an output of audio feedback that mimics a regular
key press as performed for a mechanical keyboard for the first key
press 902 and therefore readily informs the user that the press was
"good." However, for the second key press 904 the audio feedback
may be configured to indicate a miss hit of the key. Thus, even if
a user is unable to "feel" the edge of the key (e.g., for a virtual
keyboard) the audio feedback may indicate a potential miss hit of
the key. The user may then readily correct where the key is
subsequently pressed, thereby promoting an efficient user
experience. A variety of other examples are also contemplated.
Example Procedure
[0062] The following discussion describes audio feedback techniques
that may be implemented utilizing the previously described systems
and devices. Aspects of each of the procedures may be implemented
in hardware, firmware, or software, or a combination thereof. The
procedures are shown as a set of blocks that specify operations
performed by one or more devices and are not necessarily limited to
the orders shown for performing the operations by the respective
blocks. In portions of the following discussion, reference will be
made to FIGS. 1-9.
[0063] FIG. 10 depicts a procedure 1000 in an example
implementation in which a determination is made as to which audio
feedback is to be output responsive to receipt of a signal from a
pressure sensitive key. A signal is received from a pressure
sensitive key of an input device (block 1002). Although a pressure
sensitive key is described in this example, other input techniques
are also contemplated, such as virtual keyboards, track pads, and
so forth.
[0064] Audio feedback is determined, from the signal, which is to
be output as corresponding to the pressure sensitive key (block
1004). As previously described, the audio feedback may be
determined based on a variety of factors. These factors may be used
to output different sounds for different keys, sounds dependent on
where a key is pressed, sounds that appear to originate from a key
that is being pressed, adjustment based on environment, adjustment
based on how hard the key is pressed (e.g., timbre, volume),
support themes that are user selectable for different sounds,
provide audio feedback to indicate when one or more fingers of the
user's hand are positioned at a home row of a keyboard, and so
on.
[0065] The determined audio feedback is then caused to be output
(block 1006). This may include the input device 104 causing
speakers 704, 706 of the computing device 102 to output the sounds,
output by the input device 104 itself, and so forth as previously
described in relation to FIG. 7.
Example System and Device
[0066] FIG. 11 illustrates an example system generally at 1100 that
includes an example computing device 1102 that is representative of
one or more computing systems and/or devices that may implement the
various techniques described herein. The computing device 1102 may,
for example, be configured to assume a mobile configuration through
use of a housing formed and size to be grasped and carried by one
or more hands of a user, illustrated examples of which include a
mobile phone, mobile game and music device, and tablet computer
although other examples are also contemplated.
[0067] The example computing device 1102 as illustrated includes a
processing system 1104, one or more computer-readable media 1106,
and one or more I/O interface 1108 that are communicatively
coupled, one to another. Although not shown, the computing device
1102 may further include a system bus or other data and command
transfer system that couples the various components, one to
another. A system bus can include any one or combination of
different bus structures, such as a memory bus or memory
controller, a peripheral bus, a universal serial bus, and/or a
processor or local bus that utilizes any of a variety of bus
architectures. A variety of other examples are also contemplated,
such as control and data lines.
[0068] The processing system 1104 is representative of
functionality to perform one or more operations using hardware.
Accordingly, the processing system 1104 is illustrated as including
hardware element 1110 that may be configured as processors,
functional blocks, and so forth. This may include implementation in
hardware as an application specific integrated circuit or other
logic device formed using one or more semiconductors. The hardware
elements 1110 are not limited by the materials from which they are
formed or the processing mechanisms employed therein. For example,
processors may be comprised of semiconductor(s) and/or transistors
(e.g., electronic integrated circuits (ICs)). In such a context,
processor-executable instructions may be electronically-executable
instructions.
[0069] The computer-readable storage media 1106 is illustrated as
including memory/storage 1112. The memory/storage 1112 represents
memory/storage capacity associated with one or more
computer-readable media. The memory/storage component 1112 may
include volatile media (such as random access memory (RAM)) and/or
nonvolatile media (such as read only memory (ROM), Flash memory,
optical disks, magnetic disks, and so forth). The memory/storage
component 1112 may include fixed media (e.g., RAM, ROM, a fixed
hard drive, and so on) as well as removable media (e.g., Flash
memory, a removable hard drive, an optical disc, and so forth). The
computer-readable media 1106 may be configured in a variety of
other ways as further described below.
[0070] Input/output interface(s) 1108 are representative of
functionality to allow a user to enter commands and information to
computing device 1102, and also allow information to be presented
to the user and/or other components or devices using various
input/output devices. Examples of input devices include a keyboard,
a cursor control device (e.g., a mouse), a microphone, a scanner,
touch functionality (e.g., capacitive or other sensors that are
configured to detect physical touch), a camera (e.g., which may
employ visible or non-visible wavelengths such as infrared
frequencies to recognize movement as gestures that do not involve
touch), and so forth. Examples of output devices include a display
device (e.g., a monitor or projector), speakers, a printer, a
network card, tactile-response device, and so forth. Thus, the
computing device 1102 may be configured in a variety of ways to
support user interaction.
[0071] The computing device 1102 is further illustrated as being
communicatively and physically coupled to an input device 1114 that
is physically and communicatively removable from the computing
device 1102. In this way, a variety of different input devices may
be coupled to the computing device 1102 having a wide variety of
configurations to support a wide variety of functionality. In this
example, the input device 1114 includes one or more keys 1116,
which may be configured as pressure sensitive keys, mechanically
switched keys, and so forth.
[0072] The input device 1114 is further illustrated as include one
or more modules 1118 that may be configured to support a variety of
functionality. The one or more modules 1118, for instance, may be
configured to process analog and/or digital signals received from
the keys 1116 to determine whether a keystroke was intended,
determine whether an input is indicative of resting pressure,
support authentication of the input device 1114 for operation with
the computing device 1102, and so on.
[0073] Various techniques may be described herein in the general
context of software, hardware elements, or program modules.
Generally, such modules include routines, programs, objects,
elements, components, data structures, and so forth that perform
particular tasks or implement particular abstract data types. The
terms "module," "functionality," and "component" as used herein
generally represent software, firmware, hardware, or a combination
thereof. The features of the techniques described herein are
platform-independent, meaning that the techniques may be
implemented on a variety of commercial computing platforms having a
variety of processors.
[0074] An implementation of the described modules and techniques
may be stored on or transmitted across some form of
computer-readable media. The computer-readable media may include a
variety of media that may be accessed by the computing device 1102.
By way of example, and not limitation, computer-readable media may
include "computer-readable storage media" and "computer-readable
signal media."
[0075] "Computer-readable storage media" may refer to media and/or
devices that enable persistent and/or non-transitory storage of
information in contrast to mere signal transmission, carrier waves,
or signals per se. Thus, computer-readable storage media refers to
non-signal bearing media. The computer-readable storage media
includes hardware such as volatile and non-volatile, removable and
non-removable media and/or storage devices implemented in a method
or technology suitable for storage of information such as computer
readable instructions, data structures, program modules, logic
elements/circuits, or other data. Examples of computer-readable
storage media may include, but are not limited to, RAM, ROM,
EEPROM, flash memory or other memory technology, CD-ROM, digital
versatile disks (DVD) or other optical storage, hard disks,
magnetic cassettes, magnetic tape, magnetic disk storage or other
magnetic storage devices, or other storage device, tangible media,
or article of manufacture suitable to store the desired information
and which may be accessed by a computer.
[0076] "Computer-readable signal media" may refer to a
signal-bearing medium that is configured to transmit instructions
to the hardware of the computing device 1102, such as via a
network. Signal media typically may embody computer readable
instructions, data structures, program modules, or other data in a
modulated data signal, such as carrier waves, data signals, or
other transport mechanism. Signal media also include any
information delivery media. The term "modulated data signal" means
a signal that has one or more of its characteristics set or changed
in such a manner as to encode information in the signal. By way of
example, and not limitation, communication media include wired
media such as a wired network or direct-wired connection, and
wireless media such as acoustic, RF, infrared, and other wireless
media.
[0077] As previously described, hardware elements 1110 and
computer-readable media 1106 are representative of modules,
programmable device logic and/or fixed device logic implemented in
a hardware form that may be employed in some embodiments to
implement at least some aspects of the techniques described herein,
such as to perform one or more instructions. Hardware may include
components of an integrated circuit or on-chip system, an
application-specific integrated circuit (ASIC), a
field-programmable gate array (FPGA), a complex programmable logic
device (CPLD), and other implementations in silicon or other
hardware. In this context, hardware may operate as a processing
device that performs program tasks defined by instructions and/or
logic embodied by the hardware as well as a hardware utilized to
store instructions for execution, e.g., the computer-readable
storage media described previously.
[0078] Combinations of the foregoing may also be employed to
implement various techniques described herein. Accordingly,
software, hardware, or executable modules may be implemented as one
or more instructions and/or logic embodied on some form of
computer-readable storage media and/or by one or more hardware
elements 1110. The computing device 1102 may be configured to
implement particular instructions and/or functions corresponding to
the software and/or hardware modules. Accordingly, implementation
of a module that is executable by the computing device 1102 as
software may be achieved at least partially in hardware, e.g.,
through use of computer-readable storage media and/or hardware
elements 1110 of the processing system 1104. The instructions
and/or functions may be executable/operable by one or more articles
of manufacture (for example, one or more computing devices 1102
and/or processing systems 1104) to implement techniques, modules,
and examples described herein.
CONCLUSION
[0079] Although the example implementations have been described in
language specific to structural features and/or methodological
acts, it is to be understood that the implementations defined in
the appended claims is not necessarily limited to the specific
features or acts described. Rather, the specific features and acts
are disclosed as example forms of implementing the claimed
features.
* * * * *