U.S. patent application number 13/921644 was filed with the patent office on 2013-10-24 for electronic device including finger movement based musical tone generation and related methods.
The applicant listed for this patent is APPLE INC.. Invention is credited to ARTHUR LESLIE STEWART.
Application Number | 20130278380 13/921644 |
Document ID | / |
Family ID | 42116914 |
Filed Date | 2013-10-24 |
United States Patent
Application |
20130278380 |
Kind Code |
A1 |
STEWART; ARTHUR LESLIE |
October 24, 2013 |
ELECTRONIC DEVICE INCLUDING FINGER MOVEMENT BASED MUSICAL TONE
GENERATION AND RELATED METHODS
Abstract
An electronic device may include a finger biometric sensor and
an audio output transducer. The electronic device may further
include a controller cooperating with the finger biometric sensor
for determining at least one biometric characteristic of a user's
finger. The controller may also cooperate with the finger biometric
sensor for causing the audio output transducer to generate at least
one musical tone changing based upon movement of a user's finger
relative to the finger biometric sensor.
Inventors: |
STEWART; ARTHUR LESLIE;
(MELBOURNE BEACH, FL) |
|
Applicant: |
Name |
City |
State |
Country |
Type |
APPLE INC. |
Cupertino |
CA |
US |
|
|
Family ID: |
42116914 |
Appl. No.: |
13/921644 |
Filed: |
June 19, 2013 |
Related U.S. Patent Documents
|
|
|
|
|
|
Application
Number |
Filing Date |
Patent Number |
|
|
12259493 |
Oct 28, 2008 |
8471679 |
|
|
13921644 |
|
|
|
|
Current U.S.
Class: |
340/5.52 |
Current CPC
Class: |
G10H 1/34 20130101; G10H
2220/161 20130101; H04M 1/6066 20130101; G05B 1/00 20130101 |
Class at
Publication: |
340/5.52 |
International
Class: |
G05B 1/00 20060101
G05B001/00 |
Claims
1-22. (canceled)
23. An electronic device comprising: a finger biometric sensor; an
audio output transducer; and a controller coupled to said finger
biometric sensor and said audio output transducer, said controller
capable of determining at least one biometric characteristic of a
user's finger, authenticating the user by determining a match
between the at least one biometric characteristic and at least one
stored biometric characteristic, generating a finger motion signal
based upon a motion of the user's finger relative to said finger
biometric sensor, and causing said audio output transducer to
generate at least one musical tone changing based upon the finger
motion signal and motion of the user's finger across said finger
biometric sensor.
24. The electronic device according to claim 23 wherein said
controller is capable of causing said audio output transducer to
generate the at least one musical tone having a pitch that changes
based upon the motion of the user's finger relative to said finger
biometric sensor.
25. The electronic device according to claim 23 wherein said
controller is capable of performing at least one navigation
function based upon motion of the user's finger relative to said
finger biometric sensor.
26. The electronic device according to claim 23 wherein said finger
biometric sensor comprises a slide biometric finger sensor.
27. The electronic device according to claim 23 wherein said
controller is capable of permitting selection of a musical
instrument for the at least one musical tone.
28. The electronic device according to claim 23 further comprising
a wireless link coupling said audio output transducer and said
controller.
29. The electronic device according to claim 23 further comprising
at least one of a display and a keypad coupled to said
controller.
30. The electronic device according to claim 23 further comprising
a housing carrying said finger biometric sensor and said
controller, and a wireless transceiver carried by said housing and
coupled to said controller.
31. An electronic device comprising: a finger biometric sensor; an
audio output transducer; and a controller coupled to said finger
biometric sensor and said audio output transducer, said controller
capable of determining at least one biometric characteristic of a
user's finger, performing at least one navigation function based
upon motion of the user's finger relative to said finger biometric
sensor, generating a finger motion signal based upon a motion of
the user's finger relative to said finger biometric sensor, and
causing said audio output transducer to generate at least one
musical tone changing based upon the finger motion signal and
motion of the user's finger across said finger biometric
sensor.
32. The electronic device according to claim 31 wherein said
controller is capable of causing said audio output transducer to
generate the at least one musical tone having a pitch that changes
based upon the motion of the user's finger relative to said finger
biometric sensor.
33. The electronic device according to claim 31 wherein said finger
biometric sensor comprises a slide biometric finger sensor.
34. The electronic device according to claim 31 wherein said
controller is capable of permitting selection of a musical
instrument for the at least one musical tone.
35. The electronic device according to claim 31 further comprising
a wireless link coupling said audio output transducer and said
controller.
36. The electronic device according to claim 31 further comprising
at least one of a display and a keypad coupled to said
controller.
37. The electronic device according to claim 31 further comprising
a housing carrying said finger biometric sensor and said
controller, and a wireless transceiver carried by said housing and
coupled to said controller.
38. A method of operating an electronic device comprising a finger
biometric sensor, an audio output transducer, and a controller
coupled to the finger biometric sensor and the audio output
transducer, the method comprising: using the controller for
determining at least one biometric characteristic of a user's
finger, authenticating the user by determining a match between the
at least one biometric characteristic and at least one stored
biometric characteristic, generating a finger motion signal based
upon a motion of the user's finger relative to the finger biometric
sensor, and causing the audio output transducer to generate at
least one musical tone changing based upon the finger motion signal
and motion of the user's finger across the finger biometric
sensor.
39. The method according to claim 38 wherein using the controller
comprises using the controller to generate the at least one musical
tone having a pitch that changes based upon the motion of the
user's finger relative to the finger biometric sensor.
40. The method according to claim 38 further comprising using the
controller to permit selecting a musical instrument for the at
least one musical tone.
Description
FIELD OF THE INVENTION
[0001] The present invention relates to the field of electronic
devices, and, more particularly, to such devices providing musical
tone generation.
BACKGROUND OF THE INVENTION
[0002] Entertainment options offered on a mobile wireless
communications device have become increasingly popular. For
example, the ability to select custom ring tones, skins, and the
ability to play MP3 music files are a few of the entertainment
options typically offered on a mobile wireless communications
device. Another form of entertainment typically included on a
mobile wireless communications device is a game. One particularly
popular game, for example, is Snake, offered on Nokia brand mobile
wireless communications devices. While an early version of the
Snake game was controlled by a 4-way directional input, the game
remains popular, with a latest version being released on May 22,
2008 for the Nokia N-Gage mobile gaming platform that includes two
dedicated gaming buttons.
[0003] The Zeemote JS1 Controller available from Zeemote, Inc. of
Bedford, Mass., is a wireless game controller or joystick that
communicates via Bluetooth wireless technology to a mobile wireless
communications device.
[0004] U.S. Pat. No. 7,275,252 to Volk et al. discloses a mobile
wireless communications device that includes a microminiature
optical disc drive. The microminiature optical disc drive provides
a data source for playing games, movies, or other digital content
on the device.
[0005] U.S. Patent Application Publication No. 2005/0192078 to
Jawaharlal is directed to a system and method for wireless remote
access based gaming for lottery games. According to one embodiment,
a remote user terminal transmits a first gaming SMS text message
via a wireless network to an application server, and the
application server transmits a second gaming SMS text message via
the wireless network to the remote user terminal.
[0006] U.S. Pat. No. 6,681,120 to Kim is directed to a mobile
entertainment and communication device that communicates over the
internet and includes one or more replaceable memory card sockets
for receiving a blank memory card for recording data directly from
the internet. Musical performances may also be recorded and can be
selectively reproduced by the device for the enjoyment of the user.
The device also includes a camera and microphone for recording
images and sound within the range of the device that can be
wirelessly transmitted, either selectively or automatically to a
remote telephone. Further, the device includes sensors for sensing
unusual conditions that may also be transmitted to a remote
telephone, together with the location of the device as determined
by a GPS section of the device.
[0007] With entertainment, such as games, on a mobile wireless
communications device becoming increasingly popular, it may be
desirable to include additional features on a mobile wireless
communications device for entertainment purposes.
SUMMARY OF THE INVENTION
[0008] In view of the foregoing background, it is therefore an
object of the present invention to provide of an electronic device
including an entertainment feature, such as musical tone
generation, for example.
[0009] This and other objects, features, and advantages in
accordance with the present invention are provided by an electronic
device including a finger biometric sensor, an audio output
transducer, and a controller. The controller may cooperate with the
finger biometric sensor for determining at least one biometric
characteristic of a user's finger. The controller may also
cooperate with the finger biometric sensor for causing the audio
output transducer to generate at least one musical tone changing
based upon movement of a user's finger relative to the finger
biometric sensor, for example. Accordingly, the electronic device
provides a user with musical entertainment using a finger biometric
sensor. Of course, the finger biometric sensor may also be used for
authentication and/or navigation functions as well.
[0010] The controller may cooperate with the finger biometric
sensor for causing the audio output transducer to generate the at
least one musical tone changing based upon a velocity of the user's
finger relative to the finger biometric sensor. Additionally, the
controller may cooperate with the finger biometric sensor for
causing the audio output transducer to generate the at least one
musical tone having a pitch that changes based upon the movement of
the user's finger relative to the finger biometric sensor, for
example. Still further, the controller may permit selecting a
musical instrument for the at least one musical tone.
[0011] The finger biometric sensor may include a slide biometric
finger sensor, for example. The controller may generate a finger
velocity signal based upon the slide biometric finger sensor. The
controller may cooperate with the slide finger biometric sensor for
causing the audio output transducer to generate the at least one
musical tone changing based upon the finger velocity signal.
[0012] The electronic device further may include a wireless link
coupling the audio output transducer and the controller, for
example. The electronic device may also include at least one of a
display and a keypad coupled to the controller.
[0013] Another aspect is directed to a method of playing at least
one musical tone using an electronic device. The electronic device
may include a finger biometric sensor, an audio output transducer,
and a controller coupled to the finger biometric sensor and the
audio output transducer. The method may include using the
controller cooperating with the finger biometric sensor for
determining at least one biometric characteristic of a user's
finger, for example. The method may also include further using the
controller, also cooperating with the finger biometric sensor for
causing the audio output transducer to generate the at least one
musical tone changing based upon movement of the user's finger
relative to the finger biometric sensor.
BRIEF DESCRIPTION OF THE DRAWINGS
[0014] FIG. 1 is a schematic block diagram of an electronic device
in accordance with the invention.
[0015] FIG. 2 is a schematic block diagram of another embodiment of
the electronic device of FIG. 1
[0016] FIG. 3 is a flow chart of a method of playing a musical tone
in accordance with the invention.
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0017] The present invention will now be described more fully
hereinafter with reference to the accompanying drawings, in which
preferred embodiments of the invention are shown. This invention
may, however, be embodied in many different forms and should not be
construed as limited to the embodiments set forth herein. Rather,
these embodiments are provided so that this disclosure will be
thorough and complete, and will fully convey the scope of the
invention to those skilled in the art. Like numbers refer to like
elements throughout, and prime notation is used to indicate similar
elements in alternative embodiments.
[0018] Referring initially to FIG. 1, an electronic device 50
includes a finger biometric sensor 51, an audio output transducer
52, and a controller 53. The controller 53 cooperates with the
finger biometric sensor for determining at least one biometric
characteristic of a user's finger 54. The electronic device 50 is
illustratively a mobile telephone and it includes a cellular
transceiver 58, or other type of wireless transceiver as will be
appreciated by those skilled in the art. Other mobile wireless
communications devices, such as a personal digital assistant (PDA),
for example, may be used.
[0019] The finger biometric sensor 51 may be a slide fingerprint
sensor available from AuthenTec, Inc. of Melbourne, Fla. and the
assignee of the present application. Other types of fingerprint
sensors may also be used.
[0020] The controller 53 cooperates with the finger biometric
sensor 51 for causing the audio output transducer 52 to generate at
least one musical tone changing based upon movement of the user's
finger 54 relative to the finger biometric sensor. In other words,
movement of the user's finger 54 over the finger biometric sensor
51 causes the controller 53 to generate a signal or measurement
that corresponds to a different musical tone. The signal or
measurement generated by the controller 53 may be of a velocity of
the user's finger 54 relative to the finger biometric sensor, and
the musical tone may change based on that velocity.
[0021] As will be appreciated by those skilled in the art, the
signal or measurement generated by the controller 53 may be a
shared signal or measurement, or be part of image processing for
the finger biometric sensor 51, for example a signal used for
navigation and/or authentication functions. While the changing of
the musical tone may be based on the velocity of the user's finger
54 relative to the finger biometric sensor, other movement-based
signals or measurements may also be used to change the musical
tone.
[0022] The controller 53 also cooperates with the finger biometric
sensor 51 for causing the audio output transducer 52 to generate
the musical tone having a pitch, or frequency, that changes based
upon the movement or velocity of the user's finger 54 relative to
the finger biometric sensor 51. Of course, the musical tone may
have other attributes that may change based upon the velocity of
the user's finger 54 relative to the finger biometric sensor 51.
The musical tone attribute to be changed based on the velocity of
the user's finger 54 may be selected by the user using the keypad
55 of the electronic device 50. It should be understood by those
skilled in the art that, in addition to a dialing function of the
electronic device 50, the keypad 55 may be used for menu item
selection. However, as will be appreciated by those skilled in the
art, the controller 53 may also cooperate with the finger biometric
sensor 51 to provide a navigation function, such as menu item
selection and/or an authentication function.
[0023] Additionally, the controller 53 may permit selecting a
musical instrument for the musical tones. In other words, the
musical tone generated by the audio output transducer 52 may be
representative of a trumpet, for example, or other user selected
instrument. The user may select the instrument using the keypad 55
of the electronic device 50, similar to the musical tone attribute
selection, as described above.
[0024] In some embodiments, as the velocity of the user's finger 54
across or in relation to the finger biometric sensor 51 increases,
the pitch of the selected instrument is increased. In other words,
the faster the swipe of the user's finger 54, the higher the note
or frequency generated by the audio output transducer 52. Other
relationships between the velocity of the user's finger 54 in
relation to the finger biometric sensor 51 and the pitch may be
used. For example, a higher velocity of the user's finger 54 in
relation to the finger biometric sensor 51 may correspond to a
lower pitch.
[0025] As will be appreciated by those skilled in the art, the
controller 53 may be included in an integrated processor that may
be carried in the housing 56 of the electronic device 50.
[0026] The cooperation of the controller 53 with the finger
biometric sensor 51 to cause the audio output transducer 52 to
generate a musical tone advantageously provides a user with
entertainment value. Indeed, the user may combine a series of
finger movements at different velocities to produce a song or
special sound effect, for example.
[0027] The finger biometric sensor 51 is illustratively a slide
sensor. In other words, biometric characteristics are determined by
a sliding placement of the user's finger 54. Alternatively, the
finger biometric sensor 51 may be a static biometric sensor. Using
a slide biometric sensor, for example, may be advantageous, as the
signal or measurement, such as a finger velocity signal, for
example, typically used for image processing of the user's finger
and generated by the controller, may also be used for causing the
audio output transducer 52 to generate at least one musical tone
changing based thereon. Suitable biometric sensors and associated
processing are described, for example, in U.S. Published
Application Publication No. 2005/0129291 to Boshra, and assigned to
the assignee of the present application, the entire contents of
which are herein incorporated by reference.
[0028] A memory 57 is illustratively coupled to the controller 53.
The memory 57 advantageously stores the available musical tone
attributes and musical instruments for the musical tone. The memory
57 may also include a library of sounds that correspond to each
musical instrument. Additionally, programming instructions that may
be executed by the controller 53 for causing the audio output
transducer 52 to generate the musical tone changing based upon
movement of the user's finger 54 relative to the finger biometric
sensor 51 may also be stored on the memory 57. In one embodiment,
the controller 53 may include software, or a sound generator
application that may be loaded into the memory 57. In some
embodiments, the memory 57 may also be used for recording and
playback of musical tones.
[0029] The memory 57 may be included in the controller 53, for
example, or may be external to the controller, as illustrated in
FIG. 1. This advantageously permits the sound generator application
or musical tone information to be installed on the electronic
device 50 as an added option by the user.
[0030] A display 61 is also included in the electronic device 50.
The display 61 cooperates with the controller 53 to display
information related to the musical tone. For example, the display
61 may indicate which musical instrument is currently selected, the
musical tone attribute that is also currently selected, and/or the
musical note corresponding to the last movement of the user's
finger 54. Of course, the display 61 may display other information
relating to the musical tone, such as equalizer bars, or a visual
splash screen that corresponds to the musical tones. The display 61
may be the display of the electronic device 50 and also display
information relating to the operation of the electronic device.
This arrangement advantageously maintains a reduced overall size of
the electronic device 50 while adding additional functionality.
[0031] The audio output transducer 52 is also illustratively
coupled to the controller 53. The audio output transducer 53 may be
the electronic device speaker, for example, thus maintaining
reduced overall size of the electronic device 50 while adding
additional functionality.
[0032] Referring now to FIG. 2, in another embodiment, a remote
audio output device 63' that includes a remote audio output
transducer 64' is outside the housing 56' of the electronic device
50'. For example, the remote audio output device 63' may be a
wireless headset, wireless earpiece, or other external wireless
audio output device, as will be appreciated by those skilled in the
art. The remote audio output device 63' illustratively includes a
remote wireless transceiver 65' that is coupled to the remote audio
output transducer 65' that generates the musical tones. A remote
audio output device controller 66' may also be optionally included
for processing the musical tones received from the remote wireless
transceiver 65'. However, the functions of the controller 66' may
be included in the remote wireless transceiver 65'.
[0033] Additionally, the electronic device 50' illustratively
includes an electronic device wireless transceiver 62' coupling the
audio output transducer 52' and the controller 53'. The electronic
device wireless transceiver 62' establishes a short range wireless
link with the remote wireless transceiver 63'. The short range
wireless link may be a Bluetooth link, for example, or other
wireless link, as will be appreciated by those skilled in the
art.
[0034] Musical tones that are to be generated by the audio output
transducer 52' are transmitted over the wireless link to the remote
wireless transceiver 65'. The remote wireless transceiver 65'
processes the received musical tones and the remote audio output
transducer 64' remotely generates the musical tones. The musical
tones may additionally be generated on the audio output transducer
52'.
[0035] Referring now additionally to FIG. 3, a method for playing a
musical tone using an electronic device 50 is described with
reference to flowchart 70. The electronic device 50 includes a
finger biometric sensor 51, an audio output transducer 52, and a
controller 53 coupled to the finger biometric sensor and the audio
output transducer. Beginning at Block 72, the method includes using
the controller 53 to cooperate with the finger biometric sensor 51
to determine a biometric characteristic from the user's finger 54.
Determining the biometric characteristic may include reading data
from the finger biometric sensor at Block 74. The data may include
image slices of the user's finger 54 and other data relating to the
user's finger, as will be appreciated by those skilled in the art.
The controller 53 is used to calculate the velocity of the user's
finger 54 in relation to the finger biometric sensor 51 at Block
76, and generates a signal corresponding thereto. The velocity of
the user's finger 54 is used to assemble the image slices (Block
78). The controller 53 is then used for authentication to determine
a match of the image slices to the stored users' finger images
(Block 80). The stored users' finger images may be stored in the
controller 53, in the memory 57, or in both. If the controller 53
determines there is not a match at Block 82 between the user's
finger image slices and the stored users' finger images, the method
ends at Block 90.
[0036] In contrast, if the controller 53 determines there is a
match at Block 82 between the user's finger image slices and the
stored users' finger images, the controller then enables the device
such as to accept the musical instrument selection made using the
keypad 55, or may accept a default musical instrument selection,
for generating the musical tone (Block 86). The controller 53 is
then used to cooperate with the finger biometric sensor 51 for
causing the audio output transducer 52 to generate the musical tone
changing based upon the velocity signal (Block 88), before ending
at Block 90.
[0037] Many modifications and other embodiments of the invention
will come to the mind of one skilled in the art having the benefit
of the teachings presented in the foregoing descriptions and the
associated drawings. Therefore, it is understood that the invention
is not to be limited to the specific embodiments disclosed, and
that modifications and embodiments are intended to be included
within the scope of the appended claims.
* * * * *