U.S. patent application number 15/709870 was filed with the patent office on 2018-01-18 for head-mounted display.
This patent application is currently assigned to PANASONIC INTELLECTUAL PROPERTY CORPORATION OF AMERICA. The applicant listed for this patent is PANASONIC INTELLECTUAL PROPERTY CORPORATION OF AMERICA. Invention is credited to Taiji SASAKI, Yasuhito WATANABE.
Application Number | 20180017797 15/709870 |
Document ID | / |
Family ID | 52483306 |
Filed Date | 2018-01-18 |
United States Patent
Application |
20180017797 |
Kind Code |
A1 |
WATANABE; Yasuhito ; et
al. |
January 18, 2018 |
HEAD-MOUNTED DISPLAY
Abstract
A head-mounted perfume dispenser apparatus includes a processor
which plays a moving image, a box, in which a container containing
a perfume is received, a reservoir which is filled with the perfume
received from the box and emits the perfume according to a start of
playing the moving image, a tubular vent hole which vents the
emitted perfume toward a nose of a user when the user wears the
head-mounted perfume dispenser apparatus, and a first opener-closer
provided between the box and the reservoir. The first opener-closer
opens and closes according to the start and an end of the moving
image played by the processor. The reservoir has a second
opener-closer provided at an upper portion of the reservoir. The
second opener-closer opens according to the end of the moving image
played by the processor.
Inventors: |
WATANABE; Yasuhito; (Osaka,
JP) ; SASAKI; Taiji; (Osaka, JP) |
|
Applicant: |
Name |
City |
State |
Country |
Type |
PANASONIC INTELLECTUAL PROPERTY CORPORATION OF AMERICA |
Torrance |
CA |
US |
|
|
Assignee: |
PANASONIC INTELLECTUAL PROPERTY
CORPORATION OF AMERICA
Torrance
CA
|
Family ID: |
52483306 |
Appl. No.: |
15/709870 |
Filed: |
September 20, 2017 |
Related U.S. Patent Documents
|
|
|
|
|
|
Application
Number |
Filing Date |
Patent Number |
|
|
14708264 |
May 10, 2015 |
9804398 |
|
|
15709870 |
|
|
|
|
PCT/JP2014/004221 |
Aug 19, 2014 |
|
|
|
14708264 |
|
|
|
|
Current U.S.
Class: |
1/1 |
Current CPC
Class: |
G02B 2027/0178 20130101;
A45D 34/02 20130101; A61L 9/035 20130101; G11B 27/11 20130101; G02B
27/0176 20130101; G09F 19/00 20130101; A61L 9/032 20130101; H04N
5/64 20130101 |
International
Class: |
G02B 27/01 20060101
G02B027/01; G09F 19/00 20060101 G09F019/00; A45D 34/02 20060101
A45D034/02; A61L 9/03 20060101 A61L009/03; G11B 27/11 20060101
G11B027/11 |
Foreign Application Data
Date |
Code |
Application Number |
Aug 23, 2013 |
JP |
2013-173295 |
Claims
1. A head-mounted perfume dispenser apparatus comprising: a
processor which plays a moving image; a box, in which a container
containing a perfume is received; a reservoir which is filled with
the perfume received from the box and emits the perfume according
to a start of playing the moving image; a tubular vent hole which
vents the emitted perfume toward a nose of a user when the user
wears the head-mounted perfume dispenser apparatus; and a first
opener-closer provided between the box and the reservoir, wherein
the first opener-closer opens and closes according to the start and
an end of the moving image played by the processor, the reservoir
has a second opener-closer provided at an upper portion of the
reservoir, and the second opener-closer opens according to the end
of the moving image played by the processor.
2. The head-mounted perfume dispenser apparatus according to claim
1, further comprising: a fan provided above the vent hole and below
the reservoir.
3. The head-mounted perfume dispenser apparatus according to claim
2, further comprising: a gyro which senses a direction that the
user faces.
4. The head-mounted perfume dispenser apparatus according to claim
1, wherein the vent hole includes one left vent hole and one right
vent hole.
5. The head-mounted perfume dispenser apparatus according to claim
2, wherein the fan includes one left fan and one right fan.
6. The head-mounted perfume dispenser apparatus according to claim
1, further comprising a fan provided above the vent hole and below
the reservoir, wherein the fan rotates both forward and backward,
opening and closing the first opener-closer, opening and closing
the second opener, starting and stopping a fan rotation, a fan
rotation direction and a number of revolutions of the fan are
controlled in accordance with a control signal.
7. The head-mounted perfume dispenser apparatus according to claim
6, wherein the control signal is a sound signal which is included
in the moving image.
8. The head-mounted perfume dispenser apparatus according to claim
6, wherein the control signal is a MIDI signal corresponding to the
moving image.
9. The head-mounted perfume dispenser apparatus according to claim
6, further comprising: a control signal processor which generates
the control signal.
10. The head-mounted perfume dispenser apparatus according to claim
6, wherein the first opener-closer opens at a first time and closes
at a second time according to the control signal, the first time
being before a third time and the second time being after the third
time and before the fourth time, the third time corresponding to a
moving image play start time and the fourth time corresponding to a
moving image play end time, the second opener-closer opens at the
second time and closes at a fifth time according to the control
signal, the fifth time being after the fourth time, the fan rotates
forward at the first time or a sixth time according to the control
signal, the sixth time being after the first time and before the
third time, the fan rotates backward at the second time according
to the control signal, and the fan stops at the fifth time
according to the control signal.
11. The head-mounted perfume dispenser apparatus according to claim
3, further comprising: a calculator which calculates a distance
between an object in the moving image and the nose of the user
based on the sensed direction and a position of the object in the
moving image, the object being a source of a smell corresponding to
the emitted perfume; and a controller which changes a number of
revolutions of the fan in accordance with the calculated distance.
Description
[0001] This application is a continuation application of U.S.
application Ser. No. 14/708,264, filed on May 10, 2015, which is a
continuation application of International Application No.
PCT/JP2014/004221, filed on Aug. 19, 2014, which claims the benefit
of Japanese Application No. 2013-173295, filed on Aug. 23, 2013,
the disclosures of which are incorporated by reference herein in
their entireties.
BACKGROUND
1. Technical Field
[0002] The present disclosure relates to a smell reproduction
apparatus.
2. Description of the Related Art
[0003] Attempts have been started to present olfactory information
to a user in recent years (see, for example, Japanese Unexamined
Patent Application Publications Nos. 2011-184486 and
2013-74476).
SUMMARY
[0004] Japanese Unexamined Patent Application Publications Nos.
2011-184486 and 2013-74476 described above need further
improvement.
[0005] In one general aspect, the techniques disclosed here feature
a head-mounted display including a playback processor which plays
back a moving image from first time until second time, the first
time corresponding to timing of starting playback of the moving
image and the second time corresponding to timing of ending
playback of the moving image, a box for placing a container
containing a perfume inside, a filled section which is temporarily
filled with the perfume and emits the temporarily filled perfume
according to starting playback of the moving image, and a tubular
vent hole which is in contact with a nose of a user when the user
wears the head-mounted display.
[0006] An aspect of the present disclosure achieves the further
improvement.
[0007] Additional benefits and advantages of the disclosed
embodiments will become apparent from the specification and
drawings. The benefits and/or advantages may be individually
obtained by the various embodiments and features of the
specification and drawings, which need not all be provided in order
to obtain one or more of such benefits and/or advantages.
BRIEF DESCRIPTION OF THE DRAWINGS
[0008] FIG. 1 is a diagram of an overall configuration according to
a first embodiment of the present disclosure;
[0009] FIG. 2 is a diagram of a configuration of a smell
reproduction apparatus according to the first embodiment of the
present disclosure;
[0010] FIG. 3 is a timing diagram of the operations of an
opener-closer and a fan according to the first embodiment of the
present disclosure;
[0011] FIG. 4 is a timing diagram with a signal added thereto which
is defined by smell control metadata;
[0012] FIGS. 5A and 5B are diagrams for explaining a configuration
to store different smells;
[0013] FIG. 6 is a diagram for explaining a smell box set
value;
[0014] FIG. 7 is a diagram showing an example of a configuration to
store two or more smell boxes;
[0015] FIG. 8 is a diagram for explaining a method for mixing a
plurality of smells;
[0016] FIG. 9 is a diagram of a configuration of a smell
reproduction apparatus according to a second embodiment of the
present disclosure;
[0017] FIG. 10A is a diagram showing a positional relationship
between an object and an operator according to the second
embodiment of the present disclosure;
[0018] FIG. 10B is a diagram showing a positional relationship
between the object and the operator according to the second
embodiment of the present disclosure;
[0019] FIG. 11 is a diagram of a configuration of a smell
reproduction apparatus according to a third embodiment of the
present disclosure;
[0020] FIG. 12 is a timing diagram of the operations of an
opener-closer, a sending section, and a filled section
opener-closer according to the third embodiment of the present
disclosure;
[0021] FIG. 13A is a diagram for explaining a configuration which
provides a sense of augmented reality using a smell;
[0022] FIG. 13B is a diagram for explaining the configuration that
provides a sense of augmented reality using a smell;
[0023] FIG. 14A is a timing diagram of the operations of the
opener-closer, the sending section, and the filled section
opener-closer according to the third embodiment of the present
disclosure;
[0024] FIG. 14B is a timing diagram of the operations of the
opener-closer, the sending section, and the filled section
opener-closer according to the third embodiment of the present
disclosure;
[0025] FIG. 15 is a diagram of a configuration of a conventional
smell reproduction apparatus; and
[0026] FIG. 16 is a diagram of a configuration of a conventional
scent reproduction system.
DETAILED DESCRIPTION
(Underlying Knowledge Forming Basis of the Present Disclosure)
[0027] The present inventor has found that the techniques disclosed
in Japanese Unexamined Patent Application Publications Nos.
2011-184486 and 2013-74476 cause the problems below.
[0028] FIG. 15 shows a smell generation apparatus disclosed in
Japanese Unexamined Patent Application Publication No.
2011-184486.
[0029] In FIG. 15, a smell generation apparatus 500 includes a
plurality of electroosmotic flow pumps 510X, 510Y, and 5102, a
plurality of pipes 520X, 520Y, and 520Z, a merging pipe 530, a
plurality of liquid quantity sensors 540X, 540Y, and 540Z, a power
source section 550, a switch section 560, an ultrasonic vibrator
570, a radio frequency (RF) amplifier 580, a blowing section 590,
and a control section 600.
[0030] FIG. 16 shows a scent provision system disclosed in Japanese
Unexamined Patent Application Publication No. 2013-74476.
[0031] In FIG. 16, a reproduction system 610 which plays back a
moving image medium with sound and a scent provision apparatus 620
which emits a scent provided by the reproduction system 610 are
provided. The reproduction system 610 is provided with a scent
information processing section 613 which generates a control signal
for scent generation, a scent generation section 614 which
generates a desired scent on the basis of a control signal output
from the scent information processing section 613, and a cleaning
section 615 which gets rid of a scent collected from the air. The
scent provision apparatus 620 is mounted on an eyeglass type
display which a user wears and receives a scent together with a
picture.
[0032] However, the apparatus disclosed in Japanese Unexamined
Patent Application Publication No. 2011-184486 and the system
disclosed in Japanese Unexamined Patent Application Publication No.
2013-74476 suffer from the problem of user-unfriendliness due to
large configuration.
[0033] Under the circumstances, the present inventor has studied
the remedial measures below.
[0034] (1) A head-mounted display according to an aspect of the
present disclosure is a head-mounted display including a playback
processor which plays back a moving image from first time until
second time, the first time corresponding to timing of starting
playback of the moving image and the second time corresponding to
timing of ending playback of the moving image, a box for placing a
container containing a perfume inside, a filled section which is
temporarily filled with the perfume and emits the temporarily
filled perfume according to starting playback of the moving image,
and a tubular vent hole which is in contact with a nose of a user
when the user wears the head-mounted display.
[0035] (2) In the aspect, the filled section may have a first
opener-closer at an upper portion, in which the first opener-closer
may open according to ending playback of the moving image.
[0036] (3) In the aspect, the smell reproduction system may further
include a fan above the vent hole and below the filled section.
[0037] (4) In the aspect, the smell reproduction system may further
include a gyro which senses a direction that the user faces.
[0038] (5) In the aspect, the vent hole may include one left vent
hole and one right vent hole.
[0039] (6) In the aspect, the fan may include one left fan and one
right fan.
[0040] (7) In the aspect, the smell reproduction system may further
include a second opener-closer between the box and the filled
section, and the second opener-closer may open and close according
to starting and ending playback of the moving image.
[0041] (8) In the aspect, starting of rotation, the fan rotates
both forward and backward, opening and closing of the first
opener-closer, opening and closing of the second opener, stopping
and stopping of rotation of the fan, rotation direction of the fan
and the number of revolutions of the fan may be controlled in
accordance with a control signal.
[0042] (9) In the aspect, the control signal may be a sound signal
which is included in the moving image.
[0043] (10) In the aspect, the control signal may be a MIDI signal
corresponding to the moving image.
[0044] (11) In the aspect, the smell reproduction system may
further include a control signal processor which generates the
control signal.
[0045] (12) In the aspect, the second opener-closer may open at
third time and closes at fourth time, the third time being before
the first time according to the control signal, and the fourth time
being after the first time and before the second time, the first
opener-closer may open at the fourth time and closes at fifth time
according to the control signal, the fifth time being after the
second time, the fan may rotate forward at the third time or sixth
time according to the control signal, the sixth time being after
the third time and before the first time, and the fan may rotate
backward at the fourth time according to the control signal, the
fan may stop at the fifth time according to the control signal.
[0046] (13) In the aspect, the smell reproduction system may
further include a distance calculator which calculates a distance
between an object in the moving image and the nose of the user on a
basis of the sensed direction and a predetermined position of the
object in the moving image, the object being a source of a smell
corresponding to the emitted perfume, and a scent controller which
performs control to change the number of revolutions of the fan in
accordance with the calculated distance.
[0047] Embodiments of the present disclosure will be described
below with reference to the drawings.
[0048] FIG. 1 shows a configuration of a smell reproduction system.
The smell reproduction system is composed of a playback processor
100 which plays back a moving image and a smell reproduction
apparatus 200 which provides a smell. As shown in FIG. 1, the
playback processor 100 is integral with the smell reproduction
apparatus 200.
[0049] The smell reproduction apparatus 200 is a head-mounted
display and includes lenses 11 for enlarging a displayed picture
and guiding the picture to eyes, a central section 12, and temple
sections 18.
[0050] A user views an image through the lenses 11. The central
section 12 is a recessed portion for causing the head-mounted
display to engage with a nose of the user. The temple sections 18
are portions to be hooked over ears of the head-mounted display.
The playback processor 100 provides a moving image to be played
back to the smell reproduction apparatus 200. A moving image may be
played back by playing back a medium, such as a DVD or a BD, or by
downloading or streaming a moving image file on a network. An
object to be played back is not limited to a moving image, and a
game image may be provided.
[0051] A smell playback processor according to the present
disclosure will be described below in a first embodiment.
First Embodiment
[0052] FIG. 2 shows a configuration of a smell reproduction
apparatus 200 according to the present disclosure.
[0053] The smell reproduction apparatus 200 is of head-mounted
display type. The smell reproduction apparatus 200 is particularly
marked by constituent features (vent holes 13, smell boxes 14,
opener-closers 15, and a fan 16) for reproducing a smell besides an
image display section like a liquid crystal panel.
[0054] Note that the configuration except for features of the
present disclosure will not be described in detail but a
configuration of a conventional head-mounted display can be used. A
head-mounted display according to the present disclosure is not
limited to a smell reproduction apparatus with the configuration
shown in FIG. 2.
[0055] Each vent hole 13 is tubular, and an opening is located near
an upper portion of a nose when a user wears the smell reproduction
apparatus 200.
[0056] A container containing a perfume can be placed in each smell
box 14. A smell can be changed by changing a container.
[0057] Each opener-closer 15 is closed under normal conditions and
is opened to release a smell in the corresponding smell box 14.
[0058] The fan 16 rotates so as to emit the smell remaining in the
filled section 17 through the vent holes 13. Two fans 16 are
desirably mounted such that left and right ones can be controlled
independently of each other, but even one will do.
[0059] The filled section 17 is filled with part of a smell from
the smell boxes 14.
[0060] The operation of the smell reproduction apparatus with the
above-described configuration will be described with reference to
FIGS. 2 and 3.
[0061] FIG. 3 is a timing diagram of the operations of the
opener-closers 15 and the fan 16 according to the first
embodiment.
[0062] A container containing a perfume corresponding to a moving
image to be played back is placed in each smell box 14.
[0063] When playback of the moving image is started, the
opener-closers 15 are opened several seconds before timing of smell
emission (a scent reproduction start time t1). At the same time as
or slightly later than the opening, the fan 16 starts rotating.
[0064] The rotation of the fan 16 creates an airflow. The smell of
the perfume travels from the smell boxes 14 to a nose through the
filled section 17 and the vent holes 13.
[0065] Finally, the opener-closers 15 are closed before a scent
reproduction end time (t2), and rotation of the fan 16 is then
stopped.
[0066] The earlier closing of the opener-closers 15 stops a smell
from entering the filled section 17. A smell remaining in the
filled section 17 is discharged by the fan 16 after the closing,
which stops a smell from floating out continuously.
[0067] The stopping of rotation of the fan 16 stops air from
flowing, and the nose no longer senses a smell.
[0068] For example, a sound signal may be used to control rotation
of the fan 16. Use of a low-frequency sinusoidal signal as a
single-channel sound signal of a multichannel sound signal
accompanying a moving image file to control the fan 16 removes the
need for a particularly complicated control section.
[0069] A sound signal belonging to another channel may be similarly
used to control the opener-closers 15. Alternatively, a control
signal shared with the fan 16 may be used.
[0070] For example, a common control sound signal for the
opener-closers 15 and the fan 16 is used in the manner below. A
sound signal may be reproduced in advance to control the
opener-closers 15, and the sound signal for controlling the
opener-closers 15 may be subjected to delay processing and used as
a control sound signal for the fan 16.
[0071] As another example of a control signal, a MIDI signal may be
used. If a MIDI signal is used, a scent controller may be provided
in the playback processor 100 or the smell reproduction apparatus
200 to control the fan 16 and the opener-closers 15 in accordance
with a MIDI signal.
[0072] Note that smell control metadata indicating whether to
enable or disable smell emission may be prepared to control
rotation of the fan 16. Each control metadata entry indicates the
absence of a smell when the entry has a value of 0 and the presence
of a smell when the entry has a value of 1.
[0073] A control metadata entry is set in each video frame of a
video stream. This allows judgment as to whether to emit a smell in
one in question of the video frames.
[0074] FIG. 4 shows the timing diagram in FIG. 3 with a smell
control signal added thereto which is obtained by reproducing
metadata. As shown in FIG. 4, the scent reproduction start time
(t1) and the scent reproduction end time (t2) are defined by a
period when the smell control signal is 1.
[0075] A piece of control metadata may he stored in, for example,
an area (for example, user data in the case of MPEG-2 or an SEI
message in the case of MPEG-4 AVC) storing supplemental data of
each video frame of a video stream. With this configuration,
rotation control of the fan based on smell control metadata at
timing of decoding and displaying a video stream removes the need
for a complicated control section and allows control of smell
emission synchronized with a picture. Note that a piece of smell
control metadata need not be stored in every video frame and may be
stored in a top frame of a GOP.
[0076] The above-described control signals (a sound channel, a MIDI
signal, and control metadata) used to control smell emission will
be simply referred to as a smell control signal hereinafter.
(Application of First Embodiment)
[0077] FIGS. 5A and 5B show a configuration of a smell reproduction
apparatus when different smells are stored.
[0078] To implement sending of a plurality of different smells,
perfumes serving as sources of different smells are stored in a
smell box 14A and a smell box 14B, as shown in FIG. 5A.
Opener-closers 15A and 15B open and close respective doors to the
smell boxes 14A and 14B.
[0079] Pieces of timing information for emitting the perfumes are
separately stored in a moving image. For example, FIG. 5B shows an
example of the configuration of control metadata. Two pieces of
control data, a first smell control signal specifying scent
reproduction timing for the smell box 14A and a second smell
control signal specifying scent reproduction timing for the smell
box 14B, are prepared. The smell reproduction apparatus judges the
smell emission timing for the smell boxes 14A and 14B by referring
to the pieces of information.
[0080] The smell reproduction apparatus opens only the
opener-closer 15A if the smell reproduction apparatus judges, by
referring to the first smell control signal, that it is time to
send a scent from the smell box 14A and opens only the
opener-closer 15B if the smell reproduction apparatus judges, by
referring to the second smell control signal, that it is time to
send a scent from the smell box 14B.
[0081] With the above-described configuration, a plurality of
different smells can be provided to a user during same content.
Note that lack of direct connection between the smell boxes 14A and
14B and the vent holes 13 and the presence of the filled section 17
that is temporarily filled allow implementation of provision of a
plurality of different smells. If the opener-closers 15A and 15B
are controlled by the process of storing a low-frequency sinusoidal
signal as a single-channel sound signal of a multichannel sound
signal accompanying a moving image file, as described above,
respective channels may be prepared for the plurality of smells.
The same applies to a case using a MIDI signal, and a plurality of
MIDI signals may be stored.
(Sending of Smell Suited to Loading Status)
[0082] In the first embodiment, smell emission is controlled in
accordance with a control signal set in a moving image. The
configuration may be such that a smell emission method can be
selected in accordance with a user's preferences or the loading
status of the smell boxes 14. A specific configuration will be
described.
[0083] FIG. 6 is a diagram for explaining a smell box set value. As
shown on the right side of FIG. 6, a smell reproduction system
includes a smell box set value, a scent controller, and a playback
processor.
[0084] A piece of smell control information stored in a moving
image has a smell ID which is set for a corresponding smell. The
smell reproduction system has the added "smell box set value"
indicating whether to send a smell specified in the moving
image.
[0085] For example, a plurality of smells are prepared for a moving
image, and pieces of control data having a smell ID of 0 and a
smell ID of 1 are stored in the moving image. In this case, if only
a perfume with the smell ID of 1 is stored in loaded smell boxes
14A and 14B, the smell box set value has only the smell ID of 1. A
smell reproduction apparatus refers to the smell box set value,
refers to only a control signal with the specified smell ID, and
emits a smell.
[0086] Note that the smell box set value may be set by a user
through a GUI or the like even when necessary smell boxes are
loaded. With this configuration, a smell suited to a user's
preferences or a situation can be emitted during a moving image,
for which a plurality of perfumes serving sources of smells are
set.
[0087] The smell box set value may be automatically set at the time
of smell box loading. For example, a configuration is conceivable
in which an NFC chip storing information, such as a smell ID of a
corresponding scent, is embedded in each smell box, and the smell
reproduction apparatus has an NFC communication function. The smell
reproduction apparatus can judge which perfume the loaded smell box
stores by reading the information of the NFC chip in each smell box
through NFC communication. All smell boxes preferably have unique
smell IDs.
(Quantification of Smell)
[0088] A piece of information obtained by quantifying a smell may
be included in a piece of information to be stored as the smell box
set value or a smell control signal to be stored in a moving image.
An example of smell quantification is a method adopted in a smell
identification device by SHIMADZU CORPORATION. There are various
methods for smell quantification.
[0089] The smell reproduction apparatus may select a smell box to
be opened and closed in accordance with the degree of closeness to
a piece of quantified information stored as the smell box set value
(the degree of closeness is higher if an absolute value of a
difference is smaller).
[0090] For example, if a smell value of a smell control signal with
the smell ID of 0 included in a moving image is 100, a smell value
of a smell control signal with the smell ID of 1 included in the
moving image is 200, and a smell value stored as the smell box set
value is 180, smell control is performed using the smell control
signal with the smell ID of 1, which has a smaller absolute value
for a difference in value. With this configuration, a scent which
is not the same as but close to a scent included in a moving image
can be provided to a user. The user can make effective use of a
smell box.
[0091] Note that, in this case, a threshold may be set for the
degree of closeness. For example, assume that a smell value of a
smell control signal with the smell ID of 0 included in a moving
image is 100, a smell value of a smell control signal with the
smell ID of 1 included in the moving image is 200, a smell value
stored as the smell box set value is 1,000, and a smell threshold
is 500. In this case, absolute values of differences for both
smells exceed the threshold value of 500. The smell reproduction
apparatus may judge that the smells are quite different to disable
both the smells. With this configuration, a scent different from an
impression of a user is not provided to the user any longer.
[0092] Note that a smell control signal may not be stored in a
moving image and may be separately transmitted through a network.
With this configuration, it is possible to easily change only a
smell sent from an object by not changing video content, such as a
moving image, but changing only a smell control signal.
(Expansion of Boxes)
[0093] Note that the number of boxes is not limited to two and can,
of course, be expanded in the manner shown in FIG. 7. FIG. 7 shows
an example of a configuration in which a smell reproduction
apparatus stores three or more smell boxes.
[0094] For example, assume that four types of scents are stored, as
in FIG. 7, and that sending of a scent from a smell box 14A is set
in a smell control signal at the time of playback of a first
picture. If only a smell control signal, in which whether to send a
smell from a smell box 14B is set, is updated via a network at the
time of playback of a next picture, a smell to be sent can be
easily changed even during same content.
[0095] This can be applied in the manner below. For example, if a
scent of a perfume used by an idol is updated in the form of a
"smell control signal" every day in video content associated with
the idol, a user can enjoy the idol video content every day
together with a perfume used by the idol on the day.
(Addition of Mixture Proportion)
[0096] Note that smell control signals may include pieces of
information indicating mixture proportions for smell boxes with
different smells.
[0097] FIG. 8 is a diagram for explaining a method for mixing a
plurality of smells. For example, in smell control signals for a
moving image in FIG. 8, instructions for smell sending are given
for a group of frames denoted by X and a group of frames denoted by
Y. A value of each of control signals is a piece of information
indicating a mixture proportion and is a percentage. That is FIG. 8
shows that a smell sent in the group X of frames is a smell
obtained by mixing a smell with a smell ID of 0 and a smell with a
smell ID of 2 in proportions of 30% and 70%, respectively.
Similarly, FIG. 8 shows that a smell sent in the group Y of frames
is a smell obtained by mixing a smell with a smell ID of 1 and the
smell with the smell ID of 2 in proportions of 50% and 50%,
respectively. To mix smells in such mixture proportions, a smell
reproduction apparatus may adjust the number of revolutions of the
fan 16.
[0098] With this configuration, various smells can be created even
with a small number of smell boxes. Calculation of a smell mixture
proportion parameter may be implemented in a cloud system, and only
a result of the calculation may be transmitted as a smell control
signal over a network. This allows updating of content without
complicated processing on the reproduction apparatus side.
Second Embodiment
[0099] FIG. 9 is a diagram of a configuration of a smell
reproduction apparatus according to a second embodiment of the
present disclosure. In FIG. 9, same components as those in the
smell reproduction apparatus in FIGS. 1 and 2 are denoted by same
reference numerals, and a description thereof will be omitted.
[0100] The smell reproduction apparatus in FIG. 9 is different from
the smell reproduction apparatus in FIG. 2 in that a gyro 19 is
provided. FIG. 9 is different from FIG. 2 in that a distance
calculator 101 and a scent controller 102 are provided in addition
to a playback processor 100. The operation of the smell
reproduction apparatus with the above-described configuration will
be described with reference to FIGS. 10A and 10B together with FIG.
9.
[0101] FIGS. 10A and 10B are diagrams showing positional
relationships between an object and an operator according to the
second embodiment of the present disclosure. A position serving as
a source of a smell is set in advance in a moving image to be
played back. For example, assume that an object 300 which
reproduces a smell is located to the right of a person wearing the
smell reproduction apparatus, as shown in FIG. 10A. The person
wearing the smell reproduction apparatus faces to the right and
looks toward the object 300, as in FIG. 10B. At this time, which
direction the person faces is detected by the gyro 19 attached to
the smell reproduction apparatus. A distance between the person
wearing the smell reproduction apparatus and the object 300 is
calculated by the distance calculator 101. As the distance becomes
shorter, the scent controller 102 increases the number of
revolutions of a fan 16, and the person wearing the smell
reproduction apparatus comes to smell the object 300. The distance
calculator 101 may calculate distances to left and right halves of
a nose independently of each other to thereby control the numbers
of revolutions of the left and right fans 16 independently of each
other or make a distinction between left and right rotation time
periods.
Third Embodiment
[0102] FIG. 11 is a diagram of a configuration of a smell
reproduction apparatus according to a third embodiment of the
present disclosure. In FIG. 11, same components as those in the
smell reproduction apparatus in FIG. 2 are denoted by same
reference numerals, and a description thereof will be omitted.
[0103] In FIG. 11, the smell reproduction apparatus is different
from the smell reproduction apparatus in FIG. 2 in that a filled
section 17 has a filled section opener-closer 20. The operation of
the smell reproduction apparatus with the above-described
configuration will be described with reference to FIG. 12 together
with FIG. 11.
[0104] FIG. 12 is a timing diagram of the operations of an
opener-closer 15, a fan 16, and the filled section opener-closer 20
according to the third embodiment of the present disclosure.
[0105] A container containing a perfume which is fitted to, for
example, a moving image to be played back is first placed in each
smell box 14.
[0106] When playback of the moving image is started, the
opener-closers 15 are opened several seconds before timing of smell
emission (a scent reproduction start time t1). At the same time as
or slightly later than the opening, the fan 16 starts being
positively rotated. The positive rotation causes air to flow toward
vent holes 13. The positive rotation of the fan 16 creates an
airflow. A smell travels from the smell boxes 14 to a nose through
the filled section 17 and the vent holes 13.
[0107] The opener-closers 15 are then closed before a scent
reproduction end time (t2). At the same time, the filled section
opener-closer 20 is opened.
[0108] Finally, the fan 16 is negatively rotated.
[0109] The earlier closing of the opener-closers 15, the opening of
the filled section opener-closer 20, and the negative rotation of
the fan 16 cause air to flow against the vent holes 13. That is, a
smell remaining in the filled section 17 is discharged through the
filled section opener-closer 20. After the negative rotation of the
fan 16, the filled section opener-closer 20 is closed, and rotation
of the fan 16 is stopped. In this manner, the smell remaining in
the filled section 17 can be discharged.
[0110] The filled section opener-closer 20 is configured to be
openable and closable with timing, as described above. An air hole
may be formed in an upper portion of the filled section 17. Note
that a smell enable/disable button may be provided at the smell
reproduction apparatus and that the smell reproduction apparatus
may refer to the status of the smell enable/disable button and
perform smell emission control.
[0111] In this case, when smell emission is disabled, the smell
reproduction apparatus closes the opener-closers 15 to prohibit
smell emission even if smell sending is specified by a smell
control signal. With this configuration, a user can easily make an
adjustment to enable or disable smell emission in accordance with a
situation or preferences. Such a button is preferably located in
the vicinity of a central section 12 that is close to the position
of a nose of the user because the user intuitively knows the
position of the button. A gesture recognition function, such as
Kinect, may be used, and a nose-pinching gesture may be used as an
operation of enabling or disabling smell emission.
[0112] Note that the smell reproduction apparatus may be provided
with a button or a slide switch for setting smell level and that
the smell reproduction apparatus may refer to the smell level and
perform smell emission control.
[0113] In this case, the smell reproduction apparatus adjusts the
intensity of smell in accordance with the smell level. More
specifically, the smell reproduction apparatus adjusts the number
of revolutions of the fan 16. With this configuration, a user can
easily adjust the intensity of smell in accordance with a situation
or preferences. Such a button is preferably located in the vicinity
of the central section 12 that is close to the position of the nose
of the user because the user intuitively knows the position of the
button.
[0114] Note that although a system which emits a smell
synchronously with a picture has been described in the present
embodiment, the present disclosure is not limited to smell emission
synchronous with a picture. If the user can select between
synchronism and asynchronism using a GUI menu or the like and can
select a smell box to emit a smell in the case of asynchronism,
smell emission asynchronous with a picture can be implemented.
(Application of Third Embodiment)
[0115] The present application is intended for interlock with a
moving image recorded in real time.
(Sense of Augmented Reality Using Smell)
[0116] FIGS. 13A and 13B are diagrams for explaining a
configuration which provides a sense of augmented reality using a
smell. In particular, if cameras are mounted at eyeglass sections
of a smell reproduction apparatus, as shown in FIG. 13A, moving
images taken by the cameras are displayed without change, and a
smell is changed depending on the content of the images, an
augmented reality effect can be given.
[0117] A specific system configuration is shown in FIG. 13B. In
FIG. 13B, the smell reproduction apparatus has the additional
miniature cameras. The miniature cameras are set at the positions
of eyes when a user wears the smell reproduction apparatus, and the
user can receive pictures at the specified positions.
[0118] Pictures taken by the miniature cameras are transmitted to a
playback processor and are compressed as video streams and
transmitted to a smell determiner. The playback processor displays
the pictures output from the miniature cameras on a display on the
smell reproduction apparatus without change. A scent controller of
the smell reproduction apparatus emits a smell on the basis of a
smell control signal received from the smell determiner.
[0119] The smell determiner is composed of a body recognition
processing section and a smell determination section.
[0120] The body recognition processing section decodes the input
video streams, performs image recognition processing on a resultant
picture, identifies a body in the picture, and inputs information
on the body to the smell determination section.
[0121] The smell determination section refers to a smell DB and
identifies a smell corresponding to the body. For example, the
smell determination section selects a smell of a "banana" if there
is a "banana" in the picture and a smell of a "freshscent perfume"
if there is an idol in the picture. In this manner, the smell
determination section identifies a piece of scent information
corresponding to the body. The smell determination section creates
a smell control signal and transmits the smell control signal to
the smell reproduction apparatus.
[0122] With this configuration, an augmented reality effect
corresponding to a picture actually viewed by a user can be
achieved, and an emphasized smell can be delivered to the user. For
example, amplification of a smell of food allows the user to enjoy
a dish. An application is also conceivable which gives a weight
loss effect to a user by sending a smell decreasing appetite.
[0123] The body recognition section may support an AR marker and be
configured to determine an object to be displayed on an AR marker
and transmit a result of the determination to the playback
processor of the smell reproduction apparatus. The playback
processor may create an object, such as 3DCG, and display the
object superimposed on a picture displayed on the smell
reproduction apparatus.
[0124] With this configuration, the smell reproduction apparatus
can display an object corresponding to an AR marker to a user and
send a smell corresponding to the object, as shown in FIG. 14A. A
piece of scent information may be expressed as a piece of character
information like "LEMON SCENT" in FIG. 14A, a color, or the like on
a screen.
(Interlock With Perfume)
[0125] The sense of taste and a perfume have a close relationship.
It is well known that a taste sensed by a human changes with a
change in perfume. For example, if a human smells a chocolate while
chewing tasteless gum, the human feels like chewing chocolaty
gum.
[0126] For this reason, a smell different from the actual smell of
a drink or a food is provided to a user, thereby making the user
virtually experience feels of various foods.
[0127] Referring to FIG. 14B, in a picture taken by the miniature
cameras, a cup is labeled "LEMON JUICE". In fact, the cup contains
not lemon juice but a sugar solution.
[0128] The smell determiner detects the label, judges that "LEMON
JUICE" is denoted on the label, and transmits a smell control
signal for lemon. The smell reproduction apparatus emits a lemon
smell, and a user can enjoy a sense of drinking lemon juice in a
simulated manner. If a liquid portion of the picture is
simultaneously changed to lemon yellow, more effect can be
obtained. Note that although the label "LEMON JUICE" is recognized
to determine how a food or a drink is simulated, the smell
reproduction apparatus may automatically make a determination on
the basis of information of loaded smell boxes.
[0129] Note that a server on a network may play as sections which
process calculations, such as a distance calculator and the smell
determiner, in the present embodiment. This configuration allows
device miniaturization.
[0130] A smell reproduction apparatus according to the present
disclosure is a small-sized smell reproduction apparatus mounted on
a head-mounted display. The smell reproduction apparatus is
small-sized and can be easily used by a general user.
* * * * *