U.S. patent application number 16/084010 was filed with the patent office on 2019-11-14 for method for operating a virtual reality system, and virtual reality system.
This patent application is currently assigned to AUDI AG. The applicant listed for this patent is AUDI AG. Invention is credited to Marcus KUEHNE.
Application Number | 20190347858 16/084010 |
Document ID | / |
Family ID | 58191387 |
Filed Date | 2019-11-14 |
![](/patent/app/20190347858/US20190347858A1-20191114-D00000.png)
![](/patent/app/20190347858/US20190347858A1-20191114-D00001.png)
![](/patent/app/20190347858/US20190347858A1-20191114-D00002.png)
United States Patent
Application |
20190347858 |
Kind Code |
A1 |
KUEHNE; Marcus |
November 14, 2019 |
METHOD FOR OPERATING A VIRTUAL REALITY SYSTEM, AND VIRTUAL REALITY
SYSTEM
Abstract
A virtual object is displayed in a virtual environment by
virtual reality glasses placed on a first person. A configuration
menu is overlaid on the virtual object by the virtual reality
glasses, providing multiple configuration options for a specified
functional group of the displayed virtual object, as soon as a
second person activates a configuration mode on a controller
selecting one of a plurality of overlaid configuration options
according to a selection action carried out by the second person on
the controller. The display of the virtual object is changed
according to the selection that is carried out.
Inventors: |
KUEHNE; Marcus; (Beilngries,
DE) |
|
Applicant: |
Name |
City |
State |
Country |
Type |
AUDI AG |
Ingolstadt |
|
DE |
|
|
Assignee: |
AUDI AG
Ingolstadt
DE
|
Family ID: |
58191387 |
Appl. No.: |
16/084010 |
Filed: |
February 9, 2017 |
PCT Filed: |
February 9, 2017 |
PCT NO: |
PCT/EP2017/052836 |
371 Date: |
September 11, 2018 |
Current U.S.
Class: |
1/1 |
Current CPC
Class: |
H04N 13/344 20180501;
G06Q 30/06 20130101; G06F 16/5866 20190101; G06T 19/006 20130101;
G06F 3/04842 20130101; G06Q 30/0621 20130101; G06K 9/00671
20130101; G06T 7/70 20170101; G06F 3/011 20130101; G06F 3/0482
20130101; G02B 27/017 20130101 |
International
Class: |
G06T 19/00 20060101
G06T019/00; G06K 9/00 20060101 G06K009/00; G06F 3/01 20060101
G06F003/01; G06F 16/58 20060101 G06F016/58; G06T 7/70 20060101
G06T007/70; H04N 13/344 20060101 H04N013/344 |
Foreign Application Data
Date |
Code |
Application Number |
Mar 12, 2016 |
DE |
102016003074.7 |
Claims
1-10. (canceled)
11. A method for operating a virtual reality system, comprising:
displaying a virtual object, arranged in virtual surroundings, by
virtual reality goggles worn by a first person; showing a
configuration menu, having equipment options, for a prescribed
group of functions of the virtual object by the virtual reality
goggles as soon as a second person activates a configuration mode
on a control device; selecting one of the equipment options in
accordance with a selection action performed by the second person
on the control device; changing depiction of the virtual object in
accordance with the one of the equipment options selected; and
visually highlighting the group of functions or at least a
component of the virtual object belonging to the group of
functions, as soon as the configuration menu for the group of
functions is shown.
12. The method as claimed in claim 11, wherein the group of
functions for which the configuration menu is shown is prescribed
in accordance with an input made by the second person on the
control device.
13. The method as claimed in claim 12, wherein a selection symbol
by which the one of the equipment options selected is visually
marked within the configuration menu.
14. The method as claimed in claim 13, wherein the depiction of the
virtual object is not changed until selection of the one of the
equipment options has been confirmed by the second person on the
control device.
15. The method as claimed in claim 14, wherein the showing of the
configuration menu includes displaying respective information
windows for the equipment options when the second person inputs an
applicable control command on the control device.
16. The method as claimed in claim 15, wherein the showing of the
configuration menu includes a virtual distance within the virtual
surroundings between the configuration menu and a virtual
observation position of the first person that is reduced as a
distance between the virtual observation position and the group of
functions is reduced.
17. The method as claimed in claim 16, wherein the virtual distance
is limited to a prescribed extent.
18. The method as claimed in claim 11, wherein the depiction of the
virtual object is not changed until selection of the one of the
equipment options has been confirmed by the second person on the
control device.
19. The method as claimed in claim 11, wherein the showing of the
configuration menu includes displaying respective information
windows for the equipment options when the second person inputs an
applicable control command on the control device.
20. The method as claimed in claim 11, wherein the showing of the
configuration menu includes a virtual distance within the virtual
surroundings between the configuration menu and a virtual
observation position of the first person that is reduced as a
distance between the virtual observation position and the group of
functions is reduced.
21. A virtual reality system used by first and second persons,
comprising virtual reality goggles, worn by the first person,
producing a display including a virtual object arranged in virtual
surroundings; and a control device, coupled to and controlling the
display produced by the virtual reality goggles, configured to
perform a method including receiving an activation command of a
configuration mode from the second person, generating, in the
display of the virtual reality goggles upon receipt of the
activation command for the configuration mode, a configuration menu
having equipment options for a prescribed group of functions of the
virtual object with at least one of a component of the virtual
object, belonging to the group of functions, and the group of
functions being visually highlighted as the configuration menu is
displayed, detecting a selection action by the second person,
selecting one of the equipment options in accordance with the
selection action, changing depiction of the virtual object in
accordance with the one of the equipment options selected.
22. The virtual reality system as claimed in claim 21, wherein the
method further includes receiving an input from the second person,
and prescribing the group of functions in accordance with the input
by the second person.
23. The virtual reality system as claimed in claim 22, wherein the
method further includes generating in the display of the virtual
reality goggles, a selection symbol visually marking the one of the
equipment options within the configuration menu.
24. The virtual reality system as claimed in claim 23, wherein the
method further includes confirming selection of the one of the
equipment options by the second person, and wherein the changing of
the depiction of the virtual object occurs after the selection of
the one of the equipment options has been confirmed by the second
person.
25. The virtual reality system as claimed in claim 24, wherein the
method further includes receiving a configuration control command
from the second person, and wherein the generating of the
configuration menu includes displaying respective information
windows for the equipment options when the second person inputs the
configuration control command.
26. The virtual reality system as claimed in claim 25, wherein the
generating of the configuration menu includes a virtual distance
within the virtual surroundings between the configuration menu and
a virtual observation position of the first person that is reduced
as a distance between the virtual observation position and the
group of functions is reduced.
27. The virtual reality system as claimed in claim 26, wherein the
virtual distance is limited to a prescribed extent.
28. The virtual reality system as claimed in claim 21, wherein the
method further includes confirming selection of the one of the
equipment options by the second person, and wherein the changing of
the depiction of the virtual object occurs after the selection of
the one of the equipment options has been confirmed by the second
person.
29. The virtual reality system as claimed in claim 21, wherein the
method further includes receiving a configuration control command
from the second person, and wherein the generating of the
configuration menu includes displaying respective information
windows for the equipment options when the second person inputs the
configuration control command.
Description
CROSS REFERENCE TO RELATED APPLICATIONS
[0001] This application is the U.S. national stage of International
Application No. PCT/EP2017/052836, filed Feb. 9, 2017 and claims
the benefit thereof. The International Application claims the
benefit of German Application No. 10 2016 003 074.7 filed on Mar.
12, 2016, both applications are incorporated by reference herein in
their entirety.
BACKGROUND
[0002] Described below are a method for operating a virtual reality
system and to a virtual reality system.
[0003] A virtual reality system can be used to depict a virtual
reality, virtual reality usually referring to the depiction and
simultaneous perception of the physical properties of reality in
interactive virtual surroundings computer-generated in real
time.
[0004] Virtual reality systems can have virtual reality goggles for
displaying virtual surroundings. Virtual reality goggles are a
particular form of what is known as a head mounted display, which
is a visual output device worn on the head. The output device
presents images on a near-to-eye screen or projects them directly
onto the retina. In this case, virtual reality goggles additionally
have sensors for detecting the movement of the head. It is thus
possible for the display of computed graphics to be matched to the
movements of a wearer of the virtual reality goggles. The physical
proximity means that the displayed image areas of head mounted
displays appear much larger than those of free standing screens
and, in extreme cases, even cover the entire field of vision of the
user. Since respective displays of virtual reality goggles follow
all the head movements of a wearer by virtue of the head position,
the wearer gets the feeling that he is moving directly in an image
landscape generated by a computer.
[0005] In particular modern motor vehicles often have a
multiplicity of different equipment options, meaning that
customer-individual configuration can be very complex and
difficult.
SUMMARY
[0006] Described below is a method for operating a virtual reality
system and a virtual reality system by which a product can be
configured virtually in a particularly simple manner.
[0007] The method for operating a virtual reality system involves a
virtual object arranged in virtual surroundings being displayed by
virtual reality goggles put on by a first person. A configuration
menu, comprising multiple equipment options, for a prescribed group
of functions of the displayed virtual object is shown by the
virtual reality goggles as soon as a second person activates a
configuration mode of a control device. One of the shown equipment
options is selected in accordance with a selection action performed
by the second person on the control device, and the depiction of
the virtual object is changed in accordance with the selection
made.
[0008] By the method described herein, it is thus possible for a
person to be able to have the virtual reality goggles put on
continually during a configuration process for the displayed
virtual object. The second person can, whenever necessary, have a
perfectly fitting configuration menu shown by the virtual reality
goggles for respective groups of functions of the displayed virtual
object. The first person, who has put on the virtual reality
goggles, can then see which equipment options are available for the
relevant group of functions. The configuration menu displayed by
the virtual reality goggles likewise may be displayed by a display
device connected to the control device, specifically such that the
second person can likewise view the configuration menu. The wearer
of the virtual reality goggles and the further person can then talk
about which equipment option will be selected for the relevant
group of functions, for example. As soon as the second and first
persons have agreed, the second person can use the control device
to make an applicable selection, as a result of which the relevant
equipment option is selected. Subsequently, the depiction of the
virtual object is adapted in accordance with the selection
made.
[0009] The method is thus used to allow a selection window, in the
form of the configuration menu, assisting a configuration process
to be shown selectively. In this case, the configuration menu is
shown within the already displayed virtual surroundings by the
virtual reality goggles. By way of example, the control device may
be a tablet computer or a personal computer used by the second
person during the configuration process. The second person thus
controls the showing of the configuration menu and the selection of
the relevant equipment options during the method. By way of
example, the method can be used in a sales conversation in which
the first person has put on the virtual reality goggles, the second
person being able to be a vendor, for example. The vendor can have
the configuration menu shown within the already displayed virtual
surroundings by the virtual reality goggles at a suitable moment,
so that the customer, that is to say the first person, can see the
configuration menu, so that the customer is assisted in the
selection of one of the available equipment options by the showing
of the configuration menu. A potential purchaser, that is to say
the first person, who has put on the virtual reality goggles, and a
vendor, that is to say the second person, can thus configure the
displayed virtual object, which may be a virtual motor vehicle, for
example, in a particularly simple manner together in a particularly
simple and convenient manner.
[0010] An advantageous embodiment provides for the group of
functions for which the configuration menu is shown to be
prescribed in accordance with an input made by the second person on
the control device. If the virtual object is a virtual motor
vehicle, for example, then the second person can use the control
device to determine the group of functions of the virtual motor
vehicle for which an applicable configuration menu having
respective equipment options will currently be shown. The second
person may see the virtual perspective from which the first person
is currently looking at the virtual object with the virtual reality
goggles. In accordance with the virtual perspective of the first
person, the second person can use an applicable input on the
control device to select that group of functions of the virtual
motor vehicle, for example the rims, the bodywork or the like, for
which the applicable configuration menu will be shown within the
already displayed virtual surroundings. As such, the second person
can guide the first person through the configuration of the virtual
object step by step.
[0011] A further advantageous embodiment provides for the group of
functions or at least a component of the object that belongs to the
group of functions to be visually highlighted as soon as the
configuration menu for the group of functions is shown. As a
result, the first person can directly see, in a simple manner, that
group of functions of the virtual object for which the
configuration menu has just been shown. This facilitates the
configuration process considerably.
[0012] According to a further advantageous embodiment, there is
provision for a selection symbol by which the selected equipment
option is visually marked to be displayed within the shown
configuration menu. By way of example, the selection symbol can be
shown in the form of a rectangle, so that the wearer of the virtual
reality goggles, that is to say the first person, can directly see,
in a simple manner, which of the available equipment options have
just been selected by the second person. This considerably
facilitates the communication between the first and second persons
during the configuration of the virtual object.
[0013] In a further advantageous configuration, there is provision
for the depiction of the virtual object not to be changed until the
selection of the equipment option has been confirmed by the second
person on the control device. The depiction of the virtual object
thus may not be directly adapted with the selection of one of the
shown equipment options, but instead there is provision for the
depiction of the virtual object not to be changed until the
selection of the equipment option has additionally been confirmed
on the control device by the second person. The first and second
persons can thus calmly first of all talk about which of the
displayed selection options should actually be selected. Moreover,
there is also the possibility of various equipment options being
selected first of all and deselected again. As a result of the
final selection of the relevant equipment option first needing to
be confirmed by the second person before the depiction of the
displayed virtual object is adapted as appropriate, the wearer of
the virtual reality goggles, that is to say the first person, is
not distracted during the selection process by constant changing of
the depiction of the virtual object.
[0014] A further advantageous embodiment provides for respective
information windows to be displayed for the shown equipment
options, in particular if the second person inputs an applicable
control command on the control device. Further, there may also be
provision for a respective information window with supplementary
information for the relevant equipment option to be displayed for
the currently selected equipment option. As a result, the first
person can be provided with relevant information for the
configuration of the virtual object with regard to the currently
selected equipment option. This facilitates the configuration
process for the virtual object.
[0015] According to a further advantageous embodiment, there is
provision for the configuration menu to be shown such that a
virtual distance within the virtual surroundings between the
configuration menu and a virtual observation position of the first
person is chosen to be all the shorter the shorter the distance
between the virtual observation position and the group of functions
for which the configuration menu is shown. If the first person is
sitting in a virtual motor vehicle, for example, the configuration
menu is shown virtually somewhat closer to the first person than if
he should be outside the virtual motor vehicle, for example, and
therefore looks at the virtual motor vehicle from the outside. the
virtual distance may be limited to a prescribed extent, however.
Thus, should the first person move virtually very far away from the
displayed virtual object, the configuration menu is displayed
virtually no further away from the first person than the prescribed
extent is set, however. In particular, the configuration menu is
shown such that the equipment options are still easily readable and
viewable by the first person.
[0016] A further advantageous embodiment provides for that portion
of the virtual surroundings and/or of the virtual object that is
covered by the shown configuration menu to be hidden. This can
prevent a visual conflict from arising, for example because the
shown configuration menu is partly in the displayed virtual
object.
[0017] The virtual reality system has virtual reality goggles and a
control device or controller that is designed to actuate the
virtual reality goggles to perform the method or an advantageous
embodiment of the method. Advantageous configurations of the method
described herein can be regarded as advantageous configurations of
the virtual reality system in this case, the virtual reality system
performing the method.
BRIEF DESCRIPTION OF THE DRAWINGS
[0018] Further advantages, features and details will become more
apparent and more readily appreciated from the description below of
an exemplary embodiment and with reference to the drawings. The
features and combinations of features cited in the description
above and the features and combinations of features cited in the
description of the figures below and/or shown in the figures alone
can be used not only in the respectively indicated combination but
also in other combinations or on their own without departing from
the scope of the invention. The accompanying drawings are:
[0019] FIG. 1, a schematic block diagram of a virtual reality
system comprising virtual reality goggles and a control device for
actuating the virtual reality goggles;
[0020] FIG. 2, a schematic perspective view of a first person who
has put on the virtual reality goggles and a second person, sitting
at a table, who operates the control device of the virtual reality
system; and
[0021] FIG. 3, a side view of a virtual motor vehicle, arranged in
virtual surroundings, with inset rims for selection that is
displayed by the virtual reality goggles.
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT
[0022] A virtual reality system 10 having virtual reality goggles
12 and a control device 14 for actuating the virtual reality
goggles 12 is shown in a schematic depiction in FIG. 1. The virtual
reality system 10 is used to configure a virtual object, in
particular a virtual motor vehicle.
[0023] FIG. 2 schematically depicts a first person 16 and a second
person 18, the first person 16 having put on the virtual reality
goggles 12 and being in a capture space 20. The second person 18
operates the control device 14, which is a laptop in the example
shown in the present case. Alternatively, the control device 14 may
also be a tablet computer, a PC or the like, for example. The
virtual reality system 10 can have a capture device, not depicted
here, by which the position of the virtual reality goggles 12 can
be captured continually, at least so long as the person 16 is
within the capture space 20.
[0024] FIG. 3 shows a virtual motor vehicle 22 arranged within
virtual surroundings 24, such as a virtual showroom, for example.
The virtual motor vehicle arranged within the virtual surroundings
24 is displayed by the virtual reality goggles 12, which have been
put on by the first person 16. The second person 18, who is sitting
at the table, assists the first person 16 in configuring the
virtual motor vehicle 22. In the case shown here, the first person
16, who has put on the virtual reality goggles 12, is currently
supposed to be deciding on a particular rim variant.
[0025] To this end, the second person 18 uses the control device 14
to activate a configuration mode. Beforehand, the second person 18
selects that a rim selection is supposed to be made, for example.
As soon as the second person 18 has used the control device 14 to
activate the configuration mode, a configuration menu 26 is shown
within the virtual surroundings 24 displayed by the virtual reality
goggles 12. As can be seen, the shown configuration menu 26
displays various rims 28, which are respective equipment options
for the wheels 30 of the displayed virtual motor vehicle 22. As can
be seen, the front right wheel 30 is visually highlighted by a
marker 32 in the case shown here. The first person 16, who has put
on the virtual reality goggles 12, can thus easily see that the
shown configuration menu 26 belongs to the tires of the virtual
motor vehicle 22 group of functions.
[0026] Also--as soon as the configuration menu 26 is shown--a
selection symbol 34 may be displayed within the shown configuration
menu 26. The second person 18 can use applicable control actions on
the control device 14 to move the selection symbol 34, so that the
various available equipment options in the form of the displayed
rims 28 can be visually marked. The first person 16, who has put on
the virtual reality goggles 12, and the second person 18, who
performs the actual configuration action on the virtual motor
vehicle 22, can thus communicate with one another in a simple and
unequivocal manner about which of the equipment options, in the
present case that is to say which of the rims 28, is supposed to be
selected. The control device 14, in the present case that is to say
the laptop, may be used to display the same configuration menu 26
as is shown within the virtual surroundings 24 by the virtual
reality goggles 12.
[0027] As soon as the two people 16, 18 have agreed which of the
rims 28 is now actually supposed to be selected, the second person
18 confirms the selection, as a result of which a confirmation
symbol 36 may be displayed on the selection symbol. As soon as the
selection has been confirmed by the second person 18, the depiction
of the virtual motor vehicle 22 is adapted in accordance with the
selection made and confirmed.
[0028] In particular, the second person 18 can use an applicable
input on the control device 14 to prompt an information window, not
depicted here, to be shown. By way of example, it is also possible
for respective information windows to be shown for the various rims
28 if required, so that the first person 16 can be provided not
only with the shown configuration menu 26 but also with information
regarding the different rims 28 by the virtual reality goggles 12.
This facilitates the communication between the two people 16, 18
during the configuration process for the virtual motor vehicle
22.
[0029] The configuration menu 26 is in this case always shown by
the virtual reality goggles 12 such that the first person 16 can
easily see the different equipment options 28. The virtual distance
between the virtual observation position of the first person 16 and
the shown configuration menu 26 may be dynamically adapted in this
case. If the first person 16 is sitting inside the displayed
virtual motor vehicle 22, for example, then the configuration menu
26 is displayed virtually closer by the virtual reality goggles 12
than if the first person 16 should look at the virtual motor
vehicle 22 through the virtual reality goggles 12 from the
outside.
[0030] Furthermore, there may be provision for that portion of the
virtual surroundings 24 and/or the virtual motor vehicle 22 that is
covered by the shown configuration menu 26 to be hidden. This
serves in particular to avoid a visual conflict, for example if the
configuration menu 26 serving as a selection window were to be
practically partly in the displayed virtual motor vehicle 22.
[0031] The virtual reality system 10 explained is thus used to
provide a particularly simple and convenient way of configuring a
virtual product, for example in the form of the virtual motor
vehicle 22.
[0032] A description has been provided with particular reference to
preferred embodiments thereof and examples, but it will be
understood that variations and modifications can be effected within
the spirit and scope of the claims which may include the phrase "at
least one of A, B and C" as an alternative expression that means
one or more of A, B and C may be used, contrary to the holding in
Superguide v. DIRECTV, 358 F3d 870, 69 USPQ2d 1865 (Fed. Cir.
2004).
* * * * *