U.S. patent application number 16/443779 was filed with the patent office on 2019-10-03 for social media sharing in a virtual reality application.
The applicant listed for this patent is Relay Cars LLC. Invention is credited to Claudia Nefately Ambriz, Thom Denick, David Falstrup, Pat Hadnagy, Alex McClain, Ryan Murray.
Application Number | 20190304189 16/443779 |
Document ID | / |
Family ID | 66826061 |
Filed Date | 2019-10-03 |
United States Patent
Application |
20190304189 |
Kind Code |
A1 |
Falstrup; David ; et
al. |
October 3, 2019 |
SOCIAL MEDIA SHARING IN A VIRTUAL REALITY APPLICATION
Abstract
A method which allows a user who is viewing panoramic images
within a virtual reality (VR) head mounted device to share with a
social media network pre-loaded images of the content being viewed
and post a comment. Specifically, this invention will allow a user
to share an image of a vehicle just viewed or currently being
viewed by the user and upload a comment in regards to the vehicle
while still maintaining the integrity of the virtual reality
experience.
Inventors: |
Falstrup; David; (Rancho
Dominguez, CA) ; Denick; Thom; (Rancho Dominguez,
CA) ; McClain; Alex; (Los Angeles, CA) ;
Murray; Ryan; (Los Angeles, CA) ; Ambriz; Claudia
Nefately; (Los Pomona, CA) ; Hadnagy; Pat;
(Los Angeles, CA) |
|
Applicant: |
Name |
City |
State |
Country |
Type |
Relay Cars LLC |
Rancho Dominguez |
CA |
US |
|
|
Family ID: |
66826061 |
Appl. No.: |
16/443779 |
Filed: |
June 17, 2019 |
Related U.S. Patent Documents
|
|
|
|
|
|
Application
Number |
Filing Date |
Patent Number |
|
|
15481232 |
Apr 6, 2017 |
10325405 |
|
|
16443779 |
|
|
|
|
62320367 |
Apr 8, 2016 |
|
|
|
Current U.S.
Class: |
1/1 |
Current CPC
Class: |
G06T 2200/24 20130101;
G06F 3/04886 20130101; G06T 11/60 20130101; G06F 3/0484 20130101;
G06T 3/4038 20130101; G06T 19/003 20130101; G06T 19/00 20130101;
G06Q 50/01 20130101; G06F 3/0482 20130101 |
International
Class: |
G06T 19/00 20060101
G06T019/00; G06F 3/0488 20060101 G06F003/0488; G06T 3/40 20060101
G06T003/40; G06F 3/0484 20060101 G06F003/0484; G06F 3/0482 20060101
G06F003/0482; G06T 11/60 20060101 G06T011/60 |
Claims
1. A method for displaying panoramic images in a head mounted
display device, the method comprising the steps of: a. creating
computer generated images of a virtual reality experience to form
six faces of a cube and creating two identical cubes from said six
faces, placing together two inverted cubes to form a skybox,
wherein the skybox creates a virtual showroom for placing the
panoramic images within the skybox that is presented in the head
mounted display device; b. obtaining a multiplicity of pre-rendered
panoramic images of interiors of a multiplicity of vehicles and a
multiplicity of pre-rendered panoramic images of exteriors of said
multiplicity of vehicles; c. placing a specific one of said
panoramic images of a selected vehicle from either said
multiplicity of panoramic images of interiors and multiplicity of
panoramic images of exteriors within said skybox; d. placing spin
panoramic images of the vehicle within said skybox by having the
spin panoramic images of the vehicle line up with a front face of
the skybox for rotation of the vehicle within said skybox; e.
providing a plurality of graphic user interfaces that are
superimposed on the panoramic images in said skybox displayed in
the head mounted display device; f. displaying one of the plurality
of graphic user interfaces over the specific one of said panoramic
images of a selected vehicle, wherein the one of the plurality of
graphic user interfaces displays a dialog box comprising at least a
first button titled set up and a second button titled not now to
share the user's social experience of the specific panoramic images
of the vehicle with a social media; g. in response to user
selection of the first button titled set up, displaying a keyboard
virtual dialog box with a virtual keyboard that allows the user to
enter email address into the keyboard virtual dialog box to connect
to the user's social network account; h. in response to user
selection of the second button titled not now, closing said virtual
dialog box; i. providing one of the plurality of graphic user
interfaces that displays at least a first button for changing a
view from exterior panoramic images of the vehicle to interiors
panoramic images of the vehicle, a second button for changing the
vehicle being viewed by the user, a third button for switching to a
home screen, and a fourth button for sharing an image and a comment
with the user's social media network; j. providing one of the
plurality of graphic user interfaces that displays a to-be-shared
dialog box having a pre-loaded to-be-shared image, an experience
display text, and a custom text graphic user interface, wherein the
custom text graphic user interface receives user entry of a comment
into the custom text graphic user interface to share the pre-loaded
to-be-shared image with the comment entered by the user so that
other users of a social network can see the pre-loaded to-be-shared
image with the comment entered by the user.
2. The method in accordance with claim 1, further comprising: a
database that stores user names, user email addresses, upload
dates, and answers to Boolean queries, wherein said database is
accessed by a user to determine if said user has already created a
username prior to storing username within said database.
3. The method in accordance with claim 1, further comprising: said
to-be-shared image is uploaded to said social media network while
user is wearing said head mounted display device.
Description
RELATED APPLICATION INFORMATION
[0001] This patent is a continuation of patent Ser. No. 10/325,405,
titled "SOCIAL MEDIA SHARING IN A VIRTUAL REALITY APPLICATION"
issued Jun. 18, 2019. This patent also claims priority from
provisional patent application Ser. No. 62/320,367 filed on Apr. 8,
2016.
NOTICE OF COPYRIGHTS AND TRADE DRESS
[0002] A portion of the disclosure of this patent document contains
material which is subject to copyright protection. This patent
document may show and/or describe matter which is or may become
trade dress of the owner. The copyright and trade dress owner has
no objection to the facsimile reproduction by anyone of the patent
disclosure as it appears in the Patent and Trademark Office patent
files or records, but otherwise reserves all copyright and trade
dress rights whatsoever.
BACKGROUND
Field
[0003] The present invention relates to the field of photography
and virtual reality. In particular, the present invention is in the
field of enabling a user to share content with a social media
account or network while viewing the interior and exterior of a
vehicle within a virtual reality setting.
Description of the Prior Art
[0004] The following 8 patents and published patent applications
are the closest prior art references known to the inventors.
[0005] 1. United States Published Patent Application No.
2014/0280644 by applicant John Cronin on Sep. 18, 2014 for "Real
Time Unified Communications Interaction Of A Predefined Location In
A Virtual Reality Location".
[0006] 2. United States Published Patent Application No.
2015/0124051 by applicant to Robert Schinker on May 7, 2015 for
"Methods And Apparatus For Enhanced Reality Messaging",
[0007] 3. U.S. Pat. No. 9,135,754 issued to Ng-Thow-Hing et al on
Sep. 15, 2015 for "Method To Generate Virtual Display Surfaces From
Video Imagery Of Road Based Scenery".
[0008] 4. International Application No. WO 2015/183887 by applicant
Chase, Stephen on Dec. 3, 2015, for "Video Headphones, Systems,
Helmets, Methods And Video Content Files".
[0009] 5. International Application No. WO 2015/200732 by applicant
Imagine Universe, Inc. on Dec. 30, 2015 for "User Interface Using
Tagged Media, 3d Indexed Virtual Reality Images, And Global
Positioning System Locations, For Electronic Commerce",
[0010] 6. U.S. Pat. No. 9,367,950 issued to Scranton et al on Jun.
14, 2016 for "Providing Virtual Reality Experiences Based On
Three-Dimensional Designs Produced Using Three-Dimensional Design
Software",
[0011] 7. International Application No. WO 2016/130935 by applicant
Harvey, Gregory Lawrence on Aug. 18, 2016 for "System And Method To
Integrate Content In Real Time Into A Dynamic 3-Dimensional
Scene".
[0012] 8. International Application No. WO 2016/182504 by applicant
Chow, Bryan Shwo-kang on Nov. 17, 2016, for "A Virtual Reality
Headset".
DESCRIPTION OF THE DRAWINGS
[0013] Referring particularly to the drawings for the purpose of
illustration only and not limitation, there is illustrated:
[0014] FIG. 1 is a schematic view of all the cube faces (6 left and
6 right) that form the left cube and the right cube;
[0015] FIG. 2 is front view of either the left or right cube which
forms the virtual environment or virtual showroom where the cars
are viewed;
[0016] FIG. 3 is a schematic of the virtual camera illustrating
that the virtual camera is positioned to aim at the center of the
cube;
[0017] FIG. 4 is a front view of the cube/virtual environment with
an external panoramic image overlayed/layered;
[0018] FIG. 5 is a view within a virtual reality setting created by
a skybox with a virtual dialog box open having an explanation to
the user that the user may share their social experience with
social media with two graphic user interfaces titled "Set Up" and
"Now";
[0019] FIG. 6 is a view within a virtual reality setting created by
a skybox with a virtual dialog box open that allows the user to
enter their email address to connect to a user's social
network;
[0020] FIG. 7 is a screen display of a database with stored user
criteria illustrating usernames, uploaded dates, email addresses of
users and boolean questions;
[0021] FIG. 8 is a view within a virtual reality setting created by
a skybox and showing a panoramic car spin of a vehicle within the
skybox with four graphic user interfaces shown below the panoramic
car spin; and
[0022] FIG. 9 is an image of the virtual reality setting in FIG. 8
without the four graphic user interfaces in FIG. 8, but having a
graphic user interface to connect to Facebook.RTM. and a graphic
user interface to enter a comment.
SUMMARY OF THE INVENTION
[0023] The present invention is an apparatus and method which
allows a user who is viewing panoramic images within a virtual
reality (VR) head mounted device to share with a social media
network pre-loaded images of the content being viewed and post a
comment.
[0024] Specifically, this invention will allow a user to share an
image of a vehicle just viewed or currently being viewed by the
user and upload a comment with regard to the vehicle while still
maintaining the integrity of the virtual reality experience.
[0025] It is an object of the present invention to create a method
to allow a user to connect to the user's social account by using a
virtual keyboard to enter account user name and password and then
the application sends this information for verification and once
verified, allows the user to share images (with or without custom
commentary) from within the application.
[0026] It is a further object of the present invention to provide a
secondary application to connect to a user's social account in
Facebook.RTM. and Twitter.RTM. to the device using the VR
application (Samsung GearVR, Oculus Rift, etc.) via third party
application.
[0027] It is a further object of the present invention to provide
an application that allows communication through the following key
processes with a social sharing network while within a VR
setting:
[0028] 1. Providing the user a Call To Action ("CT A") to connect
their social accounts to the application. This CT A can appear at
the start of the application (app), or show up when he user
attempts to share content via a share icon CT A or some other user
interface (UI) indicator.
[0029] 2. The user enters the user's login information for their
social account, typically their e-mail address. The VR application
sends this information to a separate application, that allows the
user to confirm their account as well as connect to their
Facebook.RTM. and Twitter.RTM. accounts.
[0030] 3. The user's account information is shared in a database
associated with the device used to access the VR application, so
that when the user returns to the app, they can share at will
without having to reconnect their social accounts to the
application.
[0031] 4. When the user enters a VR experience, the app checks to
see if the user's previously entered email account is associated
with a Facebook.RTM. or Twitter.RTM. account.
[0032] 5. Once confirmed, upon clicking the share icon in the
application, the user is shown the image to be shared, allowed to
select which social network to share on and allowed the option to
enter a customized comment with the image.
[0033] Defined in detail, the present invention is a method
comprising the steps of: (a) creating computer generated images of
a virtual reality setting to form six faces of a cube and creating
two identical cubes from said six faces, placing together two
inverted cubes to form a skybox; (b) obtaining a multiplicity of
panoramic images of interiors of a multiplicity of selected
vehicles and a multiplicity of panoramic images of exteriors of
said multiplicity of selected vehicles; (c) placing a specific one
of said panoramic images of a selected vehicle from either said
multiplicity of panoramic images of interiors and multiplicity of
panoramic images of exteriors within said skybox; (d) placing a
sharing graphic user interface in said skybox that opens a
socialize virtual dialog box having a socialize display text, a set
up graphic user interface, and a not now graphic user interface
when selected by a user; (e) said set up graphic user interface
connected to a keyboard virtual dialog box with a virtual keyboard
that allows the user to enter there email address to connect to a
users social network account; (f) said not now graphic user
interface closing said socialize virtual dialog box when selected;
(g) a database that stores user names, user email addresses, upload
dates, and answers to boolean queries; and (h) a to-be-shared
dialog box having a to-be-shared image, an experience display text,
and a custom text graphic user interface; (i) whereby, said user
shares with a social media network a to-be-shared image and a
comment entered into said custom text graphic user interface for
other users of said social media network to view.
[0034] Defined more broadly, the present invention is a method
comprising the steps of: (a) creating computer generated images of
a virtual reality setting to form six faces of a cube and creating
two identical cubes from said six faces, placing together two
inverted cubes to form a skybox; (b) obtaining a multiplicity of
panoramic images of selected vehicles; (c) placing a specific one
of said panoramic images of a selected vehicle within said skybox;
(d) placing a sharing graphic user interface in said skybox that
opens a socialize virtual dialog box having a socialize display
text, a set up graphic user interface, and a not now graphic user
interface when selected by a user; (e) said set up graphic user
interface connected to a keyboard virtual dialog box with a virtual
keyboard that allows the user to enter there email address to
connect to a users social network account; (f) said not now graphic
user interface closing said socialize virtual dialog box when
selected; (g) a database that stores user names, user email
addresses, upload dates, and answers to boolean queries; and (h) a
to-be-shared dialog box having a to-be-shared image, an experience
display text, and a custom text graphic user interface; (i)
whereby, said user shares with a social media network a
to-be-shared image and a comment entered into said custom text
graphic user interface for other users of said social media network
to view.
[0035] Further novel features and other objects of the present
invention will become apparent from the following detailed
description, discussion and the appended claims, taken in
conjunction with the drawings.
DETAILED DESCRIPTION
[0036] Although specific embodiments of the present invention will
now be described with reference to the drawings, it should be
understood that such embodiments are by way of example only and
merely illustrative of but a small number of the many possible
specific embodiments which can represent applications of the
principles of the present invention. Various changes and
modifications obvious to one skilled in the art to which the
present invention pertains are deemed to be within the spirit,
scope and contemplation of the present invention as further defined
in the appended claims.
[0037] It is within the spirit and scope of the present invention
to use similar, comparable or substitute equipment known to one
skilled in the art as opposed to using the specific equipment and
items set forth below. It will be appreciated that this is simply a
recitation of the best method known to the inventors at the time
this patent application was filed and is not intended to limit the
course and scope of the specific equipment to achieve the new,
novel and non-obvious results of the present invention.
[0038] The following invention will further being explained using
panoramic images titled car spin panoramic images and pre-rendered
computer graphic images. The car spin panoramic images are of a
specific car that a user selects and the pre-rendered computer
graphic images are used to create the environment, referred to as a
skybox, in which the car spin panoramic images which are
viewed.
[0039] The specific panoramic images used within this disclosure
are panoramic images of
[0040] the interior and exterior of a car. The method used in
obtaining these panoramic car images is not specifically disclosed
within this patent application because the method of obtaining the
panoramic images is not the specific subject of this patent
application but explained herein to accurately describe what is
being viewed.
[0041] Similarly, the method of obtaining and generating the
computer graphic images used to create the environment is not
specifically disclosed, but the creation of the environment using
computer graphic images is disclosed for a complete understanding
of the present invention.
[0042] Referring to FIG. 1, the computer graphic (CG) images are
placed to create a 360 degree pre-rendered CG virtual environment.
The images are created in an equal rectangular format, then output
as six cube faces for presentation in virtual realty.
[0043] This virtual environment is created by combining 6 cube
faces as shown in FIG. 1. The textures are output with the
following number indexing: [0044] 0=FRONT [0045] 1=RIGHT [0046]
2=BACK [0047] 3=LEFT [0048] 4=TOP [0049] 5=BOTTOM
[0050] Stereo images are differentiated by a set of left eye images
and a set of right eye images. The left eye images from FIG. 1 are
left front face 302, left right face 304, left back face 306, left
left face 308, left top, face 310, and left bottom face 312. The
eye images from FIG. 1 are right front face 314, right right face
316, right back face 318, right left face 320, right top face 322,
and right bottom face 324. These images are then formed into a cube
and skybox 400 (shown in FIG. 2) to create the background
environment for car 230 (see FIG. 4) to be viewed. Skybox 400 is
created from two inverted cubes to create the virtual showroom
environment that the external panoramic images (filenames exterior
spinframes) can be placed into to form a shutterbox (shown in FIG.
9).
[0051] Once the textures are correctly set up on the cube object, a
virtual realty (VR) camera object 500 (as shown in FIG. 3) is
placed in the center of the cube. It is important that the VR
camera is placed at a fixed point directly in the center of the
cube.
[0052] Further referring to FIG. 3, the camera object 500 is a left
eye camera and a right eye camera parented to a "neck" control rig,
with the following setup: [0053] Both cameras are parented to the
parent "neck" control rig object. The left eye camera has the
following unique settings: [0054] Local position to the parent is
(0, -0.03, 0) [0055] Layermask excludes the "Right" layer. [0056]
The right eye camera has the following unique settings: [0057]
Local position to the parent is (0, 0.03, 0) [0058] Layennask
excludes the "Left" layer.
[0059] Referring to FIG. 4, the car spin panoramic images are
placed onto the skybox 400 by having the car spin panoramic images
line up with the front face of skybox 400. This ensures the images
has the perfect amount of distortion and is scaled precisely on
import.
[0060] Referring to FIG. 4, once the car is lined up, a special
Shutterbox script is synced to an invisible rotating "anchor"
object that determines the current rotation of the car. Depending
on the number of images available for the spin, the Shutterbox
script seamlessly switches out the appropriate left and right
images depending on what angle the anchor object is currently
rotated to.
[0061] Referring to FIGS. 5 and 6, there is illustrated a view
within a virtual reality setting created by a skybox 400 with a
socialize virtual dialog box 510 open having socialize display text
516 that explains to the user that the user may share their social
experience with social media using two graphic user interfaces
titled "Set Up" and "Not Now". When a user selects Set Up graphic
user interface 512, a keyboard virtual dialog box 610 with a
virtual keyboard 612 open that allows the user to enter their email
address to connect to a user's social network account. If a user
selects Not Now graphic user interface 514, then virtual dialog box
510 is closed and the user continues to view panoramic car spins
within skybox 400.
[0062] Referring to FIG. 7, there is illustrated a screen display
of a database 700 with stored user criteria illustrating in a first
column user names 710, a second column read and write storage
information 720. a third column and seventh column upload dates 730
and 770, a fourth column user email addresses 740 and a fifth and
sixth column with answers to Boolean queries 750 and 760.
[0063] Referring to FIG. 8, and by way of example, superimposed
graphic user interface (GUI) allows the user of the head mounted
display to select the elements. In FIG. 8, there are four (4)
graphic user interfaces illustrated: a steering wheel 834 which
changes the view from exterior panoramic images to internal
panoramic images, two cars 836 which changes the vehicle being
viewed by the user, a home 838 which brings the user to the home
screen within the application and a sharing graphic user interface
840 which allows the user to share an image and a comment with
their social media page. Also illustrated in FIG. 8 are the
surrounding skybox 400 and an external view of a panoramic car spin
850.
[0064] Referring to FIG. 9 there is illustrated a to-be-shared
dialog box 910 having a to-be-shared image 920. Also illustrated in
the to-be-shared dialog box 910, is a Facebook.RTM. graphic user
interface 930, a share your experience display text 940, and a
click here to add custom text graphic user interface 950. A user
while wearing the head mounted display can thus share the image as
shown by to-be-shared image 920 in FIG. 9 with a comment when
entered into custom text graphic user interface 950. To-be-shared
image 920 and custom text graphic user interface 950 will then be
shared with a social network so that other users of that same
social network can see the image and comment.
[0065] Some of the social networks that this image and comment can
be shared with, but not limited to, are Twitter.RTM.,
Facebook.RTM., Google+.RTM., Linkedin.RTM., Pinetrest.RTM.,
Instagram.RTM., Flickr.RTM., Foursquare.RTM., Tumblr.RTM.,
Flixster.RTM. and Snapchat.RTM..
[0066] Each of the disclosed portions of the invention--the
interior panoramic images, the exterior panoramic images, the
virtual environment, the graphic user interface elements--are
created as separate panoramic layers as a first layer, second
layer, third layer, and continuing on. These panoramic layers are
then brought together using gaming software such as Unity to create
a final product that can be then viewed as an interactive seamless
environment using a Virtual Reality Headset.
[0067] Of course the present invention is not intended to be
restricted to any particular form or arrangement, or any specific
embodiment, or any specific use, disclosed herein, since the same
may be modified in various particulars or relations without
departing from the spirit or scope of the claimed invention herein
above shown and described of which the apparatus or method shown is
intended only for illustration and disclosure of an operative
embodiment and not to show all of the various forms or
modifications in which this invention might be embodied or
operated.
* * * * *