U.S. patent application number 17/647747 was filed with the patent office on 2022-05-05 for methods and apparatus for three-dimensional graphical user interfaces.
This patent application is currently assigned to SLING MEDIA L.L.C.. The applicant listed for this patent is SLING MEDIA L.L.C.. Invention is credited to Ilya Asnis.
Application Number | 20220137789 17/647747 |
Document ID | / |
Family ID | |
Filed Date | 2022-05-05 |
United States Patent
Application |
20220137789 |
Kind Code |
A1 |
Asnis; Ilya |
May 5, 2022 |
METHODS AND APPARATUS FOR THREE-DIMENSIONAL GRAPHICAL USER
INTERFACES
Abstract
A three-dimensional graphical user interface system comprises a
media component configured to produce a signal comprising media
content (e.g., a movie or television show being viewed by a user)
and a three-dimensional graphical user interface (e.g., an
interactive program guide). A display device communicatively
coupled to the media component is configured to simultaneously
display the three-dimensional graphical user interface and a media
content image corresponding to the media content.
Inventors: |
Asnis; Ilya; (San Jose,
CA) |
|
Applicant: |
Name |
City |
State |
Country |
Type |
SLING MEDIA L.L.C. |
Foster City |
CA |
US |
|
|
Assignee: |
SLING MEDIA L.L.C.
Foster City
CA
|
Appl. No.: |
17/647747 |
Filed: |
January 12, 2022 |
Related U.S. Patent Documents
|
|
|
|
|
|
Application
Number |
Filing Date |
Patent Number |
|
|
14053843 |
Oct 15, 2013 |
11237695 |
|
|
17647747 |
|
|
|
|
61713065 |
Oct 12, 2012 |
|
|
|
International
Class: |
G06F 3/04815 20220101
G06F003/04815; H04N 21/81 20110101 H04N021/81; H04N 13/398 20180101
H04N013/398; H04N 13/356 20180101 H04N013/356; H04N 21/482 20110101
H04N021/482; G06F 3/0482 20130101 G06F003/0482 |
Claims
1. A system comprising: a media player configured to receive media
content over a network; and a display device coupled to the media
player configured to display a media content image from the media
content with a graphical user interface (GUI) on a display screen
of the display device; wherein the media content image is converted
from a two-dimensional image to a three-dimensional image in the
display screen to cause an element of the media content image to
appear in a three-dimensional space defined by a plane of the GUI;
wherein the GUI and the element of the media content image are each
configured with an apparent depth within the three-dimensional
space defined by the plane of the GUI.
2. The system of claim 1, wherein the GUI and the element of the
media content image are each configured with the apparent depth
within the three-dimensional space that is dynamically changing
over time.
3. The system of claim 2, wherein the GUI and the element of the
media content image are each configured with the apparent depth
within the three-dimensional space that is responsive to user input
to the media player.
4. The system of claim 3, wherein the GUI and the element of the
media content image are each configured with the apparent depth
within the three-dimensional space that is static.
5. The system of claim 4, wherein the GUI has the apparent depth
that is greater than the apparent depth of the media content image
within the three-dimensional space.
6. The system of claim 5, wherein a planar image of the GUI is
embedded with the element of the media content image based on an
overlap of an apparent distance that exits between each image.
7. The system of claim 6, wherein the planar image of the GUI
appear closer than is the element of the media content image within
the three-dimensional space to a user viewing directly of both
images.
8. A method comprising: configuring a media player to receive media
content over a network; and configuring a display device coupled to
the media player for displaying a media content image from the
media content with a graphical user interface (GUI) on a display
screen of the display device; wherein the media content image is
converted from a two-dimensional image to a three-dimensional image
in the display screen to cause an element of the media content
image to appear in a three-dimensional space defined by a plane of
the GUI; wherein the GUI and the element of the media content image
are each configured with an apparent depth within the
three-dimensional space defined by the plane of the GUI.
9. The method of claim 8, wherein the GUI and the element of the
media content image are each configured with the apparent depth
within the three-dimensional space that is dynamically changing
over time.
10. The method of claim 9, wherein the GUI and the element of the
media content image are each configured with the apparent depth
within the three-dimensional space that is response to user input
to the media player.
11. The method of claim 10, wherein the GUI and the element of the
media content image are each configured with the apparent depth
within the three-dimensional space that is static.
12. The method of claim 11, wherein the GUI has the apparent depth
that is greater than the apparent depth of the media content image
within the three-dimensional space.
13. The method of claim 12, wherein a planar image of the GUI is
embedded with the element of the media content image based on an
overlap of an apparent distance that exits between each image.
14. The method of claim 13, wherein the GUI is an interactive
program guide.
15. An apparatus comprising: a media player configured to: receive
a media stream and to decode the media stream; and display a media
content image decoded from the media stream with a graphical user
interface (GUI) on a display screen, wherein the media content
image is converted from a two-dimensional image to a
three-dimensional image in the display screen to cause an element
of the media content image to appear in a three-dimensional space
defined by a plane of the GUI; wherein the GUI and the element of
the media content image are each configured with an apparent depth
within the three-dimensional space defined by the plane of the
GUI.
16. The apparatus of claim 15, wherein the GUI and the element of
the media content image are each configured with the apparent depth
within the three-dimensional space that is dynamically changing
over time.
17. The apparatus of claim 16, wherein the GUI and the element of
the media content image are each configured with the apparent depth
within the three-dimensional space that is response to user
input.
18. The apparatus of claim 17, wherein the GUI and the element of
the media content image are each configured with the apparent depth
within the three-dimensional space that is static.
19. The apparatus of claim 18, wherein the GUI has the apparent
depth that is greater than the apparent depth of the media content
image within the three-dimensional space.
20. The apparatus of claim 19, wherein a planar image of the GUI is
embedded with the element of the media content image based on an
overlap of an apparent distance that exits between each image.
Description
CROSS-REFERENCE TO RELATED APPLICATIONS
[0001] This application is a continuation of the parent application
Ser. No. 14/053,843 filed Oct. 15, 2013, which claims priority to
U.S. Provisional Patent Application Ser. No. 61/713,065, filed Oct.
12, 2012, the contents of both applications are incorporated by
reference herein.
TECHNICAL FIELD
[0002] The present disclosure generally relates to systems and
techniques for processing, viewing, and selecting media content
within a home entertainment system. More particularly, the present
disclosure relates to graphical user interfaces for viewing media
content on three-dimensional display systems.
BACKGROUND
[0003] Three-dimensional (3D) display systems are increasingly used
for viewing media in the context of home televisions, tablet
computers, smartphones, personal computers, and the like. Such 3D
display systems pose certain challenges, however, with respect to
graphical user interfaces'i.e., how to provide the user with a
graphical user interface that to allows the user to easily interact
with the media and/or the 3D display system itself. For example,
conventional program guides are typically provided as
two-dimensional images at the plane of the display unit, while the
3D content itself might appear "closer" to the viewer than the
program guide, thereby partially or entirely occluding the program
guide.
[0004] At the same time, consumers have expressed significant
interest in "place shifting" devices that allow viewing of
television or other media content at locations other than their
primary television set. Placeshifting devices typically packetize
media content that can be transmitted over a local or wide area
network to a portable computer, mobile phone, personal digital
assistant, remote television or other remote device capable of
playing back the packetized media stream for the viewer.
Placeshifting therefore allows consumers to view their media
content from remote locations such as other rooms, hotels, offices,
and/or any other locations where portable media player devices can
gain access to a wireless or other communications network. Such
placeshifting devices typically employ graphical user interfaces
for selecting and viewing media content.
[0005] It is therefore desirable to create graphical user
interfaces for selecting and otherwise interacting with media
sources in the context of 3D display systems and placeshifting
devices. These and other desirable features and characteristics
will become apparent from the subsequent detailed description and
the appended claims, taken in conjunction with the accompanying
drawings and this background section.
BRIEF DESCRIPTION OF THE DRAWING FIGURES
[0006] Exemplary embodiments will hereinafter be described in
conjunction with the following drawing figures, wherein like
numerals denote like elements.
[0007] FIG. 1 is a conceptual view of a graphical user interface in
accordance with one embodiment.
[0008] FIG. 2 is a conceptual view of a graphical user interface in
accordance with one embodiment.
[0009] FIG. 3 is a conceptual view of a graphical user interface in
accordance with one embodiment.
[0010] FIG. 4 is a conceptual view of a graphical user interface in
accordance with one embodiment.
[0011] FIG. 5 is a block diagram of an exemplary placeshifting
system.
DETAILED DESCRIPTION
[0012] The following detailed description of the invention is
merely exemplary in nature and is not intended to limit the
invention or the application and uses of the invention.
Furthermore, there is no intention to be bound by any theory
presented in the preceding background or the following detailed
description.
[0013] In general, systems and methods in accordance with the
subject matter described herein are configured to employ a
three-dimensional (3D) display system to provide the user with a
graphical user interface (GUI), such as a program guide, that is
itself a 3D image--i.e., has an apparent depth with respect to the
display device.
[0014] Referring now to FIG. 1, a user 160 is represented
schematically as an eye oriented toward a display device 101, for
example, a liquid crystal display (LCD), organic light-emitting
diode (OLED) display, or other such display. Display device 101
composes part of a 3D display system. In some embodiments, display
device 101 is communicatively coupled (e.g., via any convenient
form of wired or wireless communication) to an external component
(e.g., a media component, not shown) that provides a signal 112
that is processed and ultimately results in an image displayed by
the 3D display system (e.g., as in "3D-ready" televisions systems).
In other embodiments, the entire 3D display system may be
self-contained within display device 101 itself.
[0015] The term "3D display system" is used herein to refer to any
combination of hardware and software configured to produce one or
more images that convey depth perception to a user. That is, from
the user's point of view, one or portions of a viewed image will
have an "apparent depth" with respect to a surface 102 of display
device 101, i.e., extending into or out of the physical display
screen (along the x-axis as defined in the drawings). Such 3D
display systems may employ a variety of methods, but typically
involve producing offset images that are presented separately to
the left and right eyes. Such 3D displays may or may not require
special glasses, depending upon the technique employed. Example 3D
display systems include, without limitation, multi-view systems,
active shutter 3D systems, polarized 3D systems, and
autostereoscopic systems. The nature of such 3D display systems are
well known in the art, and need not be discussed in detail
herein.
[0016] In accordance with various embodiment of the invention,
display device 101 is employed to provide user 160 with a
three-dimensional GUI 150--i.e., a GUI 150 that has an apparent
depth with respect to display device 101 (e.g., display device
surface 102). In the example embodiment, for example, GUI 150
includes any number of conventional and well known user interface
components 152 (menu items, lists, buttons, check-boxes, and the
like) arranged in a plane that is substantially parallel to display
device surface 102 (which for the purposes of this example is
assumed to have a substantially planar front face, as illustrated).
The invention is not so limited, however, as described in further
detail below.
[0017] In one embodiment, GUI 150 comprises a program guide used in
connection with media selection and viewing. The term "program
guide" as used herein with respect to GUI 150 refers to any form of
interactive display, menu, or user interface that allows a user to
interactively observe and navigate scheduling information relating
to content from media sources. In some embodiments, the program
guide allows selecting and discovering programming by time, title,
station, or genre using an input device such as a keypad, computer
keyboard, remote control, gestural input (e.g., via 3D sensor
devices) or the like. A typical program guide provides information
covering a certain number of days, e.g., seven or fourteen days.
The term "program guide" includes, but is not limited to, what are
referred to by some manufacturers as "interactive program guides"
and "electronic program guides."
[0018] In FIG. 1, the GUI 150 is illustrated as a lying along a
plane having an apparent depth between the user 160 and the display
device 101. That is, referring to the coordinate system indicated
in the lower right of FIG. 1, GUI 150 is substantially parallel to
the y-z plane, where the x-axis is substantially normal to the
front face of display device 102. The apparent depth of GUI 150
with respect to display device 101 and the actual content image
being viewed (from the point of view of user 160) may vary
depending upon the embodiment.
[0019] Referring to FIG. 2, for example, a media content image (or
simply "image") 210 (i.e., the movie or other programming being
viewed by user 160) may appear as a 2D image at the plane of
surface 102, while GUI 150 appears as a plane in three dimensions
with an apparent depth closer to user 160. In one embodiment, image
210 is initially presented as a 3D image, but is momentarily
converted to a 2D image (as shown) while GUI 150 is being displayed
to assist the user in interacting with GUI 150.
[0020] In one embodiment, referring now to FIG. 3, image 310 is a
3D image as shown, and GUI 150 appears as a plane in three
dimensions with an apparent depth closer to user 160 than image
310. That is, the apparent distance along the x-axis from GUI 150
to surface 102 is greater than the apparent distance along the
x-axis of the closest (to user 160) portion of image 310. In other
embodiments, the apparent distance along the x-axis from GUI 150 to
surface 102 is greater than the apparent distance along the x-axis
of most of image 310, with some overlap (i.e., GUI 150 may be
partially "embedded" within image 310).
[0021] While GUI 150 is depicted in the above figures as a plane
defined within 3D space, the invention is not so limited. Referring
to FIG. 4, for example, GUI 150 may have a shape that varies in
apparent depth. In the illustrated embodiment, GUI 150 is depicted
as a portion of a generally cylindrical surface; however, the
invention is not so limited. In some embodiments, the apparent
depth of GUI 150 and its elements are static. In other embodiments,
the apparent depth of GUI 150 and its elements are dynamic and may
change over time--e.g., in response to input from user 160.
[0022] The systems and methods summarized above may be implemented
in conjunction with a variety of home entertainment devices and/or
other media components. For example, the present invention may be
implemented in the context of a placeshifting system. Referring to
FIG. 5, an exemplary placeshifting system 1000 generally includes a
placeshifting device 1010 that receives media content from one or
more media sources 1020, encodes the received content into a
suitable format (e.g., a streaming format), and then transmits the
encoded media stream to a media player 1050 over a network 1040
(e.g., a WLAN, the Internet, etc.). Media player 1050 receives the
encoded stream, decodes the stream, and presents the decoded
content to a viewer on a television or other such display device
(or "display") 1060. Similarly, the content may be viewed locally
(with respect to placeshifting device 1010) via a display device
1030. In various embodiments, a server 1070 may also be provided to
communicate with placeshifting device 1010 and/or media player 1050
via network 1040 to assist these devices in locating each other,
maintaining security, providing or receiving content or
information, and/or any other features as desired.
[0023] In connection with the present invention, display devices
1030 and/or 1060 correspond to the 3D display device 101 described
above. Similarly, the signal 112 received by 3D display device 101
in FIG. 1 may correspond to a signal produced by media player 1050
or placeshifting device 1010, both of which may be classified as
"media components." In general, the media component is configured
to produce a signal (e.g., 112) comprising both media content and a
three-dimensional graphical user interface, while the display
device (e.g., 1030 or 1060) is configured to simultaneously display
the three-dimensional graphical user interface and the media
content image corresponding to the media content.
[0024] Media sources 1020 may include a wide range of sources now
known or later developed, including, for example, broadcast
television, cable television, satellite television,
"video-on-demand" or similar sources, digital video disk (DVD)
players and other removable media, video camera systems, video game
consoles, set-top box (STB) systems, Internet media sources (e.g.,
YouTube), and the like.
[0025] Placeshifting device 1010 includes any combination of
software and/or hardware configured to perform the functionality
described herein. In the illustrated embodiment, for example,
placeshifting device 1010 includes a display interface 1011
(coupled to display device 1030), a network interface 1015 (coupled
to network 1040), and a receiver interface 1016 (coupled to media
sources 1020), all of which are known in the art. Placeshifting
device 1010 also includes a user interface module 1013 configured
to provide interaction between the user and placeshifting device
1010 (e.g., via various menus and other conventional user interface
components, such as GUI 150 described above). Placeshifting device
1010 includes a controller 1012 for coordinating the operation of
other components of placeshifting device 1010, and suitable storage
(e.g., hard disk and/or solid state drives) 1014 for storing data
received from media sources 1020 as well as other data associated
with operation of placeshifting device 1010.
[0026] It will be appreciated that placeshifting device 1010 will
typically include a number of additional hardware and/or software
components (e.g., memory, controllers, digital signal processors,
etc.), which have been left out of the illustration in the interest
of simplicity. For example, placeshifting device 1010 will
typically incorporate an encoder and/or transcoder module
configured to convert audio/video or other data from media sources
1020 into a packetized format that can be transmitted over network
1040. Placeshifting device 1010 may also include a transmit buffer
module that temporarily stores encoded data prior to transmission
over network 1040 and adjusts one or more parameters of the
encoding (e.g., the bit rate of the media stream) to maintain
desirable picture quality and data throughput in view of the
then-current network performance. Placeshifting device may also be
configured to provide commands to one or more of the media sources
1020, e.g., to request a desired input signals from that media
source. Such commands may be provided over any convenient wired or
wireless interface, such as an infrared or other wireless
transmitter that emulates remote control commands receivable by the
media source 1020. Several examples of placeshifting devices may be
implemented using any of the various SLINGBOX products available
from Sling Media of Foster City, Calif.
[0027] In some embodiments, placeshifting device 1010 incorporates
all or a portion of the functionality typically associated with a
particular media source 1020. For example, placeshifting device
1010 might be a hybrid STB or other receiver that provides
transcoding and placeshifting features. Such a device may receive
satellite, cable, broadcast and/or other signals that encode
television programming or other content received from an antenna,
modem, server and/or other source. Such devices may also include a
content database (stored, for example, within storage 1014) to
support a personal or digital video recorder (DVR) feature or other
content library as appropriate. Stated another way, in some
embodiments, media source 1020 and placeshifting device 1010 are
physically and/or logically contained within a common component,
housing or chassis.
[0028] In some embodiments, placeshifting device 1010 is a software
application configured to be executed on a conventional computing
system (e.g., a personal computer, tablet computer, smartphone, or
the like). In such embodiments, placeshifting device 1010 may
encode some or all of a screen display typically provided to a user
of the computing system for placeshifting to media player 1050. One
device capable of providing such functionality is the
SlingProjector product available from Sling Media of Foster City,
Calif.
[0029] Media player 1050 may be any device, component, module,
hardware, software and/or the like capable of receiving a media
stream placeshifting device 1010. In various embodiments, media
player 1050 is a desktop computer, a laptop computer, a tablet
computer, a mobile phone, a personal digital assistant, a personal
media player (such as the ARCHOS.RTM. products available from the
ARCHOS.RTM. company of Igny, France) or the like. In many
embodiments, media player 1050 is a general purpose computing
device that includes a media player application that is capable of
securely connecting to placeshifting device 1010 and receiving and
presenting media content to the user of the device as appropriate.
In other embodiments, media player 1050 is a standalone or other
separate hardware device capable of receiving the media stream via
network 1040 and decoding the media stream to provide an output
signal that is presented on a television or other display device
1060. One example of a standalone media receiver 1050 is the
SLINGCATCHER product available from Sling Media of Foster City,
Calif., although other products might be used in connection with
the subject matter described herein.
[0030] The particular methods described above may be implemented,
for example, using software executable by controller 1012, and then
presented to the user via display device 1030 and/or display device
1060.
[0031] While several exemplary embodiments have been presented in
the foregoing detailed description, it should be appreciated that a
vast number of alternate but equivalent variations exist, and the
examples presented herein are not intended to limit the scope,
applicability, or configuration of the invention in any way. To the
contrary, various changes may be made in the function and
arrangement of elements described without departing from the scope
of the claims and their legal equivalents.
* * * * *