U.S. patent application number 09/931575 was filed with the patent office on 2002-09-19 for system and method for providing interactive content to multiple platforms.
Invention is credited to Borleske, Andrew J., Fraanje, Izet, Neumann, Douglas T., Newnam, Scott G..
Application Number | 20020133405 09/931575 |
Document ID | / |
Family ID | 27404178 |
Filed Date | 2002-09-19 |
United States Patent
Application |
20020133405 |
Kind Code |
A1 |
Newnam, Scott G. ; et
al. |
September 19, 2002 |
System and method for providing interactive content to multiple
platforms
Abstract
A system and method for interactive events relating to broadcast
content, whether provided over the television, internet, or other
means, provides messages that can be transmitted to different types
of user devices, including personal computers, set top boxes, net
top boxes, and wireless clients. The system can be used with
personal recorders by recording interactive content for display
with the broadcast when the recorder is used to play back the
broadcast.
Inventors: |
Newnam, Scott G.;
(Cambridge, MA) ; Fraanje, Izet; (Cambridge,
MA) ; Borleske, Andrew J.; (Charlestown, MA) ;
Neumann, Douglas T.; (Somerville, MA) |
Correspondence
Address: |
HALE AND DORR, LLP
60 STATE STREET
BOSTON
MA
02109
|
Family ID: |
27404178 |
Appl. No.: |
09/931575 |
Filed: |
August 16, 2001 |
Related U.S. Patent Documents
|
|
|
|
|
|
Application
Number |
Filing Date |
Patent Number |
|
|
09931575 |
Aug 16, 2001 |
|
|
|
09804815 |
Mar 13, 2001 |
|
|
|
09931575 |
Aug 16, 2001 |
|
|
|
09899827 |
Jul 6, 2001 |
|
|
|
60293152 |
May 23, 2001 |
|
|
|
Current U.S.
Class: |
705/14.58 ;
705/14.64; 705/14.66; 725/34; 725/35; 725/36 |
Current CPC
Class: |
G06Q 30/0261 20130101;
G06Q 30/0267 20130101; G06Q 30/02 20130101; G06Q 30/0269
20130101 |
Class at
Publication: |
705/14 ; 725/34;
725/35; 725/36 |
International
Class: |
G06F 017/60; H04N
007/025; H04N 007/10 |
Claims
What is claimed is:
1. A method for enhancing a broadcast event comprising: a server
system providing content related to the broadcast event to remote
users having local devices that can interpret content and process
messages received from the server system to cause information to be
displayed; and during the broadcast event, the server system
providing to the local devices messages that cause the local
devices to display the content; wherein each of the content and
messages are provided at the same time to at least two different
types of local devices, including two or more of personal
computers, set top boxes, net top boxes, wireless computers,
consoles, and hand held computers.
2. The method of claim 1, wherein the content and messages are sent
via Internet Protocol.
3. The method of claim 1, further comprising, in response to an
advertisement being broadcast, the server system selecting one
additional advertisement from a plurality of different
advertisements tailored to different users, the one advertisement
being related to, and for display at the same time as, the
broadcast advertisement.
4. The method of claim 3, further comprising maintaining user
profiles, wherein the server system selects the one additional
advertisement based on the user profiles.
5. The method of claim 3, wherein the server system selects the one
additional advertisement based on the user's location.
6. The method of claim 1, wherein the broadcast event is broadcast
over television, radio, and/or the Internet.
7. The method of claim 1, further comprising transmitting the
interactive content to the local device while the event is
occurring, the content being stored for later display in response
to a message after the content has been transmitted.
8. The method of claim 1, further comprising transmitting the
interactive content before the broadcast event begins.
9. The method of claim 1, wherein the content is provided by
downloading or by flashing.
10. The method of claim 1, wherein the messages do not include
Internet addresses but are sent at the same time as Internet
addresses that are used for accessing web pages with similar
content, the local devices displaying content in response to the
messages and not using the Internet addresses on receiving a
message.
11. The method of claim 1, wherein at least two of the different
types of local device are programmed to display interactive content
in a manner different from each other in terms of size and/or
location of content on a display.
12. The method of claim 11, wherein the broadcast content is
displayed and the broadcast content and the interactive content are
provided on the same display in different windows.
13. The method of claim 11, wherein the broadcast content is
displayed and the broadcast content and the interactive content are
provided on separate displays.
14. The method of claim 1, wherein the interactive content includes
content applicable to multiple broadcast events for display during
the event, and content applicable to specific events for display
during the respective specific event.
15. The method of claim 1, wherein at least some of the local
devices include a recording device for receiving and storing the
broadcast event, the content, and the messages and associating the
timing of the content messages with the programming such that the
playback of the broadcast event from the recording device includes
the content and messages being provided at the same relative time
as during the broadcast.
16. The method of claim 15, wherein the server system is responsive
to a user entering data in response to content displayed during
playback of a broadcast event for providing follow-on content
related to the user entering data.
17. The method of claim 1, wherein the server system determines the
type of local device and provides information in response to that
determination.
18. The method of claim 1, wherein a first type of local device is
programmed to use the content from the server system in one manner
and a second type of local device is programmed to use the content
from the server system in another manner.
19. An interactive system including a server system for providing
to local users messages and content related to a broadcast event,
the server system maintaining multiple local advertisement messages
directed toward different users or groups of users, the server
system, responsive to an advertisement being broadcast with the
broadcast event, for selecting one of a plurality of the local
advertisements and for causing that advertisement to be displayed
additionally to the user at the same time as the advertisement in
the broadcast event.
20. The system of claim 19, wherein the selected local
advertisement is based on the user's location.
21. The system of claim 19, wherein the selected local
advertisement is based on a profile of the user.
22. The system of claim 19, wherein the selected local
advertisement is provided to a computer and the broadcast event is
to a television.
Description
CROSS REFERENCE TO RELATED APPLICATION
[0001] This application claims priority from provisional patent
application number 60/293,152, filed Mar. 23, 2001, which is
incorporated herein by reference, and is a continuation-in-part of
application Ser. Nos. 09/804,815, pending, and 09/899,827, pending,
each of which is incorporated herein by reference in its entirety
for all purposes.
BACKGROUND OF THE INVENTION
[0002] In the interactive television market, early efforts for such
interactivity have been centered simply on allowing devices such as
PCs, set-tops, and net-tops to receive message types and display
enhanced content. The industry lacks standard hardware and software
and the products of several companies operate on separate systems
Each of these systems is designed to act as a closed system: each
cable headend, satellite broadcast system, etc. uses its own
hardware and software within the system; digital set-top systems
are designed to accept standardized triggers in the broadcast to
retrieve additional information; the standardized triggering system
can be an unreliable method of delivering interactivity as the
triggers can be removed at any part of the line from broadcast
through the MSO to the customer; the closed systems do not allow
for full, real-time interactivity, but rather just send new
information to the user upon request; and because all of the
systems are closed, no system allows them all to be connected and
provide real-time interactivity among all participants
SUMMARY OF THE INVENTION
[0003] A system of the present invention relates to connecting
different client devices, such as PCs, set-top boxes, net-top
devices, and wireless devices, using Internet Protocol (IP) to
provide true interactivity, targeted advertising, and mechanisms
for true convergence, preferably by leveraging the MPEG 4 standard
set by the Motion Picture Experts Group (MPEG). A system of the
present invention serves as a centralized system for connected all
such external devices. Furthermore, such a system can connect
closed systems, such as cable headends, and can allow different
such systems to act as one cohesive system.
[0004] The system and methods of the present invention provide a
comprehensive distribution and delivery system for interactive
entertainment and for coordinating various types of interactive
programming on various client devices (e.g., PC, set-top, net-top,
consoles, or wireless) and to facilitate interaction with each
other, and with on-line and/or on-air programming. This is
preferably accomplished by using the advantages of IP to integrate
such devices.
[0005] A system according to the present invention includes some or
all of the following components: a server system that is capable of
running multiple simultaneous interactive events; a software system
including several independent components of an interactive program;
an Interactive Program Guide (IPG) for assigning users to certain
servers based on selected interactive programming; interactive
content that populates the software components; an Electronic
Programming Guide (EPG) that communicates the selected program to
the IPG; a personal video recorder (PVR) that allows the user to
time-shift television programming; a personal interactivity
recorder (PIR) that records the interactive content and results
associated with the recorded video signal; a controller that
receives both industry standard triggers and also other message
types and controls interactive content presentation in response to
such triggers and message types; a content display interface that
determines the layout of the interactive components based on the
client hardware device and user preferences; and a client hardware
device, such as a PC, set-top box, net-top box, console, or
wireless device.
[0006] The system of the present invention (i) allows users to
impact the programming in real-time; (ii) allows users to
communicate with a producer of the programming; (iii) allows users
to interact with each other across multiple platforms; (iv) is
scalable to a television-sized audience; and (v) maintains
synchronization among users. The system can provide all users with
a similar interactive experience even though they might use one of
several client hardware devices, and/or they might have different
Internet connections speeds, they may or may not use an EPG, they
might time-shift the programming using a PVR. The design of the
system also creates opportunities for a new level of interactive
and targeted advertising.
[0007] A television producer can utilize the system to provide
related and synchronized interactive content for a television
program. For either a live or taped broadcast, the producer can use
the technical director to control content previously created and
distributed to the client devices and to send dynamic content
during the broadcast.
[0008] The interactive content is provided using Internet protocol
(IP) and is therefore independent of the distribution of the
television content. Accordingly, a producer of interactive content
can also utilize the system to provided interactive content related
to and synchronized with a television program without the
cooperation of the television producer. If either the television
producer or distributor is not participating in or cooperating with
the interactive programming, message types sent over IP would
determine the timing and content of the interactive
programming.
[0009] If the television producer and the program distributor were
cooperating in the production and distribution of the interactive
content, they could utilize industry standard triggers (e.g., ATVEF
triggers). ATVEF triggers are currently a standard set by the
Advanced Television Enhancement Forum, in which URLs are embedded
in the video signal during post-production to trigger
interactivity. Cooperation between the television producer and the
distributor is necessary for the use of some industry standard
triggers because the distributor can remove them after
post-production. The present invention can utilize these triggers,
or an IP based messaging system, or a combination of both methods.
The system of the present invention is flexible in terms of which
types of triggers take precedent. The configuration of a specific
event would determine the hierarchy of triggers. It can be
configured to allow all types, take one over another or only allow
for one type.
[0010] Existing set-top and net-top systems do not support the
ability for the participant to affect the sequence and outcome of
events in a program. With true interactivity according to the
present invention, during a sports talk show, for example, the
responses to polls and trivia questions can drive the commentary
and direction of the show's host. Previous systems allowed users in
a set-top or net-top world to merely play along with a show,
without information being shared in real time with other
participants or with the producer. An example might be playing
along with a question-and-answer game show. In previous solutions,
the television viewer would simply see a visual overlay on the
screen allowing him or her to select the correct answer at the same
time as the show. However, the participant's score is simply
calculated on the set-top box for the participant's own knowledge.
In fact, the participant has not in fact "interacted" with others.
With the system of the present invention, information on every
participant can be transmitted to a server system for real-time
processing. Such processing allows for interactivity, such as
display of aggregated results, bracketed tournaments for
competition, fast display of competitor rankings, and voting for
choices of a show's outcome.
[0011] The system and method of the present invention provides
flexibility in interactive advertising by allowing (1) the display
of advertisements that enhance the on-air advertisements without
competing with them, (2) the ability to provide targeted or local
advertisements, or (3) eliminating interactive advertisements to
retain attention for the on-air ad. The system allows for a more
targeted distribution of advertisements. For example, a broadcast
might have three overlapping advertisements and the client hardware
device displays one of the ads based on user preferences and
experience. The system and method of the present invention allows
for one of several enhanced advertisements to be delivered to the
client hardware device based on similar preferences or according to
the on-air ad being distributed.
[0012] Some targeted advertisement systems currently being deployed
with television systems and set top boxes utilize profile and
experience information stored on the set top box to select for
display one of several ads being transmitted. The present invention
allows users to answer questions, participate in polls, request
information, obtain coupons, locate stores, etc. by interacting
directly with the server system. Key information is stored or
processed at the server system and can be used to more effectively
target advertisement delivery. This results in lower bandwidth
consumption and allows for a larger potential number of targeted
ads or information to be distributed since every user does not have
to receive every piece of content.
[0013] Many consumers currently use electronic program guides
(EPGs) to inform them of available and scheduled programming and to
bring them to the selected television program. If an EPG is
resident on a client hardware device, the system of the present
invention allows the EPG to interact with the Interactive Program
Guide (IPG) of the present invention to communicate the selected
program and assign the user to the appropriate Interactive Program
Cluster of the server system.
[0014] The system of the present invention addresses problems with
interactive programming in combination with time-shifting devices,
such as personal video recorders (PVRs), which are individual
storage devices used with the television (e.g., TiVo recorders from
Tivo, Inc.). Any device that has network and video
receiving/recording capabilities can be considered a time-shifting
device; e.g., a PC can have video receiving capability and can
store broadcast programming and other content.
[0015] In one embodiment, a PIR (personal interactivity recorder)
engine collects links to interactive content associated with a
particular video frame and/or interactive content itself and
records that interactive content. When the broadcast is replayed,
the content from each link or the content itself is displayed as
the show progresses. Playback works the same as in the previously
described interactive mechanism except the content does not need to
be accessible from a server after the event, and the client device
does not even have to be connected to the network. This eliminates
the need for extra network storage costs, and lowers bandwidth
requirements. Alternatively, the user could be connected to the
network during playback. The playback feature with interactive
content provides a potentially more enjoyable experience for the
participant because, similar to live participation in the
interactive program, the participant can compare his or her
responses to the rest of the audience.
[0016] Another advantage of the system and method of the present
invention is provided by the content display interface. The content
display interface determines the size, shape, and location of the
various components of interactivity based on the user's client
hardware device and preferences. In one example, a user
participating in interactive programming using a PC and separate
television would see the entire PC monitor occupied by interactive
components while a user on a net-top device might see components
arranged on the left and bottom of the video screen while the
television program occupies the remainder of the screen. In another
example, a participant in a multi-player game not associated with a
television broadcast would use the entire screen even though the
participant is using a set-top, net-top or console as his client
hardware device. Another participant might select only to receive
programming information as a ticker along the bottom of the screen.
In yet another example, two users sharing the same display might
choose to each have a component for polls and contests while
sharing a chat box and fun fact display. The content display
interface allows users to select from available options, which may
be limited based on the type of client hardware device and
program.
[0017] The system of the present invention allows for a single
interactive system to provide interactivity to and among users of
various client hardware devices including digital head-end set-top
boxes, net-tops, wireless devices, consoles, PCs and digital
televisions. The present system connects to each client device
using Internet Protocol. Because each client device and sub-system
(e.g., Scientific Atlanta based head-end or Sprint based wireless)
is slightly different, the system connects at different points in
these devices, but maintains a constant communication via Internet
Protocol through all systems. The system uses a software component
referred to as an event management engine (EM Engine) to receive
ATVEF triggers and other message types over IP and use them to
control the interactive program.
[0018] Other features and advantages will become apparent from the
following detailed description, drawings, and claims.
BRIEF DESCRIPTION OF THE DRAWINGS
[0019] FIG. 1 is a block diagram of the server system that
coordinates interactivity across multiple client devices over
Internet Protocol.
[0020] FIG. 2 shows an example (poll) of the coordination and
aggregation of interactivity by the server system across multiple
client devices.
[0021] FIG. 3 shows the comparison of the system of the present
invention for synchronization to broadcast over IP and the prior
art embedded ATVEF triggers.
[0022] FIG. 4 shows an example of the convergence of on-line and
on-air programming into a combined MPEG4 stream over Internet
Protocol.
[0023] FIG. 5 illustrates the thin communication protocol between
the server system and set-top client that provides true
interactivity.
[0024] FIG. 6 is a block diagram representing the synchronization
of targeted on-line advertising to the on-air broadcast over
Internet Protocol across multiple client devices.
[0025] FIG. 7 is a flow diagram of the coordination of EPGs across
multiple platforms and the association of interactivity to these
EPGs.
[0026] FIG. 8 is a block diagram of the solution for interactive
programming and timeshifting devices.
[0027] FIG. 9 shows the output of the content display interface on
different user devices.
DETAILED DESCRIPTION
[0028] A content provider, such as a television network, can
broadcast television programming to a television via cable,
satellite, over-the-air, or other means. The program that is
broadcast is a type of event, and the episodes are instances of
that event. Events can consist of an on-air and on-line
programming.
[0029] The system of the present invention provides a novel way of
coordination and synchronization of interactivity across multiple
client devices based on Internet Protocol (IP). The client devices
can be a range of different devices, the most-used current examples
of which are a computer client (further referred to as PC client
but can also run on different platforms such as Macintosh), set-top
client, net-top client (e.g., WebTV, a return path over dial-up),
consoles, and wireless clients. The server system is responsible
for interactive processing for activities, such as games, polls,
and fun facts. The server system can communicate with the client
devices to initiate display of content through different types of
messages (over IP). The client device will leverage a message
library to interpret the messages.
[0030] The on-line programming can be synchronized to the on-air
broadcast by the server system's messaging system.
[0031] The server system preferably has an interactive program
cluster for each concurrent interactive event. Each interactive
program cluster can include an administrative server, multiple
event servers, ad servers, multiple chat servers, multiple
streaming servers, and a technical director. One or more of these
components can be combined on a single computer or allocated among
separate computers.
[0032] FIG. 1 shows the components of an embodiment of the present
invention for the coordination of interactivity and `on-line`
programming across multiple client devices. The server system 200
sends messages across Internet Protocol to control the
interactivity on the client devices: PC client 100, set-top client
110, net-top client 120 and wireless client 130. This is an
illustrative selection of client devices that can interact with
server system 200. Examples of other client devices are consoles
and handheld devices. The messages are interpreted on the client
devices using a message library. In one embodiment, the server
system 200 detects the type of client device. Based on the type of
client device, a device-specific configuration file can be provided
to the client device that supports the interpretation of messages
sent by server system 200. In another embodiment, the client device
software interprets messages and tailors messages to the specific
device.
[0033] The communication from these client devices back to the
server system 200 is also preferably provided over IP. The system
thus allows multiple client devices 50 (and different types of
client devices) to simultaneously interact with server system 200.
In general, the communication is initiated by the server system 200
after a user has indicated a preference to participate in
interactive programming. To provide true interactivity the server
system 200 can initiate this communication and keep this connection
open during the full duration of an interactive program.
[0034] The technical director 300 is a software interface on a
computer and is the interface between a producer of the event, such
as a television broadcaster, and the system. The technical director
300 allows viewers to impact the content of the event in real-time
by enabling the producer to change the content based on input
received from viewers. The technical director 300 can also, for
example, receive, display, and allow the producer to select
questions posed to the producer or event's host or comments made by
the user. The producer can respond to the questions or comments
through the real-time creation of event content. The new content
could be multi-media content distributed by a broadcaster or
content created by the technical director 300. For example, the
technical director 300 allows producers to generate real-time
content (e.g., a real-time fun fact or poll) and to initiate the
display of such content.
[0035] FIG. 2. shows an example of interactivity (namely, a poll)
across multiple client devices by server system 200. A producer can
initiate a poll using the Technical Director 300. The server system
200 receives poll 310 and sends poll 310 to the different client
devices: PC client 100, set-top client 110, net-top client 120 and
wireless client 130. The users of these client devices send back
their responses: answer PC client 320, answer set-top client 330,
answer net-top client 340, and answer wireless client 350. The
server system 200 processes all these results and sends back out
the aggregated results 360 to each of the different client
devices.
[0036] Other types of interactivity can include fun facts (which do
not require a response), and trivia questions, whereby the
aggregated results can include answers, scores, and a leader board
of high scores. The system can also provide chat functionality
among users, and can allow textual messages to be sent to and from
a producer. In response to chat or other textual messages, the
producer can tailor or generate content provided during the
broadcast. These functionalities can each be provided by a separate
server, or multiple functionalities can be combined in one or more
servers.
[0037] Content can be provided in advance of the start of the
broadcast, during the broadcast for storage during the broadcast,
or in real time from the server. In the first two cases, a message
is sent from the server to cause the previously provided content to
be displayed. The approach of providing the content before display
is particularly useful for graphics and other items of content with
higher bandwidth. In the third case, the content is provided in
real time, preferably with a message type that causes that message
to be processed. The content can thus be interpreted in real time
or from storage. The types of content and the methods of
transmission are also described in the incorporated pending
applications.
[0038] In FIG. 3, and embodiment of the present invention is
compared to a prior art system. In a prior art system, a head-end
facility 400 sends an on-air broadcast signal with embedded ATVEF
triggers 430 to the set-top client 110. The ATVEF trigger specifies
a URL. The set-top client 110 sends a URL request 440 to the web
Server 420. The web server 420 serves up a web page 450 to the
set-top client 110.
[0039] The system of the present invention decouples the
distribution and production of on-line enhanced TV programming from
the production and distribution of the on-air broadcast. The server
system 200 provides the mechanism of synched on-line program 210
over IP without embedding ATVEF triggers in the on-air broadcast
signal. The on-air broadcast signal 410 is delivered by the
head-end facility 400 to the set-top client 110. In the system of
the present invention the ATVEF triggers do not have to be embedded
in the on-air broadcast 410. This ability to avoid embedded
triggers allows producers other than the on-air broadcast producers
to create on-line programming. Furthermore, the system of the
present invention can prevent MSOs (the operators of the head-end
facility 400) from restricting the availability of interactive
programming by removing ATVEF triggers from the signal 430 provided
to the set-top client 110.
[0040] FIG. 4 illustrates the convergence of the on-line program
over IP 210 with the on-air broadcast 410 in on-air and on-line
programming 220 over IP. In one embodiment, the head end facility
400 provides the on-air broadcast 410 (e.g., based on MPEG2) to the
client device 50. The server system 200 provides the on-line
program over IP 210 to the client device 50 using the built-in
synced-to-broadcast mechanism as described above. In another
embodiment the server system 200 takes over the functionality of
the head end facility 400 by combining on-air and on-line
programming over IP 220 into one signal. One of the standards for
this convergence over IP is MPEG4.
[0041] FIG. 5 shows the lightweight communication protocol 105 that
allows for true interactivity for client devices that do not have
this true interactivity today. The base software 115 on the set-top
client 110 knows how to interpret the messages from server system
200 and provides light and fast communication with the server
system through which the user of set-top client 110 can actually
participate in interactive features such as real-time polls and
trivia. The server system 200 initiates and maintains the
connection with the base software 115 that is part of the set-top
client 110 using the communication protocol 105 (based on IP). The
base software can be part of the operating system of a user device,
or it can be incorporated in other software, such as in a browser,
or it can be a provided later like an application program, such as
by being downloaded over the Internet or by flashing it to the
memory of a client device.
[0042] As shown in FIG. 6, the server system 200 can synchronize
the display of targeted advertising on the client devices to on-air
advertising. The server system 200 sends message type ad 520 over
IP to the PC client 100, set-top client 110, net-top client 120,
and wireless client 130. These clients will interpret this message
type 520 to display Ad 510. The initiation of message type ad 520
can be synchronized to the broadcast such that the on-air
commercial 530 will coincide with the display of Ad 510 on all the
different client devices. Ad 510 can be personalized to the user of
the client device based on profiling of the server system 200.
[0043] An example of targeting Ad 510 is a localized list of car
dealers. A car commercial 530 for a brand or model airs on
television; in response to that ad, and at the same time, a list of
local dealers for that brand or model of car is presented to the
users on the different client devices based on the zip code of the
users. Other factors in the profile could be used, such as age. The
concept of the Ad 510 will be similar for all the user devices: PC
client 100, set-top client 110, net-top client 120 and wireless
client 130. The list of dealers close by, however, will depend on
the profile of the user.
[0044] In FIG. 7, another embodiment includes a system for
interacting with electronic programming guides (EPGs). The server
system 200 coordinates the presentation of EPGs over IP 250 across
multiple user devices. The EPGs on the different devices have the
interactive programming associated with the broadcast programming.
Each user on one of the user devices 50 can select an interactive
program 260 to interact with other users on the different user
devices 50. The EPG implementation of the present invention
includes the association of interactive programming with the EPG
and the coordination of the EPG across multiple client devices 50
over IP by server system 200. The server system 200 uses the IPG
component 270 to provide a mechanism for assigning users to the
appropriate servers and services depending on their client device
50, chosen interactive programming and potentially their profile.
In another embodiment the user can select interactive programming
by clicking on an interactive identifier, using a remote control or
using a keyboard. In all cases the IPG component 270 on the server
side will assign the users to the appropriate servers and
services.
[0045] FIG. 8 shows a solution for interactive programming
associated with time-shifted on-air broadcast. A PVR is a local
client 555 that can cache programming received from the head-end
400 in a PVR storage 550 (such as a resident hard drive). A PVR
allows for record and playback, but also allows one to pause
programming, such that the device records while earlier content is
being displayed.
[0046] According to the present invention, as this recording
occurs, a PIR (personal interactivity recorder) engine 580 stores
interactive content in interactive storage 560 (which can be
physically the same device as PVR storage 550) originating from
server system 200. The PIR engine 580 subscribes to all video
control messages to the PVR client 555, as well as the video frame
markers. The PIR engine associates the interactive content (or
links to other interactive content) to the video frame markers
received by the PVR engine 570 and stores them on the interactive
storage 560. The PIR engine then can perform all time modifying
operations (fast forward, rewind, pause etc) of the PVR engine on
the interactive content.
[0047] The PIR can have its own processing capability through a
microprocessor or a dedicated processor or programmed logic, or it
can use the processing capability of the PVR. The PIR can be
programmed to know how to process the messages and content in
advance, and further programming or modifications can be provided
by downloading or flashing.
[0048] This system allows a user to respond to a poll and then get
poll results (even if not affected by that user). The PIR records
that a poll was sent at a particular time during the broadcast, or
that a message was sent to display a previously downloaded or
flashed poll. When the PVR plays back the broadcast program, the
poll is displayed at the same time during the broadcast event as it
would have been during the live broadcast, and can include any
timeout mechanisms included in the content or governed by operating
software. The user can then enter a response to the poll, and the
server system can respond with poll results based on all results
previously provided including the user with the PVR, or all results
from when the program was live. By waiting for the user to enter a
response the user is not influenced by seeing the poll results.
[0049] It may be desirable to disconnect the user from the server
during playback, in which case, the PIR would record the display of
the poll, any timer showing remaining time to enter a response, and
the poll results at the time of the broadcast being recorded. In
this way, the user has the experience he or she would have had,
with the exception that his or her response may not be used in the
poll results calculation.
[0050] In another example, in the case of a question-and-answer
game, the system allows the user to continue to play along with the
broadcast event in what appears to the user to be real time
question and answer. The user can play under the same conditions,
including if the trivia question has variable points depending on
the speed of the response, get his or her own personal results, and
get a leader board of the scores of other players as they were
during the broadcast, but the user may not be able to play with
others and be a part of the leader board because of the delay
involved, especially if the trivia has scoring that varies with the
speed of the response. However, because the interactive program
information is recorded, the user can compare his or her score to
those of other users who participated in real time.
[0051] The PIR can also store for playback chat messages displayed
during the broadcast, fun facts, and any other one-way or
interactive content provided from the server and with the
broadcast.
[0052] Those skilled in the art would appreciate that there could
be other ways to subscribe to the video control messages and
markers, and that video frame markers can take many forms,
including, but not limited to absolute and relative time code, and
frame sequence numbers. In addition or in the alternative, the PIR
can also store triggers or other content or address to obtain
content and associate them with times during the broadcast program
for display during playback.
[0053] An example of a hard drive device is a system made by TiVo,
Inc., which is also assignee of U.S. Pat. No. 6,233,389, which is
expressly incorporated by reference.
[0054] FIG. 9 illustrates the content display interface that
determines the layout of interactive components based on the client
hardware device. PC client 100 uses the full screen for interactive
programming. Fun fact 720, game 730, and chat 710 are displayed
across the full screen while TV 10 displays the on-air broadcast
410. In the case of the set-top client 110, the content display
interface adjusts the placement of the interactive components based
on the different type of client device. The on-air broadcast 410
takes up a large part of the screen real estate of set-top client
110 while fun fact 720, game 730, and chat 710 share the remaining
space.
[0055] Having described embodiments of the present invention, it
should be apparent that modifications could be made without
departing from the scope of the invention as defined by the
appended claims. In some instances, for example, the features are
described in conjunction with television broadcast, but for some
features, the broadcast event could be over internet (webcast) with
or without television, through radio, or other broadcast medium
that allows dissemination of information to a large number of
remote recipients.
* * * * *