U.S. patent application number 14/192583 was filed with the patent office on 2014-09-25 for method and system for archiving and retrieving items based on episodic memory of groups of people.
This patent application is currently assigned to 6S LIMITED. The applicant listed for this patent is John Leslie FRASER, Elizabeth SHARPE. Invention is credited to John Leslie FRASER, Elizabeth SHARPE.
Application Number | 20140289222 14/192583 |
Document ID | / |
Family ID | 41665089 |
Filed Date | 2014-09-25 |
United States Patent
Application |
20140289222 |
Kind Code |
A1 |
SHARPE; Elizabeth ; et
al. |
September 25, 2014 |
METHOD AND SYSTEM FOR ARCHIVING AND RETRIEVING ITEMS BASED ON
EPISODIC MEMORY OF GROUPS OF PEOPLE
Abstract
A method and system are provided for archiving and retrieving
digital media items based on episodic memory for predefined
associated groups of one or more people. The method and system may
comprise identifying one or more groups to which an archiving user
belongs; receiving a user input identifying select groups to which
a digital media item to be archived; receiving archiving input data
identifying the digital media item to be archived for the group;
generating index information using the received user archiving
input; storing the index information in association with the
identified digital media item; repeating the reception of archiving
input data, the generation of the index information and the storing
of the index information for the digital media item; receiving
retrieval input data representing a selection of candidate values;
and using the selections and the identified group to retrieve and
output digital media items that match the selection.
Inventors: |
SHARPE; Elizabeth;
(EDINBURGH, GB) ; FRASER; John Leslie; (EDINBURGH,
GB) |
|
Applicant: |
Name |
City |
State |
Country |
Type |
SHARPE; Elizabeth
FRASER; John Leslie |
EDINBURGH
EDINBURGH |
|
GB
GB |
|
|
Assignee: |
6S LIMITED
Edinburgh
GB
|
Family ID: |
41665089 |
Appl. No.: |
14/192583 |
Filed: |
February 27, 2014 |
Related U.S. Patent Documents
|
|
|
|
|
|
Application
Number |
Filing Date |
Patent Number |
|
|
12264381 |
Nov 4, 2008 |
8701022 |
|
|
14192583 |
|
|
|
|
09670635 |
Sep 26, 2000 |
7461099 |
|
|
12264381 |
|
|
|
|
Current U.S.
Class: |
707/722 |
Current CPC
Class: |
G06F 16/489 20190101;
G06F 16/435 20190101; G06F 16/438 20190101 |
Class at
Publication: |
707/722 |
International
Class: |
G06F 17/30 20060101
G06F017/30 |
Claims
1-14. (canceled)
15. A multimedia retrieval method, comprising: authenticating an
operator as a member of a group of users; identifying search
parameters for multimedia retrieval, the search parameters taken
from identification values representing one or more of: persons
that are registered as members of the group, event types and time;
searching a multimedia storage system using the search parameters,
retrieving, from the multimedia storage system, stored media items
based on matches between the search parameters and index
information stored the multimedia storage system in association
with the media items; and presenting the retrieved media items to
the operator.
16. The method of claim 15, wherein the index information includes
data provided by multiple members of the group of users.
17. The method of claim 15, wherein the search further comprises
searching for stored media items that are flagged, in the
multimedia storage system, for prioritized presentation, and the
presenting further comprising presenting the flagged media items
before presenting non-flagged media items.
18. The method of claim 15, wherein the presenting includes
presenting the retrieved media items in an order identified by
metadata stored in the multimedia storage system.
19. The method of claim 15, wherein the search parameters are
provided by an operator in response to a query provided to the
operator that identifies persons that are registered as members of
the group, event types and time.
20. The method of claim 15, wherein the search parameters are
random selections of persons that are registered as members of the
group, event types and time.
21. The method of claim 15, further comprising: as media items are
presented to the operator, revising the search parameters,
re-searching the multimedia storage system using the revised search
parameters, and retrieving a new set of stored media items based on
matches between the search parameters and the index information
stored in the multimedia storage system; and presenting the new set
of stored media items to the operator.
22. The method of claim 15, wherein the multimedia items include
items of different media types.
23. A method of archiving and retrieving digital media items,
comprising receiving a input identifying a group of users to which
an operator belongs; receiving archiving input data identifying: a
digital media item to be archived for the group, the operator's
selection from among one of: a plurality of group event types,
persons in the group, and time; generating index information using
the received archiving input; storing digital media item in a
multimedia storage system in association with the group, including
the index information; repeating the reception of archiving input
data, the generation of index information and the storing of the
index information for a plurality of digital media items;
responsive to operator input representing a command to retrieve
media items: searching the multimedia storage system for media
items stored as associated with the group, retrieving, from the
multimedia storage system, the stored media items; and presenting
the retrieved media items to the operator.
24. The method of claim 23, wherein the stored index information
includes index information provided by other members of the group
of users.
25. The method of claim 23, wherein the search comprises searching
for stored media items that are flagged, in the multimedia storage
system, for prioritized presentation, and the presenting comprises
presenting the flagged media items before presenting non-flagged
media items.
26. The method of claim 23, wherein the presenting includes
presenting the retrieved media items in an order identified by
metadata stored in the multimedia storage system.
27. The method of claim 23, wherein the searching comprises
searching according search parameters provided by the operator in
response to a query that identifies persons that are registered as
members of the group, event types and time.
28. The method of claim 23, wherein the searching comprises
searching according search parameters that are random selections of
persons that are registered as members of the group, event types
and time.
29. The method of claim 23, wherein the operator command indicates
a command to retrieve all media items associated with the
group.
30. The method of claim 23, further comprising: as media items are
presented to the operator, receiving new search parameters,
re-searching the multimedia storage system using the new search
parameters, and retrieving a new set of stored media items based on
matches between the new search parameters and the index information
stored in the multimedia storage system; and presenting the new set
of stored media items to the operator.
31. The method of claim 23, wherein the multimedia items include
items of different media types.
32. An multimedia retrieval system, comprising: a multimedia
storage system storing media items and index information that
identifies social groups of users to which each media item belongs
and other index information identifying user-supplied identifiers
of event types, persons in the group, and/or time of the respective
media item; an authentication system to authenticate an operator as
a member of a group of users, an archiving interface system,
provided in communication with operator terminal equipment, to
receive archiving input data from the operator identifying: a
digital media item to be archived for the group, the operator's
selection from among one of: a plurality of group event types,
persons in the group, and time; a database interface to generate
index information from the received archiving input data and store
the index information in the multimedia storage system; a retrieval
interface system, responsive to operator input representing a
command to retrieve media items, to search the multimedia storage
system for media items stored as associated with the group and
retrieve, from the multimedia storage system, the stored media
items; and a communication interface to presenting the retrieved
media items to the operator terminal equipment.
33. The system of claim 32, wherein the stored index information
includes index information provided by other members of the group
of users.
34. The system of claim 32, wherein the search comprises searching
for stored media items that are flagged, in the multimedia storage
system, for prioritized presentation, and the presenting comprises
presenting the flagged media items before presenting non-flagged
media items.
35. The system of claim 32, wherein the presenting includes
presenting the retrieved media items in an order identified by
metadata stored in the multimedia storage system.
36. The system of claim 32, wherein the searching comprises
searching according search parameters provided by the operator in
response to a query that identifies persons that are registered as
members of the group, event types and time.
37. The system of claim 32, wherein the searching comprises
searching according search parameters that are random selections of
persons that are registered as members of the group, event types
and time.
38. The system of claim 32, wherein the operator input indicates a
command to retrieve all media items associated with the group.
Description
RELATED APPLICATIONS
[0001] This application is a continuation in part of U.S.
application Ser. No. 09/670,635 filed Sep. 26, 2000, the contents
of which are incorporated herein by reference.
FIELD OF THE INVENTION
[0002] The present invention generally relates to archiving and
retrieval of digital media items. In particular, it relates to
archiving and retrieval process based on episodic memory of
predefined groups of people.
BACKGROUND
[0003] Storage and archiving techniques for digital media and
corresponding retrieval techniques are well known. However, the
work in this field is concentrated on facilitating the retrieval of
a particular digital media item i.e., one which matches the user's
requirements exactly. The prior art archiving and retrieval systems
are based on a semantic memory approach. Such an approach is suited
to the location of items relevant to a specific requirement.
[0004] The present invention provides a different approach to the
archiving and retrieval of digital media items of any type. The
invention is based on the fact that groups of people now readily
establish archives of digital media items that reflect their
activities, relationships and interests. The archiving and
retrieval system of the present invention is designed for use by
strong interpersonal groups, such as those formed by teenage girls,
families, work mates, or sports teams or clubs. The invention can
also be used by individuals to archive and retrieve digital media
items relating to a group of people. The invention is based on the
realization that people in creating these digital archives, are
establishing group `memory` and indulging in group nostalgia. Tools
bases on episodic memory rather than semantic memory will be more
effective and desirable for these purposes.
SUMMARY
[0005] In accordance with a first aspect of the present invention,
there is provided a method and apparatus for archiving and
retrieving digital media items in which the archiving and retrieval
process is based on the common episodic memory of a social group.
To archive digital media items, a user identifies a group to which
the user belongs. If it is used by an individual, the individual
may set up a group for himself/herself. In this case the archiving
and retrieval is based on the episodic memory of the individual in
relation to activities of the group. Once the user has identified
the group to which the user belongs, one or more digital media
items to be archived for the group can then be identified. The
digital media item to be archived may either already have been
stored in an archive or may get stored in the archive as part of
the archiving process. In order to archive the digital media item,
a user can select to index the digital media item using finite sets
of enumerate parameters. More specifically the sets of parameters
may comprise group event types to which the media item relates,
persons associated with the digital media item, and a time period
associated with the digital media item. The user wishing to archive
the digital media item can thus select zero or more group event
types, zero or more persons in the group and a time which can be
defaulted to a default "no time" or to the current date. Using
these three parameters index information for the digital media
items may be generated and stored in association with the digital
media items. For retrieval, a user can manually select the three
parameters or they can be automatically generated. Thus a user can
select zero or more group event types, zero or more persons and a
time period. The manually or automatically selected parameters may
be used to retrieve digital media items. The automatic generation
of parameters enables random reminiscence through archived digital
media items by group members.
[0006] The use of time, people and event types as the three
fundamental indices for archiving and retrieval may provide a
simple user friendly method of archiving material since it is based
on the way people remember things. The application of these indices
to a group with shared experience may limit the number of people
and event types needed for indexing or retrieving the digital data
items. This may facilitate a simple user interface such as a pull
down menu on a Graphical User Interface (GUI) to allow selection of
a person and event type from all possible people and event types,
and to allow selection of a particular time. The time used for
indexing can comprise not just a specific time such as a date, but
a time period such as a range of dates e.g., 17th to 24th Jul. 2000
or Aug. 2000.
[0007] Because the collection and indexing of the digital media
items may be based on episodic memory of the group, i.e., the group
members have chosen the digital media items and indexed them
according to their relevance to the group, the retrieval and
browsing through data digital items are attuned to memories of the
group members. The goal of retrieval is not to retrieve a specific
digital media item but instead to retrieve any digital media items
relating to a memorable episode. Thus the indexing system does not
uniquely identify digital media items, but replaces them within a
highly personal framework. For example, even if a specific
photograph were required, it would be remembered through the event
and hence retrieved by searching on the event or the person. Thus
the archive may contain many commonly indexed images taken at the
same time period involving the same people at the same event.
[0008] When a group is set up, a group identifier may be assigned
so that all digital media items archived for that group can be
associated to the group in the archive. A user setting up a group
may select a number of group members and a number of group event
types which are relevant to the episodic memory of the group.
Members can be added to groups over time and event types can be
supplemented thus expanding the index of the archived digital media
items. This allows flexibility since members of social groups do
not always remains fixed. The event types for different social
groups can be determined prior to use depending on the typical
shared experiences of the group, e.g., family, friends, sports team
or club, or sales organization.
[0009] The digital media items to be archived may be already
archived digital media items to which the index information may be
associated. Alternatively, the digital media items may be retrieved
from another stored location, for example, on a CD ROM or on a web
site, or the digital media items may be generated, e.g., by typing
text to provide a text item, recording sound to provide an audio
item, using a drawing package to create an image item, taking or
scanning pictures to generate image items or inputting digital
video images to provide video items. In a preferred embodiment, a
user may be provided with capability to obtain digital media items
of any media type from any location.
[0010] An embodiment of the present invention additionally provides
the ability to provide the user with a serendipitous nostalgic
experience. A user may select an automatic retrieval and browsing
of digital media items. As an initial query for retrieval, a time,
period, one or more event types, and one or more people may be
automatically randomly selected. This forms an initial "focus" for
a search. The focus is analogous to that on a camera whereby a wide
focus draws in many items while a narrow focus reveals a' smaller
number of items. Having performed an initial retrieval based on the
initial focus, the focus can be shifted e.g. by simply changing one
of the parameters to retrieve different digital media items and
thus take the user on a nostalgic trip. Alternatively, the focus
can be broadened or narrowed. Since the focus indicates the breadth
of indexing, the indexing fields for time, people and event types
can be broadened or narrowed to broaden or narrow the focus of the
search. For example a wide focus might comprise a time range of the
year 1999, a people range of everybody in the group, an event range
of parties or gigs. A narrower focus may comprise a time range of
August of 1999, either of two people in the group, and an event
type comprising a school outing.
[0011] The present invention is not just applicable to the
archiving and retrieval of digital media items for leisure
purposes. The present invention can be used in a business context
as well. For example, it may be used as a brain-storming aid by an
individual or a group. The system may be useful in trying to
retrieve digital media items related to a memorable episode such as
a particular meeting which took place with particular people on a
particular date. The meeting may have e-mails, letters, and
presentations associated with it. The system will allow members of
the group to archive and retrieve digital media items relating to
such a meeting using parameters which mimic their memory
process.
[0012] A second aspect of the present invention provides a method
and apparatus for archiving a digital media item in which index
information may be generated by allowing a user to identify a time,
at least one person from a predetermined plurality of people, and
an event type from a predetermined plurality of event types; and
storing the index information in association with the digital media
item.
[0013] The index information may be stored together with the
digital media item for example as a "header". Alternatively, the
digital media items may be stored separately with unique
identifiers such as a file name or index. The index information
then carries a reference to this unique identifier. The index
information may be stored separately from the digital media items
in a faster storage medium. This allows the digital mediabase to be
searched quickly but does not use the expensive, fast access
storage for space consuming digital media files.
[0014] In accordance with a third aspect, the present invention
provides a method of retrieving a digital media item from a
database, the method comprising identifying a digital media item
within the database; automatically identifying another digital
media item within the database; and retrieving that other digital
media item. The other digital media item can be identified via a
previously stored association with the first mentioned digital
media item, or the other digital media item can be identified at
random. The previously stored association can indicate that the
digital media items have at least one common characteristic. The
further digital media item can be retrieved automatically or can be
identified to the user that there is another digital media item
which can then be selected by the user.
[0015] The present invention can be implemented on a stand alone
processing apparatus or over a network. The database of index
information and digital media items may not be physically located
with the processing apparatus which is used by a user. In one
embodiment, the present invention is implemented over the Internet
using the World Wide Web. A server provides the functionality to
interface the digital media item database and the index information
database to users. The users can access the server using a
conventional web browser running on a computer or a Web TV.
Alternatively, the user may use a mobile device that uses a
suitable protocol such as the Wireless Application Protocol (WAP)
for accessing the server. The digital media items can be input to
the user's device, e.g., by typing or reading digital media files.
The digital media items can then be uploaded to the server for
archiving. Alternatively, the user may access digital media items
over the Internet for archiving.
[0016] Conveniently the present invention can be implemented on any
suitable processing apparatus by processor readable and executable
code. The code can be provided to the processing apparatus on any
suitable carrier medium such as a storage medium, e.g., floppy
disk, CD ROM, programmable memory device, or tape device, or a
signal, such as an electronic signal carried over a network such as
the Internet. Thus the processor readable and executable code can
be provided to a suitable processing apparatus on such a carrier
medium in order to implement the method and system of the present
invention.
BRIEF DESCRIPTION OF THE DRAWINGS
[0017] FIG. 1 is a block diagram giving an overview of the present
invention;
[0018] FIG. 2 is a schematic block diagram of a network arrangement
of processing apparatuses implementing embodiments of the present
invention;
[0019] FIG. 3 is a schematic block diagram of a stand alone
embodiment of the present invention;
[0020] FIG. 4 is a diagram of the graphical interface in accordance
with an embodiment of the present invention;
[0021] FIG. 5 is a flow diagram of the archiving process in
accordance with an embodiment of the present invention;
[0022] FIGS. 6a, 6b, 6c, 6d and 6e illustrate the tables of the
index information stored in the database in accordance with an
embodiment of the present invention;
[0023] FIG. 7 is a flow diagram of the retrieval process in
accordance with an embodiment of the present invention;
[0024] FIG. 8 is a table illustrating the serendipitous nostalgic
process in accordance with an embodiment of the present invention;
and
[0025] FIG. 9 illustrates a block diagram of a system according to
an embodiment of the present invention; and
[0026] FIG. 10 illustrates a diagram of the graphical interface in
accordance with an embodiment of the present invention.
[0027] FIG. 11 illustrates another user interface according to an
embodiment of the present invention.
DETAILED DESCRIPTION
[0028] The present invention provides for archiving and retrieving
digital media items based on episodic memory associated with social
groups. In one exemplary embodiment, an archiving user may be a
member of multiple groups. The present invention identifies a
social group to which an archiving user belongs and stores digital
media items to be archived for the social group. The present
invention builds index information for the digital media items such
that each instance of index information identifies an event type
associated with a respective digital media item and select
member(s) of the social group. In one exemplary embodiment, to
perform a retrieving process, the present invention receives a user
input identifying select social group(s) for which a search is to
be conducted and identifies candidate identification values based
upon the select social group(s). The present invention provides a
query to identify the candidate identification values. The
candidate identification values may include event types for the
select social group(s), persons from the select social group(s). In
response to the query, selection of the candidate identification
values may be made and a database may be searched. Digital media
items that satisfy the selection criteria may be retrieved.
[0029] FIG. 1 shows a block diagram of an overview of an embodiment
of the present invention in which groups of users 1 are registered
by a group registration process 2 in a database 3. It is assumed
that the members of the private group work together (or an
individual works independently but uses digital media items related
to other users) to identify, collect, translate or create digital
media items in different media e.g., favorite phrases, photographs,
verses of poetry, recordings of their own voices, clips of home
videos, or clips from their favorite musk. These items collectively
represent the culture of the group or individual. The items may all
be in the same medium, e.g. photographs or music recordings. The
items can be archived and at a later time individuals in the group
or the group as a whole can reminisce and review the contents of
the archive.
[0030] The group registration process 2 is preferably only
performed once although it is possible to update the groups over
time. It is preferred to keep this activity to a minimum however to
ensure a database meaningful to the group is constructed. An
example of a necessary modification to the group is when a new baby
joins a family. The storage process 7 is responsible for
associating, with each item to be stored, an identifier and any
other associated information for the index. The storage process 7,
which will be described in more detail hereinafter, comprises
identifying a group of people from the database 3, identifying one
or more multimedia items to be archived 6 with index information,
selection of an event type from a table of possible event types for
the group of people 4 and selecting a date from the calendar 5.
Also individuals within the group identified on the database 3 are
selected using the database 3 for association with the selected
item or items. Thus the storage process 7 indexes one or more
multimedia items in accordance with the group, members of the
group, one or more event types, and a date. Also, the storage
process 7 can further index the multimedia items to give details of
high points and trails as will be described in more detail
hereinafter.
[0031] The result of the storage process is stored or archived
multimedia items, high points, trails and the index of associated
information. The multimedia database can be structured so that the
multimedia items are stored separately to the index data.
[0032] The retrieval process 9 allows the digital media items to be
retrieved and displayed as will be described in more detailed
hereinafter.
[0033] FIG. 2 is a schematic diagram of a network demonstrating
embodiments of the present invention. The embodiments of the
present invention are implemented using the Internet 12 to
communicate between the user device 10, 13 or 14 and the remote
server 15. The user's devices 10, 13 and 14 are connected to the
server 15 over the Internet 12. The user's device can comprise a
general purpose computer 10 provided with a scanner 11 and a disk
drive 10a (e.g. floppy, CD or DVD). This enables a user to input
media items into the computer 10 either by scanning images or text
or by inputting text, audio, image or video files on a disk using
the disk drive 10a. Alternatively, the user's device can comprise a
web-TV 13 or a WAP enabled mobile device such as a mobile phone or
personal digital assistant (PDA) 14.
[0034] The server 15 comprises a controller 16 and the multimedia
database 17. The controller comprises a web server to provide the
necessary web interface for the users, and a database interface for
accessing the multimedia database 17.
[0035] Another source of media items for a user is a media library
18 such as a web site which is connected to the Internet 12. A user
can thus access media items at the media library 18 over the
Internet 12 and archive these in the multimedia database 17 at the
server 15 for later retrieval.
[0036] The multimedia database 17 may archive single medium or
multimedia media items. The content comes from the medium or media
which surround the members of the group, e.g. films, music, mimicry
and sayings (from actors, the group members etc.), TV adverts, TV
programs, books, plays, books, photographs from personal events
like dances, school trips, holiday and parties. The users may
create some of the items themselves and obtain some items from
on-line libraries such as the media library 18. Examples of library
material are: [0037] music samples [0038] advertising (not
necessarily targeted at the users) [0039] film and TV including
clips from classic films, TV series and soap operas books such as
text from drama, fiction and poetry [0040] mimicry, impersonations
of any of the above.
[0041] As noted, the present invention is suited to groups of
individuals with strong interpersonal bonds. It is envisaged that
the service will be applicable to groups of teenage girls, women
and families who will maintain and access the group archives over
long periods of time. The service also will be applicable to young
men, particularly those who engage in sports teams or other
competitive endeavors. However, it is also applicable to
individuals An individual or a small group with access to a single
machine may use a local storage medium such as a hard disk
drive.
[0042] The present invention finds application in business
environments as well. In such applications, as media items are
added to an archive reflecting important business milestones, the
system can assist businesses to develop camaraderie among company
employees. Employees can track company achievements and measure
company growth over time, which can foster company loyalty among
the employees.
[0043] FIG. 3 shows a schematic diagram providing local storage as
mentioned hereinabove. The diagram illustrates schematically the
architecture of a general purpose computer. The computer is
provided with a display 30 for displaying options to a user and for
displaying the media items. A keyboard 32 is provided for inputting
text and a pointing device such as a mouse 33 is provided to allow
user selections. A multimedia database. 34 is provided stored on a
suitable storage medium such as a hard disk drive or CD ROM.
Program memory 35 is provided storing computer code for
implementation by a processor 31. The program memory 35 stores
graphical user interface code for implementation by the processor
31 for providing a graphical user interface on the display 30.
Database interface code is stored for providing a database
interface to the multimedia database 34 for the retrieval and
storage of media items. Also the program memory 35 stores media
item modifying application code for implementing a media item
modifying application to allow a user to modify media items for
archiving all the components. All the components of the computer
are interconnected by a control and data bus 37.
[0044] The present embodiment of the present invention is described
with reference to groups of teenage girls. The present invention is
also suitable for groups of women and families. Further, the
invention is also expected to be useful for other types of private
social groups such as work mates, sports teams or clubs and even
individuals. Each type of group will have different sets of event
types that are relevant to them. For example, for teenage girls the
event types can comprise: party, holiday, dance, gig, show, school
trip, date.
[0045] FIG. 4 is a diagram of a graphical user interface 50 which
is displayed to the user in this embodiment. An area of the display
is provided as a work space 51. In this work space media items such
as images 52 and 53 and text item 54 can be placed using known
computing techniques. Thus the media items represented in the work
space 51 can be archived. The work space 51 can also be used for
displaying retrieved media items. Beneath work space 51 are user
controls for generating index information (called "tags" herein)
for archiving or for generating a query when retrieving. A drop
down box 55 is provided for selecting any of a number of people
within the group. A drop down box 56 is provided for identifying
one of a number of event types. A date entry 57 is provided to
enable a user to enter a date. (A second date entry, not shown in
FIG. 4, is also provided for retrieval of media items, to allow the
entry of both the start and end dates of a time period.) If no date
is entered, either today's date or a default "no date" is used for
the query. Also the date entry field can be used incomplete. For
example if no date is specified, month and year only will be used.
Also if no date or month is specified then only the year will be
used for the query. A check box 58 is also provided to enable
selection of a high point and a similar check box 59 is provided to
enable to designation of a trail. When the interface is used for
archiving, any of the media items on the work space 51 can be
selected e.g. by pointing and clicking, and if the high point check
box 58 is checked and the archive button 60 is selected, the media
item will be archived with the selected people, event Type and date
selection and will be marked as a high point. Similarly the trail
check box 59 is checked and a number of media items are selected in
the work space 51, if the archive button 60 is selected, a user
will be given an option to identify the sequence of media items in
the trail and then the media items will be archived with indexes
indicating the order in the tail.
[0046] A retrieve button 61 is also provided to enable retrieval of
items in accordance with the criteria of people, event type, date,
high point and trail. There is also provided a button for a
nostalgic retrieval where retrieval takes place automatically to
provide a serendipitous nostalgic experience for the user. The
storage and retrieval processes will be described in more detail
hereinafter.
[0047] The process of storage will now be described in more detail
with reference to the flow diagram of FIG. 5 and the tables of
FIGS. 6a, 6b, 6c, 6d and 6e.
[0048] Before the storage process begins, when the registration
process (2 in FIG. 1) is carried out by a member or members of the
groups, information is stored in a group table 6a. A group
identifies a group and people in the group are identified. When a
user wishes to use the system they will enter a user name and
password thus identifying themselves as a member of a group.
[0049] Once the user has logged on and the user wishes to archive
data, in step 71 media items 72 are imported onto the work space
51. At this point tag identifiers of the new items are generated
and in step 73 the new items are stored. This causes the storage of
the item identifier in the group table shown in FIG. 6b. The items
stored are associated to the group to which the user belongs.
[0050] In step 74 the user will select whether or not the item
comprises a high point. If the user selects the item as a high
point representing a particularly memorable event, in step 75 the
high point information is stored in the table illustrated in FIG.
6c. A high point flag is stored together with the item identifier.
First the users have the opportunity to state whether the item,
either on its own or with other items is a "high point". The user
can thus decide whether the media item holds some special
significance e.g. the last day of the group's last day in school,
the first date of the quietest member of the group.
[0051] In step 76 the user can then decide whether media items
displayed in the work space comprise a sequence of items that
constitute a special trail that links them in some meaningful way.
For instance:
[0052] 1. An image depicts a still scene from a film,
[0053] 2. A sound clip repeats a catch phrase from the film as
spoken by one of the actors,
[0054] 3. Another sound clip repeats the catch phrase in the voice
of a school teacher,
[0055] 4. An image depicts a caricature of the teacher.
[0056] If the user selects to store the media items as a trail, in
step 77 the user selected sequence of items in the trail is stored
in the trail table illustrated in FIG. 6d in the database. Each
trail is given an individual identifier and each media item in the
trail is identified by its item identifier in the sequence in the
trail.
[0057] It can be seen from FIG. 5 and FIGS. 6c and 6d that the
media item that is a high point can also comprise a media item in a
trail.
[0058] In step 78 the users are given the opportunity to indicate
which, if any, information is to be associated with each stored
item. As illustrated in the graphical user interface of FIG. 4, the
user can select: [0059] which, if any the registered people are to
be associated, [0060] which, if any of the event types are to be
associated, [0061] which, if any, date is to be associated. If the
user declines to suggest the date then the current date can
automatically be associated or alternatively no date can be
associated.
[0062] The database of groups of people 79 is thus used to provide
the list of people. The table of event types 80 may be used to
provide the event types available for each group. The calendar 81
may be used to provide relevant dates. When a user selects from
among these people, event types and dates, the selected data are
appended to the media items as tags.
[0063] The tag(s) are then stored in step 82 as index information
as illustrated in FIG. 6e. Each item is identified by an item
identifier, the medium type of each item is identified. This can
either be automatically determined or a user can define the medium
type. The people, time and event type tag(s) associated with each
item are stored in the table linked to the item identifier.
[0064] The archiving process is then completed in step 83. Using
this process the archive can gradually be built up over time with
many media items, some of them grouped as high points, some of them
forming pars of trails and some of them indexed on associated
information.
[0065] The retrieval process will now be described with reference
to the flow diagram of FIG. 7. At some point in time following the
storage, members will wish to delve into the contents of the group
archive. They might want to do this to have fun, to settle
arguments, to reminisce, to experience a stream of items as a
changing backdrop to other activities, to tidy up or to add new
items. The methods of retrieval in this embodiment are:
[0066] 1. Experience items of the same medium type or types
[0067] 2. Experience high points
[0068] 3. Follow predefined trails
[0069] 4. Experience items with certain focus
[0070] 5. Engage in serendipitous nostalgia
[0071] 6. Dip in at random.
[0072] The user can choose the particular method to be used at any
time. It is assumed that there is always a focus in this embodiment
determined either by the user or automatically. The focus can be
based on tags; which involves a selection of one or more of: one or
more people; date or time period; an event type.
[0073] The focus can be empty meaning that no person, time or event
type has been specified. In this case all items in the database for
a group are within focus.
[0074] Any combination of the retrieval methods can be used. The
retrieval will depend upon the retrieval parameters selected by the
user as illustrated in the graphical user interface of FIG. 4. The
parameters can comprise the associations people, event type or
date, high point, trail or a medium type. (The GUI of FIG. 4 does
not show a means by which a user can select a medium type. Any
suitable means can be used).
[0075] The flow diagram of FIG. 7 illustrates the retrieval
process. In step 90 a user may select the retrieval parameters and
in step 91 items are identified with the associated parameters. In
step 92 a predetermined number of the items are displayed. If a
large number of items are identified, in order to avoid clutter of
the work space 51, the number of items displayed can be limited. An
indication that there are more items can be displayed to allow the
user to select the display of the further items. In step 93, it is
determined whether one of the displayed items is a trail item. If
so, in step 94 the items in the trail are displayed. This can
either take place automatically or a user can be given a
notification that then is a trail to follow from a specific
displayed item to allow the user to select to fallow that trail and
to display the items. In this way the user can undergo a nostalgic
experience following the trail of media items.
[0076] In step 95 it is then determined whether the user has ended
the session and if so the process is terminated in step 96.
Otherwise the process returns to step 90. A selection of new
retrieval parameters is made.
[0077] As illustrated in the graphical user interface in FIG. 4, a
user may select to retrieve using nostalgic retrieval. This may
result in a serendipitous nostalgia process resembling how one
would browse through a box of old photographs or personal diaries:
a start point may be chosen at random, or on the basis of a person,
time (period) or event. Then, reviewing one or more items about
that person, time or event may trigger linking one of the items to
a different association and a new sequence of associated items is
reviewed. For example, when looking at items relating to Summer of
1998, the picture of one of the group brings to mind an 18th
birthday in which that person made a fool of himself/herself; or
finding a diary in which a party is described moves the focus to a
different event also described in the diary which took place around
that time. So the nostalgic trip continues with random length
sequences focusing on items that are associated in one way,
followed by a shift in focus and a new sequence of items.
[0078] FIG. 8 shows an example of a serendipitous nostalgic
journey. The first four columns show the items retrieved in
sequence while the 5th to 7th columns show the current focus.
Whenever the focus shifts, it is indicated in the 8th column. The
arrow shows how the new focus is generated. The journey encounters
both a high point and a trail, both of which are shown in the
table.
[0079] Thus the serendipitous nostalgia retrieval process comprises
identifying an initial focus comprising the parameters people,
event type, and date. This can be randomly determined. An initial
set of media items are retrieved using the initial focus. After
that one or a number of the parameters are changed to change the
focus and the new parameters are used for retrieving media items.
There are many ways in which the focus can be automatically
shifted. Table I below identifies some possible focus shifts in the
serendipitous nostalgia retrieval process.
TABLE-US-00001 TABLE 1 Some possible focus shifts in serendipitous
nostalgia CHANGE EXAMPLE narrow the focus by if the old focus has
no restriction on time period, one level then include a time period
in the new focus broaden the focus by if the old focus specifies an
event type, let the one level new focus have no restriction on
event type narrow the people add more people focus broaden the
people remove some of existing people focus narrow the time focus
reduce the time period from a year to a season, from a season to a
month, etc. make a small focus make people focus narrower or
broader by just shift one person make a large focus select
completely new people shift make a larger focus select completely
new people and a shift different event type make the largest focus
select new people, a different time period and a shift different
event type
[0080] There is also much scope for strategies for making
successive focus shifts over time. Some possibilities are shown in
Table 2 below.
TABLE-US-00002 TABLE 2 Some strategies for shifting focus STRATEGY
alternate broadening and narrowing the focus broaden and narrow the
focus at random alternate small focus shifts and large focus shifts
small and large focus shifts at random rotate focus shifts by
people, time and event types, choose randomly between changing
people, time and event types make shifts according to observed
behavior of different kinds of groups
[0081] The user may also wish to dip into the archive "at random".
This may mean literally at random, i.e., each item is selected with
no reference whatever to the previous one. This is easy for the
retrieval process to handle.
[0082] It may alternatively mean that they want to see successive
items that are as different as possible from each other. In this
case the retrieval process can ensure the largest "distance"
between two successive items, based on the associated information
of the respective items. For instance items with non overlapping
people are further away than those with overlapping people; items
with different event types are further away than those with the
same event types; the difference in times give a direct measure of
item distance.
[0083] In an embodiment, if the nostalgic retrieval mode may
entered while a media item is being presented by the system,
subsequent retrieval operations may be made based on tags
associated with the currently-presented media item. In this
embodiment, the system may determine if the tags include
identifiers of people associated with the group and, if so, the
system may search for other media items having tags that identify
common people. Hypothetically, if a currently-presented media item
has three people assigned to it by way of tags, the system may run
searches for those same three people and present media items for
which matches are detected. The system may present the matching
media items by focusing on each of the three people serially or,
alternatively, may randomly present media items for which any of
the three people are identified. If the nostalgic retrieval mode is
entered while a media item is being presented and the media item
has no people assigned via tags, the system may determine whether
the media item has tags identifying event types or dates. The
system may retrieve other media items having the same event type or
date tags associated with them and present those media items in the
nostalgic retrieval mode.
[0084] In another embodiment of operation, shown in FIG. 9, the
system may provide a plurality of temporary work spaces 910.1-910.n
for management of media items. In this embodiment, the system may
provide both a temporary workspace 910.1 and archive storage 920.1
for each group. The temporary workspace 910.1 may store media items
that are uploaded to the system by group members. The archive 920.1
may store media items that have been assigned tags according to the
identifiers associated with the group--tagged with people, event
type and/or time identifiers. Untagged media items may be stored in
the temporary workspace 910.1 for a predetermined time, say one
month, but may be deleted from the system after the predetermined
time elapses if they have not been assigned tags by group
members.
[0085] The temporary workspace 910.1 provides a convenient
mechanism through which group members may review new media items
uploaded by other group members and to select media items for
archiving. Consider an example where, following a group event (say,
a wedding or corporate retreat) a group member uploads digital
images to the system representative of the event. The digital
images may be uploaded to the system on a particular date (say, 1
Nov. 2008) without tags. During the next month, other group members
may review the media items from the temporary workspace and may
decide that certain images should be archived. At such times, the
other group members may assign tags to the images. When such tags
are assigned, the system may include the selected image(s) in the
group archive 920.1, whereupon they are protected against deletion
by the system. Any media items that remain untagged after the
predetermined period elapses may be deleted from the system.
[0086] Of course, uploading users may assign tags to media items as
the items are uploaded to the system. For example, a user may
upload a set of 10 pictures to the system, tagging each one of them
with a selected event type (say, wedding). In such a case, the
media items would be added to the group's archive 920.1 regardless
of any interaction by other group members.
[0087] In another embodiment, the system may permit copying of
media items between group archives and/or group workspaces. As
commonly occurs in social interaction, users may belong to multiple
groups. Media items may apply to multiple groups. For example,
someone who marries a second time may import media items of
children from one group (prior to the marriage) to a second group
(the new family). In such cases, the system may provide features to
permit a user to copy media items between groups to which he/she
belongs. In an embodiment, as a security provision, the system may
restrict the user from copying of media items uploaded by other
group members unless consent of the uploading group member is
given. In such cases, the user will be permitted to copy media
items between groups only if that particular user imported the
media item to the system initially.
[0088] FIG. 9 illustrates use of the present invention in a network
environment where the archives 920.1-920.n and temporary workspaces
910.1-910.n are maintained by server. In such an environment,
individual users may access the server from terminals provided in
communication with the server via a network such as the
Internet.
[0089] FIG. 10 illustrates a user interface 1000 according to
another embodiment of the present invention. An area of the display
may be provided as a display panel 1002. The display panel 1002 may
display media items 1003-1007, which as noted may include images
1003-1004, text item 1005 and audio files 1006. The user interface
also may display icons 1007-1008 for navigation purposes as
discussed herein. The user interface 1000 also may include various
tools through which a user may assign tags to media items for
archival. These tools may include, for example, pull down menus
1012-1016 to assign tags to media items and high point and trail
identifiers 1020, 1022. An archive button 1032 will cause the
system to save tags to media items, which will cause the system to
transfer a previously untagged media item from a temporary work
space to the archive.
[0090] In one embodiment, when a user opens a new session with the
system, the system may present newly added items in the first
instance of the user interface 1000. Thus, the newest items may be
presented in a "home page" for the group, which can be browsed by
the user to identify new media items that have been added to the
group most recently. These new media items may include untagged
media items that reside in the temporary workspace 910.1 (FIG. 9)
or tagged media items that are stored in the group's archive 920.1.
To select media items for the initial display, the system may
search the group storage spaces, both the temporary workspace 910.1
and the archive 920.1, identify media items that have an upload
date within a certain period of time (say, the past 30 days),
retrieve and display them. Thereafter, the user may use the
system's tools at his discretion.
[0091] In an embodiment, new media items that have been tagged with
a common event type may be displayed as an "album" 1007, an icon
that represents a navigation pathway to a plurality of media items
tagged with the event type. In this embodiment, when a user begins
a new session with the system and the system searches for media
items with a recent upload date, the system may group tagged media
items by event type and present an album icon representing the
event type. If a user interacts with the album icon 1007 (for
example, by clicking or double-clicking on it), the system may
present the media items of the album in a new display screen (not
shown).
[0092] Additionally, the system also may store metadata associated
with each media item to identify the group member that uploaded the
respective media item to the system (stored in a "recorded by"
field). When a user opens a new session with the system, the system
may display other icons 1008 identifying media items that were
uploaded by other group members. User interaction with such an icon
(for example, by clicking or double-clicking on it) may cause the
system to present the media items uploaded by a common group member
in a new display screen (not shown). Thereafter, the user may
interact with the media items associated with the icon, for
example, by reviewing the media items and possibly adding tags to
them.
[0093] In this regard, it should be appreciated that the "recorded
by" field stored for a particular media item is distinct from a
people "tag" applied to the media item for indexing. The recorded
by field merely identifies a group member who uploads a media item
to the system. Media items may be uploaded to the system as either
tagged or untagged media items. When a tag is added to a media item
identifying a person, the tag indicates that the media item is
relevant a particular group member. In many common instances, a
media item will be uploaded by a first group member but be assigned
a tag that identifies some other group member. The uploaded by icon
1008 merely provides a convenient technique for group members to
navigate among newly added media items for review.
[0094] The system also may include a chat feature, which can be
accessed via a button 1020 of the user interface. When engaged, the
system may display a record of messages posted by group members to
other members of the group. The chat feature may provide a
convenient mechanism for group members to post temporary messages
within the group, particularly when adding new media items to the
system calling attention to particular items. The system 1000 may
maintain messages for a predetermined period of time (say, 30 days)
after which, they are deleted.
[0095] FIG. 11 illustrates a user interface 1100 according to
another embodiment of the present invention. This embodiment
illustrates a user interface 1100 that may be used during item
browsing. The user interface may include a display panel 1110 for
display of a currently viewed media item and navigation controls
1120-1145 to control presentation of media items. Directional
controls 1120 may permit users to pause a presented media item or
to scroll forward or backward as desired. Other controls 1130-1145
may engage or disengage different modes of presentation, for
example, the presentation of high points or trails or to select
tags (people, events, dates) on which to focus presentation.
[0096] The user interface 1100 also may present a control 1150 to
permit an operator to supplement media items with posts. Herein, a
"post" is an auxiliary media item that may be stored in association
with a primary media item that may include recorded notes of group
members. For example, a photo may have a text note stored with it
as a post. The text note may include member descriptions of events
associated with the photo. A post may take any form and may
include, text files, audio files and digital images. In one
embodiment, a text pad may be provided when a user clicks on the
post button 1150. In another embodiment, a voice recording menu may
be provided when a user clicks on the post button 1150. Further,
the system may permit group members to import posts from media
items created external to the system and store them as linked to
primary media items.
[0097] During retrieval operations, when the system presents a
media item that has a post associated with it, the system may
display an icon 1160 indicating the presence of a post. User
interaction with the system may cause the post to be presented as
well. For example, a user may click on the icon 1160 to cause the
system to present the post. Alternatively, if an operator pauses
playback on a media item for which a post exists, the system may
present the post automatically after a predetermined period of time
(say, 30 seconds).
[0098] As noted, retrieval may be based on a specific person or a
group. The user interface may include user interface elements 1125
to permit a user to specify a person on which the search operations
are to focus. In an embodiment, the user interface also may include
a user interface element 1170 through which a user may specify an
order for presentation of media items, for example, chronological
order or reverse chronological order. In a further embodiment, a
user may command the system to search for media items tagged as
associated with a specified person regardless of the group. In this
manner, a chronological presentation may display media items along
the identified person's lifetime.
[0099] Additionally, the user interface may include a button 1180
through which a user may decide to review material not yet seen. In
this embodiment, the system may store a user history, which records
media items that the user has seen in previous sessions. During
playback, the system may compare stored media items against the
user history to ensure that media items being presented have never
been presented to the user before or, alternatively, have not been
presented to the user within a predetermined amount of time or
number of user sessions.
[0100] Those skilled in the art can appreciate from the foregoing
description that the present invention can be implemented in a
variety of forms. Therefore, while the embodiments of this
invention have been described in connection with particular
examples thereof, the true scope of the embodiments of the
invention should not be so limited since other modifications will
become apparent to the skilled practitioner upon a study of the
drawings, specification, and following claims.
* * * * *