U.S. patent application number 11/280673 was filed with the patent office on 2006-04-13 for method and system for obtaining images from a database having images that are relevant to indicated text.
This patent application is currently assigned to Corbis Corporation. Invention is credited to Michael D. Craig, Stephen D. Land, Roland C. Lindsey, Debra L. Linker, Curtis M. Stratmeyer.
Application Number | 20060080306 11/280673 |
Document ID | / |
Family ID | 23486306 |
Filed Date | 2006-04-13 |
United States Patent
Application |
20060080306 |
Kind Code |
A1 |
Land; Stephen D. ; et
al. |
April 13, 2006 |
Method and system for obtaining images from a database having
images that are relevant to indicated text
Abstract
A method and system for using indicated text to automatically
query a search engine for a database and return images that are
relevant to the indicated text. At least five integrated components
are employed by a client program to get, view and use a returned
image. Among these is a user interface component that provides for
automatically creating search criteria for a query from the
indicated text and inserting a thumbnail or higher quality image
into an open document. Also included is a network component that
provides for detecting of a network and managing the transfer of
data across the network such as the Internet and an intranet. In
addition, a metadata results component provides for managing the
storing, parsing and displaying of the metadata results returned
from a query of the database of images.
Inventors: |
Land; Stephen D.; (Seattle,
WA) ; Linker; Debra L.; (Sammamish, WA) ;
Lindsey; Roland C.; (Renton, WA) ; Stratmeyer; Curtis
M.; (Bellevue, WA) ; Craig; Michael D.;
(Seattle, WA) |
Correspondence
Address: |
DARBY & DARBY, P.C.
P.O. BOX 5257
NEW YORK
NY
10150-5257
US
|
Assignee: |
Corbis Corporation
Seattle
WA
|
Family ID: |
23486306 |
Appl. No.: |
11/280673 |
Filed: |
November 16, 2005 |
Related U.S. Patent Documents
|
|
|
|
|
|
Application
Number |
Filing Date |
Patent Number |
|
|
09376748 |
Aug 17, 1999 |
|
|
|
11280673 |
Nov 16, 2005 |
|
|
|
Current U.S.
Class: |
1/1 ;
707/999.003; 707/E17.026 |
Current CPC
Class: |
Y10S 707/99945 20130101;
Y10S 707/99934 20130101; Y10S 707/99935 20130101; G06F 16/58
20190101 |
Class at
Publication: |
707/003 |
International
Class: |
G06F 17/30 20060101
G06F017/30 |
Claims
1. A method for searching for an object that is related to an
indicated object, comprising: automatically creating a query
related to the indicated object, the query having a data structure
that is recognizable by a local search engine and a remote search
engine; if the remote search engine is accessible, providing the
query over a network to the remote search engine to search a remote
database for at least one object that is related to the indicated
object; if the remote search engine is inaccessible, providing the
query to the local search engine to search a local database for at
least one object that is related to the indicated object; and
returning a result from the query, wherein the result indicates if
the at least one object is related to the indicated object.
2. The method of claim 1, wherein if the remote search engine is
accessible further comprises establishing a connection to the
remote search engine using at least one of a proxy server or a
dial-up facility.
3. The method of claim 1, further comprising: producing a display
of the at least one object, so that at least one of the objects may
be associated with the indicated object within a document.
4. The method of claim 1, wherein automatically creating a query
further comprises creating the query based on a context of the
indicated object that includes at least one of text, a template,
sound, video, a use, or a user preference.
5. The method of claim 1, wherein returning the result from the
query further comprises: downloading a first group of the at least
one object; and enabling a display of the first group using a slide
show facility.
6. The method of claim 1, wherein providing the query to the local
search engine further comprises employing the query to search a
local drive that includes the local database.
7. The method of claim 1, wherein if the remote search engine is
accessible, further comprises employing an autoconnect facility to
initiate a network connection to the remote search engine.
8. The method of claim 1, wherein at least one of the objects
further comprises at least one of a video, picture, or text.
9. The method of claim 1, further comprising: enabling at least one
of the objects related to the indicated object to be purchased over
a network.
10. A processor readable medium that includes data, wherein the
execution of the data provides for obtaining an object that is
related to indicated text by enabling actions, comprising:
automatically creating a query related to the indicated text, the
query having a data structure that is recognizable by a local
search engine and a remote search engine; if the remote search
engine is accessible, providing the query over a network to the
remote search engine to search a remote database for at least one
object that is related to the indicated text; if the remote search
engine is inaccessible, providing the query to the local search
engine to search a local database for at least one object that is
related to the indicated text; and receiving a result from the
query, wherein the result indicates if the at least one object is
related to the indicated text.
11. The processor readable medium of claim 10, wherein at least one
of the objects further comprises at least one of a video, picture,
or text.
12. The processor readable medium of claim 10, the actions further
comprising displaying the at least one object as a thumbnail
image.
13. The processor readable medium of claim 10, the actions further
comprising: if a purchase of a higher quality image associated with
the at least one object is indicated, launching a program for use
in performing an electronic financial transaction service that
enables the purchase of the higher quality image.
14. The processor readable medium of claim 10, the actions further
comprising: providing financial information to an electronic
service over the network, the financial information enabling a
purchase of a higher quality image associated with the at least one
object; and inserting the purchased higher quality image into a
document so that the higher quality image is displayed with the
indicated text.
15. An apparatus for use in obtaining an object that is related to
an indicated object, comprising: a processor; and a memory in
communication with the processor for use in storing data and
machine instructions that cause the processor to perform a
plurality of operations, including: automatically creating a query
related to the indicated object, the query having a data structure
that is recognizable by a remote search engine and a local search
engine; if a network connection to the remote search engine is
available, providing the query to the remote search engine, wherein
the remote search engine searches a remote database for at least
one object that is related to the indicated object; if the network
connection to the remote search engine is unavailable, providing
the query to the local search engine, wherein the local search
engine searches a local database for at least one object that is
related to the indicated object; and receiving a result from the
query, the result including at least one object is related to the
indicated object.
16. The apparatus of claim 15, the operations further comprising:
displaying the at least one object related to the indicated object;
and enabling the display of the at least one object to be
selectable for insertion into a document.
17. The apparatus of claim 15, the operations further comprising:
providing financial information to an electronic service over the
network, the financial information enabling a purchase of a higher
quality image associated with the at least one object.
18. The apparatus of claim 15, the operations further comprising:
displaying the at least one object as a thumbnail image; and if a
purchase of the at least one object as a higher quality image is
indicated, performing an electronic financial transaction service
that enables the purchase of the higher quality image.
19. The apparatus of claim 18, wherein if the purchase of the
higher quality image is indicated further comprises connecting to
the electronic financial transaction service over a network.
20. The apparatus of claim 18, wherein performing an electronic
financial transaction service further comprises: enabling a
selection of at least one of a resolution, a color, or a use of the
higher quality image; and employing the selection to determine a
cost associated with the purchase.
21. A system for use in obtaining an object that is related to an
indicated object, comprising: a remote server, comprising: a remote
database for use in storing objects; and a remote search engine
having data and machine instructions that perform operations
including: receiving a query; and searching the remote database for
at least one object based on the query; and a client device
comprising: a local database for use in storing objects; a local
search engine; and a processor having data and machine instructions
that cause the processor to perform operations including:
automatically creating the query related to the indicated object,
the query having a data structure that is recognizable by the
remote search engine and the local search engine; if the network
connection to the remote server is available, providing the query
to the remote search engine, wherein the remote search engine
searches the remote database for at least one object that is
related to the indicated object; if the network connection to the
remote server is unavailable, providing the query to the local
search engine, wherein the local search engine searches the local
database for at least one object that is related to the indicated
object; and receiving a result from the query, wherein the result
indicates if at least one object is related to the indicated
object.
22. The system of claim 21, wherein the remote server is accessed
over a network.
23. The system of claim 21, the operations of the client device's
processor further comprising: providing financial information to an
electronic service, the financial information enabling a purchase
of a higher quality image associated with the at least one
object.
24. The system of claim 21, the operations of the client device's
processor further comprising: enabling at least one of the objects
related to the indicated object to be purchased over a network.
Description
CROSS-REFERENCE TO RELATED APPLICATIONS
[0001] This application is a continuation of prior U.S. patent
application Ser. No. 09/376,748, filed Aug. 17, 1999, entitled
"Method And System For Obtaining Images From A Database Having
Images That Are Relevant To Indicated Text," and claims the benefit
under 35 U.S.C. .sctn.120, which is further incorporated herein by
reference.
FIELD OF THE INVENTION
[0002] This application relates generally to obtaining images from
a database, and, more specifically, to returning chosen images from
the database that are relevant to indicated text in a document.
BACKGROUND OF THE INVENTION
[0003] In the past, when a user of an application program wished to
add an image to a file created by that application, the user
manually searched a database of images or surveyed a relatively
large group of images organized into predetermined categories.
Alternatively, the user might be required to pre-purchase access to
a database of images prior to searching for an image relevant to
the content of the document. In either case, the user would be
required to indicate the relevant image by manually comparing a set
of preselected images to the content of a document.
[0004] Therefore, it is desirable to provide a simple and intuitive
facility for enabling a user to choose an image relevant to the
content of a document. The facility could be a stand alone
application program or integrated with an existing application
program, e.g., a word processor, slide show presentation or email
program. It is also desirable to provide a facility that enables
the user to purchase a chosen image and indicate the quality and
options associated with the purchased image. Also, the facility
should enable the purchased image to be viewed and printed with any
widely available application program.
SUMMARY OF THE INVENTION
[0005] In accordance with the present invention, a method for
searching a database to obtain an object that is related to an
indicated object, comprising: (1) automatically creating a query
related to the indicated object, the query having a data structure
that is recognizable by a search engine for the database; (2)
providing the query to the search engine, the search engine
searching the database for at least one object that is related to
the indicated text; (3) returning the result from the query of the
database, the result indicating when at least one object is related
to the indicated text; and (4) producing a display of a related
object, so that the related object may be associated with the
indicated object. The indicated object and the related object may
include data such as video, picture, sound, and text. Also, a
qualification engine may be used to determine a context of the
indicated object. The query for the database can be automatically
created based on the context of the indicated object. Additionally,
the related object may be purchased over a network. When complete
financial information provided over a network to an electronic
commerce service, the service can enable the purchase of the
related object.
[0006] In accordance with another embodiment of the present
invention, a method provides for obtaining an image from a database
for insertion into a document, the image being related to indicated
text, comprising: (1) enabling an automatic creation of a query
related to the indicated text, the query having a data structure
that is recognizable by a search engine for the database; (2)
providing the query to the search engine, the search engine
searching the database for an image that is related to the
indicated text; (3) returning the result from the query of the
database, the result indicating when at least one image is related
to the indicated text; (4) enabling the display of at least one
image indicated by the result from the query, a displayed image
being selectable for insertion into the document; and (5)
displaying a related image that is inserted into the document, so
that the related image is associated with the indicated text in the
document.
[0007] In accordance with other aspects of the other embodiment of
the present invention, the method provides for employing a user
interface component to automatically create the query for the
database, the creation of the query being related to the indicated
text. The user interface component enables the indicated text to be
edited and chosen in the document. The indicated text may be chosen
from within an application program that provides the document. A
command can be chosen to create the query for the indicated text,
the command may include a selection in a context menu, drop-down
menu, pop-up window, dialogue box, toolbar, and hot key. The
indicated text may be chosen in another application program, e.g.,
a clipboard program that is separate from the application program
that provides the document.
[0008] In accordance with yet other aspects of the other embodiment
of the present invention, the method provides for enabling a
qualification engine to determine a context of the indicated text
within the document. The context of the indicated text may be
employed by the user interface component to automatically create
the query for the database. The determined context of the indicated
text may include text, template, sound, video, picture, use, and
user preference.
[0009] In accordance with still other aspects of the other
embodiment of the present invention, the search engine may be a
local search engine that employs the query to search for related
images on a local drive that includes the database. The local drive
may include a hard disk, floppy disk, tape drive, DVD and CD-ROM.
The query of the database may include an XML data structure. Also,
a network component may be employed to communicate with the search
engine over a network that can include an intranet and the
Internet. Additionally, a result component may be employed to
manage the result of the query returned by the search engine, the
result component enabling the parsing, storing and display of the
result of the query. The result may be provided in a metadata
format.
[0010] In accordance with other aspects of the other embodiment of
the present invention, the method provides for requesting at least
one related image from the database that is indicated by the result
of the query, the related image being provided as binary image
data. An image component may be provided to manage the storage and
display of binary image data.
[0011] In accordance with yet other aspects of the other embodiment
of the present invention, a navigation component may be employed to
provide a control for displaying at least one related image. The
navigation component enables a slide show display of a group of
related images that are indicated in the result from the query. The
navigation component enables the slide show to display other groups
of related images that are indicated in the result from the query.
The navigation component may include a control for determining a
period of time that each related image is displayed in the slide
show. Also, the navigation component can include a control for
indicating the number of the related image in the group that is
currently displayed in the slide show. Additionally, the navigation
component may include a control for indicating each group of
related images that are currently displayed in the slide show.
[0012] In accordance with yet other aspects of the other embodiment
of the present invention, a help facility may be launched in
response to an input and provide an explanation of a chosen topic.
Also, a thumbnail of the related image may be displayed.
Additionally, a digital watermark may be included with the related
image which provides information related to the content of the
related image. Furthermore, the query can include a cookie that may
provide information related to a user.
[0013] In accordance with other aspects of the other embodiment of
the present invention, the method provides for: (1) indicating a
higher quality image of the related image is to be purchased over a
network; (2) providing financial information to an electronic
commerce service over the network, the electronic commerce service
enabling the purchase of the higher quality image when the
financial information is complete; and (3) inserting the purchased
higher quality image into the document so that the higher quality
image is displayed with the indicated text. An electronic shopping
cart may be employed to store a potential purchase of the higher
quality image. A parameter and use of the higher quality image may
be indicated.
[0014] In accordance with yet other aspects of the other embodiment
of the present invention, each time indicated text is employed to
create the query, the method may automatically save the indicated
text as an entry in a history file and enable at least one of the
entries in the history file to be chosen for the currently
indicated text. Also, a URL may be embedded in the related image
pasted into the document. The URL can provide a link to information
associated with the related image. Additionally, the method can
automatically connect to the search engine for the database when
the search engine is remotely located from the indicated text.
Also, when no indicated text is provided, a word that is closest to
a cursor may be determined and employed as the indicated text.
[0015] In accordance with another embodiment of the present
invention, a method for electronically purchasing an image over a
network, comprising: (1) automatically creating a query related to
an indicated object, the query having a data structure that is
recognizable by a search engine for the database; (2) providing the
query to the search engine, the search engine searching the
database for at least one image that is related to the indicated
object; (3) returning the result from the query of the database,
the result indicating when at least one image is related to the
indicated object; (4) indicating a related image is to be purchased
over the network, financial information being provided to an
electronic commerce service that enables the purchase of the
related image when the financial information is complete; and (5)
when the related image is purchased, enabling a display of the
related image, so that the related image may be associated with the
indicated object.
[0016] In accordance with other additional aspects of the present
invention, a system which implements substantially the same
functionality in substantially the same manner as the methods
described above is provided.
[0017] In accordance with yet other additional aspects of this
invention, a computer-readable medium that includes
computer-executable instructions may be used to perform
substantially the same methods as those described above is
provided.
BRIEF DESCRIPTION OF THE DRAWINGS
[0018] The foregoing aspects and many of the attendant advantages
of this invention will become more readily appreciated as the same
become better understood by reference to the following detailed
description, when taken in conjunction with the accompanying
drawings, wherein:
[0019] FIG. 1 illustrates indicated text and a context menu in a
document displayed in a graphical user interface for an exemplary
email program;
[0020] FIG. 2 shows an exemplary pop-up window for an Imagizer
program;
[0021] FIG. 3 illustrates an exemplary pop-up window for options
associated with the Imagizer program;
[0022] FIG. 4 shows a graphical image disposed in the document
displayed in the graphical user interface for the exemplary email
program;
[0023] FIGS. 5A-5B illustrate a flowchart of the logic for
obtaining an image that is relevant to indicated text;
[0024] FIG. 6 shows a schematic overview of a client program that
includes five separate components for performing functions related
to obtaining images that are relevant to the indicated text;
[0025] FIG. 7 illustrates a schematic overview of communication
between the client program and a server program for obtaining
images that are relevant to the indicated text;
[0026] FIG. 8 shows an exemplary computer system for implementing
the client program; and
[0027] FIG. 9 is a schematic overview illustrating the system
architecture for implementing the present invention over the
Internet.
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT
[0028] A method and system is described for using indicated text to
automatically query a search engine for a database and return
images that are relevant to the indicated text. At least five
integrated components are employed by a client program to get, view
and use a returned image. A user interface component provides for
automatically creating search criteria for a query from the
indicated text and inserting a thumbnail or higher quality image
into an open document. A metadata results component provides for
managing the storing, parsing and displaying of the metadata
results returned from a query of the database of images. A
navigation component provides for managing user interface
navigation elements that are employed to control the display of the
results (thumbnail images) of the query, e.g., play, stop, back and
next controls. An image binary data component provides for managing
the display of returned images and managing the storage of the
binary image data for the thumbnail and higher quality images.
Also, a network component provides for detecting the presence of a
network and its settings and managing the transfer of data across
the network such as the Internet and an intranet. Additionally, a
qualification engine may be used to determine the context of the
indicated text. An electronic commerce service may be used to
purchase higher quality versions (improved resolution and/or color)
of the thumbnail images.
[0029] The present invention enables a user to choose an image from
a group of images that are determined to be the most relevant for
indicated text. The present invention uses indicated text to find
relevant images by automatically generating a query based on the
indicated text for a database of images and displaying the query
results as thumbnail images in a slide show. The user may insert
any of the thumbnail images into a document or purchase a higher
quality version of an indicated thumbnail image for use in the
document. An electronic shopping cart may be provided for
temporarily storing several higher quality images that may be
purchased individually or as a group at a later date.
[0030] It is envisioned that the functionality of the present
invention may be provided in different ways, including a
stand-alone application program and an add-on (extension) facility
incorporated into an application program. For example, the present
invention may be implemented as an executable file (EXE), as a
Visual Basic control (VBX) or as a dynamic linked library (DLL).
Also, the application programs that work with the present invention
may include email, spreadsheet, word processor, slide show
presentation, browser, and editor.
Graphical User Interface
[0031] FIG. 1 illustrates an exemplary graphical window 100A for an
email application program that incorporates an Imagizer facility
for implementing the functionality of the present invention. The
Imagizer facility may be integrated into the email application
program in several ways, including a DLL or a separate add on
program.
[0032] In a document window 102, the sentence (string) "Do you want
to learn how to sail" is positioned in the upper left hand corner.
The word "sail" 106 is highlighted (indicated) in the sentence and
a context menu 104 is disposed adjacent to the indicated word.
Alternatively, the context menu 104 may be disposed adjacent to a
cursor. However, in this example, the context menu 104 for the word
"sail" 106 is displayed when a button on a user interface pointing
device, e.g., a mouse, is selected. The context menu 104 lists
several commands including cut, paste, font, and imagizer. When an
imagizer command 108 is selected, a pop-up window 112 entitled
"imagizer" is displayed by the Imagizer facility, as shown in FIG.
2. Although not shown, it is envisioned that the imagizer command
may be selected as an element on a toolbar and as a menu item in a
drop-down menu. Additionally, when no text is indicated, the
Imagizer facility may determine the nearest word to the cursor and
employ that word as the indicated text for searching the database
of images.
[0033] In FIG. 2, the pop-up window 112 illustrates a thumbnail
image 110A of a sailboat. The thumbnail image 110A is disposed in
the upper portion of the pop-up window 112 and the thumbnail image
is the currently displayed image in a slide show for a group of
images relevant to the indicated word "sail" 106. A slide control
118 is disposed in the lower portion of the pop-up window 112 and
the control is animated to graphically illustrate the progressive
display of each thumbnail image in the slide show. Additionally,
the slide control 118 may be selected to cause the slide show to
move to the display of a particular thumbnail image. A button 114,
entitled "Purchase HQ Image," is displayed adjacent to the
thumbnail image 110A in the upper right hand portion of the pop-up
window 112. As described in greater detail below, the selection of
the button 114 causes an electronic commerce transaction to be
initiated for the purchase of a higher quality (higher resolution)
version of an indicated thumbnail image.
[0034] Another button 116, entitled "Paste Image Into Document," is
displayed adjacent to the thumbnail image 110A in the upper right
hand portion of the pop-up window 112 and directly below the button
114. As described in greater detail below, the selection of the
button 116 causes an indicated image, e.g., a currently displayed
thumbnail image or a purchased higher quality version, to be pasted
into the document adjacent to the indicated word "sail" 106.
[0035] A button 115, entitled "Send Picture Mail," is displayed
adjacent to the thumbnail image 110A in the uppermost right hand
portion of the pop-up window 112, directly above button 114. The
selection of the button 115 causes an email facility to create and
send an email message that includes the indicated image from within
the Imagizer facility. Although not shown, the email facility
enables the user to enter an email destination and text to
accompany the indicated image.
[0036] Another button 120, entitled "<<Back," is displayed in
the lower left quarter of the pop-up window 112 and below the
slider control 118. Directly to the right of the button 120,
another button 122, entitled "Play," is disposed and a button 124,
entitled "Next>>," is positioned to the right of the button
122. The three buttons 120, 122, and 124 enable a user to navigate
the slide show by selectively controlling the play, advance, and
replay of the thumbnail images. A button 126, entitled "More," is
displayed to the right of the button 124 ("Next>>") and the
selection of the button 126 causes another pop-up window 128,
entitled "More," to be displayed, as shown in FIG. 3.
[0037] Although not shown, it is envisioned that the functionality
of the "<<Back" button 120 and the "Next>>" button 124
may be incorporated into a horizontal scrollbar that includes a
pointer. The horizontal scrollbar could include separate buttons
disposed at opposing ends of the scrollbar and the selection of a
button would enable a forward or backward navigation of the group
of thumbnail images. Also, the pointer might move along the
scrollbar as each thumbnail image in the group is sequentially
displayed. By selecting the position of the pointer on the
scrollbar, the user could navigate through the group of thumbnail
images.
[0038] FIG. 3 shows the "More" pop-up window 128 with a text entry
box 130 positioned in the upper left hand quarter of the pop-up
window. A button 132, entitled "Search," is disposed adjacent to
the right hand side of the text entry box 130. When text is entered
in the box 130 and the search button 132 is selected, this action
causes a database to be searched for images relevant to the entered
text, which is discussed in greater detail below. Also, a group of
relevant images returned from the database are displayed in a slide
show, as shown in the pop-up window 112 in FIG. 2.
[0039] A button 134, entitled "< Back 50," is positioned
directly below the text box 130 in the bottom left hand of the
pop-up window 128 and another button 136, entitled "Next 50 >,"
is positioned directly below the search button 132 in the bottom
right hand of the pop-up window. Also, a view box 135, entitled
"Now Viewing," is positioned horizontally between the buttons 134
and 136, which displays reference numbers for the group of relevant
thumbnail images that are currently displayed in the slide
show.
[0040] The slide show displayed in pop-up window 112 uses a
predetermined number (group) of thumbnail images that are relevant
to the indicated/entered text. However, the present invention
enables more than one group of relevant images to be viewed in the
slide show by using the buttons 134 and 136 to navigate the display
of different groups of images. When the "< Back 50" button 134
is selected, this action will cause a previously displayed group of
fifty relevant thumbnail images to be used in the slide show.
Similarly, when the "Next 50 >" button 136 is selected, the next
group of fifty relevant thumbnail images will be displayed in the
slide show.
[0041] Alternatively, a seamless slide show display (no 50 image
pagination) of the entire group of thumbnail images may be
provided. In this case, the buttons 134 and 136 would not be
provided in the "More" pop-up window 128.
[0042] A slide control 138 is disposed in the bottom portion of the
pop-up window 128. The manipulation of the slider control 138 will
cause an increase or decrease in the amount of time each thumbnail
image is displayed in the slide show. Also, a button 140, entitled
"help," is disposed below the slide control 138 in the lower left
hand of the pop-up window 128. The selection of the help button 138
causes a help facility to display information regarding a chosen
topic in an index. Another button 142, entitled "About Imagizer,"
is positioned below the slide control 138 in the lower right hand
of the pop-up window 128. The selection of the button 142 causes
the display of information regarding the version of the Imagizer
facility and other related matters. Also, a button 131, entitled
"About Indicated Image," is positioned in the upper left most
portion of the pop-up window 128. The selection of the button 131
causes the display of related information that is included in
metadata associated with an indicated image. For example, the
Imagizer facility may display related information that includes an
image identification number, author, original date that image of
subject matter was captured, location and descriptive title. It is
also envisioned that this information may be automatically
displayed by the Imagizer facility along with a display of each
related image.
[0043] FIG. 4 illustrates another exemplary window 100E for the
application program that incorporates the Imagizer facility. In the
document window 102, a higher quality (version) image 110B of a
sail boat is pasted into the open document window adjacent to the
word "sail" 106 in the right hand portion of the window. This
example shows the results when a higher quality version of a
thumbnail image is purchased and pasted into an open document.
[0044] Additionally, an embedded link (URL) may be automatically
added to a pasted image. When the pasted image is selected, the
embedded URL could provide a link to an information page associated
with the pasted image on a remotely located server.
[0045] Generally, a thumbnail image may have a resolution of
100.times.100 pixels. However, the higher quality versions of the
relatively low resolution thumbnail image can be provided at
increasingly greater resolutions for a correspondingly larger cost,
e.g., a 256.times.256 pixel image might be free, a 640.times.640
pixel image could cost $5.00, and a 1024.times.1024 pixel image
might cost $20.00. It is envisioned that the actual cost of the
images could be controlled/changed by a server that enables the
Imagizer facility to access a database of images.
[0046] FIGS. 5A and 5B show an overview 144 of the logic performed
by the present invention to get, indicate, and insert a relevant
image into an open document. In FIG. 5A, moving from a start block,
the logic steps to a block 146 where the Imagizer facility is
activated. In this example, the Imagizer facility is activated from
a context menu. However, it is envisioned that the Imagizer
facility may also be launched from a pop-up window, drop-down menu,
dialogue box, and hot key. Additionally, in this example, the
Imagizer facility acts as a client providing a query to a search
engine server that can search a database for relevant images.
[0047] Flowing to a decision block 148, a determination is made
whether text is indicated. If false, the logic moves to a block 156
where the "options" pop-up window 128 for the Imagizer facility is
displayed as shown in FIG. 4. Advancing to a decision block 158,
the logic determines whether indicated text is provided in the text
entry box 130 of the options pop-up window 128. If false, the logic
loops back to the block 156 until the pop-up window 128 is closed
or the indicated text is provided in the text entry box 130.
However, when the determination at the decision block 158 is true,
the logic will move to a decision block 150. Also, if the
determination at the decision block 148 was true, the logic would
have moved to the decision block 150. Additionally, the text could
be indicated in a separate clipboard program; and although not
shown, the history of previously indicated text may be saved and
reused as the currently indicated text.
[0048] At the decision block 150, a determination is made whether
the Imagizer facility can connect directly to the Internet. If
false, the logic moves to a decision block 160 where a
determination is made whether the Imagizer facility can connect to
the Internet through an intranet connection. If the determination
at the decision block 160 is false the logic will move to a
decision block 162 where a determination is made whether a local
server for searching a database of images is available. The
Imagizer facility can determine if a local drive contains a
database of images that might be relevant to the indicated text.
Also, the Imagizer facility may prompt the user to indicate the
path to a local image database.
[0049] If the determination at the decision block 162 is negative,
the logic moves to a decision block 175, as shown in FIG. 5B.
However, if the determination at the decision block 162 is
affirmative, the logic steps to a block 163 and the Imagizer
facility connects with the local, image database. The logic
advances to a block 152 where the Imagizer facility creates a
request (query) for relevant images based on the indicated/entered
text. The request is sent to a local search engine server to return
metadata results from a data base of images on a local drive, e.g.,
a hard disk, floppy disk, tape drive, digital versatile disc (DVD)
drive, and compact disc read only memory (CD-ROM) drive.
[0050] Alternatively, when the determination at the decision block
150 is true, the logic moves to the block 152 where the Imagizer
facility connects through the Internet to another search engine
server that returns metadata results from a remotely located image
database. Also, if the determination at the decision block 160 is
true, the logic steps to a block 161 where an autoconnect facility
is invoked to connect the Imagizer facility to the remotely located
image database. The autoconnect facility can determine if a proxy
server is available for connecting across the Internet to the
remotely located image database. Alternatively, the autoconnect
facility may initiate a dial-up telephone connection to an
indicated Internet Service Provider (ISP) to create a connection to
the remotely located image database. The autoconnect facility may
prompt the user to provide a new telephone number for the ISP when
a previously provided telephone number is not available.
[0051] The logic moves from the block 161 to the block 152 where
the Imagizer facility connects with the other search engine server.
An important aspect of the present invention is sending a query and
receiving results over a network without having to launch a
separate application program such as a browser. Additionally, the
query may employ an extensible markup language (XML) data structure
to communicate over a network with a search engine for searching an
image database such as the CORBIS CORPORATION'S CORBIS PICTURE
EXPERIENCE at http://www.corbis.com.
[0052] The logic flows to a decision block 154 and determines if
the metadata results from the query were returned. If false, the
logic jumps back to the block 156 where substantially the same
logic discussed above is repeated. However, if the determination is
true, then the logic moves to a block 164 as shown in FIG. 5B and
where the first group of binary image data is placed in a local
cache managed by the Imagizer facility. Although the metadata
results may identify hundreds of relevant images, the present
invention provides for downloading one group at a time of the most
relevant images for display in a slide show. For this example, the
first group downloaded includes fifty of the most relevant
thumbnail images as binary image data. However, in another
embodiment, the binary image data for all of the relevant images
identified by the metadata results could be downloaded for display
in the slide show.
[0053] The logic steps to a block 166 where the first group of
thumbnail images are displayed in the slide show such as
illustrated in pop-up window 128 of FIG. 2. Moving to a decision
block 168, a determination is made as to whether one of the
thumbnail images in the slide show is indicated for inserting
(pasting) into the open document. If affirmative, the logic
advances to a block 174 where the indicated thumbnail image is
pasted into the open document. Next, the logic flows to the
decision block 175 where a determination is made whether a user has
chosen to close the Imagizer facility. If yes, the logic steps to
an exit block and terminates. However, if the determination at the
decision block 175 is no, the logic will move to a block 177 where
new indicated text is provided. Next, the logic loops back to the
decision block 148 where substantially the same logic discussed
above is be repeated.
[0054] Alternatively, when the determination at the decision block
168 is negative, the logic steps to a decision block 170 where a
determination is made as to whether the purchase of a higher
quality version of the thumbnail image is indicated. If false, the
logic moves to a decision block 176 where a determination is made
as to whether a request for the next group of thumbnail images is
provided. If negative, the logic moves to the decision block 175
where substantially the same logic discussed above is repeated.
However, when the determination at the decision block 176 is
positive, the logic returns to the block 166 where the next group
of 50 thumbnail images is displayed in a slide show and
substantially the same logic discussed above is repeated.
[0055] Also, when the determination at the decision block 170 is
positive, i.e., the purchase of a higher quality image is
indicated, the logic moves to a block 172 where a browser program
is launched to connect to an Internet based web site for performing
an electronic financial transaction service that enables the
purchase of a higher quality version of the indicated thumbnail
image. The logic flows to a block 178 where the purchased higher
quality image is inserted into the open document. Next, the logic
advances to the block 166 where the same group of images are
displayed in the slide show and substantially the same logic
discussed above is repeated.
[0056] Although not shown, different parameters of the higher
quality image may be chosen such as resolution and color. Also, the
use of the higher quality image may be identified, e.g., personal,
work and publication. The chosen parameters and use may be employed
to determine the cost of purchasing the higher quality version of
the indicated thumbnail image.
[0057] FIG. 6 illustrates five integrated components that may be
employed by an Imagizer facility 180 to get, view, and use an
indicated image. A graphical user interface component 182 provides
for automatically creating search criteria for a query from the
indicated text and inserting a thumbnail or higher quality image
into an open document. A metadata results component 188 provides
for managing the storing, parsing and displaying of the metadata
results returned from a query of the database of images. A
navigation component 190 provides for managing user interface
navigation elements used to control the display of the results
(thumbnail images) of the query, e.g., play, stop, back and next
controls. An image binary data component 186 provides for managing
the display of returned images and managing the storage of the
binary image data for the thumbnail and higher quality images.
Also, a network component 184 provides for detecting the presence
of a network and its settings and managing the transfer of data
across the network such as the Internet and an intranet. The
network component may employ a transmission device to automatically
connect to the search engine for the database, e.g., a cable modem,
network interface card, telephony modem, satellite dish and radio
transceiver.
[0058] In one embodiment, the network component 184 may launch a
separate browser program to manage the transfer of data over a
network. In another embodiment, the network component 184 will
manage the data transfer from within the Imagizer facility without
having to launch the browser program. The network component 184
could send the query to a remotely located search engine, obtain
the result of the query, and download thumbnail images indicated by
the query result. In yet another embodiment, a browser program
could be launched by the network component 184 for managing the
transfer of financial data to purchase of a higher quality version
of an indicated thumbnail image from an electronic commerce server.
In still another embodiment, the network component may manage the
transfer of financial data to purchase a higher quality image
without having to launch the browser program.
[0059] FIG. 7 shows a graphical representation of an overview 202
of how data packets (information) are communicated between the
Imagizer facility acting as a client 204 and a search engine acting
as a server 206 that receives the client's query and returns
results, e.g., metadata, from a database of images. A time line 208
is positioned vertically adjacent to a graphical representation of
an exchange of requests and responses between the client 180 and
the server 206. Moving down the time line 208 from the top of the
figure and an initial time value of "zero," the client 204 provides
a "Get server ip address" request 210 to the server 206. In reply,
the server 206 sends a "Server ip address" response 212 to the
client 204. Next, the client 204 communicates a "Get image list"
request 214 to the server 206. This request includes a query based
on the indicated text. Advancing down the time line 208, the server
206 communicates a "Send image list" response 216 to the client 204
which includes metadata results indicating a list of the images
that are determined to be relevant to the indicated text.
[0060] A "Get thumbnail images" request 218 is communicated by the
client 204 to the server 206 indicating a particular group of
thumbnail images. The server 206 provides a "Send thumbnail images"
response 220 to the client 204 which includes the binary image data
for the requested group of thumbnail images. Optionally, when the
client 204 has requested a purchase of a higher quality image, a
"Get Purchased HQ Image" request 222 will be provided by the client
to the server. In reply, the server 206 will provide a "Send
Purchased HQ Image" response 224 to the client 204 that includes
the binary image data for the purchased higher quality image.
[0061] FIG. 8 illustrates a schematic overview 192 of a
client-server architecture for implementing the present invention.
The client 204, server 206, and an electronic commerce server 200
are in communication with each other over a network 198 such as an
intranet and the Internet. The server 206 is also in communication
with a database 198 that may be searched for images relevant to a
query related to indicated text provided by the client 204.
Additionally, it is envisioned that different types of transport
protocols may be employed to communicate between the client 204,
server 206, and electronic commerce server 208, including hyper
text transport protocol (HTTP), file transfer protocol (FTP) and
transmission control protocol/internet protocol (TCP/IP).
[0062] The electronic commerce server 200 provides a service that
enables the conduct of commerce in goods and services, with the
assistance of telecommunications and telecommunications-based
tools. The client 204 may provide a credit card number to the
electronic commerce server 200 to purchase a higher quality
(resolution) version of an indicated thumbnail image which is
retrieved from the database 198 by the server 206 and downloaded to
the client. The electronic commerce server 200 may employ a digital
signature and public/private key based encryption to complete the
financial transaction.
[0063] FIG. 9 illustrates a system 10 comprising components of a
computer suitable for executing a client program embodying the
present invention. A processor 12 is coupled bi-directionally to a
memory 14 that encompasses read only memory (ROM) and random access
memory (RAM). ROM is typically used for storing processor specific
machine code necessary to bootup the computer comprising client 10,
to enable input and output functions, and to carry out other basic
aspects of its operation. Prior to running any application program,
the machine language code comprising the program is loaded into RAM
within memory 14 and then executed by processor 12. Processor 12 is
coupled to a display 16 on which the visualization of the HTML
response discussed above is presented to a user. Often, programs
and data are retained in a nonvolatile memory media that may be
accessed by a compact disk-read only memory (CD-ROM) drive, compact
disk-read/write memory (CD-R/W) drive, optical drive, digital
versatile disc (DVD) drive, hard drive, tape drive, and floppy disk
drive, all generally indicated by reference numeral 18 in FIG. 9. A
network interface 22 couples the processor 12 to a wide area
network such as the Internet.
[0064] As noted move, the present invention can be distributed for
use on the computer system 10 as machine instructions stored on a
memory media such as a floppy disk 24 that is read by the floppy
disk drive. The program would then typically be stored on the hard
drive so that when the user elects to execute the application
program to carry out the present invention, the machine
instructions can readily be loaded into memory 14. Control of the
computer and selection of options and input of data are implemented
using input devices 20, which typically comprise a keyboard and a
pointing device such as a mouse (neither separately shown). Further
details of the system 10 and of the computer comprising it are not
illustrated, since they are generally well known to those of
ordinary skill in the art. Additionally, although not shown, a
computer system for the server 206 could be configured in
substantially the same way as the computer system 10 illustrated
here, albeit different in other ways.
[0065] In one embodiment, an electronic shopping cart may be used
for the temporary storage of a potential purchase of a higher
quality version of at least one indicated thumbnail image. An
electronic shopping cart is an application program that enables
on-line image selection and ordering processes. Typically, an
electronic shopping cart is part of the interface between an
Internet web site and its deeper infrastructure, e.g., an image
database, allowing users to select merchandise; review what they
have selected; make necessary modifications or additions; and
purchase the selected merchandise. It is envisioned that the
electronic shopping cart would temporarily hold a higher quality
image until the purchase could be completed at a later date when
final purchasing decisions are made and/or sufficient funds become
available.
[0066] In another embodiment, the present invention may employ a
separate qualification engine to assist in the creation of the
query for the search engine to locate relevant images in an image
database. It is envisioned that the qualification engine may
determine the context of the indicated text, e.g., the
qualification engine may examine the context of the indicated text
within a sentence, paragraph, or entire document. Also, the
qualification engine may employ the content of other images in the
document and user preferences to help create the query.
[0067] In one embodiment, a digital watermark may be included with
each image. A digital watermark is a represented by a pattern of
bits inserted into a file for an image. The digital watermark may
be designed to be completely invisible or visible and the actual
bits representing the watermark tend to be scattered throughout the
file in such a way that they cannot be identified and manipulated.
The digital watermark can withstand normal changes to the file,
such as reductions from lossy compression algorithms. It is
envisioned that a digital watermark may be employed to identify
copyright information and provide information related to the
content of the image.
[0068] In yet another embodiment, a cookie identifying user
preferences may be included with the query that is sent to the
search engine. The search engine could use the cookie information
to help provide metadata results that are related to the user
preferences. Also, the cookie information may provide a
user-specific set of results, such as a list of images that were
previously pasted into documents, a history of previously
ordered/purchased images, and a user-organized collection of
images, e.g., a portfolio.
[0069] In yet another embodiment, the present invention may be
employed to automatically generate a query for an indicated object
and return results from a search engine that identifies any object
that is related to the indicated object. The indicated object and
the related object may include different types of data comprising
text, pictures, video, and sound. For example, an indicated text
object could be used by the present invention to cause a search
engine to return different related objects that include text,
video, and sound (audio). While the preferred embodiment of the
invention has been illustrated and described, it will be
appreciated that various changes can be made therein without
departing from the spirit and scope of the invention.
* * * * *
References