U.S. patent application number 10/848846 was filed with the patent office on 2004-10-28 for user interface for initiating a final scan using drag and drop.
Invention is credited to Lee, Jeffrey P., Lopez, Patricia D., Neff, Theodore W..
Application Number | 20040212835 10/848846 |
Document ID | / |
Family ID | 22596128 |
Filed Date | 2004-10-28 |
United States Patent
Application |
20040212835 |
Kind Code |
A1 |
Neff, Theodore W. ; et
al. |
October 28, 2004 |
User interface for initiating a final scan using drag and drop
Abstract
A user interface method for launching an optimized final scan of
a selected region of interest selected from a preview scan of a
document. A user may drag the selected region of interest,
presented in a preview scan of a document in a scanner window, and
drop it on a software application, the desktop, or a writeable
folder, which launches an optimized final scan of the selected
region of interest. The image data resulting from the optimized
final scan automatically resides in the software application, the
desktop, or the writeable folder. In selecting a region of interest
from the preview scan, scanner software parameters are updated with
information about the region of interest which optimize the final
scan. The image data from the optimized final scan is then
formatted in the format requested and delivered to the software
application, the desktop, or the writeable folder.
Inventors: |
Neff, Theodore W.; (Ft.
Collins, CO) ; Lee, Jeffrey P.; (Greeley, CO)
; Lopez, Patricia D.; (Loveland, CO) |
Correspondence
Address: |
HEWLETT-PACKARD COMPANY
Intellectual Property Administration
P. O. Box 272400
Fort Collins
CO
80527-2400
US
|
Family ID: |
22596128 |
Appl. No.: |
10/848846 |
Filed: |
May 19, 2004 |
Related U.S. Patent Documents
|
|
|
|
|
|
Application
Number |
Filing Date |
Patent Number |
|
|
10848846 |
May 19, 2004 |
|
|
|
09164795 |
Oct 1, 1998 |
|
|
|
6751780 |
|
|
|
|
Current U.S.
Class: |
358/1.18 ;
358/453; 358/474; 382/319; 715/700 |
Current CPC
Class: |
H04N 1/3873
20130101 |
Class at
Publication: |
358/001.18 ;
358/453; 358/474; 382/319; 345/700 |
International
Class: |
G06K 015/00; H04N
001/04; H04N 001/387 |
Claims
1.-23. (Cancelled)
24. A method of scanning a document, comprising: displaying, by
scanner software, preview scan data generated in response to a
preview scan of the document; selecting a region of interest in the
preview scan data; presenting, from scanner software to an
application software, one or more data formats for the selected
region of interest; receiving selection, by the application
software, of one of the one or more data formats; launching a
second scan of the document; and storing data relating to the
second scan of the document in the selected one data format.
25. The method of claim 24, further comprising: the scanner
software determining a data type of the selected region of
interest; and the scanner software presenting the one or more data
formats associated with the determined data type.
26. The method of claim 24, further comprising: receiving user
input indicating selection of the application software; and in
response to the user input indicating selection of the application
software, the application software receiving the presented one or
more data formats.
27. The method of claim 26, further comprising: the application
software determining whether any one of the presented one or more
data formats is acceptable to the application software; and in
response to the application software determining that any one of
the presented one or more data formats is acceptable, the
application software notifying the scanner software that the
application software is able to receive scan data.
28. The method of claim 27, further comprising: in response to the
application software determining that none of the one or more data
formats is acceptable, the application software causing
presentation of an indicator that receipt of scan data is not
allowed.
29. The method of claim 24, further comprising: receiving a click
input at a location on the displayed preview scan data; and
evaluating preview scan data around the location of the click input
to identify the region of interest.
30. The method of claim 24, further comprising: displaying a window
for the application software; receiving user input indicating that
the selected region of interest is to be moved to the window for
the application software, wherein receiving the selection of the
one or more data formats and launching the second scan are
performed in response to the user input.
31. The method of claim 24, further comprising: displaying a
desktop on a computer; receiving user input indicating that the
selected region of interest is to be moved to the desktop, wherein
receiving the selection of the one or more data formats and
launching the second scan are performed in response to the user
input; and displaying an icon representing the data relating to the
second scan in the desktop.
32. A system of scanning data, comprising: scanner software; a
monitor to display preview scan data generated in response to a
preview scan of a document launched by the scanner software, the
scanner software to select a region of interest in the preview scan
data in response to user input; and an application software to
receive one or more data formats for the selected region of
interest from the scanner software, the application software to
select one of the one or more data formats, the scanner software to
launch a second scan of the document and to store data relating to
the second scan of the document in the selected one data
format.
33. The system of claim 32, wherein the scanner software is adapted
to: determine a data type of the selected region of interest, and
present the one or more data formats associated with the determined
data type.
34. The system of claim 32, wherein the application software is
adapted to: determine whether any one of the presented one or more
data formats is acceptable to the application software, and in
response to determining that any one of the presented one or more
data formats is acceptable, notify the scanner software that the
application software is able to receive scan data.
Description
CROSS REFERENCE TO RELATED APPLICATIONS
[0001] This application is related to application Ser. No. ______
of Jeffrey P. Lee et al. filed ______ entitled Click and Select
User Interface for Document Scanning.
TECHNICAL FIELD
[0002] This invention relates to document scanners and more
particularly to the user interface for document scanners. Even more
particularly, the invention relates to a user interface that allows
a user to automatically select a region of interest from a preview
scan of a document and initiate an optimized final scan of the
region of interest by moving it to an application using the drag
and drop feature of the Windows operating system.
BACKGROUND OF THE INVENTION
[0003] Current scanner technology allows a user to capture and
utilize all or portions of various scanned documents, images,
objects, etc. for use within various computer applications, even
when the documents are comprised of a variety of different
components. A document containing text, black and white and/or
color photographs, graphics, and color and black and white line art
can be scanned in its entirety. Alternatively, the user may choose
to select only certain portions of the original document for
scanning by utilizing scanner software to select an area or
particular image contained in a preview scan of the document. The
selected area is then scanned to produce a final image.
[0004] The usability of existing scanning software has been
hindered by the inability of users to easily move images from the
scanner software to the user desktop or desired application, such
as word processing or an Adobe PhotoShop.TM. image editing type
application. Typically, scanning software forces the user to either
save the image as a file, copy the image to the clipboard, or
return the data via a TWAIN or other industry standard
inter-application communication protocol initiated scan.
[0005] It is thus apparent that there is a need in the art for an
improved method or apparatus which solves the objects of the
invention. The present invention meets these and other needs in the
art.
[0006] This application is related to application Ser. No. ______
of Jeffrey P. Lee et al. filed ______ entitled Click and Select
User Interface for Document Scanning, which is incorporated herein
by reference for all that is disclosed and taught therein.
DISCLOSURE OF THE INVENTION
[0007] It is an aspect of the present invention to click on a
selected region in a preview scan of a document and drag it to an
open application or a desktop to launch an optimized final scan of
the selected region.
[0008] It is another aspect of the invention to have the image data
resulting from the optimized final scan automatically reside in the
open application or desktop.
[0009] Yet another aspect of the invention is to update scanner
software control parameters with information about the selected
region to optimize the final scan of the selected region.
[0010] Still another aspect of the invention is to offer different
data formats for the optimized final scan based upon the selected
region type.
[0011] A further aspect of the invention is to allow the open
application to query the scanner software to determine if it can
accept drop input of the selected region in an offered format
before executing the optimized final scan.
[0012] A still further aspect of the invention is to format the
data from the optimized final scan into the format requested by the
open application.
[0013] The above and other aspects of the invention are
accomplished in a user interface for scanner software that allows a
preview scan of a document to be presented to the user in a
variable resolution preview window in a computer monitor. The user
may then click on a point within a region of interest in the
preview scan data in the variable resolution preview window. Based
on the characteristics of the data represented at the click point,
an area is determined that encompasses the click point and the
neighboring points that have similar characteristics to that of the
click point. This area is then classified by type based on the
characteristics of the data represented within the area, such as
text, gray scale image, color image, or black and white image. A
selection marker is then automatically displayed around the area as
a first estimate of what the user intended by making the mouse
click at the click point.
[0014] The selection marker may be a bounding box rectangular in
shape. For non-rectangular "lasso" regions, image analysis software
may be applied, automatically tracing around the lasso region of
interest. Portions of the scanned document that lie outside the
selection marker are grayed out. Based on the determination of the
type of area, adjustments are made automatically to data type,
exposure, color, resolution, and sharpness settings that normally
would have to be made manually by the user in prior art
systems.
[0015] If the selection marker automatically generated does not
represent the image of interest desired by the user, the user can
adjust the size of the region of interest to include more area or
include less area in several different ways. One such way is by
dragging the selection area handles appropriately, expanding or
contracting the selected area. Or, the user may simultaneously
click on a point and hold down a control key on a keyboard, to
either expand the region or image of interest to include additional
area, or contract the region or image of interest to exclude area
already selected. The user may also right click on the mouse to pop
up a context menu, and select an expand selection option or select
a contract selection option from the menu. In addition, a different
region of interest can be selected by the user by clicking in an
unselected area of the variable resolution preview scan, and
dragging the mouse to create a rectangular area bounded by a
selection marker.
[0016] Based on the type of image, windows having tools for
adjusting various aspects of the selected area are automatically
enabled or disabled from user input. Once the region of interest is
properly selected, and any adjustments have been made, the user can
use a mouse to drag and drop the selected area onto the desktop, a
writeable folder, or onto an open application to launch an
optimized final scan, or re-scan, of the selected area. After the
optimized final scan, the resulting image data resides in the
desktop, folder, in a file, or within the open application.
Alternatively, the user may utilize pull down menus or buttons to
launch the optimized final scan. However, if the pull down menu is
used, save to file, copy to clipboard, and print are the only
options available. Thus, the resulting image data will not
automatically appear in an open application utilizing this
option.
DESCRIPTION OF THE DRAWINGS
[0017] The above and other aspects, features, and advantages of the
invention will be better understood by reading the following more
particular description of the invention, presented in conjunction
with the following drawings, wherein:
[0018] FIG. 1 shows a block diagram of a computer system
incorporating the user interface for scanner software of the
present invention;
[0019] FIG. 2 shows a representation of the screen display of a
computer monitor showing the user interface for scanner software of
the present invention;
[0020] FIG. 3A and FIG. 3B show a block diagram of the overall flow
of the operation of the user interface for scanner software of the
present invention;
[0021] FIG. 4 shows a block diagram for determining the boundary of
the region of interest and classifying the data type within the
region of interest;
[0022] FIG. 5 shows a block diagram for updating the screen display
of a computer monitor based on the selected area and its type;
[0023] FIG. 6 shows a block diagram for performing an optimized
final scan of the region of interest utilizing the drag and drop
feature from the Windows operating system;
[0024] FIG. 7 shows a block diagram for re-sizing the boundary of a
region of interest;
[0025] FIG. 8A and FIG. 8B show a representation of the screen
display of a computer monitor showing a screen capture of the user
interface for scanner software of the present invention and an open
application receiving a scanned image by way of drag and drop
input; and
[0026] FIG. 9A and FIG. 9B show a representation of the screen
display of a computer monitor showing a screen capture of the user
interface for scanner software of the present invention and a
desktop receiving a scanned image by way of drag and drop
input.
BEST MODE FOR CARRYING OUT THE INVENTION
[0027] The following description is of the best presently
contemplated mode of carrying out the present invention. This
description is not to be taken in a limiting sense but is made
merely for the purpose of describing the general principles of the
invention. The scope of the invention should be determined by
referencing the appended claims.
[0028] FIG. 1 shows a block diagram of a computer system
incorporating the user interface for scanner software of the
present invention. One skilled in the art will recognize that many
other configurations are possible for accessing a scanner with a
computer system. Only one configuration is shown for simplicity.
Referring now to FIG. 1, computer system 100 contains a processing
element 102. Processing element 102 communicates with other
elements of computer system 100 over a system bus 104. A keyboard
106 allows a user to input information into computer system 100 and
a monitor 110 allows computer system 100 to output information to
the user. A graphical input device 108, commonly a mouse, is also
used to input information. Scanner device 114 is also used to input
information to computer system 100.
[0029] Storage device 112 is used to store data and programs within
computer system 100. Communications interface 116, also connected
to system bus 104, receives information from sources outside of
computer system 100. A memory 118, also attached to system bus 104,
contains an operating system 120, window manager 122, and scanner
software 124 having the user interface for scanner software of the
present invention. In the preferred embodiment of the invention,
operating system 120 is the Microsoft Windows.RTM. operating
system. Memory 118 also contains first software application 126 and
second software application 128. One skilled in the art will
recognize that many more software applications could reside in
memory 118. Only two are shown for simplicity.
[0030] FIG. 2 shows a representation of the screen display from
monitor 110 (FIG. 1) showing the user interface for scanner
software 124 (FIG. 1) of the present invention. Referring now to
FIG. 2, scanner software window 200 shows a variable resolution
preview window 202 containing variable resolution preview scan 204
of a document that has been positioned on the flatbed of scanner
device 114 (FIG. 1). A user initiates a variable resolution preview
scan 204 by pressing a preview scan mode button on scanner device
114 (FIG. 1), or through a scan button or pull down menus presented
to the user on monitor 110 through scanner software 124, which
sends a signal causing scanner device 114 to use a preview scan
mode to scan the document. A preview scan mode is typically a low
resolution scan, dependent on the resolution of the display and the
size of the preview window. A user may also initiate a zoom scan of
an area of the document positioned on the flatbed, in which case
the resolution of the data contained in variable resolution preview
window 202 may be that of the scanner, which could be a
considerably higher resolution than the preview scan mode. The data
generated from the variable resolution preview scan is displayed as
variable resolution preview scan 204 in variable resolution preview
window 202. Variable resolution preview scan 204 shows regions of
various types, including text regions 206, black and white line art
regions 208, color photograph regions 210, and gray scale
photograph region 212, which is partially superimposed on one of
the color photograph regions 210.
[0031] A user has moved pointer 214 within gray scale photograph
region 212 with graphical input device 108 (FIG. 1) and has
subsequently clicked on graphical input device 108. Scanner
software 124 receives the click input, with pointer 214 in the
shown location, and determines a boundary for the region
surrounding the click point, and what data type of region is within
the boundary. Alternatively, a user can accomplish the above
manually by moving pointer 214 to a corner of gray scale photograph
region 212, and then clicking and dragging graphical input device
108 to encompass gray scale photograph region 212 and then manually
setting the data type via a pull down menu. In either case,
variable resolution preview window 202 is updated with selection
marker 216 drawn around the region identified as gray scale
photograph region 212. In this example, selection marker 216 is a
rectangular bounding box. The rest of the area of variable
resolution preview scan 204 outside of gray scale photograph region
212 is grayed out (not shown in FIG. 2).
[0032] Variable resolution preview window 202 also contains pull
down menu bar 218 and tool bar 220, which provide the user with
access to various functions of scanner software 124. If no region
has been selected, status bar 222 displays information regarding
variable resolution preview scan 204 in its entirety. If a region
has been selected, as shown in FIG. 2, status bar 222 displays
current information regarding the region selected, which in this
example is gray scale photograph region 212. Box 224 indicates that
the region selected is a gray scale photographic image. Box 226
indicates the image file size is 51.7 KB. A scaling factor of 100%
is shown in box 228. A different scaling factor may be displayed if
an inter-application communication link, such as TWAIN or OLE, has
been established indicating a preferred final size of the region of
interest, or if the user has specified one. Box 230 indicates that
the selected image is measured in inches. The user may also make a
"units" preference for Box 230 other than inches, such as
centimeters, points, or pixels. Box 232 indicates that the selected
image is 1.38 inches high, and box 234 indicates that the selected
image is 1.74 inches wide. Box 236 indicates a current resolution
of 150 dpi.
[0033] Three floating windows are also shown in scanner software
window 200 that present control tools to the user. The controls
reflect adjustments made to variable resolution preview scan 204
based on the contents of the preview window. The user may use the
tools presented in the floating windows to further manipulate a
selected region of interest.
[0034] Exposure adjustment window 238 offers control tools that
apply to all photographic output data types to preserve highlight
and shadow detail. Color adjustment window 240 applies only to
color photographic output data types to adjust hue and saturation.
Black and white threshold window 242 applies only to black and
white binary output data types such as line art, clip art,
halftones, and text.
[0035] FIG. 3A and FIG. 3B show a block diagram of the overall flow
of the operation of the user interface for scanner software of the
present invention. The user interface is called from scanner
software 124 (FIG. 1), when requested by the user of the scanner
software 124. Scanner software 124 performs other scanner functions
which are not part of the invention.
[0036] Referring now to FIG. 3A and FIG. 3B, after entry, in step
300 a variable resolution preview scan is initiated for a document
placed in the flatbed of scanner 114 (FIG. 1) that may contain
text, line art, and/or color and black and white photographic
images of interest. In step 302, variable resolution preview scan
204 (FIG. 2) is displayed within variable resolution preview window
202 (FIG. 2) in monitor 110 (FIG. 1).
[0037] Step 304 determines if click input from graphical input
device 0.108 (FIG. 1) on a region of interest within variable
resolution preview scan 204 is received, or if a manual selection
is made by clicking in an unselected area and dragging the mouse to
create a rectangular selection area, or if an indication to quit
the user interface is received. If the latter is true, FIG. 3
returns to scanner software 124. If a manual selection is made,
then in step 305 the click and drag input establishing a boundary
around a region of interest is received. Then in step 307 scanner
software 124 performs classification analysis on the set of data
elements contained within the boundary established by step 305, as
more fully explained in FIG. 4.
[0038] If click input is received in step 304, then in step 306
click input on a region of interest is received by scanner software
124. Step 308 calls FIG. 4 which evaluates the region surrounding
the click point to determine its boundary and its image data type.
After returning from FIG. 4, step 310 then calls FIG. 5 to update
the screen display of monitor 110. After returning from FIG. 5,
step 312 determines if further input, or an indication to quit the
user interface, is received. If the latter is true, FIG. 3 returns
to scanner software 124. If the former is true, then step 314
determines what type of further input was received. If the input
received was a "mouse down" input signal selecting the region of
interest for a potential drag and drop from graphical input device
108, then step 316 calls FIG. 6 to potentially perform an optimized
final scan of the region of interest. After returning from FIG. 6,
control returns to step 304 where another region of interest may be
selected, or input received to quit the user interface.
[0039] If the input determined in step 314 was click input from
graphical input device 108 on white space within variable
resolution preview scan 204, then in step 318 scanner software 124
removes selection marker 216 that was placed around the region of
interest. This action de-selects the current image selected. All
portions of variable resolution preview scan 204 that had been
grayed out are restored and the display in variable resolution
preview window 202 (FIG. 2) in monitor 110 is updated. Control then
returns to step 304 where another region of interest may be
selected, or input received to quit the user interface.
[0040] Finally, if the input determined in step 314 was click input
on a region simultaneous with a control key held down, then step
320 calls FIG. 7 to re-size the boundary of the region of interest.
After returning from FIG. 7, control returns to step 310, which is
a call to FIG. 5 to update the screen display of monitor 110.
[0041] FIG. 4 shows a block diagram for determining the boundary of
the region of interest and classifying the data type within the
region of interest. Referring now to FIG. 4, after entry, scanner
software 124 performs an analysis on the data elements from
variable resolution preview scan 204 on the immediate region around
the point clicked to determine the boundary of the region of
interest and the data type within the region of interest. In step
400, segmentation analysis is performed to determine the boundary
of the region of interest. Various techniques are well known in the
art for performing segmentation analysis, falling into three broad
categories: top down strategy (model-driven), bottom up strategy
(data-driven), and hybrid. For example, see Theo Pavlidis and
Jiangying Zhou, Page Segmentation and Classification, published in
Document Image Analysis, pp 226-238, (Lawrence O'Gorman and
Rangachar Kasturi, IEEE Press, 1995). Also, see Anil K. Jain and
Bin Yu, Documentation Representation and Its Application to Page
Decomposition, published in Pattern Analysis and Machine
Intelligence, pp 294-308, (Volume 20, No. 3, March 1998). In the
preferred embodiment of the invention, a bottom up strategy is
employed, utilizing the data element at the click point as the
beginning of the segmentation extension analysis. However,
segmentation is not performed on the entire scanned document as is
typically done, but is halted after the boundary for the region of
interest surrounding the click point has been determined. The
region of interest contains a set of data elements from the
variable resolution preview scan, and the boundary is determined by
the set of connected outermost data elements.
[0042] If the region of interest is rectangular in nature,
extension is performed along a linear front, resulting in a
selection marker that is a rectangular bounding box. For
non-rectangular "lasso" regions of interest, extension is performed
along a non-linear front, resulting in a selection marker that is a
"lasso" around the region of interest.
[0043] After performing segmentation analysis, in step 402 scanner
software 124 performs classification analysis on the set of data
elements contained within the boundary established by step 400.
Various techniques, also well known in the art for performing
classification analysis, are also disclosed in the two articles
cited above. In the preferred embodiment of the invention, the
classification method used is that disclosed in U.S. Pat. No.
5,596,655 issued to Patricia D. Lopez on Jan. 21, 1997. Upon
completion of classification analysis, FIG. 4 then returns to FIG.
3A.
[0044] FIG. 5 shows a block diagram for updating the computer
monitor display based on the selected area and its data type.
Referring now to FIG. 5, in step 500 a selection marker is
displayed in variable resolution preview scan 204 (FIG. 2) in
monitor 110 (FIG. 1) around the region of interest determined from
either FIG. 4 or from FIG. 7, which is discussed below. If a
selection marker is already displayed when FIG. 5 is called, that
selection marker is removed from display before displaying the next
selection marker. In step 502 the remainder of variable resolution
preview scan 204 lying outside of the region of interest bounded by
the currently displayed selection marker is grayed out.
[0045] Step 504 determines the data type of the region of interest.
If the data type in the region of interest is text or black and
white line art, then control passes to step 506 where scanner
software 124 updates the output in black and white threshold window
242 (FIG. 2). In step 508 scanner software 124 updates the
resolution, scaling, output dimensions, and file size within status
bar 222 (FIG. 2). In step 510 the controls in black and white
threshold window 242 (FIG. 2) are enabled for user input. The user
may make manual changes using the controls that have been enabled
prior to initiating a re-scan of the selected region of interest.
In step 512 the controls for exposure adjustment window 238 (FIG.
2) and color adjustment window 240 (FIG. 2) are disabled from user
input, and are grayed out. Thus, the steps in steps 506, 508, 510,
and 512 automatically make many of the adjustments that the user
would normally have to make manually in other prior art scanning
systems after selecting an image for scanning. The current
invention reduces the complexity of the software and confusion of
controls that the typical user may not understand. At this time,
the user may also make manual changes using the controls that have
been enabled prior to re-scanning the selected image.
[0046] In step 504, if the data type in the region of interest is
gray scale photographic, then control passes to step 514 where
scanner software 124 changes the output in exposure adjustment
window 238. In step 516 scanner software 124 updates the
resolution, scaling, output dimensions, and file size within status
bar 222. In step 518 the controls in exposure adjustment window 238
are enabled for user input. The user may make manual changes using
the controls that have been enabled prior to initiating a re-scan
of the selected region of interest. In step 520 the controls in
color adjustment window 240 and black and white threshold window
242 are disabled from user input and ate grayed out.
[0047] In step 504, if the data type in the region of interest is
color photographic, then in step 522 scanner software 124 changes
the output in exposure adjustment window 238 and in color
adjustment window 240. In step 524 scanner software 124 updates the
resolution, scaling, output dimensions, and file size within status
bar 222. In step 526 the controls in exposure adjustment window 238
and color adjustment window 240 are enabled for user input. The
user may make manual changes using the controls that have been
enabled prior to initiating a re-scan of the selected region of
interest. In step 528 the controls in black and white threshold
window 242 are disabled from user input and is grayed out. After
any of steps 512, 520, or 528, FIG. 5 returns to FIG. 3.
[0048] Thus, the steps in steps 506, 508, 510, and 512; steps 514,
516, 518, and 520; and steps 522, 524, 526, and 528, automatically
make many of the adjustments that the user would normally have to
make manually in other prior art scanning systems after selecting a
region of interest for scanning. The current invention reduces the
complexity of the software user interface and confusion of controls
that the typical user may not understand.
[0049] FIG. 6 shows a block diagram for performing an optimized
final scan of the selected region utilizing the drag and drop
feature from the Windows operating system. Referring now to FIG. 6,
in step 600, a data object is created and a list of one or more
predetermined data formats provided in scanner software 124 is
loaded into memory, based on the "mouse down" input signal
selecting the region of interest displayed in monitor 110 (FIG. 1)
whose data type, or classification, was determined in FIG. 4. In
the preferred embodiment of the invention, for image types, such as
true color, gray scale, palette, and black and white binary, a
CF_DIB format is provided, which is a Windows Device Independent
Bitmap, and a private drag/drop information format. For metafile
types, such as black and white scalable (vector), a CF_METAFILEPICT
format is provided, which is a Windows Metafile Clipboard format,
and a private drag/drop information format. For text, a CF_TEXT,
which is ASCII Text, a CF_RTF, which is Rich Text Format, and a
private drag/drop information format are provided. The private
drag/drop information format is for internal use by scanner
software 124 (FIG. 1), mainly as information for drawing feedback
when the pointer 214 is moved over scanner software window 200
(FIG. 2).
[0050] In addition, two other data formats are provided for all
data types when dragging and dropping to the desktop or to a
folder. These two data formats, CFSTR_FILEDESCRIPTOR and
CFSTR_FILECONTENTS are used by Explorer to create a file that will
reside on the desktop or in a folder. The user must hold down a
control key when the drag operation is initiated in order to add
these data formats to the list of formats available to Explorer for
a drop to the desktop or to a folder.
[0051] Step 602 determines if a "mouse over" input signal from
graphical input device 108, which is handled by operating system
120 (FIG. 1) from a call made by scanner software 124, is received
identifying an open application in monitor 110, or identifying
scanner software window 200 itself. If the "mouse over" input
signal is received identifying scanner software window 200, control
passes to step 610. Step 610 then determines if a "mouse drop"
input signal is received from graphical input device 108 selecting
scanner software window 200 displayed in monitor 110. This
indicates that the user decided not to initiate an optimized final
scan. If the answer is yes, then FIG. 6 returns to FIG. 3. If the
answer in step 610 is no, indicating no "mouse drop" signal was
received, or that pointer 214 left scanner software window 200,
then control returns to step 602.
[0052] If the "mouse over" input signal in step 602 is received
identifying an open application, which was opened by a call to the
software application, such as fist software application 126 (FIG.
1), then operating system 120 notifies first software application
126 that pointer 214 has entered its window. Then in step 604 first
software application 126 queries the list of predetermined data
formats associated with the data object created in step 600. If one
or more acceptable formats are found in the list generated in step
600, then first software application 126 lets operating system 120
know that it can receive the data and indicates a preferred format
from the one or more acceptable formats. Step 612 then determines
if a "mouse drop" input signal from graphical input device 108 is
received, selecting first software application 126. If the answer
is no, indicating no "mouse drop" signal was received, or that
pointer 214 has left the first software application 126 window,
then control returns to step 602. If the answer in step 612 is yes,
indicating that a "mouse drop" input signal was received, then in
step 614 first software application 126 makes a call to operating
system 120 and requests the image data in the format it prefers.
Then, in step 616, scanner software 124 sends a command to scanner
114 (FIG. 1) launching an optimized final scan of the document, and
the image data from the optimized final scan is put into the format
requested. The image data output from the optimized final scan for
the region of interest portion of the document is sent to first
software application 126, where the image data resides in the
selected data format for further manipulation by the user within
first software application 126. Control then returns to FIG. 3.
[0053] If in step 604 first software application 126 cannot find a
format for the data that it can accept from the list generated in
step 600, then step 608 changes the displayed pointer 214 to the
universal "no" icon, a circle with a diagonal slash through it,
indicating that a drop of the data object will not be allowed. Step
610 then determines if a "mouse drop" input signal is received from
graphical input device 108 on first software application 126. If
the answer is yes, then FIG. 6 returns to FIG. 3. If the answer in
step 610 is no, then control returns to step 602.
[0054] FIG. 7 shows a block diagram for re-sizing the boundary of a
selected area. Referring now to FIG. 7, step 700 determines if the
click input with graphical input device 108, simultaneous with a
control key held down, was received within, or outside of,
selection marker 216 (FIG. 2). If the click input was within
selection marker 216, indicating that the user wants a smaller area
than what was automatically generated in FIG. 4, then step 704
finds a subset of the data elements within selection marker 216
immediately surrounding the click point, and establishes a new,
smaller boundary around the subset of data elements. Then, in step
706, scanner software 124 performs classification analysis on the
subset of data elements contained within the new boundary
established by step 704. FIG. 7 then returns to FIG. 3.
[0055] If in step 700 the click input with graphical input device
108, simultaneous with a control key held down, was received
outside of selection marker 216, indicating that the user wants a
larger area than what was automatically generated in FIG. 4,
control passes to step 702. Step 702 determines if the click input
with graphical input device 108, simultaneous with a control key
held down, was on white space or non-white space. If the click
input was on white space, then step 712 expands the boundary to
encompass the entire scanned document. FIG. 7 then returns to FIG.
3.
[0056] If the click input in step 702 was on non-white space, then
step 708 makes an adjustment to the parameters used in the
segmentation analysis. Then step 710 calls FIG. 4 to evaluate the
data elements surrounding the click point with the new parameters
to determine a superset of data elements and a new boundary, and to
determine the data type of the superset of data elements within the
new boundary. After returning from FIG. 4, FIG. 7 then returns to
FIG. 3.
[0057] FIG. 8A and FIG. 81 show a representation of the screen
display of a computer monitor showing a screen capture of the user
interface for scanner software of the present invention and an open
application receiving a scanned image by way of drag and drop
input. Referring now to FIGS. 8A and 8B, screen display 800 has
scanner software window 200 (also shown in FIG. 2) and application
software window 802 displayed. Variable resolution preview scan 204
is displayed within variable resolution preview window 202 (also
shown in FIG. 2). Black and white line art region 208 (also shown
in FIG. 2) has been selected by a user with graphical input device
108 (FIG.
[0058] 1) by moving pointer 214 (FIG. 2) to a point within black
and white line art region 208, and clicking graphical input device
108, causing selection marker 816 to be displayed around black and
white line art region 208. Black and white line art region 208
contains black and white line art image 818.
[0059] Status bar 222 (also shown in FIG. 2) is updated to display
current information regarding black and white line art region 208.
The three dialog boxes normally displayed in scanner software
window 200 adjacent to variable resolution preview window 202 have
been closed down by the user to create room in screen display 800
for application software window 802.
[0060] First software application 126 (FIG. 1) is loaded into
memory 118 (FIG. 1) and is displayed in application software window
802, which contains open work area 820. First software application
126 may be a word processing application, a spread sheet
application, or a photo image editing type application that the
user would like to bring a scanned version of black and white line
art image 818 into. To accomplish this, the user moves pointer 214
(not shown in FIGS. 8A and 8B) with graphical input device 108 to a
point within black and white line art region 208. The user then
performs a drag and drop maneuver by holding down the graphical
input device button, moving graphical input device 108 such that
pointer 214 travels from the point within black and white line art
region 208 displayed on monitor 110 that the "mouse down" input
signal was sent, to any point within open work area 820 within
application software window 802, and then releasing the graphical
input device button to send the mouse drop input signal selecting
the open application. This drag and drop maneuver onto open work
area 820 initiates within scanner software 124 (FIG. 1) an
optimized final scan of the document, which generates image data.
When the optimized final scan is completed, the image data is sent
from scanner 114 to firsts software application 126, where the
image data appears as scanned image 822 in FIG. 8B. The image data
fully resides within the application software. The user may then
further manipulate scanned image 822 and/or save the image data to
a file.
[0061] If the user selects a text region in variable resolution
preview scan 204 to drag and drop to application software window
802, the text region is scanned utilizing the automatic adjustments
and updates made by scanner software 124 after the text region was
selected. OCR, Optical Character Recognition, is then performed.
The resulting data is put into ASCII Text format or Rich Text
Format for delivery to the open application.
[0062] FIG. 9A and FIG. 9B show a representation of the screen
display of a computer monitor showing a screen capture of the user
interface for scanner software of the present invention and a
desktop receiving a scanned image using the drag and drop feature
of the Windows operating system. Referring now to FIGS. 9A and 9B,
screen display 900 has scanner software window 200 (also shown in
FIG. 2) and desktop area 902 displayed. Variable resolution preview
scan 204 is displayed within variable resolution preview window 202
(also shown in FIG. 2). Black and white line art region 208 (also
shown in FIG. 2) has been selected by a user with graphical input
device 108 (FIG. 1) by moving pointer 214 (FIG. 2) to a point
within black and white line art region 208, and clicking graphical
input device 108, causing selection marker 816 to be displayed
around black and white line art region 208. Black and white line
art region 208 contains black and white line art image 818.
[0063] Status bar 222 (also shown in FIG. 2) is updated to display
current information regarding black and White line art region 208.
The three floating windows normally displayed in scanner software
window 200 adjacent to variable resolution preview window 202 have
been closed down by the user to create room in screen display 900
for desktop area 902.
[0064] The user may bring a scanned version of black and white line
art image 818 onto desktop area 902. To accomplish this, the user
moves pointer 214 with graphical input device 108 to a point within
black and white line art region 208. The user then performs a drag
and drop maneuver. A control key must be held down when the drag
operation is initiated to add the data formats to the list of
formats available to Explorer for a drop to the desktop or to a
folder. The graphical input device button is held down, then
graphical input device 108 is moved such that pointer 214 (not
shown in FIG. 9A or 9B) travels from the "mouse down" point within
black and white line art region 208 to any point within desktop
area 902, and then the graphical input device button is released,
completing the drag and drop maneuver. This same procedure may be
applied to bring a scanned version of black and white line art
image 818 to a writeable folder within a directory window. This
drag and drop maneuver onto desktop area 902, or onto a writeable
folder within a directory window (not shown in FIGS. 9A and 9B)
initiates within scanner software 124 (FIG. 1) an optimized final
scan of the document, which generates image data. When the
optimized final scan is completed, the image data is sent form
scanner 114 to the desktop, which is an open application, where the
image data appears in FIG. 8B as scan.bmp icon 904, representing a
file created by Explorer, the file manager software in Windows,
upon receiving the image data from scanner 114. The same icon would
appear for a drop to a writeable folder within a directory window.
The user may then further manipulate the image with a software
application that can accept .bmp file formats.
[0065] If the user selects a text region in variable resolution
preview scan 204 to drag and drop to desktop area 902, the text
region is scanned utilizing the automatic adjustments and updates
made by scanner software 124 after the text region was selected.
OCR, Optical Character Recognition, is then performed. The
resulting data is put into ASCII Text format for delivery to
desktop area 902. A text file is created by Explorer, the file
manager software in Microsoft Windows.RTM., upon receiving the
image data from scanner software 124, and the file appears as an
icon in open work area 820, which may be opened by Notepad or
whatever other comparable software has been set up by the user.
[0066] Having described a presently preferred embodiment of the
present invention, it will be understood by those skilled in the
art that many changes in construction and circuitry and widely
differing embodiments and applications of the invention will
suggest themselves without departing from the scope of the present
invention, as defined in the claims. The disclosures and the
description herein are intended to be illustrative and are not in
any sense limiting of the invention, defined in scope by the
following claims.
* * * * *