U.S. patent application number 09/325831 was filed with the patent office on 2001-12-20 for code image reading apparatus.
Invention is credited to MATSUEDA, AKIRA, MORI, TAKESHI.
Application Number | 20010052542 09/325831 |
Document ID | / |
Family ID | 15689372 |
Filed Date | 2001-12-20 |
United States Patent
Application |
20010052542 |
Kind Code |
A1 |
MATSUEDA, AKIRA ; et
al. |
December 20, 2001 |
CODE IMAGE READING APPARATUS
Abstract
Dot codes (i.e., code images) are printed on a paper sheet. Each
dot code has a variable part and a fixed part. The variable part is
specific to the dot code, whereas the fixed part is common to the
dot codes. The fixed part represents an audio mark that informs a
user when the user should move a dot code reader (i.e., a code
image reading apparatus) to read the next dot code to read the
same. As the user moves the dot code reader over any dot code, the
reader reproduces an audio message from the variable part and then
an audio mark from the fixed part. The user hears the audio message
and the audio mark through an earphone. Upon hearing the audio mark
indicating that the audio message has been completely reproduced,
the user may move the reader to the next cod code.
Inventors: |
MATSUEDA, AKIRA;
(HACHIOJI-SHI, JP) ; MORI, TAKESHI; (MACHIDA-SHI,
JP) |
Correspondence
Address: |
FRISHAUF, HOLTZ, GOODMAN &
LANGER & CHICK, PC
767 THIRD AVENUE
25TH FLOOR
NEW YORK
NY
10017-2023
US
|
Family ID: |
15689372 |
Appl. No.: |
09/325831 |
Filed: |
June 4, 1999 |
Current U.S.
Class: |
235/435 |
Current CPC
Class: |
G06K 19/06037
20130101 |
Class at
Publication: |
235/435 |
International
Class: |
G06K 007/00 |
Foreign Application Data
Date |
Code |
Application Number |
Jun 8, 1998 |
JP |
10-159238 |
Claims
1. A code image reading apparatus comprising: an imaging section
for optically reading code images printed on a recording medium and
converting the code images to image signals when the code image
reading apparatus is manually operated, each of said code images
being a coded data item containing a first data item which includes
at least one of audio data, video data and text data; a
data-restoring section for processing each of the image signals
output from said imaging section, thereby restoring the coded data
item containing the first data item; a first data output section
for processing the coded data restored by said data-restoring
section, thereby outputting the first data item; and a second data
output section for processing prescribed ones of the code images,
thereby outputting a second data item which is different from the
first data item and which is common to the prescribed coded images,
wherein said first and second output sections operate in
association to output the first data item and the second data item,
respectively.
2. The code image reading apparatus according to claim 1, wherein
the first and second data items are audio data items.
3. The code image reading apparatus according to claim 1, wherein
said second data output section include an output detecting section
for detecting that said first data output section has output the
first data item, and when said output detecting section detects
that said first data output section has output the first data item,
said second data output section outputs the second data item after
outputting of the first data item.
4. The code image reading apparatus according to claim 3, wherein
the first and second data items are audio data items.
5. The code image reading apparatus according to claim 3, wherein
said first data output section include a data converting section
for performing digital-to-analog conversion on the coded data
restored by said data-restoring section and containing the first
data item, and said output detecting section is designed to detect
that the first data item has been output, when said data converting
section finishes processing the first data item.
6. The code image reading apparatus according to claim 5, wherein
the first and second data items are audio data items.
7. The code image reading apparatus according to claim 1, wherein
said first data output section includes an output detecting section
for detecting that said second data output section has output the
second data item, and when said output detecting section detects
that said second data output section has output the second data
item, said first data output section outputs the first data item
after outputting the second data item.
8. The code image reading apparatus according to claim 7, wherein
the first and second data items are audio data items.
9. The code image reading apparatus according to claim 7, wherein
said second data output section include a data converting section
for performing digital-to-analog conversion on the coded data
containing the second data item, and said output detecting section
is designed to detect that the second data item has been output,
when said data converting section finishes processing the first
data item.
10. The code image reading apparatus according to claim 9, wherein
the first and second data items are audio data items.
11. The code image reading apparatus according to claim 1, wherein
the second data item is contained in the code image, along with the
first data item.
12. The code image reading apparatus according to claim 11, wherein
the first and second data items are audio data items.
13. The code image reading apparatus according to claim 1, further
comprising a storage section for storing the second data item.
14. The code image reading apparatus according to claim 13, wherein
the first and second data items are audio data items.
15. The code image reading apparatus according to claim 1, further
comprising a storage section for storing the second data item, and
wherein the code image contains the first data item and a third
data item, which is distinct from the first data item and which
designates the second data item stored in said storage section.
16. The code image reading apparatus according to claim 15, wherein
the first and second data items are audio data items.
17. The code image reading apparatus according to claim 1, wherein
the recording medium is designed to help users learn languages.
18. The code image reading apparatus according to claim 17, wherein
the first and second data items are audio data items.
Description
BACKGROUND OF THE INVENTION
[0001] The present invention relates to an apparatus for optically
reading code images printed on a recording media when manually
operated and for outputting so-called "multimedia information"
represented by the code images, said multimedia information
consisting of audio data, video data and text data.
[0002] A code image reading apparatus is disclosed in the
specification of U.S. Pat. No. 5,866,895. When manually operated,
this apparatus optically scans a dot code (i.e., a code images)
printed on a recording medium such as a paper sheet and outputs
multimedia information which is represented by the code images and
which consists of audio data, video data and text data.
[0003] FIG. 1 illustrates the physical format of the dot code 1
disclosed in U.S. Pat. No. 5,866,895.
[0004] As shown in FIG. 1, the dot code 1 is composed of a
plurality of data blocks 2 which are arranged in rows and columns.
Each data block 2 consists of a data-dot pattern section 3, a
plurality of markers 4, a matching-dot pattern 5, and a
block-address pattern 6. The data-dot pattern section 3 is a region
in which white data dots 7 and black data dots 7 are printed in a
predetermined arrangement. These data dots 7 constitute coded data
for the block, representing audio data, video data and text data.
Each white data dot 7 corresponds to a binary "0," and each black
data dot 7 corresponds to a binary "1." The block 2 has markers 4
at the four corners of the data-dot pattern section 3. The markers
4, each made of a prescribed number of black dots, are used to
define reference points in preparation for reading the data dots 7
printed in the data-dot pattern section 3. The matching-dot pattern
5 extends between two adjacent markers 4 and has matching dots
printed in a particular pattern. The block-address pattern 6
extends between two adjacent markers 4, one of which is one of the
two adjacent markers 4 between which the matching-dot pattern 5
extends. The block-address pattern 6 has block-address dots and
error-detecting or -correcting dots.
[0005] A code image reader is used to scan the dot code 1 having
the physical format shown in FIG. 1. The code image reader may have
a view field 8 that is smaller than the dot code 1 as shown in FIG.
1 and may not scan the entire dot code 1 at one shot. Even in this
case, any data block 2 read can be identified in accordance with
the block-address dot pattern 6, which has been read, too. Hence,
as many data blocks 2 as desired can be printed on a recording
medium (e.g., a paper sheet), forming as large a dot code 1 as
desired, and can be read to reproduce coded data they represent. On
the recording medium, far more data can be printed than in the form
of a conventional one- or two-dimensional bar code. This may
facilitate data communication using paper sheets or the like as
recording media. Further, the dot code 1 may find new various
uses.
[0006] The code image reader is, however, disadvantageous in the
following respect.
[0007] The code image reader is manually moved over a dot code,
reading the dot code. The reader outputs the multimedia information
represented by the dot code it has read. Assume that the dot code
the user has just read by operating the code image reader
represents an audio message with a silent period. Upon detecting
the silent period, the user may misunderstand that all message has
been reproduced and may therefore move the reader over the next dot
code. If this happens, the remaining part of the message cannot be
reproduced at all.
[0008] This inconvenience may arise particularly if no notes are
printed on the medium to specify the contents of the audio message,
if such a note is printed but the user is visually handicapped, or
if the silent period is a comparatively long one.
BRIEF SUMMARY OF THE INVENTION
[0009] The present invention has been made in view of the
foregoing. The object of the invention is to provide a code image
reading apparatus which optically reads an code image when manually
operated, outputs multimedia information, such as audio data,
represented by the code image, and informs a user that multimedia
information has been completely output to facilitate the reading of
a plurality of code images.
[0010] According to an aspect of the present invention, there is
provided a code image reading apparatus comprising:
[0011] an imaging section for optically reading code images printed
on a recording medium and converting the code images to image
signals when the code image reading apparatus is manually operated,
each of the code images being a coded data item containing a first
data item which includes at least one of audio data, video data and
text data;
[0012] a data-restoring section for processing each of the image
signals output from the imaging section, thereby restoring the
coded data item containing the first data item;
[0013] a first data output section for processing the coded data
restored by the data-restoring section, thereby outputting the
first data item; and
[0014] a second data output section for processing prescribed ones
of the code images, thereby outputting a second data item which is
different from the first data item and which is common to the
prescribed coded images,
[0015] wherein the first and second output sections operate in
association to output the first data item and the second data item,
respectively.
[0016] Additional objects and advantages of the invention will be
set forth in the description which follows, and in part will be
obvious from the description, or may be learned by practice of the
invention. The objects and advantages of the invention may be
realized and obtained by means of the instrumentalities and
combinations particularly pointed out hereinafter.
BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWING
[0017] The accompanying drawings, which are incorporated in and
constitute a part of the specification, illustrate presently
preferred embodiments of the invention and, together with the
general description given above and the detailed description of the
preferred embodiments given below, serve to explain the principles
of the invention.
[0018] FIG. 1 is a diagram illustrating the physical format of a
dot code, i.e., an example of a conventional code image;
[0019] FIG. 2 is a diagram showing a template-type code sheet for
use of visually handicapped persons and a dot code reader which is
the first embodiment of a code image reading apparatus of the
invention;
[0020] FIG. 3 is a diagram explaining how to form the template-type
code sheet shown in FIG. 2;
[0021] FIG. 4 is a block diagram of the dot code reader shown in
FIG. 2;
[0022] FIG. 5 is a schematic representation of an audio message
reproduced by the dot code reader shown in FIG. 4;
[0023] FIG. 6 is diagram showing the audio messages reproduced from
the three dot codes shown in FIG. 2;
[0024] FIG. 7 is a block diagram of a modification of the first
embodiment;
[0025] FIG. 8 is a schematic representation of an audio message
reproduced by a still another modification of the first
embodiment;
[0026] FIG. 9 is a flow chart explaining the operation of the still
another modification of the first embodiment;
[0027] FIG. 10 is a diagram depicting the audio message reproduced
from a modified dot code used in the first embodiment;
[0028] FIG. 11 is a schematic representation of an audio message
reproduced by a code image reader which is the second embodiment of
this invention;
[0029] FIG. 12 is a diagram showing the audio message reproduced
from another type of a dot code used in the second embodiment;
[0030] FIG. 13 is a diagram showing the subset codes constituting a
dot code to be read by a dot code reader which is the third
embodiment of the invention, and also showing the audio message
reproduced from the subset codes read by the dot code reader;
[0031] FIG. 14 is a schematic representation of one of the subset
codes shown in FIG. 13; and
[0032] FIG. 15 is a diagram illustrating the subset codes of FIG.
13, in detail.
DETAILED DESCRIPTION OF THE INVENTION
[0033] Embodiments of the present invention will now be described,
with reference to the accompanying drawings.
[0034] [First Embodiment]
[0035] FIG. 2 shows a template-type code sheet 10 for use of
visually handicapped persons and a dot code reader 100, i.e., the
first embodiment of a code image reading apparatus of the
invention.
[0036] The template-type code sheet 10 is relatively thick and
three grooves cut in one surface. Three dot codes 1-1, 1-2 and 1-3
are printed on the bottoms of these grooves, respectively. The
grooves are sufficiently large so that the distal end 102 of the
dot code reader 100 may loosely fit in the grooves.
[0037] How the template-type code sheet 10 has been formed will be
explained, with reference to FIG. 3. A paper sheet 16 is interposed
between a base sheet 12 and a top sheet 14. The base sheet 12 is
made of cardboard material, plastic or the like and about 2 to 3 mm
thick. The top sheet 14 has three rectangular windows 18. Three dot
codes 1-1, 1-2 and 1-3 are printed on the paper sheet 16 and seen
through the rectangular windows 18.
[0038] The dot codes 1-1, 1-2 and 1-3 are of the type shown in FIG.
1. Namely, each dot code is composed of data blocks 2 arranged in
rows and columns. Each data block 2 consists of a data-dot pattern
section 3, markers 4, a matching-dot pattern 5, and a block-address
pattern 6. The markers 4 are arranged at the four corners of the
data-dot pattern section 3. The data recorded in the data-dot
pattern section 3 is a combination of user data and an
error-correcting code.
[0039] As shown in FIG. 2, the dot code reader 100 has a scan
switch 104, and an earphone 106 is connected to the dot code reader
100. The dot code reader 100 can read any dot code printed on the
code sheet 10 and reproduce data from the dot code when it is
manually moved over the dot code. More specifically, a user holds
and moves the reader 100, while continuously depressing the scan
switch 104. Upon scanning the dot code completely, the user
releases the scan switch, the earphone 106 generates the audio
message reproduced from the dot code.
[0040] As shown in FIG. 4, the dot code reader 100 comprises an
imaging section 108, a binarization circuit 110, a marker detecting
section 112, a pattern-code detecting section 114, a block-address
detecting section 116, a data reading section 118, a de-interleave
section 120, an ECC section 122, an audio-data expansion circuit
124, a D/A converter 126, and a power amplifier circuit 128.
[0041] The imaging section 108 is comprises an optical section 108A
and an electrical section 108B. The optical section 108A has a lens
or the like. The electrical section 108B includes an imaging
element such as a CCD or a CMD for converting an optical input to
an image signal. The binarization circuit 110 receives an image
signal from the imaging section 108 and converts the image signal
to binary image data. The marker detecting section 112 extracts the
markers 4 of each block 2 from the binary image data, thereby
detecting the positions of the marks 4. The section 112 may extract
the markers 4 and detect the positions thereof, by performing the
erosion process described in, for example, the specification of
U.S. Pat. No. 5,866,895.
[0042] The pattern-code detecting section 114 detects the
matching-dot pattern 5 of each block 2, with reference to the
markers 4 the marker detecting section 112 has detected, and
further detects the true centers of the markers 4. The true centers
of the markers 4 will be used as reference points when the reader
100 reads data dots 7. The block-address detecting section 116
detects the block address from the block-address pattern 6 provided
between two adjacent markers 4. The data reading section 118 reads
the data dots 7 printed in the data-dot pattern section 3 and
performs, for example, 10-8 demodulation on the data represented by
the data dots which has been subjected to 8-10 modulation at the
time of recording the dot code.
[0043] The de-interleave section 120 performs de-interleave process
on the data thus demodulated by the data reading section 118. The
ECC section 122 corrects errors in the de-interleaved data, in
units of bytes. The audio-data expansion circuit 124 expands the
data that has been compressed and recorded, for example ADPCM data,
after the data has been subjected to the error correction in the
ECC section 122. The D/A converter 126 converts the data, thus
expanded, to an analog signal. The power amplifier circuit 128
amplifies the analog signal. The analog signal amplified is
supplied to the earphone 106. The earphone 106 generates the audio
message represented by the analog signal.
[0044] FIG. 5 is a schematic representation of the audio message
reproduced from the dot code. As FIG. 5 shows, the audio message
consists of a variable part (first data item) and a fixed part
(second data item). The variable part depends on the contents of
the dot code. The variable part contains one or more phrases. In
the case where the variable parts contains at least two phrases, a
silent period BLK may be interposed between the phrases. The fixed
part follows the variable part. The fixed part is common to all dot
codes. In other words, any audio message contains the same fixed
part, whichever dot code it has been reproduced. Alternatively, the
fixed part may be common to only some of the dot codes. In this
embodiment, the fixed part is a short electronic "pipp."
[0045] Assume that the audio messages reproduced from the three dot
codes 1-1, 1-2 and 1-3 shown in FIG. 2 have the forms illustrated
in FIG. 6. More precisely, the first dot code 1-1 consists of two
phrases #1 and #2, one silent period BLK interposed between the
phrases #1 and #2, and one electronic "pipp." Similarly, the second
dot code 1-2 consists of two phrases #3 and #4, one silent period
BLK interposed between the phrases #3 and #4, and one electronic
"pipp." The third dot code 1-3 consists of one phrase #5 and one
electronic "pipp."
[0046] It will now be described how the dot code reader 100 reads
the dot codes printed on the template-type code sheet 10 and
reproduces the audio messages represented by the dot codes.
[0047] First, the user holds the dot code reader 100 in the hand
and moves the reader 100 over the first dot code 1-1. The reader
100 first reproduces the phase #1, which is output from the
earphone 106. Upon lapse of the silent period BLK, the reader 100
reproduces the phrase #2, which is output from the earphone 106. As
soon as the earphone 106 generates the phrase #2, it generates the
electronic "pipp." Hearing this "pipp," the user can understand
that the audio message has been completely reproduced from the
first dot code 1-1. Then, user may move the dot code reader 100 to
the second dot code 1-2 to scan the second dot code 1-2. Unless the
user hears the "pipp," he or she determines that the audio message
has not been reproduced in its entirety. Therefore, the user would
not move the reader 100 to the second dot code 1-2 during the
silent period BLK as he or she may do when operating the
conventional dot code reader.
[0048] As the user moves the dot code reader 100 over the second
dot code 1-2, the phrase #3, silence period BLK, phrase #4 and
"pipp" are sequentially reproduced. Hearing the electronic "pipp"
after the phrase #4, the user knows that the audio message has been
completely reproduced. The user then moves the reader 100 to the
third dot code 1-3, scanning the third dot code 1-3. The reader 100
reproduces first the phrase #5 and then the electronic "pipp."
[0049] According to the present invention, a plurality of
template-type code sheets of the type shown in FIG. 2 and 3 may be
bound together, forming a template-type code book.
[0050] It will be explained below how the variable part and fixed
part of each audio message are reproduced from a dot code.
[0051] The variable part is reproduced from audio data that is
compressed and included in the dot code, just like audio data
recorded in the conventional method. By contrast, the fixed part is
reproduced from audio data that can be recorded in some different
methods.
[0052] The simplest method is to compress the data of the fixed
part and recorded, in the same way as the data of the variable
part. In this case, it suffices to add the data of the fixed part
to the data of the variable part in an encoding system which is
designed to generate dot codes from audio signals. The audio data
representing the fixed part can be recorded in two alternative
methods. The first method is to record the audio data, spaced apart
from the audio data representing the variable part and assigned
with a header. The second method is to combine the audio data is
combined with the audio data of the variable part, thus providing a
single audio signal to be recorded. If the first method is used,
the audio data of the variable part and the audio data of the fixed
part are independently processed in the dot code reader 100. If the
second method is used, these items of audio data are processed
together in the dot code reader 100.
[0053] A first alternative method of recording the audio data of
the fixed part is to store the data in a memory provided in the dot
code reader 100. In this case, the dot code contains only the audio
data which represents the variable part, not containing the audio
data of the fixed part. In the dot code reader 100, the fixed part
of the audio message is reproduced from the audio data stored in
the memory, after the variable part of the audio message has been
reproduced from the dot code.
[0054] FIG. 7 illustrates a dot code reader designed to reproduce
audio messages, each consisting of a variable part and a fixed part
which are represented by, respectively, audio data contained in a
dot code and audio data stored in a memory.
[0055] As FIG. 7 shows, this dot code reader comprises an imaging
section 130, a code-detecting digital circuit 132, a demodulation
buffer 134, a CPU 136, a data ROM 138, an audio buffer 140, a D/A
converter 142, and an audio amplifier 144. The dot code reader has
a system bus, to which the components 130, 132, 134, 136, 138, 140,
142 and 144 are connected.
[0056] The imaging section 130 comprises an imaging optical system,
an imaging element such as a CCD, peripheral ICs such as a timing
signal generator, an A/D converter for converting an audio signal
to digital data, and, if necessary, an illumination device. The
code-detecting circuit 132 performs the functions of the components
110, 112, 114, 116 and 118 of the reader 100 shown in FIG. 4.
[0057] The demodulation buffer 134 stores interleaved data obtained
from a dot code the code-detecting circuit 132 has detected.
The-data stored in the buffer 134 is processed to analyze the
header part of the audio message to be reproduced from the dot code
and analyze also the control code contained in the fixed part of
the audio message. (The control code will be described later.)
[0058] The CPU 136 performs the functions of the components 120,
122 and 124 of the dot code reader 100 shown in FIG. 4. The data
ROM 138 does not store the audio data (first data item)
representing the variable part of the audio message and does store
the audio data (second data item) representing the fixed part of
the audio message. The data ROM 138 also stores an ECC conversion
table, reference data for use in expanding the audio data, and the
like.
[0059] The audio buffer 140 temporarily stores any demodulated
audio data. The D/A converter 142 is equivalent to the D/A
converter 126 incorporated in the dot code reader 100 illustrated
in FIG. 4. The CPU 136 transfers the audio data to the D/A
converter 142 from the audio buffer 140. The audio amplifier 144
performs the function of the power amplifier circuit 128 used in
the dot code reader 100 of FIG. 4, amplifying the analog audio
signal supplied from the D/A converter 142. The analog audio signal
amplified by the audio amplifier 144 is supplied to an earphone
(not shown), which generates the audio message from the analog
audio signal.
[0060] The variable part of the audio message is reproduced in
similar to the dot code reader 100 of FIG. 4. As indicated above,
the CPU 136 transfers the audio data to the D/A converter 142 from
the audio buffer 140. To be more specific, the number of audio data
items to be output is set in a counter, and the count of the
counter is decreased by one every time one data item is transferred
to the D/A converter 142. When the count of the counter reduces to
zero, the transmission of the data items is finished. At the time,
it may be determined that the D/A converter 142 has finished
converting the audio data of the variable part to an analog audio
signal. In practice, however, the D/A converter 142 may not have
finished converting the audio data when the count of the counter
decreases to zero. This is because the converter 142 requires tens
of nanoseconds to several microseconds, depending on its
characteristic, to convert one audio data item. The time the
converter 142 requires is set in a timer, and the timer is started
the moment the count of the counter reduces to zero. When the time
set in the timer expires, it is determined that the D/A converter
142 has just finished converting the audio data to an analog audio
signal. Alternatively, an interrupt may be made to the CPU 136 when
the buffer provided in the converter 142 becomes empty. In this
case, it is detected that the D/A converter 142 has finished
converting the audio data, when an interrupt is made to the CPU 142
for the first time after the count of the counter decreases to
zero.
[0061] After it has been detected that the D/A converter 142 has
finished converting the audio data to an analog audio signal, the
audio data of the fixed part will be output. The data ROM 138
stores the audio data of the fixed part. This data may be
compressed audio data, audio waveform data not compressed, or the
function of sine waves or the like, or any other kind of audio data
that the CPU 136 can process. To enhance the use efficiency of the
data ROM 138, the data should better be compressed audio data. If
the audio data stored in the data ROM 138 is compressed one, the
CPU 136 needs perform only the function of the audio-data expansion
circuit 124 (FIG. 4). If the audio data is one not compressed, it
sufficient for the CPU 136 to pass on the data to the D/A converter
142. If the audio data is the function of sine waves, the audio
data generated from the function is first stored into the audio
buffer 140 and then output to the D/A converter 142.
[0062] A second alternative method of recording the audio data of
the fixed part is to store audio data items representing various
kinds of fixed parts in a memory provided in a dot code reader and
to record a control code designating one of these audio data items
in the dot code.
[0063] FIG. 8 shows the audio message reproduced from a dot code
that contains a control code (third data item). As shown in FIG. 8,
the control code consists of two bits (f.sub.0 and f.sub.1). Hence,
the control code can designate four kinds of audio patterns for the
fixed part. The four audio data items representing the four audio
patterns are stored in the memory incorporated in the dot code
reader. The data items are uncompressed waveform data items,
compressed audio data items, or the like.
[0064] How the four kinds of fixed parts are reproduced will be
described, with reference to the flow chart of FIG. 9.
[0065] As the dot code reader is moved over the dot code of FIG. 8,
it first reproduces the variable part of the audio message, i.e.,
phrases and silent periods BLK (Step S10). It is determined whether
or not the variable part has been reproduced completely (Step S12).
If YES, it is determined whether the control code (f.sub.0,
f.sub.1) is (0, 0) (Step S14). If YES in Step S14, the audio
pattern #1 is selected (Step S16). The fixed part represented by
the audio pattern #1, thus selected, is reproduced (Step S18). If
NO in Step S14, the operation goes to Step S20, in which it is
determined whether or not the control code (f.sub.0, f.sub.1) is
(0, 1). If YES in Step S20, the audio pattern #2 is selected (Step
S22). The fixed part represented by the audio pattern #2 is
reproduced (Step S18). If NO in Step S20, the operation goes to
Step S24, in which it is determined whether or not the control code
(f.sub.0, f.sub.1) is (1, 0). If YES in Step S24, the audio pattern
#3 is selected (Step S26). The fixed part represented by the audio
pattern #3 is reproduced (Step S18). If NO in Step S24, i.e., when
the control code (f.sub.0, f.sub.1) is (1, 1), the operation goes
to Step S28, in which the audio pattern #4 is selected (Step S28).
The fixed part represented by the audio pattern #4 is reproduced
(Step S18).
[0066] To reproduce the four kinds of fixed parts as explained
above, the dot code reader may have the same structure that is
illustrated in FIG. 7. The data ROM 138 stores four kinds of audio
patterns. The CPU 136 calculates the memory address of a desired
audio pattern from the control code (f.sub.0, f.sub.1) and reads
the desired audio pattern from the data ROM 138. The CPU 136
expands the audio pattern and outputs to the D/A converter 142, if
the audio pattern is compressed data. If the audio pattern is data
not compressed, the CPU 136 supplies the audio pattern to the D/A
converter 142, without processing the audio pattern.
[0067] If the second alternative method of recording the audio data
of the fixed part is used, it suffices to include a two-bit control
code (f.sub.0, f.sub.1). The dot code need not include the audio
data representing the fixed part of the audio message. Thus, it is
sufficient for the dot code to have a small data capacity. In
addition, the control code can define a plurality of audio patterns
for the fixed part, though it is small data.
[0068] The dot code shown in FIG. 8 may be modified in various
ways.
[0069] For example, the audio messages reproduced from the three
dot codes 1-1, 1-2 and 1-3 (FIG. 2) may have two fixed parts 1 and
2 each as is illustrated in FIG. 10. One of the two fixed parts is
a silent period BLK in the first dot code 1-1 and second dot code
1-2. Both fixed parts are electronic "pipps" in the audio message
reproduced from the third dot code 1-3. In this case, upon hearing
two "pipps," the user can understand that audio messages have been
reproduced from all dot codes printed on a template-type code
sheet. Two or more template-type code sheets may be bound together,
forming a book having groups of dot codes. In this case, too, the
user can understand that audio messages have been reproduced from
all dot codes of any group have been, upon hearing two "pipps."
[0070] Alternatively, all dot codes may be modified so that the
audio messages reproduced from them have one fixed part each. The
fixed parts of all audio messages, except the last reproduced one,
have the same audio pattern. The fixed part of the audio message
last reproduced has a different audio pattern. In this case, the
user can understand the audio message has been completely produced
from each dot code, and also that all audio messages have been
reproduced from all dot codes.
[0071] Still alternatively, each electronic "pipp" may be replaced
by a recorded audio instruction of "Scan the next dot code."
[0072] [Second Embodiment]
[0073] The second embodiment of the present invention is useful as
a system that helps people learn foreign languages.
[0074] In the second embodiment, dot codes and text data items
corresponding to the dot codes are printed on a schoolbook. The
schoolbook therefore presents both audio data and visual data,
thereby to help the user learn foreign languages efficiently. Each
dot code represents an audio message which may consist of a
variable part and a fixed part.
[0075] The dot codes printed on the code sheet may represents
spoken English words or expressions, and the text data items
printed on the sheet may be the written English words or
expressions. In this case, the audio messages reproduced from some
of the dot codes have a fixed part which includes audio labels of
"useful word" or "useful expression," while those reproduced from
the remaining dot codes have a fixed part which includes no audio
labels at all. Hence, the audio messages are generally similar to
the one illustrated in FIG. 8, and the dot code reader operates in
substantially the same way as shown in FIG. 9. However, any audio
message that has a fixed part differs from the audio message of
FIG. 8 in terms of the order the variable part and the fixed part
are recorded. More precisely, the fixed part precedes the variable
part as is illustrated in FIG. 11. Hence, the dot code reader first
reproduces the fixed part (i.e., audio label of "useful word" or
"useful expression") and then reproduces the variable part (i.e.,
spoken English word or expression). The fixed part shown in FIG. 11
may be a two-bit control code (f.sub.0, f.sub.1) as in the dot code
shown in FIG. 8. That is, no audio label is reproduced is
reproduced if (f.sub.0, f.sub.1)=(0, 0), "useful word" is
reproduced if (f.sub.0, f.sub.1)=(0,1), and "useful expression" is
reproduced if (f.sub.0, f.sub.1)=(1,0).
[0076] In the second embodiment, each dot code may be modified so
that the fixed part is reproduced after the variable part, not
before the variable part as shown in FIG. 11. Alternatively, the
dot code may be modified so that the fixed part is reproduced
between two consecutive phrases, replacing the silent period BLK
in, for example, the audio message reproduced from the dot code 1-1
or 1-2 shown in FIG. 6. Still alternatively, the dot code may be
modified so that two fixed parts are reproduced before the first
phrase and after the last phrase, respectively, as is illustrated
in FIG. 12.
[0077] [Third Embodiment]
[0078] In the first and second embodiments described above, a
plurality of dot codes are read sequentially. In the third
embodiment, each dot code consists of a plurality of subset codes,
each being a distinct data item representing a sound, a picture, a
spoken word, or the like, as discussed in U.S. Ser. No. 08/586,792.
The subset codes constituting a dot code may represent, for
example, audio segments which can be distinguished from one
another. If this is the case, the dot code can be read in units of
subsets, and the audio segments can be reproduced, on by one, from
the respective subsets. When the subsets are sequentially read, the
audio segments will be reproduced from the subsets, sounding like a
continuous audio message.
[0079] FIG. 13 shows a dot code consisting of subset codes A to D.
The subset code A has block addresses 1 to 49, the subset code B
has block addresses 50 to 69, the subset code C has block addresses
70 to 79, and the subset code D has block addresses 80 to 129. The
subset codes A to D have been interleaved and subjected to
error-correction. Audio segments can therefore be reproduced from
the subset codes A to D. When the subset codes A to D are
sequentially scanned, all blocks of each subset code are reproduced
since each block has one address.
[0080] When the subset code A is scanned, audio segment "this" is
reproduced. When the subset code B is scanned, audio segment "is"
is reproduced. When the subset codes A to D are scanned in this
order, the user hears the audio message of "This is a pen."
[0081] As mentioned above, the conventional code image reader is
disadvantageous in that, upon detecting any silent period, the user
may misunderstand that an message has been completely reproduced
from a dot code and may move the reader over the next dot code,
leaving the remaining part of the message not reproduced. To
prevent this from happening, an end code is added to each of the
subset codes A to D. When one of the subset codes A to D is
scanned, a sound is reproduced from the end code, indicating that
audio segment has just been reproduced. Moreover, all of the subset
codes A to D are scanned, a sound is reproduced from the end code,
indicating that the audio message has been reproduced
completely.
[0082] More specifically, a fixed part and a table of
sound-reproducing conditions are added to each subset code. Thus,
as shown in FIG. 14, each subset code consists of a variable part,
a fixed part, a condition table, a code-group number, and a code ID
label. The variable part and the fixed part are identical to those
used in the first and second embodiments, and will not be
described.
[0083] The condition table represents the conditions in which to
reproduce the sound of the fixed part. To be specific, the
condition table describes the information of A, B, C, D, A+B+C+D
(where A, B, C and D are subset codes).
[0084] The code-group number is the common ID number assigned not
only to the subset code but also to the other subset codes of the
same dot code. The subset codes constituting a dot code, which are
assigned with the same code-group number, have different block
addresses and can therefore be read and reproduced, either one by
one or at together at the same time. The code ID label is the ID
label assigned to the subset code. That is, the subset codes
constituting a dot code have different code ID labels. FIG. 15
illustrates the subset codes A to D in greater detail.
[0085] It will be explained below how the dot code reader operates
when it scans and reads the dot code shown in FIG. 15.
[0086] First it will be described how the dot code reader operates
when it reads the subset code A only. The dot code reader
demodulates the subset code A, acquiring two audio data items
representing the spoken word "this" and the audio end mark "poo,"
respectively, the condition table, and two other data items that
represent the code-group number "001" and the code ID label "A,"
respectively. From the block address of the subset code A it has
read, the dot code reader determines that the subset code A has
just been read and that no other subset codes have been read. Since
"A" is described in the condition table, the dot code reader
determines that both the variable part and the fixed part should be
reproduced. The dot code reader therefore expands the audio data
items representing the variable part and the fixed part and
converts them into analog audio signals.
[0087] It will now be described how the dot code reader operates
when it reads all subset codes A to D.
[0088] The dot code reader demodulates the subset codes A to D.
Thus, it acquires four audio data items representing the spoken
words "this," "is," "a" and "pen"; an audio data item representing
the audio end mark "poo"; the condition table; the code-group
number, i.e., "001"; and the four code ID labels "A," "B," "C," and
"D." From the block addresses of the subset codes A to D it has
read, the dot code reader determines that the subset codes A to D
have been read and no other subset codes have been read. Since
"A+B+C+D" is described in the condition tables, the dot code reader
determines that both the variable part and the fixed part of each
subset code should be reproduced. The dot code reader therefore
expands the audio data items representing the variable part of each
subset code and converts them into analog audio signals, and then
expands the audio data item representing the fixed part and
converts it into analog audio signals.
[0089] When the dot code reader reads subset codes in a combination
that is not described in the condition table, the fixed part is not
reproduced. Alternatively, it may not reproduces the variable parts
of the read subset codes.
[0090] As described above, each of the subset codes A to D have a
fixed part as an audio data item. Instead, each subset code may
have a fixed part as a control code. If this is the case, the dot
code reader stores an audio data item corresponding to the control
code.
[0091] The present invention is not limited to the embodiments
described above. Various changes and modifications can be made
within the scope and spirit of the invention. For instance, dot
code readers according to the invention may store different audio
data items for the fixed part of an audio message. These audio data
items may represent, for example, the voices characteristics of
various animation characters, respectively.
[0092] The present invention can provide the following code image
reading apparatuses:
[0093] (1) A code image reading apparatus comprising:
[0094] an imaging section for optically reading code images printed
on a recording medium and converting the code images to image
signals when the code image reading apparatus is manually operated,
each of said code images being a coded data item containing a first
data item which includes at least one of audio data, video data and
text data;
[0095] a data-restoring section for processing each of the image
signals output from the imaging section, thereby restoring the
coded data item containing the first data item;
[0096] a first data output section for processing the coded data
restored by the data-restoring section, thereby outputting the
first data item; and
[0097] a second data output section for processing prescribed ones
of the code images, thereby outputting a second data item which is
different from the first data item and which is common to the
prescribed coded images,
[0098] wherein the first and second output sections operate in
association to output the first data item and the second data item,
respectively.
[0099] Since the first and second output sections operate in
association to output main data (first data item) and other data
(second data item), respectively, the code image reading apparatus
can reproduce data, which consists of main data and sub-data
modifying the main data and which is therefore easy for the user to
recognize.
[0100] In other words, the present invention can provide a system
comprising a code image representing an audio message and an
apparatus for reading the code image. The audio message consists of
a variable part which is specific to the audio message and a fixed
part which is common to a group of code images. This system is
advantageous in the following respects:
[0101] 1. The fixed part may be an audio end mark that informs the
user that the coded data in the code image has been reproduced.
Until the user hears the end mark, he or she would not move the
reading apparatus to the next code image. And upon hearing the end
mark, the user can move the apparatus at once to the next code
image, wasting no time; and
[0102] 2. The last of code images forming a group my represent an
audio message the fixed part of which is an audio instruction,
telling the user what he or she should do next. The audio
instruction helps the user operate the apparatus smoothly.
[0103] (2) The code image reading apparatus described in the
paragraph (1), wherein
[0104] the second data output section include an output detecting
section for detecting that the first data output section has output
the first data item, and
[0105] when the output detecting section detects that the first
data output section has output the first data item, the second data
output section outputs the second data item after outputting of the
first data item.
[0106] Since it is detected that the first data item has been
output, an audio mark can be reproduced from the second data item
associated with the first data item after an audio message is
reproduced from the first data item. The audio mark, thus
reproduced, may inform the user of the completion of reproducing
the audio message from one code image or audio messages from a
group of code images.
[0107] (3) The code image reading apparatus described in the
paragraph (2), wherein
[0108] the first data output section include a data converting
section for performing digital-to-analog conversion on the coded
data restored by the data-restoring section and containing the
first data item, and
[0109] the output detecting section is designed to detect that the
first data item has been output, when the data converting section
finishes processing the first data item.
[0110] If so, the completion of the reproduction of the first data
item can be reliably detected, because it is detected by detecting
the completion of the digital-to-analog conversion.
[0111] (4) The code image reading apparatus described in the
paragraph (1), wherein
[0112] the first data output section includes an output detecting
section for detecting that the second data output section has
output the second data item, and
[0113] when the output detecting section detects that the second
data output section has output the second data item, the first data
output section outputs the first data item after outputting the
second data item.
[0114] Since it is detected that the second data item has been
output, an audio label can be reproduced from the second data item
associated with the first data item, before an audio message is
reproduced from the first data item. The audio label, thus
reproduced, may inform the user of the usefulness the audio message
before the audio message is reproduced.
[0115] (5) The code image reading apparatus described in the
paragraph (4), wherein
[0116] the second data output section include a data converting
section for performing digital-to-analog conversion on the coded
data containing the second data item, and
[0117] the output detecting section is designed to detect that the
second data item has been output, when the data converting section
finishes processing the first data item.
[0118] In this case, the completion of the reproduction of the
second data item can be reliably detected, because it is detected
by detecting the completion of the digital-to-analog
conversion.
[0119] (6) The code image reading apparatus described in the
paragraph (1), wherein the second data item is contained in the
code image, along with the first data item.
[0120] Therefore, the apparatus can acquire both data item when it
reads the code image. The apparatus need not have a memory for
storing the second data item and can be manufactured at the same
cost as the conventional code image reader.
[0121] (7) The code image reading apparatus described in the
paragraph (1), further comprising a storage section for storing the
second data item.
[0122] Hence, the code image does not contain the second data item.
The image code is therefore shorter than otherwise. In addition,
the second data item stored in the storage section may be one
representing any audio mark the user desires. Thus, the apparatus
can generate an audio mark specific to it.
[0123] (8) The code image reading apparatus described in the
paragraph (1), further comprising a storage section for storing the
second data item, and
[0124] wherein the code image contains the first data item and a
third data item, which is distinct from the first data item and
which designates the second data item stored in the storage
section.
[0125] The third data item is small, and the code image is
relatively short. Data items similar to the second data item may be
stored in the storage section. In this case, the third data item
may designate two or more of the data items stored in the storage
section. This renders the apparatus more useful.
[0126] (9) The code image reading apparatus described in the
paragraph (1), wherein the recording medium is designed to help
users learn languages.
[0127] As the apparatus is moved over the recording medium, it
reads the code image and generates spoken words, phrases,
expressions and sentences, and also generates audio labels
informing the user that this or that word, phase, expression or
sentence is useful.
[0128] (10) The code image reading apparatus described in any one
of the paragraphs (1) to (9), wherein the first and second data
items are audio data items.
[0129] More precisely, the first and second data items represent an
audio message and an audio mark, respectively. Generally it takes
the user much more time to determine that the audio message has
been reproduced in its entirety, than to know that an image has
been completely reproduced from a video signal. Nonetheless, upon
hearing the audio mark reproduced as soon as the audio message is
reproduced, the user can immediately understand that the audio
message has been completely reproduced. He or she need not waste
time to determine whether or not the audio message has been
reproduced in its entirety.
[0130] Additional advantages and modifications will readily occur
to those skilled in the art. Therefore, the invention in its
broader aspects is not limited to the specific details, and
representative devices shown and described herein. Accordingly,
various modifications may be made without departing from the spirit
or scope of the general inventive concept as defined by the
appended claims and their equivalents.
* * * * *