U.S. patent application number 14/723962 was filed with the patent office on 2015-09-17 for photographing apparatus and method of providing photographed video.
This patent application is currently assigned to SAMSUNG ELECTRONICS CO., LTD.. The applicant listed for this patent is SAMSUNG ELECTRONICS CO., LTD.. Invention is credited to Jin-su MYUNG.
Application Number | 20150264433 14/723962 |
Document ID | / |
Family ID | 44011059 |
Filed Date | 2015-09-17 |
United States Patent
Application |
20150264433 |
Kind Code |
A1 |
MYUNG; Jin-su |
September 17, 2015 |
PHOTOGRAPHING APPARATUS AND METHOD OF PROVIDING PHOTOGRAPHED
VIDEO
Abstract
A photographing apparatus and a method of providing a
photographed video converts a photographed video into two types of
formats, stores the converted video, and transmits the video
wirelessly in real-time. Therefore, a user stores a high quality
video photographed by a photographing apparatus as well as
broadcasts the photographed video in real-time.
Inventors: |
MYUNG; Jin-su; (Yongin-si,
KR) |
|
Applicant: |
Name |
City |
State |
Country |
Type |
SAMSUNG ELECTRONICS CO., LTD. |
Suwon-si |
|
KR |
|
|
Assignee: |
SAMSUNG ELECTRONICS CO.,
LTD.
Suwon-si
KR
|
Family ID: |
44011059 |
Appl. No.: |
14/723962 |
Filed: |
May 28, 2015 |
Related U.S. Patent Documents
|
|
|
|
|
|
Application
Number |
Filing Date |
Patent Number |
|
|
12909904 |
Oct 22, 2010 |
9049362 |
|
|
14723962 |
|
|
|
|
Current U.S.
Class: |
725/110 |
Current CPC
Class: |
H04N 5/232 20130101;
H04N 5/23206 20130101; H04N 21/440236 20130101; H04N 21/4223
20130101; H04N 7/12 20130101; H04N 21/4385 20130101 |
International
Class: |
H04N 21/4402 20060101
H04N021/4402; H04N 21/4385 20060101 H04N021/4385; H04N 21/4223
20060101 H04N021/4223 |
Foreign Application Data
Date |
Code |
Application Number |
Nov 13, 2009 |
KR |
10-2009-109686 |
Claims
1. A photographing apparatus, comprising: an image sensor to
photograph an object and to output first video data including the
photographed object; a scaler to adjust the size of the first video
data and to generate the second video data and to output the
generated second video data; a video encoder to encode the first
video data and the second video data, and to output a first video
stream and a second video stream; a first multiplexer (MUX) to
multiplex the first video stream and an audio stream, and to
convert the multiplexed stream into a video file of a first format;
a second multiplexer (MUX) to multiplex one of the first video
stream and the second video stream and the audio stream, and to
convert the multiplexed stream into a video file of a second format
which is different with the first format; and a communication unit
to transmit the video file of the second format wirelessly.
2. The photographing apparatus of claim 1, further comprising: a
selection unit to select one of the first video stream and the
second video stream according to a manipulation of a user, and to
output the selected video stream.
3. The photographing apparatus of claim 1, further comprising: a
storage unit to store at least one of the video file of the first
format and the video file of the second format.
4. The photographing apparatus of claim 3, wherein: the first MUX
outputs the video file of the first format to the storage unit; the
second MUX multiplexes the second video stream with the audio
stream, converts the multiplexed stream into a video file of the
second format, and outputs the video file of the second format to
the communication unit; and the communication unit transmits the
video file of the second format wirelessly external to the
photographing apparatus
5. The photographing apparatus of claim 4, wherein the video file
of the first format is a video file having the same definition as
the first video data photographed by the image sensor.
6. The photographing apparatus of claim 5, wherein the video file
of the first format is a video file having full high definition
(HD).
7. The photographing apparatus of claim 4, wherein the video file
of the second format is a video file having capacity which is the
same as or less than the capacity capable of being transmitted by
the communication unit wirelessly.
8. The photographing apparatus of claim 3, further comprising: a
control unit to control the second MUX to perform at least one of
storing the video file of the second format in the storage unit and
transmitting the video file of the second format wirelessly through
the communication unit according to a manipulation of a user.
9. The photographing apparatus of claim 1, wherein the scaler
adjusts the size of the first video data by performing at least one
of adjusting resolution of the first video data and extracting a
specific portion from the first video data.
10. A method of providing a photographed video, comprising:
photographing an object and generating first video data including
the photographed object; adjusting the size of the first video data
and to generate the second video data and to output the generated
second video data; encoding the first video data and the second
video data to be converted into a first video stream and a second
video stream; multiplexing the first video stream and an audio
stream, and converting the multiplexed stream into a video file of
a first format; multiplexing one of the first video stream and the
second video stream and the audio stream, and converting the
multiplexed stream into a video file of a second format which is
different with the first format; and transmitting the video file of
the second format wirelessly.
11. The method of claim 10, wherein the converting the multiplexed
stream into a video file of a second format selects one of the
first video stream and the second video stream according to a
manipulation of a user, multiplexes the selected video stream and
the audio stream, and converts the multiplexed stream into a video
file of a second format.
12. The method of claim 10, further comprising: storing at least
one of the video file of the first format and the video file of the
second format.
13. The method of claim 12, wherein: the storing stores the video
file of the first format; the converting the multiplexed stream
into the video file of the second format multiplexes the second
video stream with the audio stream, and converts the multiplexed
stream into a video file of the second format; and the transmitting
transmits the video file of the second format wirelessly external
to the photographing apparatus.
14. The method of claim 13, wherein the video file of the first
format is a video file having the same definition as that of the
first video data photographed by an image sensor.
15. The method of claim 14, wherein the video file of the first
format is a video file having full high definition (HD).
16. The method of claim 13, wherein the video file of the second
format is a video file having capacity which is the same as or less
than the capacity capable of being transmitted by the communication
unit wirelessly.
17. The method of claim 12, further comprising: controlling to
perform at least one of storing the video file of the second format
and transmitting the video file of the second format wirelessly
according to a manipulation of a user.
18. The method of claim 10, wherein the generating the second video
data adjusts the size of the first video data by performing at
least one of adjusting resolution of the first video data and
extracting a specific portion from the first video data, and
generates the second video data.
19. A photographing apparatus comprising: an image sensor unit to
capture moving images, convert the moving images into an electrical
signal and output the electrical signal as video data; a scaler
unit to reduce the size of the video data; and a communication unit
to wirelessly transmit the reduced size video data in real
time.
20. The photographing apparatus of claim 19, further comprising: a
video encoder unit to receive the video data and the reduced size
video data and create a plurality of video streams to correspond to
the video data and reduced size video data; and a multiplexer unit
to convert one of the plurality of video streams into a video file
to be transmitted by the communication unit.
Description
CROSS-REFERENCE TO RELATED APPLICATIONS
[0001] This application is a continuation application of
application U.S. Ser. No. 12/909,904 filed in the United States on
Oct. 22, 2010, which is related to and claims priority benefit of
Korean Patent Application No. 10-2009-109686, filed on Nov. 13,
2009 in the Korean Intellectual Property Office, the disclosures of
which are incorporated herein by reference.
BACKGROUND
[0002] 1. Field of the General Inventive Concept
[0003] The present general inventive concept relates to a
photographing apparatus and a method of providing a photographed
video, and more particularly, to a photographing apparatus to
photograph or record high quality videos and a method of providing
a photographed video.
[0004] 2. Description of the Related Art
[0005] With the development of technologies related to a
photographing apparatus, the quality of videos which are
photographed by photographing apparatuses has greatly improved.
Recently developed photographing apparatuses can photograph video
in full high definition (HD) resolution.
[0006] When a photographing apparatus photographs a video in high
resolution, the photographing apparatus obtains a high quality
image, which is an advantage. However, the higher the resolution of
an image, the larger the size of the photographed video data that
represents the image will be, and the photographing apparatus may
require a large capacity storage medium to store the high
resolution video data.
[0007] In addition, the large capacity of the high resolution video
may be a problem when providing a broadcasting service in
real-time. This is because the photographed video has to be
transmitted in real-time for a real-time broadcasting service, but
a communications network cannot guarantee a communication speed to
transmit a full HD image in real-time.
[0008] As described above, it is difficult for the photographing
apparatus to photograph a video in high resolution and to transmit
the photographed video in real-time. Therefore, there is a need for
a method to broadcast a high resolution video photographed by a
photographing apparatus in real-time.
SUMMARY
[0009] The present general inventive concept provides a
photographing apparatus to convert a photographed or recorded video
into two types of formats, to store the converted videos, and to
transmit the videos wirelessly in real-time, and a method of
providing a photographed video.
[0010] Additional features and utilities of the present general
inventive concept will be set forth in part in the description
which follows and, in part, will be obvious from the description,
or may be learned by practice of the general inventive concept.
[0011] Embodiments of the present general inventive concept may be
achieved by providing a photographing apparatus, including an image
sensor to photograph an object and to output first video data, a
scaler to adjust the size of the first video data, and to output
second video data, a video encoder to encode the first video data
and the second video data, and to output a first video stream and a
second video stream, a first multiplexer (MUX) to multiplex the
first video stream and an audio stream, and to convert the
multiplexed stream into a video file of a first format, a second
multiplexer (MUX) to multiplex one of the first video stream and
the second video stream and the audio stream, and to convert the
multiplexed stream into a video file of a second format, and a
communication unit to transmit the video file of the second format
wirelessly.
[0012] The photographing apparatus may further include a selection
unit to select one of the first video stream and the second video
stream according to a manipulation of a user, and to output the
selected video stream.
[0013] The photographing apparatus may further include a storage
unit to store at least one of the video file of the first format
and the video file of the second format.
[0014] The first MUX may output the video file of the first format
to the storage unit, the second MUX may multiplex the second video
stream with the audio stream, convert the multiplexed stream into a
video file of the second format, and output the video file of the
second format to the communication unit, and the communication unit
may transmit the video file of the second format wirelessly to the
outside.
[0015] The video file of the first format may be a video file
having the same definition as the first video data photographed by
the image sensor.
[0016] The video file of the first format may be a video file
having full high definition (HD).
[0017] The video file of the second format may be a video file
having capacity which is the same as or less than the capacity
capable of being transmitted by the communication unit
wirelessly.
[0018] The photographing apparatus may further include a control
unit to control the second MUX to perform at least one of storing
the video file of the second format in the storage unit and
transmitting the video file of the second format wirelessly through
the communication unit according to a manipulation of a user.
[0019] The scaler may adjust the size of the first video data by
performing at least one of adjusting resolution of the first video
data and extracting a specific portion from the first video
data.
[0020] Embodiments of the present general inventive concept may
also be achieved by providing a method of providing a photographed
video, including photographing an object and generating first video
data, adjusting the size of the first video data, and generating
the second video data, encoding the first video data and the second
video data to be converted into a first video stream and a second
video stream, multiplexing the first video stream and an audio
stream, and converting the multiplexed stream into a video file of
a first format, multiplexing one of the first video stream and the
second video stream and the audio stream, and converting the
multiplexed stream into a video file of a second format, and
transmitting the video file of the second format wirelessly.
[0021] The converting the multiplexed stream into a video file of a
second format may select one of the first video stream and the
second video stream according to a manipulation of a user,
multiplex the selected video stream and the audio stream, and
convert the multiplexed stream into a video file of a second
format.
[0022] The method may further include storing at least one of the
video file of the first format and the video file of the second
format.
[0023] The storing may store the video file of the first format,
the converting the multiplexed stream into the video file of the
second format may multiplex the second video stream with the audio
stream, and convert the multiplexed stream into a video file of the
second format, and the transmitting may transmit the video file of
the second format wirelessly to an outside.
[0024] The video file of the first format may be a video file
having the same definition as that of the first video data
photographed by an image sensor.
[0025] The video file of the first format may be a video file
having full high definition (HD).
[0026] The video file of the second format may be a video file
having capacity which is the same as or less than the capacity
capable of being transmitted by the communication unit
wirelessly.
[0027] The method may further include controlling to perform at
least one of storing the video file of the second format and
transmitting the video file of the second format wirelessly
according to a manipulation of a user.
[0028] The generating the second video data may adjust the size of
the first video data by performing at least one of adjusting
resolution of the first video data and extracting a specific
portion from the first video data, and generate the second video
data.
[0029] Embodiments of the present general inventive concept may
also be achieved by providing a photographing apparatus including
an image sensor unit to capture moving images, convert the moving
images into an electrical signal and output the electrical signal
as video data, a scaler unit to reduce the size of the video data,
and a communication unit to wirelessly transmit the reduced size
video data in real time.
[0030] A video encoder unit may receive the video data and the
reduced size video data and create a plurality of video streams to
correspond to the video data and reduced size video data, and a
multiplexer unit may convert one of the plurality of video streams
into a video file to be transmitted by the communication unit.
[0031] A selection unit may select one of the plurality of video
streams to be converted by the multiplexer, and a control unit may
control the output of the selection unit according to a
pre-programmed option or a manipulation of a user.
[0032] The video file may include a moov box and an mdat box.
[0033] The video encoder unit may further include an encoder, a
first buffer to temporarily store the video data output from the
image sensor, and a second buffer to temporarily store the reduced
video data output from the scaler unit, wherein the first and
second buffers may alternately input the video data and reduced
video data to the encoder.
[0034] Embodiments of the present general inventive concept may
also be achieved by providing a method of providing a photographed
video including converting moving images into an electrical signal
and outputting the electrical signal as video data, reducing the
size of the video data, and wirelessly transmitting the reduced
size video data in real time.
[0035] The method may further include receiving the reduced size
video data in an encoder unit and encoding the reduced size video
data into a video stream.
[0036] The method may further include temporarily storing the video
data in a first buffer of the encoder unit, and temporarily storing
the reduced video data in a second buffer of the encoder unit,
wherein the first and second buffers alternately input the video
data and reduced video data to an encoder within the encoder
unit.
[0037] The method may further include multiplexing the video stream
and an audio stream and converting the multiplexed stream into a
video file including a track having data and timing information to
correspond to different portions of the video file.
[0038] Embodiments of the present general inventive concept may
also be achieved by a method of providing a photographed video, the
method including converting a photographed video into video data
having two types of video data formats, temporarily storing the
converted video data, and transmitting the video data wirelessly in
real time.
[0039] The transmitted video data may be reduced size video
data.
[0040] The reduced size video data may be reduced by reducing the
resolution of the video data or selecting a portion of the video
data.
[0041] The method may further include receiving the video data and
reduced size video data in an encoder and parallel encoding the
video data and the reduced size video data into a plurality of
video streams to be transmitted wirelessly in real time.
BRIEF DESCRIPTION OF THE DRAWINGS
[0042] These and/or other features and utilities of the present
general inventive concept will become apparent and more readily
appreciated from the following description of the embodiments,
taken in conjunction with the accompanying drawings of which
[0043] FIG. 1 is a block diagram illustrating a photographing
apparatus according to an exemplary embodiment of the present
general inventive concept;
[0044] FIG. 2 is a block diagram illustrating a video encoder
according to an exemplary embodiment of the present general
inventive concept;
[0045] FIG. 3 is a flowchart illustrating a method of providing a
photographed video according to an exemplary embodiment of the
present general inventive concept;
[0046] FIG. 4 is a view illustrating a video which is photographed
by a photographing apparatus and broadcast in real-time, according
to an exemplary embodiment of the present general inventive
concept;
[0047] FIG. 5 is a view illustrating an original photographed video
and a video having resolution converted by a scaler according to an
exemplary embodiment of the present general inventive concept;
[0048] FIG. 6 is a view illustrating an original photographed video
and a portion extracted from the original photographed video by a
scaler according to an exemplary embodiment of the present general
inventive concept;
[0049] FIGS. 7A and 7B are views illustrating the structure of a
video file of MPEG layer 4 (MP4) format according to an exemplary
embodiment of the present general inventive concept;
[0050] FIGS. 8A to 8C are views illustrating the structure of a
video file to be broadcast in real-time according to an exemplary
embodiment of the present general inventive concept.
DETAILED DESCRIPTION OF THE EMBODIMENTS
[0051] Reference will now be made in detail to the embodiments of
the present general inventive concept, examples of which are
illustrated in the accompanying drawings, wherein like reference
numerals refer to the like elements throughout. The embodiments are
described below in order to explain the present general inventive
concept by referring to the figures.
[0052] In the present general inventive concept described herein,
the terms "photograph" and "photographing" may be used
interchangeably with terms such as "record" and "recording" to mean
that not simply that a still image may be photographed, but that a
moving video may be photographed to record or film short, long or
continuous streaming segments of moving video images. Thus, when
the specification describes photographing an object, a video, or
moving images, these terms also mean that a video, not simply a
still image photograph, may be recorded, stored, and/or transmitted
in the various embodiments described herein. When discussing a
"photographing apparatus" in the present general inventive concept,
the term is meant to include an apparatus that may take traditional
digital photographs and also include a video camera and related
apparatuses that may capture moving video images.
[0053] FIG. 1 is a block diagram illustrating a photographing
apparatus 100 according to an exemplary embodiment of the present
general inventive concept. Referring to FIG. 1, the photographing
apparatus 100 may include a microphone 110, an audio encoder 115,
an image sensor 120, a scaler 123, a video encoder 125, a selection
unit 130, a first multiplexer (MUX) 140, a second multiplexer (MUX)
150, a storage unit 160, a communication unit 170, a control unit
180, and a manipulation unit 190.
[0054] The microphone 110 may receive voice and other audio sounds,
convert the voice or other sounds into audio data (A0), and output
the audio data (A0) to the audio encoder 115. That is, the
microphone 110 may convert an acoustic signal into the audio data
(A0), which is an electrical signal.
[0055] The audio encoder 115 compresses the input audio data (A0),
and may generate a compressed audio stream (A1). The audio encoder
115 may compress audio data using encoding techniques such as
advanced audio coding (AAC), audio coding (AC3), and so on.
[0056] The image sensor 120 photographs an object, and outputs
first video data (V0) corresponding to the photographed video. That
is, the image sensor 120 converts incoming light into the first
video data (V0) which can be an electrical signal. The image sensor
120 may be implemented using a charge coupled device (CCD) or a
complementary metal oxide semiconductor (CMOS).
[0057] The scaler 123 may adjust the size of the first video data
(V0), generate second video data (V1) having a different or smaller
size than the first video data (V0) and output the second video
data (V1). The scaler 123 may adjust the size of the first video
data (V0) by performing at least one of adjusting the resolution of
the first video data (V0) and extracting one or a plurality of
specific portions from the video data (V0) to produce the second
video data (V1).
[0058] Specifically, the scaler 123 may generate the second video
data (V1) of which an image or file size is smaller than that of
the first video data (V0) by adjusting the resolution of the first
video data (V0) from a high resolution to a lower resolution. For
instance, the scaler 123 may generate the second video data (V1) by
adjusting the resolution of the first video data (V0) from full
high definition (HD) to standard definition (SD).
[0059] In addition, the scaler 123 may generate the second video
data (V1) of which the file size is smaller than that of the first
video data (V0) by extracting at least one portion from the first
video data (V0). For example, the scaler 123 may extract a portion
selected by a user from the first video data (V0), and generate the
second video data (V1) using the extracted portion. Also, the
extracted portion may be a pre-programmed portion to capture a
desired section of the video being recorded.
[0060] Therefore, the scaler 123 may adjust the resolution of the
first video data (V0) or extract a specific portion from the first
video data (V0) according to a pre-programmed selection or a
selection of a user to generate or output the second video data
(V1) of which the size is adjusted.
[0061] The scaler 123 may generate the second video data (V1) by
reducing the size of the first video data (V0) so that the
communication unit 170 may transmit the second video data (V1)
wirelessly or by wired connection in real-time. As the first video
data (V0) which is an original video photographed by the
photographing apparatus 100 may be a high quality video, there is a
possibility that it may be difficult or impossible to transmit the
first video data (V0) over limited bandwidth of the communication
unit 170 or accessible by the communication unit 170. Therefore,
the scaler 123 may reduce the size of the first video data (V0),
which is the original video data representing the original captured
or recorded video, to generate the second video data (V1), thereby
enabling the photographing apparatus 100 to broadcast the
photographed video over bandwidth of or accessible by the
communication unit 170.
[0062] The video encoder 125 may encode the first video data (V0)
and the second video data (V1), and output a first video stream
(V2) and a second video stream (V3), respectively. Specifically,
the video encoder 125 may encode the first video data (V0) and the
second video data (V1) in parallel to provide greater output
options for the photographing apparatus 100. For the parallel
processing, the video encoder 125 may be implemented using buffers
such as RAM memory to temporarily store the video data and video
streams. The structure of the video encoder 125 will be explained
in detail with reference to FIG. 2.
[0063] FIG. 2 is a block diagram illustrating the video encoder 125
according to an exemplary embodiment of the present general
inventive concept. Referring to FIG. 2, the video encoder 125 may
include an encoder 200, a first buffer 210, a second buffer 220, a
third buffer 230, and a fourth buffer 240.
[0064] The first buffer 210 may temporarily store the first video
data (V0) output from the image sensor 120, and the second buffer
220 may temporarily store the second video data (V1) output from
the scaler 123. The first and second buffers 210 and 220 may
alternately input the first and second video data (V0) and (V1) to
the encoder 200 by a predetermined unit, for example, a frame
unit.
[0065] The encoder 200 may encode the video data temporarily stored
in the first and second buffers 210 and 220, and temporarily store
the encoded video data in the third and fourth buffers 230 and 240.
Specifically, the encoder 200 may encode the first video data (V0)
input into the first buffer 210, and temporarily store the encoded
first video stream (V2) in the third buffer 230. The encoder 200
may encode the second video data (V1) input into the second buffer
220, and temporarily store the encoded second video stream (V3) in
the fourth buffer 240.
[0066] As illustrated in FIGS. 1 and 2, the third buffer 230 of the
video encoder 125 may output the first video stream (V2) to the
first MUX 140 and to the selection unit 130. The fourth buffer 240
of the video encoder 125 may output the second video stream (V3) to
the selection unit 130.
[0067] Referring again to FIG. 1, the selection unit 130 selects
one of the first video stream (V2) and the second video stream (V3)
according to a pre-programmed selection or manipulation of a user,
and outputs the selected video stream (V2) or (V3) to the second
MUX 150. The selection unit 130 may be controlled by the control
unit 180, and may be implemented as a switch unit to switch one of
the first video stream (V2) and the second video stream (V3) and to
output the video stream (V2) or (V3) to the second MUX 150.
[0068] If the bandwidth of the communication unit 170 or accessible
by the communication unit 170 is enough to transmit the first video
stream (V2) wirelessly in real-time, a user may manipulate the
selection unit 130 to select the first video stream (V2). The
controller 180 may also be programmed to automatically make this
determination, and transmit the video stream (V2). Usually, as the
first video stream (V2) is in high quality and may require a large
bandwidth for transmission, it may be difficult or impossible to
transmit the first video stream (V2) wirelessly in real-time. When
these difficulties arise, the control unit 180 may control the
selection unit 130 to select the second video stream (V3) of which
the size has been scaled to be smaller.
[0069] The first MUX 140 may multiplex the first video stream (V2)
and the audio stream (A1), and convert the multiplexed stream into
a video file of a first format. The first MUX 140 outputs the video
file of the first format and stores the video file in the storage
unit 160. Herein, the first format may represent a format suitable
to store a video file. Since the video file of the first format is
an original photographed video, the first MUX 140 converts the
first video stream (V2) into the first format suitable to store a
file. For example, the first format may be a format such as MP4,
audio video interleave (AVI), and so on. The structure of the file
of the MP4 format is illustrated in FIGS. 7A and 7B, and will be
explained later.
[0070] The video file of the first format may be a video file
having the same resolution as that of the first video data
photographed by the image sensor 120. For example, the video file
of the first format may be a video file having full HD quality.
[0071] The second MUX 150 may multiplex the audio stream (A1) and
the video stream (V2) or (V3) selected by the selection unit 130,
and converts the multiplexed stream into a video file of the second
format. Since the video file of the second format may be
transmitted wirelessly in real-time, the second MUX 150 may convert
the video stream input by the selection unit 130 into the second
format which is suitable to transmit a file wirelessly in
real-time. The second format is suitable for wireless transmission
in real-time. The file structure of a file format suitable for
wireless transmission in real-time is illustrated in FIGS. 8A to
8C, and thus this will be explained later. The video format
illustrated in FIGS. 7A and 7B may also be used for wireless
transmission of the video files as described herein. As described
above, since the video file of the second format is for wireless
transmission, its capacity may be the same as or less than the
capacity that can be transmitted wirelessly by the communication
unit 170 in real-time.
[0072] The storage unit 160 may store programs to execute various
operations of the photographing apparatus 100. The storage unit 160
may also store the video file of the first format and the video
file of the second format. The storage unit 160 may be implemented
using a hard disc drive, a non-volatile memory, an external memory
such as a flash drive, and other storage mediums as are known in
the art.
[0073] The communication unit 170 may be connected to an intranet
network, an internet network or an external device for
communication. The communication unit 170 may transmit a video file
of the second format in a wireless manner. For example, the
communication unit 170 may transmit the video file of the second
format to a server which transmits a video wirelessly in real-time
via an intranet or internet network. Therefore, clients connected
to a broadcast server may view the video photographed or recorded
by the photographing apparatus 100 in real-time. The communication
unit 170 may also be implemented using a wireless local area
network (LAN).
[0074] The manipulation unit 190 can receive a manipulation from a
user, and transmit the manipulation to the control unit 180.
Specifically, the manipulation unit 190 may be buttons or a
touchscreen provided on the photographing apparatus 100.
[0075] The control unit 180 may control overall operations of the
photographing apparatus 100. In more detail, the control unit 180
may control the second MUX 150 to perform at least one of storing
the video file of the second format in the storage unit 160 and
transmitting the video file of the second format wirelessly through
the communication unit 170 according to the manipulation of the
user or instructions pre-stored in the storage unit 160. The
control unit 180 may control the second MUX 150 to output the video
file of the second format to the storage unit 160, thereby storing
the video file of the second format in the storage unit 160. The
controlling unit 180 may also control the second MUX 150 to output
the video file of the second format to the communication unit 170
in order to transmit the video file of the second format wirelessly
in real-time.
[0076] The control unit 180 may also control the scaler 123 to
adjust the size of the first video data (V0) by performing at least
one of adjusting the resolution of the first video data (V0) and
extracting specific portions from the first video data (V0)
according to the manipulation of the user, or the capabilities of
the communication unit 170.
[0077] The control unit 180 may control the selection unit 130 to
select one of the first video stream (V2) and the second video
stream (V3), and to output the selected video stream (V2) or (V3)
to the second MUX 150 according to the manipulation of the user or
program stored in the control unit 160 or controller 180. Thus, a
user using the internet can view the video captured by the user in
real-time.
[0078] The photographing apparatus 100 may store the photographed
video having high quality in the storage unit 160, as well as
transmit the video wirelessly in real-time externally to the
photographing apparatus 100. Therefore, a user may transmit and
broadcast a photographed or recorded video in real-time via a
network while photographing an object using the photographing
apparatus 100.
[0079] Hereinbelow, a method of providing a photographed video will
be explained in detail with reference to FIG. 3. FIG. 3 is a
flowchart illustrating a method of providing a photographed video
according to an exemplary embodiment of the present general
inventive concept.
[0080] The photographing apparatus 100 photographs or records an
object through the image sensor 120, and generates and outputs the
first video data (V0) in operation S310. That is, the image sensor
120 converts light into the first video data (V0) which may be an
electrical signal.
[0081] The photographing apparatus 100 may adjust the size of the
first video data (V0), and generate and outputs the second video
data with adjusted size (V1) in operation S320. The photographing
apparatus 100 may perform at least one of adjusting the resolution
of the first video data (V0) and extracting at least one specific
portion from the first video data (V0) to adjust the size of the
first video data (V0).
[0082] Specifically, the photographing apparatus 100 may generate
the second video data (V1) of which the file size is smaller than
that of the first video data (V0) by adjusting the resolution of
the first video data (V0) from a high resolution to a lower
resolution. For example, the photographing apparatus 100 may adjust
the resolution of the first video data (V0) from full high
definition (HD) to standard definition (SD), and generate the
second video data (V1).
[0083] The photographing apparatus 100 may also generate the second
video data (V1) of which the file size is smaller than that of the
first video data (V0) by extracting at least one portion from the
first video data (V0). For example, the photographing apparatus 100
may extract a portion which may be pre-programmed to be extracted
or a user selects from the first video data (V0), and generates the
second video data (V1) using the extracted portion.
[0084] Therefore, the photographing apparatus 100 may adjust the
resolution of the first video data (V0) or may extract at least one
specific portion from the first video data (V0) according to a
pre-programmed selection or a selection of a user to generate or
output the second video data (V1) of which the size has been
adjusted.
[0085] Thus, the photographing apparatus 100 can reduce the size of
the first video data (V0) to have a capacity which is the same as
or less than the capacity capable of being transmitted wirelessly
in real-time by the communication unit 170, and generate the second
video data (V1). Since the first video data (V0) which is an
original video photographed by the photographing apparatus 100 is a
high quality video, there is a possibility that it is difficult or
impossible to transmit the first video data (V0) over available
bandwidth of the communication unit 170. Therefore, the
photographing apparatus 100 may reduce the size of the first video
data (V0) which is the original video to generate the second video
data (V1), thereby enabling the photographing apparatus 100 to
transmit the photographed video over the bandwidth accessible by
the communication unit 170.
[0086] The photographing apparatus 100 encodes the first video data
(V0) and the second video data (V1), and outputs the first video
stream (V2) and the second video stream (V3), respectively in
operation S330. Specifically, the photographing apparatus 100
encodes the first video data (V0) and the second video data (V1) in
parallel.
[0087] The photographing apparatus 100 multiplexes the first video
stream (V2) and the audio stream (A1), and converts the multiplexed
stream into a video file of a first format in operation S340.
Herein, the first format represents a format suitable to store a
video file. Since the video file of the first format is an original
photographed video, the first multiplexer 140 of the photographing
apparatus 100 converts the first video stream (V2) into the first
format suitable to store a file. For example, the first format may
be a format such as MP4, audio video interleave (AVI), and so on.
The structure of a file of the MP4 format is illustrated in FIGS.
7A and 7B, and thus this will be explained later.
[0088] The photographing apparatus 100 may select one of the first
video stream (V2) and the second video stream (V3) according to a
program of a manipulation of a user in operation S350. If the
bandwidth of the communication unit 170 is enough to transmit the
first video stream (V2) wirelessly in real-time, a user may
manipulate the photographing apparatus 100 to select the first
video stream (V2). Usually, as the first video stream (V2) is a
high quality video, it is impossible to transmit the first video
stream (V2) wirelessly in real-time. In such a case, the
photographing apparatus 100 may select the second video stream (V3)
of which the size has been scaled to smaller.
[0089] The photographing apparatus 100 may multiplex the audio
stream (A1) and the video stream selected from the first and second
video streams (V2) and (V3), and convert the multiplexed stream
into a video file of a second format in operation S360. Since the
video file of the second format will be transmitted wirelessly in
real-time, the photographing apparatus 100 may convert the video
stream input by the selection unit 130 into the second format which
is suitable to transmit a file wirelessly in real-time. The second
format is also a file format suitable for a wireless transmission
in real-time. The file structure of a file format suitable for
wireless transmission in real-time is illustrated in FIGS. 8A to
8C, and thus this will be explained later. As described above,
since the video file of the second format is for wireless
transmission, the video file may have the capacity which is the
same as or less than the capacity capable of being transmitted
wirelessly by the communication unit 170 in real-time.
[0090] The photographing apparatus 100 stores the video file of the
first format and the video file of the second format in operation
S370.
[0091] The photographing apparatus 100 may transmit a video file of
the second format wirelessly through communication network such as
an intranet or internet network. For example, the photographing
apparatus 100 may transmit the video file of the second format to a
server which broadcasts a video in real-time through the
communication unit 170. Clients, customers, social-networking
sites, business networking applications, etc. connected to the
server may view the video recorded or photographed by the
photographing apparatus 100 in real-time.
[0092] Through the above process, the photographing apparatus 100
may store the photographed video having high quality in the storage
unit 160, as well as broadcast the video in real-time external to
the photographing apparatus 100 to be used and seen by external
users. Therefore, a user may record, transmit and broadcast a
photographed video in real-time via over a network while
photographing an object using the photographing apparatus 100.
[0093] FIG. 4 is a view illustrating a video which is photographed
by the photographing apparatus 100 and broadcast in real-time,
according to an exemplary embodiment of the present general
inventive concept.
[0094] Referring to FIG. 4, the photographing apparatus 100 may
photograph moving images such as live objects or a scene 410, and
temporarily store a photographed video of the objects or scene 410
having full HD quality in the storage unit 160 as a full HD quality
video. The photographing apparatus 100 may scale the photographed
video having full HD quality to have SD quality. The photographing
apparatus 100 may wirelessly transmit the scaled video having SD
quality to an external device 420 such as a television, computer
monitor, handheld device, or other displays as are known in the
art. As illustrated in FIG. 4, the video photographed by the
photographing apparatus 100 may be displayed on the camera itself
or on an external display 420 in SD quality. Also, upon
transmission, the video having SD quality may be embedded with a
code to allow the SD quality video to be expanded to HD at a
receiving end of the transmission.
[0095] The photographing apparatus 100 may store an original
photographed video having high quality, as well as broadcast the
photographed video converted to have low quality suitable for
wireless transmission external to the photographing apparatus
100.
[0096] Hereinbelow, a method of scaling a high quality video will
be explained with reference to FIGS. 5 and 6.
[0097] FIG. 5 is a view illustrating an original photographed video
and a video having resolution converted by the scaler 123 according
to an exemplary embodiment of the present general inventive
concept. FIG. 5 illustrates that first video data 500 which is an
original photographed video having high quality may be scaled to
second video data 510 having lower quality through resolution
conversion.
[0098] As illustrated in FIGS. 1 and 5, the scaler 123 of the
photographing apparatus 100 scales the first video data 500 having
1920.times.1080 resolution to the second video data 510 having
720.times.480, and generates the second video data 510 of which the
size has been reduced.
[0099] FIGS. 1 and 6 illustrate an original photographed video and
a portion 605 which the scaler 123 may extract from the original
photographed video according to an exemplary embodiment of the
present general inventive concept. FIG. 6 illustrates that the
portion 605 of first video data 600 which is an original
photographed video may be extracted, thereby being scaled to second
video data 610.
[0100] As illustrated in FIGS. 1 and 6, the scaler 123 of the
photographing apparatus 100 extracts the portion 605 from the first
video data 600 having a specific size, scales the portion 605 to
the second video data 610, and generates the second video data 610
of which the size has been reduced. The portion 605 may be selected
by the manipulation of a user, or may be a predetermined portion.
The extracted portion 610 is not limited to an upper left hand
corner portion of the original video 605 illustrated in FIG. 6, but
may be any portion or portions programmed into the controller 180
or selected by a user through the manipulation unit 190.
[0101] Hereinbelow, the first format and the second format
generated by the first MUX 140 and the second MUX 150 will be
explained in detail with reference to FIGS. 7A to 8C.
[0102] FIGS. 7A and 7B are views illustrating the structure of a
video file of MPEG layer 4 (MP4) format that may stored in the
storage unit 160 or transmitted by the communication unit 170
according to an exemplary embodiment of the present general
inventive concept. FIG. 7A illustrates the structure of the ISO
file system 710 of the MP4 format. The Moov box 720 of the ISO file
system illustrated in FIG. 7A may include a number of different
boxes and hierarchies, and may provide for basic functionality of
the MPEG 4 file to be stored or transmitted by the communication
unit 170 over the an intranet or internet network, received by
external devices, decoded, and displayed on an HD or SD display
device. Basic functionality included in the Moov file may include
dimensions of a video file, or the duration of audio that is
multiplexed with the captured video to create a video file.
[0103] As illustrated in FIG. 7A, the Moov box 720 may include a
plurality of boxes including a data track box 725 for a video
stream and a data track box 727 for audio an audio stream that may
be encoded in the video encoder 125 and audio encoder 115 before
being multiplexed in the second multiplexer unit 150 as illustrated
in FIG. 1. The ISO file illustrated in FIG. 7A may also include an
"mdat" box 730 where the actual raw information for the ISO file
may be stored while being transmitted over a network or stored in
the photographing apparatus 100. The boxes, also known as atoms,
illustrated in FIG. 7A represent quantities of data that may make
up an MPEG 4 file to be stored or transmitted.
[0104] An MPEG 4 video file may include a number of audio and video
streams as described above. Each stream may be stored in a separate
track in a file. A track in a file may represent a timed series of
media, such as successive video frames. Various tracks may include
the atoms, or boxes, as illustrated in FIG. 7B.
[0105] FIG. 7B illustrates the structure of a Moov box 740 or atom
in the ISO file of the MP4 format. The video file of the MP4 format
having such file system may be a video file format suitable to
store a file. The structure of the movie header Moov may include a
movie header "mvhd" which may give basic information about the
content of the video file to be stored or transmitted wirelessly,
such as date of formation and duration. The track header "trak"
stores metadata for each track, that may be used later by a user.
The file may include additional boxes such as "tkhd", another track
header with track reference box "tref", a media box "mdia" to
include media declarations. The mdia box may include another media
header "mdhd," a handler box "hdlr" and media information "minf."
The file to be stored or transmitted may further break down in
either the audio or video track of the Moov box to include a video
media header "vmhd," data information "dinf" with a data reference
"dref", and a sample table "stbl" that includes sample timing,
location information, and structural data. The sample table box
"stbl" is broken down further into a sample table sample
description "stsd" box, a sample table time to sample "stts" box, a
sample table sample to chunk "stsc" box, and a sample table chunk
offset "stco" box."
[0106] The files including the audio and video combined streams may
be transmitted over the intranet and internet using internet
protocols such as Real-time Transport Protocol (RTP) controlled by
the controller 180.
[0107] FIGS. 8A to 8C are views illustrating the structure of a
video file to be broadcast in real-time according to an exemplary
embodiment of the present general inventive concept.
[0108] FIG. 8A illustrates the operation of a video encoder 125, an
audio encoder 115, a file format MUX (that is, the second MUX 150),
and communication unit 170 when real-time broadcasting starts
according to an exemplary embodiment of the present general
inventive concept. As illustrated in FIG. 8A, when real-time
broadcasting starts, video information data and audio information
data are output first from being encoded in the video encoder unit
125 and audio encoder unit 825 to the multiplexer 150. Input data
transfer takes place between the encoders and the multiplexer 150.
The multiplexer 150 combines the audio and video streams output
from the encoders 125 and 115 into a video file that includes an
output data transfer to the communication unit 170. The multiplexer
150 may convert the audio streams into a video file including audio
and video track information, such as the video track 725 and audio
track 727 of the Moov box 720 illustrated in FIG. 7A. Necessary
data and timing information is recorded in the headers and other
boxes of audio and video tracks illustrated in FIG. 7B to be
transmitted from the multiplexer 150 to the communication unit 170
to transmit the audio and video files wirelessly external to the
photographing apparatus 100.
[0109] FIG. 8B illustrates the data structure of a file system
suitable for wireless transmission in real-time, and FIG. 8C
illustrates the structure of Message_T illustrated in FIG. 8B.
[0110] The video file of the second format may be implemented in
the structures of FIGS. 8B and 8C. The video file of the second
format may be applied to any format which allows a file to be
wirelessly transmitted in real-time.
[0111] In this exemplary embodiment of the present general
inventive concept, the photographing apparatus may be any device
which photographs motion pictures, and may be a camcorder, a video
camera, digital camera, cellular telephone, MP3 player, and so on,
which may record moving images.
[0112] According to various exemplary embodiments of the present
general inventive concept, the photographing apparatus to convert
the photographed video into two types of formats, to store the
video, and to transmit the video wirelessly in real-time, and the
method of providing a photographed video thereof are provided.
Therefore, a user can store high quality video photographed or
recorded using the photographing apparatus, as well as broadcasting
the photographed video in real-time.
[0113] Although a few embodiments of the present general inventive
concept have been illustrated and described, it will be appreciated
by those skilled in the art that changes may be made in these
embodiments without departing from the principles and spirit of the
general inventive concept, the scope of which is defined in the
appended claims and their equivalents.
* * * * *