U.S. patent application number 16/889688 was filed with the patent office on 2020-09-17 for transmission device, transmission method, reception device, and reception method.
This patent application is currently assigned to SONY CORPORATION. The applicant listed for this patent is SONY CORPORATION. Invention is credited to Ikuo Tsukagoshi.
Application Number | 20200296322 16/889688 |
Document ID | / |
Family ID | 1000004867045 |
Filed Date | 2020-09-17 |
![](/patent/app/20200296322/US20200296322A1-20200917-D00001.png)
![](/patent/app/20200296322/US20200296322A1-20200917-D00002.png)
![](/patent/app/20200296322/US20200296322A1-20200917-D00003.png)
![](/patent/app/20200296322/US20200296322A1-20200917-D00004.png)
![](/patent/app/20200296322/US20200296322A1-20200917-D00005.png)
![](/patent/app/20200296322/US20200296322A1-20200917-D00006.png)
![](/patent/app/20200296322/US20200296322A1-20200917-D00007.png)
![](/patent/app/20200296322/US20200296322A1-20200917-D00008.png)
![](/patent/app/20200296322/US20200296322A1-20200917-D00009.png)
![](/patent/app/20200296322/US20200296322A1-20200917-D00010.png)
![](/patent/app/20200296322/US20200296322A1-20200917-D00011.png)
View All Diagrams
United States Patent
Application |
20200296322 |
Kind Code |
A1 |
Tsukagoshi; Ikuo |
September 17, 2020 |
TRANSMISSION DEVICE, TRANSMISSION METHOD, RECEPTION DEVICE, AND
RECEPTION METHOD
Abstract
The present technology ensures that electrooptical conversion
processing for transmission video data obtained using an HDR
optoelectrical conversion characteristic is favorably carried out
at a receiving side. The transmission video data is obtained by
performing high dynamic range optoelectrical conversion on high
dynamic range video data. A video stream is obtained by applying
encoding processing to this transmission video data. A container in
a predetermined format including this video stream is transmitted.
Meta information indicating an electrooptical conversion
characteristic corresponding to a high dynamic range optoelectrical
conversion characteristic is inserted into a parameter set field in
the video stream.
Inventors: |
Tsukagoshi; Ikuo; (Tokyo,
JP) |
|
Applicant: |
Name |
City |
State |
Country |
Type |
SONY CORPORATION |
Tokyo |
|
JP |
|
|
Assignee: |
SONY CORPORATION
Tokyo
JP
|
Family ID: |
1000004867045 |
Appl. No.: |
16/889688 |
Filed: |
June 1, 2020 |
Related U.S. Patent Documents
|
|
|
|
|
|
Application
Number |
Filing Date |
Patent Number |
|
|
16827267 |
Mar 23, 2020 |
|
|
|
16889688 |
|
|
|
|
15524441 |
May 4, 2017 |
10609327 |
|
|
PCT/JP2015/085160 |
Dec 16, 2015 |
|
|
|
16827267 |
|
|
|
|
Current U.S.
Class: |
1/1 |
Current CPC
Class: |
H04N 21/84 20130101;
G06T 5/009 20130101; G06T 2207/20208 20130101; H04N 7/005 20130101;
H04N 5/243 20130101; G06T 5/50 20130101; H04N 19/70 20141101; H04N
21/236 20130101; H04N 19/46 20141101; H04L 65/607 20130101; H04N
5/225 20130101; H04N 21/434 20130101 |
International
Class: |
H04N 7/00 20060101
H04N007/00; H04N 19/70 20060101 H04N019/70; H04N 21/236 20060101
H04N021/236; H04N 5/243 20060101 H04N005/243; H04N 5/225 20060101
H04N005/225; H04N 21/84 20060101 H04N021/84; H04N 21/434 20060101
H04N021/434; H04N 19/46 20060101 H04N019/46; G06T 5/00 20060101
G06T005/00; G06T 5/50 20060101 G06T005/50; H04L 29/06 20060101
H04L029/06 |
Foreign Application Data
Date |
Code |
Application Number |
Dec 29, 2014 |
JP |
2014-267034 |
Claims
1. A transmission device comprising: processing circuitry
configured to control a high dynamic range optoelectrical
conversion on high dynamic range video data to obtain transmission
video data, and control a video encoding of the transmission video
data to obtain a video stream; and a transmitter configured to
transmit the video stream, wherein the processing circuitry is
further configured to control an insertion of first meta
information into a parameter set field in the video stream, the
first meta information indicating a type for an electrooptical
conversion corresponding to the high dynamic range optoelectrical
conversion, and control an insertion of second meta information
including peak brightness information into a field different from
the parameter set field in the video stream.
2. The transmission device according to claim 1, wherein the
parameter set field is a field in a sequence parameter set (SPS)
network abstraction layer (NAL) unit.
3. The transmission device according to claim 1, wherein the
processing circuitry is further configured to control generation of
a container including the video stream, and control an insertion of
identification information indicating that the video stream is of a
type supporting a high dynamic range into the container, and the
transmitter is configured to transmit the container.
4. The transmission device according to claim 3, wherein the
container is in a format selected from at least MPEG-2 Transport
Stream, ISOBMFF, or MPEG Media Transport (MMT) stream.
5. The transmission device according to claim 1, wherein the field
different from the parameter set field is a field in a supplemental
enhancement information (SEI) network abstraction layer (NAL)
unit.
6. A reception device comprising: a receiver configured to receive
a video stream obtained by encoding transmission video data, the
transmission video data being obtained by applying a high dynamic
range optoelectrical conversion to high dynamic range data, first
meta information indicating a type for an electrooptical conversion
corresponding to the high dynamic range optoelectrical conversion
being inserted into a parameter set field in the video stream, and
second meta information including peak brightness information being
inserted into a field different from the parameter set field in the
video stream; and processing circuitry configured to control a
video decoding of the video stream to obtain the transmission video
data, control an electrooptical conversion on the transmission
video data to obtain display video data on a basis of the type for
the electrooptical conversion indicated by the first meta
information, and control a display brightness adjustment of the
display video data or the transmission video data on a basis of the
peak brightness information included in the second meta
information.
7. The reception device according to claim 6, wherein the display
brightness adjustment is performed in addition to the
electrooptical conversion, or the display brightness adjustment and
the electrooptical conversion are performed simultaneously.
8. The reception device according to claim 6, wherein the parameter
set field is a field in a sequence parameter set (SPS) network
abstraction layer (NAL) unit.
9. The reception device according to claim 6, wherein the field
different from the parameter set field is a field in a supplemental
enhancement information (SEI) network abstraction layer (NAL)
unit.
10. The reception device according to claim 6, wherein the receiver
is configured to receive a container, identification information
indicating the video stream is of a type supporting a high dynamic
range being inserted into the container, and the processing
circuitry is configured to control extraction of the identification
information from the container.
11. The reception device according to claim 10, wherein the
container is in a format selected from at least MPEG-2 Transport
Stream, ISOBMFF or MPEG Media Transport (MMT) stream.
12. A reception method comprising: receiving a video stream
obtained by encoding transmission video data, the transmission
video data being obtained by applying a high dynamic range
optoelectrical conversion to high dynamic range data, first meta
information indicating a type for an electrooptical conversion
corresponding to the high dynamic range optoelectrical conversion
being inserted into a parameter set field in the video stream, and
second meta information including peak brightness information being
inserted into a field different from the parameter set field in the
video stream; applying a decoding processing to the video stream to
obtain the transmission video data; performing an electrooptical
conversion on the transmission video data to obtain display video
data on a basis of the type for the electrooptical conversion
indicated by the first meta information; and performing a display
brightness adjustment of the display video data or the transmission
video data on a basis of the peak brightness information included
in the second meta information.
13. The reception method according to claim 12, wherein the display
brightness adjustment is performed in addition to the
electrooptical conversion, or the display brightness adjustment and
the electrooptical conversion are performed simultaneously.
14. The reception method according to claim 12, wherein the
parameter set field is a field in a sequence parameter set (SPS)
network abstraction layer (NAL) unit.
15. The reception method according to claim 12, wherein the field
different from the parameter set field is a field in a supplemental
enhancement information (SEI) network abstraction layer (NAL)
unit.
16. The reception method according to claim 12, further comprising:
receiving a container, identification information indicating the
video stream is of a type supporting high dynamic range being
inserted into the container, and controlling extraction of the
identification information from the container.
17. The reception method according to claim 16, wherein the
container is in a format selected from at least MPEG-2 Transport
Stream, ISOBMFF or MPEG Media Transport (MMT) stream.
Description
CROSS-REFERENCE TO RELATED APPLICATIONS
[0001] This application is a continuation of U.S. application Ser.
No. 16/827,267, filed Mar. 23, 2020, which is a continuation of
U.S. application Ser. No. 15/524,441, filed May 4, 2017, which is a
National Stage entry under 35 U.S.C. .sctn. 371 of
PCT/JP2015/085160, filed Dec. 16, 2015 and is based upon and claims
the benefit of priority from prior Japanese Patent Application No.
2014-267034, filed Dec. 29, 2014, the entire contents of each of
which are incorporated herein by reference.
TECHNICAL FIELD
[0002] The present technology relates to a transmission device, a
transmission method, a reception device, and a reception method.
More specifically, the present technology relates to a transmission
device and so on configured to transmit transmission video data
obtained by applying high dynamic range optoelectrical conversion
to high dynamic range video data.
BACKGROUND ART
[0003] Transmitting transmission video data obtained by applying
high dynamic range optoelectrical conversion to high dynamic range
video data has been considered in the past. Hereinafter, the high
dynamic range will be abbreviated as "HDR" as appropriate. For
example, Non-patent Document 1 has mentioned an HDR optoelectrical
conversion characteristic (new gamma characteristic) including a
compatibility field with a conventional optoelectrical conversion
characteristic (gamma characteristic), by taking the reception by a
conventional reception apparatus into account.
CITATION LIST
Non-Patent Document
[0004] Non-patent Document 1: Tim Borer, "Non-Linear
Opto-Electrical Transfer Functions for High Dynamic Range
Television", Research & Development White Paper WHP 283, July
2014
SUMMARY OF THE INVENTION
Problems to be Solved by the Invention
[0005] An object of the present technology is to ensure that
electrooptical conversion processing for transmission video data
obtained using an HDR optoelectrical conversion characteristic is
favorably carried out at a receiving side.
Solutions to Problems
[0006] A concept of the present technology is a transmission device
including:
[0007] an optoelectrical converter that performs high dynamic range
optoelectrical conversion on high dynamic range video data to
obtain transmission video data;
[0008] an encoding unit that applies encoding processing to the
transmission video data to obtain a video stream;
[0009] a transmitter that transmits a container in a predetermined
format including the video stream; and
[0010] an information inserter that inserts meta information
indicating an electrooptical conversion characteristic
corresponding to a characteristic of the high dynamic range
optoelectrical conversion into a parameter set field in the video
stream.
[0011] According to the present technology, the high dynamic range
optoelectrical conversion is performed on the high dynamic range
video data by the optoelectrical converter, whereby the
transmission video data is obtained. The encoding processing is
applied to the transmission video data by the encoding unit,
whereby the video stream is obtained. The container in the
predetermined format including this video stream is transmitted by
the transmitter.
[0012] The meta information indicating the electrooptical
conversion characteristic corresponding to the characteristic of
the high dynamic range optoelectrical conversion is inserted into
the parameter set field in the video stream by the information
inserter. For example, the parameter set field may be a field in an
SPS NAL unit.
[0013] As described above, the present technology is designed to
insert the meta information indicating the electrooptical
conversion characteristic corresponding to the characteristic of
the high dynamic range optoelectrical conversion into the parameter
set field in the video stream. Consequently, electrooptical
conversion processing for the transmission video data obtained
using the HDR optoelectrical conversion characteristic can be
favorably carried out at a receiving side.
[0014] In addition, for example, the present technology may be
configured in such a manner that the information inserter further
inserts, into a layer of the container, identification information
indicating that the video stream supports the high dynamic range.
This identification information allows the receiving side to easily
recognize that the video stream supports the high dynamic range,
whereby it is made possible to extract the meta information
indicating the electrooptical conversion characteristic
corresponding to the characteristic of the high dynamic range
optoelectrical conversion from the parameter set field in the video
stream and perform proper electrooptical conversion on the
transmission video data.
[0015] For example, this case may be configured in such a manner
that information indicating whether the video stream has display
compatibility with a normal dynamic range is added to the
identification information. Alternatively, for example, this case
may be configured in such a manner that information indicating
whether display brightness adjustment for the video stream is
prohibited is added to the identification information.
[0016] Additionally, for example, this case may be configured in
such a manner that the container is a transport stream, and the
information inserter inserts the identification information into a
section belonging to one of a program map table and an event
information table. Furthermore, for example, this case may be
configured in such a manner that the container is an MMT stream,
and the information inserter inserts the identification information
into a section belonging to an MMT package table.
[0017] Meanwhile, for example, the present technology may be
configured in such a manner that the information inserter further
inserts the meta information for display control into a field
different from the parameter set field in the video stream. For
example, this case may be configured in such a manner that the meta
information for display control includes peak brightness
information. Alternatively, for example, this case may be
configured in such a manner that the meta information for display
control includes field information indicating a field where the
display brightness adjustment is allowed. In this case, it is made
possible to properly carry out display control using the meta
information for display control.
[0018] Additionally, for example, this case may be configured in
such a manner that the meta information for display control
includes information indicating whether display brightness
adjustment for the video stream is prohibited. With this,
adjustment exceeding the intent of a creator can be suppressed
regarding the display brightness, or alternatively, eye fatigue of
a viewer can be suppressed.
[0019] Meanwhile, another concept of the present technology is a
reception device including:
[0020] a receiver that receives a container in a predetermined
format including a video stream obtained by encoding transmission
video data;
[0021] a decoding unit that applies decoding processing to the
video stream to obtain the transmission video data; and
[0022] an electrooptical converter that performs electrooptical
conversion on the transmission video data obtained at the decoding
unit to obtain display video data, in which
[0023] the transmission video data is data obtained by applying
high dynamic range optoelectrical conversion to high dynamic range
data, and
[0024] meta information indicating an electrooptical conversion
characteristic corresponding to a characteristic of the high
dynamic range optoelectrical conversion is inserted into a
parameter set field in the video stream,
[0025] the reception device further including an information
extractor that extracts the meta information from the video stream,
in which
[0026] the electrooptical converter uses the electrooptical
conversion characteristic indicated by the meta information
extracted at the information extractor.
[0027] According to the present technology, the container in the
predetermined format including the video stream obtained by
encoding the transmission video data is received by the receiver.
The decoding processing is applied to the video stream by the
decoding unit, whereby the transmission video data is obtained.
Subsequently, the electrooptical conversion is performed on the
transmission video data by the electrooptical converter, whereby
the display video data is obtained.
[0028] The transmission video data is data obtained by applying the
high dynamic range optoelectrical conversion to the high dynamic
range data. The meta information indicating the electrooptical
conversion characteristic corresponding to the characteristic of
the high dynamic range optoelectrical conversion is inserted into
the parameter set field in the video stream. The meta information
is extracted from the video stream by the information extractor. In
the electrooptical converter, the electrooptical conversion
characteristic indicated by this meta information is used to apply
the electrooptical conversion to the transmission video data. For
example, the parameter set field may be a field in an SPS NAL
unit.
[0029] As described above, the present technology is designed to
extract the meta information indicating the electrooptical
conversion characteristic corresponding to the characteristic of
the high dynamic range optoelectrical conversion from the parameter
set field in the video stream such that the electrooptical
conversion characteristic indicated by this meta information is
used to perform the electrooptical conversion on the transmission
video data. Consequently, electrooptical conversion processing for
the transmission video data obtained using the characteristic of
the high dynamic range optoelectrical conversion can be favorably
carried out.
[0030] In addition, for example, the present technology may be
configured in such a manner that identification information
indicating that the video stream supports the high dynamic range is
inserted into a layer of the container, and the information
extractor extracts the meta information from the parameter set
field in the video stream on the basis of the identification
information. In this case, the meta information is correctly
extracted from the parameter set field in the video stream and
accordingly, it is made possible to perform proper electrooptical
conversion on the transmission video data.
[0031] Meanwhile, for example, the present technology may be
configured in such a manner that the meta information for display
control is included in a field different from the parameter set
field in the video stream, and a brightness adjustment unit is
further provided, which adjusts display brightness of the display
video data on the basis of the meta information for display
control. For example, this case may be configured in such a manner
that the meta information for display control includes field
information indicating a field where the display brightness
adjustment is allowed, and the brightness adjustment unit adjusts
the display brightness of the field where the display brightness
adjustment is allowed. In this case, the display brightness can be
properly adjusted.
[0032] Alternatively, for example, this case may be configured in
such a manner that information indicating whether the display
brightness adjustment for the video stream is prohibited is
inserted into a layer of the container and/or a layer of the video
stream, and the brightness adjustment unit does not adjust the
display brightness of the display video data in a case where the
information indicating whether the display brightness adjustment
for the video stream is prohibited indicates the prohibition
thereof. With this, adjustment exceeding the intent of a creator
can be suppressed regarding the display brightness, or
alternatively, eye fatigue of a viewer can be suppressed.
Effects of the Invention
[0033] According to the present technology, the electrooptical
conversion processing for the transmission video data obtained
using the HDR optoelectrical conversion characteristic can be
favorably carried out at the receiving side. Note that the effects
described in the present description merely serve as examples and
not construed to be limited. There may be an additional effect as
well.
BRIEF DESCRIPTION OF DRAWINGS
[0034] FIG. 1 is a block diagram illustrating an exemplary
configuration of a transmission/reception system serving as an
embodiment.
[0035] FIG. 2 is a block diagram illustrating an exemplary
configuration of a transmission device constituting the
transmission/reception system.
[0036] FIG. 3 is a diagram for explaining a characteristic of HDR
optoelectrical conversion.
[0037] FIGS. 4(a) and 4(b) are diagrams for explaining that a
reference level "Reference level" and a threshold level "Threshold
level" can be directly or indirectly specified depending on types
of HDR electrooptical conversion characteristics.
[0038] FIG. 5 is a diagram illustrating a top access unit in a GOP
in a case where an HEVC encoding technique is used.
[0039] FIG. 6 is a diagram illustrating an access unit other than
the top access unit in the GOP in a case where the HEVC encoding
technique is used.
[0040] FIG. 7 is a diagram illustrating an exemplary structure of a
dynamic range SEI message.
[0041] FIG. 8 is a diagram illustrating content of primary
information in the exemplary structure of the dynamic range SEI
message.
[0042] FIG. 9 is a diagram illustrating an exemplary structure of a
high dynamic range descriptor.
[0043] FIG. 10 is a diagram illustrating content of primary
information in the exemplary structure of the high dynamic range
descriptor.
[0044] FIG. 11 is a diagram illustrating an exemplary configuration
of a transport stream.
[0045] FIG. 12 is a block diagram illustrating an exemplary
configuration of a reception device constituting the
transmission/reception system.
[0046] FIG. 13 is a diagram for explaining a characteristic of the
HDR electrooptical conversion, HDR display mapping processing and
so on.
[0047] FIG. 14 is a block diagram illustrating another exemplary
configuration of the transmission/reception system.
[0048] FIG. 15 is a diagram illustrating exemplary structures of a
seventh byte and subsequent bytes in a packet of "Vender Specific
InfoFrame" sent from a set top box to a monitor.
[0049] FIG. 16 is a diagram illustrating content of primary
information in the respective exemplary structures in the packet of
"Vender Specific InfoFrame".
[0050] FIG. 17 is a diagram illustrating an exemplary configuration
of an MMT stream.
MODE FOR CARRYING OUT THE INVENTION
[0051] Modes for carrying out the invention (hereinafter, referred
to as "embodiments") will be described below. Note that the
description will be given in the following order.
[0052] 1. Embodiment
[0053] 2. Variation
1. EMBODIMENT
[0054] [Exemplary Configuration of Transmission/Reception
System]
[0055] FIG. 1 illustrates an exemplary configuration of a
transmission/reception system 10 serving as an embodiment. This
transmission/reception system 10 is constituted by a transmission
device 100 and a reception device 200.
[0056] The transmission device 100 generates a transport stream TS
in MPEG2 as a container and incorporates this transport stream TS
into a broadcasting wave or a packet in a network to transmit. This
transport stream TS includes a video stream obtained by applying
encoding processing to a transmission video data obtained by
performing HDR optoelectrical conversion on HDR video data.
[0057] Meta information indicating an electrooptical conversion
characteristic corresponding to an HDR optoelectrical conversion
characteristic is inserted into a parameter set field in the video
stream. In addition, identification information indicating that the
video stream supports HDR is inserted into a layer of the
container. This identification information includes information
indicating whether the video stream has display compatibility with
a normal dynamic range, information indicating whether display
brightness adjustment for the video stream is prohibited and so on.
Hereinafter, the normal dynamic range will be abbreviated as "LDR"
as appropriate.
[0058] Meanwhile, information for display control is inserted into
a field different from the parameter set field in the video stream.
This meta information for display control includes peak brightness
information, field information indicating a field where the display
brightness adjustment is allowed, information indicating whether
the display brightness adjustment for the video stream is
prohibited and so on.
[0059] The reception device 200 applies decoding processing to the
video stream included in the received container to obtain the
transmission video data. The reception device 200 performs
optoelectrical conversion on the transmission video data on the
basis of a transmission conversion characteristic indicated by the
meta information inserted into the parameter set field in the video
stream, thereby obtaining display video data. In this case, the
reception device 200 extracts the meta information inserted into
the parameter set field in the video stream, on the basis of the
identification information inserted into the layer of the container
to indicate that the video stream supports the high dynamic
range.
[0060] The reception device 200 also carries out display mapping
processing on the display video data, namely, adjusts the display
brightness thereof on the basis of the information for display
control inserted into the parameter set field in the video stream.
In a case where information inserted into the layer of the
container and/or a layer of the video stream to indicate whether
the display brightness adjustment is prohibited indicates the
prohibition thereof, this display brightness adjustment is not
carried out.
[0061] [Exemplary Configuration of Transmission Device]
[0062] FIG. 2 illustrates an exemplary configuration of the
transmission device 100. This transmission device 100 has a control
unit 101, an HDR camera 102, an HDR optoelectrical converter 103, a
video encoder 104, a system encoder 105, and a transmitter 106. The
control unit 101 includes a central processing unit (CPU) in the
configuration thereof and controls actions of respective members in
the transmission device 100 on the basis of a control program.
[0063] The HDR camera 102 images an object and outputs high dynamic
range (HDR) video data. This HDR video data has a contrast ratio
exceeding the brightness of a white peak of a conventional SDR
image, specifically, 0 to 100%*N (where N is a numeral larger than
one) such as 0 to 1000%. For example, a level of 100% here
equivalents to a white brightness value of 100 cd/m.sup.2.
[0064] A master monitor 103a is a monitor used to carry out grading
on the HDR video data obtained at the HDR camera 102. This master
monitor 103a has a display brightness level supporting the HDR
video data or suitable for the grading of the HDR video data.
[0065] The HDR optoelectrical converter 103 applies the HDR
optoelectrical conversion characteristic to the HDR video data
obtained at the HDR camera 102 to obtain transmission video data
V1. Both of a solid line a and a dashed line b in FIG. 3 represent
examples of HDR OETF curves indicating the HDR optoelectrical
conversion characteristics. Meanwhile, a dashed line c in FIG. 3 is
an SDR OETF curve indicating an SDR optoelectrical conversion
characteristic. In FIG. 3, a lateral axis represents an input
brightness level, whereas a longitudinal axis represents a
transmission code value.
[0066] The HDR optoelectrical conversion characteristic can be
configured so as to include a compatibility field with the SDR
optoelectrical conversion characteristic, as in the HDR
optoelectrical conversion characteristics indicated by the
aforementioned solid line a and dashed line b in FIG. 3. In other
words, the curved lines of both of the characteristics match with
each other until the input brightness level reaches a compatibility
limit value for both of the characteristics. At a point where the
input brightness level reaches the compatibility limit value, the
transmission code value is obtained as a compatibility level SP.
According to the HDR optoelectrical conversion characteristic, at a
point where the input brightness level reaches peak brightness PL,
the transmission code value is obtained as a peak level MP.
[0067] An HDR display reference threshold CL represents an boundary
between afield where matching brightness is required and a field
where the dependency on the CE monitor is allowed as brightness
used for display on a monitor of a reception apparatus (CE
monitor). At a point where the input brightness level reaches the
HDR display reference threshold CL, the transmission code value is
obtained as a threshold level CP in, for example, the HDR OETF
curve by the solid line a in FIG. 3. Meanwhile, according to the
SDR optoelectrical conversion characteristic, at a point where the
input brightness level reaches SDR characteristic expression limit
brightness SL, the transmission code value is obtained as the peak
level MP. SL here is assigned to 100 cd/m.sup.2. Note that the HDR
display reference threshold CL can be also configured to match the
compatibility limit value and, in this case, the threshold level CP
can be substituted by the compatibility level SP.
[0068] Referring back to FIG. 2, the video encoder 104 applies the
encoding such as MPEG4-AVC or HEVC to the transmission video data
V1 to obtain encoded video data. This video encoder 104 also uses a
stream formatter (not illustrated) included therein in a latter
stage to generate the video stream including this encoded video
data (video elementary stream).
[0069] At this time, the video encoder 104 inserts the meta
information indicating an HDR electrooptical conversion
characteristic corresponding to the HDR optoelectrical conversion
characteristic into the parameter set field in the video stream.
The video encoder 104 according to this embodiment inserts meta
information "Transfer characteristics" into a field for video
usability information (VUI) in an SPS NAL unit in an access unit
(AU).
[0070] This meta information "Transfer characteristics" specifies
the HDR electrooptical conversion characteristic. Specifically, the
above-mentioned "Transfer characteristics" represents "New Type" as
a type of the HDR electrooptical conversion characteristic. In this
case, a reference level "Reference level" and a threshold level
"Threshold level" can be directly or indirectly specified. The
reference level "Reference level" here is assigned to, for example,
100% equivalent to a white brightness value of 100 cd/m.sup.2.
Meanwhile, the threshold level "Threshold level" represents an
boundary between a field where matching brightness is required and
a field where the dependency on the CE monitor is allowed as
brightness used for display on the monitor of the reception
apparatus (CE monitor).
[0071] In the case of the direct specification, "Reference level"
and "Threshold level" are assumed to be defined as identification
values in the VUI, as illustrated in FIG. 4(a). This case indicates
that respective elements are mentioned in semantics rules for the
VUI to be referenced. Note that "Reference level" and "Threshold
level" do not necessarily need to be separately determined but one
of the levels can be determined by setting "Reference
level"="Threshold level".
[0072] In the case of the indirect specification, "Reference level"
and "Threshold level" are not assumed to be defined as the
identification values in the VUI, as illustrated in FIG. 4 (b). In
this case, respective elements are not mentioned in the semantics
rules for the VUI. This case indicates that
Reference level=Lr(Lx>Lr>Lc)
Threshold level=Lt(Ly>Lt>Lr)
[0073] are determined in a standard defining "Transfer
characteristics" specified in the VUI as characteristics of "New
Type". Note that "Reference level" and "Threshold level" do not
necessarily need to be separately determined but one of the levels
can be determined by setting "Reference level"="Threshold
level".
[0074] Additionally, the video encoder 104 inserts the meta
information for display control into a field other than the
parameter set field in the video stream. The video encoder 104
according to this embodiment inserts a dynamic range SEI message
(Dynamic Range SEI message) to be newly defined into a section of
"SEIs" in the access unit (AU).
[0075] FIG. 5 illustrates a top access unit in a group of pictures
(GOP) in a case where an HEVC encoding technique is used.
Meanwhile, FIG. 6 illustrates an access unit other than the top
access unit in the GOP in a case where the HEVC encoding technique
is used. In the case of the HEVC encoding technique, an SEI message
group "Prefix SEIs" for decoding is arranged before slices (Slices)
in which pixel data is encoded, whereas an SEI message group
"Suffix SEIs" for display is arranged after the above-mentioned
slices (Slices). As illustrated in FIGS. 5 and 6, the dynamic range
SEI message may be configured to be arranged as the SEI message
group "Suffix SEIs".
[0076] FIG. 7 illustrates an exemplary structure (Syntax) of the
dynamic range SEI message. FIG. 8 illustrates content of primary
information (Semantics) in the above exemplary structure. An
eight-bit field of "transfer characteristics" specifies the HDR
electrooptical conversion characteristic. Specifically, this field
represents "New Type" as a type of the HDR electrooptical
conversion characteristic.
[0077] An eight-bit field of "number of bits" represents the number
of encoded pixel bits. A sixteen-bit field of "minimum brightness
value" represents a minimum level of the brightness (cd/m.sup.2). A
sixteen-bit field of "peak level" represents a relative value (%)
at a maximum level. A sixteen-bit field of "peak_level_brightness"
represents a maximum level of the brightness (cd/m.sup.2) and
corresponds to the peak brightness PL in FIG. 3.
[0078] A sixteen-bit field of "compliant_threshold_level"
represents a threshold (%) during display level mapping. A
sixteen-bit field of "compliant_threshold_level_value" represents
the brightness (cd/m.sup.2) functioning as the threshold during the
display level mapping and corresponds to the HDR display reference
threshold CL in FIG. 3. Note that threshold information constituted
by "Compliant_threshold_level" and
"Compliant_threshold_level_value" can be sent as 100% indicating
reference brightness and the reference brightness, respectively. A
flag of "mapping_protection_flag" indicates whether display mapping
(display brightness adjustment) after decoding is prohibited. "1"
indicates that the display mapping is prohibited. "0" indicates
that the display mapping is not prohibited.
[0079] Referring back to FIG. 2, the system encoder 105 generates
the transport stream TS including the video stream VS generated at
the video encoder 104. Subsequently, the transmitter 106
incorporates this transport stream TS into a broadcasting wave or a
packet in a network to transmit to the reception device 200.
[0080] At this time, the system encoder 105 inserts, into the layer
of the transport stream (container), the identification information
indicating that the video stream supports the high dynamic range.
The system encoder 105 according to this embodiment inserts a high
dynamic range descriptor (High Dynamic Range descriptor) into a
section belonging to a program map table (PMT) or a section
belonging to an event information table (EIT).
[0081] FIG. 9 illustrates an exemplary structure (Syntax) of the
high dynamic range descriptor. FIG. 10 illustrates content of
primary information (Semantics) in the above exemplary structure.
An eight-bit field of "descriptor_tag" represents a descriptor type
and here indicates that the high dynamic range descriptor is used.
An eight-bit field of "descriptor_length" represents a length
(size) of the descriptor and indicates the number of subsequent
bytes as the length of the descriptor.
[0082] A flag of "HDR_flag" indicates whether a service stream
(video stream) is of a type supporting the HDR. "1" indicates that
the video stream supports the HDR and additionally indicates
whether the VUI has the HDR characteristic, or the VUI is
conventional but the SEI provides HDR information, or the VUI has
the HDR characteristic and also the SEI has the HDR information.
"0" indicates that the video stream does not support the HDR.
[0083] A flag of "SDR_compatible_flag" indicates whether the
service stream (video stream) has the display compatibility with
the SDR in a case where the service stream (video stream) supports
the HDR. "1" indicates that the service stream (video stream) has
the display compatibility with the SDR. "0" indicates that the
service stream (video stream) does not have the display
compatibility with the SDR. A flag of "mapping_protection flag"
indicates whether the display mapping (display brightness
adjustment) is prohibited in the service stream (video stream). "1"
indicates that the display mapping is prohibited. "0" indicates
that the display mapping is not prohibited.
[0084] An action of the transmission device 100 illustrated in FIG.
2 will be briefly described. The HDR video data obtained through
imaging by the HDR camera 102 is supplied to the HDR optoelectrical
converter 103. The HDR video data obtained at the HDR camera 102 is
subjected to the grading using the master monitor 103a. In this HDR
optoelectrical converter 103, the HDR optoelectrical conversion
characteristic (HDR OETF curve) is applied to this HDR video data
while the optoelectrical conversion is performed such that the
transmission video data V1 is obtained. This transmission video
data V1 is supplied to the video encoder 104.
[0085] In the video encoder 104, the encoding such as MPEG4-AVC or
HEVC is applied to the transmission video data V1 such that the
encoded video data is obtained. In addition, in this video encoder
104, the video stream including this encoded video data is
generated by the stream formatter included therein in a latter
stage.
[0086] At this time, in the video encoder 104, the meta information
indicating the HDR electrooptical conversion characteristic
corresponding to the HDR optoelectrical conversion characteristic
is inserted into the layer of the video stream. Specifically, in
the video encoder 104, the meta information "Transfer
characteristics" is inserted into a field for the video usability
information (VUI) in the SPS NAL unit in the access unit (AU).
[0087] Additionally, in the video encoder 104, the meta information
for display control is inserted into the layer of the video stream.
Specifically, in the video encoder 104, the high dynamic range SEI
message to be newly defined is inserted into a section of "SEIs" in
the access unit (AU).
[0088] The video stream VS generated at the video encoder 104 is
supplied to the system encoder 105. In this system encoder 105, the
transport streamTS in MPEG2 including the video stream is
generated. This transport stream TS is incorporated into the
broadcasting wave or a packet in a network by the transmitter 106
to be transmitted to the reception device 200.
[0089] At this time, in the system encoder 105, the identification
information indicating that the video stream supports the high
dynamic range is inserted into the layer of the transport stream
(container). Specifically, in the system encoder 105, the high
dynamic range descriptor (High Dynamic Range descriptor) is
inserted into a section belonging to the program map table (PMT) or
a section belonging to the event information table (EIT).
[0090] [Configuration of Transport Stream TS]
[0091] FIG. 11 illustrates an exemplary configuration of the
transport stream TS. According to this exemplary configuration,
there is a PES packet "video PEST" for the video stream identified
by PID1. The meta information "Transfer characteristics" specifying
the HDR electrooptical conversion characteristic is inserted into a
field for the VUI in the SPS in the access unit. Meanwhile, the
dynamic range SEI message in which the peak level "Peak level", the
threshold level "Threshold level", a mapping protection flag
"mapping_protection_flag" and so on are stated is inserted into the
access unit.
[0092] Additionally, the program map table (PMT) is included in the
transport stream TS as program specific information (PSI). The PSI
is information mentioning which program is the one to which each of
the elementary streams included in the transport stream belongs.
The PMT has a program loop stating information relating to the
whole program.
[0093] The PMT has an elementary stream loop having information
relating to each of the elementary streams. According to this
exemplary configuration, there is a video elementary stream loop
(Video ES loop) corresponding to the video stream. Information such
as a stream type and a packet identifier (PID) is arranged in the
video elementary stream loop (Video ES loop) so as to correspond to
the video stream and at the same time, the descriptor stating
information relating to this video stream is also arranged
therein.
[0094] The value of "Stream_type" for this video stream is set to,
for example, a value indicating an HEVC video stream, whereas the
PID information is configured so as to indicate PID1 given to a PES
packet "video PES" in the video stream. The high dynamic range
descriptor in which an HDR_flag "HDR_flag", an SDR compatible flag
"SDR_compatible_flag", the mapping protection flag
"mapping_protection_flag" and so on are stated is inserted as one
of the descriptors.
[0095] Additionally, the event information table (EIT) serving as
service information (SI) managing each of events (video programs)
is included in the transport stream TS. Inserting the high dynamic
range descriptor into a section belonging to this EIT is also
acceptable.
[0096] [Exemplary Configuration of Reception Device]
[0097] FIG. 12 illustrates an exemplary configuration of the
reception device 200. This reception device 200 has a control unit
201, a receiver 202, a system decoder 203, a video decoder 204, an
HDR electrooptical converter 205, an HDR display mapping unit 206,
and a CE monitor 207. The control unit 201 includes a central
processing unit (CPU) in the configuration thereof and controls
actions of respective members in the reception device 200 on the
basis of a control program.
[0098] The receiver 202 receives the transport stream TS sent from
the transmission device 100 by being incorporated into the
broadcasting wave or a packet in a network. The system decoder 203
extracts the video stream (elementary stream) VS from this
transport stream TS. The system decoder 203 also extracts various
items of information inserted into the layer of the container
(transport stream) to send to the control unit 201.
[0099] In the embodiment, this extracted information includes the
information in the high dynamic range descriptor (refer to FIG. 9)
as well. The control unit 201 recognizes that the video stream
supports the HDR, while also recognizing that the SEI (dynamic
range SEI) should be referenced during the HDR display, since the
"HDR flag" in the high dynamic range descriptor is assigned to
"1".
[0100] The video decoder 204 carries out decoding processing on the
video stream VS extracted at the system decoder 203 to output the
transmission video data V1. The video decoder 204 also extracts the
parameter set and the SEI message inserted into each of the access
units constituting the video stream VS to send to the control unit
201.
[0101] According to the embodiment, as described above, the control
unit 201 recognizes that the video stream supports the HDR, while
also recognizing that the SEI should be referenced during the HDR
display. Accordingly, the meta information "Transfer
characteristics" specifying the HDR electrooptical conversion
characteristic, which is inserted into a field for the VUI in the
SPS NAL unit, as well as the dynamic range SEI message (refer to
FIG. 7) are correctly extracted.
[0102] The control unit 201 sets the HDR electrooptical converter
205 with the HDR electrooptical conversion characteristic specified
by the meta information "Transfer characteristics", namely, the HDR
electrooptical conversion characteristic corresponding to the HDR
optoelectrical conversion characteristic used at a transmitting
side. The HDR electrooptical converter 205 applies the set HDR
electrooptical conversion characteristic to the transmission video
data V1 output from the video decoder 204 to obtain the display
video data for displaying an HDR image.
[0103] A solid line a in FIG. 13 represents an HDR EOTF curve (Type
A) indicating the HDR electrooptical conversion characteristic.
This HDR EOTF curve (Type A) corresponds to the HDR OETF curve
indicated by the solid line a in FIG. 3. Meanwhile, a dashed line b
in FIG. 13 represents an HDR EOTF curve (Type B) indicating another
HDR electrooptical conversion characteristic. This HDR EOTF curve
(Type B) corresponds to the HDR OETF curve indicated by the dashed
line b in FIG. 3. In addition, a dashed line c in FIG. 13
represents an SDR EOTF curve (Type C) corresponding to the SDR OETF
curve indicated by the dashed line c in FIG. 3.
[0104] According to the HDR electrooptical conversion
characteristic, at a point where the transmission code value
reaches the peak level MP, the display brightness level is obtained
as PL. Meanwhile, at a point where the transmission code value
reaches the threshold level CP, an output brightness level is
obtained as the HDR display reference threshold CL. Additionally,
in FIG. 13, in the case of the HDR EOTF curve (Type A), brightness
mapping such as one indicated by a two-dot chain line a' is
performed at a display side until reaching the display brightness
level EP as long as the threshold level CP and the HDR display
reference threshold CL are provided and mapping protection is not
enabled. Compared to this, in the case of the HDR EOTF curve (Type
B), brightness mapping such as one indicated by a one-dot chain
line b' is performed at a display side until reaching the display
brightness level EP as long as the compatibility level SP and the
reference level defined therefor are detected and the mapping
protection is not enabled. Note that, as described earlier, the
threshold CL represents an boundary between a field where matching
brightness is required and a field where the dependency on the CE
monitor is allowed as brightness used for display on the monitor of
the reception apparatus (CE monitor).
[0105] Brightness information on PL and CL is included in the
dynamic range SEI message inserted into the layer of the video
stream as the meta information for display control (refer to FIG.
7). The HDR display mapping unit 206 adjusts the display brightness
of the display video data obtained at the HDR electrooptical
converter 205 on the basis of the meta information for display
control. Specifically, in a case where the CE monitor 207 has
maximum brightness display capability equal to EP higher than PL,
it is also made possible for the HDR display mapping unit 206 to
carry out, as one approach for a display function, the display
mapping processing, namely, the display brightness adjustment
processing such that a maximum display brightness level is shifted
to EP for levels exceeding the brightness at CL from among the
output brightness levels of the HDR electrooptical converter 205.
The two-dot chain line a' in FIG. 13 represents an example of the
display brightness adjustment processing in this case.
[0106] In addition, the HDR display mapping unit 206 does not carry
out the display brightness adjustment processing on the basis of
the control of the control unit 201 in a case where
"mapping_protection_flag" in the high dynamic range descriptor and
the dynamic range SEI message is assigned to "1" to indicate that
the display mapping is prohibited. With this, adjustment exceeding
the intent of a creator is suppressed regarding the display
brightness, or alternatively, eye fatigue of a viewer is
suppressed.
[0107] An action of the reception device 200 illustrated in FIG. 12
will be briefly described. In the receiver 202, the transport
stream TS sent from the transmission device 100 by being
incorporated into the broadcasting wave or a packet in a network is
received. This transport stream TS is supplied to the system
decoder 203. In the system decoder 203, the video stream VS is
extracted from this transport stream TS.
[0108] Additionally, in the system decoder 203, various items of
information inserted into the layer of the container are extracted
to be sent to the control unit 201. This extracted information
includes the information in the high dynamic range descriptor
(refer to FIG. 9) as well. In the control unit 201, a fact that the
video stream supports the HDR is recognized on the basis of the
"HDR flag" in the high dynamic range descriptor being assigned to
"1", while a fact that the SEI should be referenced during the HDR
display is also recognized similarly.
[0109] The video stream VS extracted at the system decoder 203 is
supplied to the video decoder 204. In the video decoder 204, the
decoding processing is applied to the video stream VS extracted at
the system decoder 203, whereby the transmission video data V1 is
obtained.
[0110] In addition, in the video decoder 204, the parameter set and
the SEI message inserted into each of the access units constituting
the video stream VS are extracted to be sent to the control unit
201. As described above, in the control unit 201, a fact that the
video stream supports the HDR is recognized, while a fact that the
SEI should be referenced during the HDR display is also recognized.
Accordingly, the meta information "Transfer characteristics"
specifying the HDR electrooptical conversion characteristic, which
is inserted into a field for the VUI in the SPS NAL unit, as well
as the dynamic range SEI message (refer to FIG. 7) are
extracted.
[0111] Under the control of the control unit 201, the HDR
electrooptical converter 205 is set with the HDR electrooptical
conversion characteristic specified by the meta information
"Transfer characteristics", namely, the HDR electrooptical
conversion characteristic corresponding to the HDR optoelectrical
conversion characteristic used at the transmitting side. In the HDR
electrooptical converter 205, the set HDR electrooptical conversion
characteristic is applied to the transmission video data V1 output
from the video decoder 204, whereby the display video data for
displaying the HDR image is obtained.
[0112] The display video data obtained at the HDR electrooptical
converter 205 is supplied to the HDR display mapping unit 206. In
the HDR display mapping unit 206, the display brightness of the
display video data is adjusted on the basis of the meta information
for display control. Specifically, in a case where the CE monitor
207 has the maximum brightness display capability equal to EP
higher than PL, the display mapping processing, namely, brightness
conversion processing is carried out in the HDR display mapping
unit 206 such that the maximum display brightness level is shifted
to EP for levels exceeding the brightness at CL from among the
output brightness levels of the HDR electrooptical converter 205
(refer to the two-dot chain line a' in FIG. 13). Alternatively, the
display mapping processing, namely, the brightness conversion
processing is carried out for levels exceeding the reference
brightness level such that the maximum display brightness level is
shifted to EP (refer to the one-dot chain line b' in FIG. 13).
[0113] In addition, the display brightness adjustment processing is
not carried out in the HDR display mapping unit 206 in a case where
"mapping_protection_flag" in the high dynamic range descriptor and
the dynamic range SEI message is assigned to "1" to indicate that
the display mapping is prohibited. Accordingly, the display video
data obtained at the HDR electrooptical converter 205 is output as
it is.
[0114] The output video data from the display mapping unit 206 is
supplied to the CE monitor 207. The HDR image is displayed on this
CE monitor 207.
[0115] As described thus far, in the transmission/reception system
10 illustrated in FIG. 1, the meta information "Transfer
characteristics" specifying the electrooptical conversion
characteristic corresponding to the high dynamic range
optoelectrical conversion characteristic is inserted into a field
for the VUI in the SPS NAL unit in the video stream. Consequently,
the electrooptical conversion processing for the transmission video
data obtained using the HDR optoelectrical conversion
characteristic can be favorably carried out at the receiving side
when the HDR electrooptical conversion characteristic specified by
the meta information "Transfer characteristics" is used
therefor.
[0116] Additionally, in the transmission/reception system 10
illustrated in FIG. 1, the high dynamic range descriptor (High
Dynamic Range descriptor) is inserted into the layer of the
container (transport stream). This descriptor includes "HDR_flag"
indicating whether the service stream (video stream) is of a type
supporting the HDR. This allows the receiving side to easily
recognize that the video stream supports the high dynamic range,
whereby it is made possible to correctly extract the meta
information "Transfer characteristics" indicating the
electrooptical conversion characteristic corresponding to the high
dynamic range optoelectrical conversion characteristic from the
parameter set field in the video stream and perform proper
electrooptical conversion on the transmission video data.
[0117] Meanwhile, in the transmission/reception system 10
illustrated in FIG. 1, the dynamic range SEI message (Dynamic Range
SEI message) is inserted into the layer of the video stream. This
SEI message includes the meta information for display control.
Consequently, the display brightness control can be properly
carried out at the receiving side using this meta information for
display control. In this case, the meta information for display
control includes the field information indicating a field where the
display brightness adjustment is allowed such that the brightness
conversion in accordance with, for example, the display brightness
capability of the CE monitor 207 is performed only for the field
where the brightness conversion is allowed. As a consequence, it is
made possible to favorably reproduce a brightness atmosphere
intended by the creator.
[0118] Furthermore, in the transmission/reception system 10
illustrated in FIG. 1, the high dynamic range descriptor and the
dynamic range SEI message include the flag of "mapping_protection
flag" indicating whether the display mapping (display brightness
adjustment) is prohibited in the service stream (video stream).
Consequently, adjustment exceeding the intent of the creator can be
suppressed regarding the display brightness, or alternatively, eye
fatigue of a viewer can be suppressed.
2. VARIATION
[0119] Note that the above embodiment has indicated an example
where, in the reception device 200, the HDR electrooptical
converter 205 carries out the electrooptical conversion processing
and additionally, the HDR display mapping unit 206 carries out the
brightness conversion processing in accordance with the maximum
brightness display capability of the CE monitor 207. However, by
reflecting a brightness conversion characteristic in the
electrooptical conversion characteristic (EOTF) in advance, the
electrooptical conversion processing and the brightness conversion
processing can be simultaneously carried out by the HDR
electrooptical converter 205 alone.
[0120] In addition, the above embodiment has indicated the
transmission/reception system 10 constituted by the transmission
device 100 and the reception device 200. However, the configuration
of the transmission/reception system to which the present
technology can be applied is not limited thereto. For example, as
in a transmission/reception system 10A illustrated in FIG. 14, a
section of the reception device 200 may be substituted by a
configuration including a set top box (STB) 200A and a monitor 200B
interconnected through a digital interface such as a
High-Definition Multimedia Interface (HDMI). Note that "HDMI" is a
registered trademark.
[0121] In this case, for example, the video decoder 204 and its
preceding members are included in the set top box 200A and the
electrooptical converter 205 and its subsequent members are
included in the monitor 200B. The set top box 200A uses, for
example, a packet of "Vender Specific InfoFrame" to send the meta
information indicating the HDR optoelectrical conversion
characteristic, the meta information for display control and so on
to the monitor 200B.
[0122] FIG. 15 illustrates exemplary structures of a seventh byte
and subsequent bytes in the packet of "Vender Specific InfoFrame"
sent from the set top box 200A to the monitor 200B. Meanwhile, FIG.
16 illustrates content of primary information in the respective
exemplary structures.
[0123] Three-bit information of "Display_control_type" is arranged
from a seventh bit to a fifth bit in the seventh byte. This
three-bit information represents a classification of a display
type. "001" indicates SD display control, whereas "010" indicates
HDR display control. "010" is employed here.
[0124] The flag of "mapping_protection_flag" is arranged in a
fourth bit in the seventh byte. This flag indicates whether the
display mapping (display brightness adjustment) after decoding is
prohibited. "1" indicates that the display mapping is prohibited.
"0" indicates that the display mapping is not prohibited. Four-bit
information of "Display_control_metadata_length" is arranged from a
third bit to a zeroth bit in the seventh byte. This four-bit
information represents the size of "Display_control_metadata"
arranged at the following place, in number of bytes. "12" is
employed here.
[0125] Eight-bit information of "Transfer characteristics" is
arranged in an eighth byte. This eight-bit information specifies
the HDR electrooptical conversion characteristic. The
electrooptical conversion characteristic for display is detected
through this information. "0x10" is employed here. Eight-bit
information of "Number of bits" is arranged in an 8+1st byte. This
eight-bit information represents the number of encoded pixel
bits.
[0126] Sixteen-bit information of "Minimum brightness value" is
arranged in an 8+2nd byte and an 8+3rd byte. This sixteen-bit
information represents a minimum level of the brightness
(cd/m.sup.2). Sixteen-bit information of "Peak Level" is arranged
in an 8+4th byte and an 8+5th byte. This sixteen-bit information
represents a relative value (%) at a maximum level.
[0127] Sixteen-bit information of "Peak Level Brightness" is
arranged in an 8+6th byte and an 8+7th byte. This sixteen-bit
information represents a maximum level of the brightness
(cd/m.sup.2). Sixteen-bit information of
"Compliant_threshold_level" is arranged in an 8+8th byte and an
8+9th byte. This sixteen-bit information represents a threshold (%)
during the display level mapping. Sixteen-bit information of
"Compliant_threshold_level_value" is arranged in an 8+10th byte and
an 8+11th byte. This sixteen-bit information represents the
brightness (cd/m.sup.2) functioning as the threshold during the
display level mapping. Note that threshold information constituted
by "Compliant_threshold_level" and
"Compliant_threshold_level_value" can be sent as 100% indicating
reference brightness and the reference brightness, respectively. In
addition, the above-mentioned information transmission from the set
top box 200A to the monitor 200B is not limited to a case using the
packet of "Vender Specific InfoFrame" and it is apparent that
defining another packet of InfoFrame enables the transmission
similarly.
[0128] Furthermore, the above embodiment has indicated an example
where the transport stream (MPEG-2 TS) serves as the container.
However, the transport according to the present technology is not
limited to TS and, also in the case of another packet such as
ISOBMFF or MMT, the video layers can be implemented using the same
method.
[0129] FIG. 17 illustrates an MMT structure. An MMT stream has an
MMT packet for each of assets such as video and audio. According to
the illustrated example, the MMT packet identified by ID1 is
provided as the video asset. The meta information "Transfer
characteristics" specifying the HDR electrooptical conversion
characteristic is inserted into a field for the VUI in the SPS in
the access unit. Meanwhile, the dynamic range SEI message in which
the peak level "Peak level", the threshold level "Threshold level",
a mapping protection flag "mapping_protection_flag" and so on are
stated is inserted into the access unit.
[0130] In addition, the MMT stream has a message packet such as a
packet access (PA) message packet. The PA message packet includes
tables such as an MP table (MMT Package Table). The MP table
includes information on each of the assets. Here, the high dynamic
range descriptor in which the HDR flag "HDR_flag", the SDR
compatible flag "SDR_compatible_flag", the mapping protection flag
"mapping_protection_flag" and so on are stated is inserted in
association with the video asset.
[0131] Note that the present technology can be also configured as
described below.
[0132] (1) A transmission device including:
[0133] an optoelectrical converter that performs high dynamic range
optoelectrical conversion on high dynamic range video data to
obtain transmission video data;
[0134] an encoding unit that applies encoding processing to the
transmission video data to obtain a video stream;
[0135] a transmitter that transmits a container in a predetermined
format including the video stream; and
[0136] an information inserter that inserts meta information
indicating an electrooptical conversion characteristic
corresponding to a characteristic of the high dynamic range
optoelectrical conversion into a parameter set field in the video
stream.
[0137] (2) The transmission device according to the aforementioned
(1), in which
[0138] the parameter set field is a field in an SPS NAL unit.
[0139] (3) The transmission device according to the aforementioned
(1) or (2), in which
[0140] the information inserter further inserts, into a layer of
the container, identification information indicating that the video
stream supports the high dynamic range.
[0141] (4) The transmission device according to the aforementioned
(3), in which
[0142] information indicating whether the video stream has display
compatibility with a normal dynamic range is added to the
identification information.
[0143] (5) The transmission device according to the aforementioned
(3) or (4), in which
[0144] information indicating whether display brightness adjustment
for the video stream is prohibited is added to the identification
information.
[0145] (6) The transmission device according to any one of the
aforementioned (3) to (5), in which
[0146] the container is a transport stream, and
[0147] the information inserter inserts the identification
information into a section belonging to one of a program map table
and an event information table.
[0148] (7) The transmission device according to any one of the
aforementioned (3) to (5), in which
[0149] the container is an MMT stream, and
[0150] the information inserter inserts the identification
information into a section belonging to an MMT package table.
[0151] (8) The transmission device according to any one of the
aforementioned (1) to (7), in which
[0152] the information inserter further inserts the meta
information for display control into a field different from the
parameter set field in the video stream.
[0153] (9) The transmission device according to the aforementioned
(8), in which
[0154] the meta information for display control includes peak
brightness information.
[0155] (10) The transmission device according to the aforementioned
(8) or (9), in which
[0156] the meta information for display control includes field
information indicating a field where the display brightness
adjustment is allowed.
[0157] (11) The transmission device according to any one of the
aforementioned (8) to (10), in which
[0158] the meta information for display control includes
information indicating whether display brightness adjustment for
the video stream is prohibited.
[0159] (12) The transmission device according to any one of the
aforementioned (8) to (11), in which
[0160] the field different from the parameter set field is a field
in an SEI NAL unit.
[0161] (13) A transmission method including:
[0162] an optoelectrical conversion step of performing high dynamic
range optoelectrical conversion on high dynamic range video data to
obtain transmission video data;
[0163] an encoding step of applying encoding processing to the
transmission video data to obtain a video stream;
[0164] a transmission step of transmitting a container in a
predetermined format including the video stream through a
transmitter; and
[0165] an information insertion step of inserting meta information
indicating an electrooptical conversion characteristic
corresponding to a characteristic of the high dynamic range
optoelectrical conversion into a parameter set field in the video
stream.
[0166] (14) A reception device including:
[0167] a receiver that receives a container in a predetermined
format including a video stream obtained by encoding transmission
video data;
[0168] a decoding unit that applies decoding processing to the
video stream to obtain the transmission video data; and
[0169] an electrooptical converter that performs electrooptical
conversion on the transmission video data obtained at the decoding
unit to obtain display video data, in which
[0170] the transmission video data is data obtained by applying
high dynamic range optoelectrical conversion to high dynamic range
data, and
[0171] meta information indicating an electrooptical conversion
characteristic corresponding to a characteristic of the high
dynamic range optoelectrical conversion is inserted into a
parameter set field in the video stream,
[0172] the reception device further including an information
extractor that extracts the meta information from the video stream,
in which
[0173] the electrooptical converter uses the electrooptical
conversion characteristic indicated by the meta information
extracted at the information extractor.
[0174] (15) The reception device according to the aforementioned
(14), in which
[0175] the parameter set field is a field in an SPS NAL unit.
[0176] (16) The reception device according to the aforementioned
(14) or (15), in which
[0177] identification information indicating that the video stream
supports the high dynamic range is inserted into a layer of the
container, and
[0178] the information extractor extracts the meta information from
the parameter set field in the video stream on the basis of the
identification information.
[0179] (17) The reception device according to any one of the
aforementioned (14) to (16), in which
[0180] the meta information for display control is included in a
field different from the parameter set field in the video
stream,
[0181] the reception device further including a brightness
adjustment unit that adjusts display brightness of the display
video data on the basis of the meta information for display
control.
[0182] (18) The reception device according to the aforementioned
(17), in which
[0183] the meta information for display control includes field
information indicating a field where the display brightness
adjustment is allowed, and
[0184] the brightness adjustment unit adjusts the display
brightness of the field where the display brightness adjustment is
allowed.
[0185] (19) The reception device according to the aforementioned
(17) or (18), in which
[0186] information indicating whether the display brightness
adjustment for the video stream is prohibited is inserted into a
layer of the container and/or a layer of the video stream, and
[0187] the brightness adjustment unit does not adjust the display
brightness of the display video data in a case where the
information indicating whether the display brightness adjustment
for the video stream is prohibited indicates the prohibition
thereof.
[0188] (20) A reception method including:
[0189] a reception step of receiving, through a receiver, a
container in a predetermined format including a video stream
obtained by encoding transmission video data;
[0190] a decoding step of applying decoding processing to the video
stream to obtain the transmission video data; and
[0191] an electrooptical conversion step of performing
electrooptical conversion on the transmission video data obtained
through the decoding step to obtain display video data, in
which
[0192] the transmission video data is data obtained by applying
high dynamic range optoelectrical conversion to high dynamic range
data,
[0193] meta information indicating an electrooptical conversion
characteristic corresponding to a characteristic of the high
dynamic range optoelectrical conversion is inserted into a
parameter set field in the video stream, and
[0194] the electrooptical conversion characteristic indicated by
the meta information is used during the electrooptical conversion
step.
[0195] The principal characteristic of the present technology is to
insert the meta information specifying the electrooptical
conversion characteristic corresponding to the high dynamic range
optoelectrical conversion characteristic into the SPS NAL unit in
the video stream, thereby ensuring that the electrooptical
conversion processing for the transmission video data obtained
using high dynamic range optoelectrical conversion characteristic
is favorably carried out at the receiving side (refer to FIG.
11).
REFERENCE SIGNS LIST
[0196] 10, 10A Transmission/reception system [0197] 100
Transmission device [0198] 101 Control unit [0199] 102 HDR camera
[0200] 103 HDR optoelectrical converter [0201] 103a Master monitor
[0202] 104 Video encoder [0203] 105 System encoder [0204] 106
Transmitter [0205] 200 Reception device [0206] 200A Set top box
[0207] 200B Monitor [0208] 201 Control unit [0209] 202 Receiver
[0210] 203 System decoder [0211] 204 Video decoder [0212] 205 HDR
electrooptical converter [0213] 206 HDR display mapping unit [0214]
207 CE monitor
* * * * *