Professional Documents
Culture Documents
Songchao Tan1, Junjun Si2, Siwei Ma2, Shanshe Wang3, Wen Gao2
1
School of Computer Science and Technology, Dalian University of Technology, Dalian 116024, China
2
Institute of Digital Media, Peking University, Beijing 100871, China
3
School of Computer Science and Technology, Harbin Institute of Technology, Harbin 150080, China
I. INTRODUCTION
With todays rapid development of 3D acquisition and
display technologies such as auto-stereoscopic 3D TV [1] and
free-viewpoint video [2], 3D video has gained increasing
interests recently. To better support various stereoscopic or
3D video applications, Motion Picture Experts Group (MPEG)
has started the 3D video (3DV) standardization efforts, which
are currently continued in the Joint Collaborative Team (JCT)
on 3D Video coding (JCT-3V). Both H.264/AVC and HEVC
[3] are utilized to develop 3DV standards by JCT-3V. And as
one of them, 3D-HEVC which targets at developing tools for
both texture views and depth views is based on HEVC.
The typical 3DV is stereo-view video which provides each
eye with one video separately at the same time. The disparity
between these two videos causes the illusion of depth
perception for human. And in 3D-HEVC, due to the need of a
more comprehensive view, it involves a more general case of
n-view multi-view video. By using the depth image-based
rendering (DBIR) technique, we can get large view-angle
scene with fewer amounts of data [4].
Rate Control (RC) is employed in video coding to regulate
the bitrate meanwhile guarantee good video quality. As for
3D-HEVC, it becomes more complicated because multiple
views are involved in coding and within each view there are
two kinds of video sequences (i.e. texture and depth map).
Two RC algorithms Unified Rate Quantization (URQ) [5] and
R-lambda [6] are proposed for 3D-HEVC up to now. In [7],
an inter-view mean absolute difference (MAD) prediction
based on the depth map is introduced to improve the accuracy
bpp = bitrate
w h f
(1)
where bpp refer to the bit per pixel, w and h are the width and
height of the sequence. f is the frame rate of the video.
However, the bpp-based initial QP strategy widely used in
RC algorithm does not work well in 3D-HEVC. Because bpp
can just reflect the bitrate, but the characteristic of video is
ignored. For instance, for the sequence Poznan_Hall2 and
Undo Dancer, as shown in Table I, the bpp of sequence
Poznan_Hall2 when the anchors initial QP is 25 is same as
the bpp of sequence Undo_Dancer when the anchors initial
QP is 35. Obviously, by utilizing bpp-based initial QP scheme,
the initial QP will be too large for sequence Poznan_Hall2.
In this paper, by a lot of experimental analysis we propose
an improved scheme for the decision of initial QP based on
bpp per variance of gradient (BPVG) as follows.
382
BPVG
= Bpp 105 / VG
VG = D(gradient)
(2)
Class
Sequence
Anchor
QP
Kbps
bpp
bpp based
Initial
QP
Proposed
Initial
QP
25
810.69
0.0155
35
25
30
344.89
0.0066
40
30
35
177.24
0.0034
47
35
40
98.51
0.0019
49
40
25
4626.44
0.0923
25
25
30
2005.90
0.0384
30
30
35
916.22
0.0175
35
35
40
426.33
0.0082
40
40
Poznan_Hall2
targetn ,i
1920*1088
= bpf GOP wi ,
n [ 2, m 1] (4)
m
bpf ( frame _ last ) wi , n =
Undo_Dancer
bpf = bitrate
=
Tgop
(R F ) N
framerate
(5)
where targetn,i is the target bits for nth GOP, ith frame. wi is
the weight of different frame. frame_last is the number of the
last GOP.
When overflow or underflow occurs, the difference
between target bits and actual bits in a GOP will be distributed
equally to the rest waiting for coding GOP. At the same time,
the video buffer verifier (VBV) operation model is established
to smooth quality fluctuation.
C. Proposed R-Q Model
The trade-off between the output bitrate (R) and the quality
(D) of compressed video is determined by quantization step
size (Qs), which is indexed by quantization parameter (Q). The
R-Q model has been studied extensively for previous video
coding standards such as H.264/AVC and H.265/HEVC.
Based on experimental analysis, we propose the R-Q model as,
R= X / QP
(6)
(3)
1
n 1
n
where R is the target bitrate, F is the frame rate of the X= ( wi SADi ) / ( wi SADi ) Rn 1 QPn 1
(7)
=
i 0=i 0
383
50
45
view 1
40
view 2
35
view 0
30
25
20
15
10
5
0
0
10
20
30
40
50
60
70
frame numbers
Fig. 2 The complexity (SAD) between view 0, view 1 and view 2
targetn
,
target0
(n =
1, 2)
(8)
Rtarget
(9)
100%
where Error is the bit error, Ractual is the total bits used to
encode the depth map and texture map of three views; Rtarget is
the target bits of that.
The errors of proposed, URQ model and R-lambda model
are presented in Table II. We can see that the proposed RC
scheme is accurate enough that the mismatch is less than 1.0%
on overage.
Fig. 3 shows the R-D curves of the two algorithms for
sequences Poznan_Hall2 and GT_Fly. From that, we
can see that the proposed scheme can achieve a larger PSNR
value at each target bit rate for each of the four sequences than
the R-lambda scheme.
Poznan_Hall2(view 1)
PSNR (dB)
Poznan_Hall2 (view 0)
42.5
42
41.5
41
40.5
39.5
R-lambda
38.5
Proposed
40
39
R-lambda
38
Proposed
37
37.5
0
200
400
600
800
100
300
GT_fly (view 1)
40.5
40
38.5
38
36.5
200
GT_fly (view 0)
PSNR (dB)
| Ractual - Rtarget |
PSNR (dB)
SADviewn =
SADview0
=
Error
PSNR (dB)
R-lambda
36
R-lambda
34
34.5
Proposed
Proposed
32
32.5
0
1000
2000
3000
4000
100
200
300
400
500
600
Fig. 3 The rate distortion curves of the proposed rate control scheme as well
as the rate control in reference software HTM10.0 (R-lambda).
384
Proposed vs URQ
Bitrate Error
R-lambda
Proposed
bitrate
bitrate
error
error
Video 0
Video 1
Video 2
Video
PSNR
Video 0
Video 1
Video 2
Video
PSNR
URQ
bitrate
error
Balloons
-3.2%
-4.5%
-5.2%
-3.9%
-25.3%
-45.0%
-43.4%
-33.0%
0.59%
1.47%
0.26%
Kendo
-4.3%
-4.8%
-5.3%
-4.3%
-33.0%
-50.2%
-50.0%
-39.9%
0.82%
0.58%
0.33%
Newspaper_CC
-1.8%
-2.0%
-2.8%
-2.5%
-27.6%
-55.2%
-42.2%
-37.2%
1.83%
2.61%
0.49%
GT_Fly
-6.8%
-12.5%
-12.3%
-8.4%
-31.1%
-52.4%
-51.8%
-36.4%
0.64%
1.46%
1.58%
Pozan_Hall2
-12.4%
-12.2%
-12.1%
-12.2%
-14.5%
-30.9%
-32.4%
-21.9%
0.69%
2.88%
0.44%
Poznan_Street
-3.9%
-5.2%
-4.3%
-4.1%
-33.4%
-48.7%
-69.4%
-44.7%
0.32%
6.01%
3.53%
Undo_Dancer
-6.6%
-6.1%
-6.5%
-6.3%
-24.8%
-42.2%
-40.9%
-30.4%
0.33%
0.98%
0.31%
Shark
-2.8%
-4.4%
-3.8%
-3.6%
-12.1%
-16.8%
-14.3%
-14.4%
0.51%
1.43%
0.40%
1024*768
-3.1%
-3.7%
-4.4%
-3.6%
-28.7%
-50.1%
-45.2%
-36.7%
1.08%
1.55%
0.36%
1920*1088
-6.5%
-8.1%
-7.8%
-6.9%
-23.2%
-38.2%
-41.7%
-29.6%
0.50%
2.55%
1.25%
average
-5.2%
-6.5%
-6.6%
-5.7%
-25.2%
-42.7%
-43.0%
-32.3%
0.72%
2.18%
0.92%
bits *103
REFERENCES
[1]
[2]
[3]
R-lambda
160
ACKNOWLEDGEMENT
This work was supported in part by the National High-tech
R&D Program of China (863 Program, 2012AA010805)
National Science Foundation of China (61322106, 61390515),
which are gratefully acknowledged.
Proposed
120
[4]
80
40
[5]
0
150
160
170
180
190
200
210
220
230
240
250
frame number
[6]
[7]
IV. CONCLUSIONS
In this paper, we proposed a frame level RC algorithm to
achieve the better quality for 3D-HEVC. Based on our models
for the R-Qs and the bits allocation scheme, an R-D optimized
RC algorithm is derived. Experiments are conducted on
different video sequences and the results demonstrate the
effectiveness of the proposed algorithm.
[8]
[9]
[10]
385