[1]柳伟,陈旭,梁永生,等.基于时空显著图的可伸缩视频码率控制方法[J].深圳大学学报理工版,2013,30(No.5(441-550)):462-468.[doi:10.3724/SP.J.1249.2013.05462]
 Liu Wei,Chen Xu,Liang Yongsheng,et al.Rate control for scalable video coding based on spatiotemporal saliency map[J].Journal of Shenzhen University Science and Engineering,2013,30(No.5(441-550)):462-468.[doi:10.3724/SP.J.1249.2013.05462]
点击复制

基于时空显著图的可伸缩视频码率控制方法()
分享到:

《深圳大学学报理工版》[ISSN:1000-2618/CN:44-1401/N]

卷:
第30卷
期数:
2013年No.5(441-550)
页码:
462-468
栏目:
电子与信息科学
出版日期:
2013-09-02

文章信息/Info

Title:
Rate control for scalable video coding based on spatiotemporal saliency map
文章编号:
20130504
作者:
柳伟1陈旭2梁永生1张基宏1张代军3
1) 深圳信息职业技术学院,深圳市可视媒体处理与传输重点实验室,深圳 518172
2) 深圳大学信息工程学院,深圳 518060
3) 深圳市励拓软件有限公司,深圳 518000
Author(s):
Liu Wei1 Chen Xu2 Liang Yongsheng1 Zhang Jihong1 and Zhang Daijun3
1) Shenzhen Institue of Information Technology, Shenzhen Key Laboratory of Visual Media Processing and Transmission, Shenzhen 518172, P.R.China
2) College of Information Engineering, Shenzhen University, Shenzhen 518060, P.R.China
3) Shenzhen Lituo Software Co Ltd, Shenzhen 518000, P.R.China
关键词:
模式识别视频编码数据处理时空显著图码流提取主观感知
Keywords:
pattern recognition video coding data processing spatiotemporal saliency map bitstream extration subjective perception
分类号:
TP 391
DOI:
10.3724/SP.J.1249.2013.05462
文献标志码:
A
摘要:
提出一种基于时空显著图的可伸缩视频码率控制方法.建立数学模型描述人眼视觉注意机制中显著区域提取,引入注意焦点转移等视觉感知任务,从时空域角度计算获取显著图.根据时空显著图提出基于贪婪算法的增强层码率控制方法实现码流提取,结合人眼中央凹视觉偏离角-感知清晰度关系特性进行码率分配优化.实验结果表明,该方法能有效模拟人眼视觉注意特性,在有限带宽条件下提高视频的主观视觉感知质量.
Abstract:
A rate control method for SVC based on a spatiotemporal saliency map is presented in this paper. Mathematics models are introduced to describe the tasks in the human visual sysytem (HVS) mechanism, such as salient areas extraction and attention focus shift, and a spatiotemporal saliency map is obtained as a result. According to this map a rate allocation method based on greedy algorithm for enhancement layers is proposed to extract the substream, and the algorithm is optimized according to the characteristics of relation between human fovea and visual clarity. Experiments show that the proposed methods can simulate the characteristics of HVS and assure subjective visual quality when the bandwidth is limited.

参考文献/References:

[1]Institute of Computing Technology, Chinese Academy of Sciences.Proposed draft of adaptive rate control[C/OL].Proceedings of the 8th JVT Meeting.Geneva(Swizerland):[s.n.],2003: JVT-H017.[2012-07-30].http://wftp3.itu.int/av-arch/jvt-site/2003_05_Geneva/JVT-H017.doc
[2]Jungkunz P,Darken C J.Modeling human eye-movements for military simulations[C]// Proceedings of the 19th Conference on Behavior Representation in Modeling and Simulation.Charleston(USA):[s.n.], 2010:179-186.
[3]Seo C W,Han J K.Rate control scheme for consistent video quality in scalable video codec[J].IEEE Transactions on Image Process,2011,20(8):2166-2176.
[4]Li Jia.Learning-Based Visual Saliency Computation[D]. Beijing:Chinese Academy of Science,2009.(in Chinese)
李甲.基于学习的视觉显著计算[D].北京:中国科学院研究生院,2009.
[5]Ding Wen,Zhang Haoping,Hu Pengsha.Improved JVT-H017 code rate control algorithm[J].Computer Engineering,2012,38(6):238-240.(in Chinese)
丁文,张浩平,胡鹏莎.一种改进的JVT-H017码率控制算法[J].计算机工程,2012,38(6):238-240.
[6]Kao M P,Truong Q N.Rate-distortion optimized bitstream extractor for motion scalability in wavelet-based scalable video coding[J].IEEE Transactions on Image Processing,2010,19(5):1214-1223.
[7]Ruan Ruolin,Hu Ruimin,Li Zhongming,et al.Rate control algorithm of wireless video based on visual saliency map model[J].China Communications,2011(7):105-110.
[8]Ma Zhan,Xu Meng,OU Yenfu,et al.Modeling of rate and perceptual quality of compressed video as functions of frame rate and quantization stepsize and its applications[J].IEEE Transactions on Circuits and Systems for Video Technology,2012,22(5):671-682.
[9]Li Ruiheng,Sun Jun,Gao Wen.Fast weighted algorithms for bitstream extraction of SVC medium-grain scalable video coding[C]// Proceedings of IEEE International Conference on Multimedia and Expo.Singapore:IEEE Press,2010:249-254.
[10]Liu Wei,Guo Sen,Chen Xu,et al.SVC bitstream extraction based on the importance of MGS slice[C]// Proceedings of the 2nd International Conference on Industrial and Information Systems.Dalian(China):IEEE Press,2010,1:148-151.
[11]Chen Xu,Zhang Jihong,Liu Wei,et al.Study on error control based on importance of MGS slices[J].Journal of Shenzhen University Science and Engineering,2011,28(2):154-159.(in Chinese)
陈旭,张基宏,柳伟,等.基于MGS片层重要性的差错控制方法研究[J].深圳大学学报理工版,2011, 28(2):154-159.
[12]Harel J,Koch C,Perona P.Graph-based visual saliency[C]// Advances in Neural Information Processing Systems.[s.l.]: IEEE Press, 2006: 545-552.
[13]Baidu Library.HVS [EB/OL].(2010-12-30).Beijing:Baidu.http: // wenku.baidu.com/view/7be91f260722192e4436f605.html.(in Chinese)
百度文库.人眼视觉特性(HVS)[EB/OL].(2010-12-30).北京:百度.http://wenku.baidu.com/view/7be91f260722192e4436f605.html
[14]Baidu Pedia.Photopic vision [EB/OL].(2012-03-15).Beijing:Baidu.http://baike.baidu.com/view/494848.htm.(in Chinese)
百度百科.明视觉[EB/OL].(2012-03-15) .北京:百度.http://baike.baidu.com/view/494848.htm
[15]Wang zhaonan.Rearsh on Rate of Scalable Video Coding and Visual Quality[D].Changchun:Jilin University,2009.(in Chinese)
王兆楠.可伸缩编码码率和感官质量的研究[D].长春:吉林大学,2009.

相似文献/References:

[1]胡涛,郭宝平,郭轩.基于游程分析轮廓提取算法的改进[J].深圳大学学报理工版,2009,26(4):405.
 HU Tao,GUO Bao-ping,and GUO Xuan.An improved run-based boundary extraction algorithm[J].Journal of Shenzhen University Science and Engineering,2009,26(No.5(441-550)):405.
[2]陈旭,张基宏,柳伟,等.基于MGS片层重要性差错控制方法研究[J].深圳大学学报理工版,2011,28(No.2(095-188)):154.
 CHEN Xu,ZHANG Ji-hong,LIU Wei,et al.Study on error control based on importance of MGS slices[J].Journal of Shenzhen University Science and Engineering,2011,28(No.5(441-550)):154.
[3]朱安民,陈燕明.基于特征点一致性约束的实时目标跟踪算法[J].深圳大学学报理工版,2013,30(No.3(221-330)):228.[doi:10.3724/SP.J.1249.2013.03228]
 Zhu Anmin and Chen Yanming.A real-time target tracking algorithm based on the consistency constraint of feature points[J].Journal of Shenzhen University Science and Engineering,2013,30(No.5(441-550)):228.[doi:10.3724/SP.J.1249.2013.03228]
[4]罗雪晖,李霞,张基宏.支持向量机及其应用研究[J].深圳大学学报理工版,2003,20(3):40.
 LUO Xue-hui,LI Xia and ZHANG Ji-hong.Introduction to Support Vector Machine and Its Applications[J].Journal of Shenzhen University Science and Engineering,2003,20(No.5(441-550)):40.
[5]韩迪,等.增量学习的优化算法在app使用预测中的应用[J].深圳大学学报理工版,2019,36(1):43.[doi:10.3724/SP.J.1249.2019.01043]
 HAN Di,LI Wenting,et al.The application of optimization algorithm based on incremental learning in app usage prediction[J].Journal of Shenzhen University Science and Engineering,2019,36(No.5(441-550)):43.[doi:10.3724/SP.J.1249.2019.01043]
[6]刘翠响,袁香伟,王宝珠,等.最小均衡化后的行人重识别[J].深圳大学学报理工版,2019,36(4):447.[doi:10.3724/SP.J.1249.2019.04447]
 LIU Cuixiang,YUAN Xiangwei,WANG Baozhu,et al.Minimum equalization for pedestrain re-identification[J].Journal of Shenzhen University Science and Engineering,2019,36(No.5(441-550)):447.[doi:10.3724/SP.J.1249.2019.04447]
[7]刘润奇,贺兴时,南夷非,等.网络多媒体数据中舆情关联主题的挖掘方法[J].深圳大学学报理工版,2020,37(1):72.[doi:10.3724/SP.J.1249.2020.01072]
 LIU Runqi,HE Xingshi,NAN Yifei,et al.Mining method of public opinion related topic in network multimedia data[J].Journal of Shenzhen University Science and Engineering,2020,37(No.5(441-550)):72.[doi:10.3724/SP.J.1249.2020.01072]
[8]黄林,常健,杨帆,等.基于改进k-means的电力信息系统异常检测方法[J].深圳大学学报理工版,2020,37(2):214.[doi:10.3724/SP.J.1249.2020.02214]
 HUANG Lin,CHANG Jian,YANG Fan,et al.An anomaly detection method for electric power information system based on improved k-means[J].Journal of Shenzhen University Science and Engineering,2020,37(No.5(441-550)):214.[doi:10.3724/SP.J.1249.2020.02214]

备注/Memo

备注/Memo:
Received:2012-08-21;Revised:2013-06-06;Accepted:2013-08-01
Foundation:National Natural Science Foundation of China(61172165);Natural Science Foundation of Guangdong Province(s2011010006113)
Corresponding author:Professor Zhang Jihong.E-mail:zhangjh@sziit.com.cn
Citation:Liu Wei,Chen Xu,Liang Yongsheng,et al.Rate control for scalable video coding based on spatiotemporal saliency map[J]. Journal of Shenzhen University Science and Engineering, 2013, 30(5): 462-468.(in Chinese)
基金项目:国家自然科学基金资助项目(61172165);广东省自然科学基金资助项目(s2011010006113)
作者简介:柳伟(1973-),男(壮族),湖南省长沙市人,深圳信息职业技术学院教授.E-mail:liuwei@sziit.com.cn
引文:柳伟,陈旭,梁永生,等.基于时空显著图的可伸缩视频码率控制方法[J]. 深圳大学学报理工版,2013,30(5):462-468.
更新日期/Last Update: 2013-09-02