Robust Multi-View Video Streaming through Adaptive Intra Refresh Video Transcoding
Abstract
A multi-view video (MVV) transcoder has been designed. The objective is to deliver maximum quality 3D video data from the source to the 2D video destination, through a wireless communication channel using all of its available bandwidth. This design makes use of the spatial and view downscaling algorithm. The method involves the reuse of motion information obtained from both the reference frames and views. Consequently, highly compressed MVV is converted into low bit rate single view video that is compliant with H.264/AVC format. Adaptive intra refresh (AIR) error resilience tool is configured to mitigate the error propagation resulting from channel conditions. Experimental results indicate that error resilience plus transcoding performed better than the cascaded technique. Simulation results demonstrated an efficient 3D video streaming service applied to low power mobile devices.References
D. A. Harris, "Picture This: Body Worn Video Devices ('Head Cams') as Tools for Ensuring Fourth Amendment Compliance by Police," Texas Tech Law Review, vol. 43, no. 1, pp. 357-372, 2010.
A. Vetro, J. Xin and H. Sun, "Error resilience video transcoding for wireless communications," IEEE Wireless Communications, vol. 12, pp. 14-21, 2005.
I. A. Ali, Cross-Layer Enhancements for Error Resilient Video Delivery over Wireless Networks, 2012.
Y. Zhang, W. Gao, H. Sun, Q. Huang and Y. Lu, "Error resilience video coding in H. 264 encoder with potential distortion tracking," International Conference on Image Processing (ICIP'04), IEEE press, Oct. 2014, pp. 163-166.
M. Fleury, I. A Ali and M. Ghanbari, "Video Intra Coding for Compression and Error Resilience: A Review," Recent Patents on Signal Processing, vol. 4, pp. 32-43, 2014.
M. Ebian, M. El-Sharkawy and S. El-Ramly, "Adaptive error concealment algorithm for multiview coding based on lost MBs sizes and using dynamic selection of lower candidates MBs," the 8th International Computer Engineering Conference (ICENCO'12), IEEE press, Dec. 2012, pp. 26-29.
O. H. Salim and W. Xiang, "A novel unequal error protection scheme for 3-D video transmission over cooperative MIMO-OFDM systems," EURASIP Journal on Wireless Communications and Networking, vol. 2012, p. 269, 2012.
Y. Zhou and Y. Chen, "Error-resilient video coding of H. 264/AVC based on network-adaptive intra refresh and reference selection refresh," Optical Engineering, vol. 49, pp. 077401-077401-11, 2010.
Y. Sun, X. Zhang, F. Tang, S. Fowler, H. Cui and X. Dong, "Layer-aware unequal error protection for scalable H. 264 video robust transmission over packet lossy networks," the 14th International Conference on Network-Based Information Systems (NBiS'11), IEEE press, Sept. 2011, pp. 628-633.
R. Talluri, "Error-resilient video coding in the ISO MPEG-4 standard," Communications Magazine, IEEE, vol. 36, pp. 112-119, 1998.
S. Liu and C. W. Chen, "Multiview video transcoding: From multiple views to single view," Picture Coding Symposium, (PCS '09), IEEE press, May 2009, pp. 1-4.
B. A. Adedayo, Q. Wang, J. M. A. Calero and C. Grecos, "Dynamic resource allocation engine for cloud-based real-time video transcoding in mobile cloud computing environments," IS&T/SPIE Electronic Imaging, SPIE proc. press, Feb. 2015, pp. 94000O-94000O-8.
A. Cedillo-Hernandez, M. Cedillo-Hernandez, M. Garcia-Vazquez, M. Nakano-Miyatake, H. Perez-Meana and A. Ramirez-Acosta, "Transcoding resilient video watermarking scheme based on spatio-temporal HVS and DCT," Signal Process, vol. 97, pp. 40-54, 2014.
C. F. Good, On The Fly Transcoding of Video on Demand Content for Adaptive Streaming, 2015.
S. Liu and C. W. Chen, "3D video transcoding for virtual views," Proc. of the 18th ACM International Conference on Multimedia, 2010, pp. 795-798.
A. Vetro, C. Christopoulos and H. Sun, "Video transcoding architectures and techniques: an overview," Signal Processing Magazine, IEEE, vol. 20, pp. 18-29, 2003.
J. Xin, C. Lin and M. Sun, "Digital video transcoding," Proc. IEEE, vol. 93, pp. 84-97, 2005.
I. Ahmad, X. Wei, Y. Sun and Y. Zhang, "Video transcoding: an overview of various techniques and research issues," IEEE Transactions on Multimedia, vol. 7, pp. 793-804, 2005.
S. Moiron, M. Ghanbari, P. Assunção and S. Faria, "Video transcoding techniques," Recent Advances in Multimedia Signal Processing and CommunicationsAnonymous Springer, 2009, pp. 245-270.
A. H. Sadka, "Video Transcoding for Inter‐network Communications," Compressed Video Communications, pp. 215-256, 2002.
S. Dogan, A. Sadka and A. Kondoz, "Tandeming/transcoding issues between MPEG-4 and H. 263, mobile and personal satellite communications 3," Proceedings of the Third European Workshop on Mobile/Personal Satcoms (EMPS'98), pp. 339-346.
X. Zhang, Y. Li, J. Li, K. Zhao and T. Zhang, "Proximate control stream assisted video transcoding for heterogeneous content delivery network," IEEE International Conference on Image Processing (ICIP'14), IEEE press, Oct. 2014, pp. 2552-2555.
I. Ahmad, X. Wei, Y. Sun and Y. Zhang, "Video transcoding: an overview of various techniques and research issues," IEEE Transactions on Multimedia, vol. 7, pp. 793-804, 2005.
M. T. Beck, S. Feld, A. Fichtner, C. Linnhoff-Popien and T. Schimper, "ME-VoLTE: Network functions for energy-efficient video transcoding at the mobile edge," the 18th International Conference on Intelligence in Next Generation Networks (ICIN'15), IEEE press, Feb. 2015, pp. 38-44.
C. Chen, C. Lin, H. Wei and Y. Chen, "Robust video streaming over wireless LANs using multiple description transcoding and prioritized retransmission," Journal of Visual Communication and Image Representation, vol. 18, pp. 191-206, 2007.
S. Dogan, A. Cellatoglu, M. Uyguroglu, A. H. Sadka and A. M. Kondoz, "Error-resilient video transcoding for robust internetwork communications using GPRS," IEEE Transactions on Circuits and Systems for Video Technology, vol. 12, pp. 453-464, 2002.
T. Grajek, J. Stankowski, K. Wegner and M. Domanski, "Video quality in AVC homogenous transcoding," International Conference on Systems Signals and Image Processing (IWSSIP'14), IEEE press, May 2014, pp. 211-214.
C. Kao, T. Huang, H. H. Chen and J. Wu, "Perceptully lossless video re-encoding for cloud transcoding," IEEE China Summit & International Conference on Signal and Information Processing (ChinaSIP'14), IEEE press, July 2014, pp. 301-305.
D. K. Krishnappa, M. Zink and R. K. Sitaraman, "Optimizing the video transcoding workflow in content delivery networks," Proceedings of the 6th ACM Multimedia Systems Conference, 2015, pp. 37-48.
A. H. Sadka, "Video Transcoding for Inter‐network Communications," Compressed Video Communications, pp. 215-256, 2002.
M. Song, Y. Lee and J. Park, "Scheduling a video transcoding server to save energy," ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM), vol. 11, no. 2s, article 45, 2015.
L. Sagir and A. H. Sadka, "Robust Adaptive Intra Refresh for Multiview Video," International Journal of Computer Science, Engineering and Applications, vol. 4, no. 6, pp. 1-12, 2014
A. H. Sadka, Compressed Video Communications. Halsted Press, 2002.
S. Worrall, A. Sadka, A. Kondoz and P. Sweeney, "Motion adaptive intra refresh for MPEG-4," Electron. Lett., vol. 36, pp. 1924-1925, 2000.
A. H. Sadka, "Error resilience in compressed video communications," Compressed Video Communications, pp. 121-176, 2002.
S. Dogan, A. Sadka and A. Kondoz, "Tandeming/transcoding issues between MPEG-4 and H. 263," Mobile and Personal Satellite Communications 3, Springer Lodon, 1999, pp. 339-346.
A. Vetro, J. Xin and H. Sun, "Error resilience video transcoding for wireless communications," IEEE Wireless Communications, vol. 12, pp. 14-21, 2005.
Y. Su, A. Vetro and A. Smolic, "Common test conditions for multiview video coding," JVT-T207, Klagenfurt, Austria, 2006.
A. Rombaut, N. Vercammen, N. Staelens, B. Vermeulen and P. Demeester, "Sirannon: Demonstration Guide," ACM Multimedia, vol. 9, pp. 1-4, 2009.
Published
How to Cite
Issue
Section
License
Copyright Notice
Submission of a manuscript implies: that the work described has not been published before that it is not under consideration for publication elsewhere; that if and when the manuscript is accepted for publication. Authors can retain copyright in their articles with no restrictions. Also, author can post the final, peer-reviewed manuscript version (postprint) to any repository or website.
Since Jan. 01, 2019, IJETI will publish new articles with Creative Commons Attribution Non-Commercial License, under Creative Commons Attribution Non-Commercial 4.0 International (CC BY-NC 4.0) License.
The Creative Commons Attribution Non-Commercial (CC-BY-NC) License permits use, distribution and reproduction in any medium, provided the original work is properly cited and is not used for commercial purposes.