RESILIENT VIDEO STREAM SWITCHING FOR MOBILE WIRELESS CHANNELS
Keywords:
Error concealment, error resiliency, switching frames, video streamingAbstract
In this paper, several error-resiliency techniques are combined with the H.264/AVC (Advanced Video Coding) codec’s switching frames to adaptively switch between video streams, depending on wireless channel conditions. Switching frames are a feature of H.264/AVC that allows smooth transitions between streams without the overhead of periodic intra-coded I-frames. Because video streaming over bandwidth-limited mobile networks requires higher compression ratios, when ‘lossy’ channel conditions occur it is advisable to provide error resiliency at the application layer in order to avoid degradation of video quality at the receiver. In the scheme introduced in this paper, when a change in channel conditions occurs, protection to the video stream is provided by switching to an alternative stream with error resiliency protection. To accomplish stream switching to an error-resilient video stream, minimal feedback is necessary. In this way, robust streaming is confined to periods of poor channel quality, which results in up to 3-4 dB increase in video quality (PSNR) compared to using a single robust scheme over the entire session irrespective of channel conditions. In particular, this scheme appears suited to conditions of slow fading, caused by changes in the environment as a mobile device user moves from one location to another. In the paper, the response of different error resiliency techniques to error patterns (isolated or ‘bursty’) is determined in order to adapt in a suitable way to channel conditions. Constant Bit Rate switching frames are also implemented in this paper. Compared to the usual Variable Bit Rate switching frames, CBR frames allow low-latency and low-bandwidth video services to be supported by H.264/AVC switching frames. The robust switching stream scheme can be potentially combined with adaptive stream bitrate switching. However, the main gain at low bitrates comes not from the reduced overhead of embedded switching frames but the increase in error robustness.
Downloads
References
Altaf, M., Khan, E. and Ghanbari, M., Switching frames for constant bit rate video streams. In 5th
International ICST MobiMedia Conference, (2009), article no. 5.
Chou, L.-D., Chen, J.-M., Kao, H.-S., Wu, S.-F. and Lai, W., Seamless streaming media for
heterogeneous mobile networks. Mobile Networks and Applications, 11, (2006), 873-887.
Ferré, P., Doufexi, A., Cang-How, J., Nix, A. R., and Bull, D. R., Robust video transmission over
wireless LANs. IEEE Transactions on Vehicular Technology, 57(4), (2008), 2596-2602.
Fitzek, F., Seeling, P. and Reisslein, M.,Video streaming in wireless internet. In Wireless
Internet: Technologies and Applications, A. Salkintzis and A. Poularikas (eds.) CRC Press, Boca
Raton: FL, 2004, pp. 1-41.
Fröjdh, P., Horn, U., Kampmann, M., Nohlgren, A. and Westerlund, M., Adaptive streaming
within the 3GPP packet-switched streaming service. IEEE Network, 20(2), (2006), 34-40.
Ghanbari, M. Standard Codecs: Image Compression to Advanced Video Coding. IET Press,
London, UK, 2003.
Hantanong, W. and Aramvith, S., Analysis of macroblock-to-slice group mapping for H.264
video transmission over packet-based wireless fading channel. 45th Mid-West Symposium on
Circuits and Systems, (2005), 1541-1544.
Karczewicz, R. K. M. and Kurceren, R., The SP- and SI-frames design for H.264/AVC. IEEE
Transactions on Circuits and Systems for Video Technology, 13(7), (2003), 637-644.
Kumar, S., Xu, L., Mandal, M. K., and Panchanathan, S., Error resiliency schemes in
H.264/AVC standard. Journal of Visual Representation & Image Representation, 17(2), (2006),
-26.
Lam, W. M., Reibman, A. R. and Liu, B., Recovery of lost or erroneously received motion
vectors. In IEEE Int. Conf on Acoustics, Speech, and Signal Processing, (1993), 417–420.
Lambert, P., Deneve, W., Dhondt, Y., and Vandewalle, R., Flexible macroblock ordering in
H.264/AVC. Journal of Visual Communication and Image Representation, 17, (2006), 358-375.
Liu, L., Ye, X.-J., Zhang, S.-Y. and Zhang, Y., H.264/AVC error resilience tools suitable for 3G
mobile video services. Journal of Zhejiang University SCIENCE, 6(4), (2005), 1-46.
Marpe, D., Wiegand, T. and Sullivan, G. V., The H.264/MPEG4 Advanced Video Coding
standard and its applications. IEEE Communications Magazine, 44(8), (2006), 134-142.
Nuaymi, L. WiMAX: Technology for broadband wireless access. J. Wiley & Sons Ltd,
Chichester, UK, 2007.
Sadka, A. Compressed Video Communications. J. Wiley & Sons, Chichester, UK, 2002.
Salama, F., Shroff, N. B. and Delp, E. J., Error concealment in encoded video. In Image Recovery
Techniques for Image Compression Applications. Kluwer, Norwell, MA, 1998.
Schierl, T., Wiegand, T. and Kampman, M., 3GPP compliant adaptive wireless video streaming
using H.264/AVC. In IEEE International Conference on Image Processing, (2005), 696-699.
Stockhammer, T., Hannuksela, M. M. and Wiegand, T., H.264/AVC in wireless environments.
IEEE Transactions on Circuits and Systems for Video Technology, 13(7), (2003), 57-673.
Stockhammer, T., Liebl, G. and Walter, M., Optimized H.264/AVC-based bit stream switching
for mobile video streaming. EURASIP Journal on Applied Signal Processing, [online journal],
(2006), 1-19.
Stockhammer, T. and Zia, W., Error-resilient coding and decoding strategies for video
communication, in Multimedia over IP and Wireless Networks, M. van der Schaar and P. A.
Chou (eds.), Academic Press, Amsterdam, 2007, 59-80.
Sun, X., Wu, F., Li, S., Gao, W., Zhang, Y.-Q., Seamless switching of scalable video bitstreams
for efficient streaming. IEEE Transactions on Multimedia, 6(2), (2004), 291-303.
Vars, V. and Hannuksela, M. N., Non-normative error concealment algorithms. (2001), ITU-T
SGI6 Doc., VCEG-N62.
Wenger, S., H.264/AVC over IP. IEEE Transactions on Circuits and Systems for Video
Technology, 13(7), (2003), 645-656.
