A MORE REALISTIC RTP/RTCP-BASED SIMULATION PLATFORM FOR VIDEO STREAMING QoS EVALUATION
Keywords:
Multimedia Systems, NS-2, RTP/RTCP, Simulation, Video Quality MeasurementAbstract
Over the last few years, the demand for real-time multimedia services has been growing progressively so that video streaming applications are expected to be dominant in future communications systems, and most of them using RTP/RTCP protocols. This paper presents an evolved tool-set for video streaming QoS evaluation in simulated environments using such protocols. We have designed a new NS-2 module with a full RTP/RTCP implementation (following strictly the RFC 3550) and we propose to combine it with additional multimedia tools to obtain an advanced simulation framework that allows the measurement of network-level QoS metrics (such as throughput, delay, jitter or loss rate) in simulation time. Besides, as the transmitted video files can be reconstructed and played out at the receiver side, the measurement of the quality of the delivered video streams, by employing the most common objective quality metrics (such as PSNR, SSIM or VQM) or subjective metrics (MOS), is also supported. By using this tool-set, researchers and practitioners can assess their novel designs (such as network protocols, routing strategies or video coding mechanisms) for such applications in heterogeneous scenarios over different network conditions. As RTCP feedback capabilities have been added, source based control techniques (such as rate adaptability or Multiple Description Coding) could be included and tested using this more realistic and powerful simulation platform.
Downloads
References
NS-2 Simulator Home Page, http://www.isi.edu/nsnam/ns
OPNET Simulator Home Page, http://www.opnet.com
OMNET Simulator Home Page, http://www.omnetpp.org
Schulzrinne, H., Casner, S., Frederick, R. and Jacobson, V., RTP: a transport protocol for real-time
applications, RFC-3550, July 2003.
Boronat, F., Guerri, JC. and Lloret, J., An RTP/RTCP based approach for multimedia group and
inter-stream synchronization. Multimedia Tools and Applications Journal, Vol. 40 (2), 285-319,
Begen, A., Perkins, C. and Ött, J., On the use of RTP for Monitoring and Fault Isolation in IPTV.
IEEE Network, Volume 24 Issue 2, March/April 2010.
Montagud, M. and Boronat, F., A new network simulator 2 (NS-2) module based on RTP/RTCP
protocols to achieve multimedia group synchronization. In SIMUTOOLS 2010: 3rd International
ICST Conference on Simulation Tools and Techniques, Torremolinos, Malaga, Spain, March
Boronat, F., Montagud, M. and Vidal, V., Enhanced RTP-based Tool-Set for Video Streaming
Simulation using NS-2. In MoMM 2010: The 8th International Conference on Advances on
Mobile Computing and Multimedia, Paris, November 2010.
Winkler, F. and Mohandas, P., The Evolution of Video Quality Measurement: From PSNR to
Hybrid Metrics. IEEE Transactions on Broadcasting, Vol. 54, No. 3, pp. 660-668, September
Golaup, A. and Aghvami, H., A multimedia traffic modelling framework for simulation-based
performance evaluation studies. Computer Networks, 50, 12 (Aug. 2006), 2071-2087.
Seeling, P., Reisslein, M. and Kulapala, B., Network Performance Evaluation Using Frame Sizes
and Quality Traces of Single-Layer anf Two-Layer Video: A Tutorial. IEEE Communications
Surveys and Tutorials, Vol. 6, No. 2, pp 58-78, Third Quarter 2004.
Fitzek, F.H.P. and Reissling, M., MPEG-4 and H.263 Video Traces for Network Performance
Evaluation. IEEE Network, Vol. 15, No. 6, pp. 40-54, December 2001.
Klaue, J., Rathke, B. and Wolisz, A., EvalVid – A Framework for video transmission and quality
evaluation. In Proceedings of the 13th International Conference on Modelling, Techniques and
Tools for Computer Performance Evaluation, Urbana, Illinois, 2003.
Kao, K., Ke C. and Shieh, C., An advanced simulation tool-set for video transmission performance
evaluation. In WNS2’06: the 2006 Workshop on Ns-2: the IP Network Simulator, Pisa, Italy,
October 10 - 10, 2006, vol. 202. ACM, New York, NY, 10.
Ke, C.H., Shieh, C.K., Hwang, W.S. and Ziviani, A., An Evaluation Framework for More Realistic
Simulations of MPEG Video Transmission. Journal of Information Science and Engineering, vol.
, n 2, pp. 425-440, 2008.
Abdel-Hady M. and Ward, R., A Framework for Evaluating Video Transmission over Wireless Ad
Hoc Networks. In PACRIM 2007: IEEE Pacific Rim Conference on Communications, Computers
and Signal Processing, pp.78-81. 2007.
Yu, C-Y, Ke, C-H, Chen, R-S, Shieh, C-K, Munir, B. and Chilamkurti, N. K., MyEvalvid_RTP: A
evaluation framework for more realistic simulations of multimedia transmissions. International
Journal of Software Engineering and Its Applications Vol. 2, No. 2, April, 2008.
Lie, A. and Klaue, J., Evalvid-RA: Trace Driven Simulation of Rate Adaptive MPEG-4 VBR
Video. Multimedia Systems, Springer Berlin / Heidelberg, Volume 14, Number 1 / June, pp. 33-
, 2008.
Bouras, C., Gkamas, A. and Kioumourtzis, G., Evaluation of Single Rate Multicast Congestion
Control Schemes for MPEG-4 Video Transmission. In NGI’09: 5th Euro-NGI conference on Next
Generation Internet networks, Aveiro, Portugal, July.
Yan Z., Liu G., Su R., Zhang Q., Chen X., and Chen L., A Simulation Mechanism for Video
Delivery Researches. In ChinaCom 2009: the Fourth International Conference on
Communications and Networking in China, China, August 2009.
Suki, A., Hassan, S., Ghazali, O. and Awang, S., Evalvid-RASV: Shaped VBR Rate Adaption
Stored Video System. In ICETC 2010: the 2nd International Conference on Educational
Technology and Computer, Shanghai, China, June 2010.
Klein, A. and Klaue, J., Performance Evaluation Framework for Video Applications in Mobile
Networks. In IEEE MESH 2009, Athens, Greece, June 2009.
Klein, A. and Klaue, J., Performance Study of a Video Application over Multi Hop Wireless
Networks with Statistic-Based Routing. In IFIP Networking, 2009.
YUV Video Files: http://www.tkn.tu-berlin.de/research/evalvid
Video Traces Library: http://www.tkn.tu-berlin.de/research/trace/trace.html
RTPTools, http://www.cs.columbia.edu/irt/software/rtptools
ITU-R Recommendation BT.500-11, Methodology for the subjective assessment of the quality of
television pictures. International Telecommunication Union, Geneva, Switzerland, 2002.
ITU-T Recommendation P.910, Subjective video quality assessment methods for multimedia
applications. International Telecommunication Union, Geneva, Switzerland, 2008.
Chan, A., Zeng, K., Mohapatra, P., Lee, S. and Banerjee, S., Metrics for Evaluating Video
Streaming Quality in Lossy IEEE 802.11 Wireless Networks. In IEEE Infocom 2010.
Ohm, J.R., Multimedia Communication Technology, Springer, Heidelberg (2004).
Korhonen J. and You J., Improving objective video quality assessment with content analysis. In the
Fifth International Workshop on Video Processing and Quality Metric for Consumer Electronics,
Melbourne, Australia, January 2010.
Wang, Z., Lu, L. and Bovik, A. C., Video quality assessment based on structural distortion
measurements. Signal Processing: Image Communication, vol. 19, no. 2, pp 121-132, February
Kotevski, Z. and Mitrevski, P., Experimental Comparison of PSNR and SSIM Metrics for Video
Quality Estimation. in ICT Innovations 2009.
Pinson and, M.H. and Wolf, S., A new standardized method for objectively measuring video
quality. IEEE Transactions on Broadcasting, vol. 50, no. 3, pp. 312-322, September 2004.
Issariyakul, T. and Hossain, E., Introduction to Network Simulator 2 NS-2. Springer, ISBN: 978-
-387-71759-3, 2009.
Carrascal, V., Grupo de Servicios Telemáticos, Universidad Politécnica de Cataluña, España.
http://sertel.upc.es/_vcarrascal/ns2
Bouras, C., Gkamas A. and Kioumoutzis, G., Extending the Funtionality of RTP/RTCP
Implementation in Network Simulator (NS-2) to support TCP friendly congestion control. In
SIMUTools 2008: the 1st International ICST Conference on Simulation Tools and Techniques,
Marseille, France March 3-7.
VLC Media Player, http://www.videolan.org/vlc
FFMPEG program, http://sourceforge.net/projects/ffmpeg/
YUV viewer, http://www.brothersoft.com/elecard-yuv-viewer-download-142207.html
MSU Video Quality Measurement Tool. Graphics&Media Lab, Computer Science (VMK),
Moscow State University,
http://compression.ru/video/quality_measure/video_measurement_tool_en.html
