ADAPTATION OF MULTIMEDIA RESOURCES SUPPORTED BY METADATA
Keywords:
Metadata, MPEG-7, Segment-based variation, UMA, Video adaptation, Content accessibilityAbstract
The Video adaptation is an active research area aiming at delivering heterogeneous content to yet heterogeneous devices under different network conditions. This paper presents a novel method of video adaptation called segment-based variation. It aims at applying different reduction methods on different segments based on physical content. The video is first partitioned into homogeneous segments based on the physical characteristics of motion, texture, and color. Then optimal reduction methods are selected and applied on each segment with the objective of minimizing quality loss and/or maximizing data size reduction during adaptation. In addition, the commonly used reduction methods are also implemented. To realize variation creation utilizing these methods, a unifying framework called the Variation Factory is developed. It is extended to the Multi-Step Variation Factory, which allows intermediary videos to serve as variations and also as sources to further variations. It creates a tree of variations and the associated metadata, which allow one to apply successive reductions by active network nodes. They also allow the server to easily switch from one stream to another depending on resource availability. Our proposals are implemented as part of a server component, called the Variation Processing Unit (VaPU) offering user interface to guide the generation of the different versions of the source and an MPEG-7 metadata document. The information contained in this document describes both the source and the variations and helps the system to identify the most appropriate version. It can also be used by active components on the network to carryout efficient adaptation. Such adaptation will take user preferences, including disability, into account.
Downloads
References
R. Mohan, J. R. Smith, and C.-S. Li, “Adapting Multimedia Internet Content for Universal
Access,” IEEE Transactions on Multimedia, Vol. 1, No. 1, 1999, pp. 104-114.
Harald Kosch, “Distributed Multimedia Database Technologies supported by MPEG-7 and
MPEG-21,” CRC Press, ISBN 0-8493-1854-8, November 2003.
O. Steiger, D. M. Sanjuán, and T. Ebrahimi, “MPEG-Based Personalized Content Delivery,” in
Proceedings of the IEEE International Conference on Image Processing, ICIP 2003, Barcelona,
Spain, September 2003, pp. 45-48.
H. Kosch, L. Böszörményi, M. Döller, A. Kofler, P. Schojer, and M. Libsie, “The life cycle of
multimedia meta-data,” IEEE MultiMedia, 12(1), January/March 2005.
B. S. Manjunath, P. Salembier, and T. Sikora, “Introduction to MPEG-7 Multimedia Content
Description Interface,” John Wiley & Sons, New York, 2002.
A. Tripathi and M. Claypool, “Adaptive Content-Aware Scaling for Improved Video Streaming,”
in Proceedings of the Second International Workshop on Intelligent Multimedia Computing and
Networking (IMMCN), Durham, March 2002.
R. Mohan, J. R. Smith, and C.-S. Li, “Adapting Content to Client Resources in the Internet,”
IEEE International Conference on Multimedia Computing and Systems, Vol. 1, Florence, Italy,
June 1999, pp. 9302-9307.
J. R. Smith, R. Mohan, and C.-S. Li, “Transcoding Internet Content for Heterogeneous Client
Devices,” in Proceedings of IEEE International Conference on Circuits and Systems (ISCAS),
Monterey, June 1998, pp. 599-602.
J. R. Smith, R. Mohan, C.-S. Li, “Scalable Multimedia Delivery for Pervasive Computing,” in
Proceedings of ACM International Conference on Multimedia (ACM-MM), Orlando, FL,
November 1999, pp. 131-140.
S. Dogan, A. H. Sadka, and A. M Kondpz, “MPEG-4 video transcoder for mobile multimedia
traffic planning,” in Proceedings of the IEEE Second International Conference on 3G Mobile
Communication Technologies, 3G'2001, London, March 2001, pp. 109-113.
B. Zheng and M. Atiquzzaman, “TSFD: two stage frame dropping for scalable video
transmission over data networks,” IEEE Workshop on High Performance Switching and Routing,
Dallas, TX, May 2001, pp. 43-47.
H. Cha, J. Oh, and R. Ha, “Dynamic Frame Dropping for Bandwidth Control in MPEG
Streaming System,” Multimedia Tools and Applications, Vol. 19, No. 2, February 2003, pp. 155-
B. Shen and S. Roy, “A very fast Video Spatial Resolution Reduction Transcoder,” in
International Conference on Acoustics, Speech, and Signal Processing (ICASSP), May 2002.
P. Yin, M. Wu, and B. Lui, “Video transcoding by reducing spatial resolution,” in Proceedings of
IEEE International Conference on Image Processing, Vancouver, October 2000.
Z. Lei and N. D. Georganas, “H.263 Video Transcoding for Spatial Resolution Downscaling,” in
Proceedings of IEEE International Conference on Information Technology: Coding and
Computing 2002, Las Vegas, USA, April 2002, pp. 425-430.
S. Acharya and B. Smith, “Compressed Domain Transcoding of MPEG,” in International
Conference on Multimedia Computing and Systems (ICMCS 1998), June 1998, pp. 295–304.
S. Wee, J. Apostolopoulos, and N. Feamster, “Field-to-frame transcoding with spatial and
temporal downsampling,” in International Conference on Image Processing (ICIP 1999), Vol. 4,
October 1999, pp. 271-275.
T. Shanableh and M. Ghanbari, “Heterogeneous video transcoding to lower spatio-temporal
resolutions and different encoding formats,” IEEE Transactions on Multimedia, Vol. 2, No. 2,
June 2000, pp. 101-110.
Y. C. Lin, C. N. Wang, T. Chiang, A. Vetro, and H. Sun, “Efficient FGS-to-single layer
transcoding,” in Proceedings of IEEE International Conference on Consumer Electronics, Los
Angeles, June 2002, pp. 134-135.
A. Vetro, H. Sun, and Y. Wang, “Object-based transcoding for adaptable video content delivery,”
IEEE Transactions on Circuits and Systems for Video Technology, Vol. 11, No. 3, March 2001,
pp. 387-401.
S. Goor and L. Murphy, “An Adaptive MPEG-4 Streaming System based on Object
Prioritisation,” in Proceedings of Irish Signals and Systems Conference 2003, Limerick, Ireland,
July 2003.
A. M. Dawood and M. Ghanbari, “Content-Based MPEG Video Traffic Modelling,” IEEE
Transactions on Multimedia, Vol. 1, No. 1, March 1999, pp. 77-87.
P. Kuhn, T. Suzuki, and A. Vetro, “MPEG-7 transcoding hints for reduced complexity and
improved quality,” in Proceedings of International Packet Video Workshop, Kyongju, Korea,
April 2001.
MPEG MDS Group, “MPEG-7 Multimedia Description Schemes XM,” ISO/IEC
JTC1/SC29/WG11 N3966, Singapore, Mar. 2001.
S. Harper and S. Bechhofer, “Semantic Triage for Increased Accessibility”. In John J. Ritsko et
al, editor, IBM Systems Journal, Vol.4, No. 3, August 2005, pp. 637-648.
P. Plessers, S. Casteleyn, Y.z Yesilada, O. De Troyer, R. Stevens, S. Harper, and C. Goble,
“Accessibility: A Web Engineering Approach”. In Proceedings of the 14th International
Conference on World Wide Web (WWW 2005), Chiba, Japan, 2005, pp. 353-362.
