A 3D INTERACTIVE SYSTEM FOR 3D DISPLAY
Keywords:
2D to 3D conversion, adaptive depth map pre-processing, depth image based rendering, interactive stereo picture, 3D displayAbstract
This paper proposes an interactive 3D picture system for 3D display application which includes the techniques of 3D content synthesis based on 2D image with its depth image and the interaction between the user, picture, and environment. The conversion technique uses depth image based rendering (DIBR) to synthesis 3D image. An adaptive depth map pre-processing method is proposed for DIBR to solve the hole occurring problem on virtual view images. The interaction is achieved based on the measurements of the sensors installed around the system and the methods of interaction tool recognition and speed estimation. To enhance the interaction, some sensors are installed around the picture system so that the scene in the picture can change corresponding to its surroundings. Experimental results show that the proposed system can convert any 2D image into a 3D image with good quality and achieve realtime interaction between the user, picture, and environment successfully. This proposed system can provide a good achievement for 3D display application.
Downloads
References
Smolic, K. Mueller, P. Merkle, C. Fehn, P. Kauff, P. Eisert and T. Wiegand, 3D Video and Free
Viewpoint Video - Technologies, Applications and MPEG Standards. IEEE International
Conference on Multimedia, 2006, Expo. 2161-2164.
L. Onural, A. Smolic, and T. Sikora, An overview of a new European consortium: Integrated
three-dimensional television—Capture, transmission and display (3D TV). Proceedings of
European Workshop on the Integration of Knowledge, Semantics and Digital Media Technology,
(EWIMT), 25-26.
A. Smolic and D. McCutchen, 3DAV exploration of video-based rendering technology in MPEG.
IEEE Transactions on Circuits and Systems for Video Technology, 2004 14(3), 348-356.
A. Smolic and P. Kauff , Interactive 3-D video representation and coding technologies. IEEE Int.
Special ISSUE on Advances inVideo Coding and Delivery, 2005 93(1), 98-110.
L. Onural, T. Sikora, J. Ostermann, A. Smolic, R. Civanlar, and J. Watson, An assessment of
DTV technologies. Proceeding of NAB 2006, Las Vegas, 2006 NV, 456-467.
C. Fehn, Depth-Image-Based-Rendering (DIBR), Compression and Transmission for a New
Approach on 3D-TV. International Society for Optical Engineering Conf. Stereoscopic Displays
and Virtual Reality Systems, 2004 XI, 93-104
L. McMillan, An Image-Based Approach to Three-Dimensional Computer Graphics . PhD thesis,
University of North Carolina at Chapel Hill, Chapel Hill, NC, USA, 1997.
W. R. Mark, Post-Rendering 3D Image Warping: Visibility, Reconstruction, and Performance for
Depth-Image Warping. PhD thesis, University of North Carolina at Chapel Hill, Chapel Hill, NC,
USA, Apr.1999.
C. Fehn, K. Hopf and Q. Quante, Key Technologies for an Advanced 3D-TV System .
International Society for Optical Engineering Three-Dimensional TV, Video and Display III,
Philadelphia, PA, USA, 2004, 66-80.
W. J. Tam, G. Alain, L. Zhang, T. Martin, and R. Renaud , Smoothing Depth Maps for Improved
Stereoscopic Image Quality. International Society for Optical Engineering Conf. Three-
Dimensional TV, Video, and Display III, 2004, 162-172.
L. Zhang, and W. J. Tam, Stereoscopic Image Generation Based on Depth Images for 3DTV.
IEEE Transactions on Broadcasting, 2005, 191-199.
W. Y. Chen, Y. L. Chang, S. F. Lin, L. F. Ding, and L. G. Chen, Efficient Depth Image Based
Rendering with Edge Dependent Depth Filter and Interpolation. IEEE International Conference on
Multimedia and Expo. , 2005, 1314-1317.
P. Foggia, A.Limongiello, and M.Vento, A real-time stereo-vision system for moving object and
obstacle detection in AVG and AMR applications. Proceedings of Seventh International
Workshop on Computer Architecture for Machine Perception, 2005 CAMP, 58-63.
K. Mühlmann, D. Maier, J. Hesser, and R. Männer, Calculating Dense Disparity Maps from Color
Stereo Images, an Efficient Implementation. International Journal of Computer Vision, 2002, 79-
C. J. Kuo, C. Liao, and C. C. Jin, Stereoscopic Image Generation Based on Depth Images.
International Conference on Image Processing, 2004 Singapore, 2993-2996.
Photoshop textures: http://www.photoshoptextures.com/
Free textures got3D: http://free-textures.got3d.com/
Free textures CG-India: http://cg-india.com/free_textures.html
Highend3D: http://www.highend3d.com/maya/downloads
Autodesk: http://area.autodesk.com
Fudge Graphics Textures: http://www.fudgegraphics.com/2008/11/free-hi-res-autumn-texturestree-
silhouettes-leaves/
Free Texture Maps: http://freetexturemaps.com/
3D model: Dog(TOMMY) originally created by Prashant Chandra , provided by
http://www.highend3d.com/maya/
3D model: Old man (Alfred_1.2) originally created by Rodri Torres, 2006
RobinWood Textures:
http://www.robinwood.com/Catalog/FreeStuff/Textures/TexturePages/BallMaps.html
C. Fehn, K. Schr, I. Feldmann, P. Kauff, and A. Smolic, Distribution of ATTEST test sequences
for EE4 in MPEG 3DAV. ISO/IEC C1/SC29/WG11 MPEG02/M9219, December 2002.
A. Redert, M. Op de Beeck, C. Fehn, W. IJsselsteijn, M. Pollefeys, L. Van Gool, E. Ofek, I.
Sexton, and P. Surman, ATTEST－advanced three-dimensional television system techniques. In
Proc. 3D Data Processing Visualization and Transmission, Padova, Italy, 2002, 313-319.
I. Daribo, C. Tillier, and B. Pesquet-Popescu, Distance dependent depth filtering in 3D warping
for 3DTV. IEEE International Workshop on Multimedia Signal Processing, Crete, Greece , 2007,
-315.
