ANALYSIS AND EVALUATION OF FEATURE DETECTION AND TRACKING TECHNIQUES USING OPENCV WITH FOCUS ON MARKERLESS AUGMENTED REALITY APPLICATIONS
Keywords:Augmented Reality, OpenCV, feature detector
Augmented Reality (AR) is a technology able to extend human interactions with the real world. One field of study in AR is the use of real objects as markers. To perform this task, feature recognition of the real world by computer systems must be performed. This work consists in the analysis and evaluation of several algorithms available in OpenCV library that allow the detection of pre-established patterns in images and videos. The main contribution of this work is to present the most appropriate combination of algorithms to help the development of markerless AR applications.
R. Azuma, Y. Baillot, R. Behringer, S. Feiner, S. Julier and B. MacIntyre (2001), Recent advances
in augmented reality, IEEE Computer Graphics and Applications, Vol.21, N.6, pp. 34-47.
I. E. Sutherland (1968), A head-mounted three dimensional display, Managing Requirements Knowledge,
International Workshop on, Vol.0, pp. 757.
S. F. Kurniawan, I. K. G. Darma Putra and A. A. K. Sudana (2014), Bone fracture detection using
OpenCV, Journal of Theoretical and Applied Information Technology, Vol.64, N.1, pp. 249–254.
A. Roy, N. Gale and L. Hong (2011), Automated traffic surveillance using fusion of Doppler radar
and video information, Mathematical and Computer Modelling, Vol.54, N.1–2, pp. 531–543.
P. M. Panchal, S. R. Panchal and S. K. Shah (2013), A Comparison of SIFT and SURF, International
Journal of Innovative Research in Computer and Communication Engineering, Vol.1, N.2,
K. V. S. Bezerra and E. Aguiar (2013), Casamento de padrões em imagens e vídeos usando características
de imagens, Workshop of Undergraduate Works (WUW) in SIBGRAPI 2013 (XXVI
Conference on Graphics, Patterns and Images).
J. Heinly, E. Dunn and JM. Frahm (2012), Comparative evaluation of binary features, Computer
Vision – ECCV 2012, Vol.7573, pp 759-773.
D. Mukherjee, Q. M. Jonathan Wu and G. Wang (2015), A comparative experimental study
of image feature detectors and descriptors, Machine Vision and Applications, Vol.26, N.4, pp.
E. Rublee, V. Rabaud, K. Konolige and G. Bradski (2011), ORB: An efficient alternative to SIFT
or SURF, 2011 International Conference on Computer Vision (Barcelona), pp. 2564-2571.
R. Bouchiha and K. Besbes (2015), Comparison of local descriptors for automatic remote sensing
image registration, Signal, Image and Video Processing, Vol.9, N.2, pp. 463–469.
E. Chatzilari, G. Liaros, S. Nikolopoulos and Y. Kompatsiaris (2013), A comparative study on
mobile visual recognition, Machine Learning and Data Mining in Pattern Recognition: 9th International
Conference, MLDM 2013, Proceedings, pp. 442-457.
O. D. Suarez, M. M. F. Carrobles, N. V. Enano, G. B. Garcia, I. S. Gracia, J. A. P. Incertis
and J. S. Tercero (2014), OpenCV essentials: acquire, process, and analyze visual content to build
full-fledged imaging applications using OpenCV, Packt Publishing Ltd (Birmingham).
E. Rosten and T. Drummond (2006), Machine learning for high-speed corner detection, Computer
Vision – ECCV 2006, Lecture Notes in Computer Science, Vol.3951, pp. 430–443.
S. Leutenegger, M. Chli and R. Y. Siegwart (2011), BRISK: Binary Robust invariant scalable
keypoints, International Conference on Computer Vision (Barcelona), pp. 2548-2555.
Jianbo Shi and C. Tomasi (1994), Good features to track, Proceedings of IEEE Conference on
Computer Vision and Pattern Recognition (Seattle), pp. 593-600.
C. Harris and M. Stephens (1988), A combined corner and edge detector, In Proc. of Fourth Alvey
Vision Conference, pp. 147-151.
J. Matas, O. Chum, M. Urban and T. Pajdla (2004), Robust wide-baseline stereo from maximally
stable extremal regions, Image and Vision Computing, Vol.22, I.10, pp. 761-767.
D. G. Lowe (1999), Object recognition from local scale-invariant features, Proceedings of the Seventh
IEEE International Conference on Computer Vision (Kerkyra), Vol.2, pp. 1150-1157.
M. Agrawal, K. Konolige and M. R. Blas (2008), CenSurE:Center Surround Extremas for realtime
feature detection and matching, Computer Vision – ECCV 2008, Lecture Notes in Computer
Science, Vol 5305, pp 102-115.
H. Bay, T. Tuytelaars and L. Van Gool (2006), SURF: Speeded Up Robust Features, Computer
Vision – ECCV 2006, Lecture Notes in Computer Science, Vol.3951, pp. 404-417.
M. Calonder, V. Lepetit, C. Strecha and P. Fua (2010), BRIEF: Binary Robust Independent Elementary
Features, Computer Vision – ECCV 2010, Lecture Notes in Computer Science, Vol.6314,
A. Alahi, R. Ortiz and P. Vandergheynst (2012), FREAK: Fast Retina Keypoint, IEEE Conference
on Computer Vision and Pattern Recognition (Providence), pp. 510-517.
M. Muja and D. Lowe (2009), Fast approximate nearest neighbors with automatic algorithm configuration,
In VISAPP International Conference on Computer Vision Theory and Applications,
A. Ufkes and M. Fiala (2013), A markerless augmented reality system for mobile devices, International
Conference on Computer and Robot Vision (Regina), pp. 226-233.