AUTHORS: Ricardo J. M. Veiga, João A. R. Pereira, João D. P. Sardo, Roman Bajireanu, Pedro J. S. Cardoso, João M. F. Rodrigues

Download as PDF

The conventional museum experience offers the visitors glimpses of the past with the narrative limited to the static art that garnishes it. Through technology we already can mix the past with the future, immersing the visitors in a true dynamic journey across the same walls that guard our history. One of these technologies is the Augmented Reality, which aims to enhance our surroundings into a new era of creativity and discovery. This paper presents the proof-of-concept of an indoor portable environment pose estimation module (PEPE) present inside M5SAR, a project that aims to develop a five senses augmented reality system for museums. The current state of development of this module shows that is already achievable real-world wall(s) detection and a new environment superimposition over the detection, i.e., it is now possible to have a dynamic museum experience with the ability of transforming rooms into historic live stages.

KEYWORDS: Augmented Reality, Superimposition, Indoor Localization.

REFERENCES:

[ 1] Artoolkit. ARtoolKit, the world’s most widely used tracking library for augmented reality. http://artoolkit.org/, 2017. Retrieved: Nov. 16, 2017.

[2] Ronald Azuma, Yohan Baillot, Reinhold Behringer, Steven Feiner, Simon Julier, and Blair MacIntyre. Recent advances in augmented reality. IEEE Computer Graphics and Applications, 21(6):34–47, 2001. WSEAS TRANSACTIONS on MATHEMATICS Ricardo J. M. Veiga, João A. R. Pereira, João D. P. Sardo, Roman Bajireanu, Pedro J. S. Cardoso, João M. F. Rodrigues E-ISSN: 2224-2880 208 Volume 18, 2019

[3] Tim Bailey and Hugh Durrant-Whyte. Simultaneous localization and mapping (SLAM): Part II. IEEE Robotics & Automation Magazine, 13(3):108–117, 2006.

[4] Adrien Bartoli and Peter Sturm. Structure-frommotion using lines: Representation, triangulation, and bundle adjustment. Computer vision and image understanding, 100(3):416– 441, 2005.

[5] John Canny. A computational approach to edge detection. IEEE Transactions on pattern analysis and machine intelligence, (6):679–698, 1986.

[6] Catchoom. Catchoom. http://catchoom.com/, 2017. Retrieved: Nov. 16, 2017.

[7] Kun-Hung Cheng and Chin-Chung Tsai. Affordances of augmented reality in science learning: Suggestions for future research. Journal of Science Education and Technology, 22(4):449–462, 2013.

[8] Wenting Duan. Vanishing points detection and camera calibration. PhD thesis, University of Sheffield, 2011.

[9] Hugh Durrant-Whyte and Tim Bailey. Simultaneous localization and mapping: part I. IEEE robotics & automation magazine, 13(2):99–110, 2006.

[10] Ali Elqursh and Ahmed Elgammal. Line-based relative pose estimation. In Computer Vision and Pattern Recognition (CVPR), 2011 IEEE Conference on, pages 3049–3056. IEEE, 2011.

[11] Jakob Engel, Vladlen Koltun, and Daniel Cremers. Direct sparse odometry. IEEE transactions on pattern analysis and machine intelligence, 2017.

[12] Jakob Engel, Thomas Schöps, and Daniel Cremers. LSD-SLAM: Large-scale direct monocular slam. In European Conference on Computer Vision, pages 834–849. Springer, 2014.

[13] Estimote. Create magical experiences in the physical world. https://goo.gl/ OHW04y, 2017. Retrieved: April 04, 2017.

[14] HMS. Srbija 1914 / augmented reality exhibition at historical museum of Serbia, Belgrade. https://vimeo.com/126699550, 2017. Retrieved: April 04, 2017.

[15] Paul VC Hough. Method and means for recognizing complex patterns. Technical report, 1962.

[16] Rostislav Hulik, Michal Spanel, Pavel Smrz, and Zdenek Materna. Continuous plane detection in point-cloud data based on 3D Hough transform. Journal of Visual Communication and Image Representation, 25(1):86–97, 2014.

[17] InformationWeek. Informationweek: 10 fantastic iPhone, Android Apps for museum visits. https://goo.gl/XF3rj4, 2017. Retrieved: April 04, 2017.

[18] Nahum Kiryati, Yuval Eldar, and Alfred M Bruckstein. A probabilistic hough transform. Pattern recognition, 24(4):303–316, 1991.

[19] Kudan. Kudan computer vision. https://www.kudan.eu/, 2017. Retrieved: Nov. 16, 2017.

[20] Layar. Layar. https://www.layar.com/, 2017. Retrieved: Nov. 16, 2017.

[21] Paulo RS Mendon¸ca and Roberto Cipolla. A simple technique for self-calibration. In cvpr, page 1500. IEEE, 1999.

[22] Raul Mur-Artal, Jose Maria Martinez Montiel, and Juan D Tardos. Orb-slam: a versatile and accurate monocular slam system. IEEE Transactions on Robotics, 31(5):1147–1163, 2015.

[23] Nobuyuki Otsu. A threshold selection method from gray-level histograms. IEEE transactions on systems, man, and cybernetics, 9(1):62–66, 1979.

[24] Luís Pádua, Telmo Adão, David Narciso, António Cunha, Luís Magalhães, and Emanuel Peres. Towards modern cost-effective and lightweight augmented reality setups. International Journal of Web Portals (IJWP), 7(2):33–59, 2015.

[25] João AR Pereira, Ricardo JM Veiga, Marco AG de Freitas, JDP Sardo, Pedro JS Cardoso, and Joao MF Rodrigues. Mirar: Mobile image recognition based augmented reality framework. In International Congress on Engineering and Sustainability in the XXI Century, pages 321– 337. Springer, 2017.

[26] Qualcomm. Invisible museum. https://goo.gl/aS0NKh, 2017. Retrieved: April 04, 2017.

[27] James Ring. The laser in astronomy. New Scientist, 18(344):672–673, 1963.

[28] J.M.F. Rodrigues, J. Lessa, M. Gregório, C. Ramos, and P.J.S. Cardoso. An initial framework for a museum application for senior citizens. In. Proc. 7th Int. Conf. on Software Development and Technologies for Enhancing Accessibility and Fighting Info-exclusion, 2016.

[29] J.M.F. Rodrigues, J.A.R. Pereira, J.D.P. Sardo, M.A.G. Freitas, P.J.S. Cardoso, M. Gomes, and P. Bica. Adaptive card design UI implementation for an augmented reality museum application. In Proc. 11th Int. Conf. on Universal Access in Human-Computer Interaction, integrated in the 19th Int. Conf. on Human-Computer Interaction, 2017.

[30] João MF Rodrigues, Ricardo JM Veiga, Roman Bajireanu, Roberto Lam, João AR Pereira, Joao DP Sardo, Pedro JS Cardoso, and Paulo Bica. Mobile augmented reality framework-mirar. In International Conference on Universal Access in Human-Computer Interaction, pages 102–121. Springer, 2018.

[31] J.D.P. Sardo, J. Semião, J.M. Monteiro, J.A.R. Pereira, M. Freitas, J.M.F. Rodrigues, and E. Esteves. Portable device for touch, taste and smell sensations in augmented reality experiences. Accepted for the INternational CongRess on Engineering and Sustainability in the XXI cEntury – INCREaSE 2017, 2017.

[32] M. Serrão, S. Shahrabadi, M. Moreno, J. T. José, J. I. Rodrigues, J. M. F. Rodrigues, and J. M. H. du Buf. Computer vision and GIS for the navigation of blind persons in buildings. Universal Access in the Information Society, 14(1):67–80, 2015.

[33] SM. Science museum - atmosphere gallery. https://vimeo.com/20789653, 2017. Retrieved: April 04, 2017.

[34] L. Sousa, JMF Rodrigues, J. Monteiro, PJS Cardoso, J. Semião, and R. ALVES. A 3D gesture recognition interface for energy monitoring and control applications. Proceedings of ACE’14, pages 62–71, 2014.

[35] Shaharyar Ahmed Khan Tareen and Zahra Saleem. A comparative analysis of sift, surf, kaze, akaze, orb, and brisk. In Computing, Mathematics and Engineering Technologies (iCoMET), 2018 International Conference on, pages 1–10. IEEE, 2018.

[36] Giorgos Tolias and Yannis Avrithis. Speededup, relaxed spatial matching. In Computer Vision (ICCV), 2011 IEEE International Conference on, pages 1653– 1660. IEEE, 2011.

[37] TWSJ. The wall street journal: Best apps for visiting museums. https://goo.gl/ cPTyP9, 2017. Retrieved: April 04, 2017.

[38] Natalia Vainstein, Tsvi Kuflik, and Joel Lanir. Towards using mobile, head-worn displays in cultural heritage: User requirements and a research agenda. In Proc. 21st International Conference on Intelligent User Interfaces, pages 327–331. ACM, 2016.

[39] R.J.M. Veiga, R. Bajireanu, J.A.R. Pereira, J.D.P. Sardo, P. J.S. Cardoso, and João M.F. Rodrigues. Indoor environment and human shape detection for augmented reality: an initial study. In Procs23rd edition of the Portuguese Conference on Pattern Recognition, Amadora, Portugal, 28 Oct., pp. 21., 2017.

[40] Etienne Vincent and Robert Laganiére. Detecting planar homographies in an image pair. In Image and Signal Processing and Analysis, 2001. ISPA 2001. Proceedings of the 2nd International Symposium on, pages 182–187. IEEE, 2001.

[41] Junhao Xiao, Jianhua Zhang, Benjamin Adler, Houxiang Zhang, and Jianwei Zhang. Three-dimensional point cloud plane segmentation in both structured and unstructured environments. Robotics and Autonomous Systems, 61(12):1641–1652, 2013.