Copyright and Licensing
Articles accepted for publication will be licensed under the Creative Commons BY-NC-SA. Authors must sign a non-exclusive distribution agreement after article acceptance.
Estimating Illumination Direction for Augmented Reality in Real-Time by using Low-Cost Sensors
DOI:
https://doi.org/10.24215/16666038.17.e20Keywords:
Augmented Reality, Illumination, Real- Time, Arduino, Android, Unity3d, Human Computer InteractionAbstract
In recent years, Augmented Reality has become a very popular topic, both as a research and commercial field. This trend has originated with the use of mobile devices as computational core and display. The appearance of virtual objects and their interaction with the real world is a key element in the success of an Augmented Reality software. A common issue in this type of software is the visual inconsistency between the virtual and real objects due to wrong illumination. Although illumination is a common research topic in Computer Graphics, few studies have been made about real time estimation of illumination direction. In this work we present a low-cost approach to detect the direction of the environment illumination, allowing the illumination of virtual objects according to the real light of the ambient, improving the integration of the scene. Our solution is open-source, based on Arduino hardware and the presented system was developed on Android.
Downloads
Download data is not yet available.
References
[1] G. W. Fitzmaurice, S. Zhai, and M. H. Chignell, “Virtual reality for palmtop computers,” ACM Transactions on Information Systems (TOIS), vol. 11, no. 3, pp. 197–218, 1993.
[2] X. Zhang, S. Fronz, and N. Navab, “Visual marker detection and decoding in ar systems: A comparative study,” in Proceedings of the 1st International Symposium on Mixed and Augmented Reality, p. 97, IEEE Computer Society, 2002.
[3] D. Wagner, G. Reitmayr, A. Mulloni, T. Drummond, and D. Schmalstieg, “Real-time detection
and tracking for augmented reality on mobile phones,” IEEE transactions on visualization and computer graphics, vol. 16, no. 3, pp. 355–368, 2010.
[4] R. T. Azuma, “A survey of augmented reality,” Presence: Teleoperators and virtual environments, vol. 6, no. 4, pp. 355–385, 1997.
[5] D. Van Krevelen and R. Poelman, “A survey of augmented reality technologies, applications and limitations,” International Journal of Virtual Reality, vol. 9, no. 2, p. 1, 2010.
[6] P. Supan and I. Stuppacher, “Interactive image based lighting in augmented reality,” in Central European Seminar on Computer Graphics, vol. 17, p. 18, 2006.
[7] S. DiVerdi and T. Höllerer, “Combining dynamic physical and virtual illumination in augmented reality,” Environment, vol. 5, p. 12, 2004.
[8] K. Jacobs, J.-D. Nahmias, C. Angus, A. Reche, C. Loscos, and A. Steed, “Automatic generation of consistent shadows for augmented reality,” in Proceedings of Graphics Interface 2005, pp. 113–120, Canadian Human-Computer Communications Society, 2005.
[9] J.-F. Lalonde, A. A. Efros, and S. G. Narasimhan, “Estimating natural illumination from a single outdoor image,” in 2009 IEEE 12th International Conference on Computer Vision, pp. 183–190, IEEE, 2009.
[10] Y. Liu and X. Granier, “Online tracking of outdoor lighting variations for augmented reality with moving cameras,” IEEE Transactions on visualization and computer graphics, vol. 18, no. 4, pp. 573–580, 2012.
[11] M. Clements and A. Zakhor, “Interactive shadow analysis for camera heading in outdoor images,” in 2014 IEEE International Conference on Image Processing (ICIP), pp. 3367–3371, IEEE, 2014.
[12] J. Jachnik, R. A. Newcombe, and A. J. Davison, “Real-time surface light-field capture for augmentation of planar specular surfaces,” in Mixed and Augmented Reality (ISMAR), 2012 IEEE International Symposium on, pp. 91–97, IEEE, 2012.
[13] G. Xing, X. Zhou, Q. Peng, Y. Liu, and X. Qin, “Lighting simulation of augmented outdoor scene
based on a legacy photograph,” in Computer Graphics Forum, vol. 32, pp. 101–110, Wiley Online Library, 2013.
[14] H. Kolivand, M. Kolivand, M. S. Sunar, and M. A. M. Arsad, “A fast silhouette detection algorithm for shadow volumes in augmented reality,” World Academy of Science, Engineering and Technology, International Journal of Computer, Electrical, Automation, Control and Information Engineering, vol. 10, no. 4, pp. 668–672, 2016.
[15] I. Arief, S. McCallum, and J. Y. Hardeberg, “Realtime estimation of illumination direction for augmented reality on mobile devices,” in Color and Imaging Conference, vol. 2012, pp. 111–116, Society for Imaging Science and Technology, 2012.
[16] K. Rohmer, W. Büschel, R. Dachselt, and T. Grosch, “Interactive near-field illumination for photorealistic augmented reality on mobile devices,” in Mixed and Augmented Reality (ISMAR), 2014 IEEE International Symposium on, pp. 29–38, IEEE, 2014.
[17] L. Gruber, T. Langlotz, P. Sen, T. Höherer, and D. Schmalstieg, “Efficient and robust radiance transfer for probeless photorealistic augmented reality,” in 2014 IEEE Virtual Reality (VR), pp. 15–20, IEEE, 2014.
[18] M. Slater, M. Usoh, and Y. Chrysanthou, “The influence of dynamic shadows on presence in immersive virtual environments,” in Virtual Environments 95, pp. 8–21, Springer, 1995.
[2] X. Zhang, S. Fronz, and N. Navab, “Visual marker detection and decoding in ar systems: A comparative study,” in Proceedings of the 1st International Symposium on Mixed and Augmented Reality, p. 97, IEEE Computer Society, 2002.
[3] D. Wagner, G. Reitmayr, A. Mulloni, T. Drummond, and D. Schmalstieg, “Real-time detection
and tracking for augmented reality on mobile phones,” IEEE transactions on visualization and computer graphics, vol. 16, no. 3, pp. 355–368, 2010.
[4] R. T. Azuma, “A survey of augmented reality,” Presence: Teleoperators and virtual environments, vol. 6, no. 4, pp. 355–385, 1997.
[5] D. Van Krevelen and R. Poelman, “A survey of augmented reality technologies, applications and limitations,” International Journal of Virtual Reality, vol. 9, no. 2, p. 1, 2010.
[6] P. Supan and I. Stuppacher, “Interactive image based lighting in augmented reality,” in Central European Seminar on Computer Graphics, vol. 17, p. 18, 2006.
[7] S. DiVerdi and T. Höllerer, “Combining dynamic physical and virtual illumination in augmented reality,” Environment, vol. 5, p. 12, 2004.
[8] K. Jacobs, J.-D. Nahmias, C. Angus, A. Reche, C. Loscos, and A. Steed, “Automatic generation of consistent shadows for augmented reality,” in Proceedings of Graphics Interface 2005, pp. 113–120, Canadian Human-Computer Communications Society, 2005.
[9] J.-F. Lalonde, A. A. Efros, and S. G. Narasimhan, “Estimating natural illumination from a single outdoor image,” in 2009 IEEE 12th International Conference on Computer Vision, pp. 183–190, IEEE, 2009.
[10] Y. Liu and X. Granier, “Online tracking of outdoor lighting variations for augmented reality with moving cameras,” IEEE Transactions on visualization and computer graphics, vol. 18, no. 4, pp. 573–580, 2012.
[11] M. Clements and A. Zakhor, “Interactive shadow analysis for camera heading in outdoor images,” in 2014 IEEE International Conference on Image Processing (ICIP), pp. 3367–3371, IEEE, 2014.
[12] J. Jachnik, R. A. Newcombe, and A. J. Davison, “Real-time surface light-field capture for augmentation of planar specular surfaces,” in Mixed and Augmented Reality (ISMAR), 2012 IEEE International Symposium on, pp. 91–97, IEEE, 2012.
[13] G. Xing, X. Zhou, Q. Peng, Y. Liu, and X. Qin, “Lighting simulation of augmented outdoor scene
based on a legacy photograph,” in Computer Graphics Forum, vol. 32, pp. 101–110, Wiley Online Library, 2013.
[14] H. Kolivand, M. Kolivand, M. S. Sunar, and M. A. M. Arsad, “A fast silhouette detection algorithm for shadow volumes in augmented reality,” World Academy of Science, Engineering and Technology, International Journal of Computer, Electrical, Automation, Control and Information Engineering, vol. 10, no. 4, pp. 668–672, 2016.
[15] I. Arief, S. McCallum, and J. Y. Hardeberg, “Realtime estimation of illumination direction for augmented reality on mobile devices,” in Color and Imaging Conference, vol. 2012, pp. 111–116, Society for Imaging Science and Technology, 2012.
[16] K. Rohmer, W. Büschel, R. Dachselt, and T. Grosch, “Interactive near-field illumination for photorealistic augmented reality on mobile devices,” in Mixed and Augmented Reality (ISMAR), 2014 IEEE International Symposium on, pp. 29–38, IEEE, 2014.
[17] L. Gruber, T. Langlotz, P. Sen, T. Höherer, and D. Schmalstieg, “Efficient and robust radiance transfer for probeless photorealistic augmented reality,” in 2014 IEEE Virtual Reality (VR), pp. 15–20, IEEE, 2014.
[18] M. Slater, M. Usoh, and Y. Chrysanthou, “The influence of dynamic shadows on presence in immersive virtual environments,” in Virtual Environments 95, pp. 8–21, Springer, 1995.
Downloads
Published
2017-10-01
How to Cite
Soulier, K. E., Selzer, M. N., & Larrea, M. L. (2017). Estimating Illumination Direction for Augmented Reality in Real-Time by using Low-Cost Sensors. Journal of Computer Science and Technology, 17(02), e20. https://doi.org/10.24215/16666038.17.e20
Issue
Section
Invited Articles
License
