International Journal of Mathematical Sciences and Computing (IJMSC)
IJMSC Vol. 2, No. 4, 8 Nov. 2016
Cover page and Table of Contents: PDF (size: 353KB)
Real Time Webcam based Infrared Tracking for Projection Display System
Full Text (PDF, 353KB), PP.41-53
Views: 0 Downloads: 0
Author(s)
Aniket Kudale
1,*
Kirti Wanjale
1
Index Terms
Human Computer Interaction, Camera-Projector System, User Interface, Infrared Tracking
Abstract
In this paper, we propose an interaction based projection display system, which enables an infrared pen touch interaction on flat surface (e.g. walls, whiteboard, tables), with a webcam (with an infrared filter removed) and a projector. The challenge of infrared pen touch detection is to sense the touching and movement information of an infrared pen on the surface just from the 2-dimensional image captured by the webcam. In our method, the content of a computer is projected on the surface and the user interacts with the surface using an infrared pen, the movement of an infrared pen is captured by the webcam. Here, the infrared LED light act as a tracking point which helps in controlling the content projected on surface. The proposed method is performed in three stages: 1) the infrared pen LED image is captured and tracked using webcam 2) the calibration of webcam-projector setup is done by principle of Homography 3) the tracked coordinates or location of Infrared pen LED is mapped to computer cursor. By this way, movement of infrared pen allows user to control computer content projected on the surface.
Cite This Paper
Aniket Kudale, Kirti Wanjale,"Real Time Webcam based Infrared Tracking for Projection Display System", International Journal of Mathematical Sciences and Computing(IJMSC), Vol.2, No.4, pp.41-53, 2016.DOI: 10.5815/ijmsc.2016.04.05
Reference
[1]Hu, Jun, et al. "Bare-fingers Touch Detection by the Button's Distortion in Projector-camera System.", IEEE Transactions on Circuits and Systems for Video Techmology, vol. 24, no. 4, pp. 566-575 , April 2014.
[2]Chen, Rui, Po-Jui Ray Chen, Rui Feng, Yilin Elaine Liu, Andy Wu, and Ali Mazalek. "SciSketch: a tabletop collaborative sketching system." In Proceedings of the 8th International Conference on Tangible, Embedded and Embodied Interaction, pp. 247-250. ACM, Feb. 2014.
[3]Şimşek, Serdar, and Pınar Onay Durdu. "Developing an Interactive Learning Environment with Kinect." In HCI International 2014-Posters' Extended Abstracts, pp. 150-155. Springer International Publishing, 2014.
[4]Amano, Toshiyuki. "Projection Center Calibration for a Co-located Projector Camera System." Computer Vision and Pattern Recognition Workshops (CVPRW) IEEE Conference, pp. 449-454, June. 2014.
[5]Dai, Jingwen, and C-KR Chung. "Touchscreen Everywhere: On Transferring a Normal Planar Surface to a Touch-Sensitive Display." IEEE Transaction on Cybernetics, vol. 44, no. 8, pp. 1383-1396, Aug. 2014.
[6]Soares, Christophe, Rui S. Moreira, José M. Torres, and Pedro Sobral. "LoCoBoard: Low-Cost Interactive Whiteboard Using Computer Vision Algorithms." ISRN Machine Vision, vol. 2013.
[7]Al-Rahayfeh, A. M. E. R., and M. I. A. D. Faezipour. "Eye Tracking and Head Movement Detection: A State-of-Art Survey."IEEE Journal of Translational Engineering in Health and Medicine, vol. 1, Nov. 2013.
[8]Lin, Chien-Yu, Ming Chi Lin, Li-Jun Shih, and Wei-Hsuan Hu. "Application of low-cost interactive floors on special education and assistive technology." International Journal of Elementary Education, vol. 2, no. 1, pp. 1-7, 2013.
[9]Lech, Michal, Bozena Kostek, and Andrzej Czyzewski. "Virtual Whiteboard: A gesture-controlled pen-free tool emulating school whiteboard." Intelligent Decision Technologies, vol. 6, no. 2, pp. 161-169, Feb. 2012.
[10]Ronchetti, Marco, and Mattia Avancini. "Using Kinect to emulate an Interactive Whiteboard." MS in Computer Science, University of Trento, 2011.
[11]Zhang, Shuai, Wenrui He, Qiao Yu, and Xiaojuan Zheng. "Low-cost interactive whiteboard using the Kinect." International Conference on Image Analysis and Signal Processing (IASP), pp. 1-5. 2012.
[12]Rautaray, Siddharth S., and Anupam Agrawal. "Real time hand gesture recognition system for dynamic applications." International Journal of UbiComp, vol. 3, no. 1, pp. 21-31, Jan 2012.
[13]Bosetti, Massimo, Pietro Pilolli, Matteo Ruffoni, and Marco Ronchetti. "Interactive whiteboards based on the WiiMote: Validation on the field." 14th International Conference on Interactive Collaborative Learning (ICL), pp. 269-273, Sept. 2011.
[14]Lech, Michal, and Bozena Kostek. "Gesture-based computer control system applied to the interactive whiteboard." 2nd International Conference on Information Technology (ICIT), pp. 75-78, Jun. 2010.
[15]Mistry, Pranav, Pattie Maes, and Liyan Chang. "WUW-wear Ur world: a wearable gestural interface." In CHI'09 extended abstracts on Human factors in computing systems, pp. 4111-4116. ACM, Apr. 2009.
[16]Schreiber, Michael, Margeritta von Wilamowitz-Moellendorff, and Ralph Bruder. "New interaction concepts by using the wii remote." In Human-Computer Interaction. Novel Interaction Methods and Techniques, pp. 261-270. Springer Berlin Heidelberg, 2009.
[17]Lee, Johnny Chung. "Hacking the nintendo wii remote." Pervasive Computing, IEEE, vol.7, no. 3, pp. 39-45, Jul. 2008.
[18]Pallejà, Tomàs, Edgar Rubión Soler, Mercè Teixido, Marcel Tresanchez, Alicia Fernández del Viso, Carlos Rebate Sánchez, and Jordi Palacin. "Using the Optical Flow to Implement a Relative Virtual Mouse Controlled by Head Movements." Journal of Universal Computer Science, vol. 14, no. 19, pp. 3127-3141, Nov. 2008.
[19]Argyros, Antonis A., and Manolis IA Lourakis. "Vision-based interpretation of hand gestures for remote control of a computer mouse." In Computer Vision in Human-Computer Interaction, pp. 40-51. Springer Berlin Heidelberg, 2006.
[20]Wilson, Andrew D. "PlayAnywhere: a compact interactive tabletop projection-vision system." In Proceedings of the 18th annual ACM symposium on User interface software and technology, pp. 83-92. ACM, Oct. 2005.
[21]Bérard, François. "The magic table: Computer-vision based augmentation of a whiteboard for creative meetings." In IEEE workshop on Projector-Camera Systems. Oct. 2003.
[22]Criminisi, A "Computing the plane to plane homography". http://www.robots.ox.ac.uk/~vgg/presentations/bmvc97/criminispaper, 1997, [Online]
[23]Logitech Webcam - http://www.logitech.com/en-in/product/webcam-c170
[24]Canon Projector http://www.usa.canon.com/cusa/consumer/products/projectors/ portable_projectors/-le_5w_bk
[25]IR Filter Removal - http://www.diyphotography.net/are-you-brave-enough-to-ir-ize-your-camera/ - Sept. 2012.
[26]Aniket E. Kudale and K. H. Wanjale, "Human Computer Interaction Model based Virtual Whiteboard: A Review.", In International Journal of Computer Applications, pp. 44-47, November 2015.