Raj Ratna Narwarde , Rahul Selokar , Paras Saraf , Hemant Ramole , Prof. S. S. Gadekar
Abstract
The growing adoption of digital education has transformed how children interact with learning environments. However, traditional e-learning platforms often lack engagement, interactivity, and physical involvement for young learners. This review focuses on the integration of computer vision technologies such as OpenCV and MediaPipe to create interactive, gesture-based educational systems. It highlights existing works like Virtual Canvas for Interactive Learning using OpenCV and Virtual Air Canvas using OpenCV and MediaPipe, examining how vision-based gesture tracking can support handwriting, drawing, and motion-controlled interaction. The proposed system, KidoVision, aims to enhance learning experiences through gamified content, real-time gesture detection, and story-based modules, promoting creativity and active participation. The review concludes that combining computer vision with gamified pedagogy can significantly improve cognitive development and motivation among children.
This paper reviewed the evolution of computer-vision-based interactive learning systems and proposed KidoVision, a gesture-driven e-learning framework aimed at children.
Unlike conventional platforms that rely on touch or keyboard inputs, KidoVision employs OpenCV and MediaPipe to recognize real-time gestures, enabling intuitive and playful interaction. The system aligns technological innovation with educational theory, fostering creativity, focus, and inclusivity.
By bridging computer vision, gamified pedagogy, and child psychology, KidoVision contributes to a new era of experiential learning where knowledge is both seen and felt. Its modular design allows future integration of AI tutors, emotion sensing, and AR environments, ensuring adaptability for the next generation of educational systems.
Ultimately, KidoVision demonstrates that technology, when thoughtfully designed, can restore the human element of joy, curiosity, and motion in digital learning.
References
[1] R. D. and Y. C., βA Review on Object Detection using OpenCV,β International Journal of Innovative Technology and Exploring Engineering (IJITEE), Vol. 8, Issue. 12, pp. 145β149, 2019.
[2] S. S. Shende, A. M. Patil, and P. D. Deshmukh, βReal-Time Object Detection using Deep-Learning and OpenCV,β International Research Journal of Engineering and Technology (IRJET), Vol. 7, Issue. 6, pp. 1102β1106, 2020.
[3] M. F. Khan, S. Beg, and F. Baig, βText Writing in Air,β Journal of Information Display, Vol. 14, Issue. 4, pp. 181β188, 2013.
[4] R. Z. Khan and N. Ibraheem, βHand Gesture Recognition: A Literature Review,β International Journal of Artificial Intelligence & Applications, Vol. 3, No. 4, pp. 161β174, 2012.
[5] S. Ren, K. He, R. Girshick, and J. Sun, βFaster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks,β Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), IEEE, USA, pp. 91β99, 2015.
[6] P. Rai, R. Gupta, V. Dsouza, and D. Jadhav, βVirtual Canvas for Interactive Learning using OpenCV,β Proceedings of the IEEE GCAT Conference, IEEE, Bangalore, India, pp. 242β247, 2022.
[7] R. H. V., B. G., D. K., N. M. S., and S. R. Sebastian, βVirtual Air Canvas using OpenCV and MediaPipe,β Proceedings of the IEEE INCOFT Conference, IEEE, Karnataka, India, pp. 215β219, 2022.
[8] J. Piaget, βThe Construction of Reality in the Child,β 1st Edition, Basic Books, USA, pp. 45β78, 1954. ISBN: 9780465097332.
[9] L. Vygotsky, βMind in Society: The Development of Higher Psychological Processes,β Harvard University Press, USA, pp. 22β55, 1978. ISBN: 9780674576292.
[10] R. M. Deci and E. L. Ryan, βIntrinsic Motivation and Self-Determination in Human Behavior,β Springer, USA, pp. 31β60, 1985. ISBN: 9780306420221.
[11] J. P. Gee, βWhat Video Games Have to Teach Us About Learning and Literacy,β Palgrave Macmillan, USA, pp. 12β27, 2007. ISBN: 9781403984532.
[12] S. Deterding, D. Dixon, R. Khaled, and L. Nacke, βFrom Game Design Elements to Gamefulness: Defining Gamification,β Proceedings of the MindTrek Conference, ACM, Finland, pp. 242β247, 2011.
[13] A. Paivio, βImagery and Verbal Processes,β Holt, Rinehart and Winston, USA, pp. 89β105, 1971. ISBN: 9780030850562.
[14] M. Csikszentmihalyi, βFlow: The Psychology of Optimal Experience,β Harper & Row, USA, pp. 112β134, 1990. ISBN: 9780060162535.
[15] G. Lakoff and M. Johnson, βPhilosophy in the Flesh: The Embodied Mind and Its Challenge to Western Thought,β Basic Books, USA, pp. 305β322, 1999. ISBN: 9780465056742.