Raj Ratna Narwarde , Rahul Selokar , Paras Saraf , Hemant Ramole , Prof. S. S. Gadekar
Abstract
The growing adoption of digital education has transformed how children interact with learning environments. However, traditional e-learning platforms often lack engagement, interactivity, and physical involvement for young learners. This review focuses on the integration of computer vision technologies such as OpenCV and MediaPipe to create interactive, gesture-based educational systems. It highlights existing works like Virtual Canvas for Interactive Learning using OpenCV and Virtual Air Canvas using OpenCV and MediaPipe, examining how vision-based gesture tracking can support handwriting, drawing, and motion-controlled interaction. The proposed system, KidoVision, aims to enhance learning experiences through gamified content, real-time gesture detection, and story-based modules, promoting creativity and active participation. The review concludes that combining computer vision with gamified pedagogy can significantly improve cognitive development and motivation among children.
This paper reviewed the evolution of computer-vision-based interactive learning systems and proposed KidoVision, a gesture-driven e-learning framework aimed at children.
Unlike conventional platforms that rely on touch or keyboard inputs, KidoVision employs OpenCV and MediaPipe to recognize real-time gestures, enabling intuitive and playful interaction. The system aligns technological innovation with educational theory, fostering creativity, focus, and inclusivity.
By bridging computer vision, gamified pedagogy, and child psychology, KidoVision contributes to a new era of experiential learning where knowledge is both seen and felt. Its modular design allows future integration of AI tutors, emotion sensing, and AR environments, ensuring adaptability for the next generation of educational systems.
Ultimately, KidoVision demonstrates that technology, when thoughtfully designed, can restore the human element of joy, curiosity, and motion in digital learning.
References
[1] R. D. and Y. C., âA Review on Object Detection using OpenCV,â International Journal of Innovative Technology and Exploring Engineering (IJITEE), Vol. 8, Issue. 12, pp. 145â149, 2019.
[2] S. S. Shende, A. M. Patil, and P. D. Deshmukh, âReal-Time Object Detection using Deep-Learning and OpenCV,â International Research Journal of Engineering and Technology (IRJET), Vol. 7, Issue. 6, pp. 1102â1106, 2020.
[3] M. F. Khan, S. Beg, and F. Baig, âText Writing in Air,â Journal of Information Display, Vol. 14, Issue. 4, pp. 181â188, 2013.
[4] R. Z. Khan and N. Ibraheem, âHand Gesture Recognition: A Literature Review,â International Journal of Artificial Intelligence & Applications, Vol. 3, No. 4, pp. 161â174, 2012.
[5] S. Ren, K. He, R. Girshick, and J. Sun, âFaster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks,â Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), IEEE, USA, pp. 91â99, 2015.
[6] P. Rai, R. Gupta, V. Dsouza, and D. Jadhav, âVirtual Canvas for Interactive Learning using OpenCV,â Proceedings of the IEEE GCAT Conference, IEEE, Bangalore, India, pp. 242â247, 2022.
[7] R. H. V., B. G., D. K., N. M. S., and S. R. Sebastian, âVirtual Air Canvas using OpenCV and MediaPipe,â Proceedings of the IEEE INCOFT Conference, IEEE, Karnataka, India, pp. 215â219, 2022.
[8] J. Piaget, âThe Construction of Reality in the Child,â 1st Edition, Basic Books, USA, pp. 45â78, 1954. ISBN: 9780465097332.
[9] L. Vygotsky, âMind in Society: The Development of Higher Psychological Processes,â Harvard University Press, USA, pp. 22â55, 1978. ISBN: 9780674576292.
[10] R. M. Deci and E. L. Ryan, âIntrinsic Motivation and Self-Determination in Human Behavior,â Springer, USA, pp. 31â60, 1985. ISBN: 9780306420221.
[11] J. P. Gee, âWhat Video Games Have to Teach Us About Learning and Literacy,â Palgrave Macmillan, USA, pp. 12â27, 2007. ISBN: 9781403984532.
[12] S. Deterding, D. Dixon, R. Khaled, and L. Nacke, âFrom Game Design Elements to Gamefulness: Defining Gamification,â Proceedings of the MindTrek Conference, ACM, Finland, pp. 242â247, 2011.
[13] A. Paivio, âImagery and Verbal Processes,â Holt, Rinehart and Winston, USA, pp. 89â105, 1971. ISBN: 9780030850562.
[14] M. Csikszentmihalyi, âFlow: The Psychology of Optimal Experience,â Harper & Row, USA, pp. 112â134, 1990. ISBN: 9780060162535.
[15] G. Lakoff and M. Johnson, âPhilosophy in the Flesh: The Embodied Mind and Its Challenge to Western Thought,â Basic Books, USA, pp. 305â322, 1999. ISBN: 9780465056742.