ARUN KUMAR V, ALAMELU MANGAI M

DOI: https://doi.org/10.5281/zenodo.24136812

Artificial Intelligence (AI) has significantly transformed human-computer interaction, with gesture and vision-based systems offering a new dimension of accessibility and efficiency. The AI Virtual Mouse utilizes computer vision and machine learning algorithms to enable cursor control, click, and scrolling actions through real-time hand gesture recognition using a standard webcam. This innovation eliminates the dependence on physical devices such as traditional mice, thereby enhancing hygiene, convenience, and inclusivity for users with mobility impairments. By employing algorithms such as Convolutional Neural Networks (CNN), MediaPipe Hand Tracking, and Support Vector Machines (SVM), the system achieves high accuracy and responsiveness across diverse environmental conditions. The proposed model further integrates evaluation metrics such as Confusion Matrix, Precision, Recall, F1-Score, and Accuracy to validate performance. Experimental outcomes demonstrate an accuracy of up to 99%, proving the robustness and reliability of the AI-based system. This project emphasizes the potential of intelligent, vision-driven interfaces to revolutionize interaction design and promote seamless, contactless computing experiences..

Artificial Intelligence, Computer Vision, Deep Learning, Face Recognition, Speech Recognition, Virtual ATM System, Secure Transactions, User Authentication, Cashless Banking, Contactless Interface, Financial Technology, Machine Learning, Convolutional Neural Network (CNN), Human-Computer Interaction, Biometric Verification..

In summary, the development of the proposed AI Virtual Mouse system underscores a meaningful shift in human-computer interaction by replacing traditional physical input devices with a gesture- and vision-based interface. Integrating hand-tracking and gesture-recognition technologies (for example, using frameworks like MediaPipe and OpenCV) allows users to control cursors, perform clicks, drags, and scrolls without touching a mouse. Numerous recent research works demonstrate the viability of such systems: one study achieved ~96% recognition accuracy for gesture-based cursor control. IJIREEICE+2irjaeh.com+2

The proposed system offers several significant advantages: enhanced accessibility for users with mobility impairments, hygiene improvement by minimizing surface contact, cost-effectiveness by relying on an ordinary webcam instead of specialized hardware, and a more intuitive, natural interface that aligns with modern interaction patterns. By setting concrete computational benchmarks—such as ≥ 25–30 fps frame rate, latency under ~50–100 ms, and gesture accuracy above 95%—this project aims to produce a responsive real-world solution rather than merely a research prototype. Nevertheless, the work also acknowledges key challenges and limitations: variability in lighting and background conditions, gesture ambiguity or mis-interpretation, hardware differences across users, fatigue from extended hand gestures, and the need for smooth user feedback and calibration. Furthermore, integrating the system seamlessly into existing operating systems and applications, while maintaining low cost and high reliability, remains a demanding task.Ultimately, the AI Virtual Mouse represents a forward-looking contribution to human-computer interaction. It bridges the gap between cutting-edge gesture-recognition research and practical usability in everyday computing. The successful implementation and evaluation of this system will open doors to broader applications, including assistive technologies, smart environments, virtual/augmented reality interfaces, and more hygienic public computing settings.

Joseph, I. Agustin & Sathiya Priya, A. “Virtual Mouse Using Hand Gesture Recognition.” International Journal of Innovative Research in Electrical, Electronics, Instrumentation and Control Engineering (IJIREEICE). DOI 10.17148/IJIREEICE.2025.13304. IJIREEICE

Trupti, G. M.; Chandhan Kumar; Dheeraj P; Vilas; Prasanna Kumar S. Shivaraddi. “Virtual Mouse Using Hand Gestures.” International Journal of Advanced Research in Computer and Communication Engineering (IJARCCE). DOI 10.17148/IJARCCE.2024.134203.
Peer-reviewed Journal

Purushothoman U. Khertfordshire. “A Computer Vision Based Virtual Hand Gesture Recognition System.” International Journal of Engineering Research and Sustainable Technologies (IJERST). DOI 10.63458/ijerst.v1i1.59. IJoERST

Suriya Prakash, J. & Nandhini, D. “Touchless Virtual Mouse Control Using Hand Gestures.” IJSART, Vol. 11 Issue 11, Nov. 2025. IJSART

Sampreeth S. “Hand Gesture Recognition-Based Virtual Mouse Using CNN.” IJRASET Journal for Research in Applied Science and Engineering Technology. DOI 10.22214/ijraset.2025.68259. IJRASET

Sangtani, V.S.; Porwal, A.; Kumar, A.; Sharma, A.; Kaushik, A. “Artificial Intelligence Virtual Mouse Using Hand Gesture.” International Journal of Modern Developments in Engineering and Science (IJMDES), Vol. 2 No. 5 (2023). IJMDES Journal

Uma Vignesh, P.; Thaqib-ul-Rahman, M.; Dheeraj, S.; Sai Charan Reddy, T.; Ayaz Uddin, M. “AI Virtual Mouse Using Hand Gesture Recognition.” International Research Journal on Advanced Engineering Hub (IRJAEH), Vol. 3 No. 05, May 2025.
DOI 10.47392/IRJAEH.2025.0332. Irjaeh

Dhiware, Prazjyot Milind; Patil, Pravin I.; Nikum, Manoj V. “Gesture Controlled Virtual Mouse with Voice Commands.” IJARCCE. DOI 10.17148/IJARCCE.2025.141060. Peer-reviewed
Journal

Sen, Abir; Mishra, Tapas Kumar; Dash, Ratnakar. “Deep learning based Hand gesture recognition system and design of a Human-Machine Interface.” arXiv preprint. (2022) arXiv

Kumar, Ratnesh; Anand, Angad; Mittal, Prachi; et al. “GestureCraft: Developing and Evaluating a Virtual Mouse System Using Hand Gestures for Intuitive

Human-Computer Interaction.” International Journal of Engineering Research & Technology (IJERT), Vol. 12 Issue 11, Nov. 2023



V. S. Sangtani, A. Porwal, A. Kumar, A. Sharma &
A. Kaushik, “Artificial Intelligence Virtual Mouse using Hand Gesture”, International Journal of Modern Developments in Engineering and Science (IJMDES), Vol. 2 No. 5 (2023). IJMDES Journal

Akhilesh Shukla, Dr. Devesh Katiyar & Gaurav Goel, “Gesture Recognition-based AI Virtual Mouse”, International Journal for Research in Applied Science & Engineering Technology (IJRASET), 2022. IJRASET

M. Hemalatha, V. Sreeja & S. Aswathi, “Hand Gesture Controlled Virtual Mouse”, International Journal of Advanced Research in Computer and Communication Engineering (IJARCCE), 2024. Peer-reviewed Journal

G. V. Bhole, S. Deshmukh, M. D. Gayakwad &
P. R. Devale, “Implementation of Virtual Mouse Control System Using Hand Gestures for Web Service Discovery”, International Journal of Intelligent Systems and Applications in Engineering (IJISAE), [Year not specified]. IJISAE

Pei Xu, “A Real-time Hand Gesture Recognition and Human-Computer Interaction System”, arXiv pre-print, 2017.




Agustin, J. I. & Sathiya Priya, A. (2025). Virtual Mouse Using Hand Gesture Recognition. International Journal of Innovative Research in Electrical, Electronics, Instrumentation and Control Engineering (IJIREEICE). DOI: 10.17148/IJIREEICE.2025.13304. IJIREEICE

Purushothoman, U. Khertfordshire. (2024). A Computer Vision Based Virtual Hand Gesture Recognition System. International Journal of Engineering Research and Sustainable Technologies (IJERST). DOI: 10.63458/ijerst.v1i1.59. IJoERST

Suriya Prakash, J. & Nandhini, D. (2025). Touchless Virtual Mouse Control Using Hand Gestures. IJSART, Vol. 11, Issue 11. IJSART

Trupti, G. M., Chandhan Kumar, Dheeraj P., Vilas, Prasanna Kumar S. Shivaraddi. (2024). Virtual Mouse Using Hand Gestures. International Journal of Advanced Research in Computer and Communication Engineering (IJARCCE). DOI: 10.17148/IJARCCE.2024.134203.
Peer-reviewed Journal

Dhiware, P. M., Patil, P. I., & Nikum, M. V. (2025). Gesture Controlled Virtual Mouse with Voice Commands. IJARCCE.
DOI: 10.17148/IJARCCE.2025.141060. Peer-reviewed
Journal

Indraneel, K. J. S., Reddy, P. N., Srinivas, G. L., Vara Prasad, J. A., & Vijay Kumar, A. (2023). Hand Gesture Based Virtual Mouse. IJRASET. DOI: 10.22214/ijraset.2023.51731. IJRASET

Shukla, A., Katiyar, D., & Goel, G. (2022). Gesture Recognition-based AI Virtual Mouse. IJRASET. DOI: 10.22214/ijraset.2022.40937. IJRASET

Sampreeth, S. (2025). Hand Gesture Recognition-Based Virtual Mouse Using CNN. IJRASET. DOI: 10.22214/ijraset.2025.68259. IJRASET

Kadam, P., Junagre, M., Khalate, S., Jadhav, V., & Shewale, P. (2023). Gesture Recognition based Virtual Mouse and Keyboard. IJRASET. DOI: 10.22214/ijraset.2023.51971. IJRASET

Sangtani, V. S., Porwal, A., Kumar, A., Sharma, A., & Kaushik, A. (2023). Artificial Intelligence Virtual Mouse using Hand Gesture. International Journal of Modern Developments in Engineering and Science (IJMDES), Vol. 2 No. 5.

ARUN KUMAR V, ALAMELU MANGAI M (2026). SMART CASH TERMINAL USING EMBEDDED SYSTEMS FOR AUTOMATED PAYMENT PROCESSING.. International Journal of Computer Science Engineering Techniques, 10(6), 421–427. ISSN: 2455-135X. DOI: https://doi.org/10.5281/zenodo.24136812