Teaching and Learning Enhancement using Computer Vision and Generative AI


Authors : Aravapalli Sri Chaitanya; Ragalahari Akula; Pachava Hemanth; Tanarapu Praveen Kumar; Gurani Durga Suresh

Volume/Issue : Volume 10 - 2025, Issue 2 - February


Google Scholar : https://tinyurl.com/4w5t5aju

Scribd : https://tinyurl.com/yc8jxt8m

DOI : https://doi.org/10.5281/zenodo.14949832


Abstract : This research introduces a new method for classroom teaching development which combines intelligent AI components with gesture programming solutions and team-based tooling. Users can perform blackboard activities by writing drawings through the Virtual Hand-Controlled Blackboard system using hand gestures. Users can use this function to both record and download sessions to enhance their study capabilities. Through its AI-Powered Quiz Platform that runs on GeniusAI the system turns existing documents into quizzes which both tracks teacher monitoring of student progress and allows students to build customized assessments that boost their autonomous learning abilities. The Collaborative Chat System allows instant query resolutions between educators and learners to enhance their communication efforts. Students can access notas well as recorded classes through the system which makes knowledge consolidation easier to handle. The system delivers Multilingual Support by providing users access to their native language notes in audio and video formats which breaks down language obstacles. This teaching approach includes interactive and accessible and personalized elements to transform traditional education while enabling teachers and students to adapt their educational practices to present-day learning needs.

Keywords : Virtual Hand-Controlled Black Board, Gesture-Based Technology, AI-Powered Quiz Platform, Genius AI, Multilingual Support, Recorded Classes, Collaborative Chat System, Personalized Learning, Self-Driven Learning, Modern Education Tools.

References :

  1. Akshay Kumar, Harishchander Anandaram, Richa Pandey, Khursheed Alam, Sumit Chaudhary& Kapil Joshi. “Hand Gesture based AI Controller for Presentation, Virtual Drawing and System Volume Management”, (2024), D.O.I:10.1109/ICIPCN63822
  2. Subhash Chand Agrawal, Rajesh Kumar Tripathi, Neeraj Bhardwaj, & Prashun Parashar. “Virtual Drawing: An Air Paint Application”, (2024), D.O.I:10.1109/ICECAA58104
  3. Tianyi Zhang, Antonis Koutsoumpis, Janneke K. Oostrom, Djurre Holtrop, Sina Ghassemi, Reinout E. de Vries.”Can Large Language Models Assess Personality From Asynchronous Video Interviews? A Comprehensive Evaluation of Validity, Reliability, Fairness, and Rating Patterns”, (2024), D.O.I: 10.1109/TAFFC.2024.3374875
  4. Moresh Mukhedkar, Dilip P. Deshmukh, Om Chaudhari, Harshala Shinde, Amruta Shinde, Abhijeet Kadam. “Efficient Development of Gesture Language Translation System using CNN”,(2024),D.O.I: 10.1109/ICCCNT61001.2024.10725835
  5. Anagha H M, Kartika Nair, Maitreyi P, Sushma E. “Providing Security for a Chat Application using RSA Encryption with GPG”, (2024), D.O.I: 10.1109/INOCON60754.2024.10511348
  6. Zhehuai Chen, He Huang, Andrei Andrusenko, Oleksii Hrinchuk, Krishna C. Puvvada, Jason Li, Subhankar Ghosh, Jagadeesh Balam, Boris Ginsburg. “SALM: Speech-Augmented Language Model with In-Context Learning for Speech Recognition and Translation”, (2024), DOI: 10.1109/ICASSP48485.2024.10447553
  7. Pratik Pawar, Raghav Dube, Amogh Joshi, Zinee Gulhane, Ratna Patil. “Automated Generation and Evaluation of Multiple-Choice Quizzes using Langchain and Gemini LLM”, (2024), DOI: 10.1109/ICEECT61758.2024.10739326
  8. Yulia Kumar, Anjana Manikandan, J. Jenny Li, Patricia Morreale. “Optimizing Large Language Models for Auto-Generation of Programming Quizzes”, (2024), DOI: 10.1109/ISEC61299.2024.10665141
  9. Dr. Gladiss Merlin N R, Tamizh Malar S G, Prathiksha K, Nivedha P, Pavithra K. “PICTOQUIZEZZ: Engaging Cognitive_Learning”, (2023), DOI: 10.1109/RMKMATE59243.2023.10369158
  10. Yingzhe Tang, Mingzhang Pan, Hongqi Li, Xinxin Cao. "A Convolutional-Transformer-Based Approach for Dynamic Gesture Recognition of Data Gloves",(2024), DOI: 10.1109/TIM.2024.3400361
  11. Xuehao Zhou, Mingyang Zhang, Yi Zhou, Zhizheng Wu, Haizhou Li. "Accented Text-to-Speech Synthesis With Limited Data", (2024), DOI: 10.1109/TASLP.2024.3363414
  12. Tianrui Wang, Long Zhou, Ziqiang Zhang, Yu Wu, Shujie Liu, Yashesh Gaur, Zhuo Chen, Jinyu Li, Furu Wei. "VioLA: Conditional Language Models for Speech Recognition, Synthesis, and Translation", (2024), DOI:10.1109/TASLP.2024.3434425
  13. Wen-Chin Huang, Tomoki Hayashi, Yi-Chiao Wu, Hirokazu Kameoka, Tomoki Toda. "Pretraining Techniques for Sequence-to-Sequence Voice Conversion", (2021), DOI: 10.1109/TASLP.2021.3049336
  14. Mingyang Zhang, Yi Zhou, Yi Ren, Chen Zhang, Xiang Yin, and Haizhou Li. "RefXVC: Cross-Lingual Voice Conversion With Enhanced Reference Leveraging", (2024), DOI: 10.1109/TASLP.2024.3439996
  15. Mingyang Zhang, Yi Zhou, Li Zhao, Haizhou Li. "Transfer Learning From Speech Synthesis to Voice Conversion With Non-Parallel Training Data", (2021), DOI: 10.1109/TASLP.2021.3066047
  16. Tianrui Wang, Long Zhou, Ziqiang Zhang, Yu Wu, Shujie Liu, Yashesh Gaur, Zhuo Chen, Jinyu Li, Furu Wei. "VioLA: Conditional Language Models for Speech Recognition, Synthesis, and Translation", (2024), DOI:10.1109/TASLP.2024.3434425

This research introduces a new method for classroom teaching development which combines intelligent AI components with gesture programming solutions and team-based tooling. Users can perform blackboard activities by writing drawings through the Virtual Hand-Controlled Blackboard system using hand gestures. Users can use this function to both record and download sessions to enhance their study capabilities. Through its AI-Powered Quiz Platform that runs on GeniusAI the system turns existing documents into quizzes which both tracks teacher monitoring of student progress and allows students to build customized assessments that boost their autonomous learning abilities. The Collaborative Chat System allows instant query resolutions between educators and learners to enhance their communication efforts. Students can access notas well as recorded classes through the system which makes knowledge consolidation easier to handle. The system delivers Multilingual Support by providing users access to their native language notes in audio and video formats which breaks down language obstacles. This teaching approach includes interactive and accessible and personalized elements to transform traditional education while enabling teachers and students to adapt their educational practices to present-day learning needs.

Keywords : Virtual Hand-Controlled Black Board, Gesture-Based Technology, AI-Powered Quiz Platform, Genius AI, Multilingual Support, Recorded Classes, Collaborative Chat System, Personalized Learning, Self-Driven Learning, Modern Education Tools.

Never miss an update from Papermashup

Get notified about the latest tutorials and downloads.

Subscribe by Email

Get alerts directly into your inbox after each post and stay updated.
Subscribe
OR

Subscribe by RSS

Add our RSS to your feedreader to get regular updates from us.
Subscribe