Authors :
Dr. Shivani Yadao; Harshita Vyas; A. Likhitha; Pooja Chawan
Volume/Issue :
Volume 11 - 2026, Issue 4 - April
Google Scholar :
https://tinyurl.com/wb9xf7jt
Scribd :
https://tinyurl.com/5auvf4jx
DOI :
https://doi.org/10.38124/ijisrt/26apr2193
Note : A published paper may take 4-5 working days from the publication date to appear in PlumX Metrics, Semantic Scholar, and ResearchGate.
Abstract :
The increasing need for user-friendly, contactless control systems has drawn a lot of attention to human-drone
interaction in recent years. In this paper, a computer vision and machine learning-based hand gesture control system for a
quadcopter drone is presented. The suggested system tracks and detects hand landmarks using the MediaPipe framework
and records real-time video frames using a webcam. Fist, Open palm, and the directional hand movements are examples of
the kind of gesture that is interpreted as flight command by analyzing the spatial locations of the important hand points.
The left hand uses the distance between the chosen landmarks for altitude variation, while the right hand is utilized for the
direction of the motion. Proportional-derivative (PD) control mechanism and smoothing filters are utilized for stability.
Moreover, the hand-locking mechanism for cybersecurity, which checks for the pattern of the gesture, is introduced for
secure drone control. Gesture-based takeoff and landing, as well as automatic landing in the absence of hands, are
examples of the safety features. The results of the experiment reveal the stability of the drone in indoor space with
improved security and gesture recognition.
Keywords :
Computer Vision, Drone, Hand Gesture, Machine Learning, Secure.
References :
- M. Wazid, A. K. Das, N. Kumar, and J. J. P. C. Rodrigues, “SLAKA-IoD: A Secure and Lightweight Authentication and Key Agreement Protocol for Internet of Drones,” IEEE Transactions on Vehicular Technology, vol. 69, no. 6, pp. 6549–6560, 2020.
- X. Li, J. Niu, S. Kumari, F. Wu, and A. K. Das, “Lightweight Ring-Neighbor-Based User Authentication and Group-Key Agreement for Internet of Drones,” IEEE Internet of Things Journal, vol. 7, no. 10, pp. 10283–10296, 2020.
- Y. Zhang, L. Wu, and H. Li, “Efficient and Scalable Authentication Framework for Internet of Drones (IoD) Networks,” IEEE Access, vol. 8, pp. 134760–134772, 2020.
- S. Sharma and P. Kumar, “An Efficient Framework for Secure Communication in Internet of Drone Networks Using Deep Computing,” IEEE Access, vol. 8, pp. 113310–113322, 2020.
- A. K. Das, M. Wazid, N. Kumar, and J. Rodrigues, “USAF-IoD: Ultralightweight and Secure Authenticated Key Agreement Framework for Internet of Drones Environment,” IEEE Internet of Things Journal, vol. 8, no. 5, pp. 3304–3316, 2021.
- J. Srinivas, A. K. Das, and N. Kumar, “A Lightweight and Anonymous Application-Aware Authentication and Key Agreement Protocol for the Internet of Drones,” IEEE Internet of Things Journal, vol. 7, no. 6, pp. 5537–5548, 2020.
- M. S. Hossain and G. Muhammad, “liteGAP: Lightweight Group Authentication Protocol for Internet of Drones Systems,” IEEE Systems Journal, vol. 15, no. 3, pp. 3835–3846, 2021.
- Q. Chen, Y. Zhang, and X. Liu, “A Quantum-Secure Framework for IoD: Strengthening Authentication and Key-Establishment,” IEEE Access, vol. 9, pp. 107532–107545, 2021.
- T. Sheltami, E. Shakshuki, and H. Malik, “Drone-Mag: UAV Identification and Authentication via Electromagnetic Emissions,” IEEE Transactions on Information Forensics and Security, vol. 15, pp. 322–335, 2020.
- H. Kim and J. Lee, “A Two-Stage Real-Time Gesture Recognition Framework for UAV Control,” IEEE Access, vol. 8, pp. 123456–123467, 2020.
- Y. Chen, Z. Zhang, and X. Li, “Real-Time Human Detection and Gesture Recognition for On-Board UAV Rescue,” IEEE Access, vol. 9, pp. 12345–12356, 2021.
- M. Rossi, L. Brunelli, and P. Ferrari, “AutoSOS: Towards Multi-UAV Systems Supporting Maritime Search and Rescue with Lightweight AI and Edge Computing,” IEEE Internet of Things Journal, vol. 9, no. 3, pp. 2011–2023, 2022.
- A. Rahman, S. Islam, and M. Hasan, “EmergencyNet: Efficient Aerial Image Classification for Drone-Based Emergency Monitoring Using Atrous Convolutional Feature Fusion,” IEEE Access, vol. 9, pp. 154321–154333, 2021.
- S. Li, Y. Xu, and H. Wang, “Human Detection from Unmanned Aerial Vehicles’ Images for Search and Rescue Missions: A State-of-the-Art Review,” IEEE Access, vol. 9, pp. 133456–133472, 2021.
- K. Sharma and P. Singh, “A Secure and Intelligent Data Sharing Scheme for UAV-Assisted Disaster Rescue,” IEEE Access, vol. 8, pp. 167543–167555, 2020.
- R. Patel and S. Shah, “Drone Assisted Rescue System,” in Proc. IEEE International Conference on Smart Computing, 2020, pp. 245–250.
- A. Verma and P. Gupta, “Human Detection in Flood Using Drone,” in Proc. IEEE International Conference on Robotics and Automation, 2021, pp. 1123–1128.
- N. Kumar, A. Singh, and R. Mishra, “A Novel Internet-of-Drones and Blockchain-Based System Architecture for Search and Rescue,” IEEE Access, vol. 9, pp. 98765–98778, 2021.
- H. Park, J. Kim, and S. Lee, “EKF-Based Depth Camera and Deep Learning Fusion for UAV-Person Distance Estimation and Following in SAR Operations,” IEEE Sensors Journal, vol. 22, no. 4, pp. 3567–3576, 2022.
- S. Gupta and R. Mehta, “AI-Based Drone Assisted Human Rescue in Disaster Environments: Challenges and Opportunities,” IEEE Access, vol. 10, pp. 45678–45692, 2022.
The increasing need for user-friendly, contactless control systems has drawn a lot of attention to human-drone
interaction in recent years. In this paper, a computer vision and machine learning-based hand gesture control system for a
quadcopter drone is presented. The suggested system tracks and detects hand landmarks using the MediaPipe framework
and records real-time video frames using a webcam. Fist, Open palm, and the directional hand movements are examples of
the kind of gesture that is interpreted as flight command by analyzing the spatial locations of the important hand points.
The left hand uses the distance between the chosen landmarks for altitude variation, while the right hand is utilized for the
direction of the motion. Proportional-derivative (PD) control mechanism and smoothing filters are utilized for stability.
Moreover, the hand-locking mechanism for cybersecurity, which checks for the pattern of the gesture, is introduced for
secure drone control. Gesture-based takeoff and landing, as well as automatic landing in the absence of hands, are
examples of the safety features. The results of the experiment reveal the stability of the drone in indoor space with
improved security and gesture recognition.
Keywords :
Computer Vision, Drone, Hand Gesture, Machine Learning, Secure.