Affordable Real-Time Hand Gesture Detection Using Random Forest


Authors : Abhishek Chauhan; Emilin Shyni

Volume/Issue : Volume 10 - 2025, Issue 2 - February


Google Scholar : https://tinyurl.com/4hjfvyb9

Scribd : https://tinyurl.com/mw7t948t

DOI : https://doi.org/10.5281/zenodo.14898697


Abstract : This paper represents a hand gesture recognition system that classifies each gesture from a given gesture alphabet, makes use of the Random Forest Algorithm alongside with Pickle library to efficiently save and train the model. This system is capable of identifying all the alphabets along the continuous stream of video. The approach focuses on training the Random Forest model to identify between the gesture and non-gesture instances based on the features extracted from the training dataset. The saved models seamlessly allow for integration for the real-time use. The results produced truly shows the efficiency of the Random Forest approach achieving the desired accuracy without having or requiring any additional complex preprocessing or additional spatial information. We conclude the advantage of the approach as to how low the computational cost can be attained and ease of implementation, while keeping in mind the area for enhancement for future perspective.

Keywords : Hand Gesture Recognition, Gesture Alphabet, Random Forest Algorithm, Continuous Streaming, Gesture Identification, Non-Gesture Instances, Real Time use, Model Integration.

References :

  1. S. Mitra, T. Acharya, Gesture recognition: a survey, IEEE Trans. Syst. Man Cybern. Part C Appl. Rev. 37 (3) (2007) 311–324.
  2. Ajjen Joshi, Camille Monnier , Margrit Betke , Stan Sclaroff , Comparing random forest approaches to segmenting and classifying gestures (2007) 88-90
  3. S. Malassiotis, N. Aifanti, M.G. Strintzis, A gesture recognition system using 3D data, Proceedings First International Symposium on 3D Data Processing Visualization and Transmission, 2002, IEEE. 2002, pp. 190–193.
  4. J. Alon, V. Athitsos, Q. Yuan, S. Sclaroff, Simultaneous localization and recog-nition of dynamic hand gestures, Seventh IEEE Workshops on Application of Computer Vision, 2005. WACV/MOTIONS’05, 2, IEEE. 2005, pp. 254–260.
  5. T. Starner, A. Pentland, Real-time American sign language recognition from video using hidden Markov models, Motion-Based Recognition Springer. 1997, pp. 227–243.
  6. J. Lafferty, A. McCallum, F. Pereira, Conditional random fields: probabilistic models for segmenting and labeling sequence data, Proceedings of the Eighteenth International Conference on Machine Learning, ACM. 2001, pp. 282–289.
  7. A. Quattoni, S. Wang, L.-P. Morency, M. Collins, T. Darrell, Hidden conditional random fields, IEEE Trans. Pattern Anal. Mach. Intell. 29 (10) (2007) 1848–1852.
  8. Y. Song, D. Demirdjian, R. Davis, Multi-signal gesture recognition using temporal smoothing hidden conditional random fields, 2011 IEEE International Conference on Automatic Face & Gesture Recognition and Workshops (FG 2011), IEEE. 2011, pp. 388–393.
  9. Y. Song, D. Demirdjian, R. Davis, Continuous body and hand gesture recognition for natural human–computer interaction, ACM Trans. Interact. Intell. Syst. (TiiS) 2 (1) (2012) 5.
  10. J. Shotton, T. Sharp, A. Kipman, A. Fitzgibbon, M. Finocchio, A. Blake, M. Cook, R. Moore, Real-time human pose recognition in parts from single depth images, Commun. ACM 56 (1) (2013) 116–124.
  11. F. Schroff, A. Criminisi, A. Zisserman, Object class segmentation using random forests, Proceedings of the British Machine Vision Conference, 2008.
  12. A. Bosch, A. Zisserman, X. Muoz, Image classification using random forests and ferns, IEEE 11th International Conference on Computer Vision, 2007. ICCV 2007, IEEE. 2007, pp. 1–8.
  13. A. Kuznetsova, L. Leal-Taixé, B. Rosenhahn, Real-time sign language recognition using a consumer depth camera, Computer Vision Workshops (ICCVW), 2013 IEEE International Conference on, IEEE. 2013, pp. 83–90.
  14. J. Gall, A. Yao, N. Razavi, L. Van Gool, V. Lempitsky, Hough forests for object detection, tracking, and action recognition, IEEE Trans. Pattern Anal. Mach. Intell. 33 (11) (2011) 2188–2202.
  15. G. Yu, N.A. Goussies, J. Yuan, Z. Liu, Fast action detection via discriminative random forest voting and top-k subvolume search, IEEE Trans. Multimedia 13 (3) (2011) 507–517.
  16. T.-H. Yu, T.-K. Kim, R. Cipolla, Real-time action recognition by spatiotemporal semantic and structural forests, Proceedings of the British Machine Vision Conference, 2, 2010. pp. 6.
  17. L. Xu, K. Fujimura, Real-time driver activity recognition with random forests, Proceedings of the 6th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, ACM. 2014, pp. 1–8
  18. N.C. Camgöz, A.A. Kindiroglu, L. Akarun, Gesture recognition using template based random forest classifiers, Computer Vision-ECCV 2014 Workshops, Springer. 2014, pp. 579–594.

This paper represents a hand gesture recognition system that classifies each gesture from a given gesture alphabet, makes use of the Random Forest Algorithm alongside with Pickle library to efficiently save and train the model. This system is capable of identifying all the alphabets along the continuous stream of video. The approach focuses on training the Random Forest model to identify between the gesture and non-gesture instances based on the features extracted from the training dataset. The saved models seamlessly allow for integration for the real-time use. The results produced truly shows the efficiency of the Random Forest approach achieving the desired accuracy without having or requiring any additional complex preprocessing or additional spatial information. We conclude the advantage of the approach as to how low the computational cost can be attained and ease of implementation, while keeping in mind the area for enhancement for future perspective.

Keywords : Hand Gesture Recognition, Gesture Alphabet, Random Forest Algorithm, Continuous Streaming, Gesture Identification, Non-Gesture Instances, Real Time use, Model Integration.

Never miss an update from Papermashup

Get notified about the latest tutorials and downloads.

Subscribe by Email

Get alerts directly into your inbox after each post and stay updated.
Subscribe
OR

Subscribe by RSS

Add our RSS to your feedreader to get regular updates from us.
Subscribe