Hybrid Ensemble Learning for Real-Time Crowd Behavior Analysis Using Optical Flow and Deep Motion Features


Authors : Doaa Mabrouk; Manal A. Abdel-Fattah; Ahmed Taha

Volume/Issue : Volume 10 - 2025, Issue 11 - November


Google Scholar : https://tinyurl.com/tupwzx4r

Scribd : https://tinyurl.com/m9t6ad8a

DOI : https://doi.org/10.38124/ijisrt/25nov636

Note : A published paper may take 4-5 working days from the publication date to appear in PlumX Metrics, Semantic Scholar, and ResearchGate.

Note : Google Scholar may take 30 to 40 days to display the article.


Abstract : Crowd Behavior analysis has become a crucial component of modern video surveillance systems, enabling automatic detection of abnormal events such as panic, congestion, and violence. Traditional approaches often fail to generalize under complex environmental conditions, while deep learning methods alone require large datasets and extensive computation. This paper proposes a hybrid ensemble learning framework that integrates optical flow–based motion features with deep motion representations extracted from convolutional neural networks (CNNs) to achieve real-time and robust crowd behavior recognition. The ensemble model combines Random Forests (RFs), Gradient Boosting (GB), and a lightweight CNN classifier via weighted voting. Experiments conducted on benchmark datasets, such as the UCSD Anomaly Detection Dataset and Violent Flows (VF), demonstrate that the proposed framework outperforms individual classifiers and state-of-the-art deep models in terms of accuracy, F1-score, and processing speed. The results confirm that ensemble learning effectively bridges the gap between handcrafted motion cues and deep spatio-temporal representations for practical surveillance applications.

Keywords : Crowd Behavior Analysis, Ensemble Learning, Optical Flow, Motion Analysis, Deep Learning, Surveillance Video, Anomaly Detection.

References :

  1. R. Zhao, “A Review of Abnormal Crowd Behavior Recognition,” Appl. Sci., vol. 2024.
  2. et al. X. Li, R. Zhang, “Survey of Crowd Behavior Analysis: From Traditional to Deep Learning Approaches,” IEEE Access, 2022.
  3. S. A. and M. Shah, “A Lagrangian Particle Dynamics Approach for Crowd Flow Segmentation and Stability Analysis,” in Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR), 2007.
  4. M. S. R. Mehran, A. Oyama, “Abnormal Crowd Behavior Detection Using Social Force Model,” in Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR), 2009.
  5. D. H. and P. Molnár, “Social Force Model for Pedestrian Dynamics,” Phys. Rev. E, vol. 51, no. 5, pp. 4282–4286, 1995.
  6. G. E. H. A. Krizhevsky, I. Sutskever, “ImageNet Classification with Deep Convolutional Neural Networks,” NIPS, 2012.
  7. et al. X. Zhang, “Spatio-Temporal Residual Networks for Crowd Violence Detection,” IEEE Access, 2019.
  8. et al. R. T. Ionescu, “Object-Centric Auto-Encoders for Video Anomaly Detection,” CVPR, 2020.
  9. G. Dietterich, “Ensemble Methods in Machine Learning,” Mult. Classif. Syst., 2000.
  10. A. Alfarano, “Estimating Optical Flow: A Comprehensive Review,” 2024.
  11. H. M. Elmezain, M., Maklad, A. S., Alwateer, M., Farsi, M., & Ibrahim, “Analyzing Crowd Behavior in Highly Dense Crowd Videos Using 3D ConvNet and Multi-SVM,” Electronics, 2024, doi: 10.3390/electronics13244925.
  12. S. Elmetwally, A., Eldeeb, R. & Elmougy, “Deep learning based anomaly detection in real-time video,” Multimed Tools Appl, 2025, doi: 10.1007/s11042-024-19116-9.
  13. K. Y. and A. Yilmaz, “Crowd Scene Anomaly Detection in Online Videos,” ISPRS Arch. – Photogramm. Remote Sens. Spat. Inf. Sci., 2024.
  1. M. et al. Nasir, R., Jalil, Z., Nasir, “An Enhanced Framework for Real-Time Dense Crowd Abnormal Behavior Detection Using YOLOv8,” Artif Intell Rev, 2025.
  2. S. S. N. and A. Haque, “Weakly-Supervised Anomaly Detection in Surveillance Videos Based on Two-Stream I3D Convolution Network,” arXiv, 2024.
  3. C. A. Asal B, “Ensemble-Based Knowledge Distillation for Video Anomaly Detection,” Appl. Sci., 2024, doi: 10.3390/app14031032.
  4. Y. L. a B, M. S. a B, K. K. a B, and M. H. C, “Multi-View Crowd Congestion Monitoring System Based on an Ensemble of Convolutional Neural Network Classifiers,” J. Intell. Transp. Syst., 2020.
  5. C. S. Altowairqi S, Luo S, Greer P, “Efficient Crowd Anomaly Detection Using Sparse Feature Tracking and Neural Network,” Appl. Sci., 2024, doi: 10.3390/app14093928.
  6. C. . Sharif, M.H., Jiao, L. & Omlin, “Deep Crowd Anomaly Detection: State of the Art, Challenges, and Future Research Directions,” Artif. Intell. Rev., 2025, doi: 10.1007/s10462-024-11092-8.
  7. Y. . Alasmari, A.M., Farooqi, N.S. & Alotaibi, “Recent Trends in Crowd Management Using Deep Learning Techniques: A Systematic Literature Review,” J. Umm Al-Qura Univ. Eng. Archit., 2024, doi: 10.1007/s43995-024-00071-3.

Crowd Behavior analysis has become a crucial component of modern video surveillance systems, enabling automatic detection of abnormal events such as panic, congestion, and violence. Traditional approaches often fail to generalize under complex environmental conditions, while deep learning methods alone require large datasets and extensive computation. This paper proposes a hybrid ensemble learning framework that integrates optical flow–based motion features with deep motion representations extracted from convolutional neural networks (CNNs) to achieve real-time and robust crowd behavior recognition. The ensemble model combines Random Forests (RFs), Gradient Boosting (GB), and a lightweight CNN classifier via weighted voting. Experiments conducted on benchmark datasets, such as the UCSD Anomaly Detection Dataset and Violent Flows (VF), demonstrate that the proposed framework outperforms individual classifiers and state-of-the-art deep models in terms of accuracy, F1-score, and processing speed. The results confirm that ensemble learning effectively bridges the gap between handcrafted motion cues and deep spatio-temporal representations for practical surveillance applications.

Keywords : Crowd Behavior Analysis, Ensemble Learning, Optical Flow, Motion Analysis, Deep Learning, Surveillance Video, Anomaly Detection.

CALL FOR PAPERS


Paper Submission Last Date
30 - November - 2025

Video Explanation for Published paper

Never miss an update from Papermashup

Get notified about the latest tutorials and downloads.

Subscribe by Email

Get alerts directly into your inbox after each post and stay updated.
Subscribe
OR

Subscribe by RSS

Add our RSS to your feedreader to get regular updates from us.
Subscribe