International Journal of Education and Management Engineering (IJEME)
IJEME Vol. 9, No. 1, 8 Jan. 2019
Cover page and Table of Contents: PDF (size: 384KB)
Anomaly Detection in Crowded Scene by Pedestrians Behaviour Extraction using Long Short Term Method: A Comprehensive Study
Full Text (PDF, 384KB), PP.51-63
Views: 0 Downloads: 0
Author(s)
Anupam Dey
1
Fahad Mira
1
Saleque Ahmed
1
Raiyan Sharif
1
A. F. M. Saifuddin Saif
1,*
Index Terms
Anomaly detection, Pedestrian detection, LSTM, Computer Vision, Pattern Recognition
Abstract
With the expansion of worldwide security concerns and a consistently expanding requirement for successful checking of open places, i.e. air terminals, railroad stations, shopping centres, crowded sports fields, army bases or smart healthcare facilities such as daily activity monitoring and fall detection in old people’s homes is increasing very rapidly. The visual occlusions and ambiguities in crowded scenes, usage of suitable method and in addition the perplexing practices and scene semantics make the investigation a challenging task. This research demonstrates comprehensive and critical analysis of crowd scene involves in object detection, tracking, feature extraction and learning from visual surveillance which helps to recognize behavioural pattern. This research refers scene understanding as scene layout, i.e. finding streets, structures, side-walks, vehicles turning, person on foot intersection and scene status such as crowd congestion, split, merge etc. The significance of the proposed comprehensive review to create crowd administration procedures and help the development of the group or people, to maintain a strategic distance from the group calamities and guarantee general society security. Based on the observation of previous research in three aspects, i.e. review based on methods, frameworks and critical existing results analysis, this research propose a framework for anomaly detection in crowded scene using LSTM (long Short-Term Method). Proposed comprehensive review is expected to contribute significantly for the investigation of behavior pattern analysis in computer vision research domains.
Cite This Paper
Anupam Dey, Fahad Mohammad, Saleque Ahmed, Raiyan Sharif, A.F.M. Saifuddin Saif,"Anomaly Detection in Crowded Scene by Pedestrians Behaviour Extraction using Long Short Term Method: A Comprehensive Study", International Journal of Education and Management Engineering(IJEME), Vol.9, No.1, pp.51-63, 2019. DOI: 10.5815/ijeme.2019.01.05
Reference
[1] T. Boult, “Frame-rate multi-body tracking for surveillance,” in Proc. DARPA Image Understanding Workshop, Monterey, CA, Nov. 1998, pp. 305–308.
[2] L. Bazzani, M. Cristani, and V. Murino. Decentralized particle filter for joint individual-group tracking. In Proc. of IEEECVPR, 2012.
[3] M. Zanotto, L. Bazzani, M. Cristani, and V. Murino. Online Bayesian nonparametrics for group detection. In Proc.of BMVC, 2012.
[4] Boer, E., Fernandez, M., Pentland, A., & Liu, A. (1996). Method for evaluating human and simulated drivers in real traffic situations. In IEEE Vehicular Tech. Conf. (pp. 1810–1814). Atlanta, GA.
[5] A. Krizhevsky, I. Sutskever, and G.E. Hinton. Imagenet classification with deep convolutional neural networks. In NIPS, 2012.
[6] R. Girshick, J. Donahue, T. Darrell, and J. Malik. Rich feature hierarchies for accurate object detection and semantic segmentation. In CVPR, 2014.
[7] D. Nguyen, W. Li and P. Ogunbona, "Human detection from images and videos: A survey", Pattern Recognition, vol. 51, pp. 148-175, 2016.
[8] O. Popoola and Kejun Wang, "Video-Based Abnormal Human Behavior Recognition—A Review", IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews), vol. 42, no. 6, pp. 865-878, 2012.
[9] WeinaGe, R. Collins and R. Ruback, "Vision-Based Analysis of Small Groups in Pedestrian Crowds", IEEE Transactions on Pattern Analysis and Machine Intelligence,2012.
[10] D. Chen and P. Huang, "Motion-based unusual event detection in human crowds", Journal of Visual Communication and Image Representation, vol. 22, no. 2, pp. 178-186, 2011.
[11] V. Reddy, C. Sanderson and B. Lovell, "Improved anomaly detection in crowded scenes via cell-based analysis of foreground speed, size and texture", CVPR 2011 WORKSHOPS, 2011.
[12] G. Mariem, E. Ridha and Z. Mourad, "Detection of Abnormal Movements of a Crowd in a Video Scene", International Journal of Computer Theory and Engineering, vol. 8, no. 5, pp. 398-402, 2016.
[13] Y. Kim and T. Moon, "Human Detection and Activity Classification Based on Micro-Doppler Signatures Using Deep Convolutional Neural Networks", IEEE Geoscience and Remote Sensing Letters, vol. 13, no. 1, pp. 8-12, 2016.
[14] M. Kuderer, H. Kretzschmar, C. Sprunk and W. Burgard, "Feature-Based Prediction of Trajectories for Socially Compliant Navigation", Robotics: Science and Systems VIII, 2012.
[15] A. Alahi, V. Ramanathan, K. Goel, A. Robicquet, A. Sadeghian, L. Fei-Fei and S. Savarese, "Learning to Predict Human Behavior in Crowded Scenes", Group and Crowd Behavior for Computer Vision, pp. 183-207, 2017.
[16] Kratz, L. and Nishino, K. (2012). Tracking Pedestrians Using Local Spatio-Temporal Motion Patterns in Extremely Crowded Scenes. IEEE Transactions on Pattern Analysis and Machine Intelligence, 34(5), pp.987-1002.
[17] WeinaGe, Collins, R. and Ruback, R. (2012). Vision-Based Analysis of Small Groups in Pedestrian Crowds. IEEE Transactions on Pattern Analysis and Machine Intelligence, 34(5), pp.1003-1016.
[18] Bolei Zhou, Xiaogang Wang and Xiaoou Tang (2012). Understanding collective crowd behaviors: Learning a Mixture model of Dynamic pedestrian-Agents. 2012 IEEE Conference on Computer Vision and Pattern Recognition.
[19] Ali, S. and Shah, M. (2008). Floor Fields for Tracking in High Density Crowd Scenes. Lecture Notes in Computer Science, pp.1-14.
[20] Rodriguez, M., Ali, S. and Kanade, T. (2009). Tracking in unstructured crowded scenes. 2009 IEEE 12th International Conference on Computer Vision.
[21] Li, T., Chang, H., Wang, M., Ni, B., Hong, R. and Yan, S. (2015). Crowded Scene Analysis: A Survey. IEEE Transactions on Circuits and Systems for Video Technology, 25(3), pp.367-386.
[22] Popoola, O. and Kejun Wang (2012). Video-Based Abnormal Human Behavior Recognition—A Review. IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews), 42(6), pp.865-878.
[23] Girdhar, Y., Walter Cho, Campbell, M., Pineda, J., Clarke, E. and Singh, H. (2016). Anomaly detection in unstructured environments using Bayesian nonparametric scene modeling. 2016 IEEE International Conference on Robotics and Automation (ICRA).
[24] Wanli Ouyang and Xiaogang Wang (2012). A discriminative deep model for pedestrian detection with occlusion handling. 2012 IEEE Conference on Computer Vision and Pattern Recognition.
[25] W. Ge, R. Collins and B. Ruback, "Automatically detecting the small group structure of a crowd", 2009 Workshop on Applications of Computer Vision (WACV), 2009.
[26] Alahi, A., Ramanathan, V., Goel, K., Robicquet, A., Sadeghian, A., Fei-Fei, L. and Savarese, S. (2017). Learning to Predict Human Behavior in Crowded Scenes. Group and Crowd Behavior for Computer Vision, pp.183-207.
[27] Mazzon, R., Poiesi, F. and Cavallaro, A. (2013). Detection and tracking of groups in crowd. 2013 10th IEEE International Conference on Advanced Video and Signal Based Surveillance.
[28] WeinaGe, R. Collins and R. Ruback, "Vision-Based Analysis of Small Groups in Pedestrian Crowds", IEEE Transactions on Pattern Analysis and Machine Intelligence,2012.
[29] D. Chen and P. Huang, "Motion-based unusual event detection in human crowds", Journal of Visual Communication and Image Representation, vol. 22, no. 2, pp. 178-186, 2011.
[30] G. Mariem, E. Ridha and Z. Mourad, "Detection of Abnormal Movements of a Crowd in a Video Scene", International Journal of Computer Theory and Engineering, vol. 8, no. 5, pp. 398-402, 2016.
[31] B. Zhou, X. Tang and X. Wang, "Learning Collective Crowd Behaviors with Dynamic Pedestrian-Agents", International Journal of Computer Vision, vol. 111, no. 1, pp. 50-68, 2014.
[32] Z. Zha, H. Zhang, M. Wang, H. Luan and T. Chua, "Detecting Group Activities With Multi-Camera Context", IEEE Transactions on Circuits and Systems for Video Technology, vol. 23, no. 5, pp. 856-869, 2013.
[33] B. Solmaz, B. Moore and M. Shah, "Identifying Behaviors in Crowd Scenes Using Stability Analysis for Dynamical Systems", IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 34, no. 10, pp. 2064-2070, 2012.
[34] O. Popoola and Kejun Wang, "Video-Based Abnormal Human Behavior Recognition—A Review", IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews), vol. 42, no. 6, pp. 865-878, 2012.
[35] L. Luo, S. Zhou, W. Cai, M. Low, F. Tian, Y. Wang, X. Xiao and D. Chen, "Agent-based human behavior modeling for crowd simulation", Computer Animation and Virtual Worlds, vol. 19, no. 3-4, pp. 271-281, 2008.
[36] B. Wang, M. Ye, X. Li, F. Zhao and J. Ding, "Abnormal crowd behavior detection using high-frequency and spatio-temporal features", Machine Vision and Applications, vol. 23, no. 3, pp. 501-511, 2011.
[37] M. Rodriguez, S. Ali and T. Kanade, "Tracking in Unstructured Crowded Scenes", IEEE Transactions on Pattern Analysis, vol. 34, no. 5, pp. 987-1002, 2009.
[38] N. Phan, D. Dou, B. Piniewski and D. Kil, "A deep learning approach for human behavior prediction with explanations in health social networks: social restricted Boltzmann machine (SRBM+)", Social Network Analysis and Mining, vol. 6, no. 1, 2016.
[39] M. Cristani, R. Raghavendra, A. Del Bue and V. Murino, "Human behavior analysis in video surveillance: A Social Signal Processing perspective", Neurocomputing, vol. 100, pp. 86-97, 2013.
[40] G. Ferrer and A. Sanfeliu, "Behavior estimation for a complete framework for human motion prediction in crowded environments", 2014 IEEE International Conference on Robotics and Automation (ICRA), 2014.
[41] S. Amraee, A. Vafaei, K. Jamshidi and P. Adibi, "Anomaly detection and localization in crowded scenes using connected component analysis", Multimedia Tools and Applications, 2017.
[42] V. Reddy, C. S and B. C. Lovell, "Improved anomaly detection in crowded scenes via cell-based analysis of foreground speed, size and texture", 2011.
[43] S. Choi, E. Kim and S. Oh, "Human Behavior Prediction for Smart Homes Using Deep Learning.", IEEE, 2013.