Analysis of Video Forensics System for Detection of Gun, Mask and Anomaly Using Soft Computing Techniques
DOI:
https://doi.org/10.13052/jcsm2245-1439.1143Keywords:
Digital forensics, video forensics, tampering, soft computing techniques, YOLO, CNN, suspicious personsAbstract
The video forensics world is a developing network of experts associated with the computerized video forensics industry. With quickly developing innovation, the video turned out to be the most significant weapon in the battle against individuals who violate the law by catching them in the act. Proof caught on video is viewed as more dependable, more exact, and more persuading than observer declaration alone. But, proof can be effortlessly tempered by utilizing programming. Video forensics examination, tells us about the accuracy of the input video. It has become a challenge for law enforcement agencies to deal with the increasing violence rate which involves the use of masks and weapons. The identification of a person becomes difficult with the use of face masks. The proposed method uses an efficient technique that is YOLO to detect guns, masks and suspicious persons from a video by extracting frames and features. It further compares the obtained frame with the available images in the dataset and generates output with bounding boxes detecting guns, masks and suspicious persons. This paper also examined the domain of video forensics and its outcomes. Experimental results show that the proposed method outperforms the existing techniques tested on different datasets. The precision for YOLO design for guns and masks is 100% and 75% respectively. The precision for customized CNN engineering for guns and face masks is 61.54% and 61.5% respectively. Execution measurements for both models have shown that the YOLO design outperformed the customized CNN with its presentation.
Downloads
References
Park, S., Yu, S., Kim, M., Park, K., and Paik, J. (2018). “Dual autoencoder network for retinex-based low-light image enhancement”. IEEE Access, 6, 22084–22093.
Fan, W., Wang, K., Cayre, F., and Xiong, Z. (2015). “Median filtered image quality enhancement and anti-forensics via variational deconvolution”. IEEE transactions on information forensics and security, 10(5), 1076–1091.
Mandal, S., Deán-Ben, X. L., and Razansky, D. (2016). “Visual quality enhancement in optoacoustic tomography using active contour segmentation priors”. IEEE transactions on medical imaging, 35(10), 2209–2217.
Walker, H., and Tough, A. (2015). “Facial Comparison from CCTV footage: The competence and confidence of the jury”. Science & Justice, 55(6), 487–498.
Verolme, E., and Mieremet, A. (2017). “Application of forensic image analysis in accident investigations”. Forensic science international, 278, 137–147.
Seckiner, D., Mallett, X., Roux, C., Meuwly, D., and Maynard, P. (2018). “Forensic image analysis – CCTV distortion and artifacts”. Forensic science international, 285, 77-85.
Li, S., Choo, K. K. R., Sun, Q., Buchanan, W. J., and Cao, J. (2019). “IoT forensics: Amazon echoes as a use case”. IEEE Internet of Things Journal, 6(4), 6487–6497.
Jerian, M., Paolino, S., Cervelli, F., Carrato, S., Mattei, A., and Garofano, L. (2007). “A forensic image processing environment for the investigation of surveillance video”. Forensic science international, 167(2–3), 207–212.
Nievas, E. B., Suarez, O. D., García, G. B., and Sukthankar, R. (2011). “Violence detection in video using computer vision techniques”. In International Conference on Computer Analysis of images and patterns (pp. 332–339).
Gowsikhaa, D., and Abirami, S. (2012). “Suspicious Human Activity Detection from Surveillance Videos”. International Journal on Internet & Distributed Computing Systems, 2(2).
Lone, A. H., Badroo, F. A., Chudhary, K. R., and Khalique, A. (2015). “Implementation of forensic analysis procedures for WhatsApp and Viber android applications”. International Journal of Computer Applications, 128(12), 26–33.
Kamenicky, J., Bartos, M., Flusser, J., Mahdian, B., Kotera, J., Novozamsky, A., …and Horinek, J. (2016). “PIZZARO: Forensic analysis and restoration of image and video data”. Forensic science international, 264, 153–166.
Senan, M. F. E. M., Abdullah, S. N. H. S., Kharudin, W. M., and Saupi, N. A. M. (2017). “CCTV quality assessment for forensics facial recognition analysis”. In 2017 7th International Conference on Cloud Computing, Data Science & Engineering-Confluence (pp. 649–655).
Kaur, H., and Choudhary, K. R. (2017). “Digital forensics: implementation and analysis for google android framework”. In Information Fusion for Cyber-Security Analytics (pp. 307–331).
Singh, G., and Singh, K. (2019). “Video frame and region duplication forgery detection based on correlation coefficient and coefficient of variation”. Multimedia Tools and Applications, 78(9), 11527–11562.
Ramzan, M., Abid, A., Khan, H. U., Awan, S. M., Ismail, A., Ahmed, M., …and Mahmood, A. (2019). “A review on state-of-the-art violence detection techniques”. IEEE Access, 7, 107560–107575.
Horváth, J., Güera, D., Yarlagadda, S. K., Bestagini, P., Zhu, F. M., Tubaro, S., and Delp, E. J. (2019). “Anomaly-based manipulation detection in satellite images”. networks, 29, 21.
Peixoto, B., Lavi, B., Martin, J. P. P., Avila, S., Dias, Z., and Rocha, A. (2019). “Toward subjective violence detection in videos”. In ICASSP 2019-2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) (pp. 8276–8280).
Khamparia, A., Pande, S., Gupta, D., Khanna, A. and Sangaiah, A.K. (2020), “Multi-level framework for anomaly detection in social networking”, Library Hi Tech, Vol. 38 No. 2, pp. 350–366. https://doi.org/10.1108/LHT-01-2019-0023
L. Hou, W. Wan, J.-N. Hwang, R. Muhammad, M. Yang, and K. Han, “Human tracking over camera networks: a review,” EURASIP J. Adv. Signal Process., vol. 2017, no. 1, p. 43, Dec. 2017, DOI: 10.1186/s13634-017-0482-z.
H. Bhaumik, S. Bhattacharyya, M. D. Nath, and S. Chakraborty, “Hybrid soft computing approaches to content based video retrieval: A brief review,” Appl. Soft Comput., vol. 46, pp. 1008–1029, Sep. 2016, DOI: 10.1016/j.asoc.2016.03.022.
S.-Z. Chen, C.-C. Guo, and J.-H. Lai, “Deep Ranking for Person Re-Identification via Joint Representation Learning,” IEEE Trans. Image Process., vol. 25, no. 5, pp. 2353–2367, May 2016, DOI: 10.1109/TIP.2016.2545929.
A. C. Nazare Jr. and W. R. Schwartz, “A scalable and flexible framework for smart video surveillance,” Comput. Vis. Image Underst., vol. 144, pp. 258–275, Mar. 2016, DOI: 10.1016/j.cviu.2015.10.014.
Z. Shao, J. Cai, and Z. Wang, “Smart Monitoring Cameras Driven Intelligent Processing to Big Surveillance Video Data,” IEEE Trans. Big Data, vol. 4, no. 1, pp. 105–116, Mar. 2018, DOI: 10.1109/TBDATA.2017.2715815.
A. R. Revathi and D. Kumar, “An efficient system for anomaly detection using deep learning classifier,” Signal Image Video Process., vol. 11, no. 2, pp. 291–299, Feb. 2017, DOI: 10.1007/s11760-016-0935-0.
M. Sabokrou, M. Fayyaz, M. Fathy, Z. Moayedd, and R. Klette, “Deep-Anomaly: Fully Convolutional Neural Network for Fast Anomaly Detection in Crowded Scenes,” Sep. 2016, Accessed: Feb. 22, 2022. [Online]. Available: https://arxiv.org/abs/1609.00866v2.
C.-B. Jin, S. Li, and H. Kim, “Real-Time Action Detection in Video Surveillance using Sub-Action Descriptor with Multi-CNN,” Oct. 2017, Accessed: Feb. 22, 2022. [Online]. Available: https://arxiv.org/abs/1710.03383v1.
K. Muhammad, J. Ahmad, I. Mehmood, S. Rho, and S. W. Baik, “Convolutional Neural Networks Based Fire Detection in Surveillance Videos,” IEEE Access, vol. 6, pp. 18174–18183, 2018, DOI: 10.1109/ACCESS.2018.2812835.
M. Farhadi Bajestani, S. Abadi, S. Fard, and R. Khodadadeh, AAD: Adaptive Anomaly Detection through traffic surveillance videos. 2018.
M. Kaushal, B. S. Khehra, and A. Sharma, “Soft Computing based object detection and tracking approaches: State-of-the-Art survey,” Appl. Soft Comput., vol. 70, pp. 423–464, Sep. 2018, DOI: 10.1016/j.asoc.2018.05.023.
S. Huang, D. Huang, and X. Zhou, “Learning Multimodal Deep Representations for Crowd Anomaly Event Detection,” Math. Probl. Eng., vol. 2018, pp. 1–13, 2018, DOI: 10.1155/2018/6323942.
M. Munir, S. A. Siddiqui, A. Dengel, and S. Ahmed, “DeepAnT: A Deep Learning Approach for Unsupervised Anomaly Detection in Time Series,” IEEE Access, vol. 7, pp. 1991–2005, 2019, DOI: 10.1109/ACCESS.2018.2886457.
R. D. Singh and N. Aggarwal, “Video content authentication techniques: a comprehensive survey,” Multimed. Syst., vol. 24, no. 2, pp. 211–240, Mar. 2018, DOI: 10.1007/s00530-017-0538-9.
W. Sultani, C. Chen, and M. Shah, “Real-World Anomaly Detection in Surveillance Videos,” in 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, Jun. 2018, pp. 6479–6488. DOI: 10.1109/CVPR.2018.00678.
A. Castillo, S. Tabik, F. Pérez, R. Olmos, and F. Herrera, “Brightness guided preprocessing for automatic cold steel weapon detection in surveillance videos with deep learning,” Neurocomputing, vol. 330, pp. 151–161, Feb. 2019, DOI: 10.1016/j.neucom.2018.10.076.
S. Bouindour, H. Snoussi, M. Hittawe, N. Tazi, and T. Wang, “An On-Line and Adaptive Method for Detecting Abnormal Events in Videos Using Spatio-Temporal ConvNet,” Appl. Sci., vol. 9, no. 4, p. 757, Feb. 2019, DOI: 10.3390/app9040757.
J. A. D. Cameron, P. Savoie, M. E. Kaye, and E. J. Scheme, “Design considerations for the processing system of a CNN-based automated surveillance system,” Expert Syst. Appl., vol. 136, pp. 105–114, Dec. 2019, DOI: 10.1016/j.eswa.2019.06.037.
J. Xiao, S. Li, and Q. Xu, “Video-Based Evidence Analysis and Extraction in Digital Forensic Investigation,” IEEE Access, vol. 7, pp. 55432–55442, 2019, DOI: 10.1109/ACCESS.2019.2913648.
S. Saleem, A. Dilawari, U. G. Khan, R. Iqbal, S. Wan, and T. Umer, “Stateful human-centered visual captioning system to aid video surveillance,” Comput. Electr. Eng., vol. 78, pp. 108–119, Sep. 2019, DOI: 10.1016/j.compeleceng.2019.07.009.
G. Sreenu and M. A. Saleem Durai, “Intelligent video surveillance: a review through deep learning techniques for crowd analysis,” J. Big Data, vol. 6, no. 1, p. 48, Dec. 2019, DOI: 10.1186/s40537-019-0212-5.
S. K. Nanda, D. Ghai, and S. Pande, “VGG-16-Based Framework for Identification of Facemask Using Video Forensics,” in Proceedings of Data Analytics and Management, vol. 91, D. Gupta, Z. Polkowski, A. Khanna, S. Bhattacharyya, and O. Castillo, Eds. Singapore: Springer Singapore, 2022, pp. 673–685. DOI: 10.1007/978-981-16-6285-0_54.
Published
How to Cite
Issue
Section
License
Copyright (c) 2022 Journal of Cyber Security and Mobility
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
