A Deep Learning Based Social Distance Analyzer with Person Detection and Tracking Using Region Based Convolutional Neural Networks for Novel Coronavirus

Authors

  • N. Prabakaran School of Computer Science and Engineering (SCOPE), Vellore Institute of Technology, Vellore, Tamil Nadu, India-632014 https://orcid.org/0000-0002-1232-1878
  • Suvarna Sree Sai Kumar School of Computer Science and Engineering (SCOPE), Vellore Institute of Technology, Vellore, Tamil Nadu, India-632014 https://orcid.org/0000-0002-8451-8653
  • P. Kranthi Kiran School of Computer Science and Engineering (SCOPE), Vellore Institute of Technology, Vellore, Tamil Nadu, India-632014
  • Pabbidi Supriya School of Computer Science and Engineering (SCOPE), Vellore Institute of Technology, Vellore, Tamil Nadu, India-632014

DOI:

https://doi.org/10.13052/jmm1550-4646.1834

Keywords:

Convolutional Neural Network (CNN), YOLO V3, Region-Based Convolutional Neural Network (RCNN), CCTV cameras, Drones, novel coronavirus

Abstract

With its staggering spread, the continuous novel coronavirus Covid flare-up has caused a worldwide disaster. Populace weakness develops because of an absence of productive helpful prescriptions and a shortage of antibodies against the infection. Since there are no antibodies accessible as of now, social detachment is viewed as a sufficient insurance (standard) against the transmission of the illness. With the ascent in cases, the public authority has ordered a base actual division of 2 meters in all open spaces as a security measure. Utilizing PC vision on video reconnaissance, we made an AI device to forestall the spread of the (novel coronavirus). A social separating analyzer AI apparatus that utilizes video observing from CCTV cameras and robots to control social removing convention. The made AI device was introduced in broad daylight spaces and guaranteed the distance between gatherings of individuals. If the hole was excessively close, the red line showed up, demonstrating a higher danger of being influenced, trailed by the green and yellow light, showing a protected line, and the other, demonstrating a generally safe of being influenced.

Downloads

Download data is not yet available.

Author Biographies

N. Prabakaran, School of Computer Science and Engineering (SCOPE), Vellore Institute of Technology, Vellore, Tamil Nadu, India-632014

N. Prabakaran is currently working as an Assistant Professor senior in School of Computer Science and Engineering, Vellore Institute of Technology (VIT), Vellore, Tamil Nadu and India. He received BE in Computer Science and Engineering from Anna University, Chennai, India in 2009, ME in Computer Science and Engineering from Anna University, Chennai, India in 2011. He has completed Ph.D. at Vellore Institute of Technology (VIT), Vellore, India in 2017. His research interest includes Massive mining Data, Machine learning Algorithms in Financial series, sensor Networks and Pervasive Computing.

Suvarna Sree Sai Kumar, School of Computer Science and Engineering (SCOPE), Vellore Institute of Technology, Vellore, Tamil Nadu, India-632014

Suvarna Sree Sai Kumar received the bachelor’s degree in Computer Science and Engineering from Sree Vidyanikethan Enginnering College 2018, the master’s degree in Computer Science and Engineering from Vellore Institute of Technology 2022. His research areas include Internet of Things, deep learning, and Machine Learning.

P. Kranthi Kiran, School of Computer Science and Engineering (SCOPE), Vellore Institute of Technology, Vellore, Tamil Nadu, India-632014

P. Kranthi Kiran received the bachelor’s degree in Mechanical engineering from Saveetha Engineering College 2019, the master’s degree in Computer Science and Engineering from Vellore Institute of Technology 2022. His research areas include Wireless Communication, Internet of Things, deep learning and Artificial Intelligence.

Pabbidi Supriya, School of Computer Science and Engineering (SCOPE), Vellore Institute of Technology, Vellore, Tamil Nadu, India-632014

Pabbidi Supriya received the bachelor’s degree in Instrumentation from Bharath Institute of Higher Education and research 2022, the master’s degree in Computer Science and Engineering from Vellore Institute of Technology 2020. Her research areas include Mobile Applications, Internet of Things, Deep Learning.

References

Jung, Heechul, Sihaeng Lee, Sunjeong Park, Byungju Kim, Junmo Kim, Injae Lee, and Chunghyun Ahn. “Development of deep learning-based facial expression recognition system.” In 2015 21st Korea-Japan Joint Workshop on Frontiers of Computer Vision (FCV), pp. 1–4. IEEE, 2015.

Leng, Biao, Yu Liu, Kai Yu, Songting Xu, Ziqing Yuan, and Jingyan Qin. “Cascade shallow CNN structure for face verification and identification.” Neurocomputing 215: 232–240, 2016.

Imitation of visual illusion via Open https://www.worldscientific.com/doi/abs/10.1142/S0218127408022573.

Redmon, Joseph, et al. “You only look once: Unified, real-time object detection.” Proceedings of the IEEE conference on computer vision and pattern recognition. 2016.

De Oliveira, Diulhio Candido, and Marco Aurelio Wehrmeister. “Towards real-time people recognition on aerial imagery using convolutional neural networks.” 2016 IEEE 19th international symposium on real-time distributed computing (ISORC). IEEE, 2016.

Arsenovic, M., Sladojevic, S., Anderla, A., and Stefanovic, D. (2017, September). FaceTime—Deep learning based face recognition attendance system. In 2017 IEEE 15th International Symposium on Intelligent Systems and Informatics (SISY) (pp. 000053–000058). IEEE, 2017.

Pitaloka, Diah Anggraeni, Ajeng Wulandari, T. Basaruddin, and Dewi Yanti Liliana. “Enhancing CNN with preprocessing stage in automatic emotion recognition.” Procedia computer science 116: 523–529, 2017.

Redmon, Joseph, and Ali Farhadi. “Yolov3: An incremental improvement.” arXiv preprint arXiv:1804.02767, 2018.

Jose, Reny. “A Convolutional Neural Network (CNN) Approach to Detect Face Using TensorFlow and Keras.” International Journal of Emerging Technologies and Innovative Research, ISSN: 2349-5162, 2019.

Shanmugamani, Rajalingappaa. Deep Learning for Computer Vision: Expert techniques to train advanced neural networks using TensorFlow and Keras. Packt Publishing Ltd, 2018.

Nikouei, Seyed Yahya, et al. “Real-time human detection as an edge service enabled by a lightweight cnn.” 2018 IEEE International Conference on Edge Computing (EDGE). IEEE, 2018.

Chandan, G., Ayush Jain, and Harsh Jain. “Real time object detection and tracking using Deep Learning and OpenCV.” 2018 international conference on inventive research in computing applications (ICIRCA). IEEE, 2018.

Ahmad, Misbah, et al. “Convolutional neural network–based person tracking using overhead views.” International Journal of Distributed Sensor Networks 16.6: 1550147720934738, 2020.

Ainslie, Kylie E.C., Caroline E. Walters, Han Fu, Sangeeta Bhatia, Haowei Wang, Xiaoyue Xi, Marc Baguelin et al. “Evidence of initial success for China exiting COVID-19 social distancing policy after achieving containment.” Wellcome Open Research 5, 2020.

Chakraborty, Chinmay, Amit Banerjee, Lalit Garg, and J. J. Rodrigues. “Internet of Medical Things for Smart Healthcare.” Studies in Big Data; Springer: Cham, Switzerland 80, 2020.

Yash Chaudhary D.G., Mehta M. 22nd international conference on E-health networking, applications and services (IEEE Healthcom 2020); Shenzhen, China, December 12–15; 2020.

Prem K., Liu Y., Russell T.W., Kucharski A.J., Eggo R.M., Davies N. The Lancet Public Health. 2020.

Ramadass L., Arunachalam S., Sagayasree Z. International Journal of Pervasive Computing and Communications. 2020.

Pouw, Caspar AS, Federico Toschi, Frank van Schadewijk, and Alessandro Corbetta. “Monitoring physical distancing for crowd management: Real-time trajectory and group analysis.” PloS one 15, no. 10: e0240963, 2020.

Punn N.S., Sonbhadra S.K., Agarwal S. “COVID-19 Epidemic Analysis” medRxiv. 2020.

Das, Arjya, Mohammad Wasif Ansari, and Rohini Basak. “Covid-19 Face Mask Detection Using TensorFlow, Keras and OpenCV.” In 2020 IEEE 17th India Council International Conference (INDICON), pp. 1–5. IEEE, 2020.

Badave, Harshada, and Madhav Kuber. “Face Recognition Based Activity Detection for Security Application.” In 2021 International Conference on Artificial Intelligence and Smart Systems (ICAIS), pp. 487–491. IEEE, 2021.

Ashraf, Md. Shakeeb. “Real Time Face Detection Using OpenCV.” 2021.

Bouhlel, Fatma, Hazar Mliki, and Mohamed Hammami. “Crowd Behavior Analysis based on Convolutional Neural Network: Social Distancing Control COVID-19.” VISIGRAPP (5: VISAPP). 2021.

Ayachi, Riadh, Yahia Said, and Mohamed Atri. “A Convolutional Neural Network to Perform Object Detection and Identification in Visual Large-Scale Data.” Big Data 9, no. 1: 41–52, 2021.

Gómez-Silva, María J. “Deep multi-shot network for modelling appearance similarity in multi-person tracking applications.” Multimedia Tools and Applications: 1–21, 2021.

Lu, Peng, Baoye Song, and Lin Xu. “Human face recognition based on convolutional neural network and augmented dataset.” Systems Science & Control Engineering 9, no. sup2: 29–37, 2021.

Mohammed, Soleen Basim, and Adnan Mohsin Abdulazeez. “Deep Convolution Neural Network for Facial Expression Recognition.” PalArch’s Journal of Archaeology of Egypt/Egyptology 18, no. 4: 3578–3586, 2021.

Published

2022-01-22

How to Cite

Prabakaran, N. ., Sai Kumar, S. S. ., Kiran, P. K. ., & Supriya, P. . (2022). A Deep Learning Based Social Distance Analyzer with Person Detection and Tracking Using Region Based Convolutional Neural Networks for Novel Coronavirus. Journal of Mobile Multimedia, 18(03), 541–560. https://doi.org/10.13052/jmm1550-4646.1834

Issue

Section

Enabling AI Technologies Towards Multimedia Data Analytics for Smart Healthcare