Modeling of Real Time Traffic Flow Monitoring System Using Deep Learning and Unmanned Aerial Vehicles


  • Sachin Upadhye Department of Computer Application, Shri Ramdeobaba College of Engineering and Management, Nagpur
  • S. Neelakandan Department of CSE, R.M.K Engineering College, Chennai, India
  • K. Thangaraj Department of IT, Sona College of Technology, Salem, India
  • D. Vijendra Babu School of Electronics Engineering, Vellore Institute of Technology, Vellore – 632 014, Tamil Nadu, India
  • N. Arulkumar Department of Data Science and Statistics, CHRIST (Deemed to be University), Bangalore, India
  • Kashif Qureshi Department of CSE, Sanskriti University Mathura, Uttar Pradesh, India



Deep learning, traffic flow monitoring, unmanned aerial vehicles, video surveillance, vehicle counting, speed estimation


Recently, intelligent video surveillance technologies using unmanned aerial vehicles (UAVs) have been considerably increased in the transportation sector. Real time collection of traffic videos by the use of UAVs finds useful to monitor the traffic flow and road conditions. Since traffic jams have become common in urban areas, it is needed to design artificial intelligence (AI) based recognition techniques to attain effective traffic flow monitoring. Besides, the traffic flow monitoring system can assist the traffic managers to start efficient dispersal actions. Therefore, this study designs a real time traffic flow monitoring system using deep learning (DL) and UAVs, called RTTFM-DL. The proposed RTTFM-DL technique aims to detect vehicles, count vehicles, estimate speed and determine traffic flow. In addition, an efficient vehicle detection model is proposed by the use of Faster Regional Convolutional Neural Network (Faster RCNN) with Residual Network (ResNet). Also, a detection line based vehicle counting approach is designed, which is based on overlap ratio. Finally, traffic flow monitoring takes place based on the estimated vehicle count and vehicle speed. In order to guarantee the effectual performance of the RTTFM-DL technique, a series of experimental analyses take place and the results are examined under varying aspects. The experimental outcomes highlighted the betterment of the RTTFM-DL technique over the recent techniques. The RTTFM-DL technique has gained improved outcomes with a higher accuracy of 0.975.


Download data is not yet available.

Author Biographies

Sachin Upadhye, Department of Computer Application, Shri Ramdeobaba College of Engineering and Management, Nagpur

Sachin Upadhye is an Assistant Professor at Computer Application Department of Shri Ramdeobaba College of Engineering and Management, Nagpur. He holds MCA, M. Tech. & PhD degrees in Computer Science & Engineering. He is an Oracle Certified Associate, IBM Rational Certified developer and has more than 20 research paper published in National & International Journals and conferences. He has 12 Years teaching experiences. He has successfully completed many certifications from NPTEL, IIT and also completed the research proposal and project.

S. Neelakandan, Department of CSE, R.M.K Engineering College, Chennai, India

S. Neelakandan (Senior Member, IEEE) is working as an Assistant Professor in the Department of CSE at R.M.K Engineering College Chennai. He has 14 years of Teaching experience. He has obtained his Bachelor of Engineering in Computer Science & Engineering M.E in Computer Science and Engineering from Anna University Chennai. He has received Ph.D in Information and Communication Engineering from Anna University. His research interests includes Data Science, Machine Learning, Big Data and Cloud Computing. He has published more than 30 research papers. He is a recipient of several awards for his credits and Reviewer for several International Journals. He also a Senior IEEE member, Life member of ISTE&IAENG.

K. Thangaraj, Department of IT, Sona College of Technology, Salem, India

K. Thangaraj, currently working as a Sr. Grade Assistant Professor cum Researcher in the Information Technology Department of Sona College of Technology with more than 14 years of Experience in Teaching and Research field. His current research focus is in the Design and Development of Energy Efficient Secure Wireless Protocols, and other research interests include Cloud Computing, Machine Learning and Internet of Things.

D. Vijendra Babu, School of Electronics Engineering, Vellore Institute of Technology, Vellore – 632 014, Tamil Nadu, India

D. Vijendra Babu obtained his B.E. from University of Madras, India, M.Tech. from SASTRA, Tanjore, India & Ph.D. from Jawaharlal Nehru Technological University, Hyderabad, India. He is currently designated as Vice Principal & Professor in the Department of Electronics and Communication Engineering at Aarupadai Veedu Institute of Technology, Vinayaka Mission’s Research Foundation (VMRF), Tamil Nadu, India. He has 22 Years of Experience in the field of Education, Research & Administration at various levels. He has obtained Grants for 3 Australian Patents, 1 Indian Design Patent & Published 5 Indian Patents. He has published 100+ Articles in Refereed International/National Journals & Conferences which are indexed in Scopus/SCIE/Publons and also Reviewer in various leading Journals/Conferences. He gas published 2 Book Chapters and authored 5 Books on Hands on Data Science, Python Crash Course, Computer Vision Programming, Machine Learning and its Applications & Essentials of Wireless Sensor Networks. He is a Member in Academic Council Mm& Board of Studies Member of VMRF. He has acted as Chair in 21 International/National Conferences & delivered 40 Invited Lectures. Apart from Academics, he is an active involvement in Professional Societies as a Life Member in IEEE, CSI, IETE, BES (I), ISTE, ACEEE and IACSIT. He is currently the Secretary, Robotics & Automation Society (RAS), IEEE Madras Section & Executive Committee Member, IETE Chennai Centre.

N. Arulkumar, Department of Data Science and Statistics, CHRIST (Deemed to be University), Bangalore, India

N. Arulkumar is currently working as an Assistant Professor at Christ (Deemed to be University), Bangalore, INDIA. He received a Ph.D. degree in Computer Science from Bharathidasan University, India in 2019. His research areas are Computer Networks, Cyber Security, and the Internet of Things (IoT). He published more than 30 research papers in both journals and conferences. He published 2 patents in the fields of communication and computer science. He has chaired many technical sessions and delivered more than 10 invited talks at the national and international levels. He has completed more than 33 certifications from IBM, Google, Amazon, etc. He passed the CCNA: Routing and Switching Exam in 2017. Additionally, he also passed the Networking Fundamentals in the year 2017 exam from Microsoft.

Kashif Qureshi, Department of CSE, Sanskriti University Mathura, Uttar Pradesh, India

Kashif Quarsh After having applied research and academic experience of 21+ years of various countries (US, U.K, Australia, Saudi and Libya) and cultures now it is the right time to indoctrinate my scientific and soft skills to the experience for the long term in an international reputed universities. I am much spellbound in teaching Big Data, Cloud Computing, IoT, Data Security & Data Science (Artificial Intelligence, Machine Learning & Deep Learning) as the ensuing epoch will be an intelligent machines era and non-explicit programming will be much preferable. I have published books on Artificial Intelligence, Machine Learning, Operating System and Computer fundamentals, I am sure my core experience is a quick strong learning tool for students. My Ph.D. Masters and Bachelor’s Degrees were highly dedicated towards my interest and numerous students already benefitted. I have acted on the various post and served Universities and students in all ranges across 6 Countries.


Vlahogianni, E.I., Del Ser, J., Kepaptsoglou, K. and Laña, I., 2021. Model Free Identification of Traffic Conditions Using Unmanned Aerial Vehicles and Deep Learning. Journal of Big Data Analytics in Transportation, 3(1), pp. 1–13.

Barmpounakis EN, Vlahogianni EI, Golias JC (2016) Unmanned Aerial Aircraft Systems for transportation engineering: Current practice and future challenges. Int J Transp Sci Technol 5(3):111–122.

Jian, L., Li, Z., Yang, X., Wu, W., Ahmad, A. and Jeon, G., 2019. Combining unmanned aerial vehicles with artificial-intelligence technology for traffic-congestion recognition: electronic eyes in the skies to spot clogged roads. IEEE Consumer Electronics Magazine, 8(3), pp. 81–86.

G. Salvo, L. Caruso, and A. Scordo, “Urban traffic analysis through an UAV,” Procedia-Social Behavioral Sci., vol. 111, pp. 1083–1091, 2014.

J. Wan, Y. Yuan, and Q. Wang, “Traffic congestion analysis: A new perspective,” in Proc. Acoustics, Speech and Signal Processing (ICASSP), 2017, pp. 1398–1402.

E. D’Andrea and F. Marcelloni, “Detection of traffic congestion and incidents from GPS trace analysis,” Expert Syst. Applicat., vol. 73, pp. 43–56, 2017.

Ham, S.W., Park, H.C., Kim, E.J., Kho, S.Y. and Kim, D.K., 2020. Investigating the influential factors for practical application of multi-class vehicle detection for images from unmanned aerial vehicle using deep learning models. Transportation Research Record, 2674(12), pp. 553–567.

Varia, N., Dokania, A. and Senthilnath, J., 2018, November. DeepExt: A convolution neural network for road extraction using RGB images captured by UAV. In 2018 IEEE Symposium Series on Computational Intelligence (SSCI) (pp. 1890–1895). IEEE.

C Pretty Diana Cyril, J Rene Beulah,Mohan, A Harshavardhan, D Sivabalaselvamani, An automated learning model for sentiment analysis and data classification of Twitter data using balanced CA-SVM,

Vlahogianni, E.I., Del Ser, J., Kepaptsoglou, K. and Laña, I., 2021. Model Free Identification of Traffic Conditions Using Unmanned Aerial Vehicles and Deep Learning. Journal of Big Data Analytics in Transportation, 3(1), pp. 1–13.

Zhang, H., Liptrott, M., Bessis, N. and Cheng, J., 2019, September. Real-time traffic analysis using deep learning techniques and uav based video. In 2019 16th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS) (pp. 1–5). IEEE.

Micheal, A.A., Vani, K., Sanjeevi, S. and Lin, C.H., 2021. Object Detection and Tracking with UAV Data Using Deep Learning. Journal of the Indian Society of Remote Sensing, 49(3), pp. 463–469.

S., Berlin, M.A., Tripathi, S. et al. IoT-based traffic prediction and traffic signal control system for smart city. Soft Computing (2021).

Paulraj, D 2020, ‘An Automated Exploring And Learning Model For Data Prediction Using Balanced CA-SVM’, Journal of Ambient Intelligence and Humanized Computing, Vol. 12, no. 5, April 2020 , DOI:

Gupta, H. and Verma, O.P., 2021. Monitoring and surveillance of urban road traffic using low altitude drone images: a deep learning approach. Multimedia Tools and Applications, pp. 1–21.

Zhang, J.S., Cao, J. and Mao, B., 2017, July. Application of deep learning and unmanned aerial vehicle technology in traffic flow monitoring. In 2017 International Conference on Machine Learning and Cybernetics (ICMLC) (Vol. 1, pp. 189–194). IEEE.

Ammour, N., Alhichri, H., Bazi, Y., Benjdira, B., Alajlan, N. and Zuair, M., 2017. Deep learning approach for car detection in UAV imagery. Remote Sensing, 9(4), p. 312.

Ye, D.H., Li, J., Chen, Q., Wachs, J. and Bouman, C., 2018. Deep learning for moving object detection and tracking from a single camera in unmanned aerial vehicles (UAVs). Electronic Imaging, 2018(10), pp. 466–1.

Zhang, Y., Song, C. and Zhang, D., 2020. Deep learning-based object detection improvement for tomato disease. IEEE Access, 8, pp. 56607–56614.

F. Liu, Z. Zeng, and R. Jiang, “A Video-based Real-time Adaptive Vehicle-counting System for Urban Roads,” PLOS ONE 12(11): e0186098, 2017.

Zhu, J., Sun, K., Jia, S., Li, Q., Hou, X., Lin, W., Liu, B. and Qiu, G., 2018. Urban traffic density estimation based on ultrahigh-resolution UAV video and deep neural network. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 11(12), pp. 4968–4981.





New Trends in Real-Time Image and Video Processing for Surveillance and Security