Inspection Mobile Robot’s Control System with Remote IoT-based Data Transmission

Authors

  • Yuriy Kondratenko Intelligent Information Systems Department. Petro Mohyla Black Sea National University, Mykolaiv, Ukraine https://orcid.org/0000-0001-7736-883X
  • Oleksandr Gerasin Computerized Control Systems Department, Admiral Makarov National University of Shipbuilding, Mykolaiv, Ukraine https://orcid.org/0000-0001-5107-9677
  • Oleksiy Kozlov Intelligent Information Systems Department. Petro Mohyla Black Sea National University, Mykolaiv, Ukraine https://orcid.org/0000-0003-2069-5578
  • Andriy Topalov Computerized Control Systems Department, Admiral Makarov National University of Shipbuilding, Mykolaiv, Ukraine
  • Bogdan Kilimanov Computerized Control Systems Department, Admiral Makarov National University of Shipbuilding, Mykolaiv, Ukraine https://orcid.org/0000-0002-0176-2854

DOI:

https://doi.org/10.13052/jmm1550-4646.1742

Keywords:

Internet of Things, remote data transmission, control system, inspection mobile robot, cloud service, Android application

Abstract

The article presents the main stages of the development of remote control system for the inspection mobile robot operating on inclined ferromagnetic surfaces. The mobile robot remains on the surface and moves along working areas using separate clamping permanent magnets and caterpillars. The focus is on the control system’s architecture and remote data transmission based on Internet of Things technologies. Features of non-expensive Arduino Uno and WeMos D1 R2 mini microcontrolled development boards, cloud service Blynk, as well as multi-tab Android application interactions are revealed at the inspection mobile robot movement on the inclined surface. Experimental results of the proposed system show a good compatibility of chosen hardware, user-friendly human-machine interface and high mobility for future research of modern control algorithms at Internet of Things approach implementation for the extreme robotics.

Downloads

Download data is not yet available.

Author Biographies

Yuriy Kondratenko, Intelligent Information Systems Department. Petro Mohyla Black Sea National University, Mykolaiv, Ukraine

Yuriy Kondratenko is Doctor of Science, Professor, Honour Inventor of Ukraine (2008), Corr. Academician of Royal Academy of Doctors (Barce-lona, Spain), Head of the Department of Intelligent Information Systems at Petro Mohyla Black Sea National University (PMBSNU), Ukraine. He has received (a) the Ph.D. (1983) and Dr.Sc. (1994) in Elements and Devices of Computer and Control Systems from Odessa National Polytechnic University, (b) several international grants and scholarships for conducting research at Institute of Automation of Chongqing University, P.R.China (1988-1989), Ruhr-University Bochum, Germany (2000, 2010), Nazareth College and Cleveland State University, USA (2003), (c) Fulbright Scholarship for researching in USA (2015/2016) at the Dept. of Electrical Engineering and Computer Science in Cleveland State University. Research interests include robotics, automation, sensors and control systems, intelligent decision support systems, fuzzy logic.

Oleksandr Gerasin, Computerized Control Systems Department, Admiral Makarov National University of Shipbuilding, Mykolaiv, Ukraine

Oleksandr Gerasin is a PhD, Associate Professor of the Computerized control systems department of Admiral Makarov National University of Shipbuilding, Ukraine. He has gained bachelor (2012) and master (2014) diplomas of electromechanics, as well as PhD degree diploma in Automation of Control Processes in 2020. From February 2015 till September 2020 Oleksandr has been involved in different international and state programs related to control and monitoring systems development, robotics and Internet of Things implementation. His research interests include mobile robotics, sensitive systems, industrial automation, artificial intelligence, mathematical and computer modelling of technical objects.

Oleksiy Kozlov, Intelligent Information Systems Department. Petro Mohyla Black Sea National University, Mykolaiv, Ukraine

Oleksiy Kozlov is a Ph.D., Associate Professor, Head of International Department and Associate Professor of the Department of Intelligent Information Systems at Petro Mohyla Black Sea National University (PMBSNU), Ukraine. He has received master degree in electromechanics (2011) from Admiral Makarov National University of Shipbuilding and Ph.D. degree in control processes automation (2014) from Odessa National Polytechnic University. Since 2011 took part in the implementation of a number of international and state projects related to automation of complex industrial plants, intelligent control systems, robotics and Internet of Things. His research interests include automation, intelligent information and control systems, robotics, fuzzy logic, elements and devices of computer systems.

Andriy Topalov, Computerized Control Systems Department, Admiral Makarov National University of Shipbuilding, Mykolaiv, Ukraine

Andriy Topalov is a Ph.D., Senior lecturer of Admiral Makarov National University of Shipbuilding, Ukraine. He is a specialist in electrical engineering, got master diploma in 2014. In 2020 Andriy obtained PhD degree in Computer Systems and Components. He worked in the framework of international scientific university cooperation during the implementation of international projects with the European Union: TEMPUS (Cabriolet), Erasmus + (Aliot) and DAAD-Ostpartnerschaftsprogramm (project with the University of Saarland, Germany). His research interests include computer control systems, sensor systems, fuzzy sets theory, intelligent robotic devices and measurement systems.

Bogdan Kilimanov, Computerized Control Systems Department, Admiral Makarov National University of Shipbuilding, Mykolaiv, Ukraine

Bogdan Kilimanov is a master student of Computerized Control Systems Department of Admiral Makarov National University of Shipbuilding. He received his Bachelor's degree in Automation and Electrical Engineering from the Admiral Makarov National University of Shipbuilding in 2020. From January 2020 till September 2020 Bogdan was an executor state program related to the mobile robot’s remote control system development. His main research interests include robotics, the use of the Internet of Things for the automation of industries and premises of various types.

References

O. Vermesan, P. Friess, ‘Digitising the industry – Internet of Things connecting the physical, digital and virtual worlds’, River Publishers, 2016.

Y. Kondratenko, O. Kozlov, O. Korobko, A. Topalov, ‘Complex industrial systems automation based on the Internet of Things implementation’, in: Bassiliades N. et al. (eds) Information and Communication Technologies in Education, Research, and Industrial Applications (ICTERI 2017). Communications in Computer and Information Science, volume 826, Springer, Cham, 2018.

Sh. Li, H. Wang, T. Xu, G. Zhou, ‘Application study on Internet of Things in environment protection field’, Lecture Notes in Electrical Engineering volume, Lecture Notes in Electrical Engineering, 2011.

Y.P. Kondratenko, O.V. Kozlov, A. M. Topalov, O.V. Korobko, O.S. Gerasin, ‘Automation of control processes in specialized pyrolysis complexes based on industrial Internet of Things’, in: Vyacheslav Kharchenko, Ah Lian Kor, Andrzej Rucinski (Eds.), Dependable IoT for Human and Industry. Modeling, Architecting, Implementation. Series in Information Science and Technology, River Publishers, Gistrup, Delft, 2018.

Y. Masuda, A. Zimmermann, S. Shirasaka, O. Nakamura, ‘Internet of Robotic Things with digital platforms: digitization of robotics enterprise’, International KES Conference on Human Centred Intelligent Systems, KES-HCIS 2020; Split; Croatia; 17 June 2020, volume 189, 2020.

V. S. Prabhu, R. M. Abinaya, G. Archana, R. Aishwarya, ‘IoT-based automatic library management robot’, 1st

International Conference on Frontiers in Smart Systems Technologies, ICFSST 2019, Chennai, India, volume 3, 2019.

N. Seenu, R.M.K. Chetty, K.M.A. Krishna, T. Srinivas, R.G.P. Raj, ‘A mechatronics design approach of a low-cost smart reconnaissance robot’, 6th International Conference on Information System Design and Intelligent Application, INDIA 2019, Visakhapatnam, volume 134, 2019.

P. Simoens, M. Dragone, A. Saffiotti, ‘The Internet of Robotic Things: a review of concept, added value and applications’, International Journal of Advanced Robotic Systems, 15(1), 2018.

S. Arefin, E. Heya, T. Ashrafi, J. Uddin, ‘Real-life implementation of Internet of Robotic Things Using 5 DoF Heterogeneous Robotic Arm’, 2018 Joint 7th International Conference on Informatics, Electronics & Vision and 2018 2nd International Conference on Imaging, Vision & Pattern Recognition, Kitakyushu, Japan, 2018.

P. Simoens, et al., ‘Internet of Robotic Things: context-aware and personalized interventions of assistive social robots (short paper)’, 2016 5th IEEE International Conference on Cloud Networking (Cloudnet), Pisa, Italy, 2016.

D. Souto, A. Faiña, F. López-Peña, R. J. Duro, ‘Lappa: a new type of robot for underwater non-magnetic and complex hull cleaning’, IEEE International Conference on Robotics and Automation (ICRA), Karlsruhe, 2013.

N.T.-T. Vu, L.X. Ong, N.H. Trinh, S.T.H. Pham, ‘Robust adaptive controller for wheel mobile robot with disturbances and wheel slips’, International Journal of Electrical and Computer Engineering, volume 11, Issue 1, 2020.

M. Komori, T. Terakawa, ‘Omnidirectional mobile robot and vehicle, uninterrupted transmission system, intuitive operating method, and riding robotics: overview of research activities in vibration engineering laboratory in Kyoto University’, Mechanisms and Machine Science, volume 91, 2020.

A. Salam, Q. Javaid, G. Ali, F. Ahmad, M. Ahmad, I. Wahid, ‘Flying sensor network optimization using bee intelligence for Internet of Things’, Intelligent Systems Conference, IntelliSys 2020, London, United Kingdom, volume 1252, 2020.

P.P. Ray, K. Nguyen, ‘A review on blockchain for medical delivery drones in 5G-IoT era: progress and challenges’, 2020 IEEE/CIC International Conference on Communications in China, ICCC Workshops 2020, Chongqing, China, 2020.

L. Bertizzolo, S. D’Oro, L. Ferranti, L. Bonati, E. Demirors, Z. Guan, T. Melodia, S. Pudlewski, ‘Swarm control: an automated distributed control framework for self-optimizing drone networks’, 38th IEEE Conference on Computer Communications, INFOCOM 2020, Toronto, Canada, 2020.

Y. Kondratenko, ‘Robotics, automation and information systems: future perspectives and correlation with culture, sport and life science’, in Decision Making and Knowledge Decision Support Systems, Lecture Notes in Economics and Mathematical Systems, in: A. Gil-Lafuente, C. Zopounidis (Eds.), volume 675, Springer International Publishing Switzerland, 2015.

A. Tkachenko, N. Brovinskaya, Y. Kondratenko, ‘Evolutionary adaptation of control processes in robots operating in non-stationary environments’, Mechanism and Machine Theory 18 (4), 1983.

K.L. Kristina, O. Silver, W.F. Malende, K. Anuradha, ‘Internet of Things application for implementation of smart agriculture system’, International Conference on I-SMAC’ (IoT in Social, Mobile, Analytics and Cloud), Palladam, India, 2017.

P. A. Raj, M. Srivani, ‘Internet of Robotic Things based autonomous fire fighting mobile robot’, IEEE International Conference on Computational Intelligence and Computing Research (IEEE ICCIC 2018), Madurai, India, 2018.

J. L. Avila-Alonso, D. Lopez-Araujo, N. Alvarez-Jarquin, ‘Planning of collision-free trajectories for mobile robots using IoT’, IEEE International Autumn Meeting on Power Electronics and Computing (ROPEC), Ixtapa, Mexico, USA, 2018.

L. Biqing, L. Yongfa, Zh. Hongyan, Zh. Shiyong, ‘The design and realization of cherry tomato harvesting robot based on IoT’, International Journal of Online and Biomedical Engineering (iJOE), 12 (12), 2016.

D. Singh, A. Nandgaohkar, ‘IoT-Based Wi-Fi surveillance robot with real-time audio and video streaming’, in: Advances in Intelligent Systems and Computing, Lonere, India, 2019.

H. Huang, D. Li, Z. Xue, X. Chen, S. Liu, J. Leng, Y. Wei, ‘Design and performance analysis of a tracked wall-climbing robot for ship inspection in shipbuilding’, Ocean Engineering, 131, 2017.

O. Kermorgant, ‘A magnetic climbing robot to perform autonomous welding in the shipbuilding industry’, Robotics and Computer-Integrated Manufacturing, 53, 2018.

G. Lee, J. Park, H. Kim, K. Seo, J. Kim, T. Seo, ‘Wall climbing robots with track-wheel mechanism’, Proceedings of the 3rd International Conference on Machine Learning and Computing (ICMLC 2011), Guillin, China, 2011.

Y. Kondratenko, Y. Zaporozhets, J. Rudolph, O. Gerasin, A. Topalov, O. Kozlov, ‘Modeling of clamping magnets interaction with ferromagnetic surface for wheel mobile robots’, International Journal of Computing, 17 (1), 2018.

Y.P. Kondratenko, O.V. Kozlov, O.V. Korobko, A.M. Topalov, ‘Internet of Things approach for automation of the complex industrial systems’, 13th International Conference on Information and Communication Technologies in Education, Research and Industrial Applications. Integration, Harmonization and Knowledge Transfer, in: Ermolayev, V. et al. (Eds), CEUR-WS, Vol-1844, Kyiv, Ukraine, 2017.

O. Gerasin, O. Kozlov, G. Kondratenko, J. Rudolph, Y. Kondratenko. ‘Neural controller for mobile multipurpose caterpillar robot’, Proceedings of the 10th IEEE International Conference Intelligent Data Acquisition and Advanced Computing Systems: Technology and Applications (IDAACS), volume 1, Metz, France, 2019.

O.S. Gerasin, A.M. Topalov, M.O. Taranov, O.V. Kozlov, Y.P. Kondratenko, ‘Remote IoT-based control system of the mobile caterpillar robot’, CEUR Workshop Proceedings, volume 2740, 2020.

WD WiFi tank car chassis. Electronic resource URL: https://goo.su/1g2Q.

Installation manual for T series Tank Chassis. Doctor of Intelligence & Technology (DOIT). 2016.

S. Jeschke, C. Brecher, H. Song, D. Rawat. Industrial Internet of Things. Springer International Publishing, 2017.

N. Sousa, J. V. V. Sobral, J. J. P. C. Rodrigues, R. A. L. Rabêlo and P. Solic, ‘ERAOF: A new RPL protocol objective function for Internet of Things applications,’ 2017 2nd International Multidisciplinary Conference on Computer and Energy Science (SpliTech), Split, 2017.

M. Bottone, F. Palumbo, G. Primiero, F. Raimondi, R. Stocker, ‘Implementing virtual pheromones in BDI robots using MQTT and Jason’, 5th IEEE International Conference on Cloud Networking. Pisa, Italy, 2016.

A. Kor, C. Pattinson, M. Yanovsky, V. Kharchenko, ‘IoT-enabled smart living. Technology for Smart Futures’, in: M. Dastbaz, H. Arabnia and B. Akhgar (Eds.), Cham : Springer, 2018.

P. Markopoulos, J. Nichols, F. Paternò, V. Pipek, ‘Editorial: End-user development for the Internet of Things’, ACM Transactions on Computer-Human Interaction, volume 24, 2017.

D. Russo, ‘Domotics and robotics’, Dolentium hominum, volume 84, 2014.

Y. P. Kondratenko, O. V. Kozlov, O. S. Gerasin, A. M. Topalov, O. V. Korobko, ‘Automation of control processes in specialized pyrolysis complexes based on Web SCADA Systems’, Intelligent Data Acquisition and Advanced Computing Systems: Technology and Applications (IDAACS): Proceedings of the 9th IEEE International Conference. Bucharest, Romania, volume 1, 2017.

Y. Kondratenko, A. Topalov, O. Gerasin, ‘Analysis and modeling of the slip signals’ registration processes based on sensors with multicomponent sensing elements’, The experience of designing and application of CAD systems in microelectronics (CADSM 2015), Lviv-Poljana, Ukraine, 2015.

Arduino Uno Rev3. Arduino Official Store, URL: https://goo.su/32gO.

G. A. Mutiara, P. Periyadi, A. D. Agnas, V. Darma, ‘Smart vest and monitoring system for airsoft sport – games using vibration sensor’, International Journal of Computing, volume 19, No. 2, 2020.

Wemos D1 R2 and mini on the basis ESP8266. Electronic resource URL: https://goo.su/1FuV.

T. Kusuma, M. Tirta Mulis, ‘Perancangan sistem monitoring infus berbasis mikrokontroler WeMos D1 R2’, Konferensi Nasional Sistem Informasi 2018. STMIK Atma Luhur Pangkalpinang, 2018.

Monster Moto Shield. URL: https://goo.su/1fUw.

16-bit ADC module ADS1115. Electronic resource URL: https://goo.su/1Fuw.

The open-source Arduino Software (IDE), Electronic resource URL: https://goo.su/32Gn.

Blynk IoT platform, Electronic resource URL: https://blynk.io.

O. Gerasin, Y. Zaporozhets, Y. Kondratenko, ‘Models of magnetic driver interaction with ferromagnetic surface and geometric data computing for clamping force localization patches’, IEEE Second International Conference on Data Stream Mining & Processing, Lviv, Ukraine, 2018.

Y. Kondratenko, O. Kozlov, O. Gerasin, ‘Neuroevolutionary approach to control of complex multicoordinate interrelated plants’, International Journal of Computing, volume 18, No. 4, 2019.

O. Brunetkin, K. Beglov, V. Brunetkin, O. Maksymov, O. Maksymova, O. Havaliukh, V., ‘Construction of a method for representing an approximation model of an object as a set of linear differential models’, Eastern-European Journal of Enterprise Technologies, volume 6, No. 2 (108): Information technology. Industry control systems, 2020.

Downloads

Published

2021-06-21

How to Cite

Kondratenko, Y., Gerasin, O., Kozlov, O., Topalov, A., & Kilimanov, B. (2021). Inspection Mobile Robot’s Control System with Remote IoT-based Data Transmission. Journal of Mobile Multimedia, 17(4), 499–526. https://doi.org/10.13052/jmm1550-4646.1742

Issue

2021: Vol 17 Iss 4

Section

Mobile Communication and Computing for Internet of Things and Industrial Automat

Most read articles by the same author(s)