STeSH: Intelligent Speech Technology Enabled Smart Home Automation Using IoT

Authors

  • Santosh Kumar Sahoo CVR College of Engineering, Hyderabad, Telangana, India https://orcid.org/0000-0001-5270-2387
  • Sushant Kumar Pattnaik School of Electronics Engineering, KIIT University, Bhubaneswar, India https://orcid.org/0000-0002-5916-1488
  • Soumya Ranjan Samal 3)Faculty of Telecommunications, Technical University of Sofia, Bulgaria, 4)Silicon Institute of Technology, Bhubaneswar, India https://orcid.org/0000-0002-2157-3487
  • Chinmay Kumar Nayak Faculty of Emerging Technologies, Sri Sri University, Cuttack, India
  • Jitendra Kuma Das School of Electronics Engineering, KIIT University, Bhubaneswar, India
  • Vladimir Poulkov Faculty of Telecommunications, Technical University of Sofia, Bulgaria

DOI:

https://doi.org/10.13052/jmm1550-4646.1861

Keywords:

Speech Technology, Internet Enabled Services (IES)), Smart Home Automation (SHA), Internet of Things (IoT), STeSH, Speech Recognition

Abstract

Due to the advancement in recent technologies and emergence of Internet of Things (IoT), Smart Home Automation (SHA) plays a vital role in today’s lifestyle. Many users are showing their keen interest to move towards this era of digital transformation in order to take the potential benefits of such intelligent and smart application. Traditional smart home systems have several limitations e.g. connectivity, coverage area, device dependability, platform supportability etc. which makes the system less sustainable. In this paper, the proposed technique introduces a novel scheme to operate the devices in an intelligent manner. The scheme implements a system named as “Speech Technology enabled Smart Home (STeSH)”, which supports voice assisted home automation with extreme security and range-free localization. The idea of the proposed technique is to integrate the power of IoT with classical home automation by using an advanced speech technology service. The entire processing of Speech Enabled Services (SES) is applied with this proposed technique and the detailed analysis is presented with proper experimental proof.

Downloads

Download data is not yet available.

Author Biographies

Santosh Kumar Sahoo, CVR College of Engineering, Hyderabad, Telangana, India

Santosh Kumar Sahoo is currently working as Associate Professor in the Department of Electronics & Instrumentation Engineering at CVR College of Engineering, Hyderabad, India. He has 16 years of teaching experience including 5 years of research experience. He has published 30 research publications in international journals, 45 papers in the proceedings of refereed international and national conferences with 5 best paper awards. He has reviewed more than 100 technical papers, served as reviewer and editorial board member for more than 20 journals and published 2 books in repute international publishers. He has served roughly 25 conference and workshops. He has delivered invited lectures, Keynote addresses and Chaired technical sessions in various international conferences. He has received Out Standing Teacher Award by Indo Global Chamber of Commerce-2018. He is an active member in IEEE, life member in ISTE, IETE etc.

Sushant Kumar Pattnaik, School of Electronics Engineering, KIIT University, Bhubaneswar, India

Sushant Kumar Pattnaik received his M. Tech degree in Electronics and Communication from NIT, Rourkela in 2010. He received his B. E. (Electrical and Electronics Engineering) from Berhampur University in 2001. He is now working as Assistant Professor, Electronics & Communication Engineering, Silicon Institute of Technology, Bhubaneswar. He has got more than 11 years teaching and research experience in the field of VLSI Design, IoT & Embedded Systems. He was having 3 years of Industrial Experience in the field of power electronics (UPS Manufacturing Company) and 3 years of Research experience in the field of VLSI & Embedded Systems at NIT Rourkela.

Soumya Ranjan Samal, 3)Faculty of Telecommunications, Technical University of Sofia, Bulgaria, 4)Silicon Institute of Technology, Bhubaneswar, India

Soumya Ranjan Samal received his Ph.D. degree in Communication Networks, Faculty of Telecommunications from Technical University of Sofia at Sofia, Bulgaria. He received his B.Tech. degree in Electronics & Instrumentation Engineering from Biju Patnaik University of Technology, Bhubaneswar, India in 2004. Soumya then went on to pursue his M.E. in Computer Science & Engineering from the Utkal University of Bhubaneswar, India in 2009. He, as a Senior Assistant Professor in Silicon Institute of Technology, Bhubaneswar, India has acquired a solid experience about 15 years of teaching in Communication Engineering. Soumya also worked as a Project Engineer in Indian Institute of Technology, Bombay, India in 2005. His research area of interest includes, Interference Management in 6G cellular network, Green Communication movement to develop Energy Efficient solutions through antenna parameters and IoT.

Chinmay Kumar Nayak, Faculty of Emerging Technologies, Sri Sri University, Cuttack, India

Chinmaya Kumar Nayak is currently working as a Sr. Assistant Professor in Faculty of Emerging Technologies (FET) – Sri Sri University, Odisha, India. He is having 15 years of reach experience in teaching. He received his Ph.D. (Computer Science and Engineering) from Veer Surendra Sai University of Technology (VSSUT), Burla, Odisha,India. He received his B.Tech(Information Technology) and M.Tech (Computer Science and Engineering) from Biju Patnaik University of Technology, Odisha, India. His research interest includes Computer Networks, Wireless Sensor Networks, Data Science, Artificial Intelligence and Machine Learning.

Jitendra Kuma Das, School of Electronics Engineering, KIIT University, Bhubaneswar, India

Jitendra Kumar Das has received his Ph. D. degree in Electronics and Communication from NIT, Rourkela in 2011. He received his B. E. (Electronics and Telecommunication) from Utkal University in 1992. He received his M. Tech in EE (Electronics System and Communication) from NIT, Rourkela in 2004. He is now working as Associate Professor, School of Electronics Engineering, KIIT Deemed to be University, Bhubaneswar. He successfully guided 3 Ph. D. student and 20 MTECH students. He has got more than 15 years teaching experience in the field of VLSI Design, Embedded Systems and Signal Processing. His research interest are Semiconductor Device and Nanostructures, VLSI DSP, Embedded System Design and IoT, FPGA and Reconfigurable computing.

Vladimir Poulkov, Faculty of Telecommunications, Technical University of Sofia, Bulgaria

Vladimir Poulkov has received the M.Sc. and Ph.D. degrees from the Technical University of Sofia, Sofia, Bulgaria. He has more than 30 years of teaching, research, and industrial experience in the field of telecommunications, as a Research and Development Engineer in industry, and has been a Full Professor with the Faculty of Telecommunications, Technical University of Sofia, since 1981. He has successfully managed and realized numerous industrial and engineering projects, related to the development of the transmission and access network infrastructures in Bulgaria, many Research and Development and educational projects. He was the Dean of the Faculty of the Telecommunications from 2007 to 2015. He is currently the Head of the Teleinfrastructure Research and Development Laboratory with the Technical University of Sofia, and the Chairman of the Bulgarian Cluster of Telecommunications, Sofia, Senior IEEE Member and co-founder of the CONASENSE (Communication, Navigation, Sensing and Services) society. He has authored more than 100 scientific publications and is tutoring B.Sc., M.Sc., and Ph.D. courses in Information Transmission Theory and Next Generation Access Networks. His current research interests include interference and resource management in next-generation network and Internet of Things.

References

David J. et al. (2021). The Internet of Everything: Smart things and their impact on business models, Journal of Business Research, Volume 122, 2021, pp. 853–863, ISSN 0148-2963, https://doi.org/10.1016/j.jbusres.2019.12.035.

Kumar, S., Tiwari, P. and Zymbler, M., (2019). Internet of Things is a revolutionary approach for future technology enhancement: a review. Journal of Big Data 6, 111, Springer. https://doi.org/10.1186/s40537-019-0268-2.

Stolojescu-Crisan, C., Crisan, C., and Butunoi B-P., (2021). An IoT-Based Smart Home Automation System, Sensors, 21(11):3784, https://doi.org/10.3390/s21113784.

Swain, K.P., et al., (2021). Academic Students Attendance System: A Case Study of Alexa Skill Development, In: Sabut S.K., Ray A.K., Pati B., Acharya U.R. (eds) Proceedings of International Conference on Communication, Circuits, and Systems, Lecture Notes in Electrical Engineering, vol. 728. Springer, Singapore, https://doi.org/10.1007/978-981-33-4866-0_1.

Rasha El-Azab, (2021). Smart homes: potentials and challenges, Clean Energy, Volume 5, Issue 2, Pages 302–315, https://doi.org/10.1093/ce/zkab010.

Sathesh and Hamdan, Y. B., (2021). Smart Home Environment Future Challenges and Issues - A Survey, Journal of Electronics and Informatics, 3(1), 1–14, doi:10.36548/jei.2021.1.001.

Lobaccaro, G., Carlucci, S., and Löfström, E., (2016). A Review of Systems and Technologies for Smart Homes and Smart Grids, Energies, 9(5):348, https://doi.org/10.3390/en9050348.

Kehinde, L., and Rafsanjani, H. N., (2021). Trends, benefits, risks, and challenges of IoT implementation in residential and commercial buildings, Energy and Built Environment, ISSN 2666-1233, https://doi.org/10.1016/j.enbenv.2021.01.009.

Hussain A. F., et al., (2021). Zigbee and GSM Based Security System for Business Places, International Conference on Advance Computing and Innovative Technologies in Engineering (ICACITE), pp. 264–267, doi: 10.1109/ICACITE51222.2021.9404577.

Jothi, T. M., et al., (2018). GSM Based Home Environment Monitoring System, 2nd International Conference on Trends in Electronics and Informatics (ICOEI), pp. 1263–1268, doi: 10.1109/ICOEI.2018.8553839.

Choudhury, B., et al., (2015). Design and implementation of an SMS based home security system, IEEE International Conference on Electrical, Computer and Communication Technologies (ICECCT), pp. 1–7, doi: 10.1109/ICECCT.2015.7226115.

Sharma, R. K. et al., (2014). Android interface based GSM home security system, International Conference on Issues and Challenges in Intelligent Computing Techniques (ICICT), pp. 196–201, doi: 10.1109/ICICICT.2014.6781278.

Teymourzadeh, R., et al., (2013). Smart GSM based Home Automation System, IEEE Conference on Systems, Process & Control (ICSPC), pp. 306–309, doi: 10.1109/SPC.2013.6735152.

Danbatta, S. J. and Varol, A., et al., (2019). Comparison of Zigbee, Z-Wave, Wi-Fi, and Bluetooth Wireless Technologies Used in Home Automation, 7th International Symposium on Digital Forensics and Security (ISDFS), pp. 1–5, doi: 10.1109/ISDFS.2019.8757472.

Withanage, C., et al., (2014). A comparison of the popular home automation technologies, IEEE Innovative Smart Grid Technologies – Asia (ISGT ASIA), pp. 600–605, doi: 10.1109/ISGT-Asia.2014.6873860.

Asadullah, M. and Ullah, K., (2017). Smart home automation system using Bluetooth technology, International Conference on Innovations in Electrical Engineering and Computational Technologies (ICIEECT), pp. 1–6, Karachi, Pakistan.

Anandhavalli, D.; Mubina, N.S. and Bharath, P., (2015). Smart Home Automation Control Using Bluetooth and GSM, Int. J. Inf. Futur. Res., 2, 2547–2552.

Anitha, G., et al., (2021). Bluetooth Based Home Automation and Security System, Journal of Physics: Conference Series, Bristol Vol. 1916, Iss. 1, DOI: 10.1088/1742-6596/1916/1/012106.

Baraka, K., et al., (2013). Low Cost Arduino/Android-Based Energy-Efficient Home Automation System with Smart Task Scheduling, 5th International Conference on Computational Intelligence, Communication Systems and Networks, pp. 296–301, Madrid, Spain.

Zamora-Izquierdo, M.A., Santa, J. and Gomez-Skarmeta, A.F., (2010). An Integral and Networked Home Automation Solution for Indoor Ambient Intelligence. IEEE Pervasive Comput. 2010, 9, 66–77.

Froiz-Míguez, I., et al., (2018). Design, Implementation and Practical Evaluation of an IoT Home Automation System for Fog Computing Applications Based on MQTT and ZigBee-WiFi Sensor Nodes. Sensors, 18, 2660.

Li, Z.M., Song, M., and Gao, L., (2014). Design of Smart Home System Based on Zigbee. Appl. Mech. Mater., 635–637, 1086–1089.

Vivek, G. and Sunil, M., (2015). Enabling IOT services using WIFI-ZigBee gateway for a home automation system, IEEE International Conference on Research in Computational Intelligence and Communication Networks (ICRCICN), pp. 77–80, Kolkata, India.

Huang, F.-L., and Tseng, S.-Y., (2016). Predictable smart home system integrated with heterogeneous network and cloud computing, International Conference on Machine Learning and Cybernetics (ICMLC), Volume 2, pp. 649–653, Jeju, Korea,

Jadhav, P., Chaudhari, A.and Vavale, S. (2014). Home Automation using Zigbee Protocol, International Journal of Computer Science and Information Technologies, Vol. 5(2), 2014, 1778–1780.

Ozeer, U., et al., (2019). Designing and Implementing Resilient IoT Applications in the Fog: A Smart Home Use Case. In Proceedings of the 2019 22nd Conference on Innovation in Clouds, Internet and Networks and Workshops (ICIN), pp. 230–232, Paris, France,

Yassein, M. B., Mardini, W., and Khalil, A., (2016). Smart homes automation using Z-wave protocol, International Conference on Engineering & MIS (ICEMIS), pp. 1–6, doi: 10.1109/ICEMIS.2016.7745306.

Davidovic, B. and Labus, A., (2016). A smart home system based on sensor technology, Facta Univ. Ser. Electron. Energetics, 29, 451–460.

Jabbar, W.A., et al., (2019). Design and Fabrication of Smart Home with Internet of Things Enabled Automation System, IEEE Access, 7, 144059–144074.

Bhatt, A. and Patoliya, J., (2016). Cost effective digitization of home appliances for home automation with low-power WiFi devices, International Conference on Advances in Electrical, Electronics, Information, Communication and Bio-Informatics (AEEICB), pp. 643–648, Chennai, India.

Yan, W., et al., (2019). Smart home implementation based on Internet and WiFi technology, Chinese Control Conference (CCC), pp. 9072–9077, Hangzhou, China.

Joshi1, M., and Kumbhare, K., (2018). A Review on Efficient Mac Layer Handoff Protocol to Reduce Handoff Latency for Wi-Fi Based Wireless Network, International Journal of Scientific Research in Computer Science and Engineering, Vol. 6, Issue.2, pp. 82–86.

Sebastian, A. and Sivagurunathan, S., (2018). A Survey on Load Balancing Schemes in RPL based Internet of Things, International Journal of Scientific Research in Network Security and Communication, Vol. 6, Issue 3, pp. 43–49.

Jabbar, W. A., et al., (2018). Design and Implementation of IoT-Based Automation System for Smart Home, International Symposium on Networks, Computers and Communications (ISNCC), pp. 1–6, Italy.

Bhatt, P., Thaker, B., and Shah, N., (2018). A Survey on Developing Secure IoT Products”, International Journal of Scientific Research in Computer Science and Engineering, Vol. 6, Issue 5, pp. 41–44.

Singh, U., and Ansari, M.A. (2019). Smart Home Automation System Using Internet of Things, 2nd International Conference on Power Energy, Environment and Intelligent Control (PEEIC), 144–149.

Kodali, R.K., et al., (2016). IoT based smart security and home automation system, International Conference on Computing, Communication and Automation (ICCCA), pp. 1286–1289, Noida, India.

Majeed, R., et al., (2020). An Intelligent, Secure, and Smart Home Automation System, 1058-9244, volume 2020, Article ID 4579291, Scientific Programming, Hindawi, https://doi.org/10.1155/2020/4579291.

Rathnayake, K. A. S. V., et al., (2016). Voice operated home automation system based on Kinect sensor, IEEE International Conference on Information and Automation for Sustainability (ICIAfS), pp. 1–5, Sri Lanka.

Venkatraman, S., and Overmars, A., and Thong, M., (2021). Smart Home Automation—Use Cases of a Secure and Integrated Voice-Control System. Systems, 9(4), 77. https://doi.org/10.3390/systems9040077.

Uma, S., et al., (2019). IoT based Voice/Text Controlled Home Appliances, Procedia Computer Science, Volume 165, Pages 232–238, ISSN 1877-0509, https://doi.org/10.1016/j.procs.2020.01.085.

Yang. C., (2021). Design of Smart Home Control System Based on Wireless Voice Sensor, Journal of Sensors, Hindawi, Article ID 8254478, Vol. 2021, https://doi.org/10.1155/2021/8254478.

Mittal, Y., et al., (2015). A voice-controlled multi-functional Smart Home Automation System, Annual IEEE India Conference (INDICON), pp. 1–6, doi: 10.1109/INDICON.2015.7443538.

Erić, T., et al., (2017). Voice control for smart home automation: Evaluation of approaches and possible architectures, IEEE 7th International Conference on Consumer Electronics – Berlin (ICCE-Berlin), pp. 140–142, doi: 10.1109/ICCE-Berlin.2017.8210613.

Celebre, A. M. D., et al., (2015). Home automation using raspberry Pi through Siri enabled mobile devices, International Conference on Humanoid, Nanotechnology, Information Technology, Communication and Control, Environment and Management (HNICEM), pp. 1–6, doi: 10.1109/HNICEM.2015.7393270.

Piyare. R., and Tazil, M. (2011). Bluetooth based Home Automation System using Cell Phone, IEEE 15th International Symposium on Consumer Electronics (ISCE), 192–195.

Alshu’Eili, H., Gupta, G. S., and Mukhopadhyay, S., (2011). Voice recognition based wireless home automation system. In 4th International Conference on Mechatronics: Integrated Engineering for Industrial and Societal Development, ICOM’11 – Conference Proceedings Institute of Electrical and Electronics Engineers (IEEE), https://doi.org/10.1109/ICOM.2011.5937116.

Hidayat, S., and Firmanda, S. F., (2015). Scheduler and voice recognition on home automation control system, 3rd International Conference on Information and Communication Technology (ICoICT), pp. 150–155, doi: 10.1109/ICoICT.2015.7231413.

Jain, S., Vaibhav, A., and Goyal, L., (2014). Raspberry Pi based interactive home automation system through E-mail, International Conference on Reliability Optimization and Information Technology (ICROIT), pp. 277–280, doi: 10.1109/ICROIT.2014.6798330.

Narender, M., and Vijaylakshmi, M., (2014). Raspberry Pi based Advanced Scheduled Home Automation System through E-mail, IEEE International Conference on Computational Intelligence and Computing Research, pp. 1–4, doi: 10.1109/ICCIC.2014.7238413.

Pavithra, D., and Balakrishnan, R., (2015). IoT based Monitoring and Control System for Home Automation, Global Conference on Communication Technologies (GCCT), pp. 169–173, 2015, doi: 10.1109/GCCT.2015.7342646.

Alsuhaym, F. et al., (2021). Toward Home Automation: An IoT Based Home Automation System Control and Security, International Congress of Advanced Technology and Engineering (ICOTEN), pp. 1–11, doi: 10.1109/ICOTEN52080.2021.9493464.

Purwar, K., and Verma, A., (2017). Smart Home Automation System based on IoT through Speech, International Journal of Computer Applications, 172, 36–42.

Haque, M. E., et al. (2019). IoT Based Home Automation System with Customizable GUI and Low Cost Embedded System, International Conference on Sustainable Technologies for Industry 4.0 (STI), pp. 1–5, doi: 10.1109/STI47673.2019.9068035.

Kumar, K. P. M., et al. (2019). Intrusion detection system based on GA-fuzzy classifier for detecting malicious attacks, Concurrency and Computation Practice and Experience 33(1), https://doi.org/10.1002/cpe.5242.

Asaithambi, S.P.R., Venkatraman, S., and Venkatraman. R., (2021). Big Data and Personalisation for Non-Intrusive Smart Home Automation, Big Data and Cognitive Computing. 5(1):6, https://doi.org/10.3390/bdcc5010006.

Anathi, M., and Vijayakumar, K., (2020). An Intelligent Approach for Dynamic Network Traffic Restriction using MAC Address Verification, Computer Communications, Volume 154, pp. 559–564, ISSN 0140-3664, https://doi.org/10.1016/j.comcom.2020.02.021.

Kumar, K., (2017). Fog computing: The essential catalyst for optimizing the true potential of cloud-based internet of things, International Journal of Applied Research on Information Technology and Computing, 8(3), 247–262, ISSN: 2249-3212, DOI: 10.5958/0975-8089.2017.00021.5.

Downloads

Published

2022-07-02

How to Cite

Sahoo, S. K. ., Pattnaik, S. K. ., Samal, S. R. ., Nayak, C. K. ., Das, J. K. ., & Poulkov, V. . (2022). STeSH: Intelligent Speech Technology Enabled Smart Home Automation Using IoT. Journal of Mobile Multimedia, 18(06), 1471–1496. https://doi.org/10.13052/jmm1550-4646.1861

Issue

2022: Vol 18 Iss 6

Section

Articles