Comparison of Network Performance Metrics for Dependable IoT Systems
DOI:
https://doi.org/10.13052/jmm1550-4646.2242Keywords:
Internet of Things (IoT), Functional Correctness, Availability, Responsiveness, Reliability, Resilience.Abstract
With the emergence of IoT, many aspects of our daily life are being transformed. Billions of smart devices are being connected globally to perform efficient decision making for individuals. This increases their requirement to qualify as dependable systems. Thus, the performance of such systems becomes crucial and inherently depends upon the proper functioning of its components and the underlying network. Conventionally network performance has been measured by measuring factors like packet loss, packet delivery ratio, throughput and delay, but these metrics have not provided a satisfactory measure of system dependability. In this contribution, we present analytical formulations that are used to analyze the behavior of the IoT networks, under different types of payloads, such as video, voice and text traffic. We also examine network resilience as an example of FTP (File transfer protocol) and CoAP (Constrained Application Protocol). These measures are systematically correlated with the quality characteristics that have been defined in ISO/IEC 25010, thus providing a cohesive framework of assessing the performance as well as the dependability of an IoT network. The approach suggested gives a greater understanding of those factors that influence the network connectivity and the overall robustness of the system in the case of IoT application.
Downloads
References
Amiri, Z., Heidari, A., Navimipour, N.J., and Unal, M., 2023. “Resilient and dependability management in distributed environments: A systematic and comprehensive literature review.” Cluster Computing 26(2):1565–1600.
Verma, N., et al., 2012. “Enabling system-level platform resilience through embedded data-driven inference capabilities in electronic devices.” 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).
Abdallah, R.A., and Shanbhag, N.R., 2013. “Error-resilient systems via statistical signal processing.” SiPS 2013 Proceedings.
Sterbenz, J.P.G., et al., 2010. Resilience and survivability in communication networks: Strategies, principles, and survey of disciplines.” Computer Networks 54(8):1245–1265.
Rohrer, J.P., et al., 2014. “Path diversification for future internet end-to-end resilience and survivability.” Telecommunication Systems 56(1): 49–67.
Lei, J.-J., and Kwon, G.-I., 2010. “Reliable data transmission based on erasure-resilient code in wireless sensor networks.” KSII Transactions on Internet and Information Systems (TIIS) 4(1):62–77.
Pandey, R.D., and Snigdh, I. 2022. Validity as a measure of data quality in Internet of Things systems. Wireless Personal Communications 126(1):933–948.
Amiri, Z., et al., 2023. “Resilient and dependability management in distributed environments: A systematic and comprehensive literature review,” Cluster Computing 26:1565–1600. DOI:10.1007/s10586-022-03738-5.
Moridi, M.A., et al., 2018. “Performance analysis of ZigBee network topologies for underground space monitoring and communication systems.” Tunnelling and Underground Space Technology 71: 201–209.
Leem, L., et al., 2010. “ERSA: Error resilient system architecture for probabilistic applications.” 2010 Design, Automation & Test in Europe Conference & Exhibition.
Betzler, A., et al., 2015. “CoCoA+: An advanced congestion control mechanism for CoAP.” Ad Hoc Networks 33:126–139.
Bormann, C., Castellani, A.P., and Shelby, Z., 2012. “CoAP: An application protocol for billions of tiny internet nodes.” IEEE Internet Computing 16(2):62–67.
Kershaw, S., and Hughes-Jones, R., 2010. “A study of constant bit-rate data transfer over TCP/IP.” Future Generation Computer Systems 26(1):128–134.
Udoh, I.S., and Kotonya, G., 2018. “Developing IoT applications: challenges and frameworks.” IET Cyber-Physical Systems: Theory & Applications 3(2):65–72.
Babovic, Z.B., Protic, J., and Milutinovic, V., 2016. “Web performance evaluation for internet of things applications.” IEEE Access 4:6974–6992.
Shirazi, F., Diaz, C., and Wright, J., 2015. “Towards measuring resilience in anonymous communication networks.” Proceedings of the 14th ACM Workshop on Privacy in the Electronic Society.
Wang, Y., 2016. “System resilience quantification for probabilistic design of Internet-of-Things architecture.” International Design Engineering Technical Conferences and Computers and Information in Engineering Conference.
da Cruz, M.A.A., et al., 2018. “Performance evaluation of IoT middleware.” Journal of Network and Computer Applications 109:53–65.
Vandikas, K., and Tsiatsis, V., 2014. “Performance evaluation of an IoT platform.” 2014 Eighth International Conference on Next Generation.
Dang, T.-B., et al., 2017. “Performance evaluation of an IoT platform.” Proceedings of the Korea Information Processing Society Conference.
Sindjoung, M.L.F., and Minet, P., 2019. “Wireless link quality prediction in IoT networks.” 2019 8th International Conference on Performance Evaluation and Modeling in Wired and Wireless Networks (PEMWN).
Demir, S.M., Al-Turjman, F., and Muhtaroðlu, A., 2018. “Energy scavenging methods for WBAN applications: A review.” IEEE Sensors Journal 18(16):6477–6488.
Ding, G., et al., 2018. “An amateur drone surveillance system based on the cognitive Internet of Things.” IEEE Communications Magazine 56(1):29–35.
Yang, G., and Liang, H., 2018. “A smart wireless paging sensor network for elderly care application using LoRaWAN.” IEEE Sensors Journal 18(22):9441–9448.
Gravalos, I., et al., 2018. “Efficient network planning for internet of things with QoS constraints.” IEEE Internet of Things Journal 5(5):3823–3836.
Grimaldi, S., et al., 2020. “Onboard Spectral Analysis for Low-Complexity IoT Devices.” IEEE Access 8:43027–43045.
Abdel-Khalek, R., Parikh, R., DeOrio, A., and Bertacco, V., 2011. “Functional correctness for CMP interconnects.” 2011 IEEE 29th International Conference on Computer Design (ICCD) pp. 352–359.
Girão-Silva, R., Martins, L., Gomes, T., Alashaikh, A., and Tipper, D., 2019. Improving network availability – a design perspective. Third International Congress on Information and Communication Technology: ICICT 2018, London (pp. 799–815). Springer Singapore.
Jaffe, J., and Moss, F., 1982. A responsive distributed routing algorithm for computer networks. IEEE Transactions on Communications 30(7):1758–1762.
Xing, L., 2020. Reliability in Internet of Things: Current status and future perspectives. IEEE Internet of Things Journal 7(8):6704–6721.
Berger, C., Eichhammer, P., Reiser, H.P., Domaschka, J., Hauck, F.J., and Habiger, G., 2021. A survey on resilience in the IoT: Taxonomy, classification, and discussion of resilience mechanisms. ACM Computing Surveys (CSUR) 54(7):1–39.
Francis, R., and Bekera, B., 2014. “A metric and frameworks for resilience analysis of engineered and infrastructure systems.” Reliability Engineering & System Safety 121:90-103.
