AMobileQoE: An SPL Framework to Measure the QoE of Android Applications
DOI:
https://doi.org/10.13052/jmm1550-4646.1832Keywords:
mobile application, quality of experience, SPL framework, metricsAbstract
Mobile applications are increasingly present in most aspects of our daily life, satisfying the needs of information, communication, and entertainment. Different factors can degrade the performance of these applications or services, and users can undergo unsatisfactory experiences. To achieve acceptance of mobile applications by the user, it is necessary to consider the Quality of Experience, which allows to measure the quality of an application based on the user’s perception. This work presents AMobileQoE, an SPL framework to automatically generate the code necessary to analyse the QoE of mobile applications following the Design Science Research approach. It enables developers to generate more than a thousand different product configurations to measure QoE from a set of network, device, and user metrics. The CovidInfo application was developed to test the SPL framework in a real context with real users, showing the ease of integration and the lightness of the framework. Furthermore, a quality assessment was performed on AMobileQoE showing a high degree of modularity and variability.
Downloads
References
ITU-T. Definition of Quality of Experience (QoE). International Telecommunication Union, 2007.
ETSI TR 102 643. Human Factors (HF); Quality of Experience (QoE) requirements for real-time communication services. Technical report, 2010.
Selim Ickin. Quality of Experience on Smartphone: Network, Application, and Energy Perspectives. PhD thesis, Blekinge Institute of Technology, Faculty of Computing, 2015.
Piotr Nawrocki and Adrian Sliwa. Quality of experience in the context of mobile applications. Computer Science, 17(3):371, sep 2016.
Antonio Collazo Garcia and Sandra Casas. Quality of Experience in Mobile Applications: A Systematic Mapping of Metrics and Tools. International Journal of Interactive Mobile Technologies (iJIM), 14(08):126–139, may 2020.
Klaus Pohl, Günter Böckle, and Frank Van Der Linden. Software product line engineering: Foundations, principles, and techniques. Springer Berlin Heidelberg, 2005.
Paul Clements and Linda Northrop. Software Product Lines: Practices and Patterns. Boston, MA, 2001. Addison-Wesley Longman Publishing Co., Inc.
Frank J Van der Linden, Klaus Schmid, and Eelco Rommes. Software product lines in action: the best industrial practice in product line engineering. Springer Science & Business Media, 2007.
Alcemir Santos, Felipe Gaia, Eduardo Figueiredo, Pedro Santos Neto, and João Araújo. Test-based SPL extraction: An exploratory study. Proceedings of the ACM Symposium on Applied Computing, pages 1031–1036, 2013.
Ken Peffers, Tuure Tuunanen, Marcus A. Rothenberger, and Samir Chatterjee. A design science research methodology for information systems research. Journal of Management Information Systems, 24(3):45–77, dec 2007.
Don Batory. Feature models, grammars, and propositional formulas. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), volume 3714 LNCS, pages 7–20. Springer, Berlin, Heidelberg, 2005.
Paul Clements and Linda Northrop. Software product lines: Practices and patterns. In SEI series in software engineering, Boston, MA, 2002. Addison-Wesley Professional.
Sven Apel, Don Batory, Christian Kästner, and Gunter Saake. Feature-Oriented Software Product Lines. Springer Berlin Heidelberg, 2013.
Sven Apel and Christian Kästner. An overview of feature-oriented software development, 2009.
Kyo C Kang Sholom G Cohen James A Hess William E Novak A Spencer Peterson. Feature-Oriented Domain Analysis (FODA) Feasibility Study. Technical report, Carnegie-Mellon Univ Pittsburgh Pa Software Engineering Inst., 1990.
Rafael Capilla, Jan Bosch, Pablo Trinidad, Antonio Ruiz-Cortés, and Mike Hinchey. An overview of Dynamic Software Product Line architectures and techniques: Observations from research and industry. Journal of Systems and Software, 91(1):3–23, may 2014.
Mohammed El Dammagh and Olga De Troyer. Feature modeling tools: Evaluation and lessons learned. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), volume 6999 LNCS, pages 120–129, 2011.
Meet Android Studio | Android Developers. https://developer.android.com/studio/intro.
FreeMarker Java Template Engine. https://freemarker.apache.org.
Antonio Collazo Garcia and Sandra Casas. Mobile QoE exploration: An unsupervised field study in an Argentine Patagonian city. In Proceedings – International Conference of the Chilean Computer Science Society, SCCC, volume 2020-November. IEEE Computer Society, nov 2020.
S Montagud. Un Método para la Evaluación de la Calidad de Líneas de Productos Software basado en SQuaRE. Tesis de master, Univeridad Politécnica de Valladolid, 2009.
System and Software Quality Requirements and Evaluation (SQuaRE). ISO Standard 25000. https://iso25000.com.
Qi Alfred Chen, Haokun Luo, Sanae Rosen, Z. Morley Mao, Karthik Iyer, Jie Hui, Kranthi Sontineni, and Kevin Lau. QoE Doctor: Diagnosing Mobile App QoE with Automated UI Control and Cross-layer Analysis. In Proceedings of the 2014 Conference on Internet Measurement Conference – IMC ’14, pages 151–164, Vancouver, BC, Canada, 2014.
Vaneet Aggarwal, Emir Halepovic, Jeffrey Pang, Shobha Venkataraman, and He Yan. Prometheus: Toward Quality-of-Experience Estimation for Mobile Apps from Passive Network Measurements. In Proceedings of the 15th Workshop on Mobile Computing Systems and Applications – HotMobile ’14, pages 1–6, New York, USA, 2014. ACM Press.
L. Ravindranath, J. Padhye, S. Agarwal, R. Mahajan, I. Obermiller, and S. Shayandeh. AppInsight: Mobile App Performance Monitoring in the Wild. In Proceedings of the 10th USENIX Conference on Operating Systems Design and Implementation, pages 107–120, 2012.
Qiang Xu, Sanjeev Mehrotra, Zhuoqing Mao, and Jin Li. PROTEUS: network performance forecast for real-time, interactive mobile applications. In Proceeding of the 11th annual international conference on Mobile systems, applications, and services – MobiSys ’13, pages 347–360, New York, USA, 2013. ACM Press.
Lenin Ravindranath, Jitendra Padhye, Ratul Mahajan, and Hari Balakrishnan. Timecard: Controlling User-Perceived Delays in Server-Based Mobile Applications. In Proceedings of the Twenty-Fourth ACM Symposium on Operating Systems Principles – SOSP ’13, pages 85–100, New York, USA, 2013. ACM Press.
Lide Zhang, David R Bild, Robert P Dick, Z Morley Mao, and Peter Dinda. Panappticon: Event-based Tracing to Measure Mobile Application and Platform Performance. In Proceedings of the Ninth IEEE/ACM/IFIP International Conference on Hardware/Software Codesign and System Synthesis, CODES+ISSS ’13, pages 1–10, Piscataway, NJ, USA, 2013. IEEE Press.
Florian Wamser, Michael Seufert, Pedro Casas, Ralf Irmer, Phuoc Tran-Gia, and Raimund Schatz. YoMoApp: A tool for analyzing QoE of YouTube HTTP adaptive streaming in mobile networks. In 2015 European Conference on Networks and Communications (EuCNC), pages 239–243. IEEE, jun 2015.
Katrien De Moor, Istvan Ketyko, Wout Joseph, Tom Deryckere, Lieven De Marez, Luc Martens, and Gino Verleye. Proposed Framework for Evaluating Quality of Experience in a Mobile, Testbed-oriented Living Lab Setting. Mobile Networks and Applications, 15(3):378–391, jun 2010.
Katrien De Moor, Istvan Ketyko, Wout Joseph, Adrian Juan Verdejo, Toon De Pessemier, Lieven De Marez, and Luc Martens. Evaluating ‘Quality of Experience’ of mobile applications and services in a Living Lab setting. In 1st Living Labs Summer School, 2010.
Seokjun Lee and Hojung Cha. User interface-level QoE analysis for Android application tuning. Pervasive and Mobile Computing, 40:382–396, sep 2017.
Fabiana G. Marinho, Rossana M.C. Andrade, Cláudia Werner, Windson Viana, Marcio E.F. Maia, Lincoln S. Rocha, Eldânae Teixeira, João B.Ferreira Filho, Valéria L.L. Dantas, Fabrício Lima, and Saulo Aguiar. MobiLine: A Nested Software Product Line for the domain of mobile and context-aware applications. In Science of Computer Programming, volume 78, pages 2381–2398. Elsevier, dec 2013.
Venilton Falvo Júnior, Nemésio Freitas Duarte Filho, Edson OliveiraJr, and Ellen Francine Barbosa. Towards the Establishment of a Software Product Line for Mobile Learning Applications. In SEKE, pages 678–683, 2014.
Pedro O. Rossel and Valeria Herskovic. Building a domain model for mobile collaborative systems: Towards a software product line. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), volume 8224 LNCS, pages 290–305. Springer, Berlin, Heidelberg, oct 2013.
Clément Quinton, Sébastien Mosser, Carlos Parra, and Laurence Duchien. Using multiple feature models to design applications for mobile phones. In ACM International Conference Proceeding Series, page 1, New York, USA, 2011. ACM Press.
Tobias Durschmid, Matthias Trapp, and Jurgen Dollner. Towards Architectural Styles for Android App Software Product Lines. In 2017 IEEE/ACM 4th International Conference on Mobile Software Engineering and Systems (MOBILESoft), pages 58–62. IEEE, may 2017.
