A NOVEL APPROACH FOR SERVICE PERFORMANCE ANALYSIS AND FORECAST

Authors

  • SID KARGUPTA University College London
  • SUE BLACK University College London

Keywords:

SLA, Service Level Agreement, SOA, Service Oriented Architecture, SLM, Service Level Management, QoS, Quality of Service, ART, Average Response Time

Abstract

This research establishes a predictive model to forecast the impact on service performance for changes to the underlying activities of the service‟s components. It deduces a relational model between a service‟s performance, its application component latencies and the request load. The major challenge the IT industry is currently facing with the cost associated with repeated performance testing to modify live systems has been addressed. The notion of implicit Operation Impedance gradient (IG) and Operation Potential (V) in Service Provider-Consumer contracts has been introduced. This work establishes that „IG‟, which impacts the overall Operation Performance (P), is influenced by the underlying application components‟ activities in distinct patterns. A high-level runtime abstract model is empirically deduced between „IG‟, „V‟ and „P‟ by applying established mathematical techniques. Model based indicative values of some features are computed and associated with the actual empirical values of other features against various system configurations. Appropriate regression types are applied to enable trend extrapolation/interpolation. The datasets affirmed effectiveness of the model to assess impact of modifications to the underlying application components on the operation‟s performance without repetitive full scale external performance/benchmark testing. This also enables fine tuning of application components to retrofit prescribed Quality of Services. To address real life applications, this paper describes a Matrix based technique used for the assessment of changes to multiple types of application component activities simultaneously. The method of calibrating the Matrix aided model has also been discussed briefly.

 

Downloads

Download data is not yet available.

References

Sid Kargupta and Sue Black, Service Operation Impedance and its role in projecting some key features in Service Contracts, ICWE 2009, 9th International Conference on Web Engineering, San Sebastian, Spain, June 22nd – 26th, 2009

Sid Kargupta and Sue Black, Visualizing the Underlying Trends of Component Latencies affecting Service Operation Performance, ACTEA 2009, IEEE International Conference on Advances in Computational Tools for Engineering Applications, Lebanon, July 15th – 17th, 2009

Optimized Performance Testing (OPT) at Sonata Software, http://www.sonata-software.com /export/sites/Sonata/sonata_en/innovation/resources/brochures/pdfs/Optimized_Performance_Testing_at_Sonata_Software.pdf [last accessed 22/02/2012]

CAA-KPMG Report on BAA Operating Expenditure, http://www.caa.co.uk/docs/5/ergdocs/ ccstanstedh.pdf [last accessed 26/07/2010]

B2B Cost Cutting and Cost Saving Portal, CostKiller.net, http://costkiller.net/costs-savings/costs-cutting-The-Migration-to-VoIP.htm [last accessed 22/02/2012]

White Paper on Portal Migration Strategy, http://www.chapter26.com/services/Portal Migration Strategy - White Paper v1 1.pdf, [last accessed 22/02/2012]

Change Impact Analysis, http://www.changelogic.com/GettingStarted/ImpactAnalysis?v=13ot, [last accessed 30/03/2012]

Mitigating the Business Impact of Software Changes with Coverity5, http:// www.coverity.com/library/pdf/Coverity5Brochure.pdf [last accessed 22/02/2012]

Change Management: Evaluating CM Tools to Implement a Successful ERP Application CM Strategy, http://www.oracleappsblog.com/index.php [last accessed 22/02/2012]

Natalie L. Petouhoff, Tamra Chandler and Beth Montag-Schultz, Graziadio School of Business and Management, Pepperdine University, Graziadio Business Report - The Business Impact of Change Management, http://gbr.pepperdine.edu/063/change.html [last accessed 22/02/2012]

Daniel A. Menasce, Virgilio A. F. Almeida: Capacity Planning for Web Services. Metrics, Models and Methods. Prentice Hall PTR, Upper Saddle River, NJ 07458, 2002

Arun Iyengar, Jim Challenger, Daniel Dias and Paul Dantzig: High Performance Web Site Design Techniques. Web Design, IEEE Internet Computing, March-April, 2000

D. Ardagna and B. Pernici, Adaptive Service Composition in Flexible Processes, IEEE Transactions on Software Engineering, Vol. 33, No.6, June, 2007

Yan Liu, Alan Fekete and Ian Gorton, Design-Level Performance Prediction of Component-Based Applications, IEEE Transactions on Software Engineering, Vol.31, No.11, 2005

Xiuping Wu, David McMullan and Murray Woodside, Component Based Performance Prediction, Proceedings of the 6th ICSE Workshop on Component-Based Software Engineering: Automated Reasoning and Prediction, 2003

Shiping Chen, Ian Gorton, Anna Liu and Yan Liu, Performance Prediction of COTS Component-based Enterprise Applications, Journal of Systems and Software, Vol 74, Issue 1, 2005, Pages 35-43.

Simonetta Balsamo, Antinisca Di Marco, Paola Inverardi and Marta Simeoni, Model-Based Performance Prediction in Software Development: A Survey, IEEE Transactions on Software Engineering, Vol.30, No.5, 2004

Connie U. Smith and Lloyd G. Williams, Performance Engineering Evaluation of Object-Oriented Systems with SPE.ED, Computer Performance Evaluation: Modelling Techniques and Tools, No.1245, Springer-Verlag, Berlin, 1997

Christopher Stewart and Kai Shen, Performance Modeling and System Management for Multi-component Online Services, Proceedings of the 2nd Symposium on Networked Systems Design and Implementation, May2-4, Boston, MA, USA, 2005

K.S. Jasmine and R. Vasantha, Design Based Performance Prediction of Component Based Software Products, Proceedings of the World Academy of Science, Engineering and Technology, Vol 24, ISSN 1307-6884, October, 2007

Shiping Chen, Bo Yan, Zic J., Ren Liu and Nq A., Evaluation and Modeling of Web Services Performance, IEEE International Conference on Web Services (ICWS‟06) 0-7695-2669-1/06, Sept. 2006

Menasce D.A., Performance and Availability of Internet Data Centers, Internet Computing, IEEE. George Mason University, Fairfax, VA, USA, May-June 2004, Pages 94 - 96.

Carolyn McGregor and Josef Schiefer, A Framework for Analyzing and Measuring Business Performance with Web Services, Proceedings of the IEEE International Conference on E-Commerce (CEC‟03) 0-7695-1969-5/03, 2003

Paul Fortier, Howard Michel, Computer Systems Performance Evaluation and Prediction, ISBN 1-55558-260-5, Digital Press, 2003

I-Hsin Chung and Jeffrey K. Hollingsworth, Automated Cluster-Based Web Service Performance Tuning, Proceedings of the 13th Conference on High Performance Distributed Computing, 2004, Pages 36 – 43.

Marco Vieira and Nuno Laranjeiro, Comparing Web Services Performance and Recovery in the Presence of Faults, Proceedings of the IEEE International Conference on Web Services (ICWS 2007), 0-7695-2924-0/07.

Ana C. C. Machado and Carlos A. G. Ferraz, JWSPerf: A Performance Benchmarking Utility with Support to Multiple Web Services Implementations, Proceedings of the Advanced International Conference on Telecommunications and International Conference on Internet and Web Applications and Services (AICT/ICIW 2006), 0-7695-2522-9/06.

Manjari Asawa, Measuring and Analysing Service Levels: A Scalable Passive Approach, Proceedings of the 1998 Sixth International Workshop on Quality of Service, 1998. (IWQoS 98), Pages 3 – 12.

Jamal Bentahar, Zakaria Maamar, Djamal Benslimane and Philippe Thiran, An Argumentation Framework for Communities of Web Services, IEEE Computer Society, 1541-1672/07, 2007, Pages 75 - 83.

Shiping Chen, John Zic, Kezhe Tang, David Levy, Performance Evaluation and Modeling of Web Services Security, IEEE International Conference on Web Services (ICWS 2007), 0-7695-2924-0/07.

Ariel Pashtan, Andrea Heusser and Peter Scheuermann, Personal Service Areas for Mobile Web Applications, IEEE Internet Computing, November-December 2004, Pages 34 - 39.

Matthew Swinarski, Rajiv Kishore, H. Raghav Rao, Impact of IT Service Provider Process Capabilities on Service Provider Performance: An Empirical Study, Proceedings of the 39th Hawaii International Conference on System Sciences – 2006

Ikuo Matsumura, Toru Ishida, Yohei Murakami and Yoshiyuki Fujishiro, Situated Web Service: Context-Aware Approach to High-Speed Web Service Communication, Proceedings of the IEEE International Conference on Web Services (ICWS‟06), 0-7695-2669-1/06.

Sriram Anand, Srinivas Padmanabhuni, Jai Ganesh, Perspectives on Service Oriented Architecture, Proceedings of the 2005 IEEE International Conference on Services Computing (SCC‟05), 0-7695-2408-7/05

Philipp Liegl, The strategic impact of service oriented architectures, Proceedings of the 14th Annual IEEE International Conference and Workshops on the Engineering of Computer-Based Systems (ECBS‟07), 0-7695-2772-8/07.

Matjaz B. Juric, Marjan Hericko, Tatjana Welzer, Ivan Rozman, Ana Sasa and Marjan Krisper, Web Services and Java Middleware Functional and Performance Analysis for SOA, Proceedings of the 2007 Inaugural IEEE International Conference on Digital Ecosystems and Technologies (IEEE DEST 2007), Pages 217 – 222.

Chuanchang Liu, Zhongwei Li, Junliang Chen, Xiao Lin, Dongtang Ma, A Service Level Agreement-based Web Services Performance, Proceedings of the 16th International Conference on Computer Communications and Networks, 2007, ICCCN 2007, Pages 1279 - 1284

Giovanni Pacifici, Mike Spreitzer, Asser N. Tantawi and Alaa Youssef, Performance Management for Cluster-Based Web Services, IEEE Journal On Selected Areas In Communications, Vol. 23, No. 12, Dec 2005, Pages 2333 – 2343.

Jean-Pierre Garbani with Robert Zimmerman and Stephan Wenninger, Best Practices For Service-Level Management, 2004 Forrester Research, Inc, TechRepublic White Paper, http://whitepapers.techrepublic.com [last accessed 22/02/2012]

End-End Software (Asia Pacific) Pte Ltd, info@end-endsoftware.com, 10, Jalan Besar, 10-03 Sim Lim Tower, Singapore 208787, Service Level Agreements, TechRepublic White Paper, http://whitepapers.techrepublic.com, January 2002 [last accessed 22/02/2012]

Zhengdong Gao and Gengfeng Wu, Combining QoS-based service selection with performance prediction, e-Business Engineering, 2005, ICEBE 2005, IEEE International Conference, School of Comput. Eng. & Sci., Shanghai Univ., China, 18-21 Oct., 2005, Pages 611- 614.

Mou Yu-jie, Cao Jian, Zhang Shen-sheng, Zhang Jian-hong, Interactive Web Service Choice-Making on Extended QoS Model, Proceedings of the 2005 The Fifth International Conference on Computer and Information Technology (CIT‟05), 0-7695-2432-X/05.

Marco Conti, Mohan Kumar, Sajal K. Das and Behrooz A. Shirazi, Quality of Service Issues in Internet Web Services, Proceedings of the IEEE Transactions on Computers, Vol. 51, No. 6, June 2002, Pages 593 - 594

Glen Dobson, Russell Lock, Ian Sommerville, QoSOnt: a QoS Ontology for Service-Centric Systems, Proceedings of the 2005 31st EUROMICRO Conference on Software Engineering and Advanced Applications (EUROMICRO-SEAA‟05)

Gwyduk Yeom, Dugki Min, Design and Implementation of Web Services QoS Broker, Proceedings of the IEEE International Conference on Next Generation Web Services Practices (NWeSP‟05), 2005, 0-7695-2452-4/05.

Ahsan Habib, Sonia Fahmy, Srinivas R. Avasarala, Venkatesh Prabhakar, Bharat Bhargava, On Detecting Service Violations and Bandwidth Theft in QoS Network Domains, TechRepublic White Paper, http://whitepapers.techrepublic.com, 5th November 2002 [last accessed 22/02/2012]

Least Squares Method, http://en.wikiversity.org/wiki/Least-Squares_Method, Last modified on 29th June 2010 [last accessed 22/02/2012]

Downloads

Published

2012-01-30

How to Cite

KARGUPTA, S. ., & BLACK, S. . (2012). A NOVEL APPROACH FOR SERVICE PERFORMANCE ANALYSIS AND FORECAST. Journal of Web Engineering, 11(2), 146–176. Retrieved from https://journals.riverpublishers.com/index.php/JWE/article/view/4219

Issue

Section

Articles