A COSMIC-FFP APPROACH TO PREDICT WEB APPLICATION DEVELOPMENT EFFORT
Keywords:
Dynamic Web applications, size metrics, empirical validation, effort prediction modelsAbstract
We describe an approach to predict Web application development effort, which is based on the main ideas underlying COSMIC-FFP (Cosmic Full Function Point). The method is focused on counting data movements and turns out to be suitable for capturing the specific aspects of dynamic Web applications, which are characterized by data movements to and from Web servers. It is based on two measures that can be applied to analysis and design documentation in order to provide early estimations. We also describe the empirical analysis which has been carried out to verify the usefulness of the approach for predicting Web application development effort.
Downloads
References
S.M. Abrahão, O. Pastor, “Measuring the functional size of Web applications”, in International Journal of
Web Engineering and Technology, vol. 1, no. 1, 2003.
S.M. Abrahão, Geert Poels, O. Pastor, “Evaluating a Functional Size Measurement Method for Web
Applications: An Empirical Analysis”, in Proceedings of International Software Metrics Symposium
(METRICS’04), Chicago, September 2004, pp 358-369.
A.J. Albrecht, “Measuring Application Development Productivity”, in Proceedings of the Joint
SHARE/GUIDE/IBM Application Development Symposium, Monterey, 1979, pp. 83-92.
R.D. Banker, R.J. Kaufman, R. Kumar, “An empirical test of object-oriented output measurement metrics
in a computer aided software engineering environment”, Journal of Management Information Systems, vol.
, no. 3, winter 1991-92.
L. Baresi, E. Bianchi, L. Mainetti, M. Maritati, A. Paro, “UWA Hypermedia - User Manual”, Technical
Report UWA-15, Politecnico di Milano, 2001.
L. Baresi, S. Morasca, P. Paolini, “Estimating the Design Effort of Web Applications,” in Proceedings of
the International Software Metrics Symposium (METRICS’03), Sydney, 2003, pp. 62-72.
L. Baresi, F. Garzotto, P. Paolini, “From Web Sites to Web Applications: New Issues for Conceptual
Modeling”, in Proceedings of the International Workshop on The World Wide Web and Conceptual
Modeling, co-located with the 19th International Conference on Conceptual Modeling, Salt Lake City,
October 2000, pp. 89-100.
V.R. Basili, L.C. Briand, W.L. Melo, “A Validation of Object-Oriented Design Metrics as Quality
Indicators,” IEEE Transaction on Software Engineering, vol. 22, no. 10, pp. 751-761, 1996.
V. Bévo V, G. Lévesque and A. Abran, “A pplication de la Mèthode FFP à partir d'une spécification selon
la notation UML: compte rendu des premiers essais d'application et questions”, International Workshop
on Software Measurement (IWSM99), Lac Supérieur, September 1999, pp. 230-242.
B.W. Boehm, C. Abts, A.W. Brown, S. Chulani, B.K. Clark, W. Horowitz, R. Madachy, D. Reifer, B.
Steece, “Software Cost Estimation with COCOMO II”, Prentice Hall, NJ, 2000.
B.W. Boehm, Z. Chen, T. Menzies, D. Port, “Feature Subset Selection Can Improve Software Cost
Estimation Accuracy”, in Proceedings of the Workshop on Predictor models in software engineering
(PROMISE’05), St. Louis, 2005, pp. 1-6.
D. A. Boehm-Davis, L. S. Ross, “Program Design Methodologies and the Software Development
Process”, International Journal of Man-Machine Studies, vol. 36, no.1, pp.1-19, 1992.
T.S. Breush, A.R. Pagan, “A simple test for heteroscedasticity and random coefficient variation”, in
Econometrica 47(1979), pp. 1287-1294.
L. Briand, K. El Emam, F. Bomarius, “COBRA: A Hybrid Method for Software Cost Estimation,
Benchmarking, and Risk Assessment”, in Proceedings of International Conference on Software
Engineering (ICSE’98), April 1998, pp. 390-399.
L. Briand, K. E. Emam, D. Surmann, I. Wiekzorek, and K. Maxwell “An Assessment and Comparison of
Common Software Cost Estimation Modeling Techniques,” in Proceedings of International Conference on
Software Engineering (ICSE’99), Los Angeles, May 1999, pp. 313-322.
L. Briand, K. E. Emam, I. Wieczorek, “Explaining the Cost of European Space and Military Projects”, in
Proceedings of International Conference on Software Engineering (ICSE’99), Los Angeles, May 1999, pp.
-312.
L. Briand, T. Langley, I. Wieczorek, “A Replicated Assessment and Comparison of Common Software
Cost Modeling Techniques”, International Software Engineering Research Network Technical Report
ISERN-99-15.
L. Briand, I. Wieczorek. Software Resource Estimation. Encyclopedia of Software Engineering. Volume 2.
P-Z (2nd ed.), Marciniak, John J. (ed.) New York: John Wiley & Sons, pp. 1160-1196, 2002.
B. Bruegge, A. H. Dutoit, “Object-Oriented Software Engineering: Using UML, Patterns and Java”, (2nd
edition), Prentice-Hall, 2003.
J. Carver, L. Jaccheri, S. Morasca, F. Shull, “Issues in Using Students in Empirical Studies in Software
Engineering Education”, in Proceedings of International Software Metrics Symposium (METRICS’03),
Sydney, September 2003, pp. 239-249.
S. Ceri, P. Fraternali, A. Bongio, M. Brambilla, S. Comai, M. Matera, “Designing Data-Intensive Web
Applications”, Morgan-Kaufmann, 2002.
J. Conallen, “Modelling Web Application Architectures with UML”, Communications of the ACM, vol. 42,
no. 10, pp. 63-70, 1999
J. Conallen, Building Web Applications with UML, Addison-Wesley Object Technology Series, 1999.
D. Conte, H.E. Dunsmore, V.Y. Shen, “Software Engineering Metrics and Models”, The
Benjamin/Cummings Publishing Company, Inc., 1986.
COSMIC: COSMIC-FFP Measurement manual, version 2.2, http://www.cosmicon.com, 2003.
G. Costagliola, F. Ferrucci, C. Gravino, G. Tortora, G. Vitello, “A COSMIC-FFP Based Method to
Estimate Web Application Development Effort”, in LNCS 3140, N. Koch, P. Fraternali, and M. Wirsing
(Eds.): ICWE 2004, Monaco, July 2004, pp. 161-165.
H. Diab, M. Frappier, and R. St-Denis, “A Formal Definition of COSMIC-FFP for Automated
Measurement of ROOM Specifications”, in Proceedings European Conf. Soft. Measurement and ICT
Control, Heidelberg, May 2001, pp. 185-196.
H. Diab, F. Koukane, M. Frappier, and R. St-Denis, “McRose: Functional Size Measurement of Rational
Rose RealTime”, in Proceedings International Workshop Quantitative Approaches in OO Software
Engineering, Malaga, June 2002, pp. 15-24.
K.E. Emam, “A Primer on Object-Oriented Measurement”, in Proceedings of IEEE International Sofware
Metrics Symposium (METRICS’01), London, 2001, pp. 185-188.
F. Garzotto, P. Paolini, D. Schwabe, “HDM: A Model-based Approach to Hypertext Application Design”,
ACM Transactions of Information Systems, vol. 11, no. 1, pp. 1-26, 1993.
M. Host, B. Regnell, C. Wholin, “Using Students as Subjects—A Comparative Study of Students and
Professionals in Lead-Time Impact Assessment”, in Conference of Empirical Assessment & Evaluation in
Software Engineering (EASE’00), Keele University, UK, 2000.
International Function Point Users Group: “Function Point Counting Practices Manual,” Release 4.1.1,
M.S. Jenner, “COSMIC-FFP and UML: Estimation of the Size of a System specified in UML-Problems of
Granularity”, in Proceedings of European Conference Software Measurement and ICT Control,
Heidelberg, May 2001, pp. 173-184.
M.S. Jenner, “Automation of Counting of Functional Size Using COSMIC-FFP in UML,” in Proceedings
of Workshop Software Measurement, Magdeburg, October 2002, pp. 43-51.
B. A. Kitchenham, “A Procedure for Analyzing Unbalanced Datasets”, IEEE Transaction on Software
Engineering, vol. 24 no. 4, pp. 278-301, 1998.
B. A. Kitchenham, S. L. Pfleeger, L. M. Pickard, P. W. Jones, D. C. Hoaglin, K. El Emam, J. Rosenberg
“Preliminary Guidelines for Empirical Research in Software Engineering”, IEEE Transactions on Software
Engineering, vol. 28, no. 8, pp. 721 – 734, 2002.
B. A. Kitchenham, L. M. Pickard, S. G. MacDonell, M. J. Shepperd, “What accuracy statistics really
measure”, IEE Proceedings – Software, vol. 148, no.3, pp.81-85, 2001.
N. Koch, “Software Engineering for Adaptive Hypermedia Applications”, PhD. Thesis, Reihe
Softwaretechnik 12, Uni-Druck Publishing Company, Munich 2001.
K.D. Maxwell, “Collecting Data for Comparability: Benchmarking Software Development Productivity”,
IEEE Software, 2001, pp. 22-24.
E. Mendes, N. Mosley, S. Counsell, “Do Adaptation Rules Improve Web Cost Estimation?”, in
Proceedings of ACM International Conference on Hypertext and Hypermedia, Nottingham, August 2003,
pp. 173-183.
E. Mendes, N. Mosley, S. Counsell, “Comparison of Web Size Measures for predicting Web Design and
Authoring Effort”, IEE Proceedings-Software vol. 149, no. 3, pp. 86-92, 2002.
E. Mendes, S. Counsell, and N. Mosley, “Measurement and Effort Prediction of Web Applications”, in
Proceedings of ICSE Workshop on Web Engineering, Limerick, June 2000.
E. Mendes, N. Mosley, S. Counsell, “Web Metrics – Estimating Design and Authoring Effort”, IEEE
Multimedia, Special Issue on Web Engineering, pp. 50-57, 2001.
E. Mendes, I. Watson, C. Triggs, N. Mosley, S. Counsell, “A Comparison of Development Effort
Estimation Techniques for Web Hypermedia Applications”, in Proceedings of International Software
Metrics Symposium (METRICS’02), Ottawa, Canada, June 2002, pp. 131-140.
E. Mendes, I. Watson, C. Triggs, N. Mosley, S. Counsell, “A Comparative Study of Cost Estimation
Models for Web Hypermedia Applications”, Empirical Software Engineering vol. 8, no. 2, pp. 163-196,
E. Mendes, N. Mosley, S. Counsell, “Early Web Size Meausures and Effort Prediction for Web
Costimation”, in Proceedings of International Software Metrics Symposium (METRICS’03), Sydney,
September 2003, pp. 18-39.
E. Mendes, B. Kitchenham, “Further Comparison of Cross-company and Within-company Effort
Estimation Models for Web Applications”, in Proceedings of International Software Metrics Symposium
(METRICS’04), Chicago, September 2004, pp. 348-357.
M. Morisio, I. Stamelos, V. Spahos and D. Romano, “Measuring Functionality and Productivity in Webbased
applications: a Case Study”, in Proceedings of the International Software Metrics Symposium
(METRICS’99), Boca Raton, November 1999, pp. 111-118.
P. Musilek, W. Pedrycz, N. Sun, G. Succi, “On the Sensitivity of COCOMO II Software Cost Estimation
Model”, in Proceedings of International Software Metrics Symposium (METRICS’02), Ottawa, Canada,
June 2002, pp. 13-20.
I. Myrtveit, E. Stensrud, “A Controlled Experiment to Assess the Benefits of Estimating with Analogy and
Regression Models”, IEEE Transaction on Software Engineering, vol. 25, no. 4, pp. 510-525, 1999.
O. Pastor, S.M. Abrahão, J.J. Fons, “Object-oriented approach to automate Web applications
development”, in Proceedings of International Conference on Electronic Commerce and Web
Technologies (EC-Web’01), Springer Verlag, Germany, pp. 16–28, 2001.
G. Poels, “Definition and Validation of a COSMIC-FFP Functional Size Measure for Object-Oriented
Systems”, Proceedings of Workshop Quantitative Approaches in OO Soft. Eng., Darmstadt, Germany,
July 2003.
D. Reifer, “Web-Development: Estimating Quick-Time-to-Market Software”, IEEE Software, vol. 17, no.
, pp. 57-64, November/December 2000.
D. Reifer. Ten Deadly Risks in Internet and Intranet Software Development. IEEE Software, vol. 18, no. 2,
pp. 12–14, 2002.
T. Rollo, “Sizing E-Commerce”, in Proceedings of the ACOSM 2000 - Australian Conference on Software
Measurement, Sydney, 2000.
P. Royston, “An extension of Shapiro and Wilk’s test for normality to large samples”, Applied Statistics
vol. 31, no.2, pp.115-124, 1982.
M. Ruhe, R. Jeffery, I. Wieczorek, “Using Web Objects for Estimating Software Development Effort for
Web Applications”, in Proceedings of International Software Metrics Symposium (METRICS’03), Sydney,
September 2003, pp. 30-37.
M. Ruhe, R. Jeffery, I. Wieczorek, “Cost estimation for Web applications”, in Proceedings of International
Conference on Software Engineering, Hilton Portland, May 2003, pp. 285 – 294.
D. Schwabe, G. Rossi, “Developing Hypermedia applications using OOHDM”, in Proceedings of
Workshop on Hypermedia development Process, Methods and Models, Hypertext´98, Pittsburgh, 1998.
M.J. Shepperd, M. Cartwright, “Predicting with Sparse Data”, in Proceedings of International Software
Metrics Symposium (METRICS’01), London, April 2001, pp. 28-39.
E. Stensrud, T. Foss, B. Kitchenham, I. Myrtveit, ”A Further Empirical Investigation of the Relationship
Between MRE and Project Size”, Empirical Software Engineering, vol. 8, no. 2, pp. 139-161, 2003.
E. Stensrud, I. Myrtveit, “Human Performance Estimating with analogy and Regression Models: an
Empirical Validation”, in Proceedings of International Software Metrics Symposium (METRICS’98),
Bethesda, March 1998, pp. 205.
P. Umbers, G Miles, “Resource Estimation for Web Applications”, in Proceedings of International
Software Metrics Symposium (METRICS’04), Chicago, September 2004, pp. 370-381.
