skip to main content
10.1145/1159733.1159747acmconferencesArticle/Chapter ViewAbstractPublication PagesesemConference Proceedingsconference-collections
Article

Cross-company and single-company effort models using the ISBSG database: a further replicated study

Published: 21 September 2006 Publication History

Abstract

Five years ago the ISBSG database was used by Jeffery et al. [6] (S1) to compare the effort prediction accuracy between cross- and single-company effort models. Given that more than 2,000 projects were later volunteered to this database, in 2005 Mendes et al. [17] (S2) replicated S1 but obtained different results. The difference in results between both studies could have resulted from legitimate differences in data set patterns but also could have been influenced by differences in experimental procedure. S2 was unable to employ exactly the same experimental procedure used in S1, as S1's procedure was not fully documented. Therefore this paper aimed to apply S2's experimental procedure to the ISBSG database version used in S1 (release 6) to assess if differences in experimental procedure would have contributed towards different results. Our results corroborated those from S1: we found that predictions based on a single-company model were significantly more accurate than those based on a cross-company model.

References

[1]
Briand, L.C., K. El-Emam, K. Maxwell, D. Surmann, I. Wieczorek. An assessment and comparison of common cost estimation models. Proceedings of the 21st International Conference on Software Engineering, ICSE 99, 1999, pp313--322.
[2]
Briand, L.C., T. Langley, I. Wieczorek. A replicated assessment of common software cost estimation techniques. Proceedings of the 22nd International Conference on Software Engineering, ICSE 20, 2000, pp 377--386.
[3]
Conte, S. D., Dunsmore, H. E., Shen, V. Y. Software Engineering Metrics and Models, Benjamin-Cummins, 1986.
[4]
Cook, R.D. Detection of influential observations in linear regression. Technometrics, 19, 1977, pp 15--18.
[5]
Jeffery, R., .M. Ruhe and I. Wieczorek. A Comparative Study of Two Software Development Cost Modeling Techniques using Multi-organizational and Companyspecific Data. Information and Software Technology, 42, 2000, pp 1009--1016.
[6]
Jeffery, R., M. Ruhe and I. Wieczorek. Using public domain metrics to estimate software development effort. Proceedings Metrics'01, London, 2001, pp 16--27.
[7]
Kemerer, C.F. An empirical validation of software cost estimation models. Communications ACM, 30(5), 1987.
[8]
Kitchenham, B.A., and E. Mendes. A Comparison of Crosscompany and Single-company Effort Estimation Models for Web Applications, Proceedings EASE 2004, 2004, pp 47--55.
[9]
Kitchenham, B.A., and E. Mendes, and Travassos, G. A Systematic Review of Cross- vs. Within-Company Cost Estimation Studies, EASE'06, (accepted for publication).
[10]
Kitchenham, B.A. and N.R. Taylor. Software cost models. ICL Technical Journal, May 1984, pp73--102.
[11]
Kirsopp, C. and Shepperd, M. Making Inferences with Small Numbers of Training Sets, IEE Proceedings Software, 149, pp 123--130, 2002.
[12]
Lefley, M., and M.J. Shepperd, Using Genetic Programming to Improve Software Effort Estimation Based on General Data Sets, Proceedings of GECCO 2003, LNCS 2724, Springer-Verlag, pp 2477--2487, 2003.
[13]
Lokan, C.J. Function Points. Advances in Computers, M.V. Zelkowitz (ed), Vol 65, pp 298--347, Elsevier, 2005.
[14]
Maxwell, K. Applied Statistics for Software Managers. Software Quality Institute Series, Prentice Hall, 2002.
[15]
Maxwell, K., L.V. Wassenhove, and S. Dutta, Performance Evaluation of General and Company Specific Models in Software Development Effort Estimation, Management Science, 45(6), June, pp 787--803, 1999.
[16]
Mendes, E. and B.A. Kitchenham, Further Comparison of Cross-Company and Within Company Effort Estimation Models for Web Applications. Proceedings Metrics'04, Chicago, Illinois September 11-17th 2004, IEEE Computer Society, pp 348--357, 2004.
[17]
Mendes, E., C. Lokan, R. Harrison, and C. Triggs, A Replicated Comparison of Cross-company and Withincompany Effort Estimation models using the ISBSG Database, in Proceedings of Metrics'05, Como, 2005
[18]
Tabachnick, B.G. and Fidell, L.S. Using Multivariate Statistics, HarperCollins, 1996.
[19]
Wieczorek, I. and M. Ruhe. How valuable is companyspecific data compared to multi-company data for software cost estimation? Proceedings Metrics'02, Ottawa, June 2002, pp 237--246.

Cited By

View all
  • (2023)Application of mathematical quantification theory class III in software effort prediction2023 10th International Conference on Dependable Systems and Their Applications (DSA)10.1109/DSA59317.2023.00100(688-697)Online publication date: 10-Aug-2023
  • (2022)Feature Selection Using Information Gain for Software Effort Prediction Using Neural Network ModelData, Engineering and Applications10.1007/978-981-19-4687-5_14(177-198)Online publication date: 12-Oct-2022
  • (2022)Introduction to the Metrics ThemeAccelerating Digital Transformation10.1007/978-3-031-10873-0_9(155-161)Online publication date: 20-Oct-2022
  • Show More Cited By

Index Terms

  1. Cross-company and single-company effort models using the ISBSG database: a further replicated study

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    ISESE '06: Proceedings of the 2006 ACM/IEEE international symposium on Empirical software engineering
    September 2006
    388 pages
    ISBN:1595932186
    DOI:10.1145/1159733
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 21 September 2006

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. cross-company estimation models
    2. effort estimation
    3. estimation models
    4. experimental procedure
    5. regression-based
    6. replication study
    7. single-company estimation model
    8. software projects

    Qualifiers

    • Article

    Conference

    ISESE06
    Sponsor:

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)7
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 15 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2023)Application of mathematical quantification theory class III in software effort prediction2023 10th International Conference on Dependable Systems and Their Applications (DSA)10.1109/DSA59317.2023.00100(688-697)Online publication date: 10-Aug-2023
    • (2022)Feature Selection Using Information Gain for Software Effort Prediction Using Neural Network ModelData, Engineering and Applications10.1007/978-981-19-4687-5_14(177-198)Online publication date: 12-Oct-2022
    • (2022)Introduction to the Metrics ThemeAccelerating Digital Transformation10.1007/978-3-031-10873-0_9(155-161)Online publication date: 20-Oct-2022
    • (2022)Chapter 6 Lightweight Consistency Checking for Agile Model-Based Development in PracticeAccelerating Digital Transformation10.1007/978-3-031-10873-0_8(131-151)Online publication date: 20-Oct-2022
    • (2022)Chapter 5 Expectations and Challenges from Scaling Agile in Mechatronics-Driven Companies – A Comparative Case StudyAccelerating Digital Transformation10.1007/978-3-031-10873-0_7(119-130)Online publication date: 20-Oct-2022
    • (2022)Chapter 4 Technical Debt Tracking: Current State of Practice: A Survey and Multiple Case Study in 15 Large OrganizationsAccelerating Digital Transformation10.1007/978-3-031-10873-0_6(87-118)Online publication date: 20-Oct-2022
    • (2022)Introduction to the Continuous Architecture ThemeAccelerating Digital Transformation10.1007/978-3-031-10873-0_5(85-86)Online publication date: 20-Oct-2022
    • (2022)Chapter 3 Efficient and Effective Exploratory Testing of Large-Scale Software SystemsAccelerating Digital Transformation10.1007/978-3-031-10873-0_4(51-81)Online publication date: 20-Oct-2022
    • (2022)Chapter 2 Modeling Continuous Integration Practice Differences in Industry Software DevelopmentAccelerating Digital Transformation10.1007/978-3-031-10873-0_3(23-49)Online publication date: 20-Oct-2022
    • (2022)Chapter 1 Climbing the Stairway to HeavenAccelerating Digital Transformation10.1007/978-3-031-10873-0_2(7-22)Online publication date: 20-Oct-2022
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media