skip to main content
10.1145/1083258.1083273acmotherconferencesArticle/Chapter ViewAbstractPublication PagesicseConference Proceedingsconference-collections
Article

Open source software reliability model: an empirical approach

Published: 17 May 2005 Publication History

Abstract

We collected bug tracking data from a few popular open source projects and investigated the time related bug reporting patterns from them. The results indicate that along its development cycle, open source projects exhibit similar reliability growth pattern with that of closed source project. Bug arrivals of most open source project will stabilize at a very low level, even though in comparison, no formal testing activities are involved. This stabilizing point would be viewed as the mature point for adoption consideration. The results also show that general Weibull distribution offers possible way to establish the reliability model; Also, popular measures such as page views and download are not highly correlated with the bug arrival rate and may not be suitable measures for a project's quality.

References

[1]
ApacheWeek, "Apache 2 release history", 2004 {WWW document} URL http://www.apacheweek.com/features/ap2
[2]
Cosgrove, L. Confidence in open source growing, CIO Research Report, 2003 {WWW document} URL:http://www2.cio.com/research/surveyreport.cfm?id=51
[3]
El-Emam. Ethics and Open source. Empirical Software Engineering 4, 6 (2001), 291--292
[4]
Farber D. Six barriers to open source adoption, ZDNet Tech Update, March, 2004 {WWW document} URL:http://techupdate.zdnet.com/techupdate/stories/main/Six_barriers_to_open_source_adoption.html
[5]
Hisada Koji and Ikuo Arizino, Reliability Tests for Weibull distribution with varying shape-parameter, based on complete data, IEEE transactions on Reliability, Vol. 51/No. 3 Sep. 2002
[6]
Iannacci Federico "The linux Managing Model" First Monday, vol 8, no. 12 (Dec, 2003). {WWW document} URL:http://www.firstmonday.dk/issues/issue8_12/iannacci/
[7]
Kan H. S. Metrics and models in software quality engineering, 2nd edition, Addison-Wesley (2003)
[8]
Koch, C. Bursting the CMM hype, CIO Magazine, March 1, 2004.
[9]
Lawless J. F. Statistical Models and Methods for Lifetime Data, 2nd edition. New York: Wiley (2003)
[10]
McConnell S. (eds) Best Practice: Daily build and smoke test. IEEE Software, Vol. 13, No.4, July 1996
[11]
Mockus A, Fielding T. R., and Herbsleb, J. D. Two case studies of open source software development: Apache and Mozilla, ACM Transactions on Software Engineering and Methodology, vol. 11, no. 3 (July 2002) 309--346
[12]
Mozilla organization, "CVS tags for Mozilla major public release", July 9, 2004, {WWW document} URL:http://www.mozilla.org/releases/cvstags.html
[13]
Musa J. D. and Okumoto K. "A Logarithmic Poisson Execution Time Model for Software Reliability Measurement", Proceedings of Seventh International Conference on Software Engineering, 230--238 Mar. 1984
[14]
Peynot R and Metcalfe D. The business hole in open source support, Forester Research, August, 2004.
[15]
Raymond, E. S., The Cathedral and the Bazaar: Musings on Linux and Open Source by an Accidental Revolutionary, 2nd ed. Sebastopol, CA:O'Reilly, 2001.
[16]
Rodrigues G. N, Rosenblum D. and Emmerich W. A model driven approach for software systems reliability, Proceedings of the 26th International Conference on Software Engineering, 2004
[17]
Samoladas I., Stamelos I, Angelis L. And Oikonomou A. Open source software development should strive for even greater code maintainability, Communications of the ACM, Vol. 47/No. 10, Oct, 2004.
[18]
Wheeler D. A., Why Open Source Software / Free Software (OSS/FS)? Look at the Numbers! 2003 {WWW document} URL:http://www.dwheeler.com/oss_fs_why.html
[19]
Yamada Shigeru, Jun Hishitani and Shunji Osaki, Software-Reliability Growth with a Weibull Test-Effort: A model & application, IEEE Transactions on Reliability, Vol. 42/No. 1, Mar. 1993

Cited By

View all
  • (2024)An Open-Source Software Reliability Model Considering Learning Factors and Stochastically Introduced FaultsApplied Sciences10.3390/app1402070814:2(708)Online publication date: 14-Jan-2024
  • (2024)A multi-release reliability model of open source software with fault detection obeying three-parameter lifetime distributionScientific Reports10.1038/s41598-024-70536-x14:1Online publication date: 23-Aug-2024
  • (2021)User Growth-Based Reliability Assessment of OSS During the Operational Phase Considering FRF and Imperfect DebuggingAdvances in Interdisciplinary Research in Engineering and Business Management10.1007/978-981-16-0037-1_23(293-304)Online publication date: 23-Apr-2021
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
5-WOSSE: Proceedings of the fifth workshop on Open source software engineering
May 2005
74 pages
ISBN:1595931279
DOI:10.1145/1083258
  • cover image ACM SIGSOFT Software Engineering Notes
    ACM SIGSOFT Software Engineering Notes  Volume 30, Issue 4
    July 2005
    1514 pages
    ISSN:0163-5948
    DOI:10.1145/1082983
    Issue’s Table of Contents

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 17 May 2005

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. open source software
  2. software reliability model
  3. weibull distribution

Qualifiers

  • Article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)32
  • Downloads (Last 6 weeks)2
Reflects downloads up to 27 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2024)An Open-Source Software Reliability Model Considering Learning Factors and Stochastically Introduced FaultsApplied Sciences10.3390/app1402070814:2(708)Online publication date: 14-Jan-2024
  • (2024)A multi-release reliability model of open source software with fault detection obeying three-parameter lifetime distributionScientific Reports10.1038/s41598-024-70536-x14:1Online publication date: 23-Aug-2024
  • (2021)User Growth-Based Reliability Assessment of OSS During the Operational Phase Considering FRF and Imperfect DebuggingAdvances in Interdisciplinary Research in Engineering and Business Management10.1007/978-981-16-0037-1_23(293-304)Online publication date: 23-Apr-2021
  • (2021)Open source software reliability model with nonlinear fault detection and fault introductionJournal of Software: Evolution and Process10.1002/smr.238533:12Online publication date: 2-Dec-2021
  • (2020)Large Scale Fault Data Analysis and OSS Reliability Assessment Based on Quantification Method of the First TypeMachine Learning and Knowledge Extraction10.3390/make20400242:4(436-452)Online publication date: 20-Oct-2020
  • (2020)An Organized Repository of Ethereum Smart Contracts’ Source Codes and MetricsFuture Internet10.3390/fi1211019712:11(197)Online publication date: 15-Nov-2020
  • (2020)Modeling Reliability of Three Open Source Software Systems2020 4th International Conference on Computer, Communication and Signal Processing (ICCCSP)10.1109/ICCCSP49186.2020.9315232(1-4)Online publication date: 28-Sep-2020
  • (2020)Modelling of Software FailuresGuide to Disaster-Resilient Communication Networks10.1007/978-3-030-44685-7_6(141-172)Online publication date: 23-Jul-2020
  • (2019)A Point Process Approach of Bug Fixing Analysis in Open Source Software Projects2019 IEEE 19th International Conference on Software Quality, Reliability and Security (QRS)10.1109/QRS.2019.00024(83-88)Online publication date: Jul-2019
  • (2019)A study of software reliability on big data open source softwareInternational Journal of System Assurance Engineering and Management10.1007/s13198-019-00777-x10:2(242-250)Online publication date: 5-Mar-2019
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media