Mining large software compilations over time: another perspective of software evolution

ABSTRACT

With the success of libre (free, open source) software, a new type of software compilation has become increasingly common. Such compilations, often referred to as 'distributions', group hundreds, if not thousands, of software applications and libraries written by independent parties into an integrated system. Software compilations raise a number of questions that have not been targeted so far by software evolution, which usually focuses on the evolution of single applications. Undoubtedly, the challenges that software compilations face differ from those found in single software applications. Nevertheless, it can be assumed that both, the evolution of applications and that of software compilations, have similarities and dependencies.In this sense, we identify a dichotomy, common to that in economics, of software evolution in the small (micro-evolution) and in the large (macro-evolution). The goal of this paper is to study the evolution of a large software compilation, mining the publicly available repository of a well-known Linux distribution, Debian. We will therefore investigate changes related to hundreds of millions of lines of code over seven years. The aspects that will be covered in this paper are size (in terms of number of packages and of number of lines of code), use of programming languages, maintenance of packages and file sizes.

REFERENCES

• 1: J. J. Amor, J. M. Gonzalez-Barahona, G. Robles, and I. Herraiz. Measuring libre software using Debian 3.1 (Sarge) as a case study: preliminary results. Upgrade Magazine, Aug. 2005.
• 2: Harald Gall , Mehdi Jazayeri , René Klösch , Georg Trausmuth, Software Evolution Observations Based on Product Release History, Proceedings of the International Conference on Software Maintenance, p.160, October 01-03, 1997
• 3: Michael W. Godfrey , Qiang Tu, Evolution in Open Source Software: A Case Study, Proceedings of the International Conference on Software Maintenance (ICSM'00), p.131, October 11-14, 2000
• 4: J. M. Gonzalez-Barahona, M. A. Ortuno Perez, P. de las Heras, J. Centeno, and V. Matellan. Counting potatoes: the size of Debian 2.2. Upgrade Magazine, II(6):60--66, Dec. 2001.
• 5: M. M. Lehman , L. A. Belady, Program evolution: processes of software change, Academic Press Professional, Inc., San Diego, CA, 1985
• 6: M. M. Lehman and J. F. Ramil. Implications of laws of software evolution on continuing successful use of cots software. Technical report, Imperial College, 1998.
• 7: Meir M. Lehman , Juan F. Ramil, Rules and Tools for Software Evolution Planning and Management, Annals of Software Engineering, v.11 n.1, p.15-44, November 2001 [doi>10.1023/A:1012535017876 ]
• 8: M M. Lehman , J F. Ramil , P D. Wernick , D E. Perry , W M. Turski, Metrics and Laws of Software Evolution - The Nineties View, Proceedings of the 4th International Symposium on Software Metrics, p.20, November 05-07, 1997
• 9: M. Michlmayr and B. M. Hill. Quality and the reliance on individuals in free software projects. In Proceedings 3rd Workshop on Open Source Software Engineering, pages 105--109, Portland, USA, 2003.
• 10: Gregorio Robles , Juan Jose Amor , Jesus M. Gonzalez-Barahona , Israel Herraiz, Evolution and Growth in Large Libre Software Projects, Proceedings of the Eighth International Workshop on Principles of Software Evolution, p.165-174, September 05-06, 2005 [doi>10.1109/IWPSE.2005.17]
• 11: G. Succi, J. W. Paulson, and A. Eberlein. Preliminary results from an empirical study on the growth of open source and commercial software products. In EDSER-3 Workshop, Toronto, Canada, May 2001.
• 12: E. Burton Swanson, The dimensions of maintenance, Proceedings of the 2nd international conference on Software engineering, p.492-497, October 13-15, 1976, San Francisco, California, United States
• 13: Władysław M. Turski, Reference Model for Smooth Growth of Software Systems, IEEE Transactions on Software Engineering, v.22 n.8, p.599-600, August 1996
• 14: D. A. Wheeler. More than a gigabuck: Estimating GNU/Linux's size. Technical report, June 2001.

INDEX TERMS

Primary Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.m Miscellaneous

General Terms:
Languages, Management, Measurement

Keywords:
large software collections, mining software repositories, software evolution, software integrators