TA-RE: an exchange language for mining software repositories

ABSTRACT

Software repositories have been getting a lot of attention from researchers in recent years. In order to analyze software repositories, it is necessary to first extract raw data from the version control and problem tracking systems. This poses two challenges: (1) extraction requires a non-trivial effort, and (2) the results depend on the heuristics used during extraction. These challenges burden researchers that are new to the community and make it difficult to benchmark software repository mining since it is almost impossible to reproduce experiments done by another team. In this paper we present the TA-RE corpus. TA-RE collects extracted data from software repositories in order to build a collection of projects that will simplify extraction process. Additionally the collection can be used for benchmarking. As the first step we propose an exchange language capable of making sharing and reusing data as simple as possible.

REFERENCES

• 1: Jennifer Bevan , E. James Whitehead, Jr., Identification of Software Instabilities, Proceedings of the 10th Working Conference on Reverse Engineering, p.134, November 13-17, 2003
• 2: Jennifer Bevan , E. James Whitehead, Jr. , Sunghun Kim , Michael Godfrey, Facilitating software evolution research with kenyon, Proceedings of the 10th European software engineering conference held jointly with 13th ACM SIGSOFT international symposium on Foundations of software engineering, September 05-09, 2005, Lisbon, Portugal
• 3: Dirk Beyer , Andreas Noack, Clustering Software Artifacts Based on Frequent Common Changes, Proceedings of the 13th International Workshop on Program Comprehension, p.259-268, May 15-16, 2005 [doi>10.1109/WPC.2005.12]
• 4: V. Dallmeier, P. Weißgerber, and T. Zimmermann, "APFEL: A Preprocessing Framework For Eclipse," 2005, http://www.st.cs.uni-sb.de/softevo/apfel/.
• 5: Stephen G. Eick , Todd L. Graves , Alan F. Karr , J. S. Marron , Audris Mockus, Does Code Decay? Assessing the Evidence from Change Management Data, IEEE Transactions on Software Engineering, v.27 n.1, p.1-12, January 2001 [doi>10.1109/32.895984 ]
• 6: Michael Fischer , Martin Pinzger , Harald Gall, Populating a Release History Database from Version Control and Bug Tracking Systems, Proceedings of the International Conference on Software Maintenance, p.23, September 22-26, 2003
• 7: Michael W. Godfrey , Lijie Zou, Using Origin Analysis to Detect Merging and Splitting of Source Code Entities, IEEE Transactions on Software Engineering, v.31 n.2, p.166-181, February 2005 [doi>10.1109/TSE.2005.28]
• 8: Todd L. Graves , Alan F. Karr , J. S. Marron , Harvey Siy, Predicting Fault Incidence Using Software Change History, IEEE Transactions on Software Engineering, v.26 n.7, p.653-661, July 2000 [doi>10.1109/32.859533 ]
• 9: Todd L. Graves , Audris Mockus, Inferring Change Effort from Configuration Management Databases, Proceedings of the 5th International Symposium on Software Metrics, p.267, March 20-21, 1998
• 10: Miryung Kim , Vibha Sazawal , David Notkin , Gail Murphy, An empirical study of code clone genealogies, Proceedings of the 10th European software engineering conference held jointly with 13th ACM SIGSOFT international symposium on Foundations of software engineering, September 05-09, 2005, Lisbon, Portugal
• 11: Sunghun Kim , Kai Pan , E. James Whitehead, Jr., When Functions Change Their Names: Automatic Detection of Origin Relationships, Proceedings of the 12th Working Conference on Reverse Engineering, p.143-152, November 07-11, 2005 [doi>10.1109/WCRE.2005.33]
• 12: Sunghun Kim , E. James Whitehead , Jennifer Bevan, Analysis of signature change patterns, Proceedings of the 2005 international workshop on Mining software repositories, p.1-5, May 17-17, 2005, St. Louis, Missouri
• 13: David D. Lewis , Yiming Yang , Tony G. Rose , Fan Li, RCV1: A New Benchmark Collection for Text Categorization Research, The Journal of Machine Learning Research, 5, p.361-397, 12/1/2004
• 14: Audris Mockus , Roy T. Fielding , James Herbsleb, A case study of open source software development: the Apache server, Proceedings of the 22nd international conference on Software engineering, p.263-272, June 04-11, 2000, Limerick, Ireland [doi>10.1145/337180.337209]
• 15: Audris Mockus , James D. Herbsleb, Expertise browser: a quantitative approach to identifying expertise, Proceedings of the 24th International Conference on Software Engineering, May 19-25, 2002, Orlando, Florida [doi>10.1145/581339.581401]
• 16: Audris Mockus , Lawrence G. Votta, Identifying Reasons for Software Changes Using Historic Databases, Proceedings of the International Conference on Software Maintenance (ICSM'00), p.120, October 11-14, 2000
• 17: Audris Mockus , David M. Weiss, Globalization by Chunking: A Quantitative Approach, IEEE Software, v.18 n.2, p.30-37, March 2001 [doi>10.1109/52.914737 ]
• 18: Audris Mockus , Ping Zhang , Paul Luo Li, Predictors of customer perceived software quality, Proceedings of the 27th international conference on Software engineering, p.225-233, May 15-21, 2005, St. Louis, MO, USA [doi>10.1145/1062455.1062506]
• 19: D. J. Newman, S. Hettich, C. L. Blake, and C. J. Merz, "UCI Repository of machine learning databases," 1988, http://www.ics.uci.edu/~mlearn/MLRepository.html.
• 20: J. Sayyad Shirabad and T. J. Menzies, "The PROMISE Repository of Software Engineering Databases," 2005, http://promise.site.uottawa.ca/SERepository.
• 21: Jacek Śliwerski , Thomas Zimmermann , Andreas Zeller, When do changes induce fixes?, Proceedings of the 2005 international workshop on Mining software repositories, p.1-5, May 17-17, 2005, St. Louis, Missouri
• 22: T. Zimmermann and P. Weißgerber, "Preprocessing CVS Data for Fine-Grained Analysis," Proc. of Int'l Workshop on Mining Software Repositories (MSR 2004), Edinburgh, Scotland, pp. 2--6, 2004.
• 23: Thomas Zimmermann , Peter Weissgerber , Stephan Diehl , Andreas Zeller, Mining Version Histories to Guide Software Changes, IEEE Transactions on Software Engineering, v.31 n.6, p.429-445, June 2005 [doi>10.1109/TSE.2005.72]

INDEX TERMS

Primary Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.7 Distribution, Maintenance, and Enhancement
          Subjects: Restructuring, reverse engineering, and reengineering

Additional Classification:
  K. Computing Milieux
  K.6 MANAGEMENT OF COMPUTING AND INFORMATION SYSTEMS
      K.6.3 Software Management
          Subjects: Software maintenance

General Terms:
Experimentation, Measurement

Keywords:
analysis, corpus, prediction, software repository mining