research-article

Information needs in bug reports: improving cooperation between developers and users

Authors:

Jonathan Sillito,

Thomas ZimmermannAuthors Info & Claims

CSCW '10: Proceedings of the 2010 ACM conference on Computer supported cooperative work

Pages 301 - 310

https://doi.org/10.1145/1718918.1718973

Published: 06 February 2010 Publication History

Abstract

For many software projects, bug tracking systems play a central role in supporting collaboration between the developers and the users of the software. To better understand this collaboration and how tool support can be improved, we have quantitatively and qualitatively analysed the questions asked in a sample of 600 bug reports from the MOZILLA and ECLIPSE projects. We categorised the questions and analysed response rates and times by category and project. Our results show that the role of users goes beyond simply reporting bugs: their active and ongoing participation is important for making progress on the bugs they report. Based on the results, we suggest four ways in which bug tracking systems can be improved.

References

[1]

J. Anvik, L. Hiew, and G. C. Murphy. Who should fix this bug? In ICSE '06, pages 361--370, 2006.

Digital Library

[2]

J. Aranda and G. Venolia. The secret life of bugs: Going past the errors and omissions in software repositories. In ICSE '09, pages 298--308, 2009.

Digital Library

[3]

I. Barker. What is information architecture? KM Column, available at http://www.steptwo.com.au, April 2005.

[4]

V. R. Basili, F. Shull, and F. Lanubile. Building knowledge through families of experiments. IEEE Trans. Software Eng., 25(4):456--473, 1999.

Digital Library

[5]

N. Bettenburg, S. Just, A. Schr¨oter, C. Weiss, R. Premraj, and T. Zimmermann. What makes a good bug report? In SIGSOFT '08/FSE-16, pages 308--318, 2008.

Digital Library

[6]

N. Bettenburg, R. Premraj, T. Zimmermann, and S. Kim. Duplicate bug reports considered harmful... really? In ICSM '08, pages 337--345, September 2008.

[7]

S. Breu, R. Premraj, J. Sillito, and T. Zimmermann. Appendix to Information Needs in Bug Reports Technical Report 2009-945-24, Dept. of Computer Science. University of Calgary, October 2009.

[8]

A. Erdem, W. L. Johnson, and S. Marsella. Task oriented software understanding. In ASE '98, pages 230--239, 1998.

Digital Library

[9]

J. L. Fleiss. Measuring nominal scale agreement among many raters. Psychological Bulletin, 76(5):378--382, 1971.

[10]

C. A. Halverson, J. B. Ellis, C. Danis, and W. A. Kellogg. Designing task visualizations to support the coordination of work in software development. In CSCW '06, pages 39--48, 2006.

Digital Library

[11]

J. D. Herbsleb and E. Kuwana. Preserving knowledge in design projects: what designers need to know. In CHI '93, pages 7--14, 1993.

Digital Library

[12]

N. Jalbert and W. Weimer. Automated duplicate detection for bug tracking systems. In DSN '08, pages 52--61, 2008.

[13]

J. Spolsky. Joel on Software blog. FogBUGZ. http://www.joelonsoftware.com/news/fog0000000162.html.

[14]

W. L. Johnson and A. Erdem. Interactive explanation of software systems. Automated Software Engineering, 4(1):53--75, 1997.

Digital Library

[15]

S. Just, R. Premraj, and T. Zimmermann. Towards the next generation of bug tracking systems. In VL/HCC '08, pages 82--85, 2008.

Digital Library

[16]

A. J. Ko, R. DeLine, and G. Venolia. Information needs in collocated software development teams. In ICSE '07, pages 344--353, 2007.

Digital Library

[17]

A. J. Ko, B. A. Myers, and D. H. Chau. A linguistic analysis of how people describe software problems. In VL/HCC, pages 127--134, 2006.

Digital Library

[18]

A. J. Ko, B. A. Myers, M. J. Coblenz, and H. H. Aung. An exploratory study of how developers seek, relate, and collect relevant information during software maintenance tasks. IEEE Trans. Software Eng., 32(12):971--987, 2006.

Digital Library

[19]

J. Landis and G. G. Koch. The measurement of observer agreement for categorical data. Biometrics, 33(1):159--174, 1977.

[20]

Ø. Langsrud. ANOVA for unbalanced data: Use Type II instead of Type III sums of squares. Statistics and Computing, 13(2):163--167, 2003.

Digital Library

[21]

R Development Core Team. R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, Vienna, Austria, 2008. ISBN 3-900051-07-0.

[22]

P. C. Rigby, D. M. German, and M.-A. Storey. Open source software peer review practices: a case study of the apache server. In ICSE '08, pages 541--550, 2008.

Digital Library

[23]

G. Ripoche and J. P. Sansonet. Experiences in automating the analysis of linguistic interactions for the study of distributed collectives. Journal Comput. Supported Coop. Work, 15(2-3):149--183, 2006

Digital Library

[24]

P. Runeson, M. Alexandersson, and O. Nyholm. Detection of duplicate defect reports using natural language processing. In ICSE '07, pages 499--510, 2007.

Digital Library

[25]

R. J. Sandusky. Information, activity and social order in distributed work: The case of distributed software problem management. PhD thesis, University of Illinois at Urbana-Champaign. 2005.

Digital Library

[26]

R. J. Sandusky and L. Gasser. Negotiation and the coordination of information and activity in distributed software problem management. In GROUP '05, pages 187--196, 2005

Digital Library

[27]

J. Sillito, G. C. Murphy, and K. D. Volder. Questions programmers ask during software evolution tasks. In SIGSOFT '06/FSE-14, pages 23--34, 2006.

Digital Library

[28]

X. Wang, L. Zhang, T. Xie, J. Anvik, and J. Sun. An approach to detecting duplicate bug reports using natural language and execution information. In ICSE '08, pages 461--470, 2008.

Digital Library

Cited By

Wang DGalster MMorales-Trujillo M(2025)Information needs in bug reports for web applicationsJournal of Systems and Software10.1016/j.jss.2024.112230219:COnline publication date: 1-Jan-2025
https://dl.acm.org/doi/10.1016/j.jss.2024.112230
Alsaedi SGad-Elrab ANoaman AEassa F(2024)Two-Level Information-Retrieval-Based Model for Bug Localization Based on Bug ReportsElectronics10.3390/electronics1302032113:2(321)Online publication date: 11-Jan-2024
https://doi.org/10.3390/electronics13020321
Zhang JLiu ZBao LXing ZHu XXia X(2024)Inside Bug Report Templates: An Empirical Study on Bug Report Templates in Open-Source SoftwareProceedings of the 15th Asia-Pacific Symposium on Internetware10.1145/3671016.3671401(125-134)Online publication date: 24-Jul-2024
https://dl.acm.org/doi/10.1145/3671016.3671401
Show More Cited By

Index Terms

Information needs in bug reports: improving cooperation between developers and users
1. Social and professional topics
  1. Professional topics
    1. Management of computing and information systems
      1. Software management
        Software maintenance
2. Software and its engineering
  1. Software creation and management
    1. Software post-development issues
    2. Software verification and validation
      1. Software defect analysis
        Software testing and debugging

Recommendations

Information needs in bug reports for web applications
Abstract
Given the widespread popularity and increasing reliance on long-lived web applications (such as Netflix and Facebook), effective and efficient bug reproduction is essential to maintain functionality and user satisfaction throughout the ...
Highlights
- We manually analyzed 1000 bug reports from 10 popular open-source projects.
- We identify types of information commonly missing in bug reports.
- We outline directions toward systematic bug data collection.
- We highlight the ...
An Empirical Study of Bug Fixing Rate
COMPSAC '15: Proceedings of the 2015 IEEE 39th Annual Computer Software and Applications Conference - Volume 02

Bug fixing is one of the most important activities in software development and maintenance. A software project often employs an issue tracking system such as Bugzilla to store and manage their bugs. In the issue tracking system, many bugs are invalid ...
Classifying Bug Reports to Bugs and Other Requests Using Topic Modeling
APSEC '13: Proceedings of the 2013 20th Asia-Pacific Software Engineering Conference (APSEC) - Volume 02

Bug reports are widely used in several research areas such as bug prediction, bug triaging, and etc. The performance of these studies relies on the information from bug reports. Previous study showed that a significant number of bug reports are actually ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CSCW '10: Proceedings of the 2010 ACM conference on Computer supported cooperative work

February 2010

468 pages

ISBN:9781605587950

DOI:10.1145/1718918

General Chairs:
Kori Inkpen
Microsoft Research, USA
,
Carl Gutwin
University of Saskatchewan, Canada
,
Program Chair:
John Tang
Microsoft Research, USA

Copyright © 2010 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 February 2010

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CSCW '10

Sponsor:

SIGCHI

CSCW '10: Computer Supported Cooperative Work

February 6 - 10, 2010

Georgia, Savannah, USA

Acceptance Rates

Overall Acceptance Rate 2,235 of 8,521 submissions, 26%

Upcoming Conference

CSCW '25

Sponsor:
sigchi

Computer-Supported Cooperative Work and Social Computing

October 18 - 22, 2025

Bergen , Norway

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

154
Total Citations
View Citations
1,265
Total Downloads

Downloads (Last 12 months)62
Downloads (Last 6 weeks)10

Reflects downloads up to 02 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Wang DGalster MMorales-Trujillo M(2025)Information needs in bug reports for web applicationsJournal of Systems and Software10.1016/j.jss.2024.112230219:COnline publication date: 1-Jan-2025
https://dl.acm.org/doi/10.1016/j.jss.2024.112230
Alsaedi SGad-Elrab ANoaman AEassa F(2024)Two-Level Information-Retrieval-Based Model for Bug Localization Based on Bug ReportsElectronics10.3390/electronics1302032113:2(321)Online publication date: 11-Jan-2024
https://doi.org/10.3390/electronics13020321
Zhang JLiu ZBao LXing ZHu XXia X(2024)Inside Bug Report Templates: An Empirical Study on Bug Report Templates in Open-Source SoftwareProceedings of the 15th Asia-Pacific Symposium on Internetware10.1145/3671016.3671401(125-134)Online publication date: 24-Jul-2024
https://dl.acm.org/doi/10.1145/3671016.3671401
Chaves LOliveira FTiago Ld'Amorim M(2024)Automating Issue Reporting in Software Testing: Lessons Learned from Using the Template Generator ToolCompanion Proceedings of the 32nd ACM International Conference on the Foundations of Software Engineering10.1145/3663529.3663847(278-282)Online publication date: 10-Jul-2024
https://dl.acm.org/doi/10.1145/3663529.3663847
Zhang JPeng MZhang Y(2024)Empirical Study on GitHub Issue Report Templates2024 IEEE 48th Annual Computers, Software, and Applications Conference (COMPSAC)10.1109/COMPSAC61105.2024.00169(1284-1289)Online publication date: 2-Jul-2024
https://doi.org/10.1109/COMPSAC61105.2024.00169
Goyal ASardana N(2024)An Integrated Approach using Developer Profiles with Temporal Dynamics for Assignee Recommendation in Non-Reproducible BugsProcedia Computer Science10.1016/j.procs.2024.04.268235(2833-2842)Online publication date: 2024
https://doi.org/10.1016/j.procs.2024.04.268
Wang HDevine PTizard JShahamiri SBlincoe K(2024)Conversation in forums: How software forum posts discuss potential development insightsJournal of Systems and Software10.1016/j.jss.2024.112108215(112108)Online publication date: Sep-2024
https://doi.org/10.1016/j.jss.2024.112108
Fucci DAlégroth EFelderer MJohannesson C(2024)Evaluating software security maturity using OWASP SAMM: Different approaches and stakeholders perceptionsJournal of Systems and Software10.1016/j.jss.2024.112062(112062)Online publication date: Apr-2024
https://doi.org/10.1016/j.jss.2024.112062
Kuramoto HWang DKondo MKashiwa YKamei YUbayashi N(2024)Understanding the characteristics and the role of visual issue reportsEmpirical Software Engineering10.1007/s10664-024-10459-329:4Online publication date: 10-Jun-2024
https://doi.org/10.1007/s10664-024-10459-3
Qiao YLu XWang CWang JTang WLi B(2024)Predicting Issue Resolution Time of OSS Using Multiple FeaturesJournal of Software: Evolution and Process10.1002/smr.274637:1Online publication date: 22-Nov-2024
https://doi.org/10.1002/smr.2746
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten