Developer involvement considered harmful?: an empirical examination of Android bug resolution times

ABSTRACT

In large scale software development ecosystems, there is a common perception that higher developer involvement leads to faster resolution of bugs. This is based on conjectures around more ``eyeballs" making bugs ``shallow" -- whose validity and applicability are not without dispute. In this paper, we posit that the level of developer attention as well as its extent of diversity influence how quickly bugs get resolved. We report results from a study of 1,000+ Android bugs. We find statistically significant evidence that attention and diversity have contrasting relationships with the resolution time of bugs, even after controlling for factors such as interest, importance, dependency etc. Our results can offer helpful insights on team dynamics and project governance.

References

1. Albert, R., and Barabasi, A. Statistical mechanics of complex networks. cond-mat/0106096 (June 2001). Reviews of Modern Physics 74, 47 (2002).
2. Blei, D. M., Ng, A. Y., and Jordan, M. I. Latent dirichlet allocation. J. M. L. R. (Mar. 2003).
3. Cataldo, M., Herbsleb, J. D., and Carley, K. M. Socio-technical congruence: a framework for assessing the impact of technical and work dependencies on software development productivity. In Proceedings of the Second ACM-IEEE international symposium on Empirical software engineering and measurement (New York, NY, USA, 2008), ESEM ’08, ACM, p. 2ˆ a ˘ A¸ S11.
4. Datta, S., Sarkar, P., Das, S., Sreshtha, S., Lade, P., and Majumder, S. How many eyeballs does a bug need? an empirical validation of linusˆ a ˘ A´ Z law. In Agile Processes in Software Engineering and Extreme Programming, G. Cantone and M. Marchesi, Eds., vol. 179 of LNBIP. Springer International Publishing, 2014, pp. 242–250.
5. Glass, R. L. Facts and Fallacies of Software Engineering. Addison Wesley Professional Pearson Education {distributor}, Boston; Old Tappan, 2002.
6. Guana, V., Rocha, F., Hindle, A., and Stroulia, E. Do the stars align? multidimensional analysis of android’s layered architecture. In Mining Software Repositories (MSR), 2012 9th IEEE Working Conference on (2012), pp. 124–127.
7. Herbsleb, J., and Mockus, A. An empirical study of speed and communication in globally distributed software development. IEEE Transactions on Software Engineering 29, 6 (2003), 481–494.
8. Jeong, G., Kim, S., and Zimmermann, T. Improving bug triage with bug tossing graphs. In ESEC/FSE ’09 (New York, NY, USA, 2009), ACM, pp. 111–120.
9. Kullback, S., and Leibler, R. A. On information and sufficiency. Ann. Math. Statist. 22, 1 (1951), 79–86.
10. Meneely, A., and Williams, L. Strengthening the empirical analysis of the relationship between linus’ law and software security. In Proceedings of the 2010 ACM-IEEE International Symposium on Empirical Software Engineering and Measurement (New York, NY, USA, 2010), ESEM ’10, ACM, pp. 9:1–9:10.
11. Raymond, E. S. The Cathedral and the Bazaar: Musings on Linux and Open Source by an Accidental Revolutionary. O’Reilly, 2001.
12. Shihab, E., Kamei, Y., and Bhattacharya, P. Mining challenge 2012: The android platform. In The 9th Working Conference on Mining Software Repositories (2012).
13. Steyvers, M., and Griffiths, T. Latent Semantic Analysis: A Road to Meaning. Laurence Erlbaum, 2007, ch. Probabilistic topic models.
14. Tabachnick, B., and Fidell, L. Using Multivariate Statistics. Boston: Pearson Education, 2007.
15. Wagstrom, P., Herbsleb, J. D., and Carley, K. M. Communication, team performance, and the individual: Bridging technical dependencies. Academy of Management Proceedings 2010, 1 (Aug. 2010), 1–7.
16. Wallach, H. M., Murray, I., Salakhutdinov, R., and Mimno, D. Evaluation methods for topic models. In Proceedings of the 26th Annual International Conference on Machine Learning (2009), ICML ’09, pp. 1105–1112.

Index Terms

• Social and professional topics

  • Professional topics

    • Management of computing and information systems

      • Project and people management

• Software and its engineering

  • Software creation and management

    • Software development process management

  • Software notations and tools

    • Software configuration management and version control systems