skip to main content
10.1145/1594156.1594165acmconferencesArticle/Chapter ViewAbstractPublication PagesmodConference Proceedingsconference-collections
research-article

Selection of customers for operational and usage profiling

Published:29 June 2009Publication History

ABSTRACT

Operational and usage profiles collected from customers provide developers and testers with valuable quantitative information on usage patterns of software being developed. Unfortunately, gathering such profiles from a large set of customers can be challenging due to time and resource constraints.

In this paper we propose to use information about customer defects to narrow down a list of candidate customers to profile. We present a technique for selection and prioritization of minimal set of customers for operational and usage profiling to cover certain set of defects. The technique optimally selects a minimal set of customers for profiling and, once the set is identified, prioritizes the customers within the minimal set. We describe a validation case study confirming that this approach is scalable for a large customer base. Analysis results can then be used to close gaps in testing coverage and to improve the maintenance process.

References

  1. Cormen, T. H., Stein, C., Rivest, R. L., and Leiserson, C. E. 2001 Introduction to Algorithms. 2nd. McGraw-Hill Higher Education. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Elbaum, S., Rothermel, G., Kanduri, S., and Malishevsky, A. G. 2004. Selecting a Cost-Effective Test Case Prioritization Technique. Software Quality Control 12, 3 (Sep. 2004), 185--210. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Gittens, M., Lutfiyya, H., and Bauer, M. 2004. An Extended Operational Profile Model. In Proceedings of the 15th international Symposium on Software Reliability Engineering (November 02--05, 2004). ISSRE. IEEE Computer Society, Washington, DC, 314--325. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Hassan, A. E., Martin, D. J., Flora, P., Mansfield, P., and Dietz, D. 2008. An Industrial Case Study of Customizing Operational Profiles Using Log Compression. In Proceedings of the 30th international Conference on Software Engineering (Leipzig, Germany, May 10--18, 2008). ICSE '08. ACM, New York, NY, 713--723. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. IBM® ILOG® CPLEX®: http://www.ilog.com/Google ScholarGoogle Scholar
  6. Jasper, R., Brennan, M., Williamson, K., Currier, B., and Zimmerman, D. 1994. Test data generation and feasible path analysis. In Proceedings of the 1994 ACM SIGSOFT international Symposium on Software Testing and Analysis (Seattle, Washington, United States, August 17--19, 1994). T. Ostrand, Ed. ISSTA '94. ACM, New York, NY, 95--107. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Musa, J. D. 1993. Operational Profiles in Software-Reliability Engineering. IEEE Softw. 10, 2 (Mar. 1993), 14--32. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Papadimitriou, C. H. and Steiglitz, K. 1998 Combinatorial Optimization: Algorithms and Complexity. Dover Publications, Inc. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Weyns, K. and Runeson, P. 2007. Sensitivity of software system reliability to usage profile changes. In Proceedings of the 2007 ACM Symposium on Applied Computing (Seoul, Korea, March 11--15, 2007). SAC '07. ACM, New York, NY, 1440--1444. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Yamany, H. EL and Capretz M. A. M., 2007. A Multi-Agent Framework for Building an Automatic Operational Profile, In Advances and Innovations in Systems, Computing Sciences and Software Engineering, Springer, 161--166Google ScholarGoogle Scholar

Index Terms

  1. Selection of customers for operational and usage profiling

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in
        • Published in

          cover image ACM Conferences
          DBTest '09: Proceedings of the Second International Workshop on Testing Database Systems
          June 2009
          79 pages
          ISBN:9781605587066
          DOI:10.1145/1594156

          Copyright © 2009 ACM

          Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          • Published: 29 June 2009

          Permissions

          Request permissions about this article.

          Request Permissions

          Check for updates

          Qualifiers

          • research-article

          Acceptance Rates

          Overall Acceptance Rate31of56submissions,55%

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader