skip to main content
10.1145/1159733.1159781acmconferencesArticle/Chapter ViewAbstractPublication PagesesemConference Proceedingsconference-collections
Article

A goal question metric based approach for efficient measurement framework definition

Published: 21 September 2006 Publication History

Abstract

In software engineering, measurements can be used to monitor, understand and improve software processes as well as products and resource utilization. Commonly, measurement frameworks are ambitious undertakings that require large data collection and analysis efforts. Unfortunately, such frameworks usually become too extensive, resulting in graveyards with a lot of data never being analyzed and used. One well-known way for defining measurements that tries to focus on the most important ones is the Goal Question Metric (GQM) approach. GQM focuses on eliciting goals and questions as drivers for finding metrics necessary to collect. This means that there is always a purpose with the defined measurements. GQM solves part of the problem mentioned, but it is still possible that the measurements defined become too many. In this paper, an extended GQM approach is presented that facilitates identification of and focuses on the most important measurements for an organization. The approach makes it possible to be more efficient when it comes to the application of measurement frameworks. Besides the presentation of the approach, two case studies are presented where the suitability of the approach is investigated in an industrial context. In the case studies, the suggested approach has been applied on two different processes within software development: change management and requirements engineering. From these case studies, a number of experiences are highlighted and discussed as issues to consider when applying the approach.

References

[1]
Berander, P., and Jönsson, P. Hierarchical Cumulative Voting (HCV) -- Prioritization of Requirements in Hierarchies, to be published in International Journal of Software Engineering and Knowledge Engineering (IJSEKE) -- Special Issue on Requirements Engineering Decision Support, 16, 5 (October 2006).
[2]
Clark, B. Eight Secrets of Software Measurement, IEEE Software, 19, 5 (Sept/Oct 2002), 12--15.
[3]
DePanfilis, S., Kitchenham, B., and Morfuni, N. Experiences Introducing a Measurement Program, Information and Software Technology, 39, 11 (1997), 745--754,
[4]
Fenton, N. E., and Pfleeger, S. L. Software Metrics -- A Rigorous and Practical Approach, 2nd Edition, PWA Publishing Company, Boston, MA, 1997.
[5]
Hetzel, B. Making Software Measurement Work -- Building an Effective Measurement Program, John Wiley & Sons, New York, NY, 1993.
[6]
ISO/IEC 15939:2002. Software Engineering -- Software Measurement Process, 2002.
[7]
Kotonya G., and Sommerville, I. Requirements Engineering -- Processes and Techniques, John Wiley & Sons, Chichester, England, 1998.
[8]
Mendonça, M. G., and Basili, V. R. Validation of an Approach for Improving Existing Measurement Frameworks, IEEE Transactions on Software Engineering, 26, 6, (June 2000), 484--500.
[9]
Park, R. E., Goethert, W. B., and Florac, W. A. Goal-Driven Software Measurement -- A Guidebook, Handbook CMU/SEI-96-HB-002, Software Engineering Institute, Carnegie Mellon University, Hanscom, MA, 1996.
[10]
Shepperd, M. Foundations of Software Measurement, Prentice Hall, Hemel Hempstead, England, 1995.
[11]
Van Aken, E. M, and Coleman, G. D. Building Better Measurement, Industrial Management, 44, 4 (Jul/Aug 2002), 28--33.
[12]
Van Solingen R., and Berghout, E. The Goal/Question/Metric Method -- A Practical Guide for Quality Improvement of Software Development, McGraw-Hill Publishing Company, Maidenhead, England, 1999.
[13]
Van Solingen, R., and Berghout, E. Integrating Goal-Oriented Measurement in Industrial Software Engineering: Industrial Experiences with and Additions to the Goal/Question/Metric Method (GQM), Proceedings of the Seventh International Software Metrics Symposium (METRICS 2001), (London, England, April 4-6, 2001), IEEE Computer Society, Los Alamitos, CA, 2001, 246--258.
[14]
Van Solingen, R., Basili, V., Caldiera, Gianluigi, and Rombach, D. H. Goal Question Metric (GQM) Approach, Encyclopedia of Software Engineering (Marciniak, J.J. ed.), online version @ Wiley Interscience, John Wiley & Sons, 2002.
[15]
Wang, Y., and He, Q. A Practical Methodology for Measurement Deployment in GQM, Proceedings of the Canadian Conference on Electrical and Computer Engineering (IEEE CCECE 2003) (Montreal, Canada, May 4-7, 2003), IEEE Computer Society, Los Alamitos, CA, 1329--1332 (vol. 2), 2003.

Cited By

View all
  • (2025)TEDME-KG Metrics Framework: A Metrics Framework for TEmporal Data Modelling Evaluation in Knowledge GraphsKnowledge Graphs and Semantic Web10.1007/978-3-031-81221-7_9(123-138)Online publication date: 13-Feb-2025
  • (2024)A Comprehensive Evaluation Framework of Software Visualizations EffectivenessIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.332121130:9(6056-6074)Online publication date: Sep-2024
  • (2023)Mining Task-Specific Lines of Code CountersIEEE Access10.1109/ACCESS.2023.331457211(100218-100233)Online publication date: 2023
  • Show More Cited By

Index Terms

  1. A goal question metric based approach for efficient measurement framework definition

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    ISESE '06: Proceedings of the 2006 ACM/IEEE international symposium on Empirical software engineering
    September 2006
    388 pages
    ISBN:1595932186
    DOI:10.1145/1159733
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 21 September 2006

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. GQM
    2. change management
    3. goal question metric
    4. measurements
    5. requirements management

    Qualifiers

    • Article

    Conference

    ISESE06
    Sponsor:

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)56
    • Downloads (Last 6 weeks)5
    Reflects downloads up to 20 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2025)TEDME-KG Metrics Framework: A Metrics Framework for TEmporal Data Modelling Evaluation in Knowledge GraphsKnowledge Graphs and Semantic Web10.1007/978-3-031-81221-7_9(123-138)Online publication date: 13-Feb-2025
    • (2024)A Comprehensive Evaluation Framework of Software Visualizations EffectivenessIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.332121130:9(6056-6074)Online publication date: Sep-2024
    • (2023)Mining Task-Specific Lines of Code CountersIEEE Access10.1109/ACCESS.2023.331457211(100218-100233)Online publication date: 2023
    • (2021)Method to Address Complexity in Organizations Based on a Comprehensive OverviewInformation10.3390/info1210042312:10(423)Online publication date: 16-Oct-2021
    • (2019)Integrative Double Kaizen Loop (IDKL): Towards a Culture of Continuous Learning and Sustainable Improvements for Software OrganizationsIEEE Transactions on Software Engineering10.1109/TSE.2018.282972245:12(1189-1210)Online publication date: 1-Dec-2019
    • (2018)Design and validation of precooked developer dashboardsProceedings of the 2018 26th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering10.1145/3236024.3275530(821-826)Online publication date: 26-Oct-2018
    • (2018)Data Visualization of FADEC Software Engineering Information TechnologyProceedings of the 2018 International Conference on Computing and Data Engineering10.1145/3219788.3219794(44-48)Online publication date: 4-May-2018
    • (2018)Object oriented software security: goal questions metrics approachInternational Journal of Information Technology10.1007/s41870-018-0189-xOnline publication date: 20-Apr-2018
    • (2017)A Hybrid eBusiness Software Metrics Framework for Decision Making in Cloud Computing EnvironmentIEEE Systems Journal10.1109/JSYST.2015.244304911:2(1049-1059)Online publication date: Jun-2017
    • (2017)Requirement Prioritization Using Adaptive Fuzzy Hierarchical Cumulative Voting2017 IEEE 7th International Advance Computing Conference (IACC)10.1109/IACC.2017.0034(95-102)Online publication date: Jan-2017
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media