Abstract
Models are key artifacts in Model-Driven Development (MDD) methods. To produce high-quality software by using MDD methods, quality assurance of models is of paramount importance. To evaluate the quality of models, defect detection is considered a suitable approach and is usually applied using reading techniques. However, these reading techniques have limitations and constraints, and new techniques are required to improve the efficiency at finding as many defects as possible. This article presents a case study that has been carried out to evaluate the use of a Functional Size Measurement (FSM) procedure in the detection of defects in models of an MDD environment. To do this, we compare the defects and the defect types found by an inspection group with the defects and the defect types found by the FSM procedure. The results indicate that the FSM is useful since it finds all the defects related to a specific defect type, it finds different defect types than an inspection group, and it finds defects related to the correctness and the consistency of the models.
- Abran, A., Desharnais, J., Lesterhuis, A., Londeix, B., Meli, R., Morris, P., Oligny, S., O'Neil, M., Rollo, T., Rule, G., Santillo, L., Symons, C., and Toivonen, H. 2007. The COSMIC functional size measurement method - Version 3.0. GELOG. www.gelog.etsmtl.ca.Google Scholar
- Atkinson, C. 1998. Adapting the fusion process to support the unified modeling language. Object. Mag., Nov., 32--39. Google ScholarDigital Library
- Bellur, U. and Vallieswaran, V. 2006. On OO design consistency in iterative development. In Proceedings of the 3rd International Conference on Information Technology: New Generations (ITNG'06). IEEE, 46--51. Google ScholarDigital Library
- Benbasat, I., Goldstein, D., and Mead, M. 1987. The case research strategy in studies of information systems. MIS Q. 11, 369--386. Google ScholarDigital Library
- Berenbach, B. 2004. The evaluation of large, complex uml analysis and design models. In Proceedings of the 26th International Conference on Software Engineering (ICSE'04). IEEE Computer Society, 232--241. Google ScholarDigital Library
- Berkenkötter, K. 2008. Reliable uml models and profiles. Electron. Not. Theor. Comput. Sci. 217, 203--220. Google ScholarDigital Library
- Care-Technologies 2011. Web site. http://www.care-t.com/.Google Scholar
- Coleman, D., Arnold, P., Godoff, S., Dollin, C., Gilchrist, H., Hayes, F., and Jeremaes, P. 1994. Object-Oriented Development: The Fusion Method. Prentice-Hall, Englewood Cliffs, NJ. Google ScholarDigital Library
- Conradi, R., Mohagheghi, P., Arif, T., Hegde, L. C., Bunde, G. A., and Pedersen, A. 2003. Object-oriented reading techniques for inspection of uml models -- An industrial experiment. In Proceedings of the 17th European Conference on Object-Oriented Programming (ECOOP'03). Springer, 483--501.Google Scholar
- Davenport, T. H. and Prusak, L. 1998. Working Knowledge: How Organisations Manage What They Know. Business School Press, Boston, MA. Google ScholarDigital Library
- Egyed, A. 2006. Instant consistency checking for the uml. In Proceedings of the 28th International Conference on Software Engineering (ICSE'06). ACM Press, New York, 381--390. Google ScholarDigital Library
- España, S., González, A., and Pastor, O. 2009. Communication analysis: A requirements engineering method for information systems. In Proceedings of the 21st International Conference on Advanced Information Systems Engineering (CAiSE'09). P. van Eck, J. Gordijn and R. Wieringa, Eds., Springer, 530--545. Google ScholarDigital Library
- Fink, T., Koch, M., and Pauls, K. 2006. An mda approach to access control specifications using mof and uml profiles. Electron. Not. Theor. Comput. Sci. 142, 161--179. Google ScholarDigital Library
- France, R. B., Ghosh, S., Dinh-Trong, T., and Solberg, A. 2006. Model-driven development using uml 2.0: Promises and pitfalls. IEEE Comput. 39, 59--66. Google ScholarDigital Library
- Giachetti, G., Albert, M., Marín, B., and Pastor, O. 2010. Linking uml and mdd through uml profiles: A practical approach based on the uml association. J. Universal Comput. Sci. 16, 2353--2373Google Scholar
- Giachetti, G., Marín, B., and Pastor, O. 2009. Using uml as a domain-specific modeling language: A proposal for automatic generation of uml profiles. In Proceedings of the 21st International Conference on Advanced Information Systems Engineering (CAiSE'09). P. van Eck, J. Gordijn and R. Wieringa, Eds., Springer, 110--124. Google ScholarDigital Library
- Gomaa, H. 2000. Designing Concurrent, Distributed, and Real-Time Applications with UML. Addison-Wesley. Google ScholarDigital Library
- Gomaa, H. and Wijesekera, D. 2003. Consistency in multiple-view uml models: A case study. In Proceedings of the Workshop on Consistency Problems in UML-Based Software Development II. IEEE, 1--8.Google Scholar
- Gómez, J., Insfrán, E., Pelechano, V., and Pastor, O. 1998. The execution model: A component based architecture to generate software components from conceptual models. In Proceedings of the Workshop on Component-based Information Systems Engineering.Google Scholar
- Hailpern, B. and Tarr, P. 2006. Model-driven develpment: The good, the bad, and the ugly. IBM Syst. J. 45, 451--461. Google ScholarDigital Library
- IEEE. 1990. IEEE 610 standard computer dictionary. A compilation of IEEE standard computer glossaries. http://standards.ieee.org/findstds/standard/610-1990.html.Google Scholar
- IEEE. 2009. IEEE 1044 standard classification for software anomalies. https://standards.ieee.org/findstds/standard/1044-2009.html.Google Scholar
- Insfrán, E., Pastor, O., and Wieringa, R. 2002. Requirements engineering-based conceptual modelling. J. Requir. Engin. 7, 2, 61--72.Google ScholarDigital Library
- ISO. 1998. ISO/IEC 14143-1 -- Information technology -- Software measurement -- Functional size measurement -- Part 1: Definition of concepts. http://www.iso.org/iso/iso_catalogue/catalogue_tc/catalogue_detail.htm?csnumber=22774.Google Scholar
- ISO. 2004. International vocabulary of basic and general terms in metrology (VIM), I.O.f. standardization Ed., Geneva, Switzerland. http://143.54.70.55/medterm/ISO_VEM.pdf.Google Scholar
- ISO/IEC. 2001. ISO/IEC 9126-1, Software engineering -- Product quality -- Part 1: Quality model. http://www.iso.org/iso/iso_catalogue/catalo-gue_tc/catalogue_detail.htm?csnumber=22749.Google Scholar
- ISO/IEC. 2003. ISO/IEC 19761, Software engineering -- COSMIC-FFP -- A functional size measurement method. http://www.iso.org/iso/iso_catalogue/catalogue_ics/catalogue_detail_ics.htm?csnumber=33899.Google Scholar
- Kitchenham, B. 2007. Guidelines for performing systematic literature reviews in software engineering. http://www.uio.no/studier/emner/matnat/ifi/INF5500/h11/undervisningsmateriale/Systematic%20reviews.pdf.Google Scholar
- Kuzniarz, L. 2003. Inconsistencies in student designs. In Proceedings of the Workshop on Consistency Problems in UML-based Software Development II. IEEE, 9--17.Google Scholar
- Laitenberger, O., Atkinson, C., Schlich, M., and Emam, K. E. 2000. An experimental comparison of reading techniques for defect detection in uml design documents. J. Syst. Softw. 53, 183--204. Google ScholarDigital Library
- Lange, C. and Chaudron, M. 2004. An empirical assessment of completeness in uml designs. In Proceedings of the 8th Conference on Empirical Assessment in Software Engineering (EASE'04). IEEE, 111--121.Google Scholar
- Lange, C., Wijins, M., and Chaudron, M. 2007. Metric view evolution: UML-based views for monitoring model evolution and quality. In Proceedings of the 11th European Conference on Software Maintenance and Reengineering (CSMR'07). IEEE, 327--328. Google ScholarDigital Library
- Leung, F. and Bolloju, N. 2005. Analyzing the quality of domain models developed by novice systems analysts. In Proceedings of the 38th Hawaii International Conference on System Sciences. IEEE, 1--7. Google ScholarDigital Library
- Lindland, O. I., Sindre, G., and Solvberg, A. 1994. Understanding quality in conceptual modeling. IEEE Softw. 11, 42--49. Google ScholarDigital Library
- Marín, B. 2010. OOmCFP measurement guide. Tech. rep. DSIC-II/05/10, Unviersidad Politécnica de Valencia, Valencia, Spain.Google Scholar
- Marín, B. 2011. Functional size measurement and model verification for software model-driven developments: A cosmic-based approach. Tech. rep., Departamento de Sistemas Informáticos y Computación Unviersidad Politécnica de Valencia. 333.Google Scholar
- Marín, B., Condori-Fernández, N., and Pastor, O. 2008a. Design of a functional size measurement procedure for a model-driven software development method. In Proceedings of the 3rd Workshop on Quality in Modeling of MODELS. J.-L. Sourrouille, M. Staron, L. Kuzniarz, P. Mohagheghi and L. Pareto, Eds., 1--15.Google Scholar
- Marín, B., Condori-fernández, N., Pastor, O., and Abran, A. 2008b. Measuring the functional size of conceptual models in an mda environment. In Proceedings of the 20th International Conference on Advanced Information Systems Engineering (CAiSE'08). Z. Bellahsene, C. Woo, E. Hunt, X. Franch, and R. Coletta, Eds., 33--36.Google Scholar
- Marín, B., Giachetti, G., and Pastor, O. 2008c. Automating the measurement of functional size of conceptual models in an mda environment. In Proceedings of the 9th International Conference on Product-Focused Software Process Improvement (PROFES'08). Springer, 215--229. Google ScholarDigital Library
- Marín, B., Giachetti, G., and Pastor, O. 2009. Applying a functional size measurement procedure for defect detection in mdd environments In Proceedings of the 16th European Conference on Software Process Improvement (EuroSPI'09). R. V. O'Connor, Ed., Springer, 57--68.Google Scholar
- Marín, B., Giachetti, G., Pastor, O., and Vos, T. E. J. 2010a. A tool for automatic defect detection in models used in model-driven engineering. In Proceedings of the 7th International Conference on the Quality of Information and Communications Technology (QUATIC'10). IEEE, 242--247. Google ScholarDigital Library
- Marín, B., Pastor, O., and Abran, A. 2010b. Towards an accurate functional size measurement procedure for conceptual models in an mda environment. Data Knowl. Engin. 69, 472--490. Google ScholarDigital Library
- Mohagheghi, P. and Aagedal, J. 2007. Evaluating quality in model-driven engineering. In Proceedings of the International Workshop on Modeling in Software Engineering (MISE'07). IEEE Computer Society. Google ScholarDigital Library
- Moody, D. L. 2005. Theoretical and practical issues in evaluating the quality of conceptual models: Current state and future directions. Data Knowl. Engin. 55, 243--276. Google ScholarDigital Library
- Moreno, N., Fraternali, P., and Vallecillo, A. 2007. WebML modeling in uml. IET Softw. 1, 67--80.Google ScholarCross Ref
- OMG 2010. UML 2.3 superstructure specification. http://www.omg.org/spec/UML/2.3/.Google Scholar
- Opdahl, A. L. and Henderson-Sellers, B. 2005. A unified modelling language without referential redundancy. Data Knowl. Engin. 55, 277--300. Google ScholarDigital Library
- Pastor, O. and Giachetti, G. 2010. Linking goal-oriented requirements and model-driven development. In Intentional Perpectives on Information Systems Engineering. Springer, 255--274.Google Scholar
- Pastor, O., Hayes, F., and Bear, S. 1992. OASIS: An object-oriented specification language. In Proceedings of the International Conference on Advanced Information Systems Engineering (CAiSE'92). 348--363.Google Scholar
- Pastor, O. and Molina, J. C. 2007. A software production environment based on conceptual modeling. In Model-Driven Architecture in Practice. Springer, New York.Google Scholar
- Petticrew, M. and Roberts, H. 2005. Systematic Reviews in the Social Sciences: A Practical Guide. Blackwell Publishing.Google Scholar
- Robson, C. 2002. Real World Research: A Resource for Social Scientists and Practitioner Researchers, 2nd ed., Blackwell Publishing.Google Scholar
- Runeson, P. and Host, M. 2009. Guidelines for conducting and reporting case study research in software engineering. Empirical Softw. Engin. J. 14, 131--164. Google ScholarDigital Library
- Schmidt, D. 2006. Model driven engineering. IEEE Comput. 39, 25--31. Google ScholarDigital Library
- Seaman, C. 1999. Qualitative methods in empirical studies of software engineering. IEEE Trans. Softw. Engin. 25, 557--572. Google ScholarDigital Library
- Selic, B. 2003. The pragmatics of model-driven development. IEEE Softw. 20, 19--25. Google ScholarDigital Library
- Selic, B. 2007. A systematic approach to domain-specific language design using uml. In Proceedings of the 10th IEEE International Symposium on Object and Component-Oriented Real-Time Distributed Computing (ISORC'07). 2--9. Google ScholarDigital Library
- Travassos, G., Shull, F., Fredericks, M., and Basili, V. 1999. Detecting defects in object-oriented designs: Using reading techniques to increase software quality. In Proceedings of the 14th ACM SIGPLAN Conference on Object-Oriented Programming, Systems, Languages, and Applications. 47--56. Google ScholarDigital Library
- Trudel, S. and Abran, A. 2008. Improving quality of functional requirements by measuring their functional size. In Proceedings of the International Conferences on Software Process and Product Measurement (IWSM/Metrikon/Mensura'08), Springer, 287--231. Google ScholarDigital Library
- Trudel, S. and Abran, A. 2010. Functional requirements improvements through size measurement: A case study with inexperienced measurers. In Proceedings of the 8th ACIS International Conference on Software Engineering Research, Management and Applications (SERA'10). IEEE Computer Society, 181--189. Google ScholarDigital Library
- Yin, R. 2003. Case Study Research, Design and Methods 3rd Ed. Sage, London.Google Scholar
Index Terms
- Using a functional size measurement procedure to evaluate the quality of models in MDD environments
Recommendations
Evaluating the usefulness of a functional size measurement procedure to detect defects in MDD models
ESEM '10: Proceedings of the 2010 ACM-IEEE International Symposium on Empirical Software Engineering and MeasurementModels are key artifacts in Model-Driven Development (MDD) methods. To evaluate the quality of models, defect detection is considered to be a suitable approach, which is usually applied using reading techniques. However, new techniques are required in ...
Functional Requirement Improvements through Size Measurement: A Case Study with Inexperienced Measurers
SERA '10: Proceedings of the 2010 Eighth ACIS International Conference on Software Engineering Research, Management and ApplicationsThis paper reports on a research project investigating the contribution of functional size measurers to finding defects in requirements. It describes an experiment where the same requirements document was inspected by a number of inspectors, as well as ...
Bidirectional Influence of Defects and Functional Size
IWSM-MENSURA '11: Proceedings of the 2011 Joint Conference of the 21st International Workshop on Software Measurement and the 6th International Conference on Software Process and Product MeasurementThis paper reports on a research project investigating the contribution of functional size measurers to finding defects in requirements. In previous experiments, the concurrent inspection of the same requirements document by a measurer in addition to ...
Comments