BSR: a statistic-based approach for establishing and refining software process performance baseline

ABSTRACT

High-level process management is quantitative management. The Process Performance Baseline (PPB) of process or subprocess under statistical management is the most important concept. It is the basis of process control and improvement. The existing methods for establishing process baseline are too coarse-grained or have some limitation, which lead to inaccurate or ineffective quantitative management. In this paper, we propose an approach called BSR (Baseline-Statistic-Refinement) for establishing and refining software process performance baseline, and present the experience result to validate its effectiveness for quantitative process management.

REFERENCES

• 1: Victor Basili , Gianluigi Caldiera , Frank McGarry , Rose Pajerski , Gerald Page , Sharon Waligora, The software engineering laboratory: an operational software experience factory, Proceedings of the 14th international conference on Software engineering, p.370-381, May 11-15, 1992, Melbourne, Australia [doi>10.1145/143062.143154]
• 2: Basili, V., Caldiera, G., Rombach, D.H., The Experience Factory, Encyclopaedia of Software Engineering, Vol.2, 1994, 469--476
• 3: Mary Beth Chrissis , Mike Konrad , Sandy Shrum, CMMI Guidlines for Process Integration and Product Improvement, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 2003
• 4: CMMI Product Team, Capability Maturity Model® Integration (CMMISM), Version 1.1, CMU/SEI-2002-TR-001, ESC-TR-2002-001, Software Engineering Institute, Carnegie Mellon University, Pittsburgh, PA, 2001.
• 5: Nancy Eickelmann , Animesh Anant, Statistical Process Control: What You Don't Measure Can Hurt You!, IEEE Software, v.20 n.2, p.49-51, January 2003 [doi>10.1109/MS.2003.1184166 ]
• 6: William A. Florac , Anita D. Carleton, Measuring the software process: statistical process control for software process improvement, Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1999
• 7: Florac, W.A, Park, R.E., Carleton, A.D., Practical Software Measurement: Measuring for Process Management and Improvement, GUIDEBOOK CMU/SEI-97-HB-003, Software Engineering Institute, Carnegie Mellon University, Pittsburgh, PA, 1997.
• 8: Frank Houdek , Kurt Schneider , Eva Wieser, Establishing experience factories at Daimler-Benz: an experience report, Proceedings of the 20th international conference on Software engineering, p.443-447, April 19-25, 1998, Kyoto, Japan
• 9: Humphrey, W.S., The Personal Software Process, CMU/SEI-2000-TR-022, Software Engineering Institute, Carnegie Mellon University, Pittsburgh, PA, 2000.
• 10: Humphrey, W.S., The Team Software Process, CMU/SEI-2000-TR-023, Software Engineering Institute, Carnegie Mellon University, Pittsburgh, PA, 2000.
• 11: ISBSG, http://www.isbsg.org
• 12: Ishikawa, K., Guide to Quality Control, Quality Resource, White Plains, New York, 1989.
• 13: ISO/IEC15504-1998, Information Technology- Software Process Assessment.
• 14: ISO/IEC9001:2000, Quality Management Systems-Requirements.
• 15: Paulk, M.C. Applying SPC to the Personal Software ProcessSM, 2000, Proceedings of the Tenth International Conference on Software Quality,( New Orleans, LA,16-18 October 2000).
• 16: Paulk, M.C., Practices of High Maturity Organizations, The 11th Software Engineering Process Group Conference (SEPG'99)(Atlanta, Georgia, March 8-11) 1999.
• 17: Radice, R., Statistical Process Control in Level 4 an 5 Organization Worldwide, Proc. 12th Ann. Software Technology Conf., 2000. also available at www.stt.com.
• 18: SEL, http://sel.gsfc.nasa.gov/website/exp-factory/exp-proj.htm
• 19: Sun, J., The Statistical Process Control of the Near Zero-Nonconformity Process, Tsinghua University Press, March 2001.(Chinese)
• 20: Christine B. Tayntor, Six SIGMA Software Development, Auerbach Publications, Boston, MA, 2002
• 21: Wang, Q., Li, M.S., Liu, X., An Active Measurement Model for Software Process Control and Improvement. Journal of Software, Vol.16, No.3 pp.407--418 2005 (Chinese)
• 22: Wang, Q., Li, M.S., Measuring and Improving Software Process in China, The 4th International Symposium on Empirical Software Engineering, (ISESE' 05)(Noosa Heads, Australia, Nov. 17-18) accepted.
• 23: Wang, Q., Li, M.S., Software Process Management: Practices in China, In Proc. of the Software Process Workshop 2005 (SPW2005), Beijing, 2005.
• 24: Xinpei Zhao , Keith Chan , Mingshu Li, Applying agent technology to software process modeling and process-centered software engineering environment, Proceedings of the 2005 ACM symposium on Applied computing, March 13-17, 2005, Santa Fe, New Mexico [doi>10.1145/1066677.1067021]

INDEX TERMS

Primary Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.8 Metrics
          Subjects: Process metrics

General Terms:
Experimentation, Management, Measurement

Keywords:
measurement, process performance baseline, quantitative process management, software process improvement