Principles of survey research part 4: questionnaire evaluation

Abstract

This article discusses how to avoid biased questions in survey instruments, how to motivate people to complete instruments and how to evaluate instruments. In the context of survey evaluation, we discuss how to assess survey reliability i.e. how reproducible a survey's data is and survey validity i.e. how well a survey instrument measures what it sets out to measure.

References

1. Linda Bourque and Eve Fielder, How to conduct self-administered and mail surveys, Sage Publications Inc., 1995.
2. L.J. Cronbach, "Coefficient alpha and internal structure of tests," Psychometrika, 16(2), 1951, pp. 297--334.
3. El Emam, K., Goldenson, D., Briand, L. and Marshall, P. Interrater Agreement in SPICE Based Assessments, Proceedings 4th International Software Metrics Conference, IEEE Computer Society Press, 1996, pp 149--156.
4. El Emam, K., Simon, J-M., Rousseau, S. and Jacquet. E. Cost implications of Interrater Agreement for Software process Assignments. Proceedings 5th International Software Metrics Conference, IEEE Computer Society Press, 1998, pp 38--51.
5. Humphrey, W., and Curtis, B., Comments on 'a critical look', IEEE Software, 8:4, July, 1991, pp 42--46.
6. Timothy Lethbridge, A survey of the relevance of computer science and software engineering education, Proceedings of the llth International Conference on Software Engineering, IEEE Computer Society Press, 1998.
7. Timothy Lethbridge, What knowledge is important to a software professional, IEEE Computer, May 2000.
8. J. Ropponen and K. Lyytinen, Components of software development risk: How to address them. A project manager survey, IEEE Transactions on Software Engineering 26(2), February 2000.
9. Howard Schuman and Stanley Presser, Questions and Answers in Attitude Surveys: Experiments on Question Form, Wording and Context. Sage Publications, Inc. 1996.