Forecasting software visualizations: an explorative study

ABSTRACT

A qualitative explorative evaluation considered the effects of six visualization interfaces of sales forecasting systems on 60 university students. The study builds on earlier research from the domain of business forecasting in supply chain industries. The evaluation generates exemplar interfaces derived from the theoretical framework and task analysis of interviews with 20 expert users and designers of forecasting systems. The implications for information visualization and interaction design are discussed.

References

1. Andrews, K. (2006). Evaluating information visualizations. In Proceedings of the AVI workshop on Beyond Time and Errors: novel evaluation methods for information visualization, Venice, Italy, 1--5.
2. Armstrong, J. S. (2001). Principles of Forecasting: a Handbook for Researchers and Practitioners. Boston, MA: Kluwer Academic.
3. Card, S. K., Mackinlay, J. D. & Shneiderman, B. (Editors). Readings in Information Visualization: Using Vision to Think. Morgan Kaufmann Publishers Inc., San Francisco, CA, USA, 1999.
4. Davenport, T. H. & Markus, M. L. (1999). Rigor vs relevance: response to Benbasat and Zmud. MIS Quarterly, 23 (1), 19--23.
5. Ellis, G. & Dix, A. (2006). An explorative analysis of user evaluation studies in information visualisation. In Proceedings of the conference on Beyond Time and Errors: Novel Evaluation Methods For information Visualization. Venice, Italy, May 23, 1--7.
6. Faisai, S, Craft, B. & Bladford, A. (2008). Internalization, qualitative methods, and evaluation. In Proceedings of the Conference on Beyond Time and Errors: novel evaluation methods for Information Visualization, Florence, Italy, Article No5.
7. Fildes, R., Goodwin, P. & Lawrence, M. (2006). The design features of forecasting support systems and their effectiveness. Decision Support Systems, 42 (1), 351--361.
8. Fildes, R. & Goodwin, P. (2007). Against your better judgment? How organizations can improve their use of management judgement in forecasting. Interfaces, 37 (6), 570--576.
9. Fildes, R., Goodwin, P., Lawrence, M. & Nikolopoulos, K. (2009). Effective forecasting for supply-chain planning: an empirical evaluation and strategies for improvement. International Journal of Forecasting, 25 (1), 3--23.
10. Galbraith, C. S. & Merrill, G. B. (1996). The politics of forecasting: managing the truth. California Management Review, 38 (2), 29--43.
11. Glaser, B. G. & Strauss, A. L. (1967). The Discovery of Grounded Theory: Strategies for Qualitative Research. Aldine Publishing Co., Chicago, IL.
12. Glaser, B. G. (1992). Emergence vs Forcing: Basics of Grounded Theory Analysis. Mill Valley, CA: Sociology Press.
13. Goodwin, P., Fildes, R., Lawrence, M. & Nikolopoulos, K. (2007). The process of using a forecasting support system. International Journal of Forecasting, 23, 391--404.
14. Isenberg, P., Zuk, T., Collins, C. & Carpendale, S. (2008). Grounded evaluation of information visualizations. In Proceedings of the conference on Beyond Time and Errors: novel evaluation methods for information visualization, Florence, Italy, Article No6.
15. Kobsa, A. (2001). An empirical comparison of three commercial information visualization systems. In Proceedings of IEEE symposium on Information Visualization. San Diego, CA, USA, Oct. 22--23, 123--130.
16. Küsters U., McCullogh, B. & Bell, M. (2006). Forecasting software: Past, present and future. International Journal of Forecasting, 22 (3), 599--615.
17. Lawrence, M., Goodwin, P., O' Connor, M. J. & Onkal, D. (2007). Judgemental forecasting: A review of progress over the last 25 years, International Journal of Forecasting, 22, 493--518.
18. Lee, W. Y., Goodwin, P., Fildes, R., Nikolopoulos, K. & Lawrence, M. (2007). Providing support for the use of analogies in demand forecasting tasks. International Journal of Forecasting, 23, 377--390.
19. Lim, S. J. & O'Connor, M. (1996). Judgemental forecasting with interactive forecasting support systems. Decision Support Systems, 16, 339--357.
20. Makridakis, S., Wheelwright, S. C. & Hyndman, R. J. (1998). Forecasting: Methods and Applications (3^rd edition). New York: Wiley & Sons.
21. Mentzer, J. T., Bienstock, C. C. & Kahn, K. B. (1999). Benchmarking sales forecasting management. Business Horizons, 48--56, May--June.
22. Moon, M. A., Mentzer, T. J. & Smith, D. C. (2003). Conducting a sales forecasting audit. International Journal of Forecasting, 19, 5--25.
23. Sanders, N. R. & Manrodt, K. B. (2003). Forecasting software in practice: Use, satisfaction, and performance. Interfaces, 33, 90--93.
24. Strauss, A. L. & Corbin, J. (1990). Basics of Qualitative Research: Grounded Theory procedures and techniques. Sage Publications.
25. Strauss, A. L. & Corbin, J. (1998). Basics of Qualitative Research: Techniques and procedures for developing grounded theory (2^nd edition). Newbury Park: Sage Publications.
26. Thomas, J. J., & Cook, K. A. (Editors). (2005). Illuminating the Path: The Research and Development Agenda for Visual Analytics. IEEE Computer Society Press.
27. Thomas, J. J., & Cook, A. K. (2006). A Visual Analytics Agenda, IEEE Computer Graphics and Applications, 26 (1), 10--13, Jan/Feb.
28. Tory, M., & Staub-French, S. (2008). Qualitative analysis of visualization: A building design field study. In Proceedings of the conference on Beyond Time and Errors: novel evaluation methods for information visualization, Florence, Italy, Article No 7.
29. Winklhofer, H., Diamantopoulos, A. & Witt, F. S. (1996). Forecasting practice: a review of the empirical literature and an agenda for future research. International Journal of Forecasting, 12, 193--221.

Index Terms

• Applied computing

  • Operations research

    • Decision analysis

• Human-centered computing

  • Human computer interaction (HCI)

    • HCI design and evaluation methods

• Information systems

  • Information systems applications

    • Decision support systems