Component-based high fidelity interactive prototyping of post-WIMP interactions

ABSTRACT

In order to support interactive high-fidelity prototyping of post-WIMP user interactions, we propose a multi-fidelity design method based on a unifying component-based model and supported by an advanced tool suite, the OpenInterface Platform Workbench. Our approach strives for supporting a collaborative (programmer-designer) and user-centered design activity. The workbench architecture allows exploration of novel interaction techniques through seamless integration and adaptation of heterogeneous components, high-fidelity rapid prototyping, runtime evaluation and fine-tuning of designed systems. This paper illustrates through the iterative construction of a running example how OpenInterface allows the leverage of existing resources and fosters the creation of non-conventional interaction techniques.

References

1. Beaudouin-Lafon, M. 2000. Instrumental interaction: an interaction model for designing post-wimp user interfaces. In Proc. of SIGCHI conf. on Human factors in computing systems. CHI'00. ACM, 446--453.
2. Buxton, W. 1983. Lexical and pragmatic considerations of input structures. SIGGRAPH Comp. Graph. 17(1):31--37.
3. Cohen, P. R., Johnston, M., McGee, D., Oviatt, S., Pittman, J., Smith, I., Chen, L., and Clow, J. 1997. QuickSet: multimodal interaction for distributed applications. In Proc. of ACM MULTIMEDIA '97. 31--40.
4. Hartmann, B., Klemmer, S. R., Bernstein, M., Abdulla, L., Burr, B., Robinson-Mosher, A., and Gee, J. 2006. Reflective physical prototyping through integrated design, test, and analysis. In Proc. of UIST '06.
5. König, W. A., Rädle, R., and Reiterer, H. 2009. Squidy: a zoomable design environment for natural user interfaces. In CHI EA'09. 4561--4566.
6. Lawson, J-Y. L., Al-Akkad, A., Vanderdonckt, J., and Macq, B. 2009. An open source workbench for prototyping multimodal interactions based on off-the-shelf heterogeneous components. In Proc. of EICS'09. ACM, 245--254.
7. Li, Y. and Landay, J. A. 2005. Informal prototyping of continuous graphical interactions by demonstration. In Proc. of UIST '05. ACM, 221--230.
8. Merrill, D. and Paradiso, J. A. 2005. Personalization, Expressivity, and Learnability of an Implicit Mapping Strategy for Physical Interfaces. In Proc. of CHI'05. ACM, 2152--2161.
9. Myers, B., Hudson, S. E., and Pausch, R. 2000. Past, present, and future of user interface software tools. In Trans. on Computer-Human Interaction. ACM, 7(1):3--28.
10. Rettig, M., 1994. Prototyping for tiny fingers. Communications of the ACM. 37, 4, 21--27.
11. Sinha, A. K. and Landay, J. A. 2003. Capturing user tests in a multimodal, multidevice informal prototyping tool. In Proc. of ICMI '03. ACM, 117--124.

Index Terms

• Human-centered computing

  • Interaction design

    • Interaction design process and methods

      • Interface design prototyping

• Software and its engineering

  • Software notations and tools

    • Development frameworks and environments

      • Integrated and visual development environments

    • General programming languages

      • Language features

        • Modules / packages