DEMAIS: designing multimedia applications with interactive storyboards

ABSTRACT

To create an innovative interactive multimedia application, a multimedia designer needs to rapidly explore numerous behavioral design ideas early in the design process, as creating innovative behavior is the cornerstone of creating innovative multimedia. Current tools and techniques do not support a designer's need for early behavior exploration, limiting her ability to rapidly explore and effectively communicate behavioral design ideas. To address this need, we have developed a sketch-based, interactive multimedia storyboard tool that uses a designer's ink strokes and textual annotations as an input design vocabulary. By operationalizing this vocabulary, the tool transforms an otherwise static sketch into a working example. The behavioral sketch can be quickly edited using gestures and an expressive visual language. By enabling a designer to explore and communicate behavioral design ideas using working examples early in the design process, our tool facilitates the creation of a more effective, compelling, and entertaining multimedia application.

References

1. 1.Apple Computer. HyperCard: Reference Manual, 1993.
2. 2.Baecker, R., A. Rosenthal, N. Friedlander, E. Smith, and A. Cohen. A Multimedia System for Authoring Motion Pictures. Proc. ACM Multimedia, 1996.
3. 3.Baggett, P. The Role of Temporal Overlap of Visual and Auditory Material in Forming Dual Media Associations. Journal of Educational Psychology, 76 (1984), 408-417.
4. 4.Bailey, B.P. and J.A. Konstan. Authoring Interactive Media. Encyclopedia of Electrical and Electronics Engineering. John Wiley & Sons, 2000.
5. 5.Bailey, B., R. Cooley, J. Konstan, and M. DeJong. NSync -A Toolkit for Building Interactive Multimedia Presentations. Proc. ACM Multimedia, 1998.
6. 6.D.C.A. Bulterman, L. Hardman, J. Jansen, K.S. Mullender, and L. Rutledge. GRiNS: A Graphical Interface for Creating and Playing SMIL Documents. Seventh International World Wide Web Conference, 1998.
7. 7.Caloini, A., D. Taguchi, K. Yanoo, and E. Tanaka. Scriptfree Scenario Authoring in MediaDesc. Proc. ACM Multimedia, 1998.
8. 8.Faraday, P. and A. Sutcliffe. Providing Advice for Multimedia Designers. CHI, 1998.
9. 9.Faraday, P. and A. Sutcliffe. An Empirical Study of Attending and Comprehending Multimedia Presentations, Proc. ACM Multimedia, 1996.
10. 10.Gould, J.D. and C. Lewis. Designing for Usability: Key Principles and What Designers Think. Communications of the ACM, 28 (3): 300-311, 1985.
11. 11.Gross, M.D. and E.Y. Do. Ambiguous Intentions: A Paperlike Inerface for Creative Design. UZST, 1996.
12. 12.Harada, K. and Y. Hara. Anecdote: A Multimedia Storyboarding System with Seamless Authoring Support. Proc. ACM Multimedia, 1996.
13. 13.Hong, J.I. and J.A. Landay. SATIN: A Toolkit for Informal Ink-based Applications. UIST, 2000.
14. 14.Java Technology. http://java.sun.com.
15. 15.Kant, M., S. Wilson, M. Bekker, H. Johnson, and P. Johnson. Patchwork: A Software Tool for Early Design. Proceedings CHI'98 Late Breaking Results, 1998.
16. 16.Kozma, R.B. Learning with Media. Review of Educational Research, 61 (2): 179-211, 1991.
17. 17.Landay, J.A. and B.A. Myers. Interactive Sketching for the Early Stages of User Interface Design. CHI, 1995.
18. 18.Lewis, M., W. Clark and B. Devoto (Ed). The Journals of Lewis and Clark. Houghton Mifflin Co, 1997.
19. 19.Lin, J., M.W. Newman, J.I. Hong, and J.A. Landay. DENIM: Finding a Tighter Fit Between Tools and Practice for Web Site Design. CHI, 2000.
20. 20.Mackay, W.E. and D.S. Pagani. Video Mosaic: Laying Out Time in a Physical Space. Proc. ACM Multimedia, 1994.
21. 21.Macromedia, Learning Lingo. Macromedia Press, 1997.
22. 22.Madsen, K.H. and P.H. Aiken. Experiences Using Cooperative Interactive Storyboard Prototyping. Communications of the ACM, 36 (4): 57-64, 1993.
23. 23.Mayer, R.E. Aids to Text Comprehension. Educational Psychologist, 19 (1984), 30-42.
24. 24.Najjar, L.J. Multimedia Information and Learning. J. Educ. Multimedia and Hypermedia, 5 (1996), 129- 150.
25. 25.Rieber, L.P. Getting Interactive with Authorware: Building Simulations and Games. http://www.nowhereroad.comlauthorware/index.html.
26. 26.Rudd, J., K. Stern, and S. Isensee. The Low vs. High- Fidelity Prototyping Debate. Interactions, 3 (1): 76-85, 1996.
27. 27.Wacom Technology. httn:Nwww.wacom.com.

Index Terms

• Human-centered computing

  • Human computer interaction (HCI)

    • Interactive systems and tools

  • Interaction design

• Social and professional topics

  • Professional topics

    • Management of computing and information systems

      • Project and people management

        • Systems analysis and design