Model-based design, generation, and evaluation of virtual user interfaces

ABSTRACT

A transformational approach is presented that models a virtual reality scene based on Abstract Interaction Objects (AIOs) from which virtual user interfaces can be designed (by progressive AIO assembling), generated (by automated code generation in VRML/X3D), and evaluated (by static analysis of the ongoing model). The underlying model is shared with user interfaces descriptions in other worlds like Windows applications, web pages, etc. It is therefore possible to recuperate existing interfaces in these worlds to automatically create their counterpart in VRML/ X3D. This process is called virtualization of flat user interfaces. This approach allows the progressive and flexible retargeting of non-virtual interfaces in the virtual world to achieve a better integration with other applications.

REFERENCES

• 1: L. Bouillon , J. Vanderdonckt, Retargeting of Web Pages to Other Computing Platforms with VAQUITA, Proceedings of the Ninth Working Conference on Reverse Engineering (WCRE'02), p.339, October 29-November 01, 2002
• 2: Michael D. Byrne , Scott D. Wood , James D. Foley , David E. Kieras , Piyawadee Noi Sukaviriya, Automating interface evaluation, Proceedings of the SIGCHI conference on Human factors in computing systems: celebrating interdependence, p.232-237, April 24-28, 1994, Boston, Massachusetts, United States [doi>10.1145/191666.191752]
• 3: Luca Chittaro , Roberto Ranon , Lucio Ieronutti, Guiding visitors of Web3D worlds through automatically generated tours, Proceeding of the eighth international conference on 3D Web technology, March 09-12, 2003, Saint Malo, France [doi>10.1145/636593.636598]
• 4: DEGANI, A., PALMER, E. A., AND BAUERSFELD, K. G. 1992. Soft Controls for Hard Displays: Still a Challenge. In Proceedings of the 36th Annual Meeting Conference of the Human Factors and Ergonomics Society HFES'92 (Atlanta, October 12--16, 1992). Human Factors Society, Santa Monica, 52--56.
• 5: Robert J. K. Jacob , Leonidas Deligiannidis , Stephen Morrison, A software model and specification language for non-WIMP user interfaces, ACM Transactions on Computer-Human Interaction (TOCHI), v.6 n.1, p.1-46, March 1999 [doi>10.1145/310641.310642]
• 6: MOLINA, J. P., GONZÁLEZ, P., LOZANO, M. D., MONTERO, F., AND LÓPEZ-JAQUERO, V. 2003. Dridging the Gap: Developing 2D and 3D User Interfaces with the IDEAS Methodology. In Proceedings of 10th Int. Conf. on Design, Specifications, and Verification of Interactive Systems DSV-IS'2003 (Funchal, June 2003), LNCS Vol. 2844. Springer-Verlag, Berlin, 2003, pp. 303--315.
• 7: Lloyd H. Nakatani , John A. Rohrlich, Soft machines: A philosophy of user-computer interface design, Proceedings of the SIGCHI conference on Human Factors in Computing Systems, p.19-23, December 12-15, 1983, Boston, Massachusetts, United States [doi>10.1145/800045.801573]
• 8: O'HARA, J. M. July 1994. Advanced Human-System Interface Design Review Guideline, General Evaluation Model, Technical Development, and Guideline Description. Document NUREG/CR-5908-BNL-NUREG-52333, Vol. 1, U.S. Nuclear Regulatory Commission, Brook-haven National Laboratory.
• 9: O'HARA, J. M., BROWN, W. S., BAKER, C. C., WELCH, D. L., GRANDA, T. M., AND VINGELIS, P. J. July 1994. Advanced Human-System Interface Design Review Guideline, Evaluation Procedures and Guidelines for Human Factors Engineering Reviews. Document NUREG/CR-5908 - BNL-NUREG-52333, Vol. 2, U.S. Nuclear Regulatory Commission, Brookhaven National Laboratory/Carlow International Inc.
• 10: Angel Puerta , Jacob Eisenstein, XIML: a common representation for interaction data, Proceedings of the 7th international conference on Intelligent user interfaces, January 13-16, 2002, San Francisco, California, USA [doi>10.1145/502716.502763]
• 11: PUERTA, A., AND EISENSTEIN, J. 2003. XIML: A Multiple User Interface Representation Framework for Industry. In Multiple User Interfaces Cross-Platform Applications and Context-Aware Interfaces, A. Seffah and H. Javahery, Eds., Chapter 7, John Wiley & Sons, 2003, 119--148.
• 12: Marc M. Sebrechts , John V. Cugini , Sharon J. Laskowski , Joanna Vasilakis , Michael S. Miller, Visualization of search results: a comparative evaluation of text, 2D, and 3D interfaces, Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval, p.3-10, August 15-19, 1999, Berkeley, California, United States [doi>10.1145/312624.312634]
• 13: Dorée Duncan Seligmann , Steven Feiner, Automated generation of intent-based 3D Illustrations, Proceedings of the 18th annual conference on Computer graphics and interactive techniques, p.123-132, July 1991
• 14: Dorée Duncan Seligmann , Steven Feiner, Supporting interactivity in automated 3D illustrations, Proceedings of the 1st international conference on Intelligent user interfaces, p.37-44, January 04-07, 1993, Orlando, Florida, United States [doi>10.1145/169891.169896]
• 15: SMITH, K. AND WALKER, B. A. 2003. Design of the control room environment, Denver. Accessible at http://www.isa.org/Content/Content Groups/Divisions1/Technical_Papers3/DesignoftheControlRoomEnvironment.pdf
• 16: Arne Schilling , Alexander Zipf, Generation of VRML city models for focus based tour animations: integration, modeling and presentation of heterogeneous geo-data sources, Proceeding of the eighth international conference on 3D Web technology, March 09-12, 2003, Saint Malo, France [doi>10.1145/636593.636599]
• 17: Jean Vanderdonckt , Pierre Berquin, Towards a Very Large Model-Based Approach for User Interface Development, Proceedings of the 1999 User Interfaces to Data Intensive Systems, p.76, September 05-06, 1999
• 18: Jean M. Vanderdonckt , François Bodart, Encapsulating knowledge for intelligent automatic interaction objects selection, Proceedings of the SIGCHI conference on Human factors in computing systems, p.424-429, April 24-29, 1993, Amsterdam, The Netherlands [doi>10.1145/169059.169340]
• 19: Julie Frances Waterhouse, A comparison of two-dimensional and three-dimensional interfaces for editing surfaces reconstructed from contours, University of Waterloo, Waterloo, Ont., Canada, 1998
• 20: WOOD, J. 1999. Why do we need an international standard for control rooms?, Egham. Accessible at http://www.ccd.org.uk/communications/control.html
• 21: Michelle X. Zhou , Steven K. Feiner, Top-down hierarchical planning of coherent visual discourse, Proceedings of the 2nd international conference on Intelligent user interfaces, p.129-136, January 06-09, 1997, Orlando, Florida, United States [doi>10.1145/238218.238314]

INDEX TERMS

Primary Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.2 Design Tools and Techniques
          Subjects: User interfaces

Additional Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.1 Multimedia Information Systems
          Subjects: Artificial, augmented, and virtual realities
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)

  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.6 Methodology and Techniques
          Subjects: Interaction techniques
      I.3.7 Three-Dimensional Graphics and Realism

General Terms:
Algorithms, Design, Human Factors

Keywords:
Abstract Interaction Object (AIO), Concrete Interaction Object (CIO), automated code generation, interface evaluation, retargeting, static analysis, transformational approach, usability guidelines, virtualization