MORE for less: model recovery from visual interfaces for multi-device application design

ABSTRACT

An emerging approach to multi-device application development requires developers to build an abstract semantic model that is translated into specific implementations for web browsers, PDAs, voice systems and other user interfaces. Specifying abstract semantics can be difficult for designers accustomed to working with concrete screen-oriented layout. We present an approach to model recovery: inferring semantic models from existing applications, enabling developers to use familiar tools but still reap the benefits of multi-device deployment. We describe MORE, a system that converts the visual layout of HTML forms into a semantic model with explicit captions and logical grouping. We evaluate MOREs performance on forms from existing Web applications, and demonstrate that in most cases the difference between the recovered model and a hand-authored model is under 5%

References

1. Bickmore, T.W., Shilit, B.N., Digestor: Device-independent Access to the World-Wide-Web, Proceedings of the 6th WWW Conference, 1997.
2. Di Lucca, G.A., Di Penta, M., Antoniol, G., Casazza, G., An Approach for Reverse Engineering of Web-Based Applications, Proceedings of WCRE '01, pp. 231--240.
3. Bergman, L.D., Banavar, G., Soroker, D., Sussman, J., Combining Handcrafting and Automatic Generation of User-Interfaces for Pervasive Devices, Proceedings of CADUI III (2002), pp. 155--166.
4. Bouillon, L., Vonderdonckt, J., Souchon, N., Recovering Alternative Presentation Models of a Web Page with VAQUITA, Proceedings of CADUI 02, pp. 311--322.
5. Puerta, A. and Eisenstein, J., Towards a General Computational Framework for Model-Based Interface Development Systems, Proceedings of IUI 99, pp.171--178.
6. Paganelli L., Paterno, F., Automatic Reconstruction of the Underlying Interaction Design of Web Applications, Proceedings of SEKE 02, pp. 439--445.
7. Ricca, F., Tonella, P., Baxter I.D., Restructuring Web Applications via Transformation Rules, Proceedings of SCAM 01, 150--160
8. Sannella, M, SkyBlue: A Multi-Way Local Propagation Constrain Solver for User Interface Construction, Proceedings of UIST 94, pp. 137--146.
9. Singh, G., Kok, C. and Ngan, T., Druid: A System for Demonstrational Rapid User Interface Development, Proceedings of UIST 1990, pp. 167--177.
10. St. Amant R., Lieberman H., Potter R., Zettlemoyer L., Visual Generalization in Programming by Example, Communications of the ACM, v.43 n.3, 107--114, March 2000.
11. Stroulia, E., Kapoor, R.V., Reverse Engineering Interaction Plans for Legacy Interface Migration, Proceedings of CADUI 02, pp. 295--310.
12. Sukaviriya, P., Foley, J., and Griffith, T., A Second Generation User Interface Design Environment: The Model and the Runtime Architecture, Proceedings of ACM INTERCHI'93, pp.375--382
13. Szekely, P., Luo, P., and Neches, R., Beyond Interface Builders: Model-Based Interface Tools, Proceedings of ACM INTERCHI'93, p.383--390.
14. UIML, http://www.uiml.org
15. XForms, <http://www.w3c.org/Markup/Forms/>
16. XIML, <http://www.ximl.org/>

Index Terms

• Software and its engineering

  • Software creation and management

    • Software post-development issues

      • Software reverse engineering

  • Software notations and tools

    • Development frameworks and environments

      • Integrated and visual development environments