skip to main content
10.1145/1052380.1052411acmotherconferencesArticle/Chapter ViewAbstractPublication PagesmumConference Proceedingsconference-collections
Article

Middleware support for implementing context-aware multimodal user interfaces

Published: 27 October 2004 Publication History

Abstract

In context-aware pervasive networking (Capnet) environments the user interface of a service application has to be adapted to whatever type of a device the user is using, taking into account the situation at hand, i.e. the user's current context, as well as user's personal preferences. In addition, new and more natural interaction styles have to be provided for the user. When designing and implementing user interfaces, or generating them automatically at runtime, some a priori knowledge of the capabilities of user's device and her personal preferences are required. Furthermore, runtime adaptation calls for mechanisms for recognizing context and delivering it. This paper presents the support that could be provided in middleware level for implementing context-aware multimodal user interfaces and the Capnet middleware user interface architecture model for providing that support. Adaptation algorithms are not discussed. The Capnet middleware backbone provides support for context-awareness via context recognition and automatic delivery of context data through a notification mechanism. For multimodal input and output third party components are required. The proposed architecture model is partly implemented and tested with software prototypes.

References

[1]
http://www.mediateam.oulu.fi/projects/capnet/?lang=en
[2]
Bernstein, P. A.: Middleware: a model for distributed system services. Communications of the ACM. Vol. 39, Num. 2. ACM Press (1996) 86--98.
[3]
Bauer, M., Bruegge, B., Klinker, G., MacWilliams, A., Recher, T., Riss, S. & San, M. (2001): Design of a component-based augmented reality framework. Int Symp on Augmented Reality 2001, New York, USA, 45--54.
[4]
Roman M., Hess C. K., Cerqueira R., Panganat A., Campbell R. H. & Nahrstedt K. (2002): A middleware infrastructure for active spaces. IEEE Pervasive Computing 1:74--82.
[5]
Tandler, P. (2001): Software infrastructure for ubiquitous computing environments: Supporting synchronous collaboration with heterogenous devices. Proceedings of Ubicomp 2001, Atlanta, Georgia, 96--115.
[6]
Beard M. & Korn P.: What I Need is What I Get: Downloadable User Interfaces via Jini and Java. CHI (2001) Extended Abstracts, 15--16.
[7]
Newman M. W., Izadi S., Edwards W. K., Sedivy J. Z. & Smith T. F.: User Interfaces When and Where They are Needed: An Infrastructure for Recombinant Computing. Proceedings of UIST'02 (2002), Paris, France, 171--180.
[8]
Kindberg T. & Barton J.: A Web-based Nomadic Computing System. Computer Networks. Vol. 35, Num. 4. Elsevier (2001) 443--456.
[9]
Vandervelpen C., Luyten K. and Conix K.: Location-Transparent User Interaction for Heterogeneous Environments. Proc. HCI International, Crete, Greece. Vol. 2 (2003), 313--317.
[10]
Vanderheiden G., Zimmermann G. & Trewin S.: A Standard for Controlling Ubiquitous Computing and Environmental Resources from Any Personal Device. Proc. HCI International Crete, Greece. Vol. 2 (2003), 499--503.
[11]
http://xml.coverpages.org/userInterfaceXML.html
[12]
http://www.w3.org/TR/NOTE-agent-attributes-971230.html
[13]
http://www.w3.org/2001/di/
[14]
http://www-306.ibm.com/software/voice/viavoice/
[15]
http://www.eclipse.org/swt/
[16]
Perttunen, M. & Riekki, J.: Inferring Presence in a Context-Aware Instant Messaging System. Accepted to the 2004 IFIP Int. Conference on Intelligence in Communication Systems (INTELLICOM 04), Bangkok, Thailand, 23-26 Nov. 2004.
[17]
http://akseli.tekes.fi/Resource.phx/tivi/nets/en/index.htx

Cited By

View all
  • (2013)A Web Service for Managing Spatial Context Dedicated to Serious Games on and for SmartphonesJournal of Geographic Information System10.4236/jgis.2013.5201505:02(148-160)Online publication date: 2013
  • (2012)Towards a framework to characterize ubiquitous software projectsInformation and Software Technology10.1016/j.infsof.2012.01.00954:7(759-785)Online publication date: 1-Jul-2012
  • (2011)A middleware for implicit interactionComputing with instinct10.5555/1980745.1980757(143-161)Online publication date: 1-Jan-2011
  • Show More Cited By

Index Terms

  1. Middleware support for implementing context-aware multimodal user interfaces

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Other conferences
    MUM '04: Proceedings of the 3rd international conference on Mobile and ubiquitous multimedia
    October 2004
    273 pages
    ISBN:1581139810
    DOI:10.1145/1052380
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    • UMIADCS: University of Maryland, Institute for Advanced Computer Studies

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 27 October 2004

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. component-based development
    2. context-aware applications
    3. middleware
    4. multimodal user interfaces
    5. pervasive networking

    Qualifiers

    • Article

    Conference

    MUM04
    Sponsor:
    • UMIADCS
    MUM04: International Conference on Mobile and Ubiquitous Multimedia
    October 27 - 29, 2004
    Maryland, College Park, USA

    Acceptance Rates

    Overall Acceptance Rate 190 of 465 submissions, 41%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)2
    • Downloads (Last 6 weeks)1
    Reflects downloads up to 20 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2013)A Web Service for Managing Spatial Context Dedicated to Serious Games on and for SmartphonesJournal of Geographic Information System10.4236/jgis.2013.5201505:02(148-160)Online publication date: 2013
    • (2012)Towards a framework to characterize ubiquitous software projectsInformation and Software Technology10.1016/j.infsof.2012.01.00954:7(759-785)Online publication date: 1-Jul-2012
    • (2011)A middleware for implicit interactionComputing with instinct10.5555/1980745.1980757(143-161)Online publication date: 1-Jan-2011
    • (2011)A Middleware for Implicit InteractionComputing with Instinct10.1007/978-3-642-19757-4_9(143-161)Online publication date: 2011
    • (2009)AIM: Design and Implementation of Agent-based Intelligent Middleware for Ubiquitous HCI EnvironmentsThe KIPS Transactions:PartA10.3745/KIPSTA.2009.16-A.1.4316A:1(43-54)Online publication date: 28-Feb-2009
    • (2009)A Hybrid Approach for Designing an Adaptive User Interface: IDSS and BDI AgentsAdvances in Software Engineering10.1007/978-3-642-10242-4_14(164-182)Online publication date: 2009
    • (2008)Proposal for an Adaptive User Interface DesignProceedings of the 2008 Advanced Software Engineering and Its Applications10.1109/ASEA.2008.8(91-94)Online publication date: 13-Dec-2008
    • (2007)Mining Multidimensional Data Using Clustering TechniquesProceedings of the 18th International Conference on Database and Expert Systems Applications10.1109/DEXA.2007.102(382-386)Online publication date: 3-Sep-2007
    • (2007)Using a Patterns-Based Modelling Language and a Model-Based Adaptation Architecture to Facilitate Adaptive User InterfacesInteractive Systems. Design, Specification, and Verification10.1007/978-3-540-69554-7_19(234-247)Online publication date: 2007
    • (2006)Using a patterns-based modelling language and a model-based adaptation architecture to facilitate adaptive user interfacesProceedings of the 13th international conference on Interactive systems: Design, specification, and verification10.5555/1756428.1756456(234-247)Online publication date: 26-Jul-2006
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media