skip to main content
10.1145/1111449.1111497acmconferencesArticle/Chapter ViewAbstractPublication PagesiuiConference Proceedingsconference-collections
Article

A goal-oriented interface to consumer electronics using planning and commonsense reasoning

Published: 29 January 2006 Publication History

Abstract

We are reaching a crisis with design of user interfaces for consumer electronics. Flashing 12:00 time indicators, push-and-hold buttons, and interminable modes and menus are all symptoms of trying to maintain a one-to-one correspondence between functions and physical controls, which becomes hopeless as the number of capabilities of devices grows. We propose instead to orient interfaces around the goals that users have for the use of devices.We present Roadie, a user interface agent that provides intelligent context-sensitive help and assistance for a network of consumer devices. Roadie uses a Commonsense knowledge base to map between user goals and functions of the devices, and an AI partial-order planner to provide mixed-initiative assistance with executing multi-step procedures and debugging help when things go wrong.

References

[1]
Avrim Blum, Merrick Furst. Fast Planning Through Planning Graph Analysis. Proc. Of the 14th International Joint Conference on Artificial Intelligence (IJCAI 1997), Montreal, Canada, pages 1636--1642, 1997.
[2]
Boris de Ruyter, Richard van de Sluis. Challenges for End-User Development in Intelligent Environments. In Henry Lieberman, Fabio Paterno, Volker Wulf, eds, End-User Development, Kluwer Academic Publisher, (to appear).
[3]
Jose Espinosa, Henry Lieberman. EventNet: Inferring Temporal Relations Between Commonsense Events. Proc. Fourth Mexican International Conference on Artificial Intelligence, Springer Publisher. November 14-18, 2005. Monterrey, Nuevo Leon, MEXICO (to appear).
[4]
Yolanda Gil. Knowledge Refinement in a Reflective Architecture. Proceedings of the Twelfth National Conference of Artificial Intelligence (AAAI-94), volume 1, pages 520--526, AAAI, 1994.
[5]
Stephen S. Intille, K. Larson, J.S. Beaudin, J. Nawyn, E. Munguia Tapia, P. Kaushik. A living laboratory for the design and evaluation of ubiquitous computing technologies. Extended Abstracts of the 2005 Conference on Human Factors in Computing Systems, New York, NY: ACM Press, 2004.
[6]
Chia-Hsun Jackie Lee, Leonardo Bonanni, Jose Espinosa, Henry Lieberman, Ted Selker. KitchenSense: Augmenting Kitchen Appliances with Shared Context using Knowledge about Daily Events. Conference on Intelligent user interfaces (in submission).
[7]
Henry Lieberman, Hugo Liu, Push Singh, and Barbara Barry. Beating Common Sense into Interactive Applications. AI Magazine 25(4): Winter 2005, 63--76.
[8]
Henry Lieberman, Earl Wagner: End-User Debugging for Electronic Commerce, Proceedings of the 8th international Conference on Intelligent user interfaces, ACM Press, 2003.
[9]
Henry Lieberman (Ed.). Your Wish is My Command: Programming By Example. The Morgan Kaufmann Series in Interactive Technologies, 2001.
[10]
Hugo Liu, Henry Lieberman, Ted Selker. Goose: A Goal-Oriented Search Engine with Commonsense. Proceedings of the second international conference on Adaptive Hypermedia and Adaptive Web-Based Systems, pages 253--263, ACM Press, 2002.
[11]
Jef Raskin. The Humane Interface: New Directions for Designing Interactive Systems. Addison-Wesley Professional, First Edition, 2000.
[12]
Charles Rich, Candy Sidner. Collagen: A Collaboration Manager Software Interface Agents. Journal of User Modeling and User-Adapted Interaction, pages 315--350, 8(3/4), 1998.
[13]
Charles Rich, Candy Sidner, Neal Lesh, Andrew Garland, Shane Booth, Markus Chimani. DiamonHelp: A Graphical User Interface Framework for Human-Computer Collaboration. IEEE International Conference on Distributed Computing Systems Workshops, pages 514--519, June 2005.
[14]
Push Singh. The public acquisition of Commonsense knowledge. Proc. AAAI Spring Symposium on Acquiring (and Using) Linguistic (and World) Knowledge for Information Access, 2002.
[15]
Universal Plug and Play Device Architecture. 2000. Available: http://www.upnp.org/download/UPnPDA10_20000613.htm
[16]
Alexander Yates, Oren Etzioni, Daniel Weld. A reliable natural language interface to household appliances. Proceedings of the 8th international Conference on Intelligent user interfaces, pages 189--196, ACM Press, 2003.
[17]
Gottfried Zimmermann, Gregg Vanderheiden, Al Gilman. Prototype Implementations for a Universal Remote Console Specification. ACM Special Interest Group on Computer-Human Interaction, pages 510--511, ACM Press, 2002.

Cited By

View all
  • (2018)Designing a goal-oriented smart-home environmentInformation Systems Frontiers10.1007/s10796-016-9670-x20:1(125-142)Online publication date: 1-Feb-2018
  • (2018)Playbook for UAS: UX of Goal-Oriented Planning and ExecutionEngineering Psychology and Cognitive Ergonomics10.1007/978-3-319-91122-9_44(545-557)Online publication date: 30-May-2018
  • (2009)Tracing actions helps in understanding interactionsProceedings of the 7th SIGdial Workshop on Discourse and Dialogue10.5555/1654595.1654609(60-67)Online publication date: 15-Jul-2009
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
IUI '06: Proceedings of the 11th international conference on Intelligent user interfaces
January 2006
392 pages
ISBN:1595932879
DOI:10.1145/1111449
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 29 January 2006

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. commonsense reasoning
  2. consumer electronics
  3. goal-oriented interfaces
  4. planning

Qualifiers

  • Article

Conference

IUI06
IUI06: 11th International Conference on Intelligent User Interfaces
January 29 - February 1, 2006
Sydney, Australia

Acceptance Rates

Overall Acceptance Rate 746 of 2,811 submissions, 27%

Upcoming Conference

IUI '25

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)12
  • Downloads (Last 6 weeks)1
Reflects downloads up to 13 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2018)Designing a goal-oriented smart-home environmentInformation Systems Frontiers10.1007/s10796-016-9670-x20:1(125-142)Online publication date: 1-Feb-2018
  • (2018)Playbook for UAS: UX of Goal-Oriented Planning and ExecutionEngineering Psychology and Cognitive Ergonomics10.1007/978-3-319-91122-9_44(545-557)Online publication date: 30-May-2018
  • (2009)Tracing actions helps in understanding interactionsProceedings of the 7th SIGdial Workshop on Discourse and Dialogue10.5555/1654595.1654609(60-67)Online publication date: 15-Jul-2009
  • (2009)EthyleneProceedings of the 21st International Conference on Association Francophone d'Interaction Homme-Machine10.1145/1629826.1629839(75-84)Online publication date: 13-Oct-2009
  • (2009)Recognizing and using goals in event managementCHI '09 Extended Abstracts on Human Factors in Computing Systems10.1145/1520340.1520694(4525-4530)Online publication date: 4-Apr-2009
  • (2008)Usable artificial intelligenceCHI '08 Extended Abstracts on Human Factors in Computing Systems10.1145/1358628.1358961(3937-3940)Online publication date: 5-Apr-2008
  • (2007)Making sense of virtual environmentsProceedings of the 12th international conference on Intelligent user interfaces10.1145/1216295.1216336(225-234)Online publication date: 28-Jan-2007
  • (2006)HuddleProceedings of the 19th annual ACM symposium on User interface software and technology10.1145/1166253.1166298(279-288)Online publication date: 15-Oct-2006
  • (2006)Augmenting kitchen appliances with a shared context using knowledge about daily eventsProceedings of the 11th international conference on Intelligent user interfaces10.1145/1111449.1111533(348-350)Online publication date: 29-Jan-2006

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media