Aaron Spaulding
ABSTRACT
Numerous techniques exist to help users automate repetitive tasks; however, none of these methods fully support end-user creation, use, and modification of the learned tasks. We present an integrated task learning system (ITL) that learns executable procedures based on user demonstration and instruction, constituting a first step toward a broader solution for procedure management. We discuss our deployment of ITL into a collaborative command-and-control system. In this complex domain, ITL's performance with end users doing real tasks indicates that providing multiple, integrated learning techniques both extends functionality and improves user experience. Our experience in integrat-ing this system also provides key insights for future designs of domain-independent task learning systems, specifically in supporting users' ability to understand and edit lengthy procedures.
- Allen, J. et al. PLOW: A Collaborative Task Learning Agent. Proc. AAAI 2007. Google Scholar
Digital Library
- Blythe, J. Task Learning by Instruction in Tailor. Proc IUI 2005. Google ScholarDigital Library
- Burnett, M. Software Engineering for Visual Programming Languages. Handbook of Software Engineering and Knowledge Engineering, Vol. 2, World Scientific Publishing Company, June 2001.Google Scholar
- Burstein, M., Laddaga, R., McDonald, D., Benyo, B., et al. POIROT--Integrated Learning of Web Service Procedures. Proc. AAAI-08. Google ScholarDigital Library
- Command Post of the Future (CPOF) http://www.darpa.gov/sto/strategic/cpof.htmlGoogle Scholar
- Cypher, A. (Ed.). Watch What I Do: Programming by Demonstration. MIT Press, Cambridge, MA, 1993. Google ScholarDigital Library
- Dedrick, J., Gurbaxani, V., and Kraemer, K. L. 2003. Information technology and economic performance: A critical review of the empirical evidence. ACM Comput. Surv. 35, 1 (Mar. 2003), 1--28. Google ScholarDigital Library
- Gervasio, M., Lee, T. J., and Eker, S. Learning Email Procedures for the Desktop. Proc. AAAI 2008 Workshop on Enhanced Messaging.Google Scholar
- Huffman, S. and Laird, J. Flexibly Instructable Agents, Journal of AI Research, 3, 1995 Google ScholarDigital Library
- Lerman, K., Plangrasopchok, A. and Knoblock, C. Semantic Labelling of Online Information Sources, IJSWIS 2007.Google Scholar
- Lieberman, H. (Ed.). Your Wish is My Command: Programming by Example. Morgan Kaufmann, San Francisco, CA, 2001.Google ScholarDigital Library
- Morley, D. and Myers, K. The SPARK Agent Framework. Proc AAMAS 2004. Google ScholarDigital Library
- Nardi, B. A Small Matter of Programming: Perspectives on End User Computing. MIT Press, Cambridge, MA, 1993. Google ScholarCross Ref
Index Terms
- From geek to sleek: integrating task learning tools to support end users in real-world applications
Recommendations
Super Intendo: Semantic Robot Programming from Multiple Demonstrations for taskable robots
AbstractWhen an end-user instructs a taskable robot on a new task, it is important for the robot to learn the user’s intention for the task. Knowing the user’s intention, represented as desired goal conditions, allows the robot to generalize across ...
Highlights- Semantic Robot programming from multiple demonstrations for taskable robotics.
- Factor graph belief propagation for generative inference of user intention.
- Generalization to unseen task with novel classes and numbers of objects.
Learning alternative ways of performing a task
Highlights- Learning from experts requires learning from small and only positive examples.
- ...
AbstractA common way of learning to perform a task is to observe how it is carried out by experts. However, it is well known that for most tasks there is no unique way to perform them. This is especially noticeable the more complex the task is ...
APE: learning user's habits to automate repetitive tasks
IUI '00: Proceedings of the 5th international conference on Intelligent user interfacesThe APE (Adaptive Programming Environment) project focuses on applying Machine Learning techniques to embed a software assistant into the VisualWorks Smalltalk interactive programming environment. The assistant is able to learn user's habits and to ...
Comments