User-created forms as an effective method of human-agent communication

ABSTRACT

A key challenge for mixed-initiative systems is to create a shared understanding of the task between human and agent. To address this challenge, we created a mixed-initiative interface called Mixer to aid administrators with automating tedious information-retrieval tasks. Users initiate communication with the agent by constructing a form, creating a structure to hold the information they require and to show context in order to interpret this information. They then populate the form with the desired results, demonstrating to the agent the steps required to retrieve the information. This method of form creation explicitly defines the shared understanding between human and agent. An evaluation of the interface shows that administrators can effectively create forms to communicate with the agent, that they are likely to accept this technology in their work environment, and that the agent's help can significantly reduce the time they spend on repeated information-retrieval tasks.

References

1. Allen, J., Chambers, N., Ferguson, G., Galescu, L., Jung, H., Swift, M., Taysom, W. PLOW: A Collaborative Task Learning Agent. Proc. of AAAI (2007).
2. Alterman, R., Feinman, A., Introne, J. and Landsman, S. Coordinating Representations in Computer-Mediated Joint Activities. In Proc. of the Conference of the Cognitive Science Society (2001).
3. Bly, S. and Churchill, E. F. Design through Matchmaking: Technology in Search of Users. Interactions, 6, 2 (March/April 1999), 23--31.
4. Bresina, J. L. and Morris, P. H. Mixed-Initiative Planning in Space Mission Operations. AI Magazine, 28, 2 (2007), 75--89.
5. Burstein, M. H. and Diller, D. E. Cooperative Information Sharing Among Mixed-Initiative Human/Agent Teams. In Proc. of the Conference on Artificial Intelligence, (2003).
6. Burstein, M., Laddaga, R., McDonald, D., Cox, M., Benyo, B., Robertson, P., Hussain, T., Brinn, M. and McDermott, D. POIROT: Integrated Learning of Web Service Procedures. Proc. of AAAI (2008).
7. Cypher, A. Eager: Programming Repetitive Tasks by Demonstration. In Watch What I Do: Programming by Demonstration. A. Cypher (eds). MIT Press, (1993), 205--218.
8. Davis, F. D. Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology. MIS Quarterly, 13, 3 (Sept 1989), 319--340.
9. Dix, A., Mancini, R. and Levialdi, S. Communication, Action and History. In Proc. of CHI, (1997) ACM Press, 542--543.
10. Fischer, G. and Giaccardi, E. Meta-Design: A Framework for the Future of End User Development. In End User Development: Empowering People to Flexibly Employ Advanced Information and Communication Technology. Kluwer Academic Publishers, 2006, 427--457.
11. Fogarty, J., Hudson, S. E., Atkeson, C. G., Avrahami, D., Forlizzi, J., Kiesler, S., Lee, J. C. and Yang, J. Predicting human interruptibility with sensors. ACM Transactions on Computer-Human Interaction, 12, 1 (2005), 119--146.
12. Freed, M., Carbonell, J., Gordon, G., Hayes, J., Myers, B., Siewiorek, D., Smith, S., Steinfeld, A., Tomasic, A. RADAR: A Personal Assistant that Learns to Reduce Email Overload. In Proc. of AAAI Conference on Artificial Intelligence, (2008)
13. Hearst, M. A. Mixed Initiative Interaction. IEEE Intelligent Systems, 14, 5 (1999), 14--23.
14. Horvitz, E. Principles of Mixed-initiative User Interfaces. In Proc. of CHI, (1999) ACM Press, 159--166.
15. Horvitz, E. Reflections on Challenges and Promises of Mixed-Initiative Interaction. AAAI Magazine, 28(2007).
16. Kosbie, D. S. and Myers, B. A. A System-wide Macro Facility Based on Aggregate Events: A Proposal. In Watch What I Do: Programming by Demonstration. A. Cypher (eds). MIT Press, 1993, 433--444.
17. Leshed, G., Haber, E. M., Matthews, T. and Lau, T. CoScripter: automating&sharing how-to knowledge in the enterprise. In Proc. of CHI, (2008) ACM Press, 1719--1728.
18. Malone, T. W., Grant, K. R., Lai, K., Rao, R. and Rosenblitt, D. Semistructured Messages Are Surprisingly Useful for Computer-Supported Coordination. ACM Transactions on Office Information Systems, 5, 2 (1987), 115--131.
19. Myers, B., Hudson, S. E. and Pausch, R. Past, Present, and Future of User Interface Software Tools. ACM Transactions on Computer-Human Interaction, 7, 1 (2000), 3--28.
20. Nardi, B. A. A Small Matter of Programming: Perspectives on End User Computing. MIT Press, Cambridge, MA, 1993.
21. Tecuci, G., Boicu, M. and Cox, M. T. Seven Aspects of Mixed-Initiative Reasoning: An Introduction to the Special Issue on Mixed-Initiative Assistants. AI Magazine, 28, 2 (2007), 11.
22. Tomasic, A., Zimmerman, J., Hargraves, I., McMullen, R. User Constructed Data Integration via Mixed Initiative Design. In Proc. of AAAI, Spring Symposium, (2007).
23. Tuchinda, R., Szekely, P. and Knoblock, C. A. Building Data Integration Queries by Demonstration. In Proc. of IUI, (2007) ACM Press, 170--179.
24. Zimmerman, J., Forlizzi, J. and Evenson, S. Research through Design as a Method for Interaction Design Research in HCI. In Proc. of CHI, (2007) ACM Press, 493--502.
25. Zimmerman, J., Tomasic, A., Simmons, I., Hargraves, I., Mohnkern, K., Cornwell, J., McGuire, R. VIO: a Mixed-Initiative Approach to Learning and Automating Procedural Update Tasks. In Proc. of CHI, (2007), 1445--1454.
26. Zloof, M. M. QBE/OBE: A Language for Office and Business Automation. IEEE Computer, 14, 5 (1981), 13--22.

Index Terms

• Human-centered computing

  • Human computer interaction (HCI)