skip to main content
10.1145/2522848.2522869acmconferencesArticle/Chapter ViewAbstractPublication Pagesicmi-mlmiConference Proceedingsconference-collections
research-article

Comparing task-based and socially intelligent behaviour in a robot bartender

Published: 09 December 2013 Publication History

Abstract

We address the question of whether service robots that interact with humans in public spaces must express socially appropriate behaviour. To do so, we implemented a robot bartender which is able to take drink orders from humans and serve drinks to them. By using a high-level automated planner, we explore two different robot interaction styles: in the task only setting, the robot simply fulfils its goal of asking customers for drink orders and serving them drinks; in the socially intelligent setting, the robot additionally acts in a manner socially appropriate to the bartender scenario, based on the behaviour of humans observed in natural bar interactions. The results of a user study show that the interactions with the socially intelligent robot were somewhat more efficient, but the two implemented behaviour settings had only a small influence on the subjective ratings. However, there were objective factors that influenced participant ratings: the overall duration of the interaction had a positive influence on the ratings, while the number of system order requests had a negative influence. We also found a cultural difference: German participants gave the system higher pre-test ratings than participants who interacted in English, although the post-test scores were similar.

References

[1]
W. Bainbridge, J. Hart, E. Kim, and B. Scassellati. The benefits of interactions with physically present robots over video-displayed agents. International Journal of Social Robotics, 3: 41--52, 2011.
[2]
H. Baltzakis, M. Pateraki, and P. Trahanias. Visual tracking of hands, faces and facial features of multiple persons. Machine Vision and Applications, 23 (6): 1141--1157, 2012.
[3]
C. Bartneck, D. Kulić, E. Croft, and S. Zoghbi. Measurement instruments for the anthropomorphism, animacy, likeability, perceived intelligence, and perceived safety of robots. International Journal of Social Robotics, 1: 71--81, 2009.
[4]
D. Bohus and E. Horvitz. Dialog in the open world: platform and applications. In Proceedings of ICMI-MLMI 2009, pages 31--38, 2009.
[5]
C. Breazeal. Socially intelligent robots. phinteractions, 12 (2): 19--22, 2005.
[6]
G. Castellano, I. Leite, A. Pereira, C. Martinho, A. Paiva, and P. W. McOwan. Affect recognition for interactive companions: challenges and design in real world scenarios. Journal on Multimodal User Interfaces, 3 (1): 89--98, 2010.
[7]
K. Dautenhahn. Socially intelligent robots: dimensions of human-robot interaction. Philosophical Transactions of the Royal Society B: Biological Sciences, 362 (1480): 679--704, 2007.
[8]
D. M. Dimitrov and P. D. Rumrill, Jr. Pretest-posttest designs and measurement of change. Work: A Journal of Prevention, Assessment and Rehabilitation, 20 (2): 159--165, 2003.
[9]
R. E. Fikes and N. J. Nilsson. STRIPS: A new approach to the application of theorem proving to problem solving. Artificial Intelligence, 2: 189--208, 1971.
[10]
M. E. Foster, A. Gaschler, M. Giuliani, A. Isard, M. Pateraki, and R. P. A. Petrick. Two people walk into a bar: Dynamic multi-party social interaction with a robot agent. In Proceedings of ICMI 2012, pages 3--10, 2012.
[11]
M. E. Foster, A. Gaschler, and M. Giuliani. How can I help you? comparing engagement classification strategies for a robot bartender. In Proceedings of ICMI 2013, 2013.
[12]
M. W. Gallagher, S. J. Lopez, and S. D. Pressman. Optimism is universal: Exploring the presence and benefits of optimism in a representative sample of the world. Journal of Personality, 2013.
[13]
A. Gaschler, R. P. A. Petrick, M. Giuliani, M. Rickert, and A. Knoll. KVP: A knowledge of volumes approach to robot task planning. In Proceedings of IROS 2013, 2013.
[14]
S. S. Ge and M. J. Matarić. Preface. International Journal of Social Robotics, 1 (1): 1--2, 2009.
[15]
E. C. Grigore, K. Eder, A. Lenz, S. Skachek, A. G. Pipe, and C. Melhuish. Towards safe human-robot interaction. In Towards Autonomous Robotic Systems, pages 323--335. Springer, 2011.
[16]
K. Huth, S. Loth, and J. De Ruiter. Insights from the bar: A model of interaction. In Proceedings of Formal and Computational Approaches to Multimodal Communication, August 2012.
[17]
D. Limbu, Y. Tan, C. Wong, R. Jiang, H. Wu, L. Li, E. Kah, X. Yu, D. Li, and H. Li. Experiences with a barista robot, FusionBot. Progress in Robotics, pages 140--151, 2009.
[18]
E. Márquez Segura, M. Kriegel, R. Aylett, A. Deshmukh, and H. Cramer. How do you like me in this: User embodiment preferences for companion agents. In Proceedings of IVA 2012, 2012.
[19]
T. Masuda and D. Misaki. Development of Japanese green tea serving robot "T-Bartender". In Proceedings of ICMA 2005, volume 2, pages 1069--1074, 2005.
[20]
Y. Matsusaka, T. Tojo, and T. Kobayashi. Conversation robot participating in group conversation. IEICE Transactions on Information and Systems, 86 (1): 26--36, 2003.
[21]
Global Industry Analysts Inc. Service robotics -- a global market report, 2010. http://www.strategyr.com/Service_Robotics_Market_Report.asp.
[22]
International Federation of Robotics. Service robot statistics, 2012. http://www.ifr.org/service-robots/statistics/.
[23]
B. Mutlu, T. Shiwa, T. Kanda, H. Ishiguro, and N. Hagita. Footing in human-robot conversations: how robots might shape participant roles using gaze cues. In Proceedings of HRI 2009, pages 61--68, 2009.
[24]
M. Pateraki, M. Sigalas, G. Chliveros, and P. Trahanias. Visual human-robot communication in social settings. In Proceedings of ICRA Workshop on Semantics, Identification and Control of Robot-Human-Environment Interaction, 2013.
[25]
R. P. A. Petrick and F. Bacchus. A knowledge-based approach to planning with incomplete information and sensing. In Proceedings of AIPS 2002, pages 212--221, 2002.
[26]
R. P. A. Petrick and F. Bacchus. Extending the knowledge-based approach to planning with incomplete information and sensing. In Proceedings of ICAPS 2004, pages 2--11, 2004.
[27]
R. P. A. Petrick and M. E. Foster. Planning for social interaction in a robot bartender domain. In Proceedings of ICAPS 2013, Special Track on Novel Applications, pages 389--397, 2013.
[28]
R. P. A. Petrick, M. E. Foster, and A. Isard. Social state recognition and knowledge-level planning for human-robot interaction in a bartender domain. In Proceedings of the AAAI 2012 Workshop on Grounding Language for Physical Systems, pages 32--38, 2012.
[29]
M. Rickert. Efficient Motion Planning for Intuitive Task Execution in Modular Manipulation Systems. Dissertation, Technische Universit\"at München, 2011.
[30]
V. Rieser and O. Lemon. Comparing reinforcement and supervised learning of dialogue policies with real users. In Reinforcement Learning for Adaptive Dialogue Systems, pages 167--188. Springer, 2011.
[31]
M. Sigalas, H. Baltzakis, and P. Trahanias. Visual tracking of independently moving body and arms. In Proceedings of IROS 2009, pages 3005--3010, 2009.
[32]
E. Torta, J. Heumen, R. Cuijpers, and J. Juola. How can a robot attract the attention of its human partner? a comparative study over different modalities for attracting attention. In Social Robotics, pages 288--297. Springer, 2012.
[33]
P. Viola and M. Jones. Robust real-time face detection. International Journal of Computer Vision, 57 (2): 137--154, 2004.
[34]
M. Walker, C. Kamm, and D. Litman. Towards developing general models of usability with PARADISE. Natural Language Engineering, 6 (3&4): 363--377, 2000.
[35]
M. White. Efficient realization of coordinate structures in Combinatory Categorial Grammar. Research on Language and Computation, 4 (1): 39--75, 2006.
[36]
T. Wosch, W. Neubauer, G. Wichert, and Z. Kemény. Robot motion control for assistance tasks. In Proceedings of IEEE RO-MAN 2002, pages 524--529, 2002.

Cited By

View all
  • (2025)Benefits, Challenges, and Opportunities for Empathetic Social Assistance Robots in Hospitals: An Acceptability StudyInternational Journal of Social Robotics10.1007/s12369-024-01203-417:1(73-85)Online publication date: 23-Jan-2025
  • (2024)Sustainability in tourism and hospitality: Artificial intelligence role in eco-friendly practices in Indian hotelsJournal of Tourism Theory and Research10.24288/jttr.152397610:2(46-56)Online publication date: 30-Sep-2024
  • (2024)Let’s Get Physical: The Influence of Embodiment on Industrial Human-Robot InteractionProceedings of the Human Factors and Ergonomics Society Annual Meeting10.1177/1071181324126420668:1(437-443)Online publication date: 12-Aug-2024
  • Show More Cited By

Index Terms

  1. Comparing task-based and socially intelligent behaviour in a robot bartender

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    ICMI '13: Proceedings of the 15th ACM on International conference on multimodal interaction
    December 2013
    630 pages
    ISBN:9781450321297
    DOI:10.1145/2522848
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 09 December 2013

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. multi-party interaction
    2. social robotics

    Qualifiers

    • Research-article

    Conference

    ICMI '13
    Sponsor:

    Acceptance Rates

    ICMI '13 Paper Acceptance Rate 49 of 133 submissions, 37%;
    Overall Acceptance Rate 453 of 1,080 submissions, 42%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)93
    • Downloads (Last 6 weeks)9
    Reflects downloads up to 20 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2025)Benefits, Challenges, and Opportunities for Empathetic Social Assistance Robots in Hospitals: An Acceptability StudyInternational Journal of Social Robotics10.1007/s12369-024-01203-417:1(73-85)Online publication date: 23-Jan-2025
    • (2024)Sustainability in tourism and hospitality: Artificial intelligence role in eco-friendly practices in Indian hotelsJournal of Tourism Theory and Research10.24288/jttr.152397610:2(46-56)Online publication date: 30-Sep-2024
    • (2024)Let’s Get Physical: The Influence of Embodiment on Industrial Human-Robot InteractionProceedings of the Human Factors and Ergonomics Society Annual Meeting10.1177/1071181324126420668:1(437-443)Online publication date: 12-Aug-2024
    • (2024)Perceived Intelligence in Human-Robot Interaction: A ReviewIEEE Access10.1109/ACCESS.2024.347875112(151348-151359)Online publication date: 2024
    • (2023)Robotization and Smart Technologies in the Hospitality IndustryHandbook of Research on Innovation, Differentiation, and New Technologies in Tourism, Hotels, and Food Service10.4018/978-1-6684-6985-9.ch001(1-31)Online publication date: 30-Jun-2023
    • (2023)A Theoretical Approach to Designing Interactive Robots, Using Restaurant Assistants as an Example2023 20th International Conference on Ubiquitous Robots (UR)10.1109/UR57808.2023.10202555(980-985)Online publication date: 25-Jun-2023
    • (2023)Towards socially-competent and culturally-adaptive artificial agentsInteraction Studies. Social Behaviour and Communication in Biological and Artificial SystemsInteraction Studies / Social Behaviour and Communication in Biological and Artificial SystemsInteraction Studies10.1075/is.22021.bas23:3(469-512)Online publication date: 21-Apr-2023
    • (2023)Godspeed Questionnaire Series: Translations and UsageInternational Handbook of Behavioral Health Assessment10.1007/978-3-030-89738-3_24-1(1-35)Online publication date: 2-Feb-2023
    • (2022)Moving away from robotic interactions: Evaluation of empathy, emotion and sentiment expressed and detected by computer systems2022 31st IEEE International Conference on Robot and Human Interactive Communication (RO-MAN)10.1109/RO-MAN53752.2022.9900559(1365-1370)Online publication date: 29-Aug-2022
    • (2022)Human-Like Robots and the Uncanny ValleyZeitschrift für Psychologie10.1027/2151-2604/a000486230:1(33-46)Online publication date: Jan-2022
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media