skip to main content
10.1145/3139131.3139151acmconferencesArticle/Chapter ViewAbstractPublication PagesvrstConference Proceedingsconference-collections
research-article
Public Access

Exploring the effects of observed physicality conflicts on real-virtual human interaction in augmented reality

Published: 08 November 2017 Publication History

Abstract

Augmented reality (AR) enables the illusion of computer-generated virtual objects and humans co-existing with us in the real world. Virtual humans (VHs) in AR can further induce an illusion of physicality in the real world due to their form of presentation and their behavior, such as showing awareness of their surroundings. However, certain behaviors can cause a conflict that breaks this illusion, for example, when we see a VH passing through a physical object.
In this paper we describe a human-subject study that we performed to test the hypothesis that participants experience higher copresence in conflict-free circumstances, and we investigate the magnitude of this effect and behavioral manifestations. Participants perceived a social situation in a room that they shared with a VH as seen through a HoloLens head-mounted display. The behavior of the VH either caused conflicts with (occupied the same space as) physical entities, or avoided them. Our results show that the conflicts in physicality significantly reduced subjective reports of copresence. Moreover, we observed that participants were more likely to cause a conflict (occupy the same space as) virtual entities in case the VH had avoided the conflict. We discuss implications for future research and shared AR setups with real-virtual human interactions.

References

[1]
Ronald T. Azuma. 1997. A Survey of Augmented Reality. Presence: Teleoperators and Virtual Environments 6, 4 (1997), 355--385.
[2]
Ronard T. Azuma and Gary Bishop. 1994. Improving Static and Dynamic Registration in an Optical See-Through HMD. In Computer Graphics (siggraph 94 conference proceedings ed.). ACM Press, Addison-Wesley, Orlando, FL USA, 197--204.
[3]
Jeremy N. Bailenson, Jim Blascovich, Andrew C. Beall, and Jack M. Loomis. 2003. Interpersonal distance in immersive virtual environments. Personality and Social Psychology Bulletin 29, 7 (2003), 819--833.
[4]
Christoph Bartneck, Dana Kulić, Elizabeth Croft, and Susana Zoghbi. 2009. Measurement instruments for the anthropomorphism, animacy, likeability, perceived intelligence, and perceived safety of robots. International Journal of Social Robotics 1, 1 (2009), 71--81.
[5]
Cagatay Basdogan, Chih-Hao Ho, Mandayam A. Srinivasan, and Mel Slater. 2000. An experimental study on the role of touch in shared virtual environments. ACM Transactions on Computer-Human Interaction 7, 4 (2000), 443--460.
[6]
Norman Blaikie. 2003. Analysing Quantitative Data. London: Sage Publications.
[7]
Jim Blascovich. 2002. Social Influence within Immersive Virtual Environments. In The Social Life of Avatars, Ralph Schroeder (Ed.). Springer London, 127--145.
[8]
Jim Blascovich, Jack Loomis, Andrew C. Beall, Kimberly R. Swinth, Crystal L. Hoyt, and Jeremy N. Bailenson. 2002. Immersive virtual environment technology as a methodological tool for social psychology. Psychological Inquiry 13, 2 (apr 2002), 103--124.
[9]
David E. Breen, Ross T. Whitaker, Eric Rose, and Mihran Tuceryan. 1996. Interactive occlusion and automatic object placement for augmented reality. In Computer Graphics Forum, Vol. 15. Wiley Online Library, 11--22.
[10]
Changhun Chae and Kwanghee Ko. 2008. Introduction of Physics Simulation in Augmented Reality. In 2008 International Symposium on Ubiquitous Virtual Reality. 37--40.
[11]
Joon Hao Chuah, Andrew Robb, Casey White, Adam Wendling, Samsun Lampotang, Regis Kopper, and Benjamin Lok. 2013. Exploring Agent Physicality and Social Presence for Medical Team Training. Presence: Teleoperators and Virtual Environments 22, 2 (2013), 141--170.
[12]
Paul Debevec. 2005. Image-based Lighting. In Proceedings of the ACM Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH) Courses. Article 3, 26--34 pages.
[13]
Jesse Fox, Sun Joo Ahn, Joris H. Janssen, Leo Yeykelis, Kathryn Y. Segovia, and Jeremy N. Bailenson. 2014. Avatars Versus Agents: A Meta-Analysis Quantifying the Effect of Agency on Social Influence. Human-Computer Interaction 30, 5 (2014), 401--432.
[14]
Chad Harms and Frank Biocca. 2004. Internal consistency and reliability of the networked minds measure of social presence. In Seventh Annual International Presence Workshop: Presence 2004. 246--251. http://cogprints.org/7026/
[15]
Thomas Holz, Abraham G. Campbell, Gregory M.P. O'Hare, John W. Stafford, Alan Martin, and Mauro Dragone. 2011. MiRA - Mixed Reality Agents. International Journal of Human-Computer Studies 69, 4 (apr 2011), 251--268.
[16]
Thomas Holz, Mauro Dragone, and Gregory M.P. O'Hare. 2009. Where robots and virtual agents meet: A survey of social interaction research across milgram's reality-virtuality continuum. International Journal of Social Robotics 1, 1 (2009), 83--93.
[17]
Dongsik Jo, Ki-Hong Kim, and Gerard Jounghyun Kim. 2015. SpaceTime: adaptive control of the teleported avatar for improved AR tele-conference experience. Computer Animation and Virtual Worlds 26 (2015), 259--269.
[18]
Kangsoo Kim, Gerd Bruder, Divine Maloney, and Greg Welch. 2016. The Influence of Real Human Personality on Social Presence with a Virtual Human in Augmented Reality. In Proceedings of the Combined International Conference on Artificial Reality & Telexistence and Eurographics Symposium on Virtual Environments (ICAT-EGVE). 115--122.
[19]
Thomas R. Knapp. 1990. Treating ordinal scales as interval scales: An attempt to resolve the controversy. Nurs. Res. 39 (1990), 121--123.
[20]
Rensis A. Likert. 1932. A technique for the measurement of attitudes. Arch. Psychol. 22 (1932), 5--55.
[21]
Jack M. Loomis and Joshua M. Knapp. 2003. Visual Perception of Egocentric Distance in Real and Virtual Environments. In Virtual and Adaptive Environments, L. Hettinger and M. Haas (Eds.). Erlbaum, 21--46.
[22]
Nadia Magnenat-Thalmann, George Papagiannakis, and Parag Chaudhuri. 2008. Applications of Interactive Virtual Humans in Mobile Augmented Reality. In Encyclopedia of Multimedia (2nd ed.), Borko Furht (Ed.). Springer, 362--368.
[23]
Microsoft. 2017a. Fragments. http://www.microsoft.com/microsoft-hololens/en-us/apps/Fragments. (September 18 2017).
[24]
Microsoft. 2017b. Spatial Mapping (Windows Holographic). https://developer.microsoft.com/en-us/windows/holographic/spatial_mapping. (September 18 2017).
[25]
Isabel Briggs Myers. 1962. The Myers-Briggs Type Indicator: Manual. Consulting Psychologists Press, Palo Alto. ii, 110 pages. http://trove.nla.gov.au/version/25681841
[26]
Kristine Nowak. 2001. Defining and Differentiating Copresence, Social Presence and Presence as Transportation. In International Workshop on Presence. http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.19.5482
[27]
Kristine L. Nowak and Frank Biocca. 2003. The effect of the agency and anthropomorphism on users' sense of telepresence, copresence, and social presence in virtual environments. Presence: Teleoperators and Virtual Environments 12, 5 (2003), 481--494. http://www.mitpressjournals.org/doi/abs/10.1162/105474603322761289
[28]
Mohammad Obaid, Ionut Damian, Felix Kistler, Birgit Endrass, Johannes Wagner, and Elisabeth André. 2012. Cultural Behaviors of Virtual Agents in an Augmented Reality Environment. In International Conference on Intelligent Virtual Agents (Lecture Notes in Computer Science), Yukiko Nakano, Michael Neff, Ana Paiva, and Marilyn Walker (Eds.), Vol. 7502. Springer Berlin Heidelberg, 412--418.
[29]
Mohammad Obaid, Radoslaw Niewiadomski, and Catherine Pelachaud. 2011. Perception of Spatial Relations and of Coexistence with Virtual Agents. In International Conference on Intelligent Virtual Agents, HannesHögni Vilhjálmsson, Stefan Kopp, Stacy Marsella, and KristinnR. Thórisson (Eds.). Lecture Notes in Computer Science, Vol. 6895. Springer Berlin Heidelberg, 363--369.
[30]
Tomislav Pejsa, Julian Kantor, Hrvoje Benko, Eyal Ofek, and Andrew Wilson. 2016. Room2Room: Enabling Life-Size Telepresence in a Projected Augmented Reality Environment. In Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing. ACM, 1716--1725.
[31]
Mel Slater. 2009. Place Illusion and Plausibility can Lead to Realistic Behaviour in Immersive Virtual Environments. Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences 364, 1535 (dec 2009), 3549--3557.
[32]
Rémy Torre, Pascal Fua, Selim Balcisoy, Michal Ponder, and Daniel Thalmann. 2000. Interaction Between Real and Virtual Humans: Playing Checkers. In Virtual Environments (Eurographics Workshop). 23--32.

Cited By

View all
  • (2024)Frankenstein's Monster in the Metaverse: User Interaction With Customized Virtual AgentsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.345620530:11(7162-7171)Online publication date: Nov-2024
  • (2024)Visual Guidance for User Placement in Avatar-Mediated Telepresence Between Dissimilar SpacesIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.335425630:12(7558-7570)Online publication date: Dec-2024
  • (2023)Ubi-TOUCH: Ubiquitous Tangible Object Utilization through Consistent Hand-object interaction in Augmented RealityProceedings of the 36th Annual ACM Symposium on User Interface Software and Technology10.1145/3586183.3606793(1-18)Online publication date: 29-Oct-2023
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
VRST '17: Proceedings of the 23rd ACM Symposium on Virtual Reality Software and Technology
November 2017
437 pages
ISBN:9781450355483
DOI:10.1145/3139131
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 November 2017

Permissions

Request permissions for this article.

Check for updates

Badges

  • Best Student Paper

Author Tags

  1. augmented reality
  2. copresence
  3. physicality
  4. virtual humans

Qualifiers

  • Research-article

Funding Sources

Conference

VRST '17

Acceptance Rates

Overall Acceptance Rate 66 of 254 submissions, 26%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)228
  • Downloads (Last 6 weeks)34
Reflects downloads up to 19 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Frankenstein's Monster in the Metaverse: User Interaction With Customized Virtual AgentsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.345620530:11(7162-7171)Online publication date: Nov-2024
  • (2024)Visual Guidance for User Placement in Avatar-Mediated Telepresence Between Dissimilar SpacesIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.335425630:12(7558-7570)Online publication date: Dec-2024
  • (2023)Ubi-TOUCH: Ubiquitous Tangible Object Utilization through Consistent Hand-object interaction in Augmented RealityProceedings of the 36th Annual ACM Symposium on User Interface Software and Technology10.1145/3586183.3606793(1-18)Online publication date: 29-Oct-2023
  • (2023)Crossing Reality: Comparing Physical and Virtual Robot DeixisProceedings of the 2023 ACM/IEEE International Conference on Human-Robot Interaction10.1145/3568162.3576972(152-161)Online publication date: 13-Mar-2023
  • (2023)Design of Traditional Cultural Experiences Using Augmented Reality Based on Environmental PresenceIEEE Transactions on Human-Machine Systems10.1109/THMS.2022.323213353:2(390-400)Online publication date: Apr-2023
  • (2023)Investigating Psychological Ownership in a Shared AR Space: Effects of Human and Object Reality and Object Controllability2023 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)10.1109/ISMAR59233.2023.00102(869-874)Online publication date: 16-Oct-2023
  • (2023)The Effects of Physical Coherence Factors on Presence in Extended Reality (XR)International Journal of Human-Computer Studies10.1016/j.ijhcs.2022.102994172(102994)Online publication date: Apr-2023
  • (2022)The Potential of AR Solutions for Behavioral Learning: A Scoping ReviewComputers10.3390/computers1106008711:6(87)Online publication date: 30-May-2022
  • (2022)The Impact of Varying Resolution and Motion Realism of Avatars in Augmented Reality-Supported, Virtually Co-located Sales ConsultationsProceedings of Mensch und Computer 202210.1145/3543758.3543772(255-264)Online publication date: 4-Sep-2022
  • (2021)CIRO: The Effects of Visually Diminished Real Objects on Human Perception in Handheld Augmented RealityElectronics10.3390/electronics1008090010:8(900)Online publication date: 9-Apr-2021
  • Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Login options

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media