Trip Together: A Remote Pair Sightseeing System Supporting Gestural Communication

ABSTRACT

We present Trip Together, a remote pair sightseeing system supporting gestural communication between a user remaining indoor and a remote partner going outside. With the integration of Head-mounted Display and Depth Camera, we allow the local user to perform a gestural interaction with the remote user on top of the remote scene while each user is provided an independent free viewpoint. Using Trip Together, two side of users could get a feeling that they are truly walking outdoor together side by side for a trip. We have received positive feedback from a preliminary user study.

References

1. Chang, C.-T., Takahashi, S., and Tanaka, J. Analyzing interactions between a pair out together real and virtual. Proc. collabTech'12 (2012), 100--105.
2. Chang, C.-T., Takahashi, S., and Tanaka, J. Withyou-a communication system to provide out together feeling. In Proceedings of the International Working Conference on Advanced Visual Interfaces, ACM (2012), 320--323.
3. Chang, C.-T., Takahashi, S., and Tanaka, J. A remote communication system to provide 'Out Together Feeling'. Journal of Information Processing 22, 1 (2014), 76--87.
4. Gauglitz, S., Nuernberger, B., Turk, M., and Höllerer, T. In touch with the remote world:Remote collaboration with augmented reality drawings and virtual navigation. In Proceedings of the 20th ACM Symposium on Virtual Reality Software and Technology, ACM (2014), 197--205.
5. Gurevich, P., Lanir, J., Cohen, B., and Stone, R. Teleadvisor:a versatile augmented reality tool for remote assistance. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ACM (2012), 619--622.
6. Hunter, S. E., Maes, P., Tang, A., Inkpen, K. M., and Hessey, S. M. Waazam!:supporting creative play at a distance in customized video environments. In Proceedings of the 32nd annual ACM conference on Human factors in computing systems, ACM (2014), 1197--1206.
7. Karam, H., and Tanaka, J. Two-handed interactive menu:An application of asymmetric bimanual gestures and depth based selection techniques. In International Conference on Human Interface and the Management of Information, Springer (2014), 187--198.
8. Karam, H., and Tanaka, J. Finger click detection using a depth camera. Procedia Manufacturing 3 (2015), 5381--5388.
9. Kasahara, S., and Rekimoto, J. Jackin:integrating first-person view with out-of-body vision generation for human-human augmentation. In Proceedings of the 5th Augmented Human International Conference, ACM (2014), 46.
10. Kashiwabara, T., Osawa, H., Shinozawa, K., and Imai, M. Teroos:a wearable avatar to enhance joint activities. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ACM (2012), 2001--2004.
11. Koizumi, S., Kanda, T., Shiomi, M., Ishiguro, H., and Hagita, N. Preliminary field trial for teleoperated communication robots. In Robot and Human Interactive Communication, 2006. ROMAN 2006. The 15th IEEE International Symposium on, IEEE (2006), 145--150.
12. Ohta, S., Yukioka, T., Yamazaki, K., Yamazaki, A., Kuzuoka, H., Matsuda, H., and Shimazaki, S. Remote instruction and support using a shared-view system with head mounted display (hmd). Nihon Kyukyu Igakukai Zasshi 11, 1 (2000), 1--7.
13. Raf?e, H., Ballagas, R., Revelle, G., Horii, H., Follmer, S., Go, J., Reardon, E., Mori, K., Kaye, J., and Spasojevic, M. Family story play:reading with young children (and elmo) over a distance. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ACM (2010), 1583--1592.
14. Sodhi, R. S., Jones, B. R., Forsyth, D., Bailey, B. P., and Maciocci, G. Bethere:3d mobile collaboration with spatial input. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ACM (2013), 179--188.
15. Tecchia, F., Alem, L., and Huang, W. 3d helping hands:a gesture based mr system for remote collaboration. In Proceedings of the 11th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry, ACM (2012), 323--328.
16. Weichert, F., Bachmann, D., Rudak, B., and Fisseler, D. Analysis of the accuracy and robustness of the leap motion controller. Sensors 13, 5 (2013), 6380--6393.

Index Terms

• Computing methodologies

  • Computer graphics

    • Graphics systems and interfaces

      • Virtual reality

• Human-centered computing

  • Human computer interaction (HCI)

    • Interaction paradigms

      • Mixed / augmented reality

      • Virtual reality