skip to main content
10.1145/1255047.1255068acmconferencesArticle/Chapter ViewAbstractPublication PagesesemConference Proceedingsconference-collections
Article

VisiCon: a robot control interface for visualizing manipulation using a handheld projector

Published: 13 June 2007 Publication History

Abstract

The miniaturization of image projectors leads to the expectation that projectors could be embedded in mobile devices such as cellular phones and PDAs. A projector mounted on a mobile device, freely movable in 3D space under user control, could operate not only as an output device but also as an input device for enabling humans to manipulate mobile robots. We therefore explore the possibilities of human-robot interaction techniques using handheld projectors. For this purpose, we propose an innovative interface called VisiCon. We have also developed a cooperative game, CoGAME, in which players guide a simple robot using handheld projectors. In this game, users can connect projected maps together, and cooperatively lead a robot to a specified goal. In this paper, we explain the techniques used in CoGAME, and present an evaluation.

References

[1]
P. Beardsley, J. Baar, R. Raskar, and C. Forlines. Interaction using a handheld projector. IEEE Computer Graphics and Applications, 25(1):39--43, 2005.
[2]
R. Bischoff and A. Kazi. Perspectives on augmented reality based human-robot interaction with industrial robots. In Intelligent Robots and Systems, volume 4, pages 3226--3231, 2004.
[3]
G. Blaskó, F. Coriand, and S. Feiner. Exploring interaction with a simulated wrist-worn projection display. In The 9th IEEE International Symposium on Wearable Computers (ISWC 2005), pages 2--9, 2005.
[4]
X. Cao and R. Balakrishnan. Interacting with dynamically defined information spaces using a handheld projector and a pen. In The annual ACM symposium on User interface software and technology, pages 225--234, 2006.
[5]
T. H. J. Collett and B. A. MacDonald. Developer oriented visualisation of a robot program. In the 1st ACM SIGCHI/SIGART conference on Human-robot interaction, pages 49--56, 2005.
[6]
M. Dragone, T. Holz, and G. M. ÓHare. Mixing robotic realities. In the 11th international conference on Intelligent user interfaces, pages 261--263, 2006.
[7]
C. Forlines, R. Balakrishnan, P. Beardsley, J. Baar, and R. Raskar. Zoom-and-pick: facilitating visual zooming and precision pointing with interactive handheld projectors. In The 18th annual ACM symposium on User interface software and technology, pages 73--82, 2005.
[8]
H. Kato and M. Billinghurst. Artoolkit. http://www.hitl.washington.edu/artoolkit/.
[9]
M. Kojima, M. Sugimoto, A. Nakamura, M.Tomita, H.Nii, and M.Inami. An augmented game environment with small vehicles. In First IEEE International Workshop on Horizontal Interactive Human-Computer Systems, pages 3--8, 2006.
[10]
K. Miyahara, H. Inoue, Y. Tsunesada, and M. Sugimoto. Intuitive manipulation techniques for projected displays of mobile devices. In ACM CHI2005 Extended Abstract, pages 1881--1884, 2005.
[11]
S. Rapp, G. Michelitsch, M. Osen, J. Williams, M. Barbish, R. Bohan, Z. Valsan, and M. Emel. Spotlight navigation; interaction with a handheld projection device. In International Conference on Pervasive Computing, Video paper, 2004.
[12]
Raskar and P. Beardsley. A self-correcting projector. In IEEE Computer Society Conference on Computer Vision and Pattern Recognition(CVPR), pages 504--508, 2001.
[13]
R. Raskar, P. Beardsley, Jvan Baar, Y. Wang, P. Dietz, J. Lee, D. Leigh, and T. Willwacher. Rfig lamps: Interacting with a self-describing world via photosensing wireless tags and projectors. ACM Transactions on Graphics (TOG), 23(3):406--415, 2004.
[14]
R. Raskar, Jvan Baar, P. Beardsley, T. Willwacher, S. Rao, and C. Forlines. ilamps: Geometrically aware and self-configuring projectors. ACM Transactions on Graphics (TOG), 22(3):809--818, 2003.
[15]
Shoji, KMiura, and AKonno. U-tsu-shi-o-mi:the virtual humanoid you can reach. In SIGGRAPH2006 Emerging Technologies, July 2006.
[16]
Siemens. Cell phone with builtin projector. www.physorg.com/news3505.html.
[17]
Sugimoto, K. Hosoi, and H. Hashizume. Caretta: A system for supporting face-to-face collaboration by integrating personal and shared spaces. In CHI2004, pages 41--48, 2004.
[18]
M. Sugimoto, M. Kojima, A. Nakamura, G. Kagotani, H. Nii, and M. Inami. Augmented coliseum: Display-based computing for augmented reality inspiration computing robot. In SIGGRAPH 2005 Full Conference DVD-ROM Disk1 Emerging Technologies, 2005.
[19]
M. Sugimoto, K. Miyahara, H. Inoue, and Y. Tsunesada. Hotaru: Intuitive manipulation techniques for projected displays of mobile devices. In Tenth IFIP TC13 International Conference on Human-Computer Interaction (INTERACT2005), pages 57--68, 2005.
[20]
J. Summet and R. Sunkthankar. Tracking locations of moving hand-held displays using projected light. In Pervasive, pages 37--46, 2005.
[21]
Toshiba. Tdp-ff1a(j), 2006. http://www.toshiba.co.jp/vis/lineup/portable/ff1/index.html.
[22]
M. Xin and E. Sharlin. Sheep and wolves: test bed for human-robot interaction. In CHI Extended Abstracts, pages 1553--1558, 2006.

Cited By

View all
  • (2022)Requirements for the Interaction With Highly Automated Construction Site Delivery TrucksFrontiers in Human Dynamics10.3389/fhumd.2022.7948904Online publication date: 18-Feb-2022
  • (2020)MarioControl: An Intuitive Control Method for a Mobile Robot from a Third-Person PerspectiveCompanion Proceedings of the 2020 Conference on Interactive Surfaces and Spaces10.1145/3380867.3426205(9-13)Online publication date: 8-Nov-2020
  • (2019)NavigaTorch: Projection-based Robot Control Interface using High-speed Handheld ProjectorSIGGRAPH Asia 2019 Emerging Technologies10.1145/3355049.3360538(31-33)Online publication date: 17-Nov-2019
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
ACE '07: Proceedings of the international conference on Advances in computer entertainment technology
June 2007
324 pages
ISBN:9781595936400
DOI:10.1145/1255047
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 June 2007

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. augmented reality
  2. human-robot interaction
  3. manipulation by projection

Qualifiers

  • Article

Conference

ACE2007
Sponsor:

Acceptance Rates

Overall Acceptance Rate 36 of 90 submissions, 40%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)7
  • Downloads (Last 6 weeks)1
Reflects downloads up to 12 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2022)Requirements for the Interaction With Highly Automated Construction Site Delivery TrucksFrontiers in Human Dynamics10.3389/fhumd.2022.7948904Online publication date: 18-Feb-2022
  • (2020)MarioControl: An Intuitive Control Method for a Mobile Robot from a Third-Person PerspectiveCompanion Proceedings of the 2020 Conference on Interactive Surfaces and Spaces10.1145/3380867.3426205(9-13)Online publication date: 8-Nov-2020
  • (2019)NavigaTorch: Projection-based Robot Control Interface using High-speed Handheld ProjectorSIGGRAPH Asia 2019 Emerging Technologies10.1145/3355049.3360538(31-33)Online publication date: 17-Nov-2019
  • (2018)Phygital Field: An Integrated Field with Physical Robots and Digital Images Using Projection-Based Localization and Control MethodSICE Journal of Control, Measurement, and System Integration10.9746/jcmsi.11.30211:4(302-311)Online publication date: 2018
  • (2018)Projection-based Localization and Control Method of Robot Swarms for Swarm User InterfacesProceedings of the 2018 ACM International Joint Conference and 2018 International Symposium on Pervasive and Ubiquitous Computing and Wearable Computers10.1145/3267305.3267307(584-589)Online publication date: 8-Oct-2018
  • (2016)Data-Driven Kinematic Control for Robotic Spatial Augmented Reality System with Loose Kinematic SpecificationsETRI Journal10.4218/etrij.16.0115.061038:2(337-346)Online publication date: 1-Apr-2016
  • (2014)Image-Projecting Desktop Arm Trainer for Hand-Eye Coordination TrainingJournal of Robotics and Mechatronics10.20965/jrm.2014.p070426:6(704-717)Online publication date: 20-Dec-2014
  • (2014)Intuitive Robot Control with a Projected Touch InterfaceSocial Robotics10.1007/978-3-319-11973-1_10(95-104)Online publication date: 2014
  • (2012)PICOntrolProceedings of the 25th annual ACM symposium on User interface software and technology10.1145/2380116.2380166(379-388)Online publication date: 7-Oct-2012
  • (2012)Personal Projectors for Pervasive ComputingIEEE Pervasive Computing10.1109/MPRV.2011.1711:2(30-37)Online publication date: 1-Apr-2012
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media