Article

Direct pointer: direct manipulation for large-display interaction using handheld cameras

Authors:

Hao Jiang,

Eyal Ofek,

Neema Moraveji,

Yuanchun ShiAuthors Info & Claims

CHI '06: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Pages 1107 - 1110

https://doi.org/10.1145/1124772.1124937

Published: 22 April 2006 Publication History

Get Access

Abstract

This paper describes the design and evaluation of a technique, Direct Pointer, that enables users to interact intuitively with large displays using cameras equipped on handheld devices, such as mobile phones and personal digital assistant (PDA). In contrast to many existing interaction methods that attempt to address the same problem, ours offers direct manipulation of the pointer position with continuous visual feedback. The primary advantage of this technique is that it only requires equipment that is readily available: an electronic display, a handheld digital camera, and a connection between the two. No special visual markers in the display content are needed, nor are fixed cameras pointing at the display. We evaluated the performance of Direct Pointer as an interaction product, showing that it performs as well as comparable techniques that require more sophisticated equipment.

References

[1]

Ballagas, R., Rohs, M. and Sheridan, J.G. Sweep and Point & Shoot: Phonecam-Based Interactions for Large Public Displays. Proc CHI'05, (2005).

Digital Library

Google Scholar

[2]

ISO. Ergonomic requirements for office work with visual display terminals (VDTs) - Requirements for non-keyboard input devices. ISO 9241-9, (2000).

Google Scholar

[3]

MacKenzie, I.S. and Jusoh, S. An Evaluation of Two InputDevices for Remote Pointing. Proc EHCI'01, (2001).

Digital Library

Google Scholar

[4]

MacKenzie, I.S., Kauppinen, T. and Silfverberg, M. Accuracy Measures for Evaluating Computer Pointing Devices. Proc CHI'01, (2001).

Digital Library

Google Scholar

[5]

Miyaoku, K., Higashino, S. and Tonomura, Y. C-Blink: A Hue-Difference-Based Light Signal Marker for Large Screen Interaction via Any Mobile Terminal. Proc UIST'04, (2004).

Digital Library

Google Scholar

[6]

Oh, J.-Y. and Stuerzlinger, W. Laser Pointers as Collaborative Pointing Devices. Proc Graphics Interface'02, (2002).

Google Scholar

[7]

Olsen, D.R.J. and Nielsen, T. Laser Pointer Interaction. Proc CHI'01, (2001).

Digital Library

Google Scholar

[8]

Shi, J. and Tomasi, C. Good Features to Track. Proc CVPR'94, pages 593--600, (1994).

Google Scholar

[9]

Sukthankar, R., Stockton, R. and Mullin, P. Smarter Presentations: Exploiting Homography in Camera-Projector Systems. Proc ICCV'01, (2001).

Crossref

Google Scholar

[10]

Xiang, C. and Ravin, B. VisionWand: Interaction Techniques for Large Displays using a Passive Wand Tracked in 3D. Proc UIST'03, (2003).

Digital Library

Google Scholar

Cited By

View all

Shi YYi XLiang CQin YWang YYan YCheng ZZhu PZhang SLi YLiu YWang XChen JZhou WWang YZhao DDu F(2024)HCI Research and Innovation in China: A 10-Year PerspectiveInternational Journal of Human–Computer Interaction10.1080/10447318.2024.232385840:8(1799-1831)Online publication date: 22-Mar-2024
https://doi.org/10.1080/10447318.2024.2323858
Almuuhtadi J(2024)Smartphones-Based Efficient Multi-point InteractionProceedings of Ninth International Congress on Information and Communication Technology10.1007/978-981-97-3556-3_31(381-395)Online publication date: 10-Aug-2024
https://doi.org/10.1007/978-981-97-3556-3_31
Ullah ADelamare WHasan K(2023)Exploring Users Pointing Performance on Large Displays with Different Curvatures in Virtual RealityIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.332024229:11(4535-4545)Online publication date: 1-Nov-2023
https://dl.acm.org/doi/10.1109/TVCG.2023.3320242
Show More Cited By

Index Terms

Direct pointer: direct manipulation for large-display interaction using handheld cameras
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Interaction with large ubiquitous displays using camera-equipped mobile phones

In the ubiquitous computing environment, people will interact with everyday objects (or computers embedded in them) in ways different from the usual and familiar desktop user interface. One such typical situation is interacting with applications through ...
Direct and indirect multi-touch interaction on a wall display
IHM '14: Proceedings of the 26th Conference on l'Interaction Homme-Machine

Multi-touch wall displays allow to take advantage of co-located interaction (direct interaction) on very large surfaces. However interacting with content beyond arms' reach requires body movements, introducing fatigue and impacting performance. ...
Ubi-Jector: an information-sharing screen in a casual meeting environment using mobile devices
CHI EA '13: CHI '13 Extended Abstracts on Human Factors in Computing Systems

We propose a system called Ubi-Jector, which provides a shared information screen utilizing participants' personal mobile devices in casual meeting places. This system can successfully substitute for a large projector screen in most conventional meeting ...

Comments

Information & Contributors

Information

Published In

CHI '06: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

April 2006

1353 pages

ISBN:1595933727

DOI:10.1145/1124772

Editors:
Rebecca Grinter
Georgia Institute of Technology, USA
,
Thomas Rodden
University of Nottingham, UK
,
Paul Aoki
Intel, USA
,
Ed Cutrell
Microsoft, USA
,
Robin Jeffries
Google, USA
,
Gary Olson
University of Michigan, USA

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 22 April 2006

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

CHI06

Sponsor:

CHI06: CHI 2006 Conference on Human Factors in Computing Systems

April 22 - 27, 2006

Québec, Montréal, Canada

Acceptance Rates

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

26
Total Citations
View Citations
1,199
Total Downloads

Downloads (Last 12 months)14
Downloads (Last 6 weeks)0

Reflects downloads up to 07 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Shi YYi XLiang CQin YWang YYan YCheng ZZhu PZhang SLi YLiu YWang XChen JZhou WWang YZhao DDu F(2024)HCI Research and Innovation in China: A 10-Year PerspectiveInternational Journal of Human–Computer Interaction10.1080/10447318.2024.232385840:8(1799-1831)Online publication date: 22-Mar-2024
https://doi.org/10.1080/10447318.2024.2323858
Almuuhtadi J(2024)Smartphones-Based Efficient Multi-point InteractionProceedings of Ninth International Congress on Information and Communication Technology10.1007/978-981-97-3556-3_31(381-395)Online publication date: 10-Aug-2024
https://doi.org/10.1007/978-981-97-3556-3_31
Ullah ADelamare WHasan K(2023)Exploring Users Pointing Performance on Large Displays with Different Curvatures in Virtual RealityIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.332024229:11(4535-4545)Online publication date: 1-Nov-2023
https://dl.acm.org/doi/10.1109/TVCG.2023.3320242
Babic TReiterer HHaller M(2022)Understanding and Creating Spatial Interactions with Distant Displays Enabled by Unmodified Off-The-Shelf SmartphonesMultimodal Technologies and Interaction10.3390/mti61000946:10(94)Online publication date: 19-Oct-2022
https://doi.org/10.3390/mti6100094
Thakur SUrs MIbrahim MSidenko AMajumder A(2022)Ambient Light Tolerant Laser-Pen Based Interaction with Curved Multi-projector DisplaysHuman-Computer Interaction. Technological Innovation10.1007/978-3-031-05409-9_14(180-194)Online publication date: 16-Jun-2022
https://doi.org/10.1007/978-3-031-05409-9_14
Mayer SSchwind VSchweigert RHenze NMandryk RHancock MPerry MCox A(2018)The Effect of Offset Correction and Cursor on Mid-Air Pointing in Real and Virtual EnvironmentsProceedings of the 2018 CHI Conference on Human Factors in Computing Systems10.1145/3173574.3174227(1-13)Online publication date: 21-Apr-2018
https://dl.acm.org/doi/10.1145/3173574.3174227
Cogerino CRosso GBosi IFrisiello ABazzani M(2017)Multi-modal input devices for active and healthy ageing2017 25th International Conference on Software, Telecommunications and Computer Networks (SoftCOM)10.23919/SOFTCOM.2017.8115562(1-5)Online publication date: Sep-2017
https://doi.org/10.23919/SOFTCOM.2017.8115562
Robinson SPearson JJones M(2016)PosterPointingProceedings of the First African Conference on Human Computer Interaction10.1145/2998581.2998594(170-175)Online publication date: 21-Nov-2016
https://dl.acm.org/doi/10.1145/2998581.2998594
Scherfgen DHerpers RSaitov T(2015)A robust inside-out approach for 3D interaction with large displays2015 IEEE Symposium on 3D User Interfaces (3DUI)10.1109/3DUI.2015.7131739(137-140)Online publication date: Mar-2015
https://doi.org/10.1109/3DUI.2015.7131739
Xu LFang YWang KLi JBabaguchi NAizawa KSmith JSatoh SPlagemann THua XYan R(2012)Plug&touchProceedings of the 20th ACM international conference on Multimedia10.1145/2393347.2396412(1177-1180)Online publication date: 29-Oct-2012
https://dl.acm.org/doi/10.1145/2393347.2396412
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Index Terms

Recommendations

Interaction with large ubiquitous displays using camera-equipped mobile phones

Direct and indirect multi-touch interaction on a wall display

Ubi-Jector: an information-sharing screen in a casual meeting environment using mobile devices

Comments

Information

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Upcoming Conference

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations