skip to main content
10.1145/1785455.1785478acmotherconferencesArticle/Chapter ViewAbstractPublication PagesahConference Proceedingsconference-collections
research-article

On-line document registering and retrieving system for AR annotation overlay

Published: 02 April 2010 Publication History

Abstract

We propose a system that registers and retrieves text documents to annotate them on-line. The user registers a text document captured from a nearly top view and adds virtual annotations. When the user thereafter captures the document again, the system retrieves and displays the appropriate annotations, in real-time and at the correct location. Registering and deleting documents is done by user interaction. Our approach relies on LLAH, a hashing based method for document image retrieval. At the on-line registering stage, our system extracts keypoints from the input image and stores their descriptors computed from their neighbors. After registration, our system can quickly find the stored document corresponding to an input view by matching keypoints. From the matches, our system estimates the geometrical relationship between the camera and the document for accurately overlaying the annotations. In the experimental results, we show that our system can achieve on-line and real-time performances.

References

[1]
S. Arya, D. M. Mount, N. S. Netanyahu, R. Silverman, and A. Wu. An optimal algorithm for approximate nearest neighbor searching fixed dimensions. J. of the ACM, 45:891--923, 1998.
[2]
H. Bay, A. Ess, T. Tuytelaars, and L. V. Gool. SURF: Speeded up robust features. CVIU, 110:346--359, 2008.
[3]
M. Datar, P. Indyk, N. Immorlica, and V. S. Mirrokni. Locality-sensitive hashing scheme based on p-stable distributions. In Proc. SCG, pages 253--262, 2004.
[4]
C. Harris and M. Stephens. A combined corner and edge detector. In Proc. AVC, pages 147--151, 1988.
[5]
J. Hull, B. Erol, J. Graham, Q. Ke, H. Kishi, J. Moraleda, and D. Van Olst. Paper-based augmented reality. In Proc. ICAT, pages 205--209, 2007.
[6]
H. Kato and M. Billinghurst. Marker tracking and hmd calibration for a video-based augmented reality conferencing system. In Proc. IWAR, 1999.
[7]
V. Lepetit, J. Pilet, and P. Fua. Point matching as a classification problem for fast and robust object pose estimation. In Proc. CVPR, pages 244--250, 2004.
[8]
D. G. Lowe. Distinctive image features from scale-invariant keypoints. IJCV, 60:91--110, 2004.
[9]
T. Nakai, K. Iwata, and K. Kise. Accuracy improvement and objective evaluation of annotation extraction from printed documents. In Proc. DAS, pages 329--336, 2008.
[10]
T. Nakai, K. Iwata, and K. Kise. Real-time retrieval for images of documents in various languages using a web camera. In Proc. ICDAR, pages 146--150, 2009.
[11]
T. Nakai, K. Kise, and K. Iwata. Camera based document image retrieval with more time and memory efficient LLAH. In Proc. CBDAR, pages 21--28, 2007.
[12]
D. Nister and H. Stewenius. Scalable recognition with a vocabulary tree. In Proc. CVPR, pages 2161--2168, 2006.
[13]
E. Rosten and T. Drummond. Machine learning for high speed corner detection. In Proc. ECCV, pages 430--443, 2006.
[14]
S. Sinha, J. Frahm, M. Pollefeys, and Y. Gene. GPU-based video feature tracking and matching. In Proc. EDGE, 2006.
[15]
H. Uchiyama and H. Saito. Augmenting text document by on-line learning of local arrangement of keypoints. In Proc. ISMAR, pages 95--98, 2009.
[16]
D. Wagner, G. Reitmayr, A. Mulloni, T. Drummond, and D. Schmalstieg. Pose tracking from natural features on mobile phones. In Proc. ISMAR, pages 125--134, 2008.

Cited By

View all
  • (2016)Mobile AR live annotation for printed materialsSIGGRAPH ASIA 2016 Mobile Graphics and Interactive Applications10.1145/2999508.2999515(1-2)Online publication date: 28-Nov-2016
  • (2013)SRecProceedings of the 15th International Conference on Digital Libraries: Social Media and Community Networks - Volume 827910.1007/978-3-319-03599-4_7(53-62)Online publication date: 9-Dec-2013
  • (2011)D-NoteProceedings of the 2011 Sixth International Conference on Image and Graphics10.1109/ICIG.2011.44(963-968)Online publication date: 12-Aug-2011

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
AH '10: Proceedings of the 1st Augmented Human International Conference
April 2010
175 pages
ISBN:9781605588254
DOI:10.1145/1785455
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 April 2010

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. LLAH
  2. Poes estimation
  3. augmented reality
  4. document retrieval
  5. feature matching

Qualifiers

  • Research-article

Conference

AH '10

Acceptance Rates

AH '10 Paper Acceptance Rate 25 of 46 submissions, 54%;
Overall Acceptance Rate 121 of 306 submissions, 40%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)3
  • Downloads (Last 6 weeks)0
Reflects downloads up to 07 Mar 2025

Other Metrics

Citations

Cited By

View all
  • (2016)Mobile AR live annotation for printed materialsSIGGRAPH ASIA 2016 Mobile Graphics and Interactive Applications10.1145/2999508.2999515(1-2)Online publication date: 28-Nov-2016
  • (2013)SRecProceedings of the 15th International Conference on Digital Libraries: Social Media and Community Networks - Volume 827910.1007/978-3-319-03599-4_7(53-62)Online publication date: 9-Dec-2013
  • (2011)D-NoteProceedings of the 2011 Sixth International Conference on Image and Graphics10.1109/ICIG.2011.44(963-968)Online publication date: 12-Aug-2011

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media