skip to main content
10.1145/1347390.1347414acmotherconferencesArticle/Chapter ViewAbstractPublication PagesteiConference Proceedingsconference-collections
research-article

Turning a page on the digital annotation of physical books

Published: 18 February 2008 Publication History

Abstract

The Graphical User Interface (GUI) has created an efficient work environment for many applications. However, when users are confined by keyboards and mice, they lose the ability to interact with the virtual world using habits from the real world. Our research examine how emerging modes of authorship, such as wikis, can be used to generate new possibilities for bringing atoms and bits together for digital annotation. Our goal is to combine the everyday habits in reading books with emerging digital possibilities.
In this paper, we present a prototype system called WikiTUI, which brings digital media to physical paper books. This system allows readers to access the digital world through fingertip interactions on books, and enables them to share information with other readers using wiki technology. WikiTUI not only bridges the gap between the digital and the physical worlds, but also facilitates multiple contributions to a reference base spanning across these worlds. We present user evaluations of the WikiTUI prototype and discuss research implications.

References

[1]
Ahmad, S., A Usable Real-Time 3D Hand Tracker. IEEE Asilomar Conf. 1994, (1994), 1257--1261.
[2]
Anderson, K. M., Taylor, R. N., and Whitehead, E. J. Chimera: hypermedia for heterogeneous software development environments. ACM Trans. Inf. Syst. 18, 3 ACM Press (2000), 211--245.
[3]
Ashdown, M. and Robinson, P. Escritoire: a personal projected display. Multimedia, IEEE 12, 1, IEEE CS Press (2005), 34--42.
[4]
Back, M. J. and Cohen, J. Page detection using embedded tags. Proc. UIST 2000, ACM Press (2000), 159--160.
[5]
Bobick, A. F., Wilson, A. D. A State-Based Approach to the Representation and Recognition of Gesture. IEEE Transactions on Pattern Analysis and Machine Intelligence 19, 12, (1997), 1325--1337.
[6]
Bolter, J. D., Writing space: the computer, hypertext, and the history of writing. Lawrence Erlbaum Associates, Inc., Mahwah, NJ, USA, 1991
[7]
Bush, V. As we may think. Interactions 3, 2 (1996), 35--46.
[8]
Davis, J. and Shah, M. Visual gesture recognition. Vision, Image and Signal Processing 141, 2, (1994), 101--106.
[9]
Doug Engelbart 1968 Demo. http://sloan.stanford.edu/MouseSite/1968Demo.html
[10]
Hansen, W. J. and Haas, C. Reading and writing with computers: a framework for explaining differences in performance. Commun. ACM 31, 9, ACM Press (1988), 1080--1089.
[11]
Hardenberg, C. and Bérard, F. Bare-hand human-computer interaction. Proc. of the 2001 Workshop on PUI '01, ACM Press (2001), 1--8.
[12]
Hong, P., Huang, T. S. and Turk, M. Gesture Modeling and Recognition Using Finite State Machines. Proc. Int'l Conf. Automatic Face and Gesture Recognition 2000, (2000), 410--415.
[13]
Ishii, H. and Ullmer, B. Tangible bits: towards seamless interfaces between people, bits and atoms. Proc. CHI 1997, ACM Press (1997), 234--241.
[14]
Kato, H., Billinghurst, M., Poupyrev, I., Imamoto, K. and Tachibana, K. Virtual object manipulation on a table-top AR environment. Proc. ISAR'00 (2000), 111--119.
[15]
Kjeldsen, R. and Kender, J., Finding Skin in Color Images. Proc. Int'l Conf. Automatic Face and Gesture Recognition 1996, (1996), 312--317.
[16]
Koike, H. and Kobayashi, M. EnhancedDesk: Integrating Paper Documents and Digital Documents. Proc. APCHI 1998, ACM Press (1998), 57--62.
[17]
Koike, H., Sato, Y. and Kobayashi, Y. Integrating paper and digital information on EnhancedDesk: a method for realtime finger tracking on an augmented desk system. TOCHI 8, 4, ACM Press (2001), 307--322.
[18]
Martin, J., and Durand, J-B. Automatic Handwriting Gestures Recognition Using Hidden Markov Models. Proc. Int'l Conf. Automatic Face and Gesture Recognition 2000, (2000), 403--409.
[19]
May, K. W. Conductive ink based page detection for linking digital and physical pages. Ext. Abstracts CHI 2001, ACM Press (2001), 275--276.
[20]
Nelson, T. H. Complex information processing: A File Structure for the Complex, the Changing, and the Indeterminate. Proc. of ACM National Conference, ACM Press (1965), 84--100.
[21]
Nelson, T. H. Literary Machines. Swarthmore, PA, USA, 1981.
[22]
O'Hara, K. and Sellen, A. A comparison of reading paper and on-line documents. Proc. CHI 1997, ACM Press (1997), 335--342.
[23]
Oka, K., Sato, Y. and Koike, H. Real-Time Tracking of Multiple Fingertips and Gesture Recognition for Augmented Desk Interface Systems. Proc. Int'l Conf. Automatic Face and Gesture Recognition 2002, (2002), 429--434.
[24]
Pavlovic, V. I., Sharma, R., Huang, T. S. Visual Interpretation of Hand Gestures for Human-Computer Interaction: A Review. IEEE Transactions on Pattern Analysis and Machine Intelligence 19, 7, (1997), 677--695.
[25]
Quek, F. K. H., Mysliwiec, T. and Zhao, M. Finger Mouse: A Freehand Pointing Interface. Proc. Int'l Workshop on Automatic Face and Gesture Recognition 1995, (1995), 372--377.
[26]
Rao, B. and Minakakis, L. Evolution of mobile location-based services. Commun. ACM 46, 12, ACM Press (2003), 61--65.
[27]
Sinclair, P., Martinez, K., Millard, D. E., and Weal, M. J. Links in the palm of your hand: tangible hypermedia using augmented reality. Proc. of the Thirteenth ACM Conference on Hypertext and Hypermedia, ACM Press (2002), 127--136.
[28]
Starner, T. and Pentland, A. Visual Recognition of American Sign Language Using Hidden Markov Models. M. I. T. Media Laboratory, Perceptual Computing Section, Cambridge MA, USA, 1994.
[29]
Sukthankar, R., Stockton, R., and Mullin, Smarter Presentations: Exploiting Homography in Camera-Projector Systems. Proc. Int'l Conf. Computer Vision '01, (2001), 82--87.
[30]
Underkoffler, J. and Ishii, H. Illuminating light: an optical design tool with a luminous-tangible interface. Proc. CHI 1998, ACM Press (1998), 542--549.
[31]
Underkoffler, J., and Ishii, H. Urp: A Luminous-Tangible Workbench for Urban Planning and Design. Proc. CHI 1999, ACM Press (1999), 386--393.
[32]
Wellner, P. Interacting with paper on the DigitalDesk. Commun. ACM 36, 7, ACM Press (1993), 87--96.
[33]
Yamato, J., Ohya, J., and Ishii, K. Recognizing human action in time-sequential images using hidden Markov model. Proc. of the IEEE Conference on Computer Vision and Pattern Recognition 1992, (1992), 379--385.

Cited By

View all
  • (2020)Replicate and Reuse: Tangible Interaction Design for Digitally-Augmented Physical Media ObjectsProceedings of the 2020 CHI Conference on Human Factors in Computing Systems10.1145/3313831.3376139(1-12)Online publication date: 21-Apr-2020
  • (2019)Augmenting natural interaction with physical paper in ambient intelligence environmentsMultimedia Tools and Applications10.1007/s11042-018-7088-978:10(13387-13433)Online publication date: 1-May-2019
  • (2019)Experiencing Materialized Reading: Individuals’ Encounters with BooksHuman-Computer Interaction – INTERACT 201910.1007/978-3-030-29390-1_11(203-224)Online publication date: 2-Sep-2019
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
TEI '08: Proceedings of the 2nd international conference on Tangible and embedded interaction
February 2008
267 pages
ISBN:9781605580043
DOI:10.1145/1347390
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

  • University of Duisburg-Essen
  • Nokia Corporation, Finland
  • Microsoft Research, Cambridge, UK
  • Fraunhofer IAIS, Birlinghoven
  • Bonn-Aachen International Center for Information Technology (B-IT)

In-Cooperation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 18 February 2008

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. CSCW
  2. annotation
  3. augmented books
  4. augmented reality
  5. computer vision
  6. electronic books
  7. fingertip detection
  8. gestural input
  9. human-computer interaction
  10. hypermedia
  11. paper-based user interface
  12. tangible user interface
  13. wiki

Qualifiers

  • Research-article

Conference

TEI08
Sponsor:

Acceptance Rates

Overall Acceptance Rate 393 of 1,367 submissions, 29%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)19
  • Downloads (Last 6 weeks)0
Reflects downloads up to 13 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2020)Replicate and Reuse: Tangible Interaction Design for Digitally-Augmented Physical Media ObjectsProceedings of the 2020 CHI Conference on Human Factors in Computing Systems10.1145/3313831.3376139(1-12)Online publication date: 21-Apr-2020
  • (2019)Augmenting natural interaction with physical paper in ambient intelligence environmentsMultimedia Tools and Applications10.1007/s11042-018-7088-978:10(13387-13433)Online publication date: 1-May-2019
  • (2019)Experiencing Materialized Reading: Individuals’ Encounters with BooksHuman-Computer Interaction – INTERACT 201910.1007/978-3-030-29390-1_11(203-224)Online publication date: 2-Sep-2019
  • (2018)ColourAIzeProceedings of the 2018 ACM International Conference on Interactive Surfaces and Spaces10.1145/3279778.3279785(273-278)Online publication date: 19-Nov-2018
  • (2018)A Review of Methods Used for Revitalizing Books and Reading Experience2018 International Symposium on Fundamentals of Electrical Engineering (ISFEE)10.1109/ISFEE.2018.8742485(1-6)Online publication date: Nov-2018
  • (2017)Interacting with augmented paper mapsProceedings of the 12th Biannual Conference on Italian SIGCHI Chapter10.1145/3125571.3125584(1-9)Online publication date: 18-Sep-2017
  • (2016)Freehand interaction with a paper-based input interfaceInternational Journal of Computer Applications in Technology10.1504/IJCAT.2016.07875954:2(106-120)Online publication date: 1-Jan-2016
  • (2016)Exploring Low-Cost, Internet-Free Information Access for Resource-Constrained CommunitiesACM Transactions on Computer-Human Interaction10.1145/299049823:6(1-34)Online publication date: 3-Dec-2016
  • (2014)Design of an Interactive Experience with Medieval IlluminationsJournal on Computing and Cultural Heritage 10.1145/26262897:2(1-19)Online publication date: 1-Jun-2014
  • (2014)QOOKProceedings of the 8th International Conference on Tangible, Embedded and Embodied Interaction10.1145/2540930.2540977(125-132)Online publication date: 16-Feb-2014
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media