Article

Structuralizing digital ink for efficient selection

Authors:

Guozhong DaiAuthors Info & Claims

IUI '06: Proceedings of the 11th international conference on Intelligent user interfaces

Pages 148 - 154

https://doi.org/10.1145/1111449.1111484

Published: 29 January 2006 Publication History

Abstract

Raw digital ink is informal and unstructured. Its editing, especially its selection, is often inefficient. In this paper, we present approaches to structuralize raw digital ink as multiple hierarchies to facilitate its selection. First a link model is built to organize ink as a mesh-like structure. Based on the link model, the isolated stroke groups form patches. In each patch, textual and graphical areas are separated. Then, each textual area is segmented into text lines, and each text line is partitioned to words. We also design gestures for selecting structured ink. Experiments showed that our ink-structuralizing approaches are effective and selecting structured ink by our gestures considerably outperforms selecting raw ink.

References

[1]

C. M. Bishop, M. Svensén, G. E. Hinton. Distinguishing Text from Graphics in On-line Handwritten Ink, 2004?IWFHR-9 F. Kimura and H. Fujisawa 142--147.

Digital Library

[2]

Elisabetta Bruzzone, Meri Cristina Coffetti: An Algorithm for Extracting Cursive Text Lines. ICDAR 1999: pp. 749--752.

Digital Library

[3]

Eric W. Weisstein. "Delaunay Triangulation." http://mathworld.wolfram.com/DelaunayTriangulation.html

[4]

Hideaki Goto, Hirotomo Aso, Extracting curved text lines using local linearity of the text line, IJDAR (1999) 2: pp. 111--119.

[5]

Igarashi T., Matsuoka, S. and Masui, T. Adaptive Recognition of Human-Organized Implicit Structures, In Proceedings of Visual Languages '95, pp.258--266.

Digital Library

[6]

Jisheng Liang, Robert M. Haralick, Ihsin T. Phillips: A Statistically based, Highly Accurate Text-line Segmentation Method. ICDAR 1999: pp. 551--554.

Digital Library

[7]

KEISUKE MOCHIDA and MASAKI NAKAGAWA, Separating Figure, Mathematical Formula and Japanese Text from Free Handwriting In Mixed Online Documents. International Journal of Pattern Recognition and Artificial Intelligence Vol. 18, No. 7, 2004, pp.1173--1187.

[8]

Koffka, K., Perception: An introduction to Gestalt-theorie. Psychological Bulletin, 19: pp. 531--585.

[9]

L. O'Gorman, The document spectrum for page layout analysis, IEEE Trans. on P.A.M.I., vol. 15, pp. 1162--1173, 1993.

Digital Library

[10]

Li, Y., Guan, Z.,Wang, H., Dai, G., and Ren, X. Structuralizing Freeform Notes by Implicit Sketch Understanding, In AAAI 2002 Spring Symposium on Sketch Understanding, AAAI TR.SS-02-08.

[11]

Markus Feldbach, Klaus D. Tönnies: Line Detection and Segmentation in Historical Church Registers. ICDAR 2001: pp. 743--747.

Digital Library

[12]

Martin Wattenberg and Danyel Fisher. A Model of Multi-Scale Perceptual Organization in Information Graphics. In Proceedings of IEEE Symposium on Information Visualization, October 2003.

Digital Library

[13]

Moran, T.P., Chiu, P., Melle, W.v., Kurtenbach, G. Implicit Structures for Pen-Based Systems within a Freeform Interaction Paradigm. CHI '95 (Denver, Colorado, 1995), ACM Press, pp. 487--494.

Digital Library

[14]

Pu Y. and Shi Z., A natural learning algorithm based on Hough transform for text lines extraction in handwritten documents, In Proceedings 6th IWFHR 1998, pp. 637--646.

[15]

Saund, E., and Moran, T., A Perceptually Supported Sketch Editor, Proceedings of the ACM Symposium on User Interface Software and Technology (UIST), Marina del Rey, CA., November, 1994.

Digital Library

[16]

Saund, E., Fleet, D., Larner, D., and Mahoney, J., Perceptually-Supported Image Editing of Text and Graphics, Proc. UIST '03 (ACM Symposium on User Interface Software and Technology), pp. 183--192.

Digital Library

[17]

Saund, E., Mahoney, J., Fleet, D., Larner, D., and Lank, E., Perceptual Organization as a Foundation for Intelligent Sketch Editing, 2002 AAAI Spring Symposium on Sketch Understanding, pp. 118--125.

[18]

Seong-Whan Lee and Dae-Seok Ryu, IEEE. Transaction on Pattern Analysis and Machine Intelligence, Vol. 23, No. 11, pp.1240--1256, November 2001.

Digital Library

[19]

U. Pal, S. Sinha and B. B. Chaudhuri, Multi-Oriented Text lines Detection and Their Skew Estimation, Lecture Notes in Computer Science, Volume 2749 2003, Chapter: pp. 1146--1153.

Digital Library

[20]

Zhixin Shi, Venu Govindaraju: Skew Detection for Complex Document Images Using Fuzzy Runlength. ICDAR 2003: pp.715--71.

Digital Library

Cited By

Jiang YTian FZhang XDai GWang H(2011)Understanding, Manipulating and Searching Hand-Drawn Concept MapsACM Transactions on Intelligent Systems and Technology10.1145/2036264.20362753:1(1-21)Online publication date: 1-Oct-2011
https://dl.acm.org/doi/10.1145/2036264.2036275
Ispas ASigner BNorrie MPaternò FLuyten KMaurer F(2011)An extensible digital ink segmentation and classification framework for natural notetakingProceedings of the 3rd ACM SIGCHI symposium on Engineering interactive computing systems10.1145/1996461.1996528(231-240)Online publication date: 13-Jun-2011
https://dl.acm.org/doi/10.1145/1996461.1996528
Blagojevic RPlimmer BGrundy JWang Y(2011)Technical SectionComputers and Graphics10.1016/j.cag.2011.07.00235:5(976-991)Online publication date: 1-Oct-2011
https://dl.acm.org/doi/10.1016/j.cag.2011.07.002
Show More Cited By

Index Terms

Structuralizing digital ink for efficient selection
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision problems
        Interest point and salient region detections
  2. Computer graphics
    1. Graphics systems and interfaces
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Graphics input devices

Recommendations

Reflowing digital ink annotations
CHI '03: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Annotating paper documents with a pen is a familiar and indispensable activity across a wide variety of work and educational settings. Recent developments in pen-based computing promise to bring this experience to digital documents. However, digital ...
Effect of Text/Non-text Classification for Ink Search Employing String Recognition
DAS '12: Proceedings of the 2012 10th IAPR International Workshop on Document Analysis Systems

This paper presents the effect of text/non-text classification for ink search which employs string recognition. Pen or touch interfaces provides the benefit that users can write text and draw figures without changing the device or mode, but line ...
A Data-Driven Personalized Digital Ink for Chinese Characters
MMM 2014: Proceedings of the 20th Anniversary International Conference on MultiMedia Modeling - Volume 8325

In this paper, we propose a novel data-driven digital ink generating method for Chinese characters. When users write on tablets, they can select a specific rendering style from the predefined style database to generate character images in the selected ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

IUI '06: Proceedings of the 11th international conference on Intelligent user interfaces

January 2006

392 pages

ISBN:1595932879

DOI:10.1145/1111449

General Chairs:
Ernest Edmonds
University of Technology Sydney, Australia
,
Doug Riecken
IBM Watson Research, USA
,
Program Chairs:
Cécile L. Paris
CSIRO ICT Centre, Australia
,
Candace L. Sidner
MERL, USA

Copyright © 2006 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 29 January 2006

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

IUI06

Sponsor:

IUI06: 11th International Conference on Intelligent User Interfaces

January 29 - February 1, 2006

Sydney, Australia

Acceptance Rates

Overall Acceptance Rate 746 of 2,811 submissions, 27%

Upcoming Conference

IUI '25

Sponsor:
sigai
sigai

30th International Conference on Intelligent User Interfaces

March 24 - 27, 2025

Cagliari , Italy

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

12
Total Citations
View Citations
539
Total Downloads

Downloads (Last 12 months)7
Downloads (Last 6 weeks)0

Reflects downloads up to 01 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Jiang YTian FZhang XDai GWang H(2011)Understanding, Manipulating and Searching Hand-Drawn Concept MapsACM Transactions on Intelligent Systems and Technology10.1145/2036264.20362753:1(1-21)Online publication date: 1-Oct-2011
https://dl.acm.org/doi/10.1145/2036264.2036275
Ispas ASigner BNorrie MPaternò FLuyten KMaurer F(2011)An extensible digital ink segmentation and classification framework for natural notetakingProceedings of the 3rd ACM SIGCHI symposium on Engineering interactive computing systems10.1145/1996461.1996528(231-240)Online publication date: 13-Jun-2011
https://dl.acm.org/doi/10.1145/1996461.1996528
Blagojevic RPlimmer BGrundy JWang Y(2011)Technical SectionComputers and Graphics10.1016/j.cag.2011.07.00235:5(976-991)Online publication date: 1-Oct-2011
https://dl.acm.org/doi/10.1016/j.cag.2011.07.002
Blagojevic RPlimmer BGrundy JWang Y(2010)Building digital ink recognizers using data miningProceedings of the 23rd international conference on Industrial engineering and other applications of applied intelligent systems - Volume Part I10.5555/1945758.1945801(358-367)Online publication date: 1-Jun-2010
https://dl.acm.org/doi/10.5555/1945758.1945801
Jiang YTian FWang HZhang XWang XDai GRich CYang QCavazza MZhou M(2010)Intelligent understanding of handwritten geometry theorem provingProceedings of the 15th international conference on Intelligent user interfaces10.1145/1719970.1719988(119-128)Online publication date: 7-Feb-2010
https://dl.acm.org/doi/10.1145/1719970.1719988
Zhang XAn WFu Y(2010)Adaptive Correction of Errors from Segmented Digital Ink Texts in Chinese Based on ContextProceedings of the 2010 Second International Conference on Information Technology and Computer Science10.1109/ITCS.2010.14(25-35)Online publication date: 24-Jul-2010
https://dl.acm.org/doi/10.1109/ITCS.2010.14
Wang TPlimmer BPlimmer B(2009)SmartListProceedings of the 10th International Conference NZ Chapter of the ACM's Special Interest Group on Human-Computer Interaction10.1145/1577782.1577793(61-64)Online publication date: 6-Jul-2009
https://dl.acm.org/doi/10.1145/1577782.1577793
Jiang YTian FWang XZhang XDai GWang HConati CBauer MOliver NWeld D(2009)Structuring and manipulating hand-drawn concept mapsProceedings of the 14th international conference on Intelligent user interfaces10.1145/1502650.1502718(457-462)Online publication date: 8-Feb-2009
https://dl.acm.org/doi/10.1145/1502650.1502718
Dehmeshki HStuerzlinger W(2009)ICE-Lasso: An enhanced form of Lasso selection2009 IEEE Toronto International Conference Science and Technology for Humanity (TIC-STH)10.1109/TIC-STH.2009.5444424(630-635)Online publication date: Sep-2009
https://doi.org/10.1109/TIC-STH.2009.5444424
Zhang JZhang WZhan NShen YChen HZhang YWang YWu EWang HZhu X(2008)Basic research in computer science and software engineering at SKLCSFrontiers of Computer Science in China10.1007/s11704-008-0001-32:1(1-11)Online publication date: 28-Mar-2008
https://doi.org/10.1007/s11704-008-0001-3
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten