skip to main content
10.1145/1459359.1459494acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
short-paper

Word2Image: towards visual interpreting of words

Published: 26 October 2008 Publication History

Abstract

Besides the traditional textual semantic description to convey the meanings of a certain concept or word, visual illustration is a complementary, yet important and more intuitive way to interpret the word. Thus the technique that converts word to image is desirable though it is very difficult. Since a word usually has different semantic aspects, we need several correct and semantic-rich images to represent the word. In this paper, we explore how to leverage the web image collections to fulfill such task and develop a novel multimedia application system, Word2Image. Various techniques, including the correlation analysis, semantic and visual clustering are adapted into our system to produce sets of high quality, precise, diverse and representative images to visually translate a given word. The objective and subjective evaluations show the feasibility and effectiveness of our approach.

References

[1]
Google image search engine, http://images.google.com/
[2]
AltaVista image search, http://www.altavista.com/image/
[3]
Flickr, http://www.flickr.com/
[4]
D. Cai, X. He, Z. Li, W.Y. Ma, and J. R. Wen, "Hierarchical clustering of www image search results using visual, textual and link information", ACM MM 2004
[5]
Bin Gao, Tie-Yan Liu, Xin Zheng, Qian-Sheng Cheng, Wei-Ying Ma, "Web image clustering by consistent utilization of visual features and surrounding texts", ACM MM, 2005
[6]
Feng Jing, Changhu Wang, et al, "IGroup: web image search results clustering", ACM MM, 2006
[7]
X. Zhu, A. B. Goldberg, et al, "A Text-to-Picture Synthesis System for Augmenting Communication", AAAI 2007
[8]
Lyndon S. Kennedy, Mor Naaman: "Generating diverse and representative image search results for landmarks", WWW 2008
[9]
Berry, Michael W, "Survey of Text Mining I: Clustering, Classification, and Retrieval", Springer-Verlag, New York, 2003
[10]
A. Jain and R. Dube, "Algorithms for Clustering Data", Prentice-Hall, Englewood Cliffs, NJ, 1988
[11]
M. F. Porter, "An algorithm for suffix stripping", Program, 14(3), pp 130--137, 1980
[12]
Christiane Fellbaum, "WordNet: An Electronic Lexical Database", MIT Press, 1999
[13]
X.-L. Liu, T. Mei, X.-S. Hua, et al, "Video Collage", ACM MM 2007

Cited By

View all
  • (2024)Text-to-Image Synthesis With Generative Models: Methods, Datasets, Performance Metrics, Challenges, and Future DirectionIEEE Access10.1109/ACCESS.2024.336504312(24412-24427)Online publication date: 2024
  • (2019)Towards Adaptive Multimedia System for Assisting Children with Arabic Learning Difficulties2019 IEEE Jordan International Joint Conference on Electrical Engineering and Information Technology (JEEIT)10.1109/JEEIT.2019.8717419(794-799)Online publication date: Apr-2019
  • (2019)Improving Arabic Text to Image Mapping Using a Robust Machine Learning TechniqueIEEE Access10.1109/ACCESS.2019.28967137(18772-18782)Online publication date: 2019
  • Show More Cited By

Index Terms

  1. Word2Image: towards visual interpreting of words

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    MM '08: Proceedings of the 16th ACM international conference on Multimedia
    October 2008
    1206 pages
    ISBN:9781605583037
    DOI:10.1145/1459359
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 26 October 2008

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. diversity
    2. image dictionary
    3. multimedia dictionary
    4. representativeness

    Qualifiers

    • Short-paper

    Conference

    MM08
    Sponsor:
    MM08: ACM Multimedia Conference 2008
    October 26 - 31, 2008
    British Columbia, Vancouver, Canada

    Acceptance Rates

    Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)11
    • Downloads (Last 6 weeks)1
    Reflects downloads up to 02 Mar 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Text-to-Image Synthesis With Generative Models: Methods, Datasets, Performance Metrics, Challenges, and Future DirectionIEEE Access10.1109/ACCESS.2024.336504312(24412-24427)Online publication date: 2024
    • (2019)Towards Adaptive Multimedia System for Assisting Children with Arabic Learning Difficulties2019 IEEE Jordan International Joint Conference on Electrical Engineering and Information Technology (JEEIT)10.1109/JEEIT.2019.8717419(794-799)Online publication date: Apr-2019
    • (2019)Improving Arabic Text to Image Mapping Using a Robust Machine Learning TechniqueIEEE Access10.1109/ACCESS.2019.28967137(18772-18782)Online publication date: 2019
    • (2019)Building multimedia repository for composing images perspectiveSN Applied Sciences10.1007/s42452-019-1123-y1:9Online publication date: 28-Aug-2019
    • (2019)Text-to-picture tools, systems, and approaches: a surveyMultimedia Tools and Applications10.1007/s11042-019-7541-4Online publication date: 25-Apr-2019
    • (2019)Designing an Educational Multimedia System for Supporting Learning Difficulties in ArabicIntelligent Computing10.1007/978-3-030-22868-2_74(1117-1128)Online publication date: 9-Jul-2019
    • (2018)Automatic Annotation of Text with PicturesIT Professional10.1109/MITP.2018.01129135420:1(36-44)Online publication date: 1-Feb-2018
    • (2017)Illustrate It! An Arabic Multimedia Text-to-Picture m-Learning SystemIEEE Access10.1109/ACCESS.2017.27103155(12777-12787)Online publication date: 2017
    • (2016)Exploiting visual saliency for increasing diversity of image retrieval resultsMultimedia Tools and Applications10.1007/s11042-015-2526-475:10(5581-5602)Online publication date: 1-May-2016
    • (2016)Chat with illustrationMultimedia Systems10.1007/s00530-014-0371-322:1(5-16)Online publication date: 1-Feb-2016
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media