skip to main content
10.1145/1062745.1062906acmconferencesArticle/Chapter ViewAbstractPublication PagesthewebconfConference Proceedingsconference-collections
Article

Web data cleansing for information retrieval using key resource page selection

Published: 10 May 2005 Publication History

Abstract

With the page explosion of WWW, how to cover more useful information with limited storage and computation resources becomes more and more important in web IR research. Using web page non-content feature analysis, we proposed a clustering-based method to select high quality pages from the whole page set. Although the result page set contains only 44.3% of the whole collection, it is related with more than 98% of links and covers about 90% of key information. Link property and retrieval affects are also observed and experiment results show that key resource selection method is more suitable for the job of data cleansing and the result page set outperforms the whole collection by smaller size and better retrieval performance.

References

[1]
A. Broder, A taxonomy of web search. SIGIR Forum Volume 36 Number 2, 2002.
[2]
D. Hawking and N. Craswell. Overview of the TREC-2003 Web track. NIST Special Publication: SP 500--255, The Twelfth Text Retrieval Conference (TREC 2003), 2003.
[3]
J. Kleinberg. Authoritative sources in a hyperlinked environment. Journal of the ACM, Volume 46 (5), 1999.
[4]
S. Brin and L. Page. The anatomy of a large-scale hypertextual web search engine. Proceedings of the 7th World-Wide Web Conference (WWW7), 1998.

Cited By

View all
  • (2008)Credibility: A multidisciplinary frameworkAnnual Review of Information Science and Technology10.1002/aris.2007.144041011441:1(307-364)Online publication date: 24-Oct-2008
  • (2007)Data cleansing for Web information retrieval using query independent featuresJournal of the American Society for Information Science and Technology10.1002/asi.2063358:12(1884-1898)Online publication date: 23-Jul-2007

Index Terms

  1. Web data cleansing for information retrieval using key resource page selection

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    WWW '05: Special interest tracks and posters of the 14th international conference on World Wide Web
    May 2005
    454 pages
    ISBN:1595930515
    DOI:10.1145/1062745
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 10 May 2005

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. non-content feature
    2. web IR
    3. web data cleansing

    Qualifiers

    • Article

    Acceptance Rates

    Overall Acceptance Rate 1,899 of 8,196 submissions, 23%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)1
    • Downloads (Last 6 weeks)1
    Reflects downloads up to 17 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2008)Credibility: A multidisciplinary frameworkAnnual Review of Information Science and Technology10.1002/aris.2007.144041011441:1(307-364)Online publication date: 24-Oct-2008
    • (2007)Data cleansing for Web information retrieval using query independent featuresJournal of the American Society for Information Science and Technology10.1002/asi.2063358:12(1884-1898)Online publication date: 23-Jul-2007

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media