skip to main content
10.1145/1242572.1242769acmconferencesArticle/Chapter ViewAbstractPublication PagesthewebconfConference Proceedingsconference-collections
Article

Using d-gap patterns for index compression

Published: 08 May 2007 Publication History

Abstract

Sequential patterns of d-gaps exist pervasively in inverted lists of Web document collection indices due to the cluster property. In this paper the information of d-gap sequential patterns is used as a new dimension for improving inverted index compression. We first detect d-gap sequential patterns using a novel data structure, UpDown Tree. Based on the detected patterns, we further substitute each pattern with its pattern Id in the inverted lists that contain it. The resulted inverted lists are then coded with an existing coding scheme. Experiments show that this approach can effectively improve the compression ratio of existing codes.

References

[1]
Anh V. N. and Moffat A. Index compression using fixed binary codewords. in Proc. 15th Australasian Database Conference (2004). 61--67.
[2]
Chen J., and Cook T. Mining Contiguous Sequential Patterns from Web Logs. in Proc. of the WWW2007. (Canada, 2007).
[3]
Elias P. Universal codeword sets and representation of the integers. IEEE Trans. on Info. Theory, 21, 2 (1975), 194--203.
[4]
Hawking D., Voorhees E., Craswell N., and Bailey P. Overview of the TREC--8 Web Track. in Proc. of the 8th Text REtrieval Conf. (2000). 131--150.

Cited By

View all
  • (2019)Data Collection and Node Counting by Opportunistic Communication2019 IFIP Networking Conference (IFIP Networking)10.23919/IFIPNetworking.2019.8816851(1-9)Online publication date: May-2019
  • (2019)LEMoNet; Low Energy Wireless Sensor Network Design for Data Center Monitoring2019 IFIP Networking Conference (IFIP Networking)10.23919/IFIPNetworking.2019.8816837(1-9)Online publication date: May-2019
  • (2016)Leveraging Context-Free Grammar for Efficient Inverted Index CompressionProceedings of the 39th International ACM SIGIR conference on Research and Development in Information Retrieval10.1145/2911451.2911518(275-284)Online publication date: 7-Jul-2016
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
WWW '07: Proceedings of the 16th international conference on World Wide Web
May 2007
1382 pages
ISBN:9781595936547
DOI:10.1145/1242572
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 May 2007

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. d-gap
  2. index compression
  3. inverted file
  4. sequential pattern

Qualifiers

  • Article

Conference

WWW'07
Sponsor:
WWW'07: 16th International World Wide Web Conference
May 8 - 12, 2007
Alberta, Banff, Canada

Acceptance Rates

Overall Acceptance Rate 1,899 of 8,196 submissions, 23%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)7
  • Downloads (Last 6 weeks)1
Reflects downloads up to 15 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2019)Data Collection and Node Counting by Opportunistic Communication2019 IFIP Networking Conference (IFIP Networking)10.23919/IFIPNetworking.2019.8816851(1-9)Online publication date: May-2019
  • (2019)LEMoNet; Low Energy Wireless Sensor Network Design for Data Center Monitoring2019 IFIP Networking Conference (IFIP Networking)10.23919/IFIPNetworking.2019.8816837(1-9)Online publication date: May-2019
  • (2016)Leveraging Context-Free Grammar for Efficient Inverted Index CompressionProceedings of the 39th International ACM SIGIR conference on Research and Development in Information Retrieval10.1145/2911451.2911518(275-284)Online publication date: 7-Jul-2016
  • (2009)A two stage approach for contiguous sequential pattern miningProceedings of the 10th IEEE international conference on Information Reuse & Integration10.5555/1689250.1689319(382-387)Online publication date: 10-Aug-2009
  • (2009)A two stage approach for Contiguous Sequential Pattern mining2009 IEEE International Conference on Information Reuse & Integration10.1109/IRI.2009.5211583(382-387)Online publication date: Aug-2009

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media