skip to main content
10.1145/1005847.1005859acmconferencesArticle/Chapter ViewAbstractPublication PagesmmsysConference Proceedingsconference-collections
Article

Efficient and flexible parallel retrieval using priority encoded transmission

Published: 16 June 2004 Publication History

Abstract

Many applications, including web transfers, software distribution, video-on-demand, and peer-to-peer data downloads, require the retrieval of structured documents consisting of multiple components like images, video, and text. Large systems using these applications may be made more scalable by using efficient data distribution techniques like multicast, and by enabling clients to retrieve data from multiple servers in parallel.In this paper we propose a new technique for parallel retrieval of structured documents from multiple servers using priority encoded transmission, which allows some subsets of a transmission to be reconstructed before others. We discuss the application of this technique to bulk and streaming media distribution, and provide performance results from trace-based simulations.

References

[1]
R. Janakiraman, M. Waldvogel, and L. Xu, "Fuzzycast: Efficient Video-on-Demand over Multicast," in Proceedings of INFOCOM 2002,New York, NY, USA, May 2002.
[2]
J. W. Byers, M. Luby, and M. Mitzenmacher, "Accessing Multiple Mirror Sites in Parallel: Using Tornado Codes to Speed Up Downloads," in Proceedings of INFOCOM 1999, 1999, pp. 275--283.
[3]
M. Luby, "LT Codes," in Proceedings of FOCS 2002, 2002.
[4]
A. Albanese, J. Blomer, J. Edmonds, M. Luby, and M. Sudan, "Priority encoding transmission," in Proceedings of FOCS 1994, 1994, pp. 604--612.
[5]
I. Stoica, R. Morris, D. Karger, M. F. Kaashoek, and H. Balakrishnan, "Chord: A Scalable Peer-to-peer Lookup Service for Internet Applications," in Proceedings of ACM SIGCOMM. 2001, pp. 149--160, ACM Press.
[6]
"CFSQP Software Page," http://www.aemdesign.com/FSQPframe.htm/.
[7]
L. Fan, P. Cao, J. Almeida, and A. Broder, "Summary Cache: A Scalable Wide-Area Web Cache Sharing Protocol," in Proceedings of SIGCOMM '98, Sept. 1998, pp. 254--265.
[8]
V. Pless, Introduction to the Theory of Error-Correcting Codes, Wiley-Interscience, 1998.
[9]
M. G. Luby, M. Mitzenmacher, M. Amin Shokrollahi, and D. A. Spielman, "Improved Low-Density Parity-Check Codes Using Irregular Graphs and Belief Propagation," Tech. Rep. TR-97-044, Berkeley, CA, 1997.
[10]
M. A. Shokrollahi, "Raptor codes," in To appear in the proceedings of ISIT 2004, July 2004.
[11]
L. Xu, "Efficient and Scalable On-Demand Data Streaming Using UEP Codes," in Proceedings of ACM Multimedia 2001, Ottowa, Canada, 2002.
[12]
S. Saroiu and P. K. Gummadi and S. D. Gribble, "A Measurement Study of Peer-to-peer File Sharing Systems," in Proceedings of MMCN 2002, Apr. 2002.

Cited By

View all
  • (2009)Optimal rateIEEE Transactions on Information Theory10.1109/TIT.2009.203285155:12(5491-5510)Online publication date: 1-Dec-2009
  • (2006)Influence of Adaptive Data Layouts on Performance in Dynamically Changing Storage EnvironmentsProceedings of the 14th Euromicro International Conference on Parallel, Distributed, and Network-Based Processing10.1109/PDP.2006.44(155-162)Online publication date: 15-Feb-2006

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
NOSSDAV '04: Proceedings of the 14th international workshop on Network and operating systems support for digital audio and video
June 2004
168 pages
ISBN:1581138016
DOI:10.1145/1005847
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

In-Cooperation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 16 June 2004

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. fountain codes
  2. parallel download
  3. peer-to-peer

Qualifiers

  • Article

Conference

NOSSDAV04
Sponsor:

Acceptance Rates

Overall Acceptance Rate 118 of 363 submissions, 33%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)1
  • Downloads (Last 6 weeks)1
Reflects downloads up to 16 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2009)Optimal rateIEEE Transactions on Information Theory10.1109/TIT.2009.203285155:12(5491-5510)Online publication date: 1-Dec-2009
  • (2006)Influence of Adaptive Data Layouts on Performance in Dynamically Changing Storage EnvironmentsProceedings of the 14th Euromicro International Conference on Parallel, Distributed, and Network-Based Processing10.1109/PDP.2006.44(155-162)Online publication date: 15-Feb-2006

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media