A speed-based adaptive dynamic parallel downloading technique

ABSTRACT

In this paper, we describe adPD, an improved parallel downloading approach for Peer-to-Peer environment. adPD assigns each server equal portion of file as large as possible, and ensures client downloading from each server without interrupt. And after faster servers finish their own work, adPD reallocates part of unfinished work of some slower servers to them. This reallocation is proportional to the ratio of server speed. By this means, adPD dynamically adjusts the proportion of a file retrieved from each server during the downloading process to match the bandwidth of each connection, and also reduces the number of block requests as many as possible. Our experiment results show that adPD is an effective parallel download scheme in Peer-to-Peer environment.

REFERENCES

• 1: A. Miu and E. Shih, Performance Analysis of a Dynamic Parallel Downloading Scheme from Mirror Sites Throughout the Internet, url: http://nms.lcs.mit.edu/~aklmiu/comet/paraload.html, December 1999.
• 2: Pablo Rodriguez, Andreas Kirpal, and Ernst W. Biersack. Parallel-access for mirror sites in the internet. In Proceedings of IEEE INFOCOM 2000, March 2000.
• 3: Speedbit's download accelerator. http://www.speedbit.com
• 4: Bram Cohen, Incentives Build Robustness in BitTorrent, http://bitconjurer.org/BitTorrent/documentation.html, May, 2003.
• 5: Ouri Wolfson , Sushil Jajodia , Yixiu Huang, An adaptive data replication algorithm, ACM Transactions on Database Systems (TODS), v.22 n.2, p.255-314, June 1997 [doi>10.1145/249978.249982]
• 6: Musiccity, http://www.musiccity.com
• 7: "OpenCola Swarmcast", http://www.opencola.org/projects/swarmcast.shtml.
• 8: Andy Myers, Peter A. Dinda, and Hui Zhang. Performance characteristics of mirror servers on the internet. In INFOCOM (1), pages 304--312, 1999.
• 9: Christos Gkantsidis , Mostafa Ammar , Ellen Zegura, On the Effect of Large-Scale Deployment of Parallel Downloading, Proceedings of the The Third IEEE Workshop on Internet Applications, p.79, June 23-24, 2003
• 10: Pablo Rodriguez , Ernst W. Biersack, Dynamic parallel access to replicated content in the internet, IEEE/ACM Transactions on Networking (TON), v.10 n.4, p.455-465, August 2002 [doi>10.1109/TNET.2002.801413]
• 11: Simon G. M. Koo , Catherine Rosenberg , Dongyan Xu, Analysis of Parallel Downloading for Large File Distribution, Proceedings of the The Ninth IEEE Workshop on Future Trends of Distributed Computing Systems (FTDCS'03), p.128, May 28-30, 2003
• 12: A. Zeitoun, H. Jamjoom, and M. El-Gendy. Scalable Parallel-Access For Mirrored Servers. In The 20th IASTED International Conference on Applied Informatics (AI 2002), Innsbruck, Austria, Feb. 2002.
• 13: Wei Qingsong, The Research on Large-Scale Distributed Storage Technology, Ph. D. Thesis, UESTC, China, 2004

INDEX TERMS

Primary Classification:
  C. Computer Systems Organization
  C.2 COMPUTER-COMMUNICATION NETWORKS
      C.2.4 Distributed Systems
          Subjects: Distributed applications

Additional Classification:
  C. Computer Systems Organization
  C.5 COMPUTER SYSTEM IMPLEMENTATION
      C.5.5 Servers

  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.5 On-line Information Services
          Subjects: Data sharing

General Terms:
Algorithms, Performance

Keywords:
adaptive, dynamic, parallel download, peer-to-peer