skip to main content
10.1145/2331684.2331693acmconferencesArticle/Chapter ViewAbstractPublication PagesissacConference Proceedingsconference-collections
research-article

Schönhage-Strassen algorithm with MapReduce for multiplying terabit integers

Published:07 June 2012Publication History

ABSTRACT

We present MapReduce-SSA, an integer multiplication algorithm using the ideas from Schönhage-Strassen algorithm (SSA) on MapReduce. SSA is one of the most commonly used large integer multiplication algorithms. MapReduce is a programming model invented for distributed data processing on large clusters. MapReduce-SSA is designed for multiplying integers in terabit scale on clusters of commodity machines. As parts of MapReduce-SSA, two algorithms, MapReduce-FFT and MapReduce-Sum, are created for computing discrete Fourier transforms and summations. These mathematical algorithms match the model of MapReduce seamlessly.

References

  1. F. Bellard. Pi computation record, 2009. http://bellard.org/pi/pi2700e9/announce.html.Google ScholarGoogle Scholar
  2. F. Bellard. Tachuspi, 2009. http://bellard.org/pi/pi2700e9/tpi.html.Google ScholarGoogle Scholar
  3. D. J. Bernstein. Multidigit multiplication for mathematicians, 2001. Available at http://cr.yp.to/papers/m3.pdf.Google ScholarGoogle Scholar
  4. D. J. Bernstein. Fast multiplication and its applications. Number 44 in Mathematical Sciences Research Institute Publications, pages 325--384. Cambridge University Press, 2008.Google ScholarGoogle Scholar
  5. J. M. Borwein, P. B. Borwein, and D. H. Bailey. Ramanujan, modular equations, and approximations to pi or how to compute one billion digits of pi. 96(3):201--219, 1989. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. R. P. Brent and P. Zimmermann. Modern Computer Arithmetic. Number 18 in Cambridge Monographs on Computational and Applied Mathematics. Cambridge University Press, Cambridge, United Kingdom, 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. D. Chudnovsky and G. Chudnovsky. The computation of classical constants. In Proc. Nat. Acad. Sci. USA, volume 86, pages 8178--8182. Academic Press, 1989.Google ScholarGoogle Scholar
  8. R. Crandall and C. Pomerance. Prime Numbers: A Computational Perspective. Springer-Verlag, New York, NY, 2001.Google ScholarGoogle Scholar
  9. A. De, P. P. Kurur, C. Saha, and R. Saptharishi. Fast integer multiplication using modular arithmetic. In Proceedings of the 40th annual ACM Symposium on Theory of Computing, pages 499--506. ACM, 2008. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. J. Dean and S. Ghemawat. MapReduce: simplified data processing on large clusters. In Proceedings of the 6th conference on Symposium on Opearting Systems Design & Implementation, pages 137--150. USENIX Association, 2004. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. M. Fürer. Faster integer multiplication. In Proceedings of the 39th Annual ACM Symposium on Theory of Computing, pages 57--66. ACM, 2007. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. P. Gaudry, A. Kruppa, and P. Zimmermann. A GMP-based implementation of Schönhage-Strassen's large integer multiplication algorithm. In Proceedings of the 2007 International Symposium on Symbolic and Algebraic Computation, pages 167--174. ACM, 2007. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. D. E. Knuth. The Art of Computer Programming, Volume 2: Seminumerical Algorithms. Addison-Wesley, Reading, MA, 1997. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. O. O'Malley and A. C. Murthy. Winning a 60 second dash with a yellow elephant, 2009. Available at http://sortbenchmark.org/Yahoo2009.pdf.Google ScholarGoogle Scholar
  15. A. Schönhage and V. Strassen. Schnelle Multiplikation großer Zahlen. Computing, 7:281--292, 1971.Google ScholarGoogle ScholarCross RefCross Ref
  16. K. Shvachko, H. Kuang, S. Radia, and R. Chansler. The Hadoop Distributed File System. In 26th IEEE Symposium on Massive Storage Systems and Technologies, 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. D. Takahashi, 2010. Personal communication.Google ScholarGoogle Scholar
  18. D. Takahashi. Parallel implementation of multiple-precision arithmetic and 2,576,980,370,000 decimal digits of π calculation. Parallel Comput., 36:439--448, August 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. A. J. Yee, 2010. Personal communication.Google ScholarGoogle Scholar
  20. A. J. Yee. y-cruncher -- a multi-threaded pi-program, 2010. http://www.numberworld.org/y-cruncher/.Google ScholarGoogle Scholar
  21. A. J. Yee and S. Kondo. 5 trillion digits of pi - new world record, 2010. http://www.numberworld.org/misc_runs/pi-5t/announce_en.html.Google ScholarGoogle Scholar

Index Terms

  1. Schönhage-Strassen algorithm with MapReduce for multiplying terabit integers

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in
        • Published in

          cover image ACM Conferences
          SNC '11: Proceedings of the 2011 International Workshop on Symbolic-Numeric Computation
          June 2012
          194 pages
          ISBN:9781450305150
          DOI:10.1145/2331684

          Copyright © 2012 ACM

          Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          • Published: 7 June 2012

          Permissions

          Request permissions about this article.

          Request Permissions

          Check for updates

          Qualifiers

          • research-article

          Upcoming Conference

          ISSAC '24

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader