The # model: separation of concerns for reconciling modularity, abstraction and efficiency in distributed parallel programming

ABSTRACT

The computer science community has been looking for parallel languages and models with a higher level of abstraction and modularity, without performance penalties, that could be used in conjunction with advanced software engineering techniques, and that are suitable to work with large-scale programs. This paper discusses how the # parallel programming model addresses the issues of modularity and abstraction of parallel programs using the techniques of separation of concerns.

REFERENCES

• 1: Rob Armstrong , Dennis Gannon , Al Geist , Katarzyna Keahey , Scott Kohn , Lois McInnes , Steve Parker , Brent Smolinski, Toward a Common Component Architecture for High-Performance Scientific Computing, Proceedings of the The Eighth IEEE International Symposium on High Performance Distributed Computing, p.13, August 03-06, 1999
• 2: S. Balay, K. Buschelman, W. Gropp, D. Kaushik, M. Knepley, L. C. McInnes, B. Smith, and H. Zhang. PETSc Users Manual. TR ANL-95/11 Revision 2.1.3, Argonne National Laboratory, 1996. http://www.mcs.anl.gov/petsc.
• 3: Gordon Bell , Jim Gray, What's next in high-performance computing?, Communications of the ACM, v.45 n.2, p.91-95, February 2002 [doi>10.1145/503124.503129]
• 4: Bernholdt D. E. Raising Level of Programming Abstraction in Scalable Programming Models. In IEEE HPCA, Workshop on Productivity and Performance in High-End Computing (P-PHEC), 76--84. Madrid, 2004.
• 5: E. Best, J. Esparza, B. Grahlmann, S. Melzer, S. Rmer, and F. Wallner. The PEP Verification System. In Workshop on Formal Design of Safety Critical Embedded Systems (FEmSys'97), 1997.
• 6: Rajkumar Buyya, High Performance Cluster Computing: Programming and Applications, Prentice Hall PTR, Upper Saddle River, NJ, 1999
• 7: F. H. Carvalho, Jr. , R. M. F. Lima , R. D. Lins, Coordinating functional processes with Haskell_#, Proceedings of the 2002 ACM symposium on Applied computing, March 11-14, 2002, Madrid, Spain [doi>10.1145/508791.508865]
• 8: Francisco Heron de Carvalho Junior , Rafael Dueire Lins , Nívia Cruz Quental, On the Implementation of SPMD Applications Using Haskell#, Proceedings of the 15th Symposium on Computer Architecture and High Performance Computing, p.55, November 10-12, 2003
• 9: Francisco Heron de Carvalho Junior , Rafael Dueire Lins, Topological Skeletons in Haskell#, Proceedings of the 17th International Symposium on Parallel and Distributed Processing, p.53.1, April 22-26, 2003
• 10: F. H. Carvalho Junior, R. D. Lins, and R. M. F. Lima. Translating Haskell# Programs into Petri Nets. LNCS (VECPAR'2002), 2565:635--649, Springer Verlag, 2002.
• 11: Murray Cole, Algorithmic skeletons: structured management of parallel computation, MIT Press, Cambridge, MA, 1991
• 12: Edsger W. Dijkstra, The humble programmer, Communications of the ACM, v.15 n.10, p.859-866, Oct. 1972 [doi>10.1145/355604.361591]
• 13: Jack Dongarra , Ian Foster , Geoffrey Fox , William Gropp , Ken Kennedy , Linda Torczon , Andy White, Sourcebook of parallel computing, Morgan Kaufmann Publishers Inc., San Francisco, CA, 2003
• 14: High Performance Fortran Forum. High Performance Fortran, Language Specification, V 2.0, January 1997.
• 15: Ian Foster , Carl Kesselman, The Grid 2: Blueprint for a New Computing Infrastructure, Morgan Kaufmann Publishers Inc., San Francisco, CA, 2003
• 16: Al Geist , Adam Beguelin , Jack Dongarra , Weicheng Jiang , Robert Manchek , Vaidy Sunderam, PVM: Parallel virtual machine: a users' guide and tutorial for networked parallel computing, MIT Press, Cambridge, MA, 1995
• 17: Bernd Grahlmann , Eike Best, PEP - More than a Petri Net Tool, Proceedings of the Second International Workshop on Tools and Algorithms for Construction and Analysis of Systems, p.397-401, March 27-29, 1996
• 18: C. A. R. Hoare, Communicating sequential processes, Prentice-Hall, Inc., Upper Saddle River, NJ, 1985
• 19: G. Kiczales, J. Lamping, Menhdhekar A., Maeda C., C. Lopes, J. Loingtier, and J. Irwin. Aspect-Oriented Programming. In Proc. of ECOOP '97, LNCS, pp. 220--242. Springer-Verlag, November 1997.
• 20: Message Passing Interface Forum. MPI: A Message-Passing Interface Standard. International Journal of Supercomputer Applications and High Performance Computing, 8(3-4):169--416, 1994.
• 21: H. Meuer, E. Strohmaier, J. Dongarra, and H. D. Simon. Top 500 Supercomputer sites, Web Page, http://www.top500.org, University of Mannheim/University of Tennesee/NERSC/LBNL.
• 22: T. Murata. Petri Nets: Properties Analysis and Applications. Proceedings of IEEE, 77(4):541--580, April 1989.
• 23: H. Ossher and P. Tarr. Multi-Dimensional Separation of Concerns and the Hyperspace Approach. In Proceedings of the Symposium on Software Architectures and Component Technology: The State of the Art in Software Development. Kluwer Academics, June 2000.
• 24: D. L. Parnas, On the criteria to be used in decomposing systems into modules, Communications of the ACM, v.15 n.12, p.1053-1058, Dec. 1972 [doi>10.1145/361598.361623]
• 25: J. Pool. Scalable I/O Initiative, March 1995. http://www.cacr.caltech.edu/SIO.
• 26: A. Skjellum, P. Bangalore, J. Gray, and Bryant B. Reinventing Explicit Parallel Programming for Improved Engineering of High Performance Computing Software. In ICSE'2004, pp. 59--63. ACM, May 2004. Edinburgh, UK.
• 27: J. M. Squyres and A. Lumsdaine. A Component Architecture for LAM/MPI. In LNCS 2840, September 2003. Springer-Verlag.

INDEX TERMS

Primary Classification:
  D. Software
  D.1 PROGRAMMING TECHNIQUES
      D.1.1 Applicative (Functional) Programming

Additional Classification:
  D. Software
  D.3 PROGRAMMING LANGUAGES
      D.3.2 Language Classifications
          Subjects: Concurrent, distributed, and parallel languages

General Terms:
Languages

Keywords:
high performance computing software, parallel programming, separation of concerns, software engineering