Message Passing Interface (MPI)

Posted on Daniel Moth See other posts from Daniel Moth
Published on Thu, 12 Nov 2009 00:01:00 GMT Indexed on 2010/03/16 17:11 UTC
Read the original article Hit count: 502

Filed under:

ParallelComputing

|

hpc

So you have installed your cluster and you are done with introductory material on Windows HPC. Now you want to develop an application with the most common programming model: Message Passing Interface.

The MPI programming model is a standard with implementations from many vendors. For newbies (like myself!), I have aggregated below links for getting started.

Non-Microsoft MPI resources (useful even if you are not on the Windows platform)
1. Message Passing Interface on wikipedia.

2. The MPI standard.
3. MPICH2 - an MPI implementation.
4. Tutorial on MPI by William Gropp.
5. MPI patterns presented as a tutorial with sample code.

6. THE official MPI Forum (maintains the standard) including the wiki discussing the MPI future.

7. Great MPI tutorial including at the end the MPI Exercise.

8. C++ MPI Exercises by John Burkardt.

9. Book online: MPI The Complete Reference.

MS-MPI
10. Windows HPC Server 2008 - Using MS-MPI whitepaper (15 page doc).

11. Tracing MPI applications (27 page doc).

12. Using Microsoft MPI (TechNet section).

13. Windows HPC Server MPI forum (for posting questions).

MPI.NET
14. MPI.NET Home Page (not owned by Microsoft).
15. MPI.NET Tutorial.

16. HPC Development using F# using MPI.NET (38 page doc).

Next time I'll post resources for the Microsoft Cluster SOA programming model - happy coding...

Comments about this post welcome at the original blog.

© Daniel Moth or respective owner

Related posts about ParallelComputing

Screencasts introducing C++ AMP

as seen on Daniel Moth - Search for 'Daniel Moth'
It has been almost 2.5 years since I last recorded a screencast, and I had forgotten how time consuming they are to plan/record/edit/produce/publish, but at the same time so much fun to see the end result! So below are links to 4 screencasts to teach you C++ AMP basics from scratch (even if you class… >>> More
C++ AMP Video Overview

as seen on Daniel Moth - Search for 'Daniel Moth'
I hope to be recording some C++ AMP screencasts for channel9 soon (you'll find them through my regular screencasts link on the left), and in all of them I will assume you have watched this short interview overview of C++ AMP. Note: I think there were some technical problems with streaming… >>> More
GPGPU

as seen on Daniel Moth - Search for 'Daniel Moth'
WhatGPU obviously stands for Graphics Processing Unit (the silicon powering the display you are using to read this blog post). The extra GP in front of that stands for General Purpose computing.So, altogether GPGPU refers to computing we can perform on GPU for purposes beyond just drawing on the screen… >>> More
GPU Debugging with VS 11

as seen on Daniel Moth - Search for 'Daniel Moth'
With VS 11 Developer Preview we have invested tremendously in parallel debugging for both CPU (managed and native) and GPU debugging. I'll be doing a whole bunch of blog posts on those topics, and in this post I just wanted to get people started with GPU debugging, i.e. with debugging C++ AMP code… >>> More
Microsoft Windows HPC Server R2 Beta2

as seen on Daniel Moth - Search for 'Daniel Moth'
Internally and unofficially we refer to this as "HPC Server v3" and its Beta2 became available last week. Read the full story on this blog post from Ryan and this one from Don. There has been a lot of excitement on the web for this release with coverage from last Wednesday here, here, here… >>> More

Related posts about hpc

Windows HPC Server links

as seen on Daniel Moth - Search for 'Daniel Moth'
I've already described how to setup a Windows HPC Server for development. Before you dive into developing for the cluster, if you are new to this it is probably a good idea to learn the basics by reading some overview material. Below is a list of links.Direct Links to Windows HPC content1. Windows… >>> More
Azure Grid Computing - Worker Roles as HPC Compute Nodes

as seen on Geeks with Blogs - Search for 'Geeks with Blogs'
Overview · With HPC 2008 R2 SP1 You can add Azure worker roles as compute nodes in a local Windows HPC Server cluster. · The subscription for Windows Azure like any other Azure Service - charged for the time that the role instances are available, as well as for the compute and storage… >>> More
Penguin's HPC Waddle

as seen on Internet.com - Search for 'Internet.com'
Server Snapshot: Penguin Computing has always, as its name implies, focused on developing best practices for Linux-based systems, software and services, particularly in the HPC space. >>> More
Penguin's HPC Waddle

as seen on Internet.com - Search for 'Internet.com'
Server Snapshot: Penguin Computing has always, as its name implies, focused on developing best practices for Linux-based systems, software and services, particularly in the HPC space. >>> More
Appro: Bringing HPC to the Mainstream Enterprise

as seen on Internet.com - Search for 'Internet.com'
Server Snapshot: Appro has always been about HPC. But HPC is not what it used to be, and Appro has changed to meet the needs of more mainstream enterprises with its revamped product lines built around a Scalable Unit architecture. >>> More