Q/A Exercise 15

ANSWERS:

Q- Why choosing the distribution order (rows / columns) of the matrix is important?

A- Let's consider the Fortran case with matrix stored over the processes first by colums then by rows. Note how MPI_ALLTOALL works: the jth block sent from process i is received by process j and is placed in the ith block of recvbuf.