Correct way to use MPI with cmdstanpy

using MPI only makes sense with map_rect, as that’s what’s needed to spread the computation across processes.

if you can use reduce_sum to compute what you want to compute, that amount of parallelism might be good enough.

1 Like