Backend Errors when fitting many models in parallel

[mitzimorris]

why don’t you compile the model once and pass around the exe everywhere?
I did this for a slightly different use case using CmdStanPy and slurm -

Cmdstanpy ValueError with multiprocess

hi Alex, I looked at your code, and if you supply a unique chain_id to your predict function that gets passed along to your call CmdStanPy sample method here: tablespoon/forecasters.py at 61d23c0f44e418e9b840a9356be833f2f992bfa4 · alexhallam/tablespoon · GitHub, then the resulting CSV filenames will be unique. if this helps, below is something I wrote a long time ago when I was playing around with a cluster running SLURM. this is a proof-of-concept demo of how to compile a Stan program once…