I’m lucky to use 80 cpu, so I’m trying to parallelize about 28 at once.
but, when I tried this, I got error message below.
error occurred during calling the sampler; sampling not done.
I configured that 20 cpu are working, and I got 8 error messages above.
below is my code.
rstan_options(auto_write = T)
options(mc.cores = 40)
cl <- makeCluster(40)
clusterExport(cl,c("IvT_model", "stan_data1", "stan_data2", "stan_data3", "stan_data4", "stan_data5", "stan_data6", "stan_data7"))
result <- parLapply(cl, c(1:7), first_node)
Also, when I tried to parallelize 16 sampling with different data, there comes different error below.
Error in unserialize(node$con) : error reading from connection Calls
As I searched the detail, this problem is come from memory issue. Is it right??
And is there any ways to solve the cpu calling problem??