I’m trying to fit a nonlinear model on not particularly many observations, and it occasionally crashes my computer forcing me to reset. Running on 1 core seems to always work, 2 cores sometimes crashes, and 3 cores crashes fairly regularly: it’s stochastic, which is most annoying of all. I would …

Also, the 10th gen Intel added some new multi core speed boost stuff. If you are doing any over clocking on the CPU or memory (or even if you aren’t), you may want to head into the BIOS and turn the CPU and memory speed down 10% or so to ensure stability.

The thing that is the most weird here is that we are not able to reproduce. I am not familiar with Pop!OS. Going to try to install it as a virtual machine if that would help.

[image] mathesong: Same installation Ok, then the error is probably in Stan part. Could you try to install a new cmdstan with CmdStanPy? python -m cmdstanpy.install_cmdstan And then run the model again. (You can remove the cmdstan from ~/.cmdstanpy folder after the test)

[image] STAN on multiple cores occasionally crashing Linux without overwhelming memory General Ok, then the error is probably in Stan part. Could you try to install a new cmdstan with CmdStanPy? python -m cmdstanpy.install_cmdstan And then run the model again. (You can …

And the valgrind is now finished after 10 hours. Attached here: valgrid_out.txt (49.0 KB)

I’m not any C++ expert, but the first warnings are normal (?) and given that your ram hasn’t filled, are probably not the reason for the behaviour. The second error, is there a possibility that {Eigen, Matrix, resize} -block gets collected at some point but our program still tries to use it? Would …

Sure - it’s here: cmdstanr_test.hpp (134.8 KB)

You don’t mention the hardware or if this is a virtual machine? I would suggest leaving dmesg -w running in a terminal when you crash the machine since there are only so many ways you can crash Linux with a process like Stan and the kernel will usually complain about something.

Thanks for the suggestion! Here’s my inxi -Fxz System: Kernel: 5.4.0-7642-generic x86_64 bits: 64 compiler: gcc v: 9.3.0 Desktop: Gnome 3.36.4 Distro: Pop!_OS 20.04 LTS base: Ubuntu 20.04 LTS Focal Machine: Type: Desktop System: ASUS product: N/A v: N/A serial: <filter> Mobo: ASUSTeK…

Thanks, as I thought, all of that is about the newest stuff that exists (not my boring GCC 4.8.5 on CentOS 7 on Westmere Xeon), so you might be running into a bug under the Stan layer of the stack. Will be interesting to see what the kernel says :popcorn:

STAN on multiple cores occasionally crashing Linux without overwhelming memory

General

stevebronder September 6, 2020, 11:03pm 43

Didn’t @bbbales2 do something like this with campfire?

Edit: Whups sorry wrong thread!

Topic		Replies	Views
Error in unserialize(socklist[[n]]) : error reading from connection Error in serialize(data, node$con, xdr = FALSE) : error writing to connection RStan	52	19183	December 14, 2021
Model makes R crash Modeling fitting-issues , performance	21	2120	September 24, 2017
Rstan error in RStudio - "Cannot allocate memory of 16921.6 GB" RStan	10	1735	November 10, 2019
R crashing with Rstan/brms RStan installation	13	1492	December 29, 2020
Problems with crashing R session Interfaces rstan , performance	65	9374	March 24, 2022

STAN on multiple cores occasionally crashing Linux without overwhelming memory

Related topics