Lately I have been running against many walls when messing with compilers/make/other system related stuff. At the end I was forced to install a VirtualBox on my machine to be able to reproduce errors happening on other systems to make progress.
From this experience I really think that we should make the effort and turn all our testing environments into some docker based thing. The thing is that I am not really experienced with docker. Thus, if people agree that we should do this (I really think so), I am calling out here if people have
- cmdstan docker images suitable as basis for our testing for mac and for linux
- we may consider to use the Travis docker images (but they use a really old 14.04 ubuntu LTS)
… or is setting up docker so simple that someone with Unix experience can get that done in no time?
It is really a huge time-killer if tests break on test-systems, but pass locally which is what this approach should hopefully avoid.