A while ago I’ve received a request to create a custom job for performance tests so we can test various scenarios without affecting master/dev. My bad for not posting here for more feedback, but here I am now.
The job can be found here Jenkins Job and you can change parameters and run from here
It lets you run against different cmdstan/stan/math commits, change make local and the number of test iterations.
Please take a look and if there are things to change/improve please let me know so I’ll do it!
As for the results, you can check them out after a run, example here
PS: Please click on view rather than filename in the artifacts view.
Known Issues:
- I couldn’t manage to get windows results into the Build Artifacts, WIP.
Thanks