Math not passing OpenCL tests on develop for hash `5c6f31f`

It looks like the OpenCL tests on Math are failing right now.

See: Commits · stan-dev/math · GitHub

This is the Jenkins CI run for that git hash: Jenkins

It’s failing in the OpenCL tests with lots of messages like this:

test/unit/math/opencl/prim/symmetric_eigensolver_test.cpp:89: Failure
The difference between A_eval(i) and B_eval(i) is 0.070115523991724701, which exceeds 1e-12, where
A_eval(i) evaluates to -0.035323236122317969,
B_eval(i) evaluates to 0.034792287869406732, and
1e-12 evaluates to 9.9999999999999998e-13.
test/unit/math/opencl/prim/symmetric_eigensolver_test.cpp:89: Failure
The difference between A_eval(i) and B_eval(i) is 0.052748384843405466, which exceeds 1e-12, where
A_eval(i) evaluates to 0.034316939764755909,
B_eval(i) evaluates to -0.018431445078649553, and
1e-12 evaluates to 9.9999999999999998e-13.

Can anyone help identify what’s going on? I’m tagging people that have merged PRs since the last time develop passed.
@serban-nicusor @WardBrian @andrjohns

My guess is that it has to do with this PR from @serban-nicusor: Change label from v100 to k40 for OpenCL GPU tests by serban-nicusor-toptal · Pull Request #2862 · stan-dev/math · GitHub

FYI the background to the linked PR is in this issue: Jenkins OpenCL tests failing on jenkins2 but not jenkins1 · Issue #2860 · stan-dev/math · GitHub

1 Like

Thanks! I didn’t see that issue. Glad you reported it.

Hopefully we can get this resolved soon.