Help with test failures with no diagnostics?

Developers
1

I’m on branch feature/0123-complex-var in stan-dev:math and am getting a failure I don’t understand and have no idea how to debug:

make -j5 test/unit/math/rev/mat/eigen_plugins_test test/unit/math/rev/mat/functor/algebra_solver_fp_test test/unit/math/rev/mat/functor/map_rect_concurrent_test test/unit/math/rev/mat/functor/cvodes_ode_data_rev_test test/unit/math/rev/mat/functor/integrate_ode_adams_prim_test test/unit/math/rev/mat/functor/adj_jac_apply_test test/unit/math/rev/mat/functor/integrate_ode_adams_rev_test test/unit/math/rev/mat/functor/map_rect_mpi_test test/unit/math/rev/mat/functor/gradient_test test/unit/math/rev/mat/functor/integrate_ode_bdf_rev_test test/unit/math/rev/mat/functor/map_rect_concurrent_threads_test test/unit/math/rev/mat/functor/idas_integrator_test test/unit/math/rev/mat/functor/integrate_ode_cvodes_grad_rev_test test/unit/math/rev/mat/functor/integrate_dae_test test/unit/math/rev/mat/functor/integrate_ode_bdf_prim_test test/unit/math/rev/mat/functor/cvodes_ode_data_prim_test test/unit/math/rev/mat/functor/map_rect_mpi_prim_test test/unit/math/rev/mat/functor/algebra_solver_test test/unit/math/rev/mat/functor/idas_system_test test/unit/math/rev/mat/functor/map_rect_concurrent_prim_test test/unit/math/rev/mat/functor/map_rect_prim_test test/unit/math/rev/mat/prob/poisson_log_glm_lpmf_test test/unit/math/rev/mat/prob/multi_normal_prec_test test/unit/math/rev/mat/prob/bernoulli_logit_glm_lpmf_test test/unit/math/rev/mat/prob/multinomial_test test/unit/math/rev/mat/prob/ordered_logistic_test test/unit/math/rev/mat/prob/neg_binomial_2_log_glm_lpmf_test test/unit/math/rev/mat/prob/normal_id_glm_lpdf_test test/unit/math/rev/mat/prob/multi_student_t2_test test/unit/math/rev/mat/prob/multi_gp2_test test/unit/math/rev/mat/prob/categorical2_test test/unit/math/rev/mat/prob/multi_normal_cholesky2_test test/unit/math/rev/mat/prob/categorical_logit_glm_lpmf_test test/unit/math/rev/mat/prob/dirichlet2_test test/unit/math/rev/mat/prob/lkj_corr_test test/unit/math/rev/mat/prob/multi_normal_prec2_test test/unit/math/rev/mat/prob/multi_normal2_test test/unit/math/rev/mat/prob/ordered_logistic_glm_lpmf_test test/unit/math/rev/mat/prob/multi_gp_cholesky2_test test/unit/math/rev/mat/prob/multi_normal_cholesky_test test/unit/math/rev/mat/prob/wishart_test test/unit/math/rev/mat/prob/inv_wishart2_test test/unit/math/rev/mat/err/check_greater_or_equal_test test/unit/math/rev/mat/err/check_less_test test/unit/math/rev/mat/err/check_consistent_size_test test/unit/math/rev/mat/err/check_consistent_sizes_test test/unit/math/rev/mat/err/check_positive_test test/unit/math/rev/mat/err/check_positive_finite_test test/unit/math/rev/mat/err/check_pos_definite_test test/unit/math/rev/mat/err/check_pos_semidefinite_test test/unit/math/rev/mat/err/check_less_or_equal_test test/unit/math/rev/mat/err/check_nonzero_size_test test/unit/math/rev/mat/err/check_greater_test test/unit/math/rev/mat/fun/cols_test test/unit/math/rev/mat/fun/gp_periodic_cov_test test/unit/math/rev/mat/fun/gp_exp_quad_cov_test test/unit/math/rev/mat/fun/value_of_test test/unit/math/rev/mat/fun/get_lp_test test/unit/math/rev/mat/fun/rows_test test/unit/math/rev/mat/fun/multiply_test test/unit/math/rev/mat/fun/sort_indices_test test/unit/math/rev/mat/fun/LDLT_factor_test test/unit/math/rev/mat/fun/cov_exp_quad_test test/unit/math/rev/mat/fun/to_var_test test/unit/math/rev/mat/fun/accumulator_test test/unit/math/rev/mat/fun/value_of_rec_test test/unit/math/rev/mat/fun/misc_test test/unit/math/rev/mat/fun/assign_test test/unit/math/rev/mat/fun/initialize_variable_test test/unit/math/rev/mat/fun/fill_test test/unit/math/rev/mat/fun/stored_gradient_vari_test test/unit/math/rev/mat/fun/initialize_test test/unit/math/rev/mat/fun/mdivide_left_tri_test test/unit/math/rev/mat/fun/LDLT_alloc_test test/unit/math/rev/mat/fun/promote_common_test test/unit/math/rev/core/operator_logical_or_test test/unit/math/rev/core/precomputed_gradients_test test/unit/math/rev/core/agrad_test test/unit/math/rev/core/operator_logical_and_test test/unit/math/rev/core/vari_test test/unit/math/rev/core/precomp_vv_vari_test test/unit/math/rev/core/precomp_v_vari_test test/unit/math/rev/core/std_complex_test test/unit/math/rev/core/operator_unary_not_test test/unit/math/rev/core/var_test test/unit/math/rev/core/var_stack_test test/unit/math/rev/core/precomp_vvv_vari_test test/unit/math/rev/core/build_vari_array_test test/unit/math/rev/core/thread_stack_instance_test test/unit/math/rev/arr/functor/coupled_ode_observer_test test/unit/math/rev/arr/functor/integrate_ode_rk45_grad_test test/unit/math/rev/arr/functor/.#integrate_1d_test test/unit/math/rev/arr/functor/integrate_ode_rk45_tooMuchWork_test test/unit/math/rev/arr/functor/integrate_1d_test test/unit/math/rev/arr/functor/coupled_ode_system_test test/unit/math/rev/arr/functor/integrate_ode_rk45_test test/unit/math/rev/arr/err/check_greater_or_equal_test test/unit/math/rev/arr/err/check_less_test test/unit/math/rev/arr/err/check_consistent_size_test test/unit/math/rev/arr/err/check_consistent_sizes_test test/unit/math/rev/arr/err/check_finite_test test/unit/math/rev/arr/err/check_not_nan_test test/unit/math/rev/arr/err/check_nonnegative_test test/unit/math/rev/arr/err/check_positive_test test/unit/math/rev/arr/err/domain_error_vec_test test/unit/math/rev/arr/err/check_bounded_test test/unit/math/rev/arr/err/invalid_argument_vec_test test/unit/math/rev/arr/err/check_positive_finite_test test/unit/math/rev/arr/err/out_of_range_test test/unit/math/rev/arr/err/check_less_or_equal_test test/unit/math/rev/arr/err/check_greater_test test/unit/math/rev/arr/fun/value_of_test test/unit/math/rev/arr/fun/value_of_rec_test test/unit/math/rev/meta/ad_promotable_test test/unit/math/rev/meta/operands_and_partials_test test/unit/math/rev/meta/is_fvar_test test/unit/math/rev/meta/return_type_test test/unit/math/rev/meta/is_var_or_arithmetic_test test/unit/math/rev/meta/partials_return_type_test test/unit/math/rev/meta/VectorBuilderHelper_test test/unit/math/rev/meta/partials_type_test test/unit/math/rev/meta/require_generics_test test/unit/math/rev/meta/VectorBuilder_test test/unit/math/rev/meta/child_type_test test/unit/math/rev/meta/is_var_test test/unit/math/rev/meta/include_summand_test test/unit/math/rev/meta/is_constant_all_test test/unit/math/rev/scal/prob/normal_ccdf_log_test test/unit/math/rev/scal/prob/neg_binomial_2_test test/unit/math/rev/scal/prob/normal_cdf_test test/unit/math/rev/scal/prob/normal_cdf_log_test test/unit/math/rev/scal/prob/normal_log_test test/unit/math/rev/scal/err/check_greater_or_equal_test test/unit/math/rev/scal/err/check_less_test test/unit/math/rev/scal/err/check_finite_test test/unit/math/rev/scal/err/check_not_nan_test test/unit/math/rev/scal/err/invalid_argument_test test/unit/math/rev/scal/err/check_nonnegative_test test/unit/math/rev/scal/err/domain_error_test test/unit/math/rev/scal/err/check_positive_test test/unit/math/rev/scal/err/check_bounded_test test/unit/math/rev/scal/err/check_positive_finite_test test/unit/math/rev/scal/err/check_less_or_equal_test test/unit/math/rev/scal/err/check_greater_test test/unit/math/rev/scal/fun/as_bool_test test/unit/math/rev/scal/fun/if_else_test test/unit/math/rev/scal/fun/int_step_test test/unit/math/rev/scal/fun/value_of_test test/unit/math/rev/scal/fun/is_any_nan_test test/unit/math/rev/scal/fun/primitive_value_test test/unit/math/rev/scal/fun/promote_scalar_test test/unit/math/rev/scal/fun/value_of_rec_test test/unit/math/rev/scal/fun/is_uninitialized_test test/unit/math/rev/scal/fun/is_nan_test test/unit/math/rev/scal/fun/ibeta_test test/unit/math/rev/scal/fun/is_inf_test failed

There’s no earlier failure, just this:

~/cmdstan/stan/lib/stan_math(feature/0123-complex-var)$ ./runTests.py  -j5 test/unit/math/rev
------------------------------------------------------------
make -j5 test/unit/math/rev/mat/eigen_plugins_test test/unit/math/rev/mat/functor/algebra_solver_fp_test test/unit/math/rev/mat/functor/map_rect_concurrent_test test/unit/math/rev/mat/functor/cvodes_ode_data_rev_test test/unit/math/rev/mat/functor/integrate_ode_adams_prim_test test/unit/math/rev/mat/functor/adj_jac_apply_test test/unit/math/rev/mat/functor/integrate_ode_adams_rev_test test/unit/math/rev/mat/functor/map_rect_mpi_test test/unit/math/rev/mat/functor/gradient_test test/unit/math/rev/mat/functor/integrate_ode_bdf_rev_test test/unit/math/rev/mat/functor/map_rect_concurrent_threads_test test/unit/math/rev/mat/functor/idas_integrator_test test/unit/math/rev/mat/functor/integrate_ode_cvodes_grad_rev_test test/unit/math/rev/mat/functor/integrate_dae_test test/unit/math/rev/mat/functor/integrate_ode_bdf_prim_test test/unit/math/rev/mat/functor/cvodes_ode_data_prim_test test/unit/math/rev/mat/functor/map_rect_mpi_prim_test test/unit/math/rev/mat/functor/algebra_solver_test test/unit/math/rev/mat/functor/idas_system_test test/unit/math/rev/mat/functor/map_rect_concurrent_prim_test test/unit/math/rev/mat/functor/map_rect_prim_test test/unit/math/rev/mat/prob/poisson_log_glm_lpmf_test test/unit/math/rev/mat/prob/multi_normal_prec_test test/unit/math/rev/mat/prob/bernoulli_logit_glm_lpmf_test test/unit/math/rev/mat/prob/multinomial_test test/unit/math/rev/mat/prob/ordered_logistic_test test/unit/math/rev/mat/prob/neg_binomial_2_log_glm_lpmf_test test/unit/math/rev/mat/prob/normal_id_glm_lpdf_test test/unit/math/rev/mat/prob/multi_student_t2_test test/unit/math/rev/mat/prob/multi_gp2_test test/unit/math/rev/mat/prob/categorical2_test test/unit/math/rev/mat/prob/multi_normal_cholesky2_test test/unit/math/rev/mat/prob/categorical_logit_glm_lpmf_test test/unit/math/rev/mat/prob/dirichlet2_test test/unit/math/rev/mat/prob/lkj_corr_test test/unit/math/rev/mat/prob/multi_normal_prec2_test test/unit/math/rev/mat/prob/multi_normal2_test test/unit/math/rev/mat/prob/ordered_logistic_glm_lpmf_test test/unit/math/rev/mat/prob/multi_gp_cholesky2_test test/unit/math/rev/mat/prob/multi_normal_cholesky_test test/unit/math/rev/mat/prob/wishart_test test/unit/math/rev/mat/prob/inv_wishart2_test test/unit/math/rev/mat/err/check_greater_or_equal_test test/unit/math/rev/mat/err/check_less_test test/unit/math/rev/mat/err/check_consistent_size_test test/unit/math/rev/mat/err/check_consistent_sizes_test test/unit/math/rev/mat/err/check_positive_test test/unit/math/rev/mat/err/check_positive_finite_test test/unit/math/rev/mat/err/check_pos_definite_test test/unit/math/rev/mat/err/check_pos_semidefinite_test test/unit/math/rev/mat/err/check_less_or_equal_test test/unit/math/rev/mat/err/check_nonzero_size_test test/unit/math/rev/mat/err/check_greater_test test/unit/math/rev/mat/fun/cols_test test/unit/math/rev/mat/fun/gp_periodic_cov_test test/unit/math/rev/mat/fun/gp_exp_quad_cov_test test/unit/math/rev/mat/fun/value_of_test test/unit/math/rev/mat/fun/get_lp_test test/unit/math/rev/mat/fun/rows_test test/unit/math/rev/mat/fun/multiply_test test/unit/math/rev/mat/fun/sort_indices_test test/unit/math/rev/mat/fun/LDLT_factor_test test/unit/math/rev/mat/fun/cov_exp_quad_test test/unit/math/rev/mat/fun/to_var_test test/unit/math/rev/mat/fun/accumulator_test test/unit/math/rev/mat/fun/value_of_rec_test test/unit/math/rev/mat/fun/misc_test test/unit/math/rev/mat/fun/assign_test test/unit/math/rev/mat/fun/initialize_variable_test test/unit/math/rev/mat/fun/fill_test test/unit/math/rev/mat/fun/stored_gradient_vari_test test/unit/math/rev/mat/fun/initialize_test test/unit/math/rev/mat/fun/mdivide_left_tri_test test/unit/math/rev/mat/fun/LDLT_alloc_test test/unit/math/rev/mat/fun/promote_common_test test/unit/math/rev/core/operator_logical_or_test test/unit/math/rev/core/precomputed_gradients_test test/unit/math/rev/core/agrad_test test/unit/math/rev/core/operator_logical_and_test test/unit/math/rev/core/vari_test test/unit/math/rev/core/precomp_vv_vari_test test/unit/math/rev/core/precomp_v_vari_test test/unit/math/rev/core/std_complex_test test/unit/math/rev/core/operator_unary_not_test test/unit/math/rev/core/var_test test/unit/math/rev/core/var_stack_test test/unit/math/rev/core/precomp_vvv_vari_test test/unit/math/rev/core/build_vari_array_test test/unit/math/rev/core/thread_stack_instance_test test/unit/math/rev/arr/functor/coupled_ode_observer_test test/unit/math/rev/arr/functor/integrate_ode_rk45_grad_test test/unit/math/rev/arr/functor/.#integrate_1d_test test/unit/math/rev/arr/functor/integrate_ode_rk45_tooMuchWork_test test/unit/math/rev/arr/functor/integrate_1d_test test/unit/math/rev/arr/functor/coupled_ode_system_test test/unit/math/rev/arr/functor/integrate_ode_rk45_test test/unit/math/rev/arr/err/check_greater_or_equal_test test/unit/math/rev/arr/err/check_less_test test/unit/math/rev/arr/err/check_consistent_size_test test/unit/math/rev/arr/err/check_consistent_sizes_test test/unit/math/rev/arr/err/check_finite_test test/unit/math/rev/arr/err/check_not_nan_test test/unit/math/rev/arr/err/check_nonnegative_test test/unit/math/rev/arr/err/check_positive_test test/unit/math/rev/arr/err/domain_error_vec_test test/unit/math/rev/arr/err/check_bounded_test test/unit/math/rev/arr/err/invalid_argument_vec_test test/unit/math/rev/arr/err/check_positive_finite_test test/unit/math/rev/arr/err/out_of_range_test test/unit/math/rev/arr/err/check_less_or_equal_test test/unit/math/rev/arr/err/check_greater_test test/unit/math/rev/arr/fun/value_of_test test/unit/math/rev/arr/fun/value_of_rec_test test/unit/math/rev/meta/ad_promotable_test test/unit/math/rev/meta/operands_and_partials_test test/unit/math/rev/meta/is_fvar_test test/unit/math/rev/meta/return_type_test test/unit/math/rev/meta/is_var_or_arithmetic_test test/unit/math/rev/meta/partials_return_type_test test/unit/math/rev/meta/VectorBuilderHelper_test test/unit/math/rev/meta/partials_type_test test/unit/math/rev/meta/require_generics_test test/unit/math/rev/meta/VectorBuilder_test test/unit/math/rev/meta/child_type_test test/unit/math/rev/meta/is_var_test test/unit/math/rev/meta/include_summand_test test/unit/math/rev/meta/is_constant_all_test test/unit/math/rev/scal/prob/normal_ccdf_log_test test/unit/math/rev/scal/prob/neg_binomial_2_test test/unit/math/rev/scal/prob/normal_cdf_test test/unit/math/rev/scal/prob/normal_cdf_log_test test/unit/math/rev/scal/prob/normal_log_test test/unit/math/rev/scal/err/check_greater_or_equal_test test/unit/math/rev/scal/err/check_less_test test/unit/math/rev/scal/err/check_finite_test test/unit/math/rev/scal/err/check_not_nan_test test/unit/math/rev/scal/err/invalid_argument_test test/unit/math/rev/scal/err/check_nonnegative_test test/unit/math/rev/scal/err/domain_error_test test/unit/math/rev/scal/err/check_positive_test test/unit/math/rev/scal/err/check_bounded_test test/unit/math/rev/scal/err/check_positive_finite_test test/unit/math/rev/scal/err/check_less_or_equal_test test/unit/math/rev/scal/err/check_greater_test test/unit/math/rev/scal/fun/as_bool_test test/unit/math/rev/scal/fun/if_else_test test/unit/math/rev/scal/fun/int_step_test test/unit/math/rev/scal/fun/value_of_test test/unit/math/rev/scal/fun/is_any_nan_test test/unit/math/rev/scal/fun/primitive_value_test test/unit/math/rev/scal/fun/promote_scalar_test test/unit/math/rev/scal/fun/value_of_rec_test test/unit/math/rev/scal/fun/is_uninitialized_test test/unit/math/rev/scal/fun/is_nan_test test/unit/math/rev/scal/fun/ibeta_test test/unit/math/rev/scal/fun/is_inf_test
clang++ -std=c++1y -Wno-unknown-warning-option -Wno-tautological-compare -Wno-sign-compare -D_REENTRANT       -I lib/tbb_2019_U8/include -O0  -I . -I lib/eigen_3.3.3 -I lib/boost_1.69.0 -I lib/sundials_4.1.0/include -I lib/gtest_1.8.1/include -I lib/gtest_1.8.1     -DBOOST_DISABLE_ASSERTS       -c -MT test/unit/math/rev/scal/fun/is_inf_test.o -MM -E -MG -MP -MF test/unit/math/rev/scal/fun/is_inf_test.d test/unit/math/rev/scal/fun/is_inf_test.cpp
...
clang++ -std=c++1y -Wno-unknown-warning-option -Wno-tautological-compare -Wno-sign-compare -D_REENTRANT       -I lib/tbb_2019_U8/include -O0  -I . -I lib/eigen_3.3.3 -I lib/boost_1.69.0 -I lib/sundials_4.1.0/include -I lib/gtest_1.8.1/include -I lib/gtest_1.8.1     -DBOOST_DISABLE_ASSERTS             -Wl,-L,"/Users/carp/cmdstan/stan/lib/stan_math/lib/tbb" -Wl,-rpath,"/Users/carp/cmdstan/stan/lib/stan_math/lib/tbb"  test/unit/math/rev/scal/fun/is_inf_test.o lib/gtest_1.8.1/src/gtest_main.cc lib/gtest_1.8.1/src/gtest-all.o lib/tbb/libtbb.dylib lib/tbb/libtbbmalloc.dylib lib/tbb/libtbbmalloc_proxy.dylib         -o test/unit/math/rev/scal/fun/is_inf_test
2

Is this real or just a typo in copy-pasting the error?

Have you tried bisecting over that list of test, to narrow down the one that fails?

2 Likes
3

Excellent eyes! Thanks!

I had just returned to this post to say my code’s working now. That must be because I removed .#integrate_1d_test when I saved the file to commit so that someone else could help me debug. Now at least it makes sense why it didn’t work before!