Apologies for posting two questions back to back. You guys at the Stan team have been a big help to me over the years, and I feel like I owe you guys all at least a beer each at some point.
Anyhow, I remember three years ago or so hearing that Charles Margossian was working on adding non-linear ODE root solving functions into Stan to make it possible to initiate non-linear ODEs at steady state such that it would be easier to fit non-linear ODE systems to response data without needing to “spin up” the ODEs, which would then cause each MCMC iteration to take an astronomically long time. Googling around, it doesn’t seem like non-linear root solving was ultimately added, I am presuming that goal got tabled?
The current algebraic solver uses the dogleg method. @yizhang and I are also adding a Newton-Krylov method (KINSOL) and a fixed point solver. These solvers should be faster. Both features are in math and need to be exposed to the language. So expect them in the next Stan release.
Saw the addition of the Newton-Krylov method on Github, this is huge. Thanks to you and @yizhang for implementing this, this is a big help for implementation of non-linear models.