Instructions: Ask to attend in the hangouts interface and someone should let you in in the first 10 minutes of the meeting. This may not work July 4 since Breck is not attending. Email breck@mc-stan.org if you have problems or want to attend the physical meeting in New York City.
This will maybe get used in the meeting. I created a zoom invite to post here:
Frederick Baldwin is inviting you to a scheduled Zoom meeting.
Topic: Test ZOOM
Time: Dec 3, 2020 11:00 AM Eastern Time (US and Canada)
Join Zoom Meeting
Meeting ID: 999 0530 9465
Passcode: 009999
One tap mobile
+16468769923,99905309465#,0#,009999# US (New York)
+13126266799,99905309465#,0#,009999# US (Chicago)
Dial by your location
+1 646 876 9923 US (New York)
+1 312 626 6799 US (Chicago)
+1 301 715 8592 US (Washington D.C)
+1 346 248 7799 US (Houston)
+1 669 900 6833 US (San Jose)
+1 253 215 8782 US (Tacoma)
Meeting ID: 999 0530 9465
Passcode: 009999
Find your local number: https://columbiauniversity.zoom.us/u/ad2Swl81DV
see figure 2 a. In their example the adjoint method is faster with just 3 parameters in comparison to forward (with 47 states).
So if either the number of parameters or the number of states is large, then the adjoint method is winning. For smallish PK/PD problems with 5 states and 5 parameters forward may actually be fine, but having adjoint ODE in Stan is still a nice thing for the future.
@wds15 Thank you for sharing the article, I’ll dive into it.
I’m linking the article which compares various autodiff methods for differential equations in Julia, with some examples from the PKPD litterature: https://arxiv.org/pdf/1812.01892.pdf.
Ideally, Stan would let the user choose which differentiation method to use (forward, adjoint, and maybe more). @bbbales2, I remember you were working on implementing the adjoint method in Stan and per this last thread, things seemed to be moving forward pretty smoothly: Adjoint task force for ODEs Are there any updates on this?
@wds15 It makes sense that with a small number of parameters, K, but a large number of states, N, the adjoint method outperforms forward sensitivity, given they respectively solve 2N +K and N + NK states. Figure 2 in the paper I linked (Rackauckas et al, 2018) examine a 2 state PDE, which is why you need \sim10^{2.5} parameters before you get any gain from the adjoint method. With 47 states, yes, it’s a different story.