Stan General Meeting, Dec 3, 2020, 11am EDT

Hangouts Link: https://meet.google.com/gzm-wmum-pfm

Instructions: Ask to attend in the hangouts interface and someone should let you in in the first 10 minutes of the meeting. This may not work July 4 since Breck is not attending. Email breck@mc-stan.org if you have problems or want to attend the physical meeting in New York City.

Meeting Agenda:

Distributed hosting of weekly meeting. Breck

Please add your agenda items in replies.

THIS IS NOT THE MEETING LINK:

This will maybe get used in the meeting. I created a zoom invite to post here:
Frederick Baldwin is inviting you to a scheduled Zoom meeting.

Topic: Test ZOOM
Time: Dec 3, 2020 11:00 AM Eastern Time (US and Canada)

Join Zoom Meeting

Meeting ID: 999 0530 9465
Passcode: 009999
One tap mobile
+16468769923,99905309465#,0#,009999# US (New York)
+13126266799,99905309465#,0#,009999# US (Chicago)

Dial by your location
+1 646 876 9923 US (New York)
+1 312 626 6799 US (Chicago)
+1 301 715 8592 US (Washington D.C)
+1 346 248 7799 US (Houston)
+1 669 900 6833 US (San Jose)
+1 253 215 8782 US (Tacoma)
Meeting ID: 999 0530 9465
Passcode: 009999
Find your local number: https://columbiauniversity.zoom.us/u/ad2Swl81DV

@charlesm93 you keep getting back to adjoint ODEs, which is great. You should have a decent look at the AMICI project here: https://github.com/AMICI-dev/AMICI

they published a performance evaluation of adjoint vs forward: https://journals.plos.org/ploscompbiol/article/file?id=10.1371/journal.pcbi.1005331&type=printable

see figure 2 a. In their example the adjoint method is faster with just 3 parameters in comparison to forward (with 47 states).

So if either the number of parameters or the number of states is large, then the adjoint method is winning. For smallish PK/PD problems with 5 states and 5 parameters forward may actually be fine, but having adjoint ODE in Stan is still a nice thing for the future.

1 Like

@wds15 Thank you for sharing the article, I’ll dive into it.

I’m linking the article which compares various autodiff methods for differential equations in Julia, with some examples from the PKPD litterature: https://arxiv.org/pdf/1812.01892.pdf.

Ideally, Stan would let the user choose which differentiation method to use (forward, adjoint, and maybe more). @bbbales2, I remember you were working on implementing the adjoint method in Stan and per this last thread, things seemed to be moving forward pretty smoothly: Adjoint task force for ODEs Are there any updates on this?

@wds15 It makes sense that with a small number of parameters, K, but a large number of states, N, the adjoint method outperforms forward sensitivity, given they respectively solve 2N +K and N + NK states. Figure 2 in the paper I linked (Rackauckas et al, 2018) examine a 2 state PDE, which is why you need \sim10^{2.5} parameters before you get any gain from the adjoint method. With 47 states, yes, it’s a different story.