Variational inference with a mixture of dense and diagonal normals

[martinmodrak]

I don’t think it’s possible, but see Intermediate between mean-field and full-rank ADVI for a somewhat similar case (the low rank ADVI is implemented in a PR that has however not yet been merged into Stan main branch, so you can use it, although with some hassle)