I have coded an analysis using latent difference scores in Stan, with the latent difference scores serving as a predictor in an ordinal regression model. Code is available here: https://osf.io/7xt86/
Might not be completely relevant to your case, my application was for informant discrepancies. But I’d be happy to have a look at your code if you give it a go directly in Stan.