Master-worker messaging in ep-stan

techniques

#1

Not sure if this question is appropriate, since its on ep-stan, not on stan proper. ep-stan passes one Q matrix and one r vector between Master and Workers. That works for the simple Bernoulli use case. My model has multiple groups of logistic functions. Can any one suggest whether I should combine the unrelated sets of coefficients into one matrix and one vector, or should I modify the code to work with multiple Q and r parameters? if multiple, it means the ep-stan sample code is not readily generalizable.


#2

What is “ep-stan”?


#3

Python code supplement for "Expectation propagation as a way of life"
https://github.com/gelman/ep-stan

It’s not clear what you mean by multiple groups. Can you show your model code?

Aki


#4

let’s not do this by code. I know how that will go if I throw up a whole page of code. What it is, the model has a dynamic HMM component which calculates the transition probability using logistic regression, that’s one set of parameters. For each HMM state, there is another probability of conversion which is calculated by another set of parameters. there is a third set of parameters, which is involved in estimation of the HMM state. So all together, 3 separate sets of parameters. If I lump all 3 into the current parameter passing matrix, first there needs to be room for more than one set of intercepts, second, it would not make sense to generate covariance terms for parameters that are not in the same sets. My question is therefore, should I modify the ep-stan code to allow multiple sets of parameter passing structures. Hope this is clear.


#5

If these parameters are all for the same data, then they are not separate. If the values of one set of parameters changes, I would assume the conditional posterior for others would change, too.

Even if we would have separate sets of parameters for separate sets of data, the tilted distribution is likely to have dependencies between the parameters if they have common prior.