# Multi-dimensional prior distribution

**URL:** <https://discourse.mc-stan.org/t/multi-dimensional-prior-distribution/34173>\
**Category:** Modeling\
**Created:** [February 19, 2024, 8:01pm UTC](https://discourse.mc-stan.org/t/multi-dimensional-prior-distribution/34173 "2024-02-19T20:01:33Z")\
**Posts on this page:** 9\
**Page:** 1

<div class="post-metadata">

**Author:** ![alina](https://avatars.discourse-cdn.com/v4/letter/a/f14d63/32.png) [@alina](https://discourse.mc-stan.org/u/alina)\
**Post date:** [February 19, 2024, 8:01pm UTC](https://discourse.mc-stan.org/t/multi-dimensional-prior-distribution/34173/1 "2024-02-19T20:01:33Z")

</div>

I kindly request your help with specifying a certain prior distribution using set\_prior function in the brms package.

The parameter ˮlogbˮ is 16-dimensional and depends on the covariate ˮcompoundˮ (categorical covariate with 16-levels). I need to set a prior for it, which could be - for instance – a 16-dimensional normal distribution with null covariance.

I fail to write the right R code for such a multidimensional prior and its covariance. Could you please help me?

In case of 1-dimensional prior I used:

set\_prior(“normal(log(2.5), 0.5)”, nlpar = “logb”)

and it worked.

Thanks!

---

<div class="post-metadata">

**Author:** ![jsocolar](https://yyz2.discourse-cdn.com/flex030/user_avatar/discourse.mc-stan.org/jsocolar/32/2486_2.png) [@jsocolar](https://discourse.mc-stan.org/u/jsocolar)\
**Post date:** [February 19, 2024, 9:38pm UTC](https://discourse.mc-stan.org/t/multi-dimensional-prior-distribution/34173/2 "2024-02-19T21:38:21Z")

</div>

can you show us your call to `brm` so we see the formula for the model being fit?

---

<div class="post-metadata">

**Author:** ![alina](https://avatars.discourse-cdn.com/v4/letter/a/f14d63/32.png) [@alina](https://discourse.mc-stan.org/u/alina)\
**Post date:** [February 19, 2024, 10:11pm UTC](https://discourse.mc-stan.org/t/multi-dimensional-prior-distribution/34173/3 "2024-02-19T22:11:30Z")

</div>

Sure.

```r
dr.fun.m6 <- logy ~ loga + log(exp(logc))*(1 - exp(-(x/exp(logb))^exp(logd)))
# variable comp is categorical, with 16 levels

prior_m6 <- c(set_prior("normal(2.3025, 0.22)", nlpar = "loga"),
             set_prior("normal(log(0.85), 0.7891595)", nlpar = "logb"), # logb depends on "comp"
             set_prior("normal(log(2.5), 0.5)", nlpar = "logc"),
             set_prior("normal(0, 0.1732051)", nlpar = "logd"),
             set_prior("cauchy(0, 1)", class = "sd", group = "comp", coef="Intercept", nlpar="loga"),
             set_prior("cauchy(0, 1)", class = "sd", group = "comp", coef="Intercept", nlpar="logd"))

form.m6 = bf(dr.fun.m6, nl = TRUE) + list(logc~1,logb~comp, loga~(1||comp), logd~(1||comp))

n_m6 <- brm(form.m6, data = data.ind.m15, prior = prior_m6, control = list(adapt_delta = 0.90, max_treedepth = 11))

```

edited by @jsocolar for syntax highlighting

---

<div class="post-metadata">

**Author:** ![jsocolar](https://yyz2.discourse-cdn.com/flex030/user_avatar/discourse.mc-stan.org/jsocolar/32/2486_2.png) [@jsocolar](https://discourse.mc-stan.org/u/jsocolar)\
**Post date:** [February 19, 2024, 10:50pm UTC](https://discourse.mc-stan.org/t/multi-dimensional-prior-distribution/34173/4 "2024-02-19T22:50:52Z")

</div>

Just want to check here. in `dr.fun.m6` you have `log(exp(logc))` which is just `logc`. And then you have a triple-exponential of `logd`. Is this the formula you intend?

I think your question might have an easy answer, but then there’s a subtlety that may or may not matter to you. The easy answer is that you 16-dimensional prior with null covariance is what you achieve by putting normal priors on all of the margins, which in turn is what you achieve by assigning some prior to the coefficients for `nlpar = "logb"`. So maybe that already solves your question?

However, now the subtlety: the categorical covariate will get dummy coded with a reference level and 15 non-reference levels, meaning that by setting independent marginal priors on the intercept and then on the 15 coefficients, the 15 non-reference levels will necessarily have higher marginal prior variance than the reference level. One way to avoid this is to code `comp` not as a 16-level factor but as 15 binary covariates coded -1/1 instead of 0/1. Then, if independent, symmetrical, zero-centered priors are assigned to all 15 of those covariates, you will end up with prior symmetry across all of the levels of `comp`. The intercept will no longer correspond to a reference level, but rather to some hypothetical construct that sits directly “in between” belonging to and not belonging to each category.

---

<div class="post-metadata">

**Author:** ![alina](https://avatars.discourse-cdn.com/v4/letter/a/f14d63/32.png) [@alina](https://discourse.mc-stan.org/u/alina)\
**Post date:** [February 22, 2024, 3:18pm UTC](https://discourse.mc-stan.org/t/multi-dimensional-prior-distribution/34173/5 "2024-02-22T15:18:56Z")

</div>

Thank you for the answer. Yes, I confirm that the model formula is correct as it is.

The inconvenience of the first solution is that I can only specify one single prior for all margins of logb, which is not in line with my real data. “Comp” exhibits different effects on different logb’s and this is what I want to have it reflected in the priors.

The second solution is also inconvenient because I lose the interpretation of the effects, to which I attach importance.

Finally, I did not receive answer to my question: is this not possible to specify a multi-dimensional prior as argument in set\_prior?

Thanks.

---

<div class="post-metadata">

**Author:** ![jsocolar](https://yyz2.discourse-cdn.com/flex030/user_avatar/discourse.mc-stan.org/jsocolar/32/2486_2.png) [@jsocolar](https://discourse.mc-stan.org/u/jsocolar)\
**Post date:** [February 22, 2024, 4:32pm UTC](https://discourse.mc-stan.org/t/multi-dimensional-prior-distribution/34173/6 "2024-02-22T16:32:25Z")

</div>

> [@alina](#):
>
> Finally, I did not receive answer to my question: is this not possible to specify a multi-dimensional prior as argument in set\_prior?

Brms has no problem specifying some multidimensional priors, and substantial problem specifying others.

When you call

> [@alina](#):
>
> set\_prior(“normal(log(2.5), 0.5)”, nlpar = “logb”)

this is already a multidimensional prior on the levels of `logb`, it’s just that the covariance is null 15 of the margins are the same, and are all higher variance than the margin of the reference category.

If you want to specify the 16 margins independently, but are still ok with null covariance, you can explicitly unpack the factor covariate to it’s 15 columns in the design matrix as part of your input data, and then pass the desired priors on the coefficients via the `coef` argument in `set_prior`. However, unless you are willing to encode these columns using something other than dummy coding, you will still be restricted to priors in which the prior variance is higher for 15 levels than for the reference level.

As far as I know, it is not possible to specify multivariate priors with non-null covariance except by getting really hack-y at the level of the generated Stan code. If you’d like to get hack-y, you can specify whatever prior you want by using `stanvars` to inject arbitrary Stan code into your model block.

---

<div class="post-metadata">

**Author:** ![Ven\_Popov](https://yyz2.discourse-cdn.com/flex030/user_avatar/discourse.mc-stan.org/ven_popov/32/15885_2.png) [@Ven\_Popov](https://discourse.mc-stan.org/u/Ven_Popov)\
**Post date:** [February 22, 2024, 4:59pm UTC](https://discourse.mc-stan.org/t/multi-dimensional-prior-distribution/34173/7 "2024-02-22T16:59:31Z")

</div>

To add on what @jsocolar already described, if you want to put a different prior on each level of comp, you can change

> [@alina](#):
>
> `logb~comp`

to

```no-highlight
logb ~ 0 + comp

```

which supresses the intercept and will estimate an effect for each level of comp, instead of 1 reference level and 15 differences. Then you can set your priors:

```r
set_prior('whateverprior1', class='b', coef='name_of_level1', nlpar='logb') +
set_prior('whateverprior2', class='b', coef='name_of_level2', nlpar='logb') +
...
set_prior('whateverprior16', class='b', coef='name_of_level16', nlpar='logb') 

```

---

<div class="post-metadata">

**Author:** ![alina](https://avatars.discourse-cdn.com/v4/letter/a/f14d63/32.png) [@alina](https://discourse.mc-stan.org/u/alina)\
**Post date:** [February 27, 2024, 11:12pm UTC](https://discourse.mc-stan.org/t/multi-dimensional-prior-distribution/34173/8 "2024-02-27T23:12:13Z")

</div>

Thank you very much Ven\_Popov, this is exactly what I was looking for! Now it works as I wanted!

---

<div class="post-metadata">

**Author:** ![alina](https://avatars.discourse-cdn.com/v4/letter/a/f14d63/32.png) [@alina](https://discourse.mc-stan.org/u/alina)\
**Post date:** [February 27, 2024, 11:12pm UTC](https://discourse.mc-stan.org/t/multi-dimensional-prior-distribution/34173/9 "2024-02-27T23:12:53Z")

</div>

Thank you for the explanations!