I’m new to using looic, waic, and kfoldic so I have a simple question about interpreting the output of analysis:

kfoldic of model 1 = 48165, se = 233

kfoldic of model 0 = 49332, se = 225

model1 - model 0 = -1166, se = 77

Model 1 has one additional predictor over model 0. I’m wondering if given the change in ic, there is compelling reason to think that model 1 is a better model given the change in ic relative to the SE.

For sufficient number of observations, the IC values (and their differences) are approximately normally distributed witth the given SE. This helps in putting the differences into context. In your case, the difference seems to be rather substantial. You may also compute model weights via function `model_weights()`

and `weights = kfold`

if you want `kfold`

to be used to compute the weights (stacking, which is the default, may be a better option though). In order to avoid recomputing `kfold`

every single time you call `kfold()`

I recommend taking a look at the `add_ic`

function.

2 Likes