This is because the autocorrelation structures in brms use a slightly different approach, rather than directly using the previous observations
See this forum post for a bit more background: Autocorrelation added to the model results in outrageous computation time - #2 by martinmodrak