Thanks for your suggestions.
I tried several robuts = FALSE, which slightly changed the estimates but not enough to explain the discrepancy, and in the wrong direction as well. Specifying method = posterior_linpred did not change anything. Also tried to set re_formula = NULL as suggested in Ordinal Regression - conditional effects discrepancy , but that also did not help unfortunately.
Not sure what is going on here!