A custom family for brms with natural scale reparametrization is available here: Modelling sigma - #6 by StaffanBetner
The only that is missing in that comment is the init = "0"
statement, which seems to be needed.
One alternative might be to use random intercepts with correlation between mu and sigma, to estimate the correlation within the model.