I’ve worked on a similar problem - without success so far, I might add. Currently, I’m stuck on some programming error, and haven’t had time to work further on it. Having a look at the code might still be useful.
Mixtures are hard, and you probably will have to be able to make assumptions about the number and nature of the classes to succeed. I don’t think you can do this in brms, though.