Non-smooth posterior and KKT problem

I would suggest one possible solution by combining Zaps to avoid the funnel and model averaging.

A strong boundary-avoid prior adds log-convexity, which is easy to sample from or optimize on. On the other hand, a true zero is also easy to handle. In the end, stacking gives the optimal weights.