For this case, the parameterization of the simplex that rescales gamma(alpha, 1) primitives avoids the divergences problem and the ordering arbitrariness. See
For the case you are probably actually referring to (i.e. with data), it is hard to tell in advance which parameterization will work best.