First element of solution : I avoided BFMI problems and divergent transitions by remplacing the estimated mean of factors by 0.
L_lower ~ normal(0, sigma_lower); //Regularizing prior for lower loadings
I will check if I this code can recover parameters from a simulated data set.