I prefer to summarize as the last step in order to carry uncertainty forward. If you summarize already summarized estimates you will likely get a false sense of reduced uncertainty in the estimates.
This is a nice post regarding the difference between fitted and predict