# Hotfix release

**URL:** <https://discourse.mc-stan.org/t/hotfix-release/12871>\
**Category:** Developers\
**Created:** [January 29, 2020, 6:59pm UTC](https://discourse.mc-stan.org/t/hotfix-release/12871 "2020-01-29T18:59:59Z")\
**Posts on this page:** 8\
**Page:** 1

<div class="post-metadata">

**Author:** ![rok\_cesnovar](https://avatars.discourse-cdn.com/v4/letter/r/7bcc69/32.png) [@rok\_cesnovar](https://discourse.mc-stan.org/u/rok_cesnovar)\
**Post date:** [January 29, 2020, 7:00pm UTC](https://discourse.mc-stan.org/t/hotfix-release/12871/1 "2020-01-29T19:00:00Z")

</div>

Those that follow the Github repositories closely are probably aware that we have to do a hotfix release due two separate issues. Thanks to @avehtari, @stevebronder and @bbbales2 for spotting and reporting them.

I am coordinating with @serban-nicusor to make this as painless as possible. We have three issues opened for the three repos if anyone has any questions/comments:

> <https://github.com/stan-dev/math/issues/1659>
>
> Description
> With the merge of #1644 everything is ready to proceed with the hotfix release for Math. This PR fixed #1643 which...

  

> <https://github.com/stan-dev/stan/issues/2883>
>
> Summary:
> We need to do a hotfix release of Stan 2.22. Compared to the current master this will only update the Stan...

  

> <https://github.com/stan-dev/cmdstan/issues/808>
>
> Summary:
> So as we know, we will have to do a hotfix release for Cmdstan. Compared to the current master that will...

The plan is to do the Math 3.1.1 release tonight and then proceed with the rest tomorrow (me and Nic are in the CET timezone).

---

<div class="post-metadata">

**Author:** ![avehtari](https://yyz2.discourse-cdn.com/flex030/user_avatar/discourse.mc-stan.org/avehtari/32/5935_2.png) [@avehtari](https://discourse.mc-stan.org/u/avehtari)\
**Post date:** [January 30, 2020, 11:29am UTC](https://discourse.mc-stan.org/t/hotfix-release/12871/2 "2020-01-30T11:29:15Z")

</div>

How about in the future tagging a release candidate, e.g., a week before and asking people to test? This is quite common in projects with users having diverse system configurations and usage patterns. I didn’t want to test before seeing the New Features list which was available only just before the release, but the problems were quite obvious in my use case.

---

<div class="post-metadata">

**Author:** ![rok\_cesnovar](https://avatars.discourse-cdn.com/v4/letter/r/7bcc69/32.png) [@rok\_cesnovar](https://discourse.mc-stan.org/u/rok_cesnovar)\
**Post date:** [January 30, 2020, 12:26pm UTC](https://discourse.mc-stan.org/t/hotfix-release/12871/3 "2020-01-30T12:26:28Z")

</div>

> [@avehtari](#):
>
> How about in the future tagging a release candidate, e.g., a week before and asking people to test?

We have been doing the “feature freeze week” since 2.21. However, this time, there was no announcement or post on Discourse and that is where things went wrong. We have to do better next time. The same point was made by @syclik and I fully agree with both of you. Someone has to do a post formally stating that we are in a feature freeze and to request testing.

I guess the problem here was also that there was a transition of responsibilities for the release from @seantalts to @jonah and Jonah was away. So no one was officially running the release and the release was coordinated among the rest of developers. We should have maybe postponed the release for that reason.

I decided to jump in to help with the hotfix release even though I was not sanctioned by anyone with more seniority on the project. My thinking was that the longer we waited with the hotfix, the harder it will get. Hopefully, no one took that as a coup.

---

<div class="post-metadata">

**Author:** ![avehtari](https://yyz2.discourse-cdn.com/flex030/user_avatar/discourse.mc-stan.org/avehtari/32/5935_2.png) [@avehtari](https://discourse.mc-stan.org/u/avehtari)\
**Post date:** [January 30, 2020, 12:34pm UTC](https://discourse.mc-stan.org/t/hotfix-release/12871/4 "2020-01-30T12:34:37Z")

</div>

> [@rok\_cesnovar](#):
>
> We have been doing the “feature freeze week” since 2.21. However, this time, there was no announcement or post on Discourse

I do remember feature freeze week, but I don’t remember there being rc-tags. These would help instead of following all the discussion going on github of which commits to cherry pick and which not. “feature freeze week” announcement felt being directed for developers and not for eager users. rc-tags would make it easier to just try install and run.

> [@rok\_cesnovar](#):
>
> I decided to jump in to help with the hotfix release

That was brave thing to do! Thanks for making it happen

---

<div class="post-metadata">

**Author:** ![rok\_cesnovar](https://avatars.discourse-cdn.com/v4/letter/r/7bcc69/32.png) [@rok\_cesnovar](https://discourse.mc-stan.org/u/rok_cesnovar)\
**Post date:** [January 30, 2020, 12:40pm UTC](https://discourse.mc-stan.org/t/hotfix-release/12871/5 "2020-01-30T12:40:44Z")

</div>

> [@avehtari](#):
>
> rc-tags would make it easier to just try install and run.

Great idea. @serban-nicusor we should note that somewhere for the next release.

---

<div class="post-metadata">

**Author:** ![jonah](https://yyz2.discourse-cdn.com/flex030/user_avatar/discourse.mc-stan.org/jonah/32/200_2.png) [@jonah](https://discourse.mc-stan.org/u/jonah)\
**Post date:** [January 31, 2020, 5:19pm UTC](https://discourse.mc-stan.org/t/hotfix-release/12871/6 "2020-01-31T17:19:53Z")

</div>

Sounds good to me, thanks. And thanks to everyone who helped with the hotfix release!

---

<div class="post-metadata">

**Author:** ![wds15](https://yyz2.discourse-cdn.com/flex030/user_avatar/discourse.mc-stan.org/wds15/32/908_2.png) [@wds15](https://discourse.mc-stan.org/u/wds15)\
**Post date:** [February 1, 2020, 11:24am UTC](https://discourse.mc-stan.org/t/hotfix-release/12871/7 "2020-02-01T11:24:15Z")

</div>

Thanks for managing all this… cmdstan is tagged with 2.21.1, but I think the binaries which contain stan + stan-math are not yet build. I thought these would be created with the tagging, but looks like some scripts need to turn their wheels.

---

<div class="post-metadata">

**Author:** ![rok\_cesnovar](https://avatars.discourse-cdn.com/v4/letter/r/7bcc69/32.png) [@rok\_cesnovar](https://discourse.mc-stan.org/u/rok_cesnovar)\
**Post date:** [February 1, 2020, 11:46am UTC](https://discourse.mc-stan.org/t/hotfix-release/12871/8 "2020-02-01T11:46:05Z")

</div>

Nic tagged the release yesterday and he left the tests running so we double check everything is ready. He also didnt have the release notes. The plan is to make the official release + tarball today.
