Yeah, I don’t know what that really means, but I think it is a waste of time to try to keep up fighting superior future technologies with C++ and python and all those things… best is to ditch all those dead ends and rewrite Stan in Scala.
The problem is that Stan won’t stand a chance in the cloud agains the competitors which are now being written in Scala, say Rainier, and who else is also writing HMC on top of Spark and so on … all in Scala, pure, 100% Scala code…
I don’t want to explain why Scala is good, what surprises me is that people actually decided to use it because it is difficult to get good at it. But apparently money talks - and in the cloud ML world the companies who are trying to fight with swords against tanks will loose.
So, wrapper this, wrapper that, is a nice start, but won’t last long.
Rainier is just mind blowingly smartly written. Why ? Because the language is powerful and clever people can write super powerful stuff in it in no time.
I am no good programmer, but I see it. There are some clever people who can use Scala and create something in 2 years that would take 20 for a 20 man team. Like my friend, who recently made his first 1M$ coz he wrote a solid Scala web app (he is a pro - I were not able to write it). Anyway, what I say is, ditch C++, look at Rainier and take what you can, put all the cleverness and smartness into a nice piece of Scala code and that can be the future of Stan. Something that will work on 10000 cores.
Not C++ or python or whatever else… but most of you guys are CS people so I don’t have to explain this too much.
I am saying, ScalaStan is awesome but it is just a wrapper. Rainier is the same as Stan but 100% Scala, and if they want, they can push it to 10000 cores using monix in two days of coding.
Scala is powerful, and there is lot of money in big data + AI, and for that, Scala is the most economical technology to create software that works on top of spark, cloud, whatnot.
So… this is no big news. I am not going to bring this up again. It’s already almost too late. But just in case… if you guys want that Stan survives then it will need to be rewritten into Scala. I am getting tired of being a broken record and keep saying this.
BTW, I found this awesome stuff on deep learning:
In my opinion it really thightly connects to HMC (I came to similar
realisations from thermodynamical / statistical physical arguments).
So… deep learning might have to do quite a lot with HMC…
I won’t be surprised if the two will meet halfway.
Over and out.
Ditch C++ and reimplement Stan in Scala, otherwise it won’t have a future. Sad, but inevitable.