Dear Stan community, I’m trying to understand how probabilistic computatuon works. I have a conceptual idea of what typical set is and why it is importan to explore it. However, need help in trying to connect the typical and transition functions. How does a markov chain with a given transition fun…

Is there any threads showing how to generate correlated samples (Markov transitions) that preserve a target density and see how these samples are atracted to the typical set and not to where the density lies. I still do not clearly understand why the correlated samples are atracted to the probabil…

That’s a task for @betanalpha and his geometrical arguments.

See introduction to probabilistic comptutation and then introduction to Markov chain Monte Carlo . I have plenty more writing in this direction on my website, https://betanalpha.github.io/writing/ .

Is this correct? Due to the nature (they concentrate on the typical set) and interdependency of the samples (MCMC) we can say that we are exploring the typical set of the target probability distribution.

[image] nipnipj: we can say that we are exploring the typical set of the target probability distribution. Yes. But you have to be careful what “exploring” means. It only explores enough to compute expectations. It’s not going to explore the whole posterior. This is easy to see in a high d…

Hamiltonian monte carlo comes in because we need a transition mechanism that is better in the sense that it doesn’t get easily stuck in any region or it does longer jumps between samples across the typical set, allowing the exploration of more regions of this typical set?

Markov chain and typical set

General

maxbiostat April 7, 2020, 7:30pm 2

Take a look here and here and please come back with questions if you have them.

Topic		Replies	Views
Explore different typical sets in HMC General mcmc	4	1385	December 6, 2021
The typical set and its relevance to Bayesian computation Algorithms	40	5695	April 12, 2021
HMC samples not from the posterior, but from the typical set? General	8	1952	May 7, 2019
Developing a Deeper Intuition for HMC: Connecting the Underlying Concepts with the Hamiltonian Equations Algorithms techniques , mcmc , math	10	577	January 17, 2025
Concentration of measure and typical sets General stan-math	29	4828	January 6, 2018

Markov chain and typical set

Related topics