Pooled warmup

[betanalpha]

Correct – see also the progression I suggested in the other thread,

@betanalpha

Personally I think that we want to prioritize chain parallelization first because it is beneficial in of itself.

1. Service routes that run multiple chains and create multiple streams of output.
2. Parallelizing those routes, allowing all of the interfaces consistent parallelization without having to implement it themselves.
3. Progressive warmup to allow for intra chain communication.
4. Adaptive warmup through that intra chain communication.

In addition to setting up new adaptation strategies 1 and 2 alone would allow the interfaces to simplify quite a bit and provide a more coherent user experience.