Skip to content

Time to the last word.

Play back two decoders on the same clock. Slow the replay down to see when each transcript finishes.

Single A100 · W1

Time to a complete transcript

p99
Fused CTC draft167 ms
vLLM autoregressive520 ms

Playback uses measured end-to-end p99 times from the same W1 benchmark, single-stream on an A100 40 GB. The token animation illustrates progress between endpoints. Over HTTP the fused engine measured 178 ms p99.