Time to the last word.
Play back two decoders on the same clock. Slow the replay down to see when each transcript finishes.
Single A100 · W1
p99Time to a complete transcript
Fused CTC draft167 ms
vLLM autoregressive520 ms
Playback uses measured end-to-end p99 times from the same W1 benchmark, single-stream on an A100 40 GB. The token animation illustrates progress between endpoints. Over HTTP the fused engine measured 178 ms p99.