Streaming
Last verified
Streaming returns tokens as they are produced rather than waiting for the full response.
It improves perceived latency and it does not change what you pay — you are billed for the same tokens either way.
One operational note: a client that disconnects mid-stream may still be billed for tokens already generated, so abandoned requests are not necessarily free.