TPM (tokens per minute)

TPM caps tokens processed per minute across your organisation. Long prompts consume it fast, which is why an application with large contexts can hit TPM limits at low request volume.

It is a capacity control, not a cost control — see rate limit. Handle 429 responses with exponential backoff, and be careful that the retry logic itself has a cap, or you have built a runaway loop.