Rate limit
Also: rate limits
A cap on how many requests a service will accept in a given time.
The fuller definition
A rate limit restricts how much a client can use a service over a period, often measured in requests or tokens.
- Quota
Allowed use per interval
- Requests
Consume the allowance
- Response
Proceed or retry later
A simplified relationship, not a screenshot or a complete design.
A concrete example
An API returns a limit response after too many requests in a minute; the application waits and retries under policy.
The distinction that matters
A rate limit differs from a model's context window or a monthly spending budget.
Related terms
API — Application Programming Interface
A doorway that lets one program talk to another. Apps use an API to send your request to the model and get the answer back.
FoundationsToken
A piece of text, often part of a word, that the model actually works with. Models read and write tokens, not whole words.
Agents & automationRetry
Trying a failed step again, usually after a short wait.
Where it is taught
APIs and JSON: connect a model to a small programSource and further reading
MDN · Web technology glossaryThe definition and example are written for this library. The link gives background, official documentation or legal authority as labelled. Legal scope depends on the jurisdiction and current text; product features depend on release and settings.