Streaming
Showing the answer word by word as it is written, instead of waiting for the whole thing.
The fuller definition
Streaming delivers output incrementally rather than waiting for the entire result to finish.
- Start
Request accepted
- Chunks
Partial output arrives
- End
Completion or error
A simplified relationship, not a screenshot or a complete design.
A concrete example
A chat interface displays generated text as it arrives in chunks.
The distinction that matters
An incomplete streamed response may not yet be valid JSON or a complete answer; cancellation needs handling.
Related terms
API — Application Programming Interface
A doorway that lets one program talk to another. Apps use an API to send your request to the model and get the answer back.
APIs & softwareJSON — JavaScript Object Notation
A tidy text format for data, made of labels and values in curly brackets. Programs use it to pass information around.
APIs & softwareLatency
The wait between sending a request and getting the answer back.
Where it is taught
APIs and JSON: connect a model to a small programSource and further reading
MDN · Web technology glossaryThe definition and example are written for this library. The link gives background, official documentation or legal authority as labelled. Legal scope depends on the jurisdiction and current text; product features depend on release and settings.