Multimodal
Also: multimodality
Able to work with more than text, such as images, audio, or video.
The fuller definition
A multimodal system handles more than one type of information, such as text, images, audio, or video. Supported inputs and outputs differ between systems.
- Input
Image plus question
- Processing
Use supported modalities
- Output
Text explanation
A simplified relationship, not a screenshot or a complete design.
A concrete example
You provide a photograph of a chart and ask for an explanation in text.
The distinction that matters
Being multimodal does not mean the system handles every modality or reads every small detail correctly.
Related terms
Vision model
A model that can look at images as well as read text.
FoundationsSpeech to text (STT)
Software that turns speech into text. Check names, numbers, and words it may have misheard.
FoundationsAI model
The trained part of an AI system. It uses a large set of numbers to turn what you give it into a result.
Where it is taught
What actually happens when you ask AI a question?Source and further reading
Google · Machine Learning GlossaryThe definition and example are written for this library. The link gives background, official documentation or legal authority as labelled. Legal scope depends on the jurisdiction and current text; product features depend on release and settings.