CPU — Central processing unit
Also: CPUs
The main brain of a computer. It can run AI models, but slowly.
The fuller definition
A Central Processing Unit is a general-purpose processor that executes program instructions and coordinates many computer tasks.
- Instructions
Program operations
- CPU
General computation
- System memory
Working data
A simplified relationship, not a screenshot or a complete design.
A concrete example
A local inference runtime can perform model computation on a CPU, with performance depending on the workload and implementation.
The distinction that matters
CPU speed alone does not determine model performance; memory bandwidth and software support also matter.
Related terms
GPU — Graphics processing unit
The chip that handles graphics, and also the maths AI needs. It is what makes AI fast.
Hardware & hostingRAM — Random-access memory
A computer's short-term working memory. Programs and data live here while in use.
FoundationsInference
The act of running a trained model to get an answer. In law the word means something else: a conclusion drawn from evidence.
Where it is taught
Understand the hardware a local model needsSource and further reading
Hugging Face · Model inference and quantizationThe definition and example are written for this library. The link gives background, official documentation or legal authority as labelled. Legal scope depends on the jurisdiction and current text; product features depend on release and settings.