Case & CodeA FIELD GUIDE TO AI
Start learning
Intermediate

RAM — Random-access memory

Also: system RAM, system memory, working memory

In plain words

A computer's short-term working memory. Programs and data live here while in use.

The fuller definition

Random-access memory is a computer's working memory for active programs and data. It is distinct from persistent disk storage.

Same eight billion values, different storage precision
32 bits32 GB
16 bits16 GB
8 bits8 GB
4 bits4 GB

Idealized value storage only, in decimal GB. Metadata, caches, mixed precision, and runtime overhead add to actual requirements. This is not a GPU purchasing calculator.

A concrete example

A model runtime holds weights or intermediate data in system RAM when running on a CPU or offloading from a GPU.

The distinction that matters

Free disk space is not interchangeable with enough working memory at useful speed.

Related terms

Where it is taught

Understand the hardware a local model needs

Source and further reading

Hugging Face · Model inference and quantization

The definition and example are written for this library. The link gives background, official documentation or legal authority as labelled. Legal scope depends on the jurisdiction and current text; product features depend on release and settings.

Lessons, terms, practical guides and sources ESC