Case & CodeA FIELD GUIDE TO AI
Start learning
Intermediate

MXFP4

Also: MXFP4_MOE

In plain words

A compact 4-bit format some newer models are released in, which keeps their files small.

The fuller definition

MXFP4 is a 4-bit floating-point weight format with shared scaling per small block of weights. Some recent models, including gpt-oss, are released in it.

How it fits together
  1. Weights

    4-bit values

  2. Blocks

    Shared scale

  3. File

    Smaller model

A simplified relationship, not a screenshot or a complete design.

A concrete example

gpt-oss-20b ships as a 12.11 GB MXFP4 GGUF file.

The distinction that matters

MXFP4 is a format the model was trained or released in, not just a compression applied afterwards.

Related terms

Where it is taught

How models learn from examples

Source and further reading

Hugging Face · LLM course

The definition and example are written for this library. The link gives background, official documentation or legal authority as labelled. Legal scope depends on the jurisdiction and current text; product features depend on release and settings.

Lessons, terms, practical guides and sources ESC