Home›Models›glm-5.3-flash

Model sheet

glm-5.3-flash

Architecture mixture of experts45 LayersLicense mitMaximum context 1,024kVocabulary 154,880

Watch 3 videos

At Q4_K_M it is a 187.04 GiB file, and it fits on 1 of the 18 machines we measure (only one: Mac Studio with M5 Ultra and 512 GB). Here the file is what fills the memory: even at its maximum context of 1024k tokens, the context adds 22.00 GiB — and the same content in German takes ×1.49 the tokens of English.

At a glance
Size at Q4_K_M187.04 GiB
Context memory at 8k0.17 GiB
Fits on1 / 18
German cost×1.49
Smallest machine that takes itMac Studio with M5 Ultra and 512 GB
187.04 GiB

Model size at Q4_K_M

Measured by Local AI Scope

0.17 GiB

Context memory at 8k tokens

Measured by Local AI Scope

×1.49

What German costs versus English

Measured by Local AI Scope

Videos

Videos: glm-5.3-flash 3

The best walk-throughs we found. Press play and it opens right here.

The videos live on YouTube, and nothing loads from there until you press play (no-cookie mode). The thumbnail is served by us.

Sizes

Sizes of the real published files

These are the sizes of the files actually published by the author, added up when the model ships split into parts. Not an estimate from the parameter count.

Size of the published file for each compression
Compression Model size
Q8_0 318.05 GiB
Q6_K 261.74 GiB
Q5_K_M 226.96 GiB
Q5_K_S 212.26 GiB
Q4_K_M 187.04 GiB
Q4_K_S 176.30 GiB
IQ4_XS 165.54 GiB
Q3_K_M 144.37 GiB

This model also reads images. For that it needs a second file, the vision projector (mmproj-GLM-5.3-Flash-BF16-f16.gguf, 1.05 GiB), published next to the model and not included in the figures on this page: they count text only. If you are going to send it images, add it to the model size.

Context

Context memory

Computed from the attention pattern this model declares layer by layer, not from the generic formula. That is why the figure is often far smaller than other calculators tell you. This model stores its context memory compressed (latent attention): per layer and token, one vector of 512 values instead of its 64 heads of 256. We count it as one head of 512 for the key and another for the value, which is a little more than it really takes (one latent serves both), so these figures err on the high side, never the low one.

  • 8k tokens → 0.17 GiB
  • 32k tokens → 0.69 GiB
  • 128k tokens → 2.75 GiB
Languages

What it costs in each language

Measured by running this model’s own tokenizer over the same content in four languages. Tokens are what you pay for in context, in memory and in your cloud bill.

Token cost per kind of text and language, with English as the baseline
Kind of text EN ES FR DE
Code — ×1.26 ×1.41 ×1.64
Contracts — ×1.29 ×1.36 ×1.52
Business email — ×1.22 ×1.32 ×1.32
Support tickets — ×1.33 ×1.51 ×1.41

English is the baseline: every figure is how many times more tokens the same content costs in that language. Average across the whole corpus: DE ×1.49.

Machines

Where it fits

Fits means the model, its context memory and the working headroom all fit at the stated context, leaving the system its share. 1 of the 18 machine profiles tested (Q4_K_M, 8k tokens).

The 18 machine profiles, with the memory each one leaves and the largest context this model holds on it
Machine Fits Memory left Largest context that fits
PC with an RTX 4060 8 GB no 7.20 GiB —
PC with an RTX 3060 12 GB no 11.20 GiB —
PC with an RTX 4070 12 GB no 11.20 GiB —
Mac with M4 and 16 GB unified memory no 13.00 GiB —
Office laptop, CPU only, 16 GB no 13.00 GiB —
Mac mini with M6 and 16 GB no 13.00 GiB —
Mac with M4 Pro and 24 GB no 21.00 GiB —
Workstation with an RTX 4090 24 GB no 23.20 GiB —
Mini-PC with an NPU and 32 GB LPDDR5X no 29.00 GiB —
Mac mini with M6 and 32 GB no 29.00 GiB —
Server with 2× RTX 3090 (48 GB) no 47.20 GiB —
Mac with M4 Max and 64 GB no 61.00 GiB —
Mac mini with M5 Pro and 64 GB no 61.00 GiB —
Xiaomi AI Cube, 80 GB — engineering prototype no 77.00 GiB —
PC with Ryzen AI Max+ 395 and 128 GB unified no 96.00 GiB —
Mac Studio with M5 Max and 128 GB no 125.00 GiB —
PC with Ryzen AI Max+ PRO 495 and 192 GB unified no 160.00 GiB —
Mac Studio with M5 Ultra and 512 GB yes 509.00 GiB 1024k

If you are willing to compress it more, it does run where the table says no: at Q3_K_M (144.37 GiB), up to 256k tokens of context, on PC with Ryzen AI Max+ PRO 495 and 192 GB unified. Below Q4_K_M the model loses a little quality, and at Q3_K_M you can tell; that is why the table above sticks to Q4_K_M.

Before you hit download: as of 6 October 2026, the way to run this model on one of these machines is llama.cpp: its stable v0.6.0, released on 5 October 2026, opens it, and so do its daily builds from b11279 onwards; earlier versions do not. Ollama and LM Studio offer it only in their cloud (there is no local download in their catalogues), and mlx-lm does not support its architecture. vLLM does support it, but with the original FP8 weights (305.81 GiB) in graphics-card memory, and no PC on our list has that much VRAM. One upside: the Q4_K_M file carries a 3.93 GiB layer for predicting several tokens at once that llama.cpp does not load, so with it the model needs 3.93 GiB less than the table counts.