colibriRun GLM-5.2 (744B MoE) on a 25GB-RAM consumer machine
g20260717miscΣ=0 g20260717Version of this port present on the latest quarterly branch.upstream: v2.1.0A newer version was found upstream by portscout, first on 2026-11-01.
colibri allows to run GLM-5.2 (744B-parameter MoE) on a consumer machine with
~25 GB of RAM - in pure C, with zero dependencies, by streaming experts from
disk.
Colibri is a lightweight, quality-preserving MoE runtime that treats VRAM, RAM,
and storage as one managed memory hierarchy. Insufficient fast memory may reduce
speed, but the default policy never silently changes model precision or router
semantics.
You installed colibri: GLM-5.2 AI model runner.
It requires a very large download of ~400GB from HuggingFace:
https://huggingface.co/mateogrgic/GLM-5.2-colibri-int4-with-int8-mtp
Install py312-huggingface-hub and then:
$ hf download mateogrgic/GLM-5.2-colibri-int4-with-int8-mtp