Qwen2.5-0.5B chat — running on a free CPU Space

Quantized to Q4_K_M (4-bit) and served via llama.cpp. Expect ~5-10 tok/s. Quality is what you'd expect from a 0.5B model.

0 1.5
16 1024