By: Karim Pichara, Developer / AI Engineer
It is no secret that token costs are high, especially when it comes to proprietary frontier models.
Since GLM 5 was announced I started exploring open weight alternatives for my personal projects due to their appeal in terms of cost and capability. At the time I took a look at the pricing of “coding plans” for GLM, Kimi, and Qwen, and decided to stay with GLM, mainly after reading comments on Reddit, praising the model. I just wanted “good enough”, not “the best”.
Nowadays, I use GLM 5.3 as my daily driver in my personal projects with a couple of hiccups here and there, but overall I'm satisfied with the model (anecdotal side comment: for me, the biggest jump in quality was from 5.1 to 5.2). With that in mind, I always wanted to try GLM at Funnel, but due to the compliance requirements such as Zero Data Retention, SOC2, among others, I couldn't do it… until August this year!
During the summer we started trialling open weight models on one of the EU sovereign AI providers. After some initial testing (nothing fancy, just using it as the daily coding assistant) some questions arose:
Then in October 2026, our primary cloud provider released GLM 5.3 as well. This was my chance for a larger experiment.
The experiment was simple, really. These were the steps I followed:
Small note about this: this experiment uses a small sample of issues; however I believe it is directionally good enough and gives a hint of the full picture.
This table shows the results across all 10 tasks:
# One important aspect of the GLM-5.3 on the Provider B is that it uses NVFP4 compiled weights - this is NVIDIA’s 4-bit floating point E2M1 data format. We unfortunately have no information on the data format of the same model on Provider A, but suspect it to be a full 16-bit floating point checkpoint.
* We are a bit uncertain about why this one is so much slower. Our guess is because of the amount of output tokens, probably related to thinking, even though we put max effort on both versions of GLM.
From the table, you can draw your own conclusions, but these are my takeaways:
(**) Applying standard good agentic coding patterns such as clean supporting Markdown files, planning before implementing, etc.
Are you willing to wait twice as long for a third of the price? For my personal projects, I already made that choice. At work, it depends on the task, and that's a better answer than "we can't use it".