Tag

local LLM

26
lip 2026

Deterministic where you can, model where you must

Last time I wrote about the judge that scores my benchmark, I left one thing out. That post was about adding a model to the scoring. It was not about the fact that the model is the…

AI · Programming
10 min
23
lip 2026

Why I still score my own benchmark, even though two LLM judges do it for me

Last time I wrote about my benchmark (the code that kills your browser), I skipped the boring part. Sixteen models, six attempts each, one task – that is 96 HTML files somebo…

AI · Programming
10 min
21
cze 2026

One small trick and you stop losing context in local LLM models

Recently I was messing around with the Refio plugin and testing it on local LLM models. In theory everything worked: the model was supposed to get the whole project context –…

AI
6 min
10
maj 2026

Quantization for the impatient – why int4 doesn’t speed up image generation on GPU

Long time no post… on image generation. Recently I sat down with an old codebase and put together a quantization pipeline for diffusion models out of curiosity – SDXL, …

AI
9 min
04
maj 2026

Every LLM writes the same Todo App. And I mean that literally

I’m building a benchmark of local models. Simple task: build a Todo App in a single HTML file – add, delete, mark as done, filters, localStorage. Trivial. Each model ge…

AI
6 min
02
kwi 2026

How Refio manages conversation context, or how to fit a big project into limited AI memory

How Refio manages conversation context, or how to fit a big project into limited AI memory AI models can do a lot these days. They can analyze code, write documentation, hunt for b…

Bez kategorii
10 min
28
gru 2025

Refio – a local AI assistant for IntelliJ and 6 RAG techniques worth knowing

Genuinely practical RAG? It’s not just about building a vector index and hoping the LLM will find everything on its own. When you’re working on a project, you’re …

Bez kategorii
7 min