What a €2-7K budget gets you for local AI in 2026. Which chips actually matter for inference. The real difference between running models locally vs. using an API. Why some tasks belong on-device and others don't.
The prosumer AI hardware stack is moving fast, and in 2026 it is moving on one thing: memory. A global DRAM shortage has repriced the whole shelf, so here is what I'd buy today, and why.
At this budget the choice is raw speed on a discrete GPU, or memory capacity on a unified-memory box. The shortage has pushed those two further apart.
The speed route. An NVIDIA RTX 5090 with 32GB of very fast memory, now around €3,000 to €3,500 (the €2,000 launch price did not survive the shortage). It is the quickest tokens you can buy without an enterprise contract, and by some distance the best local image and video generator. You can even run it as an external GPU over Thunderbolt 5 or OCuLink, though at 575W it needs a serious enclosure, so in practice it stays a desktop-tower card. The catch is unchanged: 32GB is the ceiling on a single consumer card, so a 70B model already spills past it.
The capacity route. An AMD Ryzen AI Max+ 395 mini PC, the GMKtec EVO-X2, with 128GB of unified memory for around €1,900 direct. It holds 70B-class models a 32GB card cannot, sits silently on a desk, and sips power next to a 575W discrete card. The honest trade is speed: it is bandwidth-limited, so it flies on mixture-of-experts models and crawls on dense 70B, single digits to low teens of tokens per second. You run bigger models, just slower, on Linux rather than CUDA.
The Apple route. A Mac with 128GB of unified memory is the quiet, efficient option: near-silent, low power, comfortably over 20 tokens per second on a 70B model with Apple's MLX stack. The asterisk is price. The 128GB box here is a Mac Studio with the M3 Ultra chip, 32-core CPU and 80-core GPU, around €6,600, and the DRAM shortage is a big part of why that much memory costs what it does. You pay a real premium for macOS and silence.
None of this top end is needed for everyday work. Most business tasks, drafting, summarising, classifying, and answering questions over your own documents, sit happily on 14B to 32B models, which run on far cheaper hardware.
The honest part. Local wins on privacy, full control of your data, and zero cost per token once the box is paid for. The API wins on frontier reasoning and the occasional heavy lift you cannot match at home. For most teams the answer is hybrid: a small local model for the private, high-volume, repetitive work, and a frontier API for the hard problems.
So buy for the model you run every day, not the one you run once. And in 2026, buy the memory before the shortage decides for you.