# You can run a capable AI model on your own laptop now

URL: https://ai-pulse.aglaganova.com/blog/you-can-run-a-capable-ai-model-on-your-own-laptop-now
Published: 2026-10-09
Author: Roman Aglaganov, Full-stack developer
Category: Tools
Region: Global
Tags: open-weights

> Thanks to open-weight models and clever compression, a decent AI assistant can run offline on an ordinary computer. No cloud, no subscription, no data leaving your machine.

![Typographic cover: the command “ollama run”, a capable model on your own laptop](https://ai-pulse.aglaganova.com/api/media/file/local-ai-1.png)

Big AI models live in data centres the size of warehouses. Smaller ones, it turns out, fit on your laptop, and they are better than you might expect.

## A weekend project that changed things

In March 2023, days after Meta’s Llama model weights leaked online, the developer Georgi Gerganov released llama.cpp, a lean program that could run Llama on an ordinary MacBook. The trick was *quantisation*: storing the model’s billions of numbers with fewer bits, which shrinks it dramatically at a modest cost in quality. Think of it as an MP3 for AI models.

Tools such as Ollama then made it almost boring: install one app, type a command like “ollama run” followed by a model name, and you are chatting with an AI that runs entirely on your own machine.

## Why bother?

**Privacy:** your documents never leave your computer, which matters for lawyers, doctors and anyone with a diary.

**Offline:** it works on a plane, in a cabin or during an outage.

**Cost:** no subscription and no per-question fees, once you have the hardware.

**Tinkering:** you can try dozens of open models, from Meta’s Llama and Mistral’s models to Google’s Gemma, Alibaba’s Qwen and DeepSeek’s smaller versions.

## The trade-offs

Local models are smaller than the giants in the cloud, so they are weaker at hard reasoning and long, complex tasks, and they make your laptop fan sound like a hair dryer. But for summarising, drafting and private brainstorming, they are more than good enough, and getting better every few months.

## Sources

- [llama.cpp on GitHub](https://github.com/ggml-org/llama.cpp)
- [Ollama](https://ollama.com)