Ollama

← All terms · Local models and inference

A lightweight, user-friendly tool that allows developers to easily download, run, and manage large language models locally on their own hardware.

What it is

Ollama abstracts away the complex Python environments and configuration files usually required to run open-weight models. With simple commands (like ollama run deepseek-r1), it downloads the model, optimizes it for your Mac, Linux, or Windows machine, and exposes a local API that acts exactly like OpenAI's API.

When you would use it

You use Ollama when you want the absolute easiest, frictionless way to run an AI model privately on your laptop.

Common operations

• Running a private coding assistant entirely offline to protect corporate IP.
• Quickly testing new open-weight models locally before deploying them to the cloud.

Related terms

• llama.cpp
• Self-hosted inference
• GGUF

Where this is taught

• Running Your First Local Model