Skip to content
New this week26 prompts for Sora, Veo and Runway video workflows.
Explore video prompts→
AIPrompt123Prompt library

Search AIPrompt123

Search prompts, categories, platforms and repositories

Models & inferenceGoMIT

ollama/ollama

Ollama packages model weights, a runtime and a local API so developers can run Llama, Mistral, Gemma, Qwen and others on a laptop or server. It is the easiest on-ramp to local inference and a good fit for prototyping, privacy-sensitive work and offline workflows. Production deployments should review concurrency and memory limits.

152.0k stars13.2k forks520 contributors1600 open issuesUpdated

What it does

  • Downloads and runs quantised open models locally.
  • Exposes a local HTTP API compatible with common client libraries.
  • Manages model versions and keeps them on disk.

Key features

  • One-command model pulls.
  • OpenAI-compatible chat endpoint.
  • GPU acceleration on macOS, Linux and Windows.
  • Modelfiles for custom system prompts and parameters.

How to install it

Commands are copied from the project documentation at the time of review. Check the repository for the current version.

macOS / Linux
curl -fsSL https://ollama.com/install.sh | sh
ollama run llama3.2

Alternatives to consider

ollama is a strong default for models & inference, but the right choice depends on your stack, licence constraints and how much control you need. These are the projects we compare most often.

llama.cppvLLMLM Studio

Prompts that pair with it

All prompts →
Verified Knowledge · FAQ

ollama FAQ

Adoption questions we hear most often about this project.

Related repositories

Models & inference · Python

The reference library for state-of-the-art pretrained models across text, vision and audio.

149.0k30.2kApache-2.0

Models & inference · C++

Efficient C/C++ inference for Llama-family models on CPUs, GPUs and edge devices.

89.0k13.1kMIT

Models & inference · Python

A high-throughput inference and serving engine for LLMs, built around PagedAttention.

58.0k9.7kApache-2.0