Models & inference · Python
The reference library for state-of-the-art pretrained models across text, vision and audio.
Search prompts, categories, platforms and repositories
Ollama packages model weights, a runtime and a local API so developers can run Llama, Mistral, Gemma, Qwen and others on a laptop or server. It is the easiest on-ramp to local inference and a good fit for prototyping, privacy-sensitive work and offline workflows. Production deployments should review concurrency and memory limits.
Commands are copied from the project documentation at the time of review. Check the repository for the current version.
curl -fsSL https://ollama.com/install.sh | sh ollama run llama3.2
ollama is a strong default for models & inference, but the right choice depends on your stack, licence constraints and how much control you need. These are the projects we compare most often.
Write a system prompt for a support assistant
This copy-ready system prompts prompt helps you write a system prompt for a support assistant with fewer blank-page decisions. Paste it into ChatGPT and Claude, fill the variables, and you get a structured first draft you can edit. It is written for repeatable results and tells you what to check before publishing.
Write a system prompt for a coding assistant
A system prompts prompt for write a system prompt for a coding assistant. It gives Claude and ChatGPT a clear role, explicit constraints and a defined output, so the first answer is closer to usable. Fill in the variables, run it once, then use the verification notes on this page to review the result.
Create a character card with a real flaw
This copy-ready roleplay prompt helps you create a character card with a real flaw with fewer blank-page decisions. Paste it into ChatGPT and Claude, fill the variables, and you get a structured first draft you can edit. It is written for repeatable results and tells you what to check before publishing.
Adoption questions we hear most often about this project.
Models & inference · Python
The reference library for state-of-the-art pretrained models across text, vision and audio.
Models & inference · C++
Efficient C/C++ inference for Llama-family models on CPUs, GPUs and edge devices.
Models & inference · Python
A high-throughput inference and serving engine for LLMs, built around PagedAttention.