Models & inference · Go
Run open models locally with a single command and a simple local API.
Search prompts, categories, platforms and repositories
llama.cpp is the engine behind much of the local inference ecosystem. It implements efficient quantisation and runs models across Apple Silicon, x86, CUDA, Vulkan and more. It is lower level than Ollama but gives finer control over memory, context and sampling, and it ships an OpenAI-compatible server.
Commands are copied from the project documentation at the time of review. Check the repository for the current version.
git clone https://github.com/ggml-org/llama.cpp cd llama.cpp && cmake -B build && cmake --build build --config Release
llama.cpp is a strong default for models & inference, but the right choice depends on your stack, licence constraints and how much control you need. These are the projects we compare most often.
Explain an unfamiliar codebase
A coding prompt for explain an unfamiliar codebase. It gives Claude and Cursor a clear role, explicit constraints and a defined output, so the first answer is closer to usable. Fill in the variables, run it once, then use the verification notes on this page to review the result.
Hunt a performance bottleneck
A coding prompt for hunt a performance bottleneck. It gives Cursor and Claude a clear role, explicit constraints and a defined output, so the first answer is closer to usable. Fill in the variables, run it once, then use the verification notes on this page to review the result.
Write a system prompt with a strict output schema
This copy-ready system prompts prompt helps you write a system prompt with a strict output schema with fewer blank-page decisions. Paste it into ChatGPT and Claude, fill the variables, and you get a structured first draft you can edit. It is written for repeatable results and tells you what to check before publishing.
Adoption questions we hear most often about this project.
Models & inference · Go
Run open models locally with a single command and a simple local API.
Models & inference · Python
The reference library for state-of-the-art pretrained models across text, vision and audio.
Models & inference · Python
A high-throughput inference and serving engine for LLMs, built around PagedAttention.