All Local AI
Pick VRAM for fit estimates
Models Tools Hardware Best Of Compare Calculators Stacks Guides Blog

Directory

Local AI tools

Inference engines, desktop apps, and OpenAI-compatible servers for running open models on your own hardware.

Stacks Grid Table
All desktop appdownload toolinference engineinference serverweb UI
Tool Category Install Stars
vLLM

High-throughput serving engine with PagedAttention and continuous batching, built for concurrent requests.

inference server pip ★ 93,989