Local AI tools

Inference engines, desktop apps, and OpenAI-compatible servers for running open models on your own hardware.

Gradio web interface that can drive several inference backends, with LoRA training and extensions built in.

Best for: Experimenting across backends and quantization formats without maintaining separate installs for each.

manual · AGPL-3.0 · ★ 47,733

GGUF · safetensors · EXL2 · GPTQ

Open WebUI

Self-hosted, multi-user chat interface for Ollama and any OpenAI-compatible backend, with RAG and document upload.

Best for: Giving a household or a team a polished chat interface over a local model, with accounts and shared history.

docker · NOASSERTION · ★ 155,957

GGUF