BYOAIK (Bring Your Own AI Key) is a directory of AI tools that run on your own API key.
KoboldCpp
Single-file GGUF runner with a bundled web UI: everything runs on your own machine with no key or account.
- Category:
- Local AI Tools
- Maintenance:
- Actively developed (last commit 3 days ago)
- Pricing:
- Open Source
- Open source:
- Yes (AGPL-3.0)
- Self-hostable:
- Yes
- Local-first:
- Yes
- Platforms:
- Desktop, CLI, Self-hosted, Docker
- AI providers (bring your own key):
- Ollama, Custom / OpenAI-compatible
- API key storage:
- No cloud key required for local model
- Key risk level:
- LOW
- Trust score:
- 87/100
KoboldCpp is a self-contained distributable built on llama.cpp that bundles a GGUF model runner with the KoboldAI Lite web interface for chat, story writing and roleplay, running entirely on your own machine. You download one binary for Windows, macOS or Linux, or run it via Docker, Colab, Termux or a Raspberry Pi, and load a local model file: nothing leaves the device so there is no key to set. It also exposes an OpenAI-compatible local endpoint other clients can use. AGPL-3.0 for the interface layer with llama.cpp's MIT core, 11,415 stars, pushed the day of review.
How this tool was scored
Key handling 93/100 (where your key rests and who sees it, comparable across any licence) and verifiability 70/100 (how much of that BYOAIK could confirm, lower for closed source). Neither contains a popularity signal.
- Key Safety 25/25: No cloud key is needed at all. The model runs locally.
- Request Routing 17/20: Requests go straight from you to the AI provider.
- Transparency 20/20: Source is public under AGPL-3.0, so anyone can check how the key is handled.
- Privacy 14/15: Local-first: it works without sending your data anywhere. Can be self-hosted, so the data path stays inside infrastructure you control.
- Maintenance 10/10: Actively developed, with commits within the last three months.
- Verification Confidence 1/10: Compiled from public documentation by an AI-assisted pass, not independently confirmed.
What was checked
Verification tier RESEARCH_ASSISTED, derived from the evidence below and not set by hand.
- [STRONG · SOURCE_SCAN] Supports a local model backend, so it can run with no cloud provider key at all. source
- [CONFIRMED · SOURCE_SCAN] Most recent commit 2026-09-26, about 0 month(s) ago. source
How your API key is handled
Key handling varies. Requests are sent directly to the AI provider. Because it can be self-hosted, your key never has to touch a third-party backend.
Setup
Add your provider API key in settings and choose a model.