BYOAIK (Bring Your Own AI Key) is a directory of AI tools that run on your own API key.
KServe
Kubernetes-native model serving, the piece that makes self-hosting survive production.
- Category:
- Self-Hosted AI Platforms
- Maintenance:
- Actively developed (last commit today)
- Pricing:
- Open Source
- Open source:
- Yes (Apache-2.0)
- Self-hostable:
- Yes
- Local-first:
- Yes
- Platforms:
- Self-hosted, Docker
- AI providers (bring your own key):
- Ollama, Custom / OpenAI-compatible
- API key storage:
- User controls deployment
- Key risk level:
- LOW
- Trust score:
- 83/100
KServe is the CNCF standard for serving models on Kubernetes, covering autoscaling to zero, canary rollouts and an OpenAI-compatible runtime for language models. It matters to this directory as the layer that turns a self-hosted model from a demonstration into something an organisation can actually depend on, with the endpoint inside its own cluster and no provider key anywhere. Apache-2.0, vendor-neutral under the CNCF rather than a single company.
How this tool was scored
Key handling 87/100 (where your key rests and who sees it, comparable across any licence) and verifiability 70/100 (how much of that BYOAIK could confirm, lower for closed source). Neither contains a popularity signal.
- Key Safety 21/25: The key lives in a deployment you run yourself.
- Request Routing 17/20: Requests go straight from you to the AI provider.
- Transparency 20/20: Source is public under Apache-2.0, so anyone can check how the key is handled.
- Privacy 14/15: Local-first: it works without sending your data anywhere. Can be self-hosted, so the data path stays inside infrastructure you control.
- Maintenance 10/10: Actively developed, with commits within the last three months.
- Verification Confidence 1/10: Compiled from public documentation by an AI-assisted pass, not independently confirmed.
What was checked
Verification tier RESEARCH_ASSISTED, derived from the evidence below and not set by hand.
- [REPORTED · RESEARCH] This listing was compiled by an AI-assisted research pass over the tool's public website, README and documentation. No person independently confirmed it.
- [STRONG · SOURCE_SCAN] Supports a local model backend, so it can run with no cloud provider key at all. source
- [CONFIRMED · SOURCE_SCAN] Ships a container definition, so it can be self-hosted on your own infrastructure. source
- [CONFIRMED · SOURCE_SCAN] Most recent commit 2026-09-29, about 0 month(s) ago. source
How your API key is handled
You self-host the app, so your API key lives in your own deployment. Requests are sent directly to the AI provider. Because it can be self-hosted, your key never has to touch a third-party backend.
Setup
Deploy it (Docker/compose), add your provider API key in the admin or environment config, then select models.