BYOAIK (Bring Your Own AI Key) is a directory of AI tools that run on your own API key.

Xinference

Self-hosted model server for LLMs, embeddings and speech behind one OpenAI-compatible API.

Website Source code

Category:
Self-Hosted AI Platforms
Pricing:
Open Source
Open source:
Yes (Apache-2.0)
Self-hostable:
Yes
Local-first:
Yes
Platforms:
Self-hosted, Docker, Local-only
AI providers (bring your own key):
OpenAI, Custom / OpenAI-compatible, Ollama
API key storage:
User controls deployment
Key risk level:
LOW
Trust score:
83/100

Xorbits Inference runs language, embedding, reranking, image and speech models on your own infrastructure and exposes them through an OpenAI-compatible API, plus a web UI and clients. Because the models run where you put them, a BYOK client can be pointed at it with no cloud provider key in the path. It can also front third-party providers when you want them, using credentials you supply. Apache-2.0.

Why this trust score (83/100)

Trust measures how the tool treats your API key and how much of that has been verified. It contains no popularity signal.

  • Key Safety 21/25: The key lives in a deployment you run yourself.
  • Request Routing 17/20: Requests go straight from you to the AI provider.
  • Transparency 20/20: Source is public under Apache-2.0, so anyone can check how the key is handled.
  • Privacy 14/15: Local-first: it works without sending your data anywhere. Can be self-hosted, so the data path stays inside infrastructure you control.
  • Maintenance 10/10: Actively developed, with commits within the last three months.
  • Verification Confidence 1/10: Compiled from public documentation by an AI-assisted pass, not independently confirmed.

What was checked

Verification tier RESEARCH_ASSISTED, derived from the evidence below and not set by hand.

  • [REPORTED · RESEARCH] This listing was compiled by an AI-assisted research pass over the tool's public website, README and documentation. No person independently confirmed it.
  • [STRONG · SOURCE_SCAN] Supports a local model backend, so it can run with no cloud provider key at all. source
  • [CONFIRMED · SOURCE_SCAN] Most recent commit 2026-08-21, about 0 month(s) ago. source

How your API key is handled

You self-host the app, so your API key lives in your own deployment. Requests are sent directly to the AI provider. Because it can be self-hosted, your key never has to touch a third-party backend.

Setup

Deploy it (Docker/compose), add your provider API key in the admin or environment config, then select models.