BYOAIK — Bring Your Own AI Key: a directory of AI tools that run on your own API key.

Haystack

Open-source Python framework for building production RAG pipelines and agent workflows with any LLM provider.

Website Source code

Category:

Agent Frameworks

Pricing:

Open Source

Open source:

Yes (Apache-2.0)

Self-hostable:

Yes

Local-first:

Yes

Platforms:

Library/SDK, Self-hosted, Docker

AI providers (bring your own key):

OpenAI, Anthropic, Google Gemini, Azure OpenAI, Mistral, Cohere, Groq, Ollama, Hugging Face, Custom / OpenAI-compatible

API key storage:

User controls deployment

Key risk level:

LOW

Trust score:

90/100

Haystack is deepset's open-source, vendor-agnostic AI orchestration framework for building production-ready LLM applications in Python. Developers compose modular pipelines and agent workflows with explicit control over retrieval, routing, memory, and generation, covering RAG, semantic search, multimodal, and conversational systems. It is bring-your-own-credentials by design: generator components (e.g. OpenAIGenerator) read keys from environment variables by default but accept a key passed directly at init via Secret.from_token("<your-api-key>"), and OpenAIGenerator exposes a configurable api_base_url so end users can point at OpenAI-compatible or self-hosted/local endpoints. It integrates a very broad provider set including OpenAI, Anthropic, Mistral, Cohere, Azure OpenAI, Google Gemini (Google Gen AI / Vertex), Hugging Face, Ollama for local models, AWS Bedrock, NVIDIA, and Groq.

How your API key is handled

You self-host the app, so your API key lives in your own deployment. Requests are sent directly to the AI provider. Because it can be self-hosted, your key never has to touch a third-party backend.

Setup

Deploy it (Docker/compose), add your provider API key in the admin or environment config, then select models.