Providers

Complete list of LLM providers supported by any-llm including OpenAI, Anthropic, Mistral, and more

any-llm supports multiple providers. Provider source code is in src/any_llm/providers/.

Is your endpoint OpenAI-compatible but not listed below? You are not blocked: use AnyLLM.create_openai_compatible. Prefer it over pointing the openai provider at a custom api_base, which misreports the provider identity as openai, silently sends any OPENAI_API_KEY in your environment to the custom endpoint, and rejects keyless local servers.

Support tiers

The Tier column is a support promise, not a statement about how the provider is implemented:

• ✅ Verified: we hold an API key, integration tests run against the provider in CI, and we fix breakage.
• 🤝 Community: verified live by the contributor when it was added, then community-maintained. No CI key, so its integration tests skip in CI. Report breakage by opening an issue.

A provider can be verified whether it ships as a code folder or as a single config row, and a config-only gateway we hold a key for is verified.

ID	Tier	Key	Base	Responses	Completion	Streaming (Completions)	Reasoning (Completions)	Image (Completions)	Embedding	List Models	Batch
anthropic	✅ Verified	ANTHROPIC_API_KEY	ANTHROPIC_BASE_URL	❌	✅	✅	✅	✅	❌	✅	✅
atlascloud	🤝 Community	ATLASCLOUD_API_KEY	ATLASCLOUD_API_BASE	❌	✅	✅	✅	❌	❌	✅	❌
azure	🤝 Community	AZURE_API_KEY	AZURE_AI_CHAT_ENDPOINT	❌	✅	✅	❌	❌	✅	✅	❌
azureanthropic	🤝 Community	AZURE_ANTHROPIC_API_KEY	AZURE_ANTHROPIC_API_BASE	❌	✅	✅	✅	✅	❌	❌	✅
azureopenai	✅ Verified	AZURE_OPENAI_API_KEY	AZURE_OPENAI_ENDPOINT	✅	✅	✅	❌	✅	✅	✅	❌
bedrock	✅ Verified	AWS_BEARER_TOKEN_BEDROCK	AWS_ENDPOINT_URL_BEDROCK_RUNTIME	❌	✅	✅	✅	✅	✅	✅	✅
cascadia	🤝 Community	CASCADIA_API_KEY	CASCADIA_API_BASE	❌	✅	✅	✅	❌	❌	✅	❌
cerebras	✅ Verified	CEREBRAS_API_KEY	CEREBRAS_API_BASE	❌	✅	✅	✅	❌	❌	✅	❌
cohere	🤝 Community	COHERE_API_KEY	COHERE_BASE_URL	❌	✅	✅	✅	✅	✅	✅	❌
dashscope	🤝 Community	DASHSCOPE_API_KEY	DASHSCOPE_API_BASE	❌	✅	✅	❌	✅	✅	✅	❌
databricks	🤝 Community	DATABRICKS_TOKEN	DATABRICKS_HOST	❌	✅	✅	✅	❌	✅	❌	❌
deepinfra	🤝 Community	DEEPINFRA_API_KEY	DEEPINFRA_API_BASE	❌	✅	✅	✅	✅	✅	✅	❌
deepseek	✅ Verified	DEEPSEEK_API_KEY	DEEPSEEK_API_BASE	❌	✅	✅	✅	❌	❌	✅	❌
edenai	🤝 Community	EDENAI_API_KEY	EDENAI_API_BASE	❌	✅	✅	❌	✅	✅	✅	❌
fireworks	✅ Verified	FIREWORKS_API_KEY	FIREWORKS_API_BASE	✅	✅	✅	✅	✅	❌	✅	❌
gemini	✅ Verified	GEMINI_API_KEY/GOOGLE_API_KEY	GOOGLE_GEMINI_BASE_URL	❌	✅	✅	✅	✅	✅	✅	✅
github	🤝 Community	GITHUB_TOKEN	GITHUB_MODELS_API_BASE	❌	✅	✅	❌	❌	✅	✅	❌
gmi	🤝 Community	GMI_API_KEY	GMI_API_BASE	✅	✅	✅	✅	❌	❌	✅	❌
groq	✅ Verified	GROQ_API_KEY	GROQ_BASE_URL	✅	✅	✅	✅	❌	❌	✅	❌
huggingface	🤝 Community	HF_TOKEN	HUGGINGFACE_API_BASE	✅	✅	✅	❌	❌	❌	✅	❌
inception	✅ Verified	INCEPTION_API_KEY	INCEPTION_API_BASE	❌	✅	✅	❌	❌	❌	✅	❌
kenari	🤝 Community	KENARI_API_KEY	KENARI_API_BASE	❌	✅	✅	✅	❌	❌	✅	❌
llama	🤝 Community	LLAMA_API_KEY	LLAMA_API_BASE	❌	✅	✅	❌	❌	❌	✅	❌
llamacpp	✅ Verified	None	LLAMACPP_API_BASE	❌	✅	✅	✅	✅	✅	✅	❌
llamafile	✅ Verified	None	LLAMAFILE_API_BASE	❌	✅	❌	✅	❌	❌	✅	❌
lmstudio	✅ Verified	LM_STUDIO_API_KEY	LM_STUDIO_API_BASE	❌	✅	✅	✅	❌	✅	✅	❌
meta	🤝 Community	MODEL_API_KEY	META_API_BASE	✅	✅	✅	❌	✅	❌	✅	❌
minimax	✅ Verified	MINIMAX_API_KEY	MINIMAX_API_BASE	❌	✅	✅	✅	❌	❌	❌	❌
mistral	✅ Verified	MISTRAL_API_KEY	MISTRAL_API_BASE	❌	✅	✅	✅	❌	✅	✅	✅
moonshot	✅ Verified	MOONSHOT_API_KEY	MOONSHOT_API_BASE	❌	✅	✅	✅	❌	❌	✅	❌
mzai	🤝 Community	ANY_LLM_KEY	ANY_LLM_PLATFORM_URL	❌	✅	✅	✅	✅	✅	✅	❌
nebius	✅ Verified	NEBIUS_API_KEY	NEBIUS_API_BASE	❌	✅	✅	✅	✅	✅	✅	❌
neosantara	🤝 Community	NEOSANTARA_API_KEY	NEOSANTARA_API_BASE	✅	✅	✅	✅	✅	✅	✅	✅
ollama	✅ Verified	None	OLLAMA_HOST	❌	✅	✅	✅	✅	✅	✅	❌
openai	✅ Verified	OPENAI_API_KEY	OPENAI_BASE_URL	✅	✅	✅	❌	✅	✅	✅	✅
openrouter	✅ Verified	OPENROUTER_API_KEY	OPENROUTER_API_BASE	✅	✅	✅	✅	✅	✅	✅	❌
otari	✅ Verified	OTARI_API_KEY	OTARI_API_BASE	✅	✅	✅	✅	✅	✅	✅	✅
perplexity	🤝 Community	PERPLEXITY_API_KEY	PERPLEXITY_BASE_URL	❌	✅	✅	❌	✅	❌	❌	❌
portkey	✅ Verified	PORTKEY_API_KEY	PORTKEY_API_BASE	❌	✅	✅	✅	✅	❌	✅	❌
qiniu	🤝 Community	QINIU_API_KEY	QINIU_API_BASE	❌	✅	✅	✅	✅	✅	✅	❌
requesty	🤝 Community	REQUESTY_API_KEY	REQUESTY_API_BASE	❌	✅	✅	✅	✅	✅	✅	❌
sagemaker	🤝 Community	AWS_ACCESS_KEY_ID and AWS_SECRET_ACCESS_KEY	SAGEMAKER_ENDPOINT_URL	❌	✅	✅	❌	✅	✅	❌	❌
sambanova	✅ Verified	SAMBANOVA_API_KEY	SAMBANOVA_API_BASE	❌	✅	✅	✅	✅	✅	✅	❌
telnyx	🤝 Community	TELNYX_API_KEY	TELNYX_API_BASE	❌	✅	✅	✅	✅	❌	✅	❌
together	✅ Verified	TOGETHER_API_KEY	TOGETHER_API_BASE	❌	✅	✅	✅	✅	✅	✅	✅
vertexai	🤝 Community		VERTEXAI_API_BASE	❌	✅	✅	✅	✅	✅	✅	✅
vertexaianthropic	🤝 Community		VERTEXAI_ANTHROPIC_API_BASE	❌	✅	✅	✅	✅	❌	❌	✅
vllm	🤝 Community	VLLM_API_KEY	VLLM_API_BASE	❌	✅	✅	✅	✅	✅	✅	❌
voyage	✅ Verified	VOYAGE_API_KEY	VOYAGE_API_BASE	❌	❌	❌	❌	❌	✅	❌	❌
watsonx	🤝 Community	WATSONX_API_KEY	WATSONX_URL	❌	✅	✅	❌	✅	❌	✅	❌
xai	✅ Verified	XAI_API_KEY	XAI_API_BASE	❌	✅	✅	✅	❌	❌	✅	❌
zai	✅ Verified	ZAI_API_KEY	ZAI_BASE_URL	❌	✅	✅	✅	❌	❌	✅	❌