Providers

Complete list of LLM providers supported by any-llm including OpenAI, Anthropic, Mistral, and more

any-llm supports multiple providers. Provider source code is in src/any_llm/providers/.

ID	Key	Base	Responses	Completion	Streaming (Completions)	Reasoning (Completions)	Image (Completions)	Embedding	List Models	Batch
anthropic	ANTHROPIC_API_KEY	ANTHROPIC_BASE_URL	❌	✅	✅	✅	✅	❌	✅	✅
azure	AZURE_API_KEY	AZURE_AI_CHAT_ENDPOINT	❌	✅	✅	❌	❌	✅	❌	❌
azureanthropic	AZURE_ANTHROPIC_API_KEY	AZURE_ANTHROPIC_API_BASE	❌	✅	✅	✅	✅	❌	❌	✅
azureopenai	AZURE_OPENAI_API_KEY	AZURE_OPENAI_ENDPOINT	✅	✅	✅	❌	✅	✅	✅	❌
bedrock	AWS_BEARER_TOKEN_BEDROCK	AWS_ENDPOINT_URL_BEDROCK_RUNTIME	❌	✅	✅	✅	✅	✅	✅	✅
cerebras	CEREBRAS_API_KEY	CEREBRAS_API_BASE	❌	✅	✅	✅	❌	❌	✅	❌
cohere	COHERE_API_KEY	COHERE_BASE_URL	❌	✅	✅	✅	✅	✅	✅	❌
dashscope	DASHSCOPE_API_KEY	DASHSCOPE_API_BASE	❌	✅	✅	❌	✅	✅	✅	❌
databricks	DATABRICKS_TOKEN	DATABRICKS_HOST	❌	✅	✅	✅	❌	✅	❌	❌
deepinfra	DEEPINFRA_API_KEY	DEEPINFRA_API_BASE	❌	✅	✅	✅	✅	✅	✅	❌
deepseek	DEEPSEEK_API_KEY	DEEPSEEK_API_BASE	❌	✅	✅	✅	❌	❌	✅	❌
fireworks	FIREWORKS_API_KEY	FIREWORKS_API_BASE	✅	✅	✅	✅	✅	❌	✅	❌
gemini	GEMINI_API_KEY/GOOGLE_API_KEY	GOOGLE_GEMINI_BASE_URL	❌	✅	✅	✅	✅	✅	✅	✅
github	GITHUB_TOKEN	GITHUB_MODELS_API_BASE	❌	✅	✅	❌	❌	✅	✅	❌
groq	GROQ_API_KEY	GROQ_BASE_URL	✅	✅	✅	✅	❌	❌	✅	❌
huggingface	HF_TOKEN	HUGGINGFACE_API_BASE	✅	✅	✅	❌	❌	❌	✅	❌
inception	INCEPTION_API_KEY	INCEPTION_API_BASE	❌	✅	✅	❌	❌	❌	✅	❌
llama	LLAMA_API_KEY	LLAMA_API_BASE	❌	✅	✅	❌	❌	❌	✅	❌
llamacpp	None	LLAMACPP_API_BASE	❌	✅	✅	✅	✅	✅	✅	❌
llamafile	None	LLAMAFILE_API_BASE	❌	✅	❌	✅	❌	❌	✅	❌
lmstudio	LM_STUDIO_API_KEY	LM_STUDIO_API_BASE	❌	✅	✅	✅	❌	✅	✅	❌
minimax	MINIMAX_API_KEY	MINIMAX_API_BASE	❌	✅	✅	✅	❌	❌	❌	❌
mistral	MISTRAL_API_KEY	MISTRAL_API_BASE	❌	✅	✅	✅	❌	✅	✅	✅
moonshot	MOONSHOT_API_KEY	MOONSHOT_API_BASE	❌	✅	✅	✅	❌	❌	✅	❌
mzai	ANY_LLM_KEY	ANY_LLM_PLATFORM_URL	❌	✅	✅	✅	✅	✅	✅	❌
nebius	NEBIUS_API_KEY	NEBIUS_API_BASE	❌	✅	✅	✅	✅	✅	✅	❌
neosantara	NEOSANTARA_API_KEY	NEOSANTARA_API_BASE	✅	✅	✅	✅	✅	✅	✅	✅
ollama	None	OLLAMA_HOST	❌	✅	✅	✅	✅	✅	✅	❌
openai	OPENAI_API_KEY	OPENAI_BASE_URL	✅	✅	✅	❌	✅	✅	✅	✅
openrouter	OPENROUTER_API_KEY	OPENROUTER_API_BASE	❌	✅	✅	✅	✅	✅	✅	❌
otari	OTARI_API_KEY	OTARI_API_BASE	✅	✅	✅	✅	✅	✅	✅	✅
perplexity	PERPLEXITY_API_KEY	PERPLEXITY_BASE_URL	❌	✅	✅	❌	✅	❌	❌	❌
portkey	PORTKEY_API_KEY	PORTKEY_API_BASE	❌	✅	✅	✅	✅	❌	✅	❌
qiniu	QINIU_API_KEY	QINIU_API_BASE	❌	✅	✅	✅	✅	✅	✅	❌
sagemaker	AWS_ACCESS_KEY_ID and AWS_SECRET_ACCESS_KEY	SAGEMAKER_ENDPOINT_URL	❌	✅	✅	❌	✅	✅	❌	❌
sambanova	SAMBANOVA_API_KEY	SAMBANOVA_API_BASE	❌	✅	✅	✅	✅	✅	✅	❌
together	TOGETHER_API_KEY	TOGETHER_API_BASE	❌	✅	✅	✅	✅	❌	✅	❌
vertexai		VERTEXAI_API_BASE	❌	✅	✅	✅	✅	✅	✅	✅
vertexaianthropic		VERTEXAI_ANTHROPIC_API_BASE	❌	✅	✅	✅	✅	❌	❌	✅
vllm	VLLM_API_KEY	VLLM_API_BASE	❌	✅	✅	✅	✅	✅	✅	❌
voyage	VOYAGE_API_KEY	VOYAGE_API_BASE	❌	❌	❌	❌	❌	✅	❌	❌
watsonx	WATSONX_API_KEY	WATSONX_URL	❌	✅	✅	❌	✅	❌	✅	❌
xai	XAI_API_KEY	XAI_API_BASE	❌	✅	✅	✅	❌	❌	✅	❌
zai	ZAI_API_KEY	ZAI_BASE_URL	❌	✅	✅	✅	❌	❌	✅	❌