> For the complete documentation index, see [llms.txt](https://docs.mozilla.ai/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://docs.mozilla.ai/providers.md).

# Providers

Complete list of LLM providers supported by any-llm including OpenAI, Anthropic, Mistral, and more

`any-llm` supports multiple providers. Provider source code is in [`src/any_llm/providers/`](https://github.com/mozilla-ai/any-llm/tree/main/src/any_llm/providers).

Is your endpoint OpenAI-compatible but not listed below? You are not blocked: use [`AnyLLM.create_openai_compatible`](/quickstart.md#custom-openai-compatible-endpoints). Prefer it over pointing the `openai` provider at a custom `api_base`, which misreports the provider identity as `openai`, silently sends any `OPENAI_API_KEY` in your environment to the custom endpoint, and rejects keyless local servers.

### Support tiers

The **Tier** column is a support promise, not a statement about how the provider is implemented:

* ✅ **Verified**: we hold an API key, integration tests run against the provider in CI, and we fix breakage.
* 🤝 **Community**: verified live by the contributor when it was added, then community-maintained. No CI key, so its integration tests skip in CI. Report breakage by opening an issue.

A provider can be verified whether it ships as a code folder or as a single config row, and a config-only gateway we hold a key for is verified.

| ID                                                                                                               | Tier         | Key                                               | Base                                 | Responses | Completion | <p>Streaming<br>(Completions)</p> | <p>Reasoning<br>(Completions)</p> | <p>Image<br>(Completions)</p> | Embedding | List Models | Batch |
| ---------------------------------------------------------------------------------------------------------------- | ------------ | ------------------------------------------------- | ------------------------------------ | --------- | ---------- | --------------------------------- | --------------------------------- | ----------------------------- | --------- | ----------- | ----- |
| [`anthropic`](https://docs.anthropic.com/en/home)                                                                | ✅ Verified   | ANTHROPIC\_API\_KEY                               | ANTHROPIC\_BASE\_URL                 | ❌         | ✅          | ✅                                 | ✅                                 | ✅                             | ❌         | ✅           | ✅     |
| [`atlascloud`](https://www.atlascloud.ai/docs)                                                                   | 🤝 Community | ATLASCLOUD\_API\_KEY                              | ATLASCLOUD\_API\_BASE                | ❌         | ✅          | ✅                                 | ✅                                 | ❌                             | ❌         | ✅           | ❌     |
| [`azure`](https://learn.microsoft.com/en-us/azure/foundry/foundry-models/concepts/models-sold-directly-by-azure) | 🤝 Community | AZURE\_API\_KEY                                   | AZURE\_AI\_CHAT\_ENDPOINT            | ❌         | ✅          | ✅                                 | ❌                                 | ❌                             | ✅         | ✅           | ❌     |
| [`azureanthropic`](https://learn.microsoft.com/en-us/azure/ai-foundry/model-inference/concepts/models)           | 🤝 Community | AZURE\_ANTHROPIC\_API\_KEY                        | AZURE\_ANTHROPIC\_API\_BASE          | ❌         | ✅          | ✅                                 | ✅                                 | ✅                             | ❌         | ❌           | ✅     |
| [`azureopenai`](https://learn.microsoft.com/azure/foundry/openai/api-version-lifecycle)                          | ✅ Verified   | AZURE\_OPENAI\_API\_KEY                           | AZURE\_OPENAI\_ENDPOINT              | ✅         | ✅          | ✅                                 | ❌                                 | ✅                             | ✅         | ✅           | ❌     |
| [`bedrock`](https://aws.amazon.com/bedrock/)                                                                     | ✅ Verified   | AWS\_BEARER\_TOKEN\_BEDROCK                       | AWS\_ENDPOINT\_URL\_BEDROCK\_RUNTIME | ❌         | ✅          | ✅                                 | ✅                                 | ✅                             | ✅         | ✅           | ✅     |
| [`cascadia`](https://cascadia.to)                                                                                | 🤝 Community | CASCADIA\_API\_KEY                                | CASCADIA\_API\_BASE                  | ❌         | ✅          | ✅                                 | ✅                                 | ❌                             | ❌         | ✅           | ❌     |
| [`cerebras`](https://docs.cerebras.ai/)                                                                          | ✅ Verified   | CEREBRAS\_API\_KEY                                | CEREBRAS\_API\_BASE                  | ❌         | ✅          | ✅                                 | ✅                                 | ❌                             | ❌         | ✅           | ❌     |
| [`cohere`](https://cohere.com/api)                                                                               | 🤝 Community | COHERE\_API\_KEY                                  | COHERE\_BASE\_URL                    | ❌         | ✅          | ✅                                 | ✅                                 | ✅                             | ✅         | ✅           | ❌     |
| [`dashscope`](https://bailian.console.aliyun.com/cn-beijing/?tab=api#/api)                                       | 🤝 Community | DASHSCOPE\_API\_KEY                               | DASHSCOPE\_API\_BASE                 | ❌         | ✅          | ✅                                 | ❌                                 | ✅                             | ✅         | ✅           | ❌     |
| [`databricks`](https://docs.databricks.com/)                                                                     | 🤝 Community | DATABRICKS\_TOKEN                                 | DATABRICKS\_HOST                     | ❌         | ✅          | ✅                                 | ✅                                 | ❌                             | ✅         | ❌           | ❌     |
| [`deepinfra`](https://deepinfra.com/docs/openai_api)                                                             | 🤝 Community | DEEPINFRA\_API\_KEY                               | DEEPINFRA\_API\_BASE                 | ❌         | ✅          | ✅                                 | ✅                                 | ✅                             | ✅         | ✅           | ❌     |
| [`deepseek`](https://platform.deepseek.com/)                                                                     | ✅ Verified   | DEEPSEEK\_API\_KEY                                | DEEPSEEK\_API\_BASE                  | ❌         | ✅          | ✅                                 | ✅                                 | ❌                             | ❌         | ✅           | ❌     |
| [`edenai`](https://www.edenai.co/docs)                                                                           | 🤝 Community | EDENAI\_API\_KEY                                  | EDENAI\_API\_BASE                    | ❌         | ✅          | ✅                                 | ❌                                 | ✅                             | ✅         | ✅           | ❌     |
| [`fireworks`](https://fireworks.ai/api)                                                                          | ✅ Verified   | FIREWORKS\_API\_KEY                               | FIREWORKS\_API\_BASE                 | ✅         | ✅          | ✅                                 | ✅                                 | ✅                             | ❌         | ✅           | ❌     |
| [`gemini`](https://ai.google.dev/gemini-api/docs)                                                                | ✅ Verified   | GEMINI\_API\_KEY/GOOGLE\_API\_KEY                 | GOOGLE\_GEMINI\_BASE\_URL            | ❌         | ✅          | ✅                                 | ✅                                 | ✅                             | ✅         | ✅           | ✅     |
| [`github`](https://docs.github.com/en/github-models)                                                             | 🤝 Community | GITHUB\_TOKEN                                     | GITHUB\_MODELS\_API\_BASE            | ❌         | ✅          | ✅                                 | ❌                                 | ❌                             | ✅         | ✅           | ❌     |
| [`gmi`](https://docs.gmicloud.ai/inference-engine/api-reference/llm-api-reference)                               | 🤝 Community | GMI\_API\_KEY                                     | GMI\_API\_BASE                       | ✅         | ✅          | ✅                                 | ✅                                 | ❌                             | ❌         | ✅           | ❌     |
| [`groq`](https://groq.com/api)                                                                                   | ✅ Verified   | GROQ\_API\_KEY                                    | GROQ\_BASE\_URL                      | ✅         | ✅          | ✅                                 | ✅                                 | ❌                             | ❌         | ✅           | ❌     |
| [`huggingface`](https://huggingface.co/docs/huggingface_hub/package_reference/inference_client)                  | 🤝 Community | HF\_TOKEN                                         | HUGGINGFACE\_API\_BASE               | ✅         | ✅          | ✅                                 | ❌                                 | ❌                             | ❌         | ✅           | ❌     |
| [`inception`](https://inceptionlabs.ai/)                                                                         | ✅ Verified   | INCEPTION\_API\_KEY                               | INCEPTION\_API\_BASE                 | ❌         | ✅          | ✅                                 | ❌                                 | ❌                             | ❌         | ✅           | ❌     |
| [`kenari`](https://kenari.id/docs)                                                                               | 🤝 Community | KENARI\_API\_KEY                                  | KENARI\_API\_BASE                    | ❌         | ✅          | ✅                                 | ✅                                 | ❌                             | ❌         | ✅           | ❌     |
| [`llama`](https://www.llama.com/products/llama-api/)                                                             | 🤝 Community | LLAMA\_API\_KEY                                   | LLAMA\_API\_BASE                     | ❌         | ✅          | ✅                                 | ❌                                 | ❌                             | ❌         | ✅           | ❌     |
| [`llamacpp`](https://github.com/ggml-org/llama.cpp)                                                              | ✅ Verified   | None                                              | LLAMACPP\_API\_BASE                  | ❌         | ✅          | ✅                                 | ✅                                 | ✅                             | ✅         | ✅           | ❌     |
| [`llamafile`](https://github.com/Mozilla-Ocho/llamafile)                                                         | ✅ Verified   | None                                              | LLAMAFILE\_API\_BASE                 | ❌         | ✅          | ❌                                 | ✅                                 | ❌                             | ❌         | ✅           | ❌     |
| [`lmstudio`](https://lmstudio.ai/docs/python)                                                                    | ✅ Verified   | LM\_STUDIO\_API\_KEY                              | LM\_STUDIO\_API\_BASE                | ❌         | ✅          | ✅                                 | ✅                                 | ❌                             | ✅         | ✅           | ❌     |
| [`meta`](https://dev.meta.ai/docs)                                                                               | 🤝 Community | MODEL\_API\_KEY                                   | META\_API\_BASE                      | ✅         | ✅          | ✅                                 | ❌                                 | ✅                             | ❌         | ✅           | ❌     |
| [`minimax`](https://www.minimax.io/platform_overview)                                                            | ✅ Verified   | MINIMAX\_API\_KEY                                 | MINIMAX\_API\_BASE                   | ❌         | ✅          | ✅                                 | ✅                                 | ❌                             | ❌         | ❌           | ❌     |
| [`mistral`](https://docs.mistral.ai/)                                                                            | ✅ Verified   | MISTRAL\_API\_KEY                                 | MISTRAL\_API\_BASE                   | ❌         | ✅          | ✅                                 | ✅                                 | ❌                             | ✅         | ✅           | ✅     |
| [`moonshot`](https://platform.moonshot.ai/)                                                                      | ✅ Verified   | MOONSHOT\_API\_KEY                                | MOONSHOT\_API\_BASE                  | ❌         | ✅          | ✅                                 | ✅                                 | ❌                             | ❌         | ✅           | ❌     |
| [`mzai`](https://any-llm.ai)                                                                                     | 🤝 Community | ANY\_LLM\_KEY                                     | ANY\_LLM\_PLATFORM\_URL              | ❌         | ✅          | ✅                                 | ✅                                 | ✅                             | ✅         | ✅           | ❌     |
| [`nebius`](https://studio.nebius.ai/)                                                                            | ✅ Verified   | NEBIUS\_API\_KEY                                  | NEBIUS\_API\_BASE                    | ❌         | ✅          | ✅                                 | ✅                                 | ✅                             | ✅         | ✅           | ❌     |
| [`neosantara`](https://docs.neosantara.xyz)                                                                      | 🤝 Community | NEOSANTARA\_API\_KEY                              | NEOSANTARA\_API\_BASE                | ✅         | ✅          | ✅                                 | ✅                                 | ✅                             | ✅         | ✅           | ✅     |
| [`ollama`](https://github.com/ollama/ollama)                                                                     | ✅ Verified   | None                                              | OLLAMA\_HOST                         | ❌         | ✅          | ✅                                 | ✅                                 | ✅                             | ✅         | ✅           | ❌     |
| [`openai`](https://platform.openai.com/docs/api-reference)                                                       | ✅ Verified   | OPENAI\_API\_KEY                                  | OPENAI\_BASE\_URL                    | ✅         | ✅          | ✅                                 | ❌                                 | ✅                             | ✅         | ✅           | ✅     |
| [`openrouter`](https://openrouter.ai/docs)                                                                       | ✅ Verified   | OPENROUTER\_API\_KEY                              | OPENROUTER\_API\_BASE                | ✅         | ✅          | ✅                                 | ✅                                 | ✅                             | ✅         | ✅           | ❌     |
| [`otari`](https://mozilla-ai.github.io/otari/)                                                                   | ✅ Verified   | OTARI\_API\_KEY                                   | OTARI\_API\_BASE                     | ✅         | ✅          | ✅                                 | ✅                                 | ✅                             | ✅         | ✅           | ✅     |
| [`ovhcloud`](https://docs.ovhcloud.com/en/guides/public-cloud/ai-machine-learning/ai-endpoints-getting-started)  | 🤝 Community | OVHCLOUD\_API\_KEY                                | OVHCLOUD\_API\_BASE                  | ❌         | ✅          | ✅                                 | ❌                                 | ❌                             | ❌         | ✅           | ❌     |
| [`perplexity`](https://docs.perplexity.ai/)                                                                      | 🤝 Community | PERPLEXITY\_API\_KEY                              | PERPLEXITY\_BASE\_URL                | ❌         | ✅          | ✅                                 | ❌                                 | ✅                             | ❌         | ❌           | ❌     |
| [`portkey`](https://portkey.ai/docs)                                                                             | ✅ Verified   | PORTKEY\_API\_KEY                                 | PORTKEY\_API\_BASE                   | ❌         | ✅          | ✅                                 | ✅                                 | ✅                             | ❌         | ✅           | ❌     |
| [`qiniu`](https://developer.qiniu.com/aitokenapi)                                                                | 🤝 Community | QINIU\_API\_KEY                                   | QINIU\_API\_BASE                     | ❌         | ✅          | ✅                                 | ✅                                 | ✅                             | ✅         | ✅           | ❌     |
| [`requesty`](https://docs.requesty.ai)                                                                           | 🤝 Community | REQUESTY\_API\_KEY                                | REQUESTY\_API\_BASE                  | ❌         | ✅          | ✅                                 | ✅                                 | ✅                             | ✅         | ✅           | ❌     |
| [`sagemaker`](https://aws.amazon.com/sagemaker/)                                                                 | 🤝 Community | AWS\_ACCESS\_KEY\_ID and AWS\_SECRET\_ACCESS\_KEY | SAGEMAKER\_ENDPOINT\_URL             | ❌         | ✅          | ✅                                 | ❌                                 | ✅                             | ✅         | ❌           | ❌     |
| [`sambanova`](https://sambanova.ai/)                                                                             | ✅ Verified   | SAMBANOVA\_API\_KEY                               | SAMBANOVA\_API\_BASE                 | ❌         | ✅          | ✅                                 | ✅                                 | ✅                             | ✅         | ✅           | ❌     |
| [`telnyx`](https://developers.telnyx.com/docs/inference/getting-started)                                         | 🤝 Community | TELNYX\_API\_KEY                                  | TELNYX\_API\_BASE                    | ❌         | ✅          | ✅                                 | ✅                                 | ✅                             | ❌         | ✅           | ❌     |
| [`together`](https://together.ai/)                                                                               | ✅ Verified   | TOGETHER\_API\_KEY                                | TOGETHER\_API\_BASE                  | ❌         | ✅          | ✅                                 | ✅                                 | ✅                             | ✅         | ✅           | ✅     |
| [`vertexai`](https://cloud.google.com/vertex-ai/docs)                                                            | 🤝 Community |                                                   | VERTEXAI\_API\_BASE                  | ❌         | ✅          | ✅                                 | ✅                                 | ✅                             | ✅         | ✅           | ✅     |
| [`vertexaianthropic`](https://cloud.google.com/vertex-ai/generative-ai/docs/partner-models/use-claude)           | 🤝 Community |                                                   | VERTEXAI\_ANTHROPIC\_API\_BASE       | ❌         | ✅          | ✅                                 | ✅                                 | ✅                             | ❌         | ❌           | ✅     |
| [`vllm`](https://docs.vllm.ai/)                                                                                  | 🤝 Community | VLLM\_API\_KEY                                    | VLLM\_API\_BASE                      | ❌         | ✅          | ✅                                 | ✅                                 | ✅                             | ✅         | ✅           | ❌     |
| [`voyage`](https://docs.voyageai.com/)                                                                           | ✅ Verified   | VOYAGE\_API\_KEY                                  | VOYAGE\_API\_BASE                    | ❌         | ❌          | ❌                                 | ❌                                 | ❌                             | ✅         | ❌           | ❌     |
| [`watsonx`](https://www.ibm.com/watsonx)                                                                         | 🤝 Community | WATSONX\_API\_KEY                                 | WATSONX\_URL                         | ❌         | ✅          | ✅                                 | ❌                                 | ✅                             | ❌         | ✅           | ❌     |
| [`xai`](https://x.ai/)                                                                                           | ✅ Verified   | XAI\_API\_KEY                                     | XAI\_API\_BASE                       | ❌         | ✅          | ✅                                 | ✅                                 | ❌                             | ❌         | ✅           | ❌     |
| [`zai`](https://docs.z.ai/guides/develop/python/introduction)                                                    | ✅ Verified   | ZAI\_API\_KEY                                     | ZAI\_BASE\_URL                       | ❌         | ✅          | ✅                                 | ✅                                 | ❌                             | ❌         | ✅           | ❌     |


---

# Agent Instructions
This documentation is published with GitBook. GitBook is the documentation platform designed so that both humans and AI agents can read, navigate, and reason over technical content effectively. Learn more at gitbook.com.

## Querying This Documentation
If you need additional information that is not directly available in this page, you can query the documentation dynamically by asking a question.

Perform an HTTP GET request on the current page URL with the `ask` query parameter, and the optional `goal` query parameter:

```
GET https://docs.mozilla.ai/providers.md?ask=<question>&goal=<endgoal>
```

`ask` is the immediate question: it should be specific, self-contained, and written in natural language.
`goal` is optional and describes the broader end goal you are ultimately trying to accomplish on behalf of the user. GitBook uses it to tailor the answer towards what is most useful for that goal.

The response will contain a direct answer to the question and relevant excerpts and sources from the documentation.

Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.