Large Language Models

AnythingLLM allows you to use a host of LLM providers for chatting and generative AI.

Depending on your selection additional configuration might be required.

Supported Language Model Providers

Local Language Model Providers

Built-in (default)→Ollama→LM Studio→Local AI→

Cloud Language Model Providers

OpenAI→Azure OpenAI→AWS Bedrock→Anthropic→Cohere→Google Gemini Pro→Hugging Face→Together AI→OpenRouter→Perplexity AI→Mistral API→Groq→KobaldCPP→OpenAI (generic)→