Large Language Models Types of LLMs in AnythingLLM System LLM Workspace LLM Agent LLM Supported LLM Providers Local Language Model Providers Cloud Language Model Providers ...
Upstream Formats OpenAI Format Ollama Format Using the plugin with Mistral Prerequisites Set up route and plugin Test the configuration This guide walks you through setting...
OpenAI (Generic) LLM Connecting to OpenAI (Generic) OpenAI (Generic) LLM ️‼️ Caution! This is a developer-focused llm provider - you should not use it unless you know what...
Upstream Formats OpenAI Format Ollama Format Using the plugin with Mistral Prerequisites Set up route and plugin Test the configuration This guide walks you through setting...
Upstream Formats OpenAI Format Ollama Format Using the plugin with Mistral Prerequisites Set up route and plugin Test the configuration This guide walks you through setting...
Kong AI Gateway How to get started What is the Kong AI Gateway? AI Gateway capabilities AI Provider Proxy AI usage governance Data governance Prompt engineering Request transf...
Use Cases Semantic Search LLM Orchestration Chains Retrieval augmented generation Language Model Workflows Use Cases The following sections introduce common txtai use cases...
Kong AI Gateway How to get started What is the Kong AI Gateway? AI Gateway capabilities AI Provider Proxy AI usage governance Data governance Prompt engineering Request transf...
Conversational search Conversation history RAG Prerequisites Using conversational search Step 1: Create a connector to a model Step 2: Register and deploy the model Step 3: Cr...