Prerequisites Provider configuration Create or locate OpenAI instance Create or locate model deployment Set up route and plugin Test the configuration This guide walks you t...
CreateAnomalyDetectorTool Step 1: Register a flow agent that runs the CreateAnomalyDetectorTool Step 2: Run the agent Register parameters Execute parameters CreateAnomalyDet...
Upstream formats Raw format Ollama format OpenAI format Using the plugin with Llama2 Prerequisites Provider configuration Set up route and plugin Test the configuration T...
Use Cases Semantic Search LLM Orchestration Language Model Workflows Use Cases The following sections introduce common txtai use cases. A comprehensive set of over 50 example...
HuggingFace LLM Connecting to Hugging Face HuggingFace LLM HuggingFace (opens in a new tab) is where the world puts open-source LLMs and other AI models online. All of the ...
Register an agent Path and HTTP methods Request fields Example request: Flow agent Example request: Conversational flow agent Example request: Conversational agent Example resp...
Mistral AI LLM Connecting to Mistral AI Mistral AI LLM Mistral AI (opens in a new tab) is the creator of the popular, uncensored, open-source Mistral-7B model. They provid...
RAG Example Configuration-driven example config.yml Run with Workflows Run with API Methods __init__(similarity, path, quantize=False, gpu=True, model=None, tokenizer=None, mi...
RAG tool Before you start Step 1: Register a flow agent that will run the RAGTool Step 2: Run the agent Register parameters Execute parameters RAG tool Introduced 2.12 Th...