AI Agents Quick Links AI Agents Agents are basically an LLM that has access to some simple tools. We will be adding much more customization in this area soon. All agents sha...
AI 缓存 功能说明 配置说明 配置示例 AI 缓存 功能说明 AI 缓存插件实现了将 LLM 响应进行抽取并缓存的功能,对于向 LLM API 高频请求相同问题的场景可以显著降低响应时延并节省成本。默认配置方式可以直接用于 openai 协议的结果缓存,同时支持流式和非流式响应的缓存。 需要数据面的proxy wasm版本大于等于0.2....
Examples Semantic Search LLM Pipelines Workflows Model Training Scale Architecture Releases Applications Examples See below for a comprehensive series of example not...
How to get started ⚠️ High performance GPU required The process of training your own LLM locally is very resource intensive and will require a GPU with at least 16GB of VRAM....
Examples Semantic Search LLM Pipelines Workflows Model Training Scale Architecture Releases Applications Examples See below for a comprehensive series of example not...
Workflow tutorial Workflow graph 1. Deploy a model on the cluster create_connector_1 register_model_2 deploy_model_3 Ordering steps 2. Use the deployed model for inference ca...
Workflow tutorial Workflow graph 1. Deploy a model on the cluster create_connector_1 register_model_2 deploy_model_3 Ordering steps 2. Use the deployed model for inference ca...
Large Language Models Supported Language Model Providers Local Language Model Providers Cloud Language Model Providers Large Language Models AnythingLLM allows you to use a...