Chroma Vector Database

Chroma (opens in a new tab) is an open-source (opens in a new tab) and ai-native vector database that is easy to run and host anywhere.

AnythingLLM can connect to your local or cloud-hosted Chroma instance running so that AnythingLLM can store and search embeddings on it automatically.

Connecting to Chroma Vector Database

️⚠️

Developer Notice

Chroma requires a server (opens in a new tab) to be running so that Chroma can embed or index your embeddings automatically.

AnythingLLM will use the embedding model set and will not use Chroma’s built-in embedders even if defined.

You can configure Chroma at any time in the Settings.

How to run Chroma Locally via Docker