HuggingFace LLM

HuggingFace (opens in a new tab) is where the world puts open-source LLMs and other AI models online.

All of the raw model files of over 100,000 LLMs can be found here and run while connected to AnythingLLM.

Connecting to Hugging Face

️💡

Valid Configuration required!

This integration is specific to the HuggingFace serverless inference service that HuggingFace runs.

️💡

Tip:

This integration works best when a model’s chat template is defined. You may get unexpected results otherwise.

You can update your model to a different model at any time in the Settings.