AnythingLLM Default LLM

️💡

DESKTOP ONLY!

This default llm provider feature is only present on Desktop Version of AnythingLLM

AnythingLLM ships with a built-in LLM engine and provider that enables you to download popular and highly-rated LLMs like LLama-3, Phi-3 and more that can run locally on your CPU and GPU.

When you boot up AnythingLLM Desktop you will be able to select the model you wish to download. Its progress will be tracked in the top-right of the application window.

You can update your model to a different model at any time in the Settings.