Groq LLM

Groq (opens in a new tab) is a model provider popular for pioneering the fastest way to run open-source models.

This provider enables you to get near-instant replies back from your LLM.

If speed is your primary concern - there is no competition.

Connecting to Groq

️💡

Valid API Key required!

You must obtain a valid API key from Groq AI (opens in a new tab) for this integration to work.

Like other LLM providers, the Chat Model Selection dropdown will automatically populate when your API key is entered.

All Groq models are currently available for use with AnythingLLM.

You can update your model to a different model at any time in the Settings.