Description
Integrates with Groq AI models to generate responses and handle interactions. This middleware leverages Groq's capabilities to enhance the chat engine's response generation.
GroqgroqRequired
Modeltext
- Default option: gemma2-9b-it
- Options
- gemma2-9b-itgemma2-9b-it
- llama-3.3-70b-versatilellama-3.3-70b-versatile
- llama-3.1-8b-instantllama-3.1-8b-instant
- llama-guard-3-8bllama-guard-3-8b
- llama3-70b-8192llama3-70b-8192
- llama3-8b-8192llama3-8b-8192
- mixtral-8x7b-32768mixtral-8x7b-32768
- deepseek-r1-distill-llama-70b (preview)deepseek-r1-distill-llama-70b
Temperaturenumber