pip install groq and configure your Groq credentials, as described in the Working with Groq tutorial.
View source on GitHub
func invoke_tools()
tools._invoke().
udf chat_completions()
chat/completions API endpoint. For additional details, see: https://console.groq.com/docs/api-reference#chat-create
Request throttling: Applies the rate limit set in the config (section groq, key rate_limit). If no rate limit is configured, uses a default of 600 RPM.
Requirements:
pip install groq
messages(Json): A list of messages comprising the conversation so far.model(String): ID of the model to use. (See overview here: https://console.groq.com/docs/models)model_kwargs(Json | None): Additional keyword args for the Groqchat/completionsAPI. For details on the available parameters, see: https://console.groq.com/docs/api-reference#chat-create
Json: A dictionary containing the response and other metadata.
llama-3.1-8b-instant to an existing Pixeltable column tbl.prompt of the table tbl: