module pixeltable.functions.groq
View source on GitHub
Pixeltable UDFs that wrap various endpoints from the Groq API. In order to use them, you must first pip install groq and configure your Groq credentials, as described in the Working with Groq tutorial.
func invoke_tools()
tools._invoke().
udf chat_completions()
chat/completions API endpoint. For additional details, see: https://console.groq.com/docs/api-reference#chat-create
Request throttling: Applies the rate limit set in the config (section groq, key rate_limit). If no rate limit is configured, uses a default of 600 RPM.
Requirements:
pip install groq
messages(Json): A list of messages comprising the conversation so far.model(String): ID of the model to use. (See overview here: https://console.groq.com/docs/models)model_kwargs(Json | None): Additional keyword args for the Groqchat/completionsAPI. For details on the available parameters, see: https://console.groq.com/docs/api-reference#chat-create
Json: A dictionary containing the response and other metadata.
llama-3.1-8b-instant to an existing Pixeltable column tbl.prompt of the table tbl: