example:
ai_agent_text_genThe type of AI agent used for generating text.Value is always ai_agent_text_genAI agent basic tool used to generate text.
Show child attributes
Show child attributes
example:
---{content}---How the content should be included in a request to the LLM.
Input for {content} is optional, depending on the use.Show child attributes
Show child attributes
example:
azure__openai__text_embedding_ada_002The model used for the AI agent for calculating embeddings.llm_endpoint_params
AI LLM endpoint params AWS/AI LLM endpoint params Google/AI LLM endpoint params IBM/AI LLM endpoint params OpenAIobject
The parameters for the LLM endpoint specific to a model.
example:
azure__openai__gpt_4o_miniThe model used for the AI agent for basic text. For specific model values, see the available models list.example:
8400The number of tokens for completion.example:
\{user_question\}The prompt template contains contextual information of the request and the user prompt.When using the prompt_template parameter, you must include input for {user_question}.
Inputs for {current_date} and {content} are optional, depending on the use.example:
You are a helpful travel assistant specialized in budget travelSystem messages aim at helping the LLM understand its role and what it is supposed to do.
The input for {current_date} is optional, depending on the use.Copy
Ask AI
{
"type": "ai_agent_text_gen",
"basic_gen": {
"content_template": "---{content}---",
"embeddings": {
"model": "azure__openai__text_embedding_ada_002",
"strategy": {
"id": "basic",
"num_tokens_per_chunk": 64
}
},
"llm_endpoint_params": {
"type": "openai_params",
"frequency_penalty": 1.5,
"presence_penalty": 1.5,
"stop": "<|im_end|>",
"temperature": 0,
"top_p": 1
},
"model": "azure__openai__gpt_4o_mini",
"num_tokens_for_completion": 8400,
"prompt_template": "It is `{current_date}`, and I have $8000 and want to spend a week in the Azores. `{user_question}`",
"system_message": "You are a helpful travel assistant specialized in budget travel"
}
}