The AI agent used for generating text.
ai_agent_text_gen
The type of AI agent used for generating text.
Value is always ai_agent_text_gen
AI agent basic tool used to generate text.
---{content}---
How the content should be included in a request to the LLM.
Input for {content}
is optional, depending on the use.
openai__text_embedding_ada_002
The model used for the AI Agent for calculating embeddings.
basic
The strategy used for the AI Agent for calculating embeddings.
64
1
The number of tokens per chunk.
The parameters for the LLM endpoint specific to OpenAI / Google models.
openai__gpt_3_5_turbo
The model used for the AI Agent for basic text.
8400
1
The number of tokens for completion.
\{user_question\}
It is `{current_date}`, and I have $8000 and want to spend a week in the Azores. `{user_question}`
10000
The prompt template contains contextual information of the request and the user prompt.
When using the prompt_template
parameter, you must include input for {user_question}
.
Inputs for {current_date}
and {content}
are optional, depending on the use.
You are a helpful travel assistant specialized in budget travel
System messages try to help the LLM "understand" its role and what it is supposed to do.
Input for {current_date}
is optional, depending on the use.
{
"type": "ai_agent_text_gen",
"basic_gen": {
"content_template": "---{content}---",
"embeddings": {
"model": "openai__text_embedding_ada_002",
"strategy": {
"id": "basic",
"num_tokens_per_chunk": 64
}
},
"llm_endpoint_params": {
"type": "openai_params",
"frequency_penalty": 1.5,
"presence_penalty": 1.5,
"stop": "<|im_end|>",
"temperature": 0,
"top_p": 1
},
"model": "openai__gpt_3_5_turbo",
"num_tokens_for_completion": 8400,
"prompt_template": "It is `{current_date}`, and I have $8000 and want to spend a week in the Azores. `{user_question}`",
"system_message": "You are a helpful travel assistant specialized in budget travel"
}
}