AI agent for text generation requests

The AI agent used for generating text.

type string

exampleai_agent_text_gen

The type of AI agent used for generating text.

Value is always ai_agent_text_gen

basic_gen object

AI agent basic tool used to generate text.

basic_gen.content_template string

example---{content}---

How the content should be included in a request to the LLM. Input for {content} is optional, depending on the use.

basic_gen.embeddings object

embeddings.model string

exampleopenai__text_embedding_ada_002

The model used for the AI Agent for calculating embeddings.

embeddings.strategy object

strategy.id string

examplebasic

The strategy used for the AI Agent for calculating embeddings.

strategy.num_tokens_per_chunk integer

example64min1

The number of tokens per chunk.

basic_gen.llm_endpoint_params AI LLM endpoint params Google / AI LLM endpoint params OpenAI object

The parameters for the LLM endpoint specific to OpenAI / Google models.

basic_gen.model string

exampleopenai__gpt_3_5_turbo

The model used for the AI Agent for basic text.

basic_gen.num_tokens_for_completion integer

example8400min1

The number of tokens for completion.

basic_gen.prompt_template string

pattern\{user_question\}exampleIt is `{current_date}`, and I have $8000 and want to spend a week in the Azores. `{user_question}`max length10000

The prompt template contains contextual information of the request and the user prompt.

When using the prompt_template parameter, you must include input for {user_question}. Inputs for {current_date} and {content} are optional, depending on the use.

basic_gen.system_message string

exampleYou are a helpful travel assistant specialized in budget travel

System messages try to help the LLM "understand" its role and what it is supposed to do. Input for {current_date} is optional, depending on the use.

Response Example

{
  "type": "ai_agent_text_gen",
  "basic_gen": {
    "content_template": "---{content}---",
    "embeddings": {
      "model": "openai__text_embedding_ada_002",
      "strategy": {
        "id": "basic",
        "num_tokens_per_chunk": 64
      }
    },
    "llm_endpoint_params": {
      "type": "openai_params",
      "frequency_penalty": 1.5,
      "presence_penalty": 1.5,
      "stop": "<|im_end|>",
      "temperature": 0,
      "top_p": 1
    },
    "model": "openai__gpt_3_5_turbo",
    "num_tokens_for_completion": 8400,
    "prompt_template": "It is `{current_date}`, and I have $8000 and want to spend a week in the Azores. `{user_question}`",
    "system_message": "You are a helpful travel assistant specialized in budget travel"
  }
}