Class GoogleCloudAiplatformV1EvaluationRunInferenceConfig

Defines the configuration for a candidate model or agent being evaluated. InferenceConfig encapsulates all the necessary information to invoke or scrape the candidate during the evaluation run. This includes direct model inference parameters, agent execution settings, and multi-turn scraping configurations (such as user simulators). It serves as the primary representation of the candidate across different stages of the evaluation process.

Inheritance

object

GoogleCloudAiplatformV1EvaluationRunInferenceConfig

Implements

IDirectResponseSchema

Inherited Members

object.Equals(object)

object.Equals(object, object)

object.GetHashCode()

object.GetType()

object.MemberwiseClone()

object.ReferenceEquals(object, object)

object.ToString()

Namespace: Google.Apis.Aiplatform.v1.Data

Assembly: Google.Apis.Aiplatform.v1.dll

Syntax

public class GoogleCloudAiplatformV1EvaluationRunInferenceConfig : IDirectResponseSchema

Properties

AgentRunConfig

Optional. Agent run config.

Declaration

[JsonProperty("agentRunConfig")]
public virtual GoogleCloudAiplatformV1EvaluationRunInferenceConfigAgentRunConfig AgentRunConfig { get; set; }

Property Value

Type	Description
GoogleCloudAiplatformV1EvaluationRunInferenceConfigAgentRunConfig

Agents

Optional. Contains the static configurations for each agent in the system. Key: agent_id (matches the author field in events). Value: The static configuration of the agent.

Declaration

[JsonProperty("agents")]
public virtual IDictionary<string, GoogleCloudAiplatformV1AgentConfig> Agents { get; set; }

Property Value

Type	Description
IDictionary<string, GoogleCloudAiplatformV1AgentConfig>

ETag

The ETag of the item.

Declaration

public virtual string ETag { get; set; }

Property Value

Type	Description
string

GenerationConfig

Optional. Generation config.

Declaration

[JsonProperty("generationConfig")]
public virtual GoogleCloudAiplatformV1GenerationConfig GenerationConfig { get; set; }

Property Value

Type	Description
GoogleCloudAiplatformV1GenerationConfig

Model

Optional. The fully qualified name of the publisher model or endpoint to use. Anthropic and Llama third-party models are also supported through Model Garden. Publisher model format: projects/{project}/locations/{location}/publishers/*/models/* Third-party model formats: projects/{project}/locations/{location}/publishers/anthropic/models/{model} or projects/{project}/locations/{location}/publishers/llama/models/{model} Endpoint format: projects/{project}/locations/{location}/endpoints/{endpoint}

Declaration

[JsonProperty("model")]
public virtual string Model { get; set; }

Property Value

Type	Description
string

Parallelism

Optional. The parallelism of the evaluation run for the inference step. If not specified, the default parallelism will be used.

Declaration

[JsonProperty("parallelism")]
public virtual int? Parallelism { get; set; }

Property Value

Type	Description
int?

PromptTemplate

Optional. The prompt template used for inference. The values for variables in the prompt template are defined in EvaluationItem.EvaluationPrompt.PromptTemplateData.values. If not specified, the prompt template in the EvaluationConfig will be used.

Declaration

[JsonProperty("promptTemplate")]
public virtual GoogleCloudAiplatformV1EvaluationRunEvaluationConfigPromptTemplate PromptTemplate { get; set; }

Property Value

Type	Description
GoogleCloudAiplatformV1EvaluationRunEvaluationConfigPromptTemplate

Implements

IDirectResponseSchema