Class GoogleCloudAiplatformV1EvaluationRunEvaluationConfig

The Evalution configuration used for the evaluation run.

Inheritance

object

GoogleCloudAiplatformV1EvaluationRunEvaluationConfig

Implements

IDirectResponseSchema

Inherited Members

object.Equals(object)

object.Equals(object, object)

object.GetHashCode()

object.GetType()

object.MemberwiseClone()

object.ReferenceEquals(object, object)

object.ToString()

Namespace: Google.Apis.Aiplatform.v1.Data

Assembly: Google.Apis.Aiplatform.v1.dll

Syntax

public class GoogleCloudAiplatformV1EvaluationRunEvaluationConfig : IDirectResponseSchema

Properties

AutoraterConfig

Optional. The autorater config for the evaluation run.

Declaration

[JsonProperty("autoraterConfig")]
public virtual GoogleCloudAiplatformV1EvaluationRunEvaluationConfigAutoraterConfig AutoraterConfig { get; set; }

Property Value

Type	Description
GoogleCloudAiplatformV1EvaluationRunEvaluationConfigAutoraterConfig

ETag

The ETag of the item.

Declaration

public virtual string ETag { get; set; }

Property Value

Type	Description
string

Metrics

Required. The metrics to be calculated in the evaluation run.

Declaration

[JsonProperty("metrics")]
public virtual IList<GoogleCloudAiplatformV1EvaluationRunMetric> Metrics { get; set; }

Property Value

Type	Description
IList<GoogleCloudAiplatformV1EvaluationRunMetric>

OutputConfig

Optional. The output config for the evaluation run.

Declaration

[JsonProperty("outputConfig")]
public virtual GoogleCloudAiplatformV1EvaluationRunEvaluationConfigOutputConfig OutputConfig { get; set; }

Property Value

Type	Description
GoogleCloudAiplatformV1EvaluationRunEvaluationConfigOutputConfig

PromptTemplate

The prompt template used for inference. The values for variables in the prompt template are defined in EvaluationItem.EvaluationPrompt.PromptTemplateData.values.

Declaration

[JsonProperty("promptTemplate")]
public virtual GoogleCloudAiplatformV1EvaluationRunEvaluationConfigPromptTemplate PromptTemplate { get; set; }

Property Value

Type	Description
GoogleCloudAiplatformV1EvaluationRunEvaluationConfigPromptTemplate

RubricConfigs

Optional. The rubric configs for the evaluation run. They are used to generate rubrics which can be used by rubric-based metrics. Multiple rubric configs can be specified for rubric generation but only one rubric config can be used for a rubric-based metric. If more than one rubric config is provided, the evaluation metric must specify a rubric group key. Note that if a generation spec is specified on both a rubric config and an evaluation metric, the rubrics generated for the metric will be used for evaluation.

Declaration

[JsonProperty("rubricConfigs")]
public virtual IList<GoogleCloudAiplatformV1EvaluationRubricConfig> RubricConfigs { get; set; }

Property Value

Type	Description
IList<GoogleCloudAiplatformV1EvaluationRubricConfig>

Implements

IDirectResponseSchema