Class EvaluationJob

Defines an evaluation job that runs periodically to generate [Evaluations][google.cloud.datalabeling.v1beta1.Evaluation]. Creating an evaluation job is the starting point for using continuous evaluation.

Inheritance
System.Object
EvaluationJob
Implements
System.IEquatable<EvaluationJob>
Google.Protobuf.IBufferMessage
Inherited Members
System.Object.ToString()
System.Object.GetHashCode()
System.Object.GetType()
System.Object.MemberwiseClone()
Namespace: Google.Cloud.DataLabeling.V1Beta1
Assembly: Google.Cloud.DataLabeling.V1Beta1.dll
Syntax
public sealed class EvaluationJob : IMessage<EvaluationJob>, IEquatable<EvaluationJob>, IDeepCloneable<EvaluationJob>, IBufferMessage, IMessage

Constructors

EvaluationJob()

Declaration
public EvaluationJob()

EvaluationJob(EvaluationJob)

Declaration
public EvaluationJob(EvaluationJob other)
Parameters
Type Name Description
EvaluationJob other

Properties

AnnotationSpecSet

Required. Name of the [AnnotationSpecSet][google.cloud.datalabeling.v1beta1.AnnotationSpecSet] describing all the labels that your machine learning model outputs. You must create this resource before you create an evaluation job and provide its name in the following format:

"projects/<var>{project_id}</var>/annotationSpecSets/<var>{annotation_spec_set_id}</var>"

Declaration
public string AnnotationSpecSet { get; set; }
Property Value
Type Description
System.String

Attempts

Output only. Every time the evaluation job runs and an error occurs, the failed attempt is appended to this array.

Declaration
public RepeatedField<Attempt> Attempts { get; }
Property Value
Type Description
RepeatedField<Attempt>

CreateTime

Output only. Timestamp of when this evaluation job was created.

Declaration
public Timestamp CreateTime { get; set; }
Property Value
Type Description
Timestamp

Description

Required. Description of the job. The description can be up to 25,000 characters long.

Declaration
public string Description { get; set; }
Property Value
Type Description
System.String

EvaluationJobConfig

Required. Configuration details for the evaluation job.

Declaration
public EvaluationJobConfig EvaluationJobConfig { get; set; }
Property Value
Type Description
EvaluationJobConfig

EvaluationJobName

EvaluationJobName-typed view over the Name resource name property.

Declaration
public EvaluationJobName EvaluationJobName { get; set; }
Property Value
Type Description
EvaluationJobName

LabelMissingGroundTruth

Required. Whether you want Data Labeling Service to provide ground truth labels for prediction input. If you want the service to assign human labelers to annotate your data, set this to true. If you want to provide your own ground truth labels in the evaluation job's BigQuery table, set this to false.

Declaration
public bool LabelMissingGroundTruth { get; set; }
Property Value
Type Description
System.Boolean

ModelVersion

Required. The AI Platform Prediction model version to be evaluated. Prediction input and output is sampled from this model version. When creating an evaluation job, specify the model version in the following format:

"projects/<var>{project_id}</var>/models/<var>{model_name}</var>/versions/<var>{version_name}</var>"

There can only be one evaluation job per model version.

Declaration
public string ModelVersion { get; set; }
Property Value
Type Description
System.String

Name

Output only. After you create a job, Data Labeling Service assigns a name to the job with the following format:

"projects/<var>{project_id}</var>/evaluationJobs/<var>{evaluation_job_id}</var>"

Declaration
public string Name { get; set; }
Property Value
Type Description
System.String

Schedule

Required. Describes the interval at which the job runs. This interval must be at least 1 day, and it is rounded to the nearest day. For example, if you specify a 50-hour interval, the job runs every 2 days.

You can provide the schedule in crontab format or in an English-like format.

Regardless of what you specify, the job will run at 10:00 AM UTC. Only the interval from this schedule is used, not the specific time of day.

Declaration
public string Schedule { get; set; }
Property Value
Type Description
System.String

State

Output only. Describes the current state of the job.

Declaration
public EvaluationJob.Types.State State { get; set; }
Property Value
Type Description
EvaluationJob.Types.State