Class: Google::Apis::DialogflowV2::GoogleCloudDialogflowV2ConversationModelEvaluation

Inherits:
Object
  • Object
show all
Includes:
Core::Hashable, Core::JsonObjectSupport
Defined in:
lib/google/apis/dialogflow_v2/classes.rb,
lib/google/apis/dialogflow_v2/representations.rb,
lib/google/apis/dialogflow_v2/representations.rb

Overview

Represents evaluation result of a conversation model.

Instance Attribute Summary collapse

Instance Method Summary collapse

Constructor Details

#initialize(**args) ⇒ GoogleCloudDialogflowV2ConversationModelEvaluation

Returns a new instance of GoogleCloudDialogflowV2ConversationModelEvaluation.



9278
9279
9280
 
# File 'lib/google/apis/dialogflow_v2/classes.rb', line 9278

def initialize(**args)
   update!(**args)
end

Instance Attribute Details

#create_time ⇒ String

Output only. Creation time of this model. Corresponds to the JSON property createTime

Returns:

  • (String) 


9239
9240
9241
 
# File 'lib/google/apis/dialogflow_v2/classes.rb', line 9239

def create_time
  @create_time
end

#display_name ⇒ String

Optional. The display name of the model evaluation. At most 64 bytes long. Corresponds to the JSON property displayName

Returns:

  • (String) 


9244
9245
9246
 
# File 'lib/google/apis/dialogflow_v2/classes.rb', line 9244

def display_name
  @display_name
end

#evaluation_config ⇒ Google::Apis::DialogflowV2::GoogleCloudDialogflowV2EvaluationConfig

The configuration for model evaluation. Corresponds to the JSON property evaluationConfig

Returns:



9249
9250
9251
 
# File 'lib/google/apis/dialogflow_v2/classes.rb', line 9249

def evaluation_config
  @evaluation_config
end

#name ⇒ String

The resource name of the evaluation. Format: projects//conversationModels// evaluations/ Corresponds to the JSON property name

Returns:

  • (String) 


9255
9256
9257
 
# File 'lib/google/apis/dialogflow_v2/classes.rb', line 9255

def name
  @name
end

#raw_human_eval_template_csv ⇒ String

Output only. Human eval template in csv format. It tooks real-world conversations provided through input dataset, generates example suggestions for customer to verify quality of the model. For Smart Reply, the generated csv file contains columns of Context, (Suggestions,Q1,Q2)*3, Actual reply. Context contains at most 10 latest messages in the conversation prior to the current suggestion. Q1: "Would you send it as the next message of agent?" Evaluated based on whether the suggest is appropriate to be sent by agent in current context. Q2: "Does the suggestion move the conversation closer to resolution?" Evaluated based on whether the suggestion provide solutions, or answers customer's question or collect information from customer to resolve the customer's issue. Actual reply column contains the actual agent reply sent in the context. Corresponds to the JSON property rawHumanEvalTemplateCsv

Returns:

  • (String) 


9271
9272
9273
 
# File 'lib/google/apis/dialogflow_v2/classes.rb', line 9271

def raw_human_eval_template_csv
  @raw_human_eval_template_csv
end

#smart_reply_metrics ⇒ Google::Apis::DialogflowV2::GoogleCloudDialogflowV2SmartReplyMetrics

The evaluation metrics for smart reply model. Corresponds to the JSON property smartReplyMetrics

Returns:



9276
9277
9278
 
# File 'lib/google/apis/dialogflow_v2/classes.rb', line 9276

def smart_reply_metrics
  @smart_reply_metrics
end

Instance Method Details

#update!(**args) ⇒ Object

Update properties of this object



9283
9284
9285
9286
9287
9288
9289
9290
 
# File 'lib/google/apis/dialogflow_v2/classes.rb', line 9283

def update!(**args)
  @create_time = args[:create_time] if args.key?(:create_time)
  @display_name = args[:display_name] if args.key?(:display_name)
  @evaluation_config = args[:evaluation_config] if args.key?(:evaluation_config)
  @name = args[:name] if args.key?(:name)
  @raw_human_eval_template_csv = args[:raw_human_eval_template_csv] if args.key?(:raw_human_eval_template_csv)
  @smart_reply_metrics = args[:smart_reply_metrics] if args.key?(:smart_reply_metrics)
end