Class: Google::Apis::DialogflowV2::GoogleCloudDialogflowV2ConversationModelEvaluation

Inherits:
Object
  • Object
show all
Includes:
Core::Hashable, Core::JsonObjectSupport
Defined in:
lib/google/apis/dialogflow_v2/classes.rb,
lib/google/apis/dialogflow_v2/representations.rb,
lib/google/apis/dialogflow_v2/representations.rb

Overview

Represents evaluation result of a conversation model.

Instance Attribute Summary collapse

Instance Method Summary collapse

Constructor Details

#initialize(**args) ⇒ GoogleCloudDialogflowV2ConversationModelEvaluation

Returns a new instance of GoogleCloudDialogflowV2ConversationModelEvaluation.



9142
9143
9144
 
# File 'lib/google/apis/dialogflow_v2/classes.rb', line 9142

def initialize(**args)
   update!(**args)
end

Instance Attribute Details

#create_time ⇒ String

Output only. Creation time of this model. Corresponds to the JSON property createTime

Returns:

  • (String) 


9103
9104
9105
 
# File 'lib/google/apis/dialogflow_v2/classes.rb', line 9103

def create_time
  @create_time
end

#display_name ⇒ String

Optional. The display name of the model evaluation. At most 64 bytes long. Corresponds to the JSON property displayName

Returns:

  • (String) 


9108
9109
9110
 
# File 'lib/google/apis/dialogflow_v2/classes.rb', line 9108

def display_name
  @display_name
end

#evaluation_config ⇒ Google::Apis::DialogflowV2::GoogleCloudDialogflowV2EvaluationConfig

The configuration for model evaluation. Corresponds to the JSON property evaluationConfig

Returns:



9113
9114
9115
 
# File 'lib/google/apis/dialogflow_v2/classes.rb', line 9113

def evaluation_config
  @evaluation_config
end

#name ⇒ String

The resource name of the evaluation. Format: projects//conversationModels// evaluations/ Corresponds to the JSON property name

Returns:

  • (String) 


9119
9120
9121
 
# File 'lib/google/apis/dialogflow_v2/classes.rb', line 9119

def name
  @name
end

#raw_human_eval_template_csv ⇒ String

Output only. Human eval template in csv format. It tooks real-world conversations provided through input dataset, generates example suggestions for customer to verify quality of the model. For Smart Reply, the generated csv file contains columns of Context, (Suggestions,Q1,Q2)*3, Actual reply. Context contains at most 10 latest messages in the conversation prior to the current suggestion. Q1: "Would you send it as the next message of agent?" Evaluated based on whether the suggest is appropriate to be sent by agent in current context. Q2: "Does the suggestion move the conversation closer to resolution?" Evaluated based on whether the suggestion provide solutions, or answers customer's question or collect information from customer to resolve the customer's issue. Actual reply column contains the actual agent reply sent in the context. Corresponds to the JSON property rawHumanEvalTemplateCsv

Returns:

  • (String) 


9135
9136
9137
 
# File 'lib/google/apis/dialogflow_v2/classes.rb', line 9135

def raw_human_eval_template_csv
  @raw_human_eval_template_csv
end

#smart_reply_metrics ⇒ Google::Apis::DialogflowV2::GoogleCloudDialogflowV2SmartReplyMetrics

The evaluation metrics for smart reply model. Corresponds to the JSON property smartReplyMetrics

Returns:



9140
9141
9142
 
# File 'lib/google/apis/dialogflow_v2/classes.rb', line 9140

def smart_reply_metrics
  @smart_reply_metrics
end

Instance Method Details

#update!(**args) ⇒ Object

Update properties of this object



9147
9148
9149
9150
9151
9152
9153
9154
 
# File 'lib/google/apis/dialogflow_v2/classes.rb', line 9147

def update!(**args)
  @create_time = args[:create_time] if args.key?(:create_time)
  @display_name = args[:display_name] if args.key?(:display_name)
  @evaluation_config = args[:evaluation_config] if args.key?(:evaluation_config)
  @name = args[:name] if args.key?(:name)
  @raw_human_eval_template_csv = args[:raw_human_eval_template_csv] if args.key?(:raw_human_eval_template_csv)
  @smart_reply_metrics = args[:smart_reply_metrics] if args.key?(:smart_reply_metrics)
end