Class: Google::Apis::DialogflowV2::GoogleCloudDialogflowV2ConversationModelEvaluation

Inherits:
Object
  • Object
show all
Includes:
Core::Hashable, Core::JsonObjectSupport
Defined in:
lib/google/apis/dialogflow_v2/classes.rb,
lib/google/apis/dialogflow_v2/representations.rb,
lib/google/apis/dialogflow_v2/representations.rb

Overview

Represents evaluation result of a conversation model.

Instance Attribute Summary collapse

Instance Method Summary collapse

Constructor Details

#initialize(**args) ⇒ GoogleCloudDialogflowV2ConversationModelEvaluation

Returns a new instance of GoogleCloudDialogflowV2ConversationModelEvaluation.



9114
9115
9116
 
# File 'lib/google/apis/dialogflow_v2/classes.rb', line 9114

def initialize(**args)
   update!(**args)
end

Instance Attribute Details

#create_time ⇒ String

Output only. Creation time of this model. Corresponds to the JSON property createTime

Returns:

  • (String) 


9075
9076
9077
 
# File 'lib/google/apis/dialogflow_v2/classes.rb', line 9075

def create_time
  @create_time
end

#display_name ⇒ String

Optional. The display name of the model evaluation. At most 64 bytes long. Corresponds to the JSON property displayName

Returns:

  • (String) 


9080
9081
9082
 
# File 'lib/google/apis/dialogflow_v2/classes.rb', line 9080

def display_name
  @display_name
end

#evaluation_config ⇒ Google::Apis::DialogflowV2::GoogleCloudDialogflowV2EvaluationConfig

The configuration for model evaluation. Corresponds to the JSON property evaluationConfig

Returns:



9085
9086
9087
 
# File 'lib/google/apis/dialogflow_v2/classes.rb', line 9085

def evaluation_config
  @evaluation_config
end

#name ⇒ String

The resource name of the evaluation. Format: projects//conversationModels// evaluations/ Corresponds to the JSON property name

Returns:

  • (String) 


9091
9092
9093
 
# File 'lib/google/apis/dialogflow_v2/classes.rb', line 9091

def name
  @name
end

#raw_human_eval_template_csv ⇒ String

Output only. Human eval template in csv format. It tooks real-world conversations provided through input dataset, generates example suggestions for customer to verify quality of the model. For Smart Reply, the generated csv file contains columns of Context, (Suggestions,Q1,Q2)*3, Actual reply. Context contains at most 10 latest messages in the conversation prior to the current suggestion. Q1: "Would you send it as the next message of agent?" Evaluated based on whether the suggest is appropriate to be sent by agent in current context. Q2: "Does the suggestion move the conversation closer to resolution?" Evaluated based on whether the suggestion provide solutions, or answers customer's question or collect information from customer to resolve the customer's issue. Actual reply column contains the actual agent reply sent in the context. Corresponds to the JSON property rawHumanEvalTemplateCsv

Returns:

  • (String) 


9107
9108
9109
 
# File 'lib/google/apis/dialogflow_v2/classes.rb', line 9107

def raw_human_eval_template_csv
  @raw_human_eval_template_csv
end

#smart_reply_metrics ⇒ Google::Apis::DialogflowV2::GoogleCloudDialogflowV2SmartReplyMetrics

The evaluation metrics for smart reply model. Corresponds to the JSON property smartReplyMetrics

Returns:



9112
9113
9114
 
# File 'lib/google/apis/dialogflow_v2/classes.rb', line 9112

def smart_reply_metrics
  @smart_reply_metrics
end

Instance Method Details

#update!(**args) ⇒ Object

Update properties of this object



9119
9120
9121
9122
9123
9124
9125
9126
 
# File 'lib/google/apis/dialogflow_v2/classes.rb', line 9119

def update!(**args)
  @create_time = args[:create_time] if args.key?(:create_time)
  @display_name = args[:display_name] if args.key?(:display_name)
  @evaluation_config = args[:evaluation_config] if args.key?(:evaluation_config)
  @name = args[:name] if args.key?(:name)
  @raw_human_eval_template_csv = args[:raw_human_eval_template_csv] if args.key?(:raw_human_eval_template_csv)
  @smart_reply_metrics = args[:smart_reply_metrics] if args.key?(:smart_reply_metrics)
end