Class: Google::Apis::DialogflowV2::GoogleCloudDialogflowV2ConversationModelEvaluation

Inherits:
Object
  • Object
show all
Includes:
Core::Hashable, Core::JsonObjectSupport
Defined in:
lib/google/apis/dialogflow_v2/classes.rb,
lib/google/apis/dialogflow_v2/representations.rb,
lib/google/apis/dialogflow_v2/representations.rb

Overview

Represents evaluation result of a conversation model.

Instance Attribute Summary collapse

Instance Method Summary collapse

Constructor Details

#initialize(**args) ⇒ GoogleCloudDialogflowV2ConversationModelEvaluation

Returns a new instance of GoogleCloudDialogflowV2ConversationModelEvaluation.



8597
8598
8599
 
# File 'lib/google/apis/dialogflow_v2/classes.rb', line 8597

def initialize(**args)
   update!(**args)
end

Instance Attribute Details

#create_time ⇒ String

Output only. Creation time of this model. Corresponds to the JSON property createTime

Returns:

  • (String) 


8558
8559
8560
 
# File 'lib/google/apis/dialogflow_v2/classes.rb', line 8558

def create_time
  @create_time
end

#display_name ⇒ String

Optional. The display name of the model evaluation. At most 64 bytes long. Corresponds to the JSON property displayName

Returns:

  • (String) 


8563
8564
8565
 
# File 'lib/google/apis/dialogflow_v2/classes.rb', line 8563

def display_name
  @display_name
end

#evaluation_config ⇒ Google::Apis::DialogflowV2::GoogleCloudDialogflowV2EvaluationConfig

The configuration for model evaluation. Corresponds to the JSON property evaluationConfig

Returns:



8568
8569
8570
 
# File 'lib/google/apis/dialogflow_v2/classes.rb', line 8568

def evaluation_config
  @evaluation_config
end

#name ⇒ String

The resource name of the evaluation. Format: projects//conversationModels// evaluations/ Corresponds to the JSON property name

Returns:

  • (String) 


8574
8575
8576
 
# File 'lib/google/apis/dialogflow_v2/classes.rb', line 8574

def name
  @name
end

#raw_human_eval_template_csv ⇒ String

Output only. Human eval template in csv format. It tooks real-world conversations provided through input dataset, generates example suggestions for customer to verify quality of the model. For Smart Reply, the generated csv file contains columns of Context, (Suggestions,Q1,Q2)*3, Actual reply. Context contains at most 10 latest messages in the conversation prior to the current suggestion. Q1: "Would you send it as the next message of agent?" Evaluated based on whether the suggest is appropriate to be sent by agent in current context. Q2: "Does the suggestion move the conversation closer to resolution?" Evaluated based on whether the suggestion provide solutions, or answers customer's question or collect information from customer to resolve the customer's issue. Actual reply column contains the actual agent reply sent in the context. Corresponds to the JSON property rawHumanEvalTemplateCsv

Returns:

  • (String) 


8590
8591
8592
 
# File 'lib/google/apis/dialogflow_v2/classes.rb', line 8590

def raw_human_eval_template_csv
  @raw_human_eval_template_csv
end

#smart_reply_metrics ⇒ Google::Apis::DialogflowV2::GoogleCloudDialogflowV2SmartReplyMetrics

The evaluation metrics for smart reply model. Corresponds to the JSON property smartReplyMetrics

Returns:



8595
8596
8597
 
# File 'lib/google/apis/dialogflow_v2/classes.rb', line 8595

def smart_reply_metrics
  @smart_reply_metrics
end

Instance Method Details

#update!(**args) ⇒ Object

Update properties of this object



8602
8603
8604
8605
8606
8607
8608
8609
 
# File 'lib/google/apis/dialogflow_v2/classes.rb', line 8602

def update!(**args)
  @create_time = args[:create_time] if args.key?(:create_time)
  @display_name = args[:display_name] if args.key?(:display_name)
  @evaluation_config = args[:evaluation_config] if args.key?(:evaluation_config)
  @name = args[:name] if args.key?(:name)
  @raw_human_eval_template_csv = args[:raw_human_eval_template_csv] if args.key?(:raw_human_eval_template_csv)
  @smart_reply_metrics = args[:smart_reply_metrics] if args.key?(:smart_reply_metrics)
end