Class: Google::Apis::DialogflowV2::GoogleCloudDialogflowV2ConversationModelEvaluation

Inherits:
Object
  • Object
show all
Includes:
Core::Hashable, Core::JsonObjectSupport
Defined in:
lib/google/apis/dialogflow_v2/classes.rb,
lib/google/apis/dialogflow_v2/representations.rb,
lib/google/apis/dialogflow_v2/representations.rb

Overview

Represents evaluation result of a conversation model.

Instance Attribute Summary collapse

Instance Method Summary collapse

Constructor Details

#initialize(**args) ⇒ GoogleCloudDialogflowV2ConversationModelEvaluation

Returns a new instance of GoogleCloudDialogflowV2ConversationModelEvaluation.



8819
8820
8821
 
# File 'lib/google/apis/dialogflow_v2/classes.rb', line 8819

def initialize(**args)
   update!(**args)
end

Instance Attribute Details

#create_time ⇒ String

Output only. Creation time of this model. Corresponds to the JSON property createTime

Returns:

  • (String) 


8780
8781
8782
 
# File 'lib/google/apis/dialogflow_v2/classes.rb', line 8780

def create_time
  @create_time
end

#display_name ⇒ String

Optional. The display name of the model evaluation. At most 64 bytes long. Corresponds to the JSON property displayName

Returns:

  • (String) 


8785
8786
8787
 
# File 'lib/google/apis/dialogflow_v2/classes.rb', line 8785

def display_name
  @display_name
end

#evaluation_config ⇒ Google::Apis::DialogflowV2::GoogleCloudDialogflowV2EvaluationConfig

The configuration for model evaluation. Corresponds to the JSON property evaluationConfig

Returns:



8790
8791
8792
 
# File 'lib/google/apis/dialogflow_v2/classes.rb', line 8790

def evaluation_config
  @evaluation_config
end

#name ⇒ String

The resource name of the evaluation. Format: projects//conversationModels// evaluations/ Corresponds to the JSON property name

Returns:

  • (String) 


8796
8797
8798
 
# File 'lib/google/apis/dialogflow_v2/classes.rb', line 8796

def name
  @name
end

#raw_human_eval_template_csv ⇒ String

Output only. Human eval template in csv format. It tooks real-world conversations provided through input dataset, generates example suggestions for customer to verify quality of the model. For Smart Reply, the generated csv file contains columns of Context, (Suggestions,Q1,Q2)*3, Actual reply. Context contains at most 10 latest messages in the conversation prior to the current suggestion. Q1: "Would you send it as the next message of agent?" Evaluated based on whether the suggest is appropriate to be sent by agent in current context. Q2: "Does the suggestion move the conversation closer to resolution?" Evaluated based on whether the suggestion provide solutions, or answers customer's question or collect information from customer to resolve the customer's issue. Actual reply column contains the actual agent reply sent in the context. Corresponds to the JSON property rawHumanEvalTemplateCsv

Returns:

  • (String) 


8812
8813
8814
 
# File 'lib/google/apis/dialogflow_v2/classes.rb', line 8812

def raw_human_eval_template_csv
  @raw_human_eval_template_csv
end

#smart_reply_metrics ⇒ Google::Apis::DialogflowV2::GoogleCloudDialogflowV2SmartReplyMetrics

The evaluation metrics for smart reply model. Corresponds to the JSON property smartReplyMetrics

Returns:



8817
8818
8819
 
# File 'lib/google/apis/dialogflow_v2/classes.rb', line 8817

def smart_reply_metrics
  @smart_reply_metrics
end

Instance Method Details

#update!(**args) ⇒ Object

Update properties of this object



8824
8825
8826
8827
8828
8829
8830
8831
 
# File 'lib/google/apis/dialogflow_v2/classes.rb', line 8824

def update!(**args)
  @create_time = args[:create_time] if args.key?(:create_time)
  @display_name = args[:display_name] if args.key?(:display_name)
  @evaluation_config = args[:evaluation_config] if args.key?(:evaluation_config)
  @name = args[:name] if args.key?(:name)
  @raw_human_eval_template_csv = args[:raw_human_eval_template_csv] if args.key?(:raw_human_eval_template_csv)
  @smart_reply_metrics = args[:smart_reply_metrics] if args.key?(:smart_reply_metrics)
end