Class: Google::Apis::AiplatformV1::GoogleCloudAiplatformV1EvaluateInstancesRequest
- Inherits:
-
Object
- Object
- Google::Apis::AiplatformV1::GoogleCloudAiplatformV1EvaluateInstancesRequest
- Includes:
- Core::Hashable, Core::JsonObjectSupport
- Defined in:
- lib/google/apis/aiplatform_v1/classes.rb,
lib/google/apis/aiplatform_v1/representations.rb,
lib/google/apis/aiplatform_v1/representations.rb
Overview
Request message for EvaluationService.EvaluateInstances.
Instance Attribute Summary collapse
-
#bleu_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1BleuInput
Input for bleu metric.
-
#coherence_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1CoherenceInput
Input for coherence metric.
-
#comet_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1CometInput
Input for Comet metric.
-
#exact_match_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1ExactMatchInput
Input for exact match metric.
-
#fluency_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1FluencyInput
Input for fluency metric.
-
#fulfillment_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1FulfillmentInput
Input for fulfillment metric.
-
#groundedness_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1GroundednessInput
Input for groundedness metric.
-
#metricx_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1MetricxInput
Input for MetricX metric.
-
#pairwise_metric_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1PairwiseMetricInput
Input for pairwise metric.
-
#pairwise_question_answering_quality_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1PairwiseQuestionAnsweringQualityInput
Input for pairwise question answering quality metric.
-
#pairwise_summarization_quality_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1PairwiseSummarizationQualityInput
Input for pairwise summarization quality metric.
-
#pointwise_metric_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1PointwiseMetricInput
Input for pointwise metric.
-
#question_answering_correctness_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1QuestionAnsweringCorrectnessInput
Input for question answering correctness metric.
-
#question_answering_helpfulness_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1QuestionAnsweringHelpfulnessInput
Input for question answering helpfulness metric.
-
#question_answering_quality_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1QuestionAnsweringQualityInput
Input for question answering quality metric.
-
#question_answering_relevance_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1QuestionAnsweringRelevanceInput
Input for question answering relevance metric.
-
#rouge_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1RougeInput
Input for rouge metric.
-
#safety_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1SafetyInput
Input for safety metric.
-
#summarization_helpfulness_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1SummarizationHelpfulnessInput
Input for summarization helpfulness metric.
-
#summarization_quality_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1SummarizationQualityInput
Input for summarization quality metric.
-
#summarization_verbosity_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1SummarizationVerbosityInput
Input for summarization verbosity metric.
-
#tool_call_valid_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1ToolCallValidInput
Input for tool call valid metric.
-
#tool_name_match_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1ToolNameMatchInput
Input for tool name match metric.
-
#tool_parameter_key_match_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1ToolParameterKeyMatchInput
Input for tool parameter key match metric.
-
#tool_parameter_kv_match_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1ToolParameterKvMatchInput
Input for tool parameter key value match metric.
-
#trajectory_any_order_match_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1TrajectoryAnyOrderMatchInput
Instances and metric spec for TrajectoryAnyOrderMatch metric.
-
#trajectory_exact_match_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1TrajectoryExactMatchInput
Instances and metric spec for TrajectoryExactMatch metric.
-
#trajectory_in_order_match_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1TrajectoryInOrderMatchInput
Instances and metric spec for TrajectoryInOrderMatch metric.
-
#trajectory_precision_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1TrajectoryPrecisionInput
Instances and metric spec for TrajectoryPrecision metric.
-
#trajectory_recall_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1TrajectoryRecallInput
Instances and metric spec for TrajectoryRecall metric.
-
#trajectory_single_tool_use_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1TrajectorySingleToolUseInput
Instances and metric spec for TrajectorySingleToolUse metric.
Instance Method Summary collapse
-
#initialize(**args) ⇒ GoogleCloudAiplatformV1EvaluateInstancesRequest
constructor
A new instance of GoogleCloudAiplatformV1EvaluateInstancesRequest.
-
#update!(**args) ⇒ Object
Update properties of this object.
Constructor Details
#initialize(**args) ⇒ GoogleCloudAiplatformV1EvaluateInstancesRequest
Returns a new instance of GoogleCloudAiplatformV1EvaluateInstancesRequest.
6941 6942 6943 |
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6941 def initialize(**args) update!(**args) end |
Instance Attribute Details
#bleu_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1BleuInput
Input for bleu metric.
Corresponds to the JSON property bleuInput
6789 6790 6791 |
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6789 def bleu_input @bleu_input end |
#coherence_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1CoherenceInput
Input for coherence metric.
Corresponds to the JSON property coherenceInput
6794 6795 6796 |
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6794 def coherence_input @coherence_input end |
#comet_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1CometInput
Input for Comet metric.
Corresponds to the JSON property cometInput
6799 6800 6801 |
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6799 def comet_input @comet_input end |
#exact_match_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1ExactMatchInput
Input for exact match metric.
Corresponds to the JSON property exactMatchInput
6804 6805 6806 |
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6804 def exact_match_input @exact_match_input end |
#fluency_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1FluencyInput
Input for fluency metric.
Corresponds to the JSON property fluencyInput
6809 6810 6811 |
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6809 def fluency_input @fluency_input end |
#fulfillment_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1FulfillmentInput
Input for fulfillment metric.
Corresponds to the JSON property fulfillmentInput
6814 6815 6816 |
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6814 def fulfillment_input @fulfillment_input end |
#groundedness_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1GroundednessInput
Input for groundedness metric.
Corresponds to the JSON property groundednessInput
6819 6820 6821 |
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6819 def groundedness_input @groundedness_input end |
#metricx_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1MetricxInput
Input for MetricX metric.
Corresponds to the JSON property metricxInput
6824 6825 6826 |
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6824 def metricx_input @metricx_input end |
#pairwise_metric_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1PairwiseMetricInput
Input for pairwise metric.
Corresponds to the JSON property pairwiseMetricInput
6829 6830 6831 |
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6829 def pairwise_metric_input @pairwise_metric_input end |
#pairwise_question_answering_quality_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1PairwiseQuestionAnsweringQualityInput
Input for pairwise question answering quality metric.
Corresponds to the JSON property pairwiseQuestionAnsweringQualityInput
6834 6835 6836 |
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6834 def pairwise_question_answering_quality_input @pairwise_question_answering_quality_input end |
#pairwise_summarization_quality_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1PairwiseSummarizationQualityInput
Input for pairwise summarization quality metric.
Corresponds to the JSON property pairwiseSummarizationQualityInput
6839 6840 6841 |
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6839 def pairwise_summarization_quality_input @pairwise_summarization_quality_input end |
#pointwise_metric_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1PointwiseMetricInput
Input for pointwise metric.
Corresponds to the JSON property pointwiseMetricInput
6844 6845 6846 |
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6844 def pointwise_metric_input @pointwise_metric_input end |
#question_answering_correctness_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1QuestionAnsweringCorrectnessInput
Input for question answering correctness metric.
Corresponds to the JSON property questionAnsweringCorrectnessInput
6849 6850 6851 |
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6849 def question_answering_correctness_input @question_answering_correctness_input end |
#question_answering_helpfulness_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1QuestionAnsweringHelpfulnessInput
Input for question answering helpfulness metric.
Corresponds to the JSON property questionAnsweringHelpfulnessInput
6854 6855 6856 |
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6854 def question_answering_helpfulness_input @question_answering_helpfulness_input end |
#question_answering_quality_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1QuestionAnsweringQualityInput
Input for question answering quality metric.
Corresponds to the JSON property questionAnsweringQualityInput
6859 6860 6861 |
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6859 def question_answering_quality_input @question_answering_quality_input end |
#question_answering_relevance_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1QuestionAnsweringRelevanceInput
Input for question answering relevance metric.
Corresponds to the JSON property questionAnsweringRelevanceInput
6864 6865 6866 |
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6864 def question_answering_relevance_input @question_answering_relevance_input end |
#rouge_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1RougeInput
Input for rouge metric.
Corresponds to the JSON property rougeInput
6869 6870 6871 |
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6869 def rouge_input @rouge_input end |
#safety_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1SafetyInput
Input for safety metric.
Corresponds to the JSON property safetyInput
6874 6875 6876 |
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6874 def safety_input @safety_input end |
#summarization_helpfulness_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1SummarizationHelpfulnessInput
Input for summarization helpfulness metric.
Corresponds to the JSON property summarizationHelpfulnessInput
6879 6880 6881 |
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6879 def summarization_helpfulness_input @summarization_helpfulness_input end |
#summarization_quality_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1SummarizationQualityInput
Input for summarization quality metric.
Corresponds to the JSON property summarizationQualityInput
6884 6885 6886 |
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6884 def summarization_quality_input @summarization_quality_input end |
#summarization_verbosity_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1SummarizationVerbosityInput
Input for summarization verbosity metric.
Corresponds to the JSON property summarizationVerbosityInput
6889 6890 6891 |
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6889 def summarization_verbosity_input @summarization_verbosity_input end |
#tool_call_valid_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1ToolCallValidInput
Input for tool call valid metric.
Corresponds to the JSON property toolCallValidInput
6894 6895 6896 |
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6894 def tool_call_valid_input @tool_call_valid_input end |
#tool_name_match_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1ToolNameMatchInput
Input for tool name match metric.
Corresponds to the JSON property toolNameMatchInput
6899 6900 6901 |
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6899 def tool_name_match_input @tool_name_match_input end |
#tool_parameter_key_match_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1ToolParameterKeyMatchInput
Input for tool parameter key match metric.
Corresponds to the JSON property toolParameterKeyMatchInput
6904 6905 6906 |
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6904 def tool_parameter_key_match_input @tool_parameter_key_match_input end |
#tool_parameter_kv_match_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1ToolParameterKvMatchInput
Input for tool parameter key value match metric.
Corresponds to the JSON property toolParameterKvMatchInput
6909 6910 6911 |
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6909 def tool_parameter_kv_match_input @tool_parameter_kv_match_input end |
#trajectory_any_order_match_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1TrajectoryAnyOrderMatchInput
Instances and metric spec for TrajectoryAnyOrderMatch metric.
Corresponds to the JSON property trajectoryAnyOrderMatchInput
6914 6915 6916 |
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6914 def trajectory_any_order_match_input @trajectory_any_order_match_input end |
#trajectory_exact_match_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1TrajectoryExactMatchInput
Instances and metric spec for TrajectoryExactMatch metric.
Corresponds to the JSON property trajectoryExactMatchInput
6919 6920 6921 |
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6919 def trajectory_exact_match_input @trajectory_exact_match_input end |
#trajectory_in_order_match_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1TrajectoryInOrderMatchInput
Instances and metric spec for TrajectoryInOrderMatch metric.
Corresponds to the JSON property trajectoryInOrderMatchInput
6924 6925 6926 |
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6924 def trajectory_in_order_match_input @trajectory_in_order_match_input end |
#trajectory_precision_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1TrajectoryPrecisionInput
Instances and metric spec for TrajectoryPrecision metric.
Corresponds to the JSON property trajectoryPrecisionInput
6929 6930 6931 |
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6929 def trajectory_precision_input @trajectory_precision_input end |
#trajectory_recall_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1TrajectoryRecallInput
Instances and metric spec for TrajectoryRecall metric.
Corresponds to the JSON property trajectoryRecallInput
6934 6935 6936 |
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6934 def trajectory_recall_input @trajectory_recall_input end |
#trajectory_single_tool_use_input ⇒ Google::Apis::AiplatformV1::GoogleCloudAiplatformV1TrajectorySingleToolUseInput
Instances and metric spec for TrajectorySingleToolUse metric.
Corresponds to the JSON property trajectorySingleToolUseInput
6939 6940 6941 |
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6939 def trajectory_single_tool_use_input @trajectory_single_tool_use_input end |
Instance Method Details
#update!(**args) ⇒ Object
Update properties of this object
6946 6947 6948 6949 6950 6951 6952 6953 6954 6955 6956 6957 6958 6959 6960 6961 6962 6963 6964 6965 6966 6967 6968 6969 6970 6971 6972 6973 6974 6975 6976 6977 6978 |
# File 'lib/google/apis/aiplatform_v1/classes.rb', line 6946 def update!(**args) @bleu_input = args[:bleu_input] if args.key?(:bleu_input) @coherence_input = args[:coherence_input] if args.key?(:coherence_input) @comet_input = args[:comet_input] if args.key?(:comet_input) @exact_match_input = args[:exact_match_input] if args.key?(:exact_match_input) @fluency_input = args[:fluency_input] if args.key?(:fluency_input) @fulfillment_input = args[:fulfillment_input] if args.key?(:fulfillment_input) @groundedness_input = args[:groundedness_input] if args.key?(:groundedness_input) @metricx_input = args[:metricx_input] if args.key?(:metricx_input) @pairwise_metric_input = args[:pairwise_metric_input] if args.key?(:pairwise_metric_input) @pairwise_question_answering_quality_input = args[:pairwise_question_answering_quality_input] if args.key?(:pairwise_question_answering_quality_input) @pairwise_summarization_quality_input = args[:pairwise_summarization_quality_input] if args.key?(:pairwise_summarization_quality_input) @pointwise_metric_input = args[:pointwise_metric_input] if args.key?(:pointwise_metric_input) @question_answering_correctness_input = args[:question_answering_correctness_input] if args.key?(:question_answering_correctness_input) @question_answering_helpfulness_input = args[:question_answering_helpfulness_input] if args.key?(:question_answering_helpfulness_input) @question_answering_quality_input = args[:question_answering_quality_input] if args.key?(:question_answering_quality_input) @question_answering_relevance_input = args[:question_answering_relevance_input] if args.key?(:question_answering_relevance_input) @rouge_input = args[:rouge_input] if args.key?(:rouge_input) @safety_input = args[:safety_input] if args.key?(:safety_input) @summarization_helpfulness_input = args[:summarization_helpfulness_input] if args.key?(:summarization_helpfulness_input) @summarization_quality_input = args[:summarization_quality_input] if args.key?(:summarization_quality_input) @summarization_verbosity_input = args[:summarization_verbosity_input] if args.key?(:summarization_verbosity_input) @tool_call_valid_input = args[:tool_call_valid_input] if args.key?(:tool_call_valid_input) @tool_name_match_input = args[:tool_name_match_input] if args.key?(:tool_name_match_input) @tool_parameter_key_match_input = args[:tool_parameter_key_match_input] if args.key?(:tool_parameter_key_match_input) @tool_parameter_kv_match_input = args[:tool_parameter_kv_match_input] if args.key?(:tool_parameter_kv_match_input) @trajectory_any_order_match_input = args[:trajectory_any_order_match_input] if args.key?(:trajectory_any_order_match_input) @trajectory_exact_match_input = args[:trajectory_exact_match_input] if args.key?(:trajectory_exact_match_input) @trajectory_in_order_match_input = args[:trajectory_in_order_match_input] if args.key?(:trajectory_in_order_match_input) @trajectory_precision_input = args[:trajectory_precision_input] if args.key?(:trajectory_precision_input) @trajectory_recall_input = args[:trajectory_recall_input] if args.key?(:trajectory_recall_input) @trajectory_single_tool_use_input = args[:trajectory_single_tool_use_input] if args.key?(:trajectory_single_tool_use_input) end |