Class: Google::Apis::DocumentaiV1beta3::GoogleCloudDocumentaiV1beta3EvaluationMultiConfidenceMetrics

Inherits:
Object
  • Object
show all
Includes:
Core::Hashable, Core::JsonObjectSupport
Defined in:
lib/google/apis/documentai_v1beta3/classes.rb,
lib/google/apis/documentai_v1beta3/representations.rb,
lib/google/apis/documentai_v1beta3/representations.rb

Overview

Metrics across multiple confidence levels.

Instance Attribute Summary collapse

Instance Method Summary collapse

Constructor Details

#initialize(**args) ⇒ GoogleCloudDocumentaiV1beta3EvaluationMultiConfidenceMetrics

Returns a new instance of GoogleCloudDocumentaiV1beta3EvaluationMultiConfidenceMetrics.



9576
9577
9578
 
# File 'lib/google/apis/documentai_v1beta3/classes.rb', line 9576

def initialize(**args)
   update!(**args)
end

Instance Attribute Details

#auprc ⇒ Float

The calculated area under the precision recall curve (AUPRC), computed by integrating over all confidence thresholds. Corresponds to the JSON property auprc

Returns:

  • (Float) 


9542
9543
9544
 
# File 'lib/google/apis/documentai_v1beta3/classes.rb', line 9542

def auprc
  @auprc
end

#auprc_exact ⇒ Float

The AUPRC for metrics with fuzzy matching disabled, i.e., exact matching only. Corresponds to the JSON property auprcExact

Returns:

  • (Float) 


9547
9548
9549
 
# File 'lib/google/apis/documentai_v1beta3/classes.rb', line 9547

def auprc_exact
  @auprc_exact
end

#confidence_level_metrics ⇒ Array<Google::Apis::DocumentaiV1beta3::GoogleCloudDocumentaiV1beta3EvaluationConfidenceLevelMetrics>

Metrics across confidence levels with fuzzy matching enabled. Corresponds to the JSON property confidenceLevelMetrics

Returns:



9552
9553
9554
 
# File 'lib/google/apis/documentai_v1beta3/classes.rb', line 9552

def confidence_level_metrics
  @confidence_level_metrics
end

#confidence_level_metrics_exact ⇒ Array<Google::Apis::DocumentaiV1beta3::GoogleCloudDocumentaiV1beta3EvaluationConfidenceLevelMetrics>

Metrics across confidence levels with only exact matching. Corresponds to the JSON property confidenceLevelMetricsExact

Returns:



9557
9558
9559
 
# File 'lib/google/apis/documentai_v1beta3/classes.rb', line 9557

def confidence_level_metrics_exact
  @confidence_level_metrics_exact
end

#estimated_calibration_error ⇒ Float

The Estimated Calibration Error (ECE) of the confidence of the predicted entities. Corresponds to the JSON property estimatedCalibrationError

Returns:

  • (Float) 


9563
9564
9565
 
# File 'lib/google/apis/documentai_v1beta3/classes.rb', line 9563

def estimated_calibration_error
  @estimated_calibration_error
end

#estimated_calibration_error_exact ⇒ Float

The ECE for the predicted entities with fuzzy matching disabled, i.e., exact matching only. Corresponds to the JSON property estimatedCalibrationErrorExact

Returns:

  • (Float) 


9569
9570
9571
 
# File 'lib/google/apis/documentai_v1beta3/classes.rb', line 9569

def estimated_calibration_error_exact
  @estimated_calibration_error_exact
end

#metrics_type ⇒ String

The metrics type for the label. Corresponds to the JSON property metricsType

Returns:

  • (String) 


9574
9575
9576
 
# File 'lib/google/apis/documentai_v1beta3/classes.rb', line 9574

def metrics_type
  @metrics_type
end

Instance Method Details

#update!(**args) ⇒ Object

Update properties of this object



9581
9582
9583
9584
9585
9586
9587
9588
9589
 
# File 'lib/google/apis/documentai_v1beta3/classes.rb', line 9581

def update!(**args)
  @auprc = args[:auprc] if args.key?(:auprc)
  @auprc_exact = args[:auprc_exact] if args.key?(:auprc_exact)
  @confidence_level_metrics = args[:confidence_level_metrics] if args.key?(:confidence_level_metrics)
  @confidence_level_metrics_exact = args[:confidence_level_metrics_exact] if args.key?(:confidence_level_metrics_exact)
  @estimated_calibration_error = args[:estimated_calibration_error] if args.key?(:estimated_calibration_error)
  @estimated_calibration_error_exact = args[:estimated_calibration_error_exact] if args.key?(:estimated_calibration_error_exact)
  @metrics_type = args[:metrics_type] if args.key?(:metrics_type)
end