Class SparkStatistics

Statistics for a BigSpark query. Populated as part of JobStatistics2

Inheritance
object
SparkStatistics
Implements
Inherited Members
Namespace: Google.Apis.Bigquery.v2.Data
Assembly: Google.Apis.Bigquery.v2.dll
Syntax
public class SparkStatistics : IDirectResponseSchema

Properties

ETag

The ETag of the item.

Declaration
public virtual string ETag { get; set; }
Property Value
Type Description
string

Endpoints

Output only. Endpoints returned from Dataproc. Key list: - history_server_endpoint: A link to Spark job UI.

Declaration
[JsonProperty("endpoints")]
public virtual IDictionary<string, string> Endpoints { get; set; }
Property Value
Type Description
IDictionary<string, string>

GcsStagingBucket

Output only. The Google Cloud Storage bucket that is used as the default filesystem by the Spark application. This fields is only filled when the Spark procedure uses the INVOKER security mode. It is inferred from the system variable @@spark_proc_properties.staging_bucket if it is provided. Otherwise, BigQuery creates a default staging bucket for the job and returns the bucket name in this field. Example: * gs://[bucket_name]

Declaration
[JsonProperty("gcsStagingBucket")]
public virtual string GcsStagingBucket { get; set; }
Property Value
Type Description
string

KmsKeyName

Output only. The Cloud KMS encryption key that is used to protect the resources created by the Spark job. If the Spark procedure uses DEFINER security mode, the Cloud KMS key is inferred from the Spark connection associated with the procedure if it is provided. Otherwise the key is inferred from the default key of the Spark connection's project if the CMEK organization policy is enforced. If the Spark procedure uses INVOKER security mode, the Cloud KMS encryption key is inferred from the system variable @@spark_proc_properties.kms_key_name if it is provided. Otherwise, the key is inferred fromt he default key of the BigQuery job's project if the CMEK organization policy is enforced. Example: * projects/[kms_project_id]/locations/[region]/keyRings/[key_region]/cryptoKeys/[key]

Declaration
[JsonProperty("kmsKeyName")]
public virtual string KmsKeyName { get; set; }
Property Value
Type Description
string

LoggingInfo

Output only. Logging info is used to generate a link to Cloud Logging.

Declaration
[JsonProperty("loggingInfo")]
public virtual SparkLoggingInfo LoggingInfo { get; set; }
Property Value
Type Description
SparkLoggingInfo

SparkJobId

Output only. Spark job ID if a Spark job is created successfully.

Declaration
[JsonProperty("sparkJobId")]
public virtual string SparkJobId { get; set; }
Property Value
Type Description
string

SparkJobLocation

Output only. Location where the Spark job is executed. A location is selected by BigQueury for jobs configured to run in a multi-region.

Declaration
[JsonProperty("sparkJobLocation")]
public virtual string SparkJobLocation { get; set; }
Property Value
Type Description
string

Implements