Class SparkOptions

Options for a user-defined Spark routine.

Inheritance

object

SparkOptions

Implements

IDirectResponseSchema

Inherited Members

object.Equals(object)

object.Equals(object, object)

object.GetHashCode()

object.GetType()

object.MemberwiseClone()

object.ReferenceEquals(object, object)

object.ToString()

Namespace: Google.Apis.Bigquery.v2.Data

Assembly: Google.Apis.Bigquery.v2.dll

Syntax

public class SparkOptions : IDirectResponseSchema

Properties

ArchiveUris

Archive files to be extracted into the working directory of each executor. For more information about Apache Spark, see Apache Spark.

Declaration

[JsonProperty("archiveUris")]
public virtual IList<string> ArchiveUris { get; set; }

Property Value

Type	Description
System.Collections.Generic.IList<T><string>

Connection

Fully qualified name of the user-provided Spark connection object. Format: "projects/{project_id}/locations/{location_id}/connections/{connection_id}"

Declaration

[JsonProperty("connection")]
public virtual string Connection { get; set; }

Property Value

Type	Description
string

ContainerImage

Custom container image for the runtime environment.

Declaration

[JsonProperty("containerImage")]
public virtual string ContainerImage { get; set; }

Property Value

Type	Description
string

ETag

The ETag of the item.

Declaration

public virtual string ETag { get; set; }

Property Value

Type	Description
string

FileUris

Files to be placed in the working directory of each executor. For more information about Apache Spark, see Apache Spark.

Declaration

[JsonProperty("fileUris")]
public virtual IList<string> FileUris { get; set; }

Property Value

Type	Description
System.Collections.Generic.IList<T><string>

JarUris

JARs to include on the driver and executor CLASSPATH. For more information about Apache Spark, see Apache Spark.

Declaration

[JsonProperty("jarUris")]
public virtual IList<string> JarUris { get; set; }

Property Value

Type	Description
System.Collections.Generic.IList<T><string>

MainFileUri

The main file/jar URI of the Spark application. Exactly one of the definition_body field and the main_file_uri field must be set for Python. Exactly one of main_class and main_file_uri field should be set for Java/Scala language type.

Declaration

[JsonProperty("mainFileUri")]
public virtual string MainFileUri { get; set; }

Property Value

Type	Description
string

Properties

Configuration properties as a set of key/value pairs, which will be passed on to the Spark application. For more information, see Apache Spark.

Declaration

[JsonProperty("properties")]
public virtual IDictionary<string, string> Properties { get; set; }

Property Value

Type	Description
System.Collections.Generic.IDictionary<TKey, TValue><string, string>

PyFileUris

Python files to be placed on the PYTHONPATH for PySpark application. Supported file types: .py, .egg, and .zip. For more information about Apache Spark, see Apache Spark.

Declaration

[JsonProperty("pyFileUris")]
public virtual IList<string> PyFileUris { get; set; }

Property Value

Type	Description
System.Collections.Generic.IList<T><string>

RuntimeVersion

Runtime version. If not specified, the default runtime version is used.

Declaration

[JsonProperty("runtimeVersion")]
public virtual string RuntimeVersion { get; set; }

Property Value

Type	Description
string

Implements

IDirectResponseSchema