Class GoogleCloudDataplexV1TaskSparkTaskConfig

User-specified config for running a Spark task.

Inheritance

object

GoogleCloudDataplexV1TaskSparkTaskConfig

Implements

IDirectResponseSchema

Inherited Members

object.Equals(object)

object.Equals(object, object)

object.GetHashCode()

object.GetType()

object.MemberwiseClone()

object.ReferenceEquals(object, object)

object.ToString()

Namespace: Google.Apis.CloudDataplex.v1.Data

Assembly: Google.Apis.CloudDataplex.v1.dll

Syntax

public class GoogleCloudDataplexV1TaskSparkTaskConfig : IDirectResponseSchema

Properties

ArchiveUris

Optional. Cloud Storage URIs of archives to be extracted into the working directory of each executor. Supported file types: .jar, .tar, .tar.gz, .tgz, and .zip.

Declaration

[JsonProperty("archiveUris")]
public virtual IList<string> ArchiveUris { get; set; }

Property Value

Type	Description
IList<string>

ETag

The ETag of the item.

Declaration

public virtual string ETag { get; set; }

Property Value

Type	Description
string

FileUris

Optional. Cloud Storage URIs of files to be placed in the working directory of each executor.

Declaration

[JsonProperty("fileUris")]
public virtual IList<string> FileUris { get; set; }

Property Value

Type	Description
IList<string>

InfrastructureSpec

Optional. Infrastructure specification for the execution.

Declaration

[JsonProperty("infrastructureSpec")]
public virtual GoogleCloudDataplexV1TaskInfrastructureSpec InfrastructureSpec { get; set; }

Property Value

Type	Description
GoogleCloudDataplexV1TaskInfrastructureSpec

MainClass

The name of the driver's main class. The jar file that contains the class must be in the default CLASSPATH or specified in jar_file_uris. The execution args are passed in as a sequence of named process arguments (--key=value).

Declaration

[JsonProperty("mainClass")]
public virtual string MainClass { get; set; }

Property Value

Type	Description
string

MainJarFileUri

The Cloud Storage URI of the jar file that contains the main class. The execution args are passed in as a sequence of named process arguments (--key=value).

Declaration

[JsonProperty("mainJarFileUri")]
public virtual string MainJarFileUri { get; set; }

Property Value

Type	Description
string

PythonScriptFile

The Gcloud Storage URI of the main Python file to use as the driver. Must be a .py file. The execution args are passed in as a sequence of named process arguments (--key=value).

Declaration

[JsonProperty("pythonScriptFile")]
public virtual string PythonScriptFile { get; set; }

Property Value

Type	Description
string

SqlScript

The query text. The execution args are used to declare a set of script variables (set key="value";).

Declaration

[JsonProperty("sqlScript")]
public virtual string SqlScript { get; set; }

Property Value

Type	Description
string

SqlScriptFile

A reference to a query file. This should be the Cloud Storage URI of the query file. The execution args are used to declare a set of script variables (set key="value";).

Declaration

[JsonProperty("sqlScriptFile")]
public virtual string SqlScriptFile { get; set; }

Property Value

Type	Description
string

Implements

IDirectResponseSchema