Class PigJob

A Dataproc job for running Apache Pig (https://pig.apache.org/) queries on YARN.

Inheritance

System.Object

PigJob

Implements

Google.Apis.Requests.IDirectResponseSchema

Inherited Members

System.Object.Equals(System.Object)

System.Object.Equals(System.Object, System.Object)

System.Object.GetHashCode()

System.Object.GetType()

System.Object.MemberwiseClone()

System.Object.ReferenceEquals(System.Object, System.Object)

System.Object.ToString()

Namespace: Google.Apis.Dataproc.v1beta2.Data

Assembly: Google.Apis.Dataproc.v1beta2.dll

Syntax

public class PigJob : IDirectResponseSchema

Properties

ContinueOnFailure

Optional. Whether to continue executing queries if a query fails. The default value is false. Setting to true can be useful when executing independent parallel queries.

Declaration

[JsonProperty("continueOnFailure")]
public virtual bool? ContinueOnFailure { get; set; }

Property Value

Type	Description
System.Nullable<System.Boolean>

ETag

The ETag of the item.

Declaration

public virtual string ETag { get; set; }

Property Value

Type	Description
System.String

JarFileUris

Optional. HCFS URIs of jar files to add to the CLASSPATH of the Pig Client and Hadoop MapReduce (MR) tasks. Can contain Pig UDFs.

Declaration

[JsonProperty("jarFileUris")]
public virtual IList<string> JarFileUris { get; set; }

Property Value

Type	Description
System.Collections.Generic.IList<System.String>

LoggingConfig

Optional. The runtime log config for job execution.

Declaration

[JsonProperty("loggingConfig")]
public virtual LoggingConfig LoggingConfig { get; set; }

Property Value

Type	Description
LoggingConfig

Properties

Optional. A mapping of property names to values, used to configure Pig. Properties that conflict with values set by the Dataproc API may be overwritten. Can include properties set in /etc/hadoop/conf/*-site.xml, /etc/pig/conf/pig.properties, and classes in user code.

Declaration

[JsonProperty("properties")]
public virtual IDictionary<string, string> Properties { get; set; }

Property Value

Type	Description
System.Collections.Generic.IDictionary<System.String, System.String>

QueryFileUri

The HCFS URI of the script that contains the Pig queries.

Declaration

[JsonProperty("queryFileUri")]
public virtual string QueryFileUri { get; set; }

Property Value

Type	Description
System.String

QueryList

A list of queries.

Declaration

[JsonProperty("queryList")]
public virtual QueryList QueryList { get; set; }

Property Value

Type	Description
QueryList

ScriptVariables

Optional. Mapping of query variable names to values (equivalent to the Pig command: name=[value]).

Declaration

[JsonProperty("scriptVariables")]
public virtual IDictionary<string, string> ScriptVariables { get; set; }

Property Value

Type	Description
System.Collections.Generic.IDictionary<System.String, System.String>

Implements

Google.Apis.Requests.IDirectResponseSchema