com.google.api.services.dataproc.v1beta2.model

Class PigJob

java.lang.Object

java.util.AbstractMap<String,Object>

com.google.api.client.util.GenericData

com.google.api.client.json.GenericJson

com.google.api.services.dataproc.v1beta2.model.PigJob

All Implemented Interfaces:

Cloneable, Map<String,Object>

public final class PigJob
extends GenericJson

A Dataproc job for running Apache Pig (https://pig.apache.org/) queries on YARN.

This is the Java data model class that specifies how to parse/serialize into the JSON that is transmitted over HTTP when working with the Cloud Dataproc API. For a detailed explanation see: https://developers.google.com/api-client-library/java/google-http-java-client/json

Author:

Google, Inc.

Nested Class Summary

Nested classes/interfaces inherited from class com.google.api.client.util.GenericData

GenericData.Flags

Nested classes/interfaces inherited from class java.util.AbstractMap

AbstractMap.SimpleEntry<K,V>, AbstractMap.SimpleImmutableEntry<K,V>

Nested classes/interfaces inherited from interface java.util.Map

Map.Entry<K,V>

Constructor Summary

Constructors

Constructor and Description
PigJob()

Method Summary

Modifier and Type	Method and Description
PigJob	clone()
Boolean	getContinueOnFailure() Optional.
List<String>	getJarFileUris() Optional.
LoggingConfig	getLoggingConfig() Optional.
Map<String,String>	getProperties() Optional.
String	getQueryFileUri() The HCFS URI of the script that contains the Pig queries.
QueryList	getQueryList() A list of queries.
Map<String,String>	getScriptVariables() Optional.
PigJob	set(String fieldName, Object value)
PigJob	setContinueOnFailure(Boolean continueOnFailure) Optional.
PigJob	setJarFileUris(List<String> jarFileUris) Optional.
PigJob	setLoggingConfig(LoggingConfig loggingConfig) Optional.
PigJob	setProperties(Map<String,String> properties) Optional.
PigJob	setQueryFileUri(String queryFileUri) The HCFS URI of the script that contains the Pig queries.
PigJob	setQueryList(QueryList queryList) A list of queries.
PigJob	setScriptVariables(Map<String,String> scriptVariables) Optional.

Methods inherited from class com.google.api.client.json.GenericJson

getFactory, setFactory, toPrettyString, toString

Methods inherited from class com.google.api.client.util.GenericData

entrySet, equals, get, getClassInfo, getUnknownKeys, hashCode, put, putAll, remove, setUnknownKeys

Methods inherited from class java.util.AbstractMap

clear, containsKey, containsValue, isEmpty, keySet, size, values

Methods inherited from class java.lang.Object

finalize, getClass, notify, notifyAll, wait, wait, wait

Methods inherited from interface java.util.Map

compute, computeIfAbsent, computeIfPresent, forEach, getOrDefault, merge, putIfAbsent, remove, replace, replace, replaceAll

Constructor Detail

PigJob

public PigJob()

Method Detail

getContinueOnFailure

public Boolean getContinueOnFailure()

Optional. Whether to continue executing queries if a query fails. The default value is false. Setting to true can be useful when executing independent parallel queries.

Returns:

value or null for none

setContinueOnFailure

public PigJob setContinueOnFailure(Boolean continueOnFailure)

Optional. Whether to continue executing queries if a query fails. The default value is false. Setting to true can be useful when executing independent parallel queries.

Parameters:

continueOnFailure - continueOnFailure or null for none

getJarFileUris

public List<String> getJarFileUris()

Optional. HCFS URIs of jar files to add to the CLASSPATH of the Pig Client and Hadoop MapReduce (MR) tasks. Can contain Pig UDFs.

Returns:

value or null for none

setJarFileUris

public PigJob setJarFileUris(List<String> jarFileUris)

Optional. HCFS URIs of jar files to add to the CLASSPATH of the Pig Client and Hadoop MapReduce (MR) tasks. Can contain Pig UDFs.

Parameters:

jarFileUris - jarFileUris or null for none

getLoggingConfig

public LoggingConfig getLoggingConfig()

Optional. The runtime log config for job execution.

Returns:

value or null for none

setLoggingConfig

public PigJob setLoggingConfig(LoggingConfig loggingConfig)

Optional. The runtime log config for job execution.

Parameters:

loggingConfig - loggingConfig or null for none

getProperties

public Map<String,String> getProperties()

Optional. A mapping of property names to values, used to configure Pig. Properties that conflict with values set by the Dataproc API may be overwritten. Can include properties set in /etc/hadoop/conf-site.xml, /etc/pig/conf/pig.properties, and classes in user code.

Returns:

value or null for none

setProperties

public PigJob setProperties(Map<String,String> properties)

Optional. A mapping of property names to values, used to configure Pig. Properties that conflict with values set by the Dataproc API may be overwritten. Can include properties set in /etc/hadoop/conf-site.xml, /etc/pig/conf/pig.properties, and classes in user code.

Parameters:

properties - properties or null for none

getQueryFileUri

public String getQueryFileUri()

The HCFS URI of the script that contains the Pig queries.

Returns:

value or null for none

setQueryFileUri

public PigJob setQueryFileUri(String queryFileUri)

The HCFS URI of the script that contains the Pig queries.

Parameters:

queryFileUri - queryFileUri or null for none

getQueryList

public QueryList getQueryList()

A list of queries.

Returns:

value or null for none

setQueryList

public PigJob setQueryList(QueryList queryList)

A list of queries.

Parameters:

queryList - queryList or null for none

getScriptVariables

public Map<String,String> getScriptVariables()

Optional. Mapping of query variable names to values (equivalent to the Pig command: name=[value]).

Returns:

value or null for none

setScriptVariables

public PigJob setScriptVariables(Map<String,String> scriptVariables)

Optional. Mapping of query variable names to values (equivalent to the Pig command: name=[value]).

Parameters:

scriptVariables - scriptVariables or null for none

set

public PigJob set(String fieldName,
                  Object value)

Overrides:

set in class GenericJson

clone

public PigJob clone()

Overrides:

clone in class GenericJson