com.google.api.services.dataproc.model

Class SparkBatch

java.lang.Object

java.util.AbstractMap<String,Object>

com.google.api.client.util.GenericData

com.google.api.client.json.GenericJson

com.google.api.services.dataproc.model.SparkBatch

All Implemented Interfaces:

Cloneable, Map<String,Object>

public final class SparkBatch
extends com.google.api.client.json.GenericJson

A configuration for running an Apache Spark (https://spark.apache.org/) batch workload.

This is the Java data model class that specifies how to parse/serialize into the JSON that is transmitted over HTTP when working with the Cloud Dataproc API. For a detailed explanation see: https://developers.google.com/api-client-library/java/google-http-java-client/json

Author:

Google, Inc.

Nested Class Summary

Nested classes/interfaces inherited from class com.google.api.client.util.GenericData

com.google.api.client.util.GenericData.Flags

Nested classes/interfaces inherited from class java.util.AbstractMap

AbstractMap.SimpleEntry<K,V>, AbstractMap.SimpleImmutableEntry<K,V>

Nested classes/interfaces inherited from interface java.util.Map

Map.Entry<K,V>

Constructor Summary

Constructors

Constructor and Description
SparkBatch()

Method Summary

Modifier and Type	Method and Description
SparkBatch	clone()
List<String>	getArchiveUris() Optional.
List<String>	getArgs() Optional.
List<String>	getFileUris() Optional.
List<String>	getJarFileUris() Optional.
String	getMainClass() Optional.
String	getMainJarFileUri() Optional.
SparkBatch	set(String fieldName, Object value)
SparkBatch	setArchiveUris(List<String> archiveUris) Optional.
SparkBatch	setArgs(List<String> args) Optional.
SparkBatch	setFileUris(List<String> fileUris) Optional.
SparkBatch	setJarFileUris(List<String> jarFileUris) Optional.
SparkBatch	setMainClass(String mainClass) Optional.
SparkBatch	setMainJarFileUri(String mainJarFileUri) Optional.

Methods inherited from class com.google.api.client.json.GenericJson

getFactory, setFactory, toPrettyString, toString

Methods inherited from class com.google.api.client.util.GenericData

entrySet, equals, get, getClassInfo, getUnknownKeys, hashCode, put, putAll, remove, setUnknownKeys

Methods inherited from class java.util.AbstractMap

clear, containsKey, containsValue, isEmpty, keySet, size, values

Methods inherited from class java.lang.Object

finalize, getClass, notify, notifyAll, wait, wait, wait

Methods inherited from interface java.util.Map

compute, computeIfAbsent, computeIfPresent, forEach, getOrDefault, merge, putIfAbsent, remove, replace, replace, replaceAll

Constructor Detail

SparkBatch

public SparkBatch()

Method Detail

getArchiveUris

public List<String> getArchiveUris()

Optional. HCFS URIs of archives to be extracted into the working directory of each executor. Supported file types: .jar, .tar, .tar.gz, .tgz, and .zip.

Returns:

value or null for none

setArchiveUris

public SparkBatch setArchiveUris(List<String> archiveUris)

Optional. HCFS URIs of archives to be extracted into the working directory of each executor. Supported file types: .jar, .tar, .tar.gz, .tgz, and .zip.

Parameters:

archiveUris - archiveUris or null for none

getArgs

public List<String> getArgs()

Optional. The arguments to pass to the driver. Do not include arguments that can be set as batch properties, such as --conf, since a collision can occur that causes an incorrect batch submission.

Returns:

value or null for none

setArgs

public SparkBatch setArgs(List<String> args)

Optional. The arguments to pass to the driver. Do not include arguments that can be set as batch properties, such as --conf, since a collision can occur that causes an incorrect batch submission.

Parameters:

args - args or null for none

getFileUris

public List<String> getFileUris()

Optional. HCFS URIs of files to be placed in the working directory of each executor.

Returns:

value or null for none

setFileUris

public SparkBatch setFileUris(List<String> fileUris)

Optional. HCFS URIs of files to be placed in the working directory of each executor.

Parameters:

fileUris - fileUris or null for none

getJarFileUris

public List<String> getJarFileUris()

Optional. HCFS URIs of jar files to add to the classpath of the Spark driver and tasks.

Returns:

value or null for none

setJarFileUris

public SparkBatch setJarFileUris(List<String> jarFileUris)

Optional. HCFS URIs of jar files to add to the classpath of the Spark driver and tasks.

Parameters:

jarFileUris - jarFileUris or null for none

getMainClass

public String getMainClass()

Optional. The name of the driver main class. The jar file that contains the class must be in the classpath or specified in jar_file_uris.

Returns:

value or null for none

setMainClass

public SparkBatch setMainClass(String mainClass)

Optional. The name of the driver main class. The jar file that contains the class must be in the classpath or specified in jar_file_uris.

Parameters:

mainClass - mainClass or null for none

getMainJarFileUri

public String getMainJarFileUri()

Optional. The HCFS URI of the jar file that contains the main class.

Returns:

value or null for none

setMainJarFileUri

public SparkBatch setMainJarFileUri(String mainJarFileUri)

Optional. The HCFS URI of the jar file that contains the main class.

Parameters:

mainJarFileUri - mainJarFileUri or null for none

set

public SparkBatch set(String fieldName,
                      Object value)

Overrides:

set in class com.google.api.client.json.GenericJson

clone

public SparkBatch clone()

Overrides:

clone in class com.google.api.client.json.GenericJson