com.google.api.services.dataproc.v1beta2.model

Class SparkRJob

java.lang.Object

java.util.AbstractMap<String,Object>

com.google.api.client.util.GenericData

com.google.api.client.json.GenericJson

com.google.api.services.dataproc.v1beta2.model.SparkRJob

All Implemented Interfaces:

Cloneable, Map<String,Object>

public final class SparkRJob
extends GenericJson

A Dataproc job for running Apache SparkR (https://spark.apache.org/docs/latest/sparkr.html) applications on YARN.

This is the Java data model class that specifies how to parse/serialize into the JSON that is transmitted over HTTP when working with the Cloud Dataproc API. For a detailed explanation see: https://developers.google.com/api-client-library/java/google-http-java-client/json

Author:

Google, Inc.

Nested Class Summary

Nested classes/interfaces inherited from class com.google.api.client.util.GenericData

GenericData.Flags

Nested classes/interfaces inherited from class java.util.AbstractMap

AbstractMap.SimpleEntry<K,V>, AbstractMap.SimpleImmutableEntry<K,V>

Nested classes/interfaces inherited from interface java.util.Map

Map.Entry<K,V>

Constructor Summary

Constructors

Constructor and Description
SparkRJob()

Method Summary

Modifier and Type	Method and Description
SparkRJob	clone()
List<String>	getArchiveUris() Optional.
List<String>	getArgs() Optional.
List<String>	getFileUris() Optional.
LoggingConfig	getLoggingConfig() Optional.
String	getMainRFileUri() Required.
Map<String,String>	getProperties() Optional.
SparkRJob	set(String fieldName, Object value)
SparkRJob	setArchiveUris(List<String> archiveUris) Optional.
SparkRJob	setArgs(List<String> args) Optional.
SparkRJob	setFileUris(List<String> fileUris) Optional.
SparkRJob	setLoggingConfig(LoggingConfig loggingConfig) Optional.
SparkRJob	setMainRFileUri(String mainRFileUri) Required.
SparkRJob	setProperties(Map<String,String> properties) Optional.

Methods inherited from class com.google.api.client.json.GenericJson

getFactory, setFactory, toPrettyString, toString

Methods inherited from class com.google.api.client.util.GenericData

entrySet, equals, get, getClassInfo, getUnknownKeys, hashCode, put, putAll, remove, setUnknownKeys

Methods inherited from class java.util.AbstractMap

clear, containsKey, containsValue, isEmpty, keySet, size, values

Methods inherited from class java.lang.Object

finalize, getClass, notify, notifyAll, wait, wait, wait

Methods inherited from interface java.util.Map

compute, computeIfAbsent, computeIfPresent, forEach, getOrDefault, merge, putIfAbsent, remove, replace, replace, replaceAll

Constructor Detail

SparkRJob

public SparkRJob()

Method Detail

getArchiveUris

public List<String> getArchiveUris()

Optional. HCFS URIs of archives to be extracted into the working directory of each executor. Supported file types: .jar, .tar, .tar.gz, .tgz, and .zip.

Returns:

value or null for none

setArchiveUris

public SparkRJob setArchiveUris(List<String> archiveUris)

Optional. HCFS URIs of archives to be extracted into the working directory of each executor. Supported file types: .jar, .tar, .tar.gz, .tgz, and .zip.

Parameters:

archiveUris - archiveUris or null for none

getArgs

public List<String> getArgs()

Optional. The arguments to pass to the driver. Do not include arguments, such as --conf, that can be set as job properties, since a collision may occur that causes an incorrect job submission.

Returns:

value or null for none

setArgs

public SparkRJob setArgs(List<String> args)

Optional. The arguments to pass to the driver. Do not include arguments, such as --conf, that can be set as job properties, since a collision may occur that causes an incorrect job submission.

Parameters:

args - args or null for none

getFileUris

public List<String> getFileUris()

Optional. HCFS URIs of files to be placed in the working directory of each executor. Useful for naively parallel tasks.

Returns:

value or null for none

setFileUris

public SparkRJob setFileUris(List<String> fileUris)

Optional. HCFS URIs of files to be placed in the working directory of each executor. Useful for naively parallel tasks.

Parameters:

fileUris - fileUris or null for none

getLoggingConfig

public LoggingConfig getLoggingConfig()

Optional. The runtime log config for job execution.

Returns:

value or null for none

setLoggingConfig

public SparkRJob setLoggingConfig(LoggingConfig loggingConfig)

Optional. The runtime log config for job execution.

Parameters:

loggingConfig - loggingConfig or null for none

getMainRFileUri

public String getMainRFileUri()

Required. The HCFS URI of the main R file to use as the driver. Must be a .R file.

Returns:

value or null for none

setMainRFileUri

public SparkRJob setMainRFileUri(String mainRFileUri)

Required. The HCFS URI of the main R file to use as the driver. Must be a .R file.

Parameters:

mainRFileUri - mainRFileUri or null for none

getProperties

public Map<String,String> getProperties()

Optional. A mapping of property names to values, used to configure SparkR. Properties that conflict with values set by the Dataproc API may be overwritten. Can include properties set in /etc/spark/conf/spark-defaults.conf and classes in user code.

Returns:

value or null for none

setProperties

public SparkRJob setProperties(Map<String,String> properties)

Optional. A mapping of property names to values, used to configure SparkR. Properties that conflict with values set by the Dataproc API may be overwritten. Can include properties set in /etc/spark/conf/spark-defaults.conf and classes in user code.

Parameters:

properties - properties or null for none

set

public SparkRJob set(String fieldName,
                     Object value)

Overrides:

set in class GenericJson

clone

public SparkRJob clone()

Overrides:

clone in class GenericJson