public interface SparkJobOrBuilder extends MessageOrBuilder
Modifier and Type | Method and Description |
---|---|
boolean |
containsProperties(String key)
Optional.
|
String |
getArchiveUris(int index)
Optional.
|
ByteString |
getArchiveUrisBytes(int index)
Optional.
|
int |
getArchiveUrisCount()
Optional.
|
List<String> |
getArchiveUrisList()
Optional.
|
String |
getArgs(int index)
Optional.
|
ByteString |
getArgsBytes(int index)
Optional.
|
int |
getArgsCount()
Optional.
|
List<String> |
getArgsList()
Optional.
|
SparkJob.DriverCase |
getDriverCase() |
String |
getFileUris(int index)
Optional.
|
ByteString |
getFileUrisBytes(int index)
Optional.
|
int |
getFileUrisCount()
Optional.
|
List<String> |
getFileUrisList()
Optional.
|
String |
getJarFileUris(int index)
Optional.
|
ByteString |
getJarFileUrisBytes(int index)
Optional.
|
int |
getJarFileUrisCount()
Optional.
|
List<String> |
getJarFileUrisList()
Optional.
|
LoggingConfig |
getLoggingConfig()
Optional.
|
LoggingConfigOrBuilder |
getLoggingConfigOrBuilder()
Optional.
|
String |
getMainClass()
The name of the driver's main class.
|
ByteString |
getMainClassBytes()
The name of the driver's main class.
|
String |
getMainJarFileUri()
The HCFS URI of the jar file that contains the main class.
|
ByteString |
getMainJarFileUriBytes()
The HCFS URI of the jar file that contains the main class.
|
Map<String,String> |
getProperties()
Deprecated.
|
int |
getPropertiesCount()
Optional.
|
Map<String,String> |
getPropertiesMap()
Optional.
|
String |
getPropertiesOrDefault(String key,
String defaultValue)
Optional.
|
String |
getPropertiesOrThrow(String key)
Optional.
|
boolean |
hasLoggingConfig()
Optional.
|
boolean |
hasMainClass()
The name of the driver's main class.
|
boolean |
hasMainJarFileUri()
The HCFS URI of the jar file that contains the main class.
|
findInitializationErrors, getAllFields, getDefaultInstanceForType, getDescriptorForType, getField, getInitializationErrorString, getOneofFieldDescriptor, getRepeatedField, getRepeatedFieldCount, getUnknownFields, hasField, hasOneof
isInitialized
boolean hasMainJarFileUri()
The HCFS URI of the jar file that contains the main class.
string main_jar_file_uri = 1;
String getMainJarFileUri()
The HCFS URI of the jar file that contains the main class.
string main_jar_file_uri = 1;
ByteString getMainJarFileUriBytes()
The HCFS URI of the jar file that contains the main class.
string main_jar_file_uri = 1;
boolean hasMainClass()
The name of the driver's main class. The jar file that contains the class must be in the default CLASSPATH or specified in `jar_file_uris`.
string main_class = 2;
String getMainClass()
The name of the driver's main class. The jar file that contains the class must be in the default CLASSPATH or specified in `jar_file_uris`.
string main_class = 2;
ByteString getMainClassBytes()
The name of the driver's main class. The jar file that contains the class must be in the default CLASSPATH or specified in `jar_file_uris`.
string main_class = 2;
List<String> getArgsList()
Optional. The arguments to pass to the driver. Do not include arguments, such as `--conf`, that can be set as job properties, since a collision may occur that causes an incorrect job submission.
repeated string args = 3 [(.google.api.field_behavior) = OPTIONAL];
int getArgsCount()
Optional. The arguments to pass to the driver. Do not include arguments, such as `--conf`, that can be set as job properties, since a collision may occur that causes an incorrect job submission.
repeated string args = 3 [(.google.api.field_behavior) = OPTIONAL];
String getArgs(int index)
Optional. The arguments to pass to the driver. Do not include arguments, such as `--conf`, that can be set as job properties, since a collision may occur that causes an incorrect job submission.
repeated string args = 3 [(.google.api.field_behavior) = OPTIONAL];
index
- The index of the element to return.ByteString getArgsBytes(int index)
Optional. The arguments to pass to the driver. Do not include arguments, such as `--conf`, that can be set as job properties, since a collision may occur that causes an incorrect job submission.
repeated string args = 3 [(.google.api.field_behavior) = OPTIONAL];
index
- The index of the value to return.List<String> getJarFileUrisList()
Optional. HCFS URIs of jar files to add to the CLASSPATHs of the Spark driver and tasks.
repeated string jar_file_uris = 4 [(.google.api.field_behavior) = OPTIONAL];
int getJarFileUrisCount()
Optional. HCFS URIs of jar files to add to the CLASSPATHs of the Spark driver and tasks.
repeated string jar_file_uris = 4 [(.google.api.field_behavior) = OPTIONAL];
String getJarFileUris(int index)
Optional. HCFS URIs of jar files to add to the CLASSPATHs of the Spark driver and tasks.
repeated string jar_file_uris = 4 [(.google.api.field_behavior) = OPTIONAL];
index
- The index of the element to return.ByteString getJarFileUrisBytes(int index)
Optional. HCFS URIs of jar files to add to the CLASSPATHs of the Spark driver and tasks.
repeated string jar_file_uris = 4 [(.google.api.field_behavior) = OPTIONAL];
index
- The index of the value to return.List<String> getFileUrisList()
Optional. HCFS URIs of files to be placed in the working directory of each executor. Useful for naively parallel tasks.
repeated string file_uris = 5 [(.google.api.field_behavior) = OPTIONAL];
int getFileUrisCount()
Optional. HCFS URIs of files to be placed in the working directory of each executor. Useful for naively parallel tasks.
repeated string file_uris = 5 [(.google.api.field_behavior) = OPTIONAL];
String getFileUris(int index)
Optional. HCFS URIs of files to be placed in the working directory of each executor. Useful for naively parallel tasks.
repeated string file_uris = 5 [(.google.api.field_behavior) = OPTIONAL];
index
- The index of the element to return.ByteString getFileUrisBytes(int index)
Optional. HCFS URIs of files to be placed in the working directory of each executor. Useful for naively parallel tasks.
repeated string file_uris = 5 [(.google.api.field_behavior) = OPTIONAL];
index
- The index of the value to return.List<String> getArchiveUrisList()
Optional. HCFS URIs of archives to be extracted into the working directory of each executor. Supported file types: .jar, .tar, .tar.gz, .tgz, and .zip.
repeated string archive_uris = 6 [(.google.api.field_behavior) = OPTIONAL];
int getArchiveUrisCount()
Optional. HCFS URIs of archives to be extracted into the working directory of each executor. Supported file types: .jar, .tar, .tar.gz, .tgz, and .zip.
repeated string archive_uris = 6 [(.google.api.field_behavior) = OPTIONAL];
String getArchiveUris(int index)
Optional. HCFS URIs of archives to be extracted into the working directory of each executor. Supported file types: .jar, .tar, .tar.gz, .tgz, and .zip.
repeated string archive_uris = 6 [(.google.api.field_behavior) = OPTIONAL];
index
- The index of the element to return.ByteString getArchiveUrisBytes(int index)
Optional. HCFS URIs of archives to be extracted into the working directory of each executor. Supported file types: .jar, .tar, .tar.gz, .tgz, and .zip.
repeated string archive_uris = 6 [(.google.api.field_behavior) = OPTIONAL];
index
- The index of the value to return.int getPropertiesCount()
Optional. A mapping of property names to values, used to configure Spark. Properties that conflict with values set by the Dataproc API may be overwritten. Can include properties set in /etc/spark/conf/spark-defaults.conf and classes in user code.
map<string, string> properties = 7 [(.google.api.field_behavior) = OPTIONAL];
boolean containsProperties(String key)
Optional. A mapping of property names to values, used to configure Spark. Properties that conflict with values set by the Dataproc API may be overwritten. Can include properties set in /etc/spark/conf/spark-defaults.conf and classes in user code.
map<string, string> properties = 7 [(.google.api.field_behavior) = OPTIONAL];
@Deprecated Map<String,String> getProperties()
getPropertiesMap()
instead.Map<String,String> getPropertiesMap()
Optional. A mapping of property names to values, used to configure Spark. Properties that conflict with values set by the Dataproc API may be overwritten. Can include properties set in /etc/spark/conf/spark-defaults.conf and classes in user code.
map<string, string> properties = 7 [(.google.api.field_behavior) = OPTIONAL];
String getPropertiesOrDefault(String key, String defaultValue)
Optional. A mapping of property names to values, used to configure Spark. Properties that conflict with values set by the Dataproc API may be overwritten. Can include properties set in /etc/spark/conf/spark-defaults.conf and classes in user code.
map<string, string> properties = 7 [(.google.api.field_behavior) = OPTIONAL];
String getPropertiesOrThrow(String key)
Optional. A mapping of property names to values, used to configure Spark. Properties that conflict with values set by the Dataproc API may be overwritten. Can include properties set in /etc/spark/conf/spark-defaults.conf and classes in user code.
map<string, string> properties = 7 [(.google.api.field_behavior) = OPTIONAL];
boolean hasLoggingConfig()
Optional. The runtime log config for job execution.
.google.cloud.dataproc.v1.LoggingConfig logging_config = 8 [(.google.api.field_behavior) = OPTIONAL];
LoggingConfig getLoggingConfig()
Optional. The runtime log config for job execution.
.google.cloud.dataproc.v1.LoggingConfig logging_config = 8 [(.google.api.field_behavior) = OPTIONAL];
LoggingConfigOrBuilder getLoggingConfigOrBuilder()
Optional. The runtime log config for job execution.
.google.cloud.dataproc.v1.LoggingConfig logging_config = 8 [(.google.api.field_behavior) = OPTIONAL];
SparkJob.DriverCase getDriverCase()
Copyright © 2022 Google LLC. All rights reserved.