public interface PySparkBatchOrBuilder extends MessageOrBuilder
findInitializationErrors, getAllFields, getDefaultInstanceForType, getDescriptorForType, getField, getInitializationErrorString, getOneofFieldDescriptor, getRepeatedField, getRepeatedFieldCount, getUnknownFields, hasField, hasOneof
isInitialized
String getMainPythonFileUri()
Required. The HCFS URI of the main Python file to use as the Spark driver. Must be a .py file.
string main_python_file_uri = 1 [(.google.api.field_behavior) = REQUIRED];
ByteString getMainPythonFileUriBytes()
Required. The HCFS URI of the main Python file to use as the Spark driver. Must be a .py file.
string main_python_file_uri = 1 [(.google.api.field_behavior) = REQUIRED];
List<String> getArgsList()
Optional. The arguments to pass to the driver. Do not include arguments that can be set as batch properties, such as `--conf`, since a collision can occur that causes an incorrect batch submission.
repeated string args = 2 [(.google.api.field_behavior) = OPTIONAL];
int getArgsCount()
Optional. The arguments to pass to the driver. Do not include arguments that can be set as batch properties, such as `--conf`, since a collision can occur that causes an incorrect batch submission.
repeated string args = 2 [(.google.api.field_behavior) = OPTIONAL];
String getArgs(int index)
Optional. The arguments to pass to the driver. Do not include arguments that can be set as batch properties, such as `--conf`, since a collision can occur that causes an incorrect batch submission.
repeated string args = 2 [(.google.api.field_behavior) = OPTIONAL];
index
- The index of the element to return.ByteString getArgsBytes(int index)
Optional. The arguments to pass to the driver. Do not include arguments that can be set as batch properties, such as `--conf`, since a collision can occur that causes an incorrect batch submission.
repeated string args = 2 [(.google.api.field_behavior) = OPTIONAL];
index
- The index of the value to return.List<String> getPythonFileUrisList()
Optional. HCFS file URIs of Python files to pass to the PySpark framework. Supported file types: `.py`, `.egg`, and `.zip`.
repeated string python_file_uris = 3 [(.google.api.field_behavior) = OPTIONAL];
int getPythonFileUrisCount()
Optional. HCFS file URIs of Python files to pass to the PySpark framework. Supported file types: `.py`, `.egg`, and `.zip`.
repeated string python_file_uris = 3 [(.google.api.field_behavior) = OPTIONAL];
String getPythonFileUris(int index)
Optional. HCFS file URIs of Python files to pass to the PySpark framework. Supported file types: `.py`, `.egg`, and `.zip`.
repeated string python_file_uris = 3 [(.google.api.field_behavior) = OPTIONAL];
index
- The index of the element to return.ByteString getPythonFileUrisBytes(int index)
Optional. HCFS file URIs of Python files to pass to the PySpark framework. Supported file types: `.py`, `.egg`, and `.zip`.
repeated string python_file_uris = 3 [(.google.api.field_behavior) = OPTIONAL];
index
- The index of the value to return.List<String> getJarFileUrisList()
Optional. HCFS URIs of jar files to add to the classpath of the Spark driver and tasks.
repeated string jar_file_uris = 4 [(.google.api.field_behavior) = OPTIONAL];
int getJarFileUrisCount()
Optional. HCFS URIs of jar files to add to the classpath of the Spark driver and tasks.
repeated string jar_file_uris = 4 [(.google.api.field_behavior) = OPTIONAL];
String getJarFileUris(int index)
Optional. HCFS URIs of jar files to add to the classpath of the Spark driver and tasks.
repeated string jar_file_uris = 4 [(.google.api.field_behavior) = OPTIONAL];
index
- The index of the element to return.ByteString getJarFileUrisBytes(int index)
Optional. HCFS URIs of jar files to add to the classpath of the Spark driver and tasks.
repeated string jar_file_uris = 4 [(.google.api.field_behavior) = OPTIONAL];
index
- The index of the value to return.List<String> getFileUrisList()
Optional. HCFS URIs of files to be placed in the working directory of each executor.
repeated string file_uris = 5 [(.google.api.field_behavior) = OPTIONAL];
int getFileUrisCount()
Optional. HCFS URIs of files to be placed in the working directory of each executor.
repeated string file_uris = 5 [(.google.api.field_behavior) = OPTIONAL];
String getFileUris(int index)
Optional. HCFS URIs of files to be placed in the working directory of each executor.
repeated string file_uris = 5 [(.google.api.field_behavior) = OPTIONAL];
index
- The index of the element to return.ByteString getFileUrisBytes(int index)
Optional. HCFS URIs of files to be placed in the working directory of each executor.
repeated string file_uris = 5 [(.google.api.field_behavior) = OPTIONAL];
index
- The index of the value to return.List<String> getArchiveUrisList()
Optional. HCFS URIs of archives to be extracted into the working directory of each executor. Supported file types: `.jar`, `.tar`, `.tar.gz`, `.tgz`, and `.zip`.
repeated string archive_uris = 6 [(.google.api.field_behavior) = OPTIONAL];
int getArchiveUrisCount()
Optional. HCFS URIs of archives to be extracted into the working directory of each executor. Supported file types: `.jar`, `.tar`, `.tar.gz`, `.tgz`, and `.zip`.
repeated string archive_uris = 6 [(.google.api.field_behavior) = OPTIONAL];
String getArchiveUris(int index)
Optional. HCFS URIs of archives to be extracted into the working directory of each executor. Supported file types: `.jar`, `.tar`, `.tar.gz`, `.tgz`, and `.zip`.
repeated string archive_uris = 6 [(.google.api.field_behavior) = OPTIONAL];
index
- The index of the element to return.ByteString getArchiveUrisBytes(int index)
Optional. HCFS URIs of archives to be extracted into the working directory of each executor. Supported file types: `.jar`, `.tar`, `.tar.gz`, `.tgz`, and `.zip`.
repeated string archive_uris = 6 [(.google.api.field_behavior) = OPTIONAL];
index
- The index of the value to return.Copyright © 2022 Google LLC. All rights reserved.