| Class | Description |
|---|---|
| AcceleratorConfig |
Specifies the type and number of accelerator cards attached to the instances of an instance.
|
| AutoscalingConfig |
Autoscaling Policy config associated with the cluster.
|
| AutoscalingPolicy |
Describes an autoscaling policy for Dataproc cluster autoscaler.
|
| AuxiliaryNodeGroup |
Node group identification and configuration information.
|
| AuxiliaryServicesConfig |
Auxiliary services configuration for a Cluster.
|
| BasicAutoscalingAlgorithm |
Basic algorithm for autoscaling.
|
| BasicYarnAutoscalingConfig |
Basic autoscaling configurations for YARN.
|
| Batch |
A representation of a batch workload in the service.
|
| BatchOperationMetadata |
Metadata describing the Batch operation.
|
| Binding |
Associates members, or principals, with a role.
|
| CancelJobRequest |
A request to cancel a job.
|
| Cluster |
Describes the identifying information, config, and status of a Dataproc cluster
|
| ClusterConfig |
The cluster config.
|
| ClusterMetrics |
Contains cluster daemon metrics, such as HDFS and YARN stats.Beta Feature: This report is
available for testing purposes only.
|
| ClusterOperation |
The cluster operation triggered by a workflow.
|
| ClusterOperationMetadata |
Metadata describing the operation.
|
| ClusterOperationStatus |
The status of the operation.
|
| ClusterSelector |
A selector that chooses target cluster for jobs based on metadata.
|
| ClusterStatus |
The status of a cluster and its instances.
|
| ConfidentialInstanceConfig |
Confidential Instance Config for clusters using Confidential VMs
(https://cloud.google.com/compute/confidential-vm/docs)
|
| DataprocMetricConfig |
Dataproc metric config.
|
| DiagnoseClusterRequest |
A request to collect cluster diagnostic information.
|
| DiagnoseClusterResults |
The location of diagnostic output.
|
| DiskConfig |
Specifies the config of disk options for a group of VM instances.
|
| DriverSchedulingConfig |
Driver scheduling configuration.
|
| Empty |
A generic empty message that you can re-use to avoid defining duplicated empty messages in your
APIs.
|
| EncryptionConfig |
Encryption settings for the cluster.
|
| EndpointConfig |
Endpoint config for this cluster
|
| EnvironmentConfig |
Environment configuration for a workload.
|
| ExecutionConfig |
Execution configuration for a workload.
|
| Expr |
Represents a textual expression in the Common Expression Language (CEL) syntax.
|
| FlinkJob |
A Dataproc job for running Apache Flink applications on YARN.
|
| GceClusterConfig |
Common config settings for resources of Compute Engine cluster instances, applicable to all
instances in the cluster.
|
| GceNodePoolOperationMetadata |
Metadata describing the Compute Engine node pool operation.
|
| GetIamPolicyRequest |
Request message for GetIamPolicy method.
|
| GetPolicyOptions |
Encapsulates settings provided to GetIamPolicy.
|
| GkeClusterConfig |
The cluster's GKE config.
|
| GkeNodeConfig |
Parameters that describe cluster nodes.
|
| GkeNodePoolAcceleratorConfig |
A GkeNodeConfigAcceleratorConfig represents a Hardware Accelerator request for a node pool.
|
| GkeNodePoolAutoscalingConfig |
GkeNodePoolAutoscaling contains information the cluster autoscaler needs to adjust the size of
the node pool to the current cluster usage.
|
| GkeNodePoolConfig |
The configuration of a GKE node pool used by a Dataproc-on-GKE cluster
(https://cloud.google.com/dataproc/docs/concepts/jobs/dataproc-gke#create-a-dataproc-on-gke-
cluster).
|
| GkeNodePoolTarget |
GKE node pools that Dataproc workloads run on.
|
| HadoopJob |
A Dataproc job for running Apache Hadoop MapReduce (https://hadoop.apache.org/docs/current
/hadoop-mapreduce-client/hadoop-mapreduce-client-core/MapReduceTutorial.html) jobs on Apache
Hadoop YARN (https://hadoop.apache.org/docs/r2.7.1/hadoop-yarn/hadoop-yarn-site/YARN.html).
|
| HiveJob |
A Dataproc job for running Apache Hive (https://hive.apache.org/) queries on YARN.
|
| IdentityConfig |
Identity related configuration, including service account based secure multi-tenancy user
mappings.
|
| InjectCredentialsRequest |
A request to inject credentials into a cluster.
|
| InjectSessionCredentialsRequest |
A request to inject credentials to a session.
|
| InstanceFlexibilityPolicy |
Instance flexibility Policy allowing a mixture of VM shapes and provisioning models.
|
| InstanceGroupAutoscalingPolicyConfig |
Configuration for the size bounds of an instance group, including its proportional size to other
groups.
|
| InstanceGroupConfig |
The config settings for Compute Engine resources in an instance group, such as a master or worker
group.
|
| InstanceReference |
A reference to a Compute Engine instance.
|
| InstanceSelection |
Defines machines types and a rank to which the machines types belong.
|
| InstanceSelectionResult |
Defines a mapping from machine types to the number of VMs that are created with each machine
type.
|
| InstantiateWorkflowTemplateRequest |
A request to instantiate a workflow template.
|
| Interval |
Represents a time interval, encoded as a Timestamp start (inclusive) and a Timestamp end
(exclusive).The start must be less than or equal to the end.
|
| Job |
A Dataproc job resource.
|
| JobMetadata |
Job Operation metadata.
|
| JobPlacement |
Dataproc job config.
|
| JobReference |
Encapsulates the full scoping used to reference a job.
|
| JobScheduling |
Job scheduling options.
|
| JobStatus |
Dataproc job status.
|
| JupyterConfig |
Jupyter configuration for an interactive session.
|
| KerberosConfig |
Specifies Kerberos related configuration.
|
| KubernetesClusterConfig |
The configuration for running the Dataproc cluster on Kubernetes.
|
| KubernetesSoftwareConfig |
The software configuration for this Dataproc cluster running on Kubernetes.
|
| LifecycleConfig |
Specifies the cluster auto-delete schedule configuration.
|
| ListAutoscalingPoliciesResponse |
A response to a request to list autoscaling policies in a project.
|
| ListBatchesResponse |
A list of batch workloads.
|
| ListClustersResponse |
The list of all clusters in a project.
|
| ListJobsResponse |
A list of jobs in a project.
|
| ListOperationsResponse |
The response message for Operations.ListOperations.
|
| ListSessionsResponse |
A list of interactive sessions.
|
| ListSessionTemplatesResponse |
A list of session templates.
|
| ListWorkflowTemplatesResponse |
A response to a request to list workflow templates in a project.
|
| LoggingConfig |
The runtime logging config of the job.
|
| ManagedCluster |
Cluster that is managed by the workflow.
|
| ManagedGroupConfig |
Specifies the resources used to actively manage an instance group.
|
| MetastoreConfig |
Specifies a Metastore configuration.
|
| Metric |
A Dataproc custom metric.
|
| NamespacedGkeDeploymentTarget |
Deprecated.
|
| NodeGroup |
Dataproc Node Group.
|
| NodeGroupAffinity |
Node Group Affinity for clusters using sole-tenant node groups.
|
| NodeGroupOperationMetadata |
Metadata describing the node group operation.
|
| NodeInitializationAction |
Specifies an executable to run on a fully configured node and a timeout period for executable
completion.
|
| NodePool |
indicating a list of workers of same type
|
| Operation |
This resource represents a long-running operation that is the result of a network API call.
|
| OrderedJob |
A job executed by the workflow.
|
| ParameterValidation |
Configuration for parameter validation.
|
| PeripheralsConfig |
Auxiliary services configuration for a workload.
|
| PigJob |
A Dataproc job for running Apache Pig (https://pig.apache.org/) queries on YARN.
|
| Policy |
An Identity and Access Management (IAM) policy, which specifies access controls for Google Cloud
resources.A Policy is a collection of bindings.
|
| PrestoJob |
A Dataproc job for running Presto (https://prestosql.io/) queries.
|
| PyPiRepositoryConfig |
Configuration for PyPi repository
|
| PySparkBatch |
A configuration for running an Apache PySpark
(https://spark.apache.org/docs/latest/api/python/getting_started/quickstart.html) batch workload.
|
| PySparkJob |
A Dataproc job for running Apache PySpark (https://spark.apache.org/docs/0.9.0/python-
programming-guide.html) applications on YARN.
|
| QueryList |
A list of queries to run on a cluster.
|
| RegexValidation |
Validation based on regular expressions.
|
| RepairClusterRequest |
A request to repair a cluster.
|
| RepositoryConfig |
Configuration for dependency repositories
|
| ReservationAffinity |
Reservation Affinity for consuming Zonal reservation.
|
| ResizeNodeGroupRequest |
A request to resize a node group.
|
| RuntimeConfig |
Runtime configuration for a workload.
|
| RuntimeInfo |
Runtime information about workload execution.
|
| SecurityConfig |
Security related configuration, including encryption, Kerberos, etc.
|
| Session |
A representation of a session.
|
| SessionOperationMetadata |
Metadata describing the Session operation.
|
| SessionStateHistory |
Historical state information.
|
| SessionTemplate |
A representation of a session template.
|
| SetIamPolicyRequest |
Request message for SetIamPolicy method.
|
| ShieldedInstanceConfig |
Shielded Instance Config for clusters using Compute Engine Shielded VMs
(https://cloud.google.com/security/shielded-cloud/shielded-vm).
|
| SoftwareConfig |
Specifies the selection and config of software inside the cluster.
|
| SparkBatch |
A configuration for running an Apache Spark (https://spark.apache.org/) batch workload.
|
| SparkHistoryServerConfig |
Spark History Server configuration for the workload.
|
| SparkJob |
A Dataproc job for running Apache Spark (https://spark.apache.org/) applications on YARN.
|
| SparkRBatch |
A configuration for running an Apache SparkR (https://spark.apache.org/docs/latest/sparkr.html)
batch workload.
|
| SparkRJob |
A Dataproc job for running Apache SparkR (https://spark.apache.org/docs/latest/sparkr.html)
applications on YARN.
|
| SparkSqlBatch |
A configuration for running Apache Spark SQL (https://spark.apache.org/sql/) queries as a batch
workload.
|
| SparkSqlJob |
A Dataproc job for running Apache Spark SQL (https://spark.apache.org/sql/) queries.
|
| SparkStandaloneAutoscalingConfig |
Basic autoscaling configurations for Spark Standalone.
|
| StartClusterRequest |
A request to start a cluster.
|
| StartupConfig |
Configuration to handle the startup of instances during cluster create and update process.
|
| StateHistory |
Historical state information.
|
| Status |
The Status type defines a logical error model that is suitable for different programming
environments, including REST APIs and RPC APIs.
|
| StopClusterRequest |
A request to stop a cluster.
|
| SubmitJobRequest |
A request to submit a job.
|
| TemplateParameter |
A configurable parameter that replaces one or more fields in the template.
|
| TerminateSessionRequest |
A request to terminate an interactive session.
|
| TestIamPermissionsRequest |
Request message for TestIamPermissions method.
|
| TestIamPermissionsResponse |
Response message for TestIamPermissions method.
|
| TrinoJob |
A Dataproc job for running Trino (https://trino.io/) queries.
|
| UsageMetrics |
Usage metrics represent approximate total resources consumed by a workload.
|
| UsageSnapshot |
The usage snapshot represents the resources consumed by a workload at a specified time.
|
| ValueValidation |
Validation based on a list of allowed values.
|
| VirtualClusterConfig |
The Dataproc cluster config for a cluster that does not directly control the underlying compute
resources, such as a Dataproc-on-GKE cluster (https://cloud.google.com/dataproc/docs/guides/dpgke
/dataproc-gke-overview).
|
| WorkflowGraph |
The workflow graph.
|
| WorkflowMetadata |
A Dataproc workflow template resource.
|
| WorkflowNode |
The workflow node.
|
| WorkflowTemplate |
A Dataproc workflow template resource.
|
| WorkflowTemplatePlacement |
Specifies workflow execution target.Either managed_cluster or cluster_selector is required.
|
| YarnApplication |
A YARN application created by a job.
|
Copyright © 2011–2023 Google. All rights reserved.