Class: Google::Apis::DataprocV1beta2::ClusterConfig
- Inherits:
-
Object
- Object
- Google::Apis::DataprocV1beta2::ClusterConfig
- Includes:
- Core::Hashable, Core::JsonObjectSupport
- Defined in:
- generated/google/apis/dataproc_v1beta2/classes.rb,
generated/google/apis/dataproc_v1beta2/representations.rb,
generated/google/apis/dataproc_v1beta2/representations.rb
Overview
The cluster config.
Instance Attribute Summary collapse
-
#autoscaling_config ⇒ Google::Apis::DataprocV1beta2::AutoscalingConfig
Autoscaling Policy config associated with the cluster.
-
#config_bucket ⇒ String
Optional.
-
#encryption_config ⇒ Google::Apis::DataprocV1beta2::EncryptionConfig
Encryption settings for the cluster.
-
#endpoint_config ⇒ Google::Apis::DataprocV1beta2::EndpointConfig
Endpoint config for this cluster Corresponds to the JSON property
endpointConfig
. -
#gce_cluster_config ⇒ Google::Apis::DataprocV1beta2::GceClusterConfig
Common config settings for resources of Compute Engine cluster instances, applicable to all instances in the cluster.
-
#initialization_actions ⇒ Array<Google::Apis::DataprocV1beta2::NodeInitializationAction>
Optional.
-
#lifecycle_config ⇒ Google::Apis::DataprocV1beta2::LifecycleConfig
Specifies the cluster auto-delete schedule configuration.
-
#master_config ⇒ Google::Apis::DataprocV1beta2::InstanceGroupConfig
The config settings for Compute Engine resources in an instance group, such as a master or worker group.
-
#secondary_worker_config ⇒ Google::Apis::DataprocV1beta2::InstanceGroupConfig
The config settings for Compute Engine resources in an instance group, such as a master or worker group.
-
#security_config ⇒ Google::Apis::DataprocV1beta2::SecurityConfig
Security related configuration, including encryption, Kerberos, etc.
-
#software_config ⇒ Google::Apis::DataprocV1beta2::SoftwareConfig
Specifies the selection and config of software inside the cluster.
-
#worker_config ⇒ Google::Apis::DataprocV1beta2::InstanceGroupConfig
The config settings for Compute Engine resources in an instance group, such as a master or worker group.
Instance Method Summary collapse
-
#initialize(**args) ⇒ ClusterConfig
constructor
A new instance of ClusterConfig.
-
#update!(**args) ⇒ Object
Update properties of this object.
Methods included from Core::JsonObjectSupport
Methods included from Core::Hashable
Constructor Details
#initialize(**args) ⇒ ClusterConfig
Returns a new instance of ClusterConfig.
471 472 473 |
# File 'generated/google/apis/dataproc_v1beta2/classes.rb', line 471 def initialize(**args) update!(**args) end |
Instance Attribute Details
#autoscaling_config ⇒ Google::Apis::DataprocV1beta2::AutoscalingConfig
Autoscaling Policy config associated with the cluster.
Corresponds to the JSON property autoscalingConfig
395 396 397 |
# File 'generated/google/apis/dataproc_v1beta2/classes.rb', line 395 def autoscaling_config @autoscaling_config end |
#config_bucket ⇒ String
Optional. A Cloud Storage bucket used to stage job dependencies, config files,
and job driver console output. If you do not specify a staging bucket, Cloud
Dataproc will determine a Cloud Storage location (US, ASIA, or EU) for your
cluster's staging bucket according to the Compute Engine zone where your
cluster is deployed, and then create and manage this project-level, per-
location bucket (see Dataproc staging bucket).
Corresponds to the JSON property configBucket
405 406 407 |
# File 'generated/google/apis/dataproc_v1beta2/classes.rb', line 405 def config_bucket @config_bucket end |
#encryption_config ⇒ Google::Apis::DataprocV1beta2::EncryptionConfig
Encryption settings for the cluster.
Corresponds to the JSON property encryptionConfig
410 411 412 |
# File 'generated/google/apis/dataproc_v1beta2/classes.rb', line 410 def encryption_config @encryption_config end |
#endpoint_config ⇒ Google::Apis::DataprocV1beta2::EndpointConfig
Endpoint config for this cluster
Corresponds to the JSON property endpointConfig
415 416 417 |
# File 'generated/google/apis/dataproc_v1beta2/classes.rb', line 415 def endpoint_config @endpoint_config end |
#gce_cluster_config ⇒ Google::Apis::DataprocV1beta2::GceClusterConfig
Common config settings for resources of Compute Engine cluster instances,
applicable to all instances in the cluster.
Corresponds to the JSON property gceClusterConfig
421 422 423 |
# File 'generated/google/apis/dataproc_v1beta2/classes.rb', line 421 def gce_cluster_config @gce_cluster_config end |
#initialization_actions ⇒ Array<Google::Apis::DataprocV1beta2::NodeInitializationAction>
Optional. Commands to execute on each node after config is completed. By
default, executables are run on master and all worker nodes. You can test a
node's role
metadata to run an executable on a master or worker
node, as shown below using curl (you can also use wget):
ROLE=$(curl -H Metadata-Flavor:Google
http://metadata/computeMetadata/v1beta2/instance/attributes/dataproc-role)
if [[ "$ROLE
" == 'Master' ]]; then
... master specific actions ...
else
... worker specific actions ...
fi
Corresponds to the JSON property initializationActions
436 437 438 |
# File 'generated/google/apis/dataproc_v1beta2/classes.rb', line 436 def initialization_actions @initialization_actions end |
#lifecycle_config ⇒ Google::Apis::DataprocV1beta2::LifecycleConfig
Specifies the cluster auto-delete schedule configuration.
Corresponds to the JSON property lifecycleConfig
441 442 443 |
# File 'generated/google/apis/dataproc_v1beta2/classes.rb', line 441 def lifecycle_config @lifecycle_config end |
#master_config ⇒ Google::Apis::DataprocV1beta2::InstanceGroupConfig
The config settings for Compute Engine resources in an instance group, such as
a master or worker group.
Corresponds to the JSON property masterConfig
447 448 449 |
# File 'generated/google/apis/dataproc_v1beta2/classes.rb', line 447 def master_config @master_config end |
#secondary_worker_config ⇒ Google::Apis::DataprocV1beta2::InstanceGroupConfig
The config settings for Compute Engine resources in an instance group, such as
a master or worker group.
Corresponds to the JSON property secondaryWorkerConfig
453 454 455 |
# File 'generated/google/apis/dataproc_v1beta2/classes.rb', line 453 def secondary_worker_config @secondary_worker_config end |
#security_config ⇒ Google::Apis::DataprocV1beta2::SecurityConfig
Security related configuration, including encryption, Kerberos, etc.
Corresponds to the JSON property securityConfig
458 459 460 |
# File 'generated/google/apis/dataproc_v1beta2/classes.rb', line 458 def security_config @security_config end |
#software_config ⇒ Google::Apis::DataprocV1beta2::SoftwareConfig
Specifies the selection and config of software inside the cluster.
Corresponds to the JSON property softwareConfig
463 464 465 |
# File 'generated/google/apis/dataproc_v1beta2/classes.rb', line 463 def software_config @software_config end |
#worker_config ⇒ Google::Apis::DataprocV1beta2::InstanceGroupConfig
The config settings for Compute Engine resources in an instance group, such as
a master or worker group.
Corresponds to the JSON property workerConfig
469 470 471 |
# File 'generated/google/apis/dataproc_v1beta2/classes.rb', line 469 def worker_config @worker_config end |
Instance Method Details
#update!(**args) ⇒ Object
Update properties of this object
476 477 478 479 480 481 482 483 484 485 486 487 488 489 |
# File 'generated/google/apis/dataproc_v1beta2/classes.rb', line 476 def update!(**args) @autoscaling_config = args[:autoscaling_config] if args.key?(:autoscaling_config) @config_bucket = args[:config_bucket] if args.key?(:config_bucket) @encryption_config = args[:encryption_config] if args.key?(:encryption_config) @endpoint_config = args[:endpoint_config] if args.key?(:endpoint_config) @gce_cluster_config = args[:gce_cluster_config] if args.key?(:gce_cluster_config) @initialization_actions = args[:initialization_actions] if args.key?(:initialization_actions) @lifecycle_config = args[:lifecycle_config] if args.key?(:lifecycle_config) @master_config = args[:master_config] if args.key?(:master_config) @secondary_worker_config = args[:secondary_worker_config] if args.key?(:secondary_worker_config) @security_config = args[:security_config] if args.key?(:security_config) @software_config = args[:software_config] if args.key?(:software_config) @worker_config = args[:worker_config] if args.key?(:worker_config) end |