Class: Google::Apis::DataprocV1::ClusterConfig
- Inherits:
-
Object
- Object
- Google::Apis::DataprocV1::ClusterConfig
- Includes:
- Core::Hashable, Core::JsonObjectSupport
- Defined in:
- generated/google/apis/dataproc_v1/classes.rb,
generated/google/apis/dataproc_v1/representations.rb,
generated/google/apis/dataproc_v1/representations.rb
Overview
The cluster config.
Instance Attribute Summary collapse
-
#autoscaling_config ⇒ Google::Apis::DataprocV1::AutoscalingConfig
Autoscaling Policy config associated with the cluster.
-
#config_bucket ⇒ String
Optional.
-
#encryption_config ⇒ Google::Apis::DataprocV1::EncryptionConfig
Encryption settings for the cluster.
-
#gce_cluster_config ⇒ Google::Apis::DataprocV1::GceClusterConfig
Common config settings for resources of Compute Engine cluster instances, applicable to all instances in the cluster.
-
#initialization_actions ⇒ Array<Google::Apis::DataprocV1::NodeInitializationAction>
Optional.
-
#lifecycle_config ⇒ Google::Apis::DataprocV1::LifecycleConfig
Specifies the cluster auto-delete schedule configuration.
-
#master_config ⇒ Google::Apis::DataprocV1::InstanceGroupConfig
The config settings for Compute Engine resources in an instance group, such as a master or worker group.
-
#secondary_worker_config ⇒ Google::Apis::DataprocV1::InstanceGroupConfig
The config settings for Compute Engine resources in an instance group, such as a master or worker group.
-
#security_config ⇒ Google::Apis::DataprocV1::SecurityConfig
Security related configuration, including Kerberos.
-
#software_config ⇒ Google::Apis::DataprocV1::SoftwareConfig
Specifies the selection and config of software inside the cluster.
-
#worker_config ⇒ Google::Apis::DataprocV1::InstanceGroupConfig
The config settings for Compute Engine resources in an instance group, such as a master or worker group.
Instance Method Summary collapse
-
#initialize(**args) ⇒ ClusterConfig
constructor
A new instance of ClusterConfig.
-
#update!(**args) ⇒ Object
Update properties of this object.
Methods included from Core::JsonObjectSupport
Methods included from Core::Hashable
Constructor Details
#initialize(**args) ⇒ ClusterConfig
Returns a new instance of ClusterConfig.
467 468 469 |
# File 'generated/google/apis/dataproc_v1/classes.rb', line 467 def initialize(**args) update!(**args) end |
Instance Attribute Details
#autoscaling_config ⇒ Google::Apis::DataprocV1::AutoscalingConfig
Autoscaling Policy config associated with the cluster.
Corresponds to the JSON property autoscalingConfig
396 397 398 |
# File 'generated/google/apis/dataproc_v1/classes.rb', line 396 def autoscaling_config @autoscaling_config end |
#config_bucket ⇒ String
Optional. A Cloud Storage bucket used to stage job dependencies, config files,
and job driver console output. If you do not specify a staging bucket, Cloud
Dataproc will determine a Cloud Storage location (US, ASIA, or EU) for your
cluster's staging bucket according to the Compute Engine zone where your
cluster is deployed, and then create and manage this project-level, per-
location bucket (see Dataproc staging bucket).
Corresponds to the JSON property configBucket
406 407 408 |
# File 'generated/google/apis/dataproc_v1/classes.rb', line 406 def config_bucket @config_bucket end |
#encryption_config ⇒ Google::Apis::DataprocV1::EncryptionConfig
Encryption settings for the cluster.
Corresponds to the JSON property encryptionConfig
411 412 413 |
# File 'generated/google/apis/dataproc_v1/classes.rb', line 411 def encryption_config @encryption_config end |
#gce_cluster_config ⇒ Google::Apis::DataprocV1::GceClusterConfig
Common config settings for resources of Compute Engine cluster instances,
applicable to all instances in the cluster.
Corresponds to the JSON property gceClusterConfig
417 418 419 |
# File 'generated/google/apis/dataproc_v1/classes.rb', line 417 def gce_cluster_config @gce_cluster_config end |
#initialization_actions ⇒ Array<Google::Apis::DataprocV1::NodeInitializationAction>
Optional. Commands to execute on each node after config is completed. By
default, executables are run on master and all worker nodes. You can test a
node's role metadata to run an executable on a master or worker node, as shown
below using curl (you can also use wget):
ROLE=$(curl -H Metadata-Flavor:Google
http://metadata/computeMetadata/v1/instance/attributes/dataproc-role)
if [[ "$ROLE
" == 'Master' ]]; then
... master specific actions ...
else
... worker specific actions ...
fi
Corresponds to the JSON property initializationActions
432 433 434 |
# File 'generated/google/apis/dataproc_v1/classes.rb', line 432 def initialization_actions @initialization_actions end |
#lifecycle_config ⇒ Google::Apis::DataprocV1::LifecycleConfig
Specifies the cluster auto-delete schedule configuration.
Corresponds to the JSON property lifecycleConfig
437 438 439 |
# File 'generated/google/apis/dataproc_v1/classes.rb', line 437 def lifecycle_config @lifecycle_config end |
#master_config ⇒ Google::Apis::DataprocV1::InstanceGroupConfig
The config settings for Compute Engine resources in an instance group, such as
a master or worker group.
Corresponds to the JSON property masterConfig
443 444 445 |
# File 'generated/google/apis/dataproc_v1/classes.rb', line 443 def master_config @master_config end |
#secondary_worker_config ⇒ Google::Apis::DataprocV1::InstanceGroupConfig
The config settings for Compute Engine resources in an instance group, such as
a master or worker group.
Corresponds to the JSON property secondaryWorkerConfig
449 450 451 |
# File 'generated/google/apis/dataproc_v1/classes.rb', line 449 def secondary_worker_config @secondary_worker_config end |
#security_config ⇒ Google::Apis::DataprocV1::SecurityConfig
Security related configuration, including Kerberos.
Corresponds to the JSON property securityConfig
454 455 456 |
# File 'generated/google/apis/dataproc_v1/classes.rb', line 454 def security_config @security_config end |
#software_config ⇒ Google::Apis::DataprocV1::SoftwareConfig
Specifies the selection and config of software inside the cluster.
Corresponds to the JSON property softwareConfig
459 460 461 |
# File 'generated/google/apis/dataproc_v1/classes.rb', line 459 def software_config @software_config end |
#worker_config ⇒ Google::Apis::DataprocV1::InstanceGroupConfig
The config settings for Compute Engine resources in an instance group, such as
a master or worker group.
Corresponds to the JSON property workerConfig
465 466 467 |
# File 'generated/google/apis/dataproc_v1/classes.rb', line 465 def worker_config @worker_config end |
Instance Method Details
#update!(**args) ⇒ Object
Update properties of this object
472 473 474 475 476 477 478 479 480 481 482 483 484 |
# File 'generated/google/apis/dataproc_v1/classes.rb', line 472 def update!(**args) @autoscaling_config = args[:autoscaling_config] if args.key?(:autoscaling_config) @config_bucket = args[:config_bucket] if args.key?(:config_bucket) @encryption_config = args[:encryption_config] if args.key?(:encryption_config) @gce_cluster_config = args[:gce_cluster_config] if args.key?(:gce_cluster_config) @initialization_actions = args[:initialization_actions] if args.key?(:initialization_actions) @lifecycle_config = args[:lifecycle_config] if args.key?(:lifecycle_config) @master_config = args[:master_config] if args.key?(:master_config) @secondary_worker_config = args[:secondary_worker_config] if args.key?(:secondary_worker_config) @security_config = args[:security_config] if args.key?(:security_config) @software_config = args[:software_config] if args.key?(:software_config) @worker_config = args[:worker_config] if args.key?(:worker_config) end |