Class: Google::Apis::DataprocV1beta2::ClusterConfig

Inherits:
Object
  • Object
show all
Includes:
Core::Hashable, Core::JsonObjectSupport
Defined in:
generated/google/apis/dataproc_v1beta2/classes.rb,
generated/google/apis/dataproc_v1beta2/representations.rb,
generated/google/apis/dataproc_v1beta2/representations.rb

Overview

The cluster config.

Instance Attribute Summary collapse

Instance Method Summary collapse

Methods included from Core::JsonObjectSupport

#to_json

Methods included from Core::Hashable

process_value, #to_h

Constructor Details

#initialize(**args) ⇒ ClusterConfig

Returns a new instance of ClusterConfig.



481
482
483
# File 'generated/google/apis/dataproc_v1beta2/classes.rb', line 481

def initialize(**args)
   update!(**args)
end

Instance Attribute Details

#autoscaling_configGoogle::Apis::DataprocV1beta2::AutoscalingConfig

Autoscaling Policy config associated with the cluster. Corresponds to the JSON property autoscalingConfig



399
400
401
# File 'generated/google/apis/dataproc_v1beta2/classes.rb', line 399

def autoscaling_config
  @autoscaling_config
end

#config_bucketString

Optional. A Cloud Storage bucket used to stage job dependencies, config files, and job driver console output. If you do not specify a staging bucket, Cloud Dataproc will determine a Cloud Storage location (US, ASIA, or EU) for your cluster's staging bucket according to the Compute Engine zone where your cluster is deployed, and then create and manage this project-level, per- location bucket (see Dataproc staging bucket (https://cloud.google.com/ dataproc/docs/concepts/configuring-clusters/staging-bucket)). Corresponds to the JSON property configBucket

Returns:

  • (String)


410
411
412
# File 'generated/google/apis/dataproc_v1beta2/classes.rb', line 410

def config_bucket
  @config_bucket
end

#encryption_configGoogle::Apis::DataprocV1beta2::EncryptionConfig

Encryption settings for the cluster. Corresponds to the JSON property encryptionConfig



415
416
417
# File 'generated/google/apis/dataproc_v1beta2/classes.rb', line 415

def encryption_config
  @encryption_config
end

#endpoint_configGoogle::Apis::DataprocV1beta2::EndpointConfig

Endpoint config for this cluster Corresponds to the JSON property endpointConfig



420
421
422
# File 'generated/google/apis/dataproc_v1beta2/classes.rb', line 420

def endpoint_config
  @endpoint_config
end

#gce_cluster_configGoogle::Apis::DataprocV1beta2::GceClusterConfig

Common config settings for resources of Compute Engine cluster instances, applicable to all instances in the cluster. Corresponds to the JSON property gceClusterConfig



426
427
428
# File 'generated/google/apis/dataproc_v1beta2/classes.rb', line 426

def gce_cluster_config
  @gce_cluster_config
end

#gke_cluster_configGoogle::Apis::DataprocV1beta2::GkeClusterConfig

The GKE config for this cluster. Corresponds to the JSON property gkeClusterConfig



431
432
433
# File 'generated/google/apis/dataproc_v1beta2/classes.rb', line 431

def gke_cluster_config
  @gke_cluster_config
end

#initialization_actionsArray<Google::Apis::DataprocV1beta2::NodeInitializationAction>

Optional. Commands to execute on each node after config is completed. By default, executables are run on master and all worker nodes. You can test a node's role metadata to run an executable on a master or worker node, as shown below using curl (you can also use wget): ROLE=$(curl -H Metadata-Flavor:Google http://metadata/computeMetadata/v1beta2/instance/attributes/dataproc-role) if [[ "$ROLE" == 'Master' ]]; then ... master specific actions ... else ... worker specific actions ... fi Corresponds to the JSON property initializationActions



446
447
448
# File 'generated/google/apis/dataproc_v1beta2/classes.rb', line 446

def initialization_actions
  @initialization_actions
end

#lifecycle_configGoogle::Apis::DataprocV1beta2::LifecycleConfig

Specifies the cluster auto-delete schedule configuration. Corresponds to the JSON property lifecycleConfig



451
452
453
# File 'generated/google/apis/dataproc_v1beta2/classes.rb', line 451

def lifecycle_config
  @lifecycle_config
end

#master_configGoogle::Apis::DataprocV1beta2::InstanceGroupConfig

The config settings for Compute Engine resources in an instance group, such as a master or worker group. Corresponds to the JSON property masterConfig



457
458
459
# File 'generated/google/apis/dataproc_v1beta2/classes.rb', line 457

def master_config
  @master_config
end

#secondary_worker_configGoogle::Apis::DataprocV1beta2::InstanceGroupConfig

The config settings for Compute Engine resources in an instance group, such as a master or worker group. Corresponds to the JSON property secondaryWorkerConfig



463
464
465
# File 'generated/google/apis/dataproc_v1beta2/classes.rb', line 463

def secondary_worker_config
  @secondary_worker_config
end

#security_configGoogle::Apis::DataprocV1beta2::SecurityConfig

Security related configuration, including encryption, Kerberos, etc. Corresponds to the JSON property securityConfig



468
469
470
# File 'generated/google/apis/dataproc_v1beta2/classes.rb', line 468

def security_config
  @security_config
end

#software_configGoogle::Apis::DataprocV1beta2::SoftwareConfig

Specifies the selection and config of software inside the cluster. Corresponds to the JSON property softwareConfig



473
474
475
# File 'generated/google/apis/dataproc_v1beta2/classes.rb', line 473

def software_config
  @software_config
end

#worker_configGoogle::Apis::DataprocV1beta2::InstanceGroupConfig

The config settings for Compute Engine resources in an instance group, such as a master or worker group. Corresponds to the JSON property workerConfig



479
480
481
# File 'generated/google/apis/dataproc_v1beta2/classes.rb', line 479

def worker_config
  @worker_config
end

Instance Method Details

#update!(**args) ⇒ Object

Update properties of this object



486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
# File 'generated/google/apis/dataproc_v1beta2/classes.rb', line 486

def update!(**args)
  @autoscaling_config = args[:autoscaling_config] if args.key?(:autoscaling_config)
  @config_bucket = args[:config_bucket] if args.key?(:config_bucket)
  @encryption_config = args[:encryption_config] if args.key?(:encryption_config)
  @endpoint_config = args[:endpoint_config] if args.key?(:endpoint_config)
  @gce_cluster_config = args[:gce_cluster_config] if args.key?(:gce_cluster_config)
  @gke_cluster_config = args[:gke_cluster_config] if args.key?(:gke_cluster_config)
  @initialization_actions = args[:initialization_actions] if args.key?(:initialization_actions)
  @lifecycle_config = args[:lifecycle_config] if args.key?(:lifecycle_config)
  @master_config = args[:master_config] if args.key?(:master_config)
  @secondary_worker_config = args[:secondary_worker_config] if args.key?(:secondary_worker_config)
  @security_config = args[:security_config] if args.key?(:security_config)
  @software_config = args[:software_config] if args.key?(:software_config)
  @worker_config = args[:worker_config] if args.key?(:worker_config)
end