Class: Google::Apis::DataprocV1beta2::ClusterConfig

Inherits:
Object
  • Object
show all
Includes:
Core::Hashable, Core::JsonObjectSupport
Defined in:
generated/google/apis/dataproc_v1beta2/classes.rb,
generated/google/apis/dataproc_v1beta2/representations.rb,
generated/google/apis/dataproc_v1beta2/representations.rb

Overview

The cluster config.

Instance Attribute Summary collapse

Instance Method Summary collapse

Methods included from Core::JsonObjectSupport

#to_json

Methods included from Core::Hashable

process_value, #to_h

Constructor Details

#initialize(**args) ⇒ ClusterConfig

Returns a new instance of ClusterConfig



439
440
441
 
# File 'generated/google/apis/dataproc_v1beta2/classes.rb', line 439

def initialize(**args)
   update!(**args)
end

Instance Attribute Details

#autoscaling_config ⇒ Google::Apis::DataprocV1beta2::AutoscalingConfig

Autoscaling Policy config associated with the cluster. Corresponds to the JSON property autoscalingConfig

Returns:



363
364
365
 
# File 'generated/google/apis/dataproc_v1beta2/classes.rb', line 363

def autoscaling_config
  @autoscaling_config
end

#config_bucket ⇒ String

Optional. A Google Cloud Storage bucket used to stage job dependencies, config files, and job driver console output. If you do not specify a staging bucket, Cloud Dataproc will determine a Cloud Storage location (US, ASIA, or EU) for your cluster's staging bucket according to the Google Compute Engine zone where your cluster is deployed, and then create and manage this project-level, per-location bucket (see Cloud Dataproc staging bucket). Corresponds to the JSON property configBucket

Returns:

  • (String) 


373
374
375
 
# File 'generated/google/apis/dataproc_v1beta2/classes.rb', line 373

def config_bucket
  @config_bucket
end

#encryption_config ⇒ Google::Apis::DataprocV1beta2::EncryptionConfig

Encryption settings for the cluster. Corresponds to the JSON property encryptionConfig

Returns:



378
379
380
 
# File 'generated/google/apis/dataproc_v1beta2/classes.rb', line 378

def encryption_config
  @encryption_config
end

#endpoint_config ⇒ Google::Apis::DataprocV1beta2::EndpointConfig

Endpoint config for this cluster Corresponds to the JSON property endpointConfig

Returns:



383
384
385
 
# File 'generated/google/apis/dataproc_v1beta2/classes.rb', line 383

def endpoint_config
  @endpoint_config
end

#gce_cluster_config ⇒ Google::Apis::DataprocV1beta2::GceClusterConfig

Common config settings for resources of Compute Engine cluster instances, applicable to all instances in the cluster. Corresponds to the JSON property gceClusterConfig

Returns:



389
390
391
 
# File 'generated/google/apis/dataproc_v1beta2/classes.rb', line 389

def gce_cluster_config
  @gce_cluster_config
end

#initialization_actions ⇒ Array<Google::Apis::DataprocV1beta2::NodeInitializationAction>

Optional. Commands to execute on each node after config is completed. By default, executables are run on master and all worker nodes. You can test a node's role metadata to run an executable on a master or worker node, as shown below using curl (you can also use wget): ROLE=$(curl -H Metadata-Flavor:Google http://metadata/computeMetadata/v1beta2/instance/attributes/dataproc-role) if [[ "$ROLE" == 'Master' ]]; then ... master specific actions ... else ... worker specific actions ... fi Corresponds to the JSON property initializationActions

Returns:



404
405
406
 
# File 'generated/google/apis/dataproc_v1beta2/classes.rb', line 404

def initialization_actions
  @initialization_actions
end

#lifecycle_config ⇒ Google::Apis::DataprocV1beta2::LifecycleConfig

Specifies the cluster auto-delete schedule configuration. Corresponds to the JSON property lifecycleConfig

Returns:



409
410
411
 
# File 'generated/google/apis/dataproc_v1beta2/classes.rb', line 409

def lifecycle_config
  @lifecycle_config
end

#master_config ⇒ Google::Apis::DataprocV1beta2::InstanceGroupConfig

Optional. The config settings for Compute Engine resources in an instance group, such as a master or worker group. Corresponds to the JSON property masterConfig

Returns:



415
416
417
 
# File 'generated/google/apis/dataproc_v1beta2/classes.rb', line 415

def master_config
  @master_config
end

#secondary_worker_config ⇒ Google::Apis::DataprocV1beta2::InstanceGroupConfig

Optional. The config settings for Compute Engine resources in an instance group, such as a master or worker group. Corresponds to the JSON property secondaryWorkerConfig

Returns:



421
422
423
 
# File 'generated/google/apis/dataproc_v1beta2/classes.rb', line 421

def secondary_worker_config
  @secondary_worker_config
end

#security_config ⇒ Google::Apis::DataprocV1beta2::SecurityConfig

Security related configuration, including encryption, Kerberos, etc. Corresponds to the JSON property securityConfig

Returns:



426
427
428
 
# File 'generated/google/apis/dataproc_v1beta2/classes.rb', line 426

def security_config
  @security_config
end

#software_config ⇒ Google::Apis::DataprocV1beta2::SoftwareConfig

Specifies the selection and config of software inside the cluster. Corresponds to the JSON property softwareConfig

Returns:



431
432
433
 
# File 'generated/google/apis/dataproc_v1beta2/classes.rb', line 431

def software_config
  @software_config
end

#worker_config ⇒ Google::Apis::DataprocV1beta2::InstanceGroupConfig

Optional. The config settings for Compute Engine resources in an instance group, such as a master or worker group. Corresponds to the JSON property workerConfig

Returns:



437
438
439
 
# File 'generated/google/apis/dataproc_v1beta2/classes.rb', line 437

def worker_config
  @worker_config
end

Instance Method Details

#update!(**args) ⇒ Object

Update properties of this object



444
445
446
447
448
449
450
451
452
453
454
455
456
457
 
# File 'generated/google/apis/dataproc_v1beta2/classes.rb', line 444

def update!(**args)
  @autoscaling_config = args[:autoscaling_config] if args.key?(:autoscaling_config)
  @config_bucket = args[:config_bucket] if args.key?(:config_bucket)
  @encryption_config = args[:encryption_config] if args.key?(:encryption_config)
  @endpoint_config = args[:endpoint_config] if args.key?(:endpoint_config)
  @gce_cluster_config = args[:gce_cluster_config] if args.key?(:gce_cluster_config)
  @initialization_actions = args[:initialization_actions] if args.key?(:initialization_actions)
  @lifecycle_config = args[:lifecycle_config] if args.key?(:lifecycle_config)
  @master_config = args[:master_config] if args.key?(:master_config)
  @secondary_worker_config = args[:secondary_worker_config] if args.key?(:secondary_worker_config)
  @security_config = args[:security_config] if args.key?(:security_config)
  @software_config = args[:software_config] if args.key?(:software_config)
  @worker_config = args[:worker_config] if args.key?(:worker_config)
end