Class: Google::Apis::DataprocV1beta2::ClusterConfig

Inherits:
Object
  • Object
show all
Includes:
Core::Hashable, Core::JsonObjectSupport
Defined in:
generated/google/apis/dataproc_v1beta2/classes.rb,
generated/google/apis/dataproc_v1beta2/representations.rb,
generated/google/apis/dataproc_v1beta2/representations.rb

Overview

The cluster config.

Instance Attribute Summary collapse

Instance Method Summary collapse

Methods included from Core::JsonObjectSupport

#to_json

Methods included from Core::Hashable

process_value, #to_h

Constructor Details

#initialize(**args) ⇒ ClusterConfig

Returns a new instance of ClusterConfig



202
203
204
# File 'generated/google/apis/dataproc_v1beta2/classes.rb', line 202

def initialize(**args)
   update!(**args)
end

Instance Attribute Details

#config_bucketString

Optional. A Google Cloud Storage staging bucket used for sharing generated SSH keys and config. If you do not specify a staging bucket, Cloud Dataproc will determine an appropriate Cloud Storage location (US, ASIA, or EU) for your cluster's staging bucket according to the Google Compute Engine zone where your cluster is deployed, and then it will create and manage this project- level, per-location bucket for you. Corresponds to the JSON property configBucket

Returns:

  • (String)


151
152
153
# File 'generated/google/apis/dataproc_v1beta2/classes.rb', line 151

def config_bucket
  @config_bucket
end

#gce_cluster_configGoogle::Apis::DataprocV1beta2::GceClusterConfig

Common config settings for resources of Google Compute Engine cluster instances, applicable to all instances in the cluster. Corresponds to the JSON property gceClusterConfig



157
158
159
# File 'generated/google/apis/dataproc_v1beta2/classes.rb', line 157

def gce_cluster_config
  @gce_cluster_config
end

#initialization_actionsArray<Google::Apis::DataprocV1beta2::NodeInitializationAction>

Optional. Commands to execute on each node after config is completed. By default, executables are run on master and all worker nodes. You can test a node's role metadata to run an executable on a master or worker node, as shown below using curl (you can also use wget): ROLE=$(curl -H Metadata-Flavor:Google http://metadata/computeMetadata/v1beta2/ instance/attributes/dataproc-role) if [[ "$ROLE" == 'Master' ]]; then ... master specific actions ... else ... worker specific actions ... fi Corresponds to the JSON property initializationActions



172
173
174
# File 'generated/google/apis/dataproc_v1beta2/classes.rb', line 172

def initialization_actions
  @initialization_actions
end

#lifecycle_configGoogle::Apis::DataprocV1beta2::LifecycleConfig

Specifies the cluster auto delete related schedule configuration. Corresponds to the JSON property lifecycleConfig



177
178
179
# File 'generated/google/apis/dataproc_v1beta2/classes.rb', line 177

def lifecycle_config
  @lifecycle_config
end

#master_configGoogle::Apis::DataprocV1beta2::InstanceGroupConfig

Optional. The config settings for Google Compute Engine resources in an instance group, such as a master or worker group. Corresponds to the JSON property masterConfig



183
184
185
# File 'generated/google/apis/dataproc_v1beta2/classes.rb', line 183

def master_config
  @master_config
end

#secondary_worker_configGoogle::Apis::DataprocV1beta2::InstanceGroupConfig

Optional. The config settings for Google Compute Engine resources in an instance group, such as a master or worker group. Corresponds to the JSON property secondaryWorkerConfig



189
190
191
# File 'generated/google/apis/dataproc_v1beta2/classes.rb', line 189

def secondary_worker_config
  @secondary_worker_config
end

#software_configGoogle::Apis::DataprocV1beta2::SoftwareConfig

Specifies the selection and config of software inside the cluster. Corresponds to the JSON property softwareConfig



194
195
196
# File 'generated/google/apis/dataproc_v1beta2/classes.rb', line 194

def software_config
  @software_config
end

#worker_configGoogle::Apis::DataprocV1beta2::InstanceGroupConfig

Optional. The config settings for Google Compute Engine resources in an instance group, such as a master or worker group. Corresponds to the JSON property workerConfig



200
201
202
# File 'generated/google/apis/dataproc_v1beta2/classes.rb', line 200

def worker_config
  @worker_config
end

Instance Method Details

#update!(**args) ⇒ Object

Update properties of this object



207
208
209
210
211
212
213
214
215
216
# File 'generated/google/apis/dataproc_v1beta2/classes.rb', line 207

def update!(**args)
  @config_bucket = args[:config_bucket] if args.key?(:config_bucket)
  @gce_cluster_config = args[:gce_cluster_config] if args.key?(:gce_cluster_config)
  @initialization_actions = args[:initialization_actions] if args.key?(:initialization_actions)
  @lifecycle_config = args[:lifecycle_config] if args.key?(:lifecycle_config)
  @master_config = args[:master_config] if args.key?(:master_config)
  @secondary_worker_config = args[:secondary_worker_config] if args.key?(:secondary_worker_config)
  @software_config = args[:software_config] if args.key?(:software_config)
  @worker_config = args[:worker_config] if args.key?(:worker_config)
end