Class: Google::Apis::DataprocV1beta2::ClusterConfig
- Inherits:
-
Object
- Object
- Google::Apis::DataprocV1beta2::ClusterConfig
- Includes:
- Core::Hashable, Core::JsonObjectSupport
- Defined in:
- generated/google/apis/dataproc_v1beta2/classes.rb,
generated/google/apis/dataproc_v1beta2/representations.rb,
generated/google/apis/dataproc_v1beta2/representations.rb
Overview
The cluster config.
Instance Attribute Summary collapse
-
#config_bucket ⇒ String
Optional.
-
#gce_cluster_config ⇒ Google::Apis::DataprocV1beta2::GceClusterConfig
Common config settings for resources of Compute Engine cluster instances, applicable to all instances in the cluster.
-
#initialization_actions ⇒ Array<Google::Apis::DataprocV1beta2::NodeInitializationAction>
Optional.
-
#lifecycle_config ⇒ Google::Apis::DataprocV1beta2::LifecycleConfig
Specifies the cluster auto delete related schedule configuration.
-
#master_config ⇒ Google::Apis::DataprocV1beta2::InstanceGroupConfig
Optional.
-
#secondary_worker_config ⇒ Google::Apis::DataprocV1beta2::InstanceGroupConfig
Optional.
-
#software_config ⇒ Google::Apis::DataprocV1beta2::SoftwareConfig
Specifies the selection and config of software inside the cluster.
-
#worker_config ⇒ Google::Apis::DataprocV1beta2::InstanceGroupConfig
Optional.
Instance Method Summary collapse
-
#initialize(**args) ⇒ ClusterConfig
constructor
A new instance of ClusterConfig.
-
#update!(**args) ⇒ Object
Update properties of this object.
Methods included from Core::JsonObjectSupport
Methods included from Core::Hashable
Constructor Details
#initialize(**args) ⇒ ClusterConfig
Returns a new instance of ClusterConfig
241 242 243 |
# File 'generated/google/apis/dataproc_v1beta2/classes.rb', line 241 def initialize(**args) update!(**args) end |
Instance Attribute Details
#config_bucket ⇒ String
Optional. A Cloud Storage staging bucket used for sharing generated SSH keys
and config. If you do not specify a staging bucket, Cloud Dataproc will
determine an appropriate Cloud Storage location (US, ASIA, or EU) for your
cluster's staging bucket according to the Google Compute Engine zone where
your cluster is deployed, and then it will create and manage this project-
level, per-location bucket for you.
Corresponds to the JSON property configBucket
190 191 192 |
# File 'generated/google/apis/dataproc_v1beta2/classes.rb', line 190 def config_bucket @config_bucket end |
#gce_cluster_config ⇒ Google::Apis::DataprocV1beta2::GceClusterConfig
Common config settings for resources of Compute Engine cluster instances,
applicable to all instances in the cluster.
Corresponds to the JSON property gceClusterConfig
196 197 198 |
# File 'generated/google/apis/dataproc_v1beta2/classes.rb', line 196 def gce_cluster_config @gce_cluster_config end |
#initialization_actions ⇒ Array<Google::Apis::DataprocV1beta2::NodeInitializationAction>
Optional. Commands to execute on each node after config is completed. By
default, executables are run on master and all worker nodes. You can test a
node's role
metadata to run an executable on a master or worker
node, as shown below using curl (you can also use wget):
ROLE=$(curl -H Metadata-Flavor:Google http://metadata/computeMetadata/v1beta2/
instance/attributes/dataproc-role)
if [[ "$ROLE
" == 'Master' ]]; then
... master specific actions ...
else
... worker specific actions ...
fi
Corresponds to the JSON property initializationActions
211 212 213 |
# File 'generated/google/apis/dataproc_v1beta2/classes.rb', line 211 def initialization_actions @initialization_actions end |
#lifecycle_config ⇒ Google::Apis::DataprocV1beta2::LifecycleConfig
Specifies the cluster auto delete related schedule configuration.
Corresponds to the JSON property lifecycleConfig
216 217 218 |
# File 'generated/google/apis/dataproc_v1beta2/classes.rb', line 216 def lifecycle_config @lifecycle_config end |
#master_config ⇒ Google::Apis::DataprocV1beta2::InstanceGroupConfig
Optional. The config settings for Compute Engine resources in an instance
group, such as a master or worker group.
Corresponds to the JSON property masterConfig
222 223 224 |
# File 'generated/google/apis/dataproc_v1beta2/classes.rb', line 222 def master_config @master_config end |
#secondary_worker_config ⇒ Google::Apis::DataprocV1beta2::InstanceGroupConfig
Optional. The config settings for Compute Engine resources in an instance
group, such as a master or worker group.
Corresponds to the JSON property secondaryWorkerConfig
228 229 230 |
# File 'generated/google/apis/dataproc_v1beta2/classes.rb', line 228 def secondary_worker_config @secondary_worker_config end |
#software_config ⇒ Google::Apis::DataprocV1beta2::SoftwareConfig
Specifies the selection and config of software inside the cluster.
Corresponds to the JSON property softwareConfig
233 234 235 |
# File 'generated/google/apis/dataproc_v1beta2/classes.rb', line 233 def software_config @software_config end |
#worker_config ⇒ Google::Apis::DataprocV1beta2::InstanceGroupConfig
Optional. The config settings for Compute Engine resources in an instance
group, such as a master or worker group.
Corresponds to the JSON property workerConfig
239 240 241 |
# File 'generated/google/apis/dataproc_v1beta2/classes.rb', line 239 def worker_config @worker_config end |
Instance Method Details
#update!(**args) ⇒ Object
Update properties of this object
246 247 248 249 250 251 252 253 254 255 |
# File 'generated/google/apis/dataproc_v1beta2/classes.rb', line 246 def update!(**args) @config_bucket = args[:config_bucket] if args.key?(:config_bucket) @gce_cluster_config = args[:gce_cluster_config] if args.key?(:gce_cluster_config) @initialization_actions = args[:initialization_actions] if args.key?(:initialization_actions) @lifecycle_config = args[:lifecycle_config] if args.key?(:lifecycle_config) @master_config = args[:master_config] if args.key?(:master_config) @secondary_worker_config = args[:secondary_worker_config] if args.key?(:secondary_worker_config) @software_config = args[:software_config] if args.key?(:software_config) @worker_config = args[:worker_config] if args.key?(:worker_config) end |