Class: Google::Apis::DataprocV1beta2::ClusterConfig
- Inherits:
-
Object
- Object
- Google::Apis::DataprocV1beta2::ClusterConfig
- Includes:
- Core::Hashable, Core::JsonObjectSupport
- Defined in:
- generated/google/apis/dataproc_v1beta2/classes.rb,
generated/google/apis/dataproc_v1beta2/representations.rb,
generated/google/apis/dataproc_v1beta2/representations.rb
Overview
The cluster config.
Instance Attribute Summary collapse
-
#config_bucket ⇒ String
Optional.
-
#gce_cluster_config ⇒ Google::Apis::DataprocV1beta2::GceClusterConfig
Common config settings for resources of Compute Engine cluster instances, applicable to all instances in the cluster.
-
#initialization_actions ⇒ Array<Google::Apis::DataprocV1beta2::NodeInitializationAction>
Optional.
-
#lifecycle_config ⇒ Google::Apis::DataprocV1beta2::LifecycleConfig
Specifies the cluster auto delete related schedule configuration.
-
#master_config ⇒ Google::Apis::DataprocV1beta2::InstanceGroupConfig
Optional.
-
#secondary_worker_config ⇒ Google::Apis::DataprocV1beta2::InstanceGroupConfig
Optional.
-
#software_config ⇒ Google::Apis::DataprocV1beta2::SoftwareConfig
Specifies the selection and config of software inside the cluster.
-
#worker_config ⇒ Google::Apis::DataprocV1beta2::InstanceGroupConfig
Optional.
Instance Method Summary collapse
-
#initialize(**args) ⇒ ClusterConfig
constructor
A new instance of ClusterConfig.
-
#update!(**args) ⇒ Object
Update properties of this object.
Methods included from Core::JsonObjectSupport
Methods included from Core::Hashable
Constructor Details
#initialize(**args) ⇒ ClusterConfig
Returns a new instance of ClusterConfig
243 244 245 |
# File 'generated/google/apis/dataproc_v1beta2/classes.rb', line 243 def initialize(**args) update!(**args) end |
Instance Attribute Details
#config_bucket ⇒ String
Optional. A Cloud Storage staging bucket used for sharing generated SSH keys
and config. If you do not specify a staging bucket, Cloud Dataproc will
determine an appropriate Cloud Storage location (US, ASIA, or EU) for your
cluster's staging bucket according to the Google Compute Engine zone where
your cluster is deployed, and then it will create and manage this project-
level, per-location bucket for you.
Corresponds to the JSON property configBucket
192 193 194 |
# File 'generated/google/apis/dataproc_v1beta2/classes.rb', line 192 def config_bucket @config_bucket end |
#gce_cluster_config ⇒ Google::Apis::DataprocV1beta2::GceClusterConfig
Common config settings for resources of Compute Engine cluster instances,
applicable to all instances in the cluster.
Corresponds to the JSON property gceClusterConfig
198 199 200 |
# File 'generated/google/apis/dataproc_v1beta2/classes.rb', line 198 def gce_cluster_config @gce_cluster_config end |
#initialization_actions ⇒ Array<Google::Apis::DataprocV1beta2::NodeInitializationAction>
Optional. Commands to execute on each node after config is completed. By
default, executables are run on master and all worker nodes. You can test a
node's role
metadata to run an executable on a master or worker
node, as shown below using curl (you can also use wget):
ROLE=$(curl -H Metadata-Flavor:Google http://metadata/computeMetadata/v1beta2/
instance/attributes/dataproc-role)
if [[ "$ROLE
" == 'Master' ]]; then
... master specific actions ...
else
... worker specific actions ...
fi
Corresponds to the JSON property initializationActions
213 214 215 |
# File 'generated/google/apis/dataproc_v1beta2/classes.rb', line 213 def initialization_actions @initialization_actions end |
#lifecycle_config ⇒ Google::Apis::DataprocV1beta2::LifecycleConfig
Specifies the cluster auto delete related schedule configuration.
Corresponds to the JSON property lifecycleConfig
218 219 220 |
# File 'generated/google/apis/dataproc_v1beta2/classes.rb', line 218 def lifecycle_config @lifecycle_config end |
#master_config ⇒ Google::Apis::DataprocV1beta2::InstanceGroupConfig
Optional. The config settings for Compute Engine resources in an instance
group, such as a master or worker group.
Corresponds to the JSON property masterConfig
224 225 226 |
# File 'generated/google/apis/dataproc_v1beta2/classes.rb', line 224 def master_config @master_config end |
#secondary_worker_config ⇒ Google::Apis::DataprocV1beta2::InstanceGroupConfig
Optional. The config settings for Compute Engine resources in an instance
group, such as a master or worker group.
Corresponds to the JSON property secondaryWorkerConfig
230 231 232 |
# File 'generated/google/apis/dataproc_v1beta2/classes.rb', line 230 def secondary_worker_config @secondary_worker_config end |
#software_config ⇒ Google::Apis::DataprocV1beta2::SoftwareConfig
Specifies the selection and config of software inside the cluster.
Corresponds to the JSON property softwareConfig
235 236 237 |
# File 'generated/google/apis/dataproc_v1beta2/classes.rb', line 235 def software_config @software_config end |
#worker_config ⇒ Google::Apis::DataprocV1beta2::InstanceGroupConfig
Optional. The config settings for Compute Engine resources in an instance
group, such as a master or worker group.
Corresponds to the JSON property workerConfig
241 242 243 |
# File 'generated/google/apis/dataproc_v1beta2/classes.rb', line 241 def worker_config @worker_config end |
Instance Method Details
#update!(**args) ⇒ Object
Update properties of this object
248 249 250 251 252 253 254 255 256 257 |
# File 'generated/google/apis/dataproc_v1beta2/classes.rb', line 248 def update!(**args) @config_bucket = args[:config_bucket] if args.key?(:config_bucket) @gce_cluster_config = args[:gce_cluster_config] if args.key?(:gce_cluster_config) @initialization_actions = args[:initialization_actions] if args.key?(:initialization_actions) @lifecycle_config = args[:lifecycle_config] if args.key?(:lifecycle_config) @master_config = args[:master_config] if args.key?(:master_config) @secondary_worker_config = args[:secondary_worker_config] if args.key?(:secondary_worker_config) @software_config = args[:software_config] if args.key?(:software_config) @worker_config = args[:worker_config] if args.key?(:worker_config) end |