Class: Google::Apis::DataprocV1::ClusterConfig
- Inherits:
-
Object
- Object
- Google::Apis::DataprocV1::ClusterConfig
- Includes:
- Core::Hashable, Core::JsonObjectSupport
- Defined in:
- generated/google/apis/dataproc_v1/classes.rb,
generated/google/apis/dataproc_v1/representations.rb,
generated/google/apis/dataproc_v1/representations.rb
Overview
The cluster config.
Instance Attribute Summary collapse
-
#config_bucket ⇒ String
Optional.
-
#gce_cluster_config ⇒ Google::Apis::DataprocV1::GceClusterConfig
Common config settings for resources of Compute Engine cluster instances, applicable to all instances in the cluster.
-
#initialization_actions ⇒ Array<Google::Apis::DataprocV1::NodeInitializationAction>
Optional.
-
#master_config ⇒ Google::Apis::DataprocV1::InstanceGroupConfig
Optional.
-
#secondary_worker_config ⇒ Google::Apis::DataprocV1::InstanceGroupConfig
Optional.
-
#software_config ⇒ Google::Apis::DataprocV1::SoftwareConfig
Specifies the selection and config of software inside the cluster.
-
#worker_config ⇒ Google::Apis::DataprocV1::InstanceGroupConfig
Optional.
Instance Method Summary collapse
-
#initialize(**args) ⇒ ClusterConfig
constructor
A new instance of ClusterConfig.
-
#update!(**args) ⇒ Object
Update properties of this object.
Methods included from Core::JsonObjectSupport
Methods included from Core::Hashable
Constructor Details
#initialize(**args) ⇒ ClusterConfig
Returns a new instance of ClusterConfig
199 200 201 |
# File 'generated/google/apis/dataproc_v1/classes.rb', line 199 def initialize(**args) update!(**args) end |
Instance Attribute Details
#config_bucket ⇒ String
Optional. A Cloud Storage staging bucket used for sharing generated SSH keys
and config. If you do not specify a staging bucket, Cloud Dataproc will
determine an appropriate Cloud Storage location (US, ASIA, or EU) for your
cluster's staging bucket according to the Google Compute Engine zone where
your cluster is deployed, and then it will create and manage this project-
level, per-location bucket for you.
Corresponds to the JSON property configBucket
153 154 155 |
# File 'generated/google/apis/dataproc_v1/classes.rb', line 153 def config_bucket @config_bucket end |
#gce_cluster_config ⇒ Google::Apis::DataprocV1::GceClusterConfig
Common config settings for resources of Compute Engine cluster instances,
applicable to all instances in the cluster.
Corresponds to the JSON property gceClusterConfig
159 160 161 |
# File 'generated/google/apis/dataproc_v1/classes.rb', line 159 def gce_cluster_config @gce_cluster_config end |
#initialization_actions ⇒ Array<Google::Apis::DataprocV1::NodeInitializationAction>
Optional. Commands to execute on each node after config is completed. By
default, executables are run on master and all worker nodes. You can test a
node's role metadata to run an executable on a master or worker node, as shown
below using curl (you can also use wget):
ROLE=$(curl -H Metadata-Flavor:Google http://metadata/computeMetadata/v1/
instance/attributes/dataproc-role)
if [[ "$ROLE
" == 'Master' ]]; then
... master specific actions ...
else
... worker specific actions ...
fi
Corresponds to the JSON property initializationActions
174 175 176 |
# File 'generated/google/apis/dataproc_v1/classes.rb', line 174 def initialization_actions @initialization_actions end |
#master_config ⇒ Google::Apis::DataprocV1::InstanceGroupConfig
Optional. The config settings for Compute Engine resources in an instance
group, such as a master or worker group.
Corresponds to the JSON property masterConfig
180 181 182 |
# File 'generated/google/apis/dataproc_v1/classes.rb', line 180 def master_config @master_config end |
#secondary_worker_config ⇒ Google::Apis::DataprocV1::InstanceGroupConfig
Optional. The config settings for Compute Engine resources in an instance
group, such as a master or worker group.
Corresponds to the JSON property secondaryWorkerConfig
186 187 188 |
# File 'generated/google/apis/dataproc_v1/classes.rb', line 186 def secondary_worker_config @secondary_worker_config end |
#software_config ⇒ Google::Apis::DataprocV1::SoftwareConfig
Specifies the selection and config of software inside the cluster.
Corresponds to the JSON property softwareConfig
191 192 193 |
# File 'generated/google/apis/dataproc_v1/classes.rb', line 191 def software_config @software_config end |
#worker_config ⇒ Google::Apis::DataprocV1::InstanceGroupConfig
Optional. The config settings for Compute Engine resources in an instance
group, such as a master or worker group.
Corresponds to the JSON property workerConfig
197 198 199 |
# File 'generated/google/apis/dataproc_v1/classes.rb', line 197 def worker_config @worker_config end |
Instance Method Details
#update!(**args) ⇒ Object
Update properties of this object
204 205 206 207 208 209 210 211 212 |
# File 'generated/google/apis/dataproc_v1/classes.rb', line 204 def update!(**args) @config_bucket = args[:config_bucket] if args.key?(:config_bucket) @gce_cluster_config = args[:gce_cluster_config] if args.key?(:gce_cluster_config) @initialization_actions = args[:initialization_actions] if args.key?(:initialization_actions) @master_config = args[:master_config] if args.key?(:master_config) @secondary_worker_config = args[:secondary_worker_config] if args.key?(:secondary_worker_config) @software_config = args[:software_config] if args.key?(:software_config) @worker_config = args[:worker_config] if args.key?(:worker_config) end |