Class: Google::Apis::DataprocV1::ClusterConfig
- Inherits:
-
Object
- Object
- Google::Apis::DataprocV1::ClusterConfig
- Includes:
- Core::Hashable, Core::JsonObjectSupport
- Defined in:
- generated/google/apis/dataproc_v1/classes.rb,
generated/google/apis/dataproc_v1/representations.rb,
generated/google/apis/dataproc_v1/representations.rb
Overview
The cluster config.
Instance Attribute Summary collapse
-
#config_bucket ⇒ String
Optional.
-
#encryption_config ⇒ Google::Apis::DataprocV1::EncryptionConfig
Encryption settings for the cluster.
-
#gce_cluster_config ⇒ Google::Apis::DataprocV1::GceClusterConfig
Common config settings for resources of Compute Engine cluster instances, applicable to all instances in the cluster.
-
#initialization_actions ⇒ Array<Google::Apis::DataprocV1::NodeInitializationAction>
Optional.
-
#lifecycle_config ⇒ Google::Apis::DataprocV1::LifecycleConfig
Specifies the cluster auto-delete schedule configuration.
-
#master_config ⇒ Google::Apis::DataprocV1::InstanceGroupConfig
Optional.
-
#secondary_worker_config ⇒ Google::Apis::DataprocV1::InstanceGroupConfig
Optional.
-
#security_config ⇒ Google::Apis::DataprocV1::SecurityConfig
Security related configuration, including Kerberos.
-
#software_config ⇒ Google::Apis::DataprocV1::SoftwareConfig
Specifies the selection and config of software inside the cluster.
-
#worker_config ⇒ Google::Apis::DataprocV1::InstanceGroupConfig
Optional.
Instance Method Summary collapse
-
#initialize(**args) ⇒ ClusterConfig
constructor
A new instance of ClusterConfig.
-
#update!(**args) ⇒ Object
Update properties of this object.
Methods included from Core::JsonObjectSupport
Methods included from Core::Hashable
Constructor Details
#initialize(**args) ⇒ ClusterConfig
Returns a new instance of ClusterConfig
262 263 264 |
# File 'generated/google/apis/dataproc_v1/classes.rb', line 262 def initialize(**args) update!(**args) end |
Instance Attribute Details
#config_bucket ⇒ String
Optional. A Google Cloud Storage bucket used to stage job dependencies, config
files, and job driver console output. If you do not specify a staging bucket,
Cloud Dataproc will determine a Cloud Storage location (US, ASIA, or EU) for
your cluster's staging bucket according to the Google Compute Engine zone
where your cluster is deployed, and then create and manage this project-level,
per-location bucket (see Cloud Dataproc staging bucket).
Corresponds to the JSON property configBucket
201 202 203 |
# File 'generated/google/apis/dataproc_v1/classes.rb', line 201 def config_bucket @config_bucket end |
#encryption_config ⇒ Google::Apis::DataprocV1::EncryptionConfig
Encryption settings for the cluster.
Corresponds to the JSON property encryptionConfig
206 207 208 |
# File 'generated/google/apis/dataproc_v1/classes.rb', line 206 def encryption_config @encryption_config end |
#gce_cluster_config ⇒ Google::Apis::DataprocV1::GceClusterConfig
Common config settings for resources of Compute Engine cluster instances,
applicable to all instances in the cluster.
Corresponds to the JSON property gceClusterConfig
212 213 214 |
# File 'generated/google/apis/dataproc_v1/classes.rb', line 212 def gce_cluster_config @gce_cluster_config end |
#initialization_actions ⇒ Array<Google::Apis::DataprocV1::NodeInitializationAction>
Optional. Commands to execute on each node after config is completed. By
default, executables are run on master and all worker nodes. You can test a
node's role metadata to run an executable on a master or worker node, as shown
below using curl (you can also use wget):
ROLE=$(curl -H Metadata-Flavor:Google
http://metadata/computeMetadata/v1/instance/attributes/dataproc-role)
if [[ "$ROLE
" == 'Master' ]]; then
... master specific actions ...
else
... worker specific actions ...
fi
Corresponds to the JSON property initializationActions
227 228 229 |
# File 'generated/google/apis/dataproc_v1/classes.rb', line 227 def initialization_actions @initialization_actions end |
#lifecycle_config ⇒ Google::Apis::DataprocV1::LifecycleConfig
Specifies the cluster auto-delete schedule configuration.
Corresponds to the JSON property lifecycleConfig
232 233 234 |
# File 'generated/google/apis/dataproc_v1/classes.rb', line 232 def lifecycle_config @lifecycle_config end |
#master_config ⇒ Google::Apis::DataprocV1::InstanceGroupConfig
Optional. The config settings for Compute Engine resources in an instance
group, such as a master or worker group.
Corresponds to the JSON property masterConfig
238 239 240 |
# File 'generated/google/apis/dataproc_v1/classes.rb', line 238 def master_config @master_config end |
#secondary_worker_config ⇒ Google::Apis::DataprocV1::InstanceGroupConfig
Optional. The config settings for Compute Engine resources in an instance
group, such as a master or worker group.
Corresponds to the JSON property secondaryWorkerConfig
244 245 246 |
# File 'generated/google/apis/dataproc_v1/classes.rb', line 244 def secondary_worker_config @secondary_worker_config end |
#security_config ⇒ Google::Apis::DataprocV1::SecurityConfig
Security related configuration, including Kerberos.
Corresponds to the JSON property securityConfig
249 250 251 |
# File 'generated/google/apis/dataproc_v1/classes.rb', line 249 def security_config @security_config end |
#software_config ⇒ Google::Apis::DataprocV1::SoftwareConfig
Specifies the selection and config of software inside the cluster.
Corresponds to the JSON property softwareConfig
254 255 256 |
# File 'generated/google/apis/dataproc_v1/classes.rb', line 254 def software_config @software_config end |
#worker_config ⇒ Google::Apis::DataprocV1::InstanceGroupConfig
Optional. The config settings for Compute Engine resources in an instance
group, such as a master or worker group.
Corresponds to the JSON property workerConfig
260 261 262 |
# File 'generated/google/apis/dataproc_v1/classes.rb', line 260 def worker_config @worker_config end |
Instance Method Details
#update!(**args) ⇒ Object
Update properties of this object
267 268 269 270 271 272 273 274 275 276 277 278 |
# File 'generated/google/apis/dataproc_v1/classes.rb', line 267 def update!(**args) @config_bucket = args[:config_bucket] if args.key?(:config_bucket) @encryption_config = args[:encryption_config] if args.key?(:encryption_config) @gce_cluster_config = args[:gce_cluster_config] if args.key?(:gce_cluster_config) @initialization_actions = args[:initialization_actions] if args.key?(:initialization_actions) @lifecycle_config = args[:lifecycle_config] if args.key?(:lifecycle_config) @master_config = args[:master_config] if args.key?(:master_config) @secondary_worker_config = args[:secondary_worker_config] if args.key?(:secondary_worker_config) @security_config = args[:security_config] if args.key?(:security_config) @software_config = args[:software_config] if args.key?(:software_config) @worker_config = args[:worker_config] if args.key?(:worker_config) end |