Class: Google::Cloud::Orchestration::Airflow::Service::V1::WorkloadsConfig

Inherits:

Object

• Object
• Google::Cloud::Orchestration::Airflow::Service::V1::WorkloadsConfig

Extended by:

Protobuf::MessageExts::ClassMethods

Includes:

Protobuf::MessageExts

Defined in:

proto_docs/google/cloud/orchestration/airflow/service/v1/environments.rb

Overview

The Kubernetes workloads configuration for GKE cluster associated with the Cloud Composer environment. Supported for Cloud Composer environments in versions composer-2..-airflow-..* and newer.

Defined Under Namespace

Classes: DagProcessorResource, SchedulerResource, TriggererResource, WebServerResource, WorkerResource

Instance Attribute Summary

• #dag_processor ⇒ ::Google::Cloud::Orchestration::Airflow::Service::V1::WorkloadsConfig::DagProcessorResource

  Optional.

• #scheduler ⇒ ::Google::Cloud::Orchestration::Airflow::Service::V1::WorkloadsConfig::SchedulerResource

  Optional.

• #triggerer ⇒ ::Google::Cloud::Orchestration::Airflow::Service::V1::WorkloadsConfig::TriggererResource

  Optional.

• #web_server ⇒ ::Google::Cloud::Orchestration::Airflow::Service::V1::WorkloadsConfig::WebServerResource

  Optional.

• #worker ⇒ ::Google::Cloud::Orchestration::Airflow::Service::V1::WorkloadsConfig::WorkerResource

  Optional.

Instance Attribute Details

#dag_processor ⇒ ::Google::Cloud::Orchestration::Airflow::Service::V1::WorkloadsConfig::DagProcessorResource

Returns Optional. Resources used by Airflow DAG processors.

This field is supported for Cloud Composer environments in versions composer-3..-airflow-..* and newer.

Returns:

• (::Google::Cloud::Orchestration::Airflow::Service::V1::WorkloadsConfig::DagProcessorResource) —

  Optional. Resources used by Airflow DAG processors.

  This field is supported for Cloud Composer environments in versions composer-3..-airflow-..* and newer.

# File 'proto_docs/google/cloud/orchestration/airflow/service/v1/environments.rb', line 1546

class WorkloadsConfig
  include ::Google::Protobuf::MessageExts
  extend ::Google::Protobuf::MessageExts::ClassMethods

  # Configuration for resources used by Airflow schedulers.
  # @!attribute [rw] cpu
  #   @return [::Float]
  #     Optional. CPU request and limit for a single Airflow scheduler replica.
  # @!attribute [rw] memory_gb
  #   @return [::Float]
  #     Optional. Memory (GB) request and limit for a single Airflow scheduler
  #     replica.
  # @!attribute [rw] storage_gb
  #   @return [::Float]
  #     Optional. Storage (GB) request and limit for a single Airflow scheduler
  #     replica.
  # @!attribute [rw] count
  #   @return [::Integer]
  #     Optional. The number of schedulers.
  class SchedulerResource
    include ::Google::Protobuf::MessageExts
    extend ::Google::Protobuf::MessageExts::ClassMethods
  end

  # Configuration for resources used by Airflow web server.
  # @!attribute [rw] cpu
  #   @return [::Float]
  #     Optional. CPU request and limit for Airflow web server.
  # @!attribute [rw] memory_gb
  #   @return [::Float]
  #     Optional. Memory (GB) request and limit for Airflow web server.
  # @!attribute [rw] storage_gb
  #   @return [::Float]
  #     Optional. Storage (GB) request and limit for Airflow web server.
  class WebServerResource
    include ::Google::Protobuf::MessageExts
    extend ::Google::Protobuf::MessageExts::ClassMethods
  end

  # Configuration for resources used by Airflow workers.
  # @!attribute [rw] cpu
  #   @return [::Float]
  #     Optional. CPU request and limit for a single Airflow worker replica.
  # @!attribute [rw] memory_gb
  #   @return [::Float]
  #     Optional. Memory (GB) request and limit for a single Airflow worker
  #     replica.
  # @!attribute [rw] storage_gb
  #   @return [::Float]
  #     Optional. Storage (GB) request and limit for a single Airflow worker
  #     replica.
  # @!attribute [rw] min_count
  #   @return [::Integer]
  #     Optional. Minimum number of workers for autoscaling.
  # @!attribute [rw] max_count
  #   @return [::Integer]
  #     Optional. Maximum number of workers for autoscaling.
  class WorkerResource
    include ::Google::Protobuf::MessageExts
    extend ::Google::Protobuf::MessageExts::ClassMethods
  end

  # Configuration for resources used by Airflow triggerers.
  # @!attribute [rw] count
  #   @return [::Integer]
  #     Optional. The number of triggerers.
  # @!attribute [rw] cpu
  #   @return [::Float]
  #     Optional. CPU request and limit for a single Airflow triggerer replica.
  # @!attribute [rw] memory_gb
  #   @return [::Float]
  #     Optional. Memory (GB) request and limit for a single Airflow triggerer
  #     replica.
  class TriggererResource
    include ::Google::Protobuf::MessageExts
    extend ::Google::Protobuf::MessageExts::ClassMethods
  end

  # Configuration for resources used by Airflow DAG processors.
  #
  # This field is supported for Cloud Composer environments in versions
  # composer-3.*.*-airflow-*.*.* and newer.
  # @!attribute [rw] cpu
  #   @return [::Float]
  #     Optional. CPU request and limit for a single Airflow DAG processor
  #     replica.
  # @!attribute [rw] memory_gb
  #   @return [::Float]
  #     Optional. Memory (GB) request and limit for a single Airflow DAG
  #     processor replica.
  # @!attribute [rw] storage_gb
  #   @return [::Float]
  #     Optional. Storage (GB) request and limit for a single Airflow DAG
  #     processor replica.
  # @!attribute [rw] count
  #   @return [::Integer]
  #     Optional. The number of DAG processors. If not provided or set to 0, a
  #     single DAG processor instance will be created.
  class DagProcessorResource
    include ::Google::Protobuf::MessageExts
    extend ::Google::Protobuf::MessageExts::ClassMethods
  end
end

#scheduler ⇒ ::Google::Cloud::Orchestration::Airflow::Service::V1::WorkloadsConfig::SchedulerResource

Returns Optional. Resources used by Airflow schedulers.

Returns:

• (::Google::Cloud::Orchestration::Airflow::Service::V1::WorkloadsConfig::SchedulerResource) —

  Optional. Resources used by Airflow schedulers.

# File 'proto_docs/google/cloud/orchestration/airflow/service/v1/environments.rb', line 1546

class WorkloadsConfig
  include ::Google::Protobuf::MessageExts
  extend ::Google::Protobuf::MessageExts::ClassMethods

  # Configuration for resources used by Airflow schedulers.
  # @!attribute [rw] cpu
  #   @return [::Float]
  #     Optional. CPU request and limit for a single Airflow scheduler replica.
  # @!attribute [rw] memory_gb
  #   @return [::Float]
  #     Optional. Memory (GB) request and limit for a single Airflow scheduler
  #     replica.
  # @!attribute [rw] storage_gb
  #   @return [::Float]
  #     Optional. Storage (GB) request and limit for a single Airflow scheduler
  #     replica.
  # @!attribute [rw] count
  #   @return [::Integer]
  #     Optional. The number of schedulers.
  class SchedulerResource
    include ::Google::Protobuf::MessageExts
    extend ::Google::Protobuf::MessageExts::ClassMethods
  end

  # Configuration for resources used by Airflow web server.
  # @!attribute [rw] cpu
  #   @return [::Float]
  #     Optional. CPU request and limit for Airflow web server.
  # @!attribute [rw] memory_gb
  #   @return [::Float]
  #     Optional. Memory (GB) request and limit for Airflow web server.
  # @!attribute [rw] storage_gb
  #   @return [::Float]
  #     Optional. Storage (GB) request and limit for Airflow web server.
  class WebServerResource
    include ::Google::Protobuf::MessageExts
    extend ::Google::Protobuf::MessageExts::ClassMethods
  end

  # Configuration for resources used by Airflow workers.
  # @!attribute [rw] cpu
  #   @return [::Float]
  #     Optional. CPU request and limit for a single Airflow worker replica.
  # @!attribute [rw] memory_gb
  #   @return [::Float]
  #     Optional. Memory (GB) request and limit for a single Airflow worker
  #     replica.
  # @!attribute [rw] storage_gb
  #   @return [::Float]
  #     Optional. Storage (GB) request and limit for a single Airflow worker
  #     replica.
  # @!attribute [rw] min_count
  #   @return [::Integer]
  #     Optional. Minimum number of workers for autoscaling.
  # @!attribute [rw] max_count
  #   @return [::Integer]
  #     Optional. Maximum number of workers for autoscaling.
  class WorkerResource
    include ::Google::Protobuf::MessageExts
    extend ::Google::Protobuf::MessageExts::ClassMethods
  end

  # Configuration for resources used by Airflow triggerers.
  # @!attribute [rw] count
  #   @return [::Integer]
  #     Optional. The number of triggerers.
  # @!attribute [rw] cpu
  #   @return [::Float]
  #     Optional. CPU request and limit for a single Airflow triggerer replica.
  # @!attribute [rw] memory_gb
  #   @return [::Float]
  #     Optional. Memory (GB) request and limit for a single Airflow triggerer
  #     replica.
  class TriggererResource
    include ::Google::Protobuf::MessageExts
    extend ::Google::Protobuf::MessageExts::ClassMethods
  end

  # Configuration for resources used by Airflow DAG processors.
  #
  # This field is supported for Cloud Composer environments in versions
  # composer-3.*.*-airflow-*.*.* and newer.
  # @!attribute [rw] cpu
  #   @return [::Float]
  #     Optional. CPU request and limit for a single Airflow DAG processor
  #     replica.
  # @!attribute [rw] memory_gb
  #   @return [::Float]
  #     Optional. Memory (GB) request and limit for a single Airflow DAG
  #     processor replica.
  # @!attribute [rw] storage_gb
  #   @return [::Float]
  #     Optional. Storage (GB) request and limit for a single Airflow DAG
  #     processor replica.
  # @!attribute [rw] count
  #   @return [::Integer]
  #     Optional. The number of DAG processors. If not provided or set to 0, a
  #     single DAG processor instance will be created.
  class DagProcessorResource
    include ::Google::Protobuf::MessageExts
    extend ::Google::Protobuf::MessageExts::ClassMethods
  end
end

#triggerer ⇒ ::Google::Cloud::Orchestration::Airflow::Service::V1::WorkloadsConfig::TriggererResource

Returns Optional. Resources used by Airflow triggerers.

Returns:

• (::Google::Cloud::Orchestration::Airflow::Service::V1::WorkloadsConfig::TriggererResource) —

  Optional. Resources used by Airflow triggerers.

# File 'proto_docs/google/cloud/orchestration/airflow/service/v1/environments.rb', line 1546

class WorkloadsConfig
  include ::Google::Protobuf::MessageExts
  extend ::Google::Protobuf::MessageExts::ClassMethods

  # Configuration for resources used by Airflow schedulers.
  # @!attribute [rw] cpu
  #   @return [::Float]
  #     Optional. CPU request and limit for a single Airflow scheduler replica.
  # @!attribute [rw] memory_gb
  #   @return [::Float]
  #     Optional. Memory (GB) request and limit for a single Airflow scheduler
  #     replica.
  # @!attribute [rw] storage_gb
  #   @return [::Float]
  #     Optional. Storage (GB) request and limit for a single Airflow scheduler
  #     replica.
  # @!attribute [rw] count
  #   @return [::Integer]
  #     Optional. The number of schedulers.
  class SchedulerResource
    include ::Google::Protobuf::MessageExts
    extend ::Google::Protobuf::MessageExts::ClassMethods
  end

  # Configuration for resources used by Airflow web server.
  # @!attribute [rw] cpu
  #   @return [::Float]
  #     Optional. CPU request and limit for Airflow web server.
  # @!attribute [rw] memory_gb
  #   @return [::Float]
  #     Optional. Memory (GB) request and limit for Airflow web server.
  # @!attribute [rw] storage_gb
  #   @return [::Float]
  #     Optional. Storage (GB) request and limit for Airflow web server.
  class WebServerResource
    include ::Google::Protobuf::MessageExts
    extend ::Google::Protobuf::MessageExts::ClassMethods
  end

  # Configuration for resources used by Airflow workers.
  # @!attribute [rw] cpu
  #   @return [::Float]
  #     Optional. CPU request and limit for a single Airflow worker replica.
  # @!attribute [rw] memory_gb
  #   @return [::Float]
  #     Optional. Memory (GB) request and limit for a single Airflow worker
  #     replica.
  # @!attribute [rw] storage_gb
  #   @return [::Float]
  #     Optional. Storage (GB) request and limit for a single Airflow worker
  #     replica.
  # @!attribute [rw] min_count
  #   @return [::Integer]
  #     Optional. Minimum number of workers for autoscaling.
  # @!attribute [rw] max_count
  #   @return [::Integer]
  #     Optional. Maximum number of workers for autoscaling.
  class WorkerResource
    include ::Google::Protobuf::MessageExts
    extend ::Google::Protobuf::MessageExts::ClassMethods
  end

  # Configuration for resources used by Airflow triggerers.
  # @!attribute [rw] count
  #   @return [::Integer]
  #     Optional. The number of triggerers.
  # @!attribute [rw] cpu
  #   @return [::Float]
  #     Optional. CPU request and limit for a single Airflow triggerer replica.
  # @!attribute [rw] memory_gb
  #   @return [::Float]
  #     Optional. Memory (GB) request and limit for a single Airflow triggerer
  #     replica.
  class TriggererResource
    include ::Google::Protobuf::MessageExts
    extend ::Google::Protobuf::MessageExts::ClassMethods
  end

  # Configuration for resources used by Airflow DAG processors.
  #
  # This field is supported for Cloud Composer environments in versions
  # composer-3.*.*-airflow-*.*.* and newer.
  # @!attribute [rw] cpu
  #   @return [::Float]
  #     Optional. CPU request and limit for a single Airflow DAG processor
  #     replica.
  # @!attribute [rw] memory_gb
  #   @return [::Float]
  #     Optional. Memory (GB) request and limit for a single Airflow DAG
  #     processor replica.
  # @!attribute [rw] storage_gb
  #   @return [::Float]
  #     Optional. Storage (GB) request and limit for a single Airflow DAG
  #     processor replica.
  # @!attribute [rw] count
  #   @return [::Integer]
  #     Optional. The number of DAG processors. If not provided or set to 0, a
  #     single DAG processor instance will be created.
  class DagProcessorResource
    include ::Google::Protobuf::MessageExts
    extend ::Google::Protobuf::MessageExts::ClassMethods
  end
end

#web_server ⇒ ::Google::Cloud::Orchestration::Airflow::Service::V1::WorkloadsConfig::WebServerResource

Returns Optional. Resources used by Airflow web server.

Returns:

• (::Google::Cloud::Orchestration::Airflow::Service::V1::WorkloadsConfig::WebServerResource) —

  Optional. Resources used by Airflow web server.

# File 'proto_docs/google/cloud/orchestration/airflow/service/v1/environments.rb', line 1546

class WorkloadsConfig
  include ::Google::Protobuf::MessageExts
  extend ::Google::Protobuf::MessageExts::ClassMethods

  # Configuration for resources used by Airflow schedulers.
  # @!attribute [rw] cpu
  #   @return [::Float]
  #     Optional. CPU request and limit for a single Airflow scheduler replica.
  # @!attribute [rw] memory_gb
  #   @return [::Float]
  #     Optional. Memory (GB) request and limit for a single Airflow scheduler
  #     replica.
  # @!attribute [rw] storage_gb
  #   @return [::Float]
  #     Optional. Storage (GB) request and limit for a single Airflow scheduler
  #     replica.
  # @!attribute [rw] count
  #   @return [::Integer]
  #     Optional. The number of schedulers.
  class SchedulerResource
    include ::Google::Protobuf::MessageExts
    extend ::Google::Protobuf::MessageExts::ClassMethods
  end

  # Configuration for resources used by Airflow web server.
  # @!attribute [rw] cpu
  #   @return [::Float]
  #     Optional. CPU request and limit for Airflow web server.
  # @!attribute [rw] memory_gb
  #   @return [::Float]
  #     Optional. Memory (GB) request and limit for Airflow web server.
  # @!attribute [rw] storage_gb
  #   @return [::Float]
  #     Optional. Storage (GB) request and limit for Airflow web server.
  class WebServerResource
    include ::Google::Protobuf::MessageExts
    extend ::Google::Protobuf::MessageExts::ClassMethods
  end

  # Configuration for resources used by Airflow workers.
  # @!attribute [rw] cpu
  #   @return [::Float]
  #     Optional. CPU request and limit for a single Airflow worker replica.
  # @!attribute [rw] memory_gb
  #   @return [::Float]
  #     Optional. Memory (GB) request and limit for a single Airflow worker
  #     replica.
  # @!attribute [rw] storage_gb
  #   @return [::Float]
  #     Optional. Storage (GB) request and limit for a single Airflow worker
  #     replica.
  # @!attribute [rw] min_count
  #   @return [::Integer]
  #     Optional. Minimum number of workers for autoscaling.
  # @!attribute [rw] max_count
  #   @return [::Integer]
  #     Optional. Maximum number of workers for autoscaling.
  class WorkerResource
    include ::Google::Protobuf::MessageExts
    extend ::Google::Protobuf::MessageExts::ClassMethods
  end

  # Configuration for resources used by Airflow triggerers.
  # @!attribute [rw] count
  #   @return [::Integer]
  #     Optional. The number of triggerers.
  # @!attribute [rw] cpu
  #   @return [::Float]
  #     Optional. CPU request and limit for a single Airflow triggerer replica.
  # @!attribute [rw] memory_gb
  #   @return [::Float]
  #     Optional. Memory (GB) request and limit for a single Airflow triggerer
  #     replica.
  class TriggererResource
    include ::Google::Protobuf::MessageExts
    extend ::Google::Protobuf::MessageExts::ClassMethods
  end

  # Configuration for resources used by Airflow DAG processors.
  #
  # This field is supported for Cloud Composer environments in versions
  # composer-3.*.*-airflow-*.*.* and newer.
  # @!attribute [rw] cpu
  #   @return [::Float]
  #     Optional. CPU request and limit for a single Airflow DAG processor
  #     replica.
  # @!attribute [rw] memory_gb
  #   @return [::Float]
  #     Optional. Memory (GB) request and limit for a single Airflow DAG
  #     processor replica.
  # @!attribute [rw] storage_gb
  #   @return [::Float]
  #     Optional. Storage (GB) request and limit for a single Airflow DAG
  #     processor replica.
  # @!attribute [rw] count
  #   @return [::Integer]
  #     Optional. The number of DAG processors. If not provided or set to 0, a
  #     single DAG processor instance will be created.
  class DagProcessorResource
    include ::Google::Protobuf::MessageExts
    extend ::Google::Protobuf::MessageExts::ClassMethods
  end
end

#worker ⇒ ::Google::Cloud::Orchestration::Airflow::Service::V1::WorkloadsConfig::WorkerResource

Returns Optional. Resources used by Airflow workers.

Returns:

• (::Google::Cloud::Orchestration::Airflow::Service::V1::WorkloadsConfig::WorkerResource) —

  Optional. Resources used by Airflow workers.

# File 'proto_docs/google/cloud/orchestration/airflow/service/v1/environments.rb', line 1546

class WorkloadsConfig
  include ::Google::Protobuf::MessageExts
  extend ::Google::Protobuf::MessageExts::ClassMethods

  # Configuration for resources used by Airflow schedulers.
  # @!attribute [rw] cpu
  #   @return [::Float]
  #     Optional. CPU request and limit for a single Airflow scheduler replica.
  # @!attribute [rw] memory_gb
  #   @return [::Float]
  #     Optional. Memory (GB) request and limit for a single Airflow scheduler
  #     replica.
  # @!attribute [rw] storage_gb
  #   @return [::Float]
  #     Optional. Storage (GB) request and limit for a single Airflow scheduler
  #     replica.
  # @!attribute [rw] count
  #   @return [::Integer]
  #     Optional. The number of schedulers.
  class SchedulerResource
    include ::Google::Protobuf::MessageExts
    extend ::Google::Protobuf::MessageExts::ClassMethods
  end

  # Configuration for resources used by Airflow web server.
  # @!attribute [rw] cpu
  #   @return [::Float]
  #     Optional. CPU request and limit for Airflow web server.
  # @!attribute [rw] memory_gb
  #   @return [::Float]
  #     Optional. Memory (GB) request and limit for Airflow web server.
  # @!attribute [rw] storage_gb
  #   @return [::Float]
  #     Optional. Storage (GB) request and limit for Airflow web server.
  class WebServerResource
    include ::Google::Protobuf::MessageExts
    extend ::Google::Protobuf::MessageExts::ClassMethods
  end

  # Configuration for resources used by Airflow workers.
  # @!attribute [rw] cpu
  #   @return [::Float]
  #     Optional. CPU request and limit for a single Airflow worker replica.
  # @!attribute [rw] memory_gb
  #   @return [::Float]
  #     Optional. Memory (GB) request and limit for a single Airflow worker
  #     replica.
  # @!attribute [rw] storage_gb
  #   @return [::Float]
  #     Optional. Storage (GB) request and limit for a single Airflow worker
  #     replica.
  # @!attribute [rw] min_count
  #   @return [::Integer]
  #     Optional. Minimum number of workers for autoscaling.
  # @!attribute [rw] max_count
  #   @return [::Integer]
  #     Optional. Maximum number of workers for autoscaling.
  class WorkerResource
    include ::Google::Protobuf::MessageExts
    extend ::Google::Protobuf::MessageExts::ClassMethods
  end

  # Configuration for resources used by Airflow triggerers.
  # @!attribute [rw] count
  #   @return [::Integer]
  #     Optional. The number of triggerers.
  # @!attribute [rw] cpu
  #   @return [::Float]
  #     Optional. CPU request and limit for a single Airflow triggerer replica.
  # @!attribute [rw] memory_gb
  #   @return [::Float]
  #     Optional. Memory (GB) request and limit for a single Airflow triggerer
  #     replica.
  class TriggererResource
    include ::Google::Protobuf::MessageExts
    extend ::Google::Protobuf::MessageExts::ClassMethods
  end

  # Configuration for resources used by Airflow DAG processors.
  #
  # This field is supported for Cloud Composer environments in versions
  # composer-3.*.*-airflow-*.*.* and newer.
  # @!attribute [rw] cpu
  #   @return [::Float]
  #     Optional. CPU request and limit for a single Airflow DAG processor
  #     replica.
  # @!attribute [rw] memory_gb
  #   @return [::Float]
  #     Optional. Memory (GB) request and limit for a single Airflow DAG
  #     processor replica.
  # @!attribute [rw] storage_gb
  #   @return [::Float]
  #     Optional. Storage (GB) request and limit for a single Airflow DAG
  #     processor replica.
  # @!attribute [rw] count
  #   @return [::Integer]
  #     Optional. The number of DAG processors. If not provided or set to 0, a
  #     single DAG processor instance will be created.
  class DagProcessorResource
    include ::Google::Protobuf::MessageExts
    extend ::Google::Protobuf::MessageExts::ClassMethods
  end
end