Class: Google::Apis::DataflowV1b3::Step
- Inherits:
-
Object
- Object
- Google::Apis::DataflowV1b3::Step
- Includes:
- Core::Hashable, Core::JsonObjectSupport
- Defined in:
- generated/google/apis/dataflow_v1b3/classes.rb,
generated/google/apis/dataflow_v1b3/representations.rb,
generated/google/apis/dataflow_v1b3/representations.rb
Overview
Defines a particular step within a Cloud Dataflow job. A job consists of multiple steps, each of which performs some specific operation as part of the overall job. Data is typically passed from one step to another as part of the job. Here's an example of a sequence of steps which together implement a Map-Reduce job:
- Read a collection of data from some source, parsing the collection's elements.
- Validate the elements.
- Apply a user-defined function to map each element to some value and extract an element-specific key value.
- Group elements with the same key into a single element with that key, transforming a multiply-keyed collection into a uniquely-keyed collection.
- Write the elements out to some data sink. Note that the Cloud Dataflow service may be used to run many different types of jobs, not just Map-Reduce.
Instance Attribute Summary collapse
-
#kind ⇒ String
The kind of step in the Cloud Dataflow job.
-
#name ⇒ String
The name that identifies the step.
-
#properties ⇒ Hash<String,Object>
Named properties associated with the step.
Instance Method Summary collapse
-
#initialize(**args) ⇒ Step
constructor
A new instance of Step.
-
#update!(**args) ⇒ Object
Update properties of this object.
Methods included from Core::JsonObjectSupport
Methods included from Core::Hashable
Constructor Details
#initialize(**args) ⇒ Step
Returns a new instance of Step.
4546 4547 4548 |
# File 'generated/google/apis/dataflow_v1b3/classes.rb', line 4546 def initialize(**args) update!(**args) end |
Instance Attribute Details
#kind ⇒ String
The kind of step in the Cloud Dataflow job.
Corresponds to the JSON property kind
4531 4532 4533 |
# File 'generated/google/apis/dataflow_v1b3/classes.rb', line 4531 def kind @kind end |
#name ⇒ String
The name that identifies the step. This must be unique for each
step with respect to all other steps in the Cloud Dataflow job.
Corresponds to the JSON property name
4537 4538 4539 |
# File 'generated/google/apis/dataflow_v1b3/classes.rb', line 4537 def name @name end |
#properties ⇒ Hash<String,Object>
Named properties associated with the step. Each kind of
predefined step has its own required set of properties.
Must be provided on Create. Only retrieved with JOB_VIEW_ALL.
Corresponds to the JSON property properties
4544 4545 4546 |
# File 'generated/google/apis/dataflow_v1b3/classes.rb', line 4544 def properties @properties end |
Instance Method Details
#update!(**args) ⇒ Object
Update properties of this object
4551 4552 4553 4554 4555 |
# File 'generated/google/apis/dataflow_v1b3/classes.rb', line 4551 def update!(**args) @kind = args[:kind] if args.key?(:kind) @name = args[:name] if args.key?(:name) @properties = args[:properties] if args.key?(:properties) end |