Class: Google::Apis::DataflowV1b3::SourceSplitRequest

Inherits:

Object

• Object
• Google::Apis::DataflowV1b3::SourceSplitRequest

Includes:

Core::Hashable, Core::JsonObjectSupport

Defined in:

generated/google/apis/dataflow_v1b3/classes.rb,
generated/google/apis/dataflow_v1b3/representations.rb,
generated/google/apis/dataflow_v1b3/representations.rb

Overview

Represents the operation to split a high-level Source specification into bundles (parts for parallel processing). At a high level, splitting of a source into bundles happens as follows: SourceSplitRequest is applied to the source. If it returns SOURCE_SPLIT_OUTCOME_USE_CURRENT, no further splitting happens and the source is used "as is". Otherwise, splitting is applied recursively to each produced DerivedSource. As an optimization, for any Source, if its does_not_need_splitting is true, the framework assumes that splitting this source would return SOURCE_SPLIT_OUTCOME_USE_CURRENT, and doesn't initiate a SourceSplitRequest. This applies both to the initial source being split and to bundles produced from it.

Instance Attribute Summary

• #options ⇒ Google::Apis::DataflowV1b3::SourceSplitOptions

  Hints for splitting a Source into bundles (parts for parallel processing) using SourceSplitRequest.

• #source ⇒ Google::Apis::DataflowV1b3::Source

  A source that records can be read and decoded from.

Instance Method Summary

• #initialize(**args) ⇒ SourceSplitRequest constructor

  A new instance of SourceSplitRequest.

• #update!(**args) ⇒ Object

  Update properties of this object.

Methods included from Core::JsonObjectSupport

#to_json

Methods included from Core::Hashable

process_value, #to_h

Constructor Details

#initialize(**args) ⇒ SourceSplitRequest

Returns a new instance of SourceSplitRequest

# File 'generated/google/apis/dataflow_v1b3/classes.rb', line 3993

def initialize(**args)
   update!(**args)
end

Instance Attribute Details

#options ⇒ Google::Apis::DataflowV1b3::SourceSplitOptions

Hints for splitting a Source into bundles (parts for parallel processing) using SourceSplitRequest. Corresponds to the JSON property options

Returns:

• (Google::Apis::DataflowV1b3::SourceSplitOptions)

# File 'generated/google/apis/dataflow_v1b3/classes.rb', line 3986

def options
  @options
end

#source ⇒ Google::Apis::DataflowV1b3::Source

A source that records can be read and decoded from. Corresponds to the JSON property source

Returns:

• (Google::Apis::DataflowV1b3::Source)

# File 'generated/google/apis/dataflow_v1b3/classes.rb', line 3991

def source
  @source
end

Instance Method Details

#update!(**args) ⇒ Object

Update properties of this object

# File 'generated/google/apis/dataflow_v1b3/classes.rb', line 3998

def update!(**args)
  @options = args[:options] if args.key?(:options)
  @source = args[:source] if args.key?(:source)
end