Class: Google::Apis::DataflowV1b3::SourceOperationRequest

Inherits:
Object
  • Object
show all
Includes:
Core::Hashable, Core::JsonObjectSupport
Defined in:
generated/google/apis/dataflow_v1b3/classes.rb,
generated/google/apis/dataflow_v1b3/representations.rb,
generated/google/apis/dataflow_v1b3/representations.rb

Overview

A work item that represents the different operations that can be performed on a user-defined Source specification.

Instance Attribute Summary collapse

Instance Method Summary collapse

Methods included from Core::JsonObjectSupport

#to_json

Methods included from Core::Hashable

process_value, #to_h

Constructor Details

#initialize(**args) ⇒ SourceOperationRequest

Returns a new instance of SourceOperationRequest



3898
3899
3900
# File 'generated/google/apis/dataflow_v1b3/classes.rb', line 3898

def initialize(**args)
   update!(**args)
end

Instance Attribute Details

#get_metadataGoogle::Apis::DataflowV1b3::SourceGetMetadataRequest

A request to compute the SourceMetadata of a Source. Corresponds to the JSON property getMetadata



3857
3858
3859
# File 'generated/google/apis/dataflow_v1b3/classes.rb', line 3857

def 
  @get_metadata
end

#nameString

User-provided name of the Read instruction for this source. Corresponds to the JSON property name

Returns:

  • (String)


3862
3863
3864
# File 'generated/google/apis/dataflow_v1b3/classes.rb', line 3862

def name
  @name
end

#original_nameString

System-defined name for the Read instruction for this source in the original workflow graph. Corresponds to the JSON property originalName

Returns:

  • (String)


3868
3869
3870
# File 'generated/google/apis/dataflow_v1b3/classes.rb', line 3868

def original_name
  @original_name
end

#splitGoogle::Apis::DataflowV1b3::SourceSplitRequest

Represents the operation to split a high-level Source specification into bundles (parts for parallel processing). At a high level, splitting of a source into bundles happens as follows: SourceSplitRequest is applied to the source. If it returns SOURCE_SPLIT_OUTCOME_USE_CURRENT, no further splitting happens and the source is used "as is". Otherwise, splitting is applied recursively to each produced DerivedSource. As an optimization, for any Source, if its does_not_need_splitting is true, the framework assumes that splitting this source would return SOURCE_SPLIT_OUTCOME_USE_CURRENT, and doesn't initiate a SourceSplitRequest. This applies both to the initial source being split and to bundles produced from it. Corresponds to the JSON property split



3884
3885
3886
# File 'generated/google/apis/dataflow_v1b3/classes.rb', line 3884

def split
  @split
end

#stage_nameString

System-defined name of the stage containing the source operation. Unique across the workflow. Corresponds to the JSON property stageName

Returns:

  • (String)


3890
3891
3892
# File 'generated/google/apis/dataflow_v1b3/classes.rb', line 3890

def stage_name
  @stage_name
end

#system_nameString

System-defined name of the Read instruction for this source. Unique across the workflow. Corresponds to the JSON property systemName

Returns:

  • (String)


3896
3897
3898
# File 'generated/google/apis/dataflow_v1b3/classes.rb', line 3896

def system_name
  @system_name
end

Instance Method Details

#update!(**args) ⇒ Object

Update properties of this object



3903
3904
3905
3906
3907
3908
3909
3910
# File 'generated/google/apis/dataflow_v1b3/classes.rb', line 3903

def update!(**args)
  @get_metadata = args[:get_metadata] if args.key?(:get_metadata)
  @name = args[:name] if args.key?(:name)
  @original_name = args[:original_name] if args.key?(:original_name)
  @split = args[:split] if args.key?(:split)
  @stage_name = args[:stage_name] if args.key?(:stage_name)
  @system_name = args[:system_name] if args.key?(:system_name)
end