Class: Google::Apis::DataprocV1::PigJob

Inherits:
Object
  • Object
show all
Includes:
Core::Hashable, Core::JsonObjectSupport
Defined in:
generated/google/apis/dataproc_v1/classes.rb,
generated/google/apis/dataproc_v1/representations.rb,
generated/google/apis/dataproc_v1/representations.rb

Overview

A Cloud Dataproc job for running Apache Pig (https://pig.apache.org/) queries on YARN.

Instance Attribute Summary collapse

Instance Method Summary collapse

Methods included from Core::JsonObjectSupport

#to_json

Methods included from Core::Hashable

process_value, #to_h

Constructor Details

#initialize(**args) ⇒ PigJob

Returns a new instance of PigJob



1430
1431
1432
 
# File 'generated/google/apis/dataproc_v1/classes.rb', line 1430

def initialize(**args)
   update!(**args)
end

Instance Attribute Details

#continue_on_failure ⇒ Boolean Also known as: continue_on_failure?

Optional Whether to continue executing queries if a query fails. The default value is false. Setting to true can be useful when executing independent parallel queries. Corresponds to the JSON property continueOnFailure

Returns:

  • (Boolean) 


1427
1428
1429
 
# File 'generated/google/apis/dataproc_v1/classes.rb', line 1427

def continue_on_failure
  @continue_on_failure
end

#jar_file_uris ⇒ Array<String>

Optional HCFS URIs of jar files to add to the CLASSPATH of the Pig Client and Hadoop MapReduce (MR) tasks. Can contain Pig UDFs. Corresponds to the JSON property jarFileUris

Returns:

  • (Array<String>) 


1401
1402
1403
 
# File 'generated/google/apis/dataproc_v1/classes.rb', line 1401

def jar_file_uris
  @jar_file_uris
end

#logging_config ⇒ Google::Apis::DataprocV1::LoggingConfig

The runtime logging config of the job. Corresponds to the JSON property loggingConfig

Returns:



1412
1413
1414
 
# File 'generated/google/apis/dataproc_v1/classes.rb', line 1412

def logging_config
  @logging_config
end

#properties ⇒ Hash<String,String>

Optional A mapping of property names to values, used to configure Pig. Properties that conflict with values set by the Cloud Dataproc API may be overwritten. Can include properties set in /etc/hadoop/conf/*-site.xml, /etc/ pig/conf/pig.properties, and classes in user code. Corresponds to the JSON property properties

Returns:

  • (Hash<String,String>) 


1420
1421
1422
 
# File 'generated/google/apis/dataproc_v1/classes.rb', line 1420

def properties
  @properties
end

#query_file_uri ⇒ String

The HCFS URI of the script that contains the Pig queries. Corresponds to the JSON property queryFileUri

Returns:

  • (String) 


1395
1396
1397
 
# File 'generated/google/apis/dataproc_v1/classes.rb', line 1395

def query_file_uri
  @query_file_uri
end

#query_list ⇒ Google::Apis::DataprocV1::QueryList

A list of queries to run on a cluster. Corresponds to the JSON property queryList

Returns:



1390
1391
1392
 
# File 'generated/google/apis/dataproc_v1/classes.rb', line 1390

def query_list
  @query_list
end

#script_variables ⇒ Hash<String,String>

Optional Mapping of query variable names to values (equivalent to the Pig command: name=[value]). Corresponds to the JSON property scriptVariables

Returns:

  • (Hash<String,String>) 


1407
1408
1409
 
# File 'generated/google/apis/dataproc_v1/classes.rb', line 1407

def script_variables
  @script_variables
end

Instance Method Details

#update!(**args) ⇒ Object

Update properties of this object



1435
1436
1437
1438
1439
1440
1441
1442
1443
 
# File 'generated/google/apis/dataproc_v1/classes.rb', line 1435

def update!(**args)
  @query_list = args[:query_list] if args.key?(:query_list)
  @query_file_uri = args[:query_file_uri] if args.key?(:query_file_uri)
  @jar_file_uris = args[:jar_file_uris] if args.key?(:jar_file_uris)
  @script_variables = args[:script_variables] if args.key?(:script_variables)
  @logging_config = args[:logging_config] if args.key?(:logging_config)
  @properties = args[:properties] if args.key?(:properties)
  @continue_on_failure = args[:continue_on_failure] if args.key?(:continue_on_failure)
end