Class: Google::Apis::DataprocV1beta2::PigJob
- Inherits:
-
Object
- Object
- Google::Apis::DataprocV1beta2::PigJob
- Includes:
- Core::Hashable, Core::JsonObjectSupport
- Defined in:
- generated/google/apis/dataproc_v1beta2/classes.rb,
generated/google/apis/dataproc_v1beta2/representations.rb,
generated/google/apis/dataproc_v1beta2/representations.rb
Overview
A Cloud Dataproc job for running Apache Pig (https://pig.apache.org/) queries on YARN.
Instance Attribute Summary collapse
-
#continue_on_failure ⇒ Boolean
(also: #continue_on_failure?)
Optional.
-
#jar_file_uris ⇒ Array<String>
Optional.
-
#logging_config ⇒ Google::Apis::DataprocV1beta2::LoggingConfig
The runtime logging config of the job.
-
#properties ⇒ Hash<String,String>
Optional.
-
#query_file_uri ⇒ String
The HCFS URI of the script that contains the Pig queries.
-
#query_list ⇒ Google::Apis::DataprocV1beta2::QueryList
A list of queries to run on a cluster.
-
#script_variables ⇒ Hash<String,String>
Optional.
Instance Method Summary collapse
-
#initialize(**args) ⇒ PigJob
constructor
A new instance of PigJob.
-
#update!(**args) ⇒ Object
Update properties of this object.
Methods included from Core::JsonObjectSupport
Methods included from Core::Hashable
Constructor Details
#initialize(**args) ⇒ PigJob
Returns a new instance of PigJob
1717 1718 1719 |
# File 'generated/google/apis/dataproc_v1beta2/classes.rb', line 1717 def initialize(**args) update!(**args) end |
Instance Attribute Details
#continue_on_failure ⇒ Boolean Also known as: continue_on_failure?
Optional. Whether to continue executing queries if a query fails. The default
value is false. Setting to true can be useful when executing independent
parallel queries.
Corresponds to the JSON property continueOnFailure
1679 1680 1681 |
# File 'generated/google/apis/dataproc_v1beta2/classes.rb', line 1679 def continue_on_failure @continue_on_failure end |
#jar_file_uris ⇒ Array<String>
Optional. HCFS URIs of jar files to add to the CLASSPATH of the Pig Client and
Hadoop MapReduce (MR) tasks. Can contain Pig UDFs.
Corresponds to the JSON property jarFileUris
1686 1687 1688 |
# File 'generated/google/apis/dataproc_v1beta2/classes.rb', line 1686 def jar_file_uris @jar_file_uris end |
#logging_config ⇒ Google::Apis::DataprocV1beta2::LoggingConfig
The runtime logging config of the job.
Corresponds to the JSON property loggingConfig
1691 1692 1693 |
# File 'generated/google/apis/dataproc_v1beta2/classes.rb', line 1691 def logging_config @logging_config end |
#properties ⇒ Hash<String,String>
Optional. A mapping of property names to values, used to configure Pig.
Properties that conflict with values set by the Cloud Dataproc API may be
overwritten. Can include properties set in /etc/hadoop/conf/*-site.xml, /etc/
pig/conf/pig.properties, and classes in user code.
Corresponds to the JSON property properties
1699 1700 1701 |
# File 'generated/google/apis/dataproc_v1beta2/classes.rb', line 1699 def properties @properties end |
#query_file_uri ⇒ String
The HCFS URI of the script that contains the Pig queries.
Corresponds to the JSON property queryFileUri
1704 1705 1706 |
# File 'generated/google/apis/dataproc_v1beta2/classes.rb', line 1704 def query_file_uri @query_file_uri end |
#query_list ⇒ Google::Apis::DataprocV1beta2::QueryList
A list of queries to run on a cluster.
Corresponds to the JSON property queryList
1709 1710 1711 |
# File 'generated/google/apis/dataproc_v1beta2/classes.rb', line 1709 def query_list @query_list end |
#script_variables ⇒ Hash<String,String>
Optional. Mapping of query variable names to values (equivalent to the Pig
command: name=[value]).
Corresponds to the JSON property scriptVariables
1715 1716 1717 |
# File 'generated/google/apis/dataproc_v1beta2/classes.rb', line 1715 def script_variables @script_variables end |
Instance Method Details
#update!(**args) ⇒ Object
Update properties of this object
1722 1723 1724 1725 1726 1727 1728 1729 1730 |
# File 'generated/google/apis/dataproc_v1beta2/classes.rb', line 1722 def update!(**args) @continue_on_failure = args[:continue_on_failure] if args.key?(:continue_on_failure) @jar_file_uris = args[:jar_file_uris] if args.key?(:jar_file_uris) @logging_config = args[:logging_config] if args.key?(:logging_config) @properties = args[:properties] if args.key?(:properties) @query_file_uri = args[:query_file_uri] if args.key?(:query_file_uri) @query_list = args[:query_list] if args.key?(:query_list) @script_variables = args[:script_variables] if args.key?(:script_variables) end |