Class: Google::Apis::DataprocV1::HiveJob

Inherits:
Object
  • Object
show all
Includes:
Core::Hashable, Core::JsonObjectSupport
Defined in:
generated/google/apis/dataproc_v1/classes.rb,
generated/google/apis/dataproc_v1/representations.rb,
generated/google/apis/dataproc_v1/representations.rb

Overview

A Cloud Dataproc job for running Apache Hive (https://hive.apache.org/) queries on YARN.

Instance Attribute Summary collapse

Instance Method Summary collapse

Methods included from Core::JsonObjectSupport

#to_json

Methods included from Core::Hashable

process_value, #to_h

Constructor Details

#initialize(**args) ⇒ HiveJob

Returns a new instance of HiveJob



918
919
920
 
# File 'generated/google/apis/dataproc_v1/classes.rb', line 918

def initialize(**args)
   update!(**args)
end

Instance Attribute Details

#continue_on_failure ⇒ Boolean Also known as: continue_on_failure?

Optional Whether to continue executing queries if a query fails. The default value is false. Setting to true can be useful when executing independent parallel queries. Corresponds to the JSON property continueOnFailure

Returns:

  • (Boolean) 


905
906
907
 
# File 'generated/google/apis/dataproc_v1/classes.rb', line 905

def continue_on_failure
  @continue_on_failure
end

#jar_file_uris ⇒ Array<String>

Optional HCFS URIs of jar files to add to the CLASSPATH of the Hive server and Hadoop MapReduce (MR) tasks. Can contain Hive SerDes and UDFs. Corresponds to the JSON property jarFileUris

Returns:

  • (Array<String>) 


884
885
886
 
# File 'generated/google/apis/dataproc_v1/classes.rb', line 884

def jar_file_uris
  @jar_file_uris
end

#properties ⇒ Hash<String,String>

Optional A mapping of property names and values, used to configure Hive. Properties that conflict with values set by the Cloud Dataproc API may be overwritten. Can include properties set in /etc/hadoop/conf/*-site.xml, /etc/ hive/conf/hive-site.xml, and classes in user code. Corresponds to the JSON property properties

Returns:

  • (Hash<String,String>) 


898
899
900
 
# File 'generated/google/apis/dataproc_v1/classes.rb', line 898

def properties
  @properties
end

#query_file_uri ⇒ String

The HCFS URI of the script that contains Hive queries. Corresponds to the JSON property queryFileUri

Returns:

  • (String) 


911
912
913
 
# File 'generated/google/apis/dataproc_v1/classes.rb', line 911

def query_file_uri
  @query_file_uri
end

#query_list ⇒ Google::Apis::DataprocV1::QueryList

A list of queries to run on a cluster. Corresponds to the JSON property queryList

Returns:



916
917
918
 
# File 'generated/google/apis/dataproc_v1/classes.rb', line 916

def query_list
  @query_list
end

#script_variables ⇒ Hash<String,String>

Optional Mapping of query variable names to values (equivalent to the Hive command: SET name="value";). Corresponds to the JSON property scriptVariables

Returns:

  • (Hash<String,String>) 


890
891
892
 
# File 'generated/google/apis/dataproc_v1/classes.rb', line 890

def script_variables
  @script_variables
end

Instance Method Details

#update!(**args) ⇒ Object

Update properties of this object



923
924
925
926
927
928
929
930
 
# File 'generated/google/apis/dataproc_v1/classes.rb', line 923

def update!(**args)
  @jar_file_uris = args[:jar_file_uris] if args.key?(:jar_file_uris)
  @script_variables = args[:script_variables] if args.key?(:script_variables)
  @properties = args[:properties] if args.key?(:properties)
  @continue_on_failure = args[:continue_on_failure] if args.key?(:continue_on_failure)
  @query_file_uri = args[:query_file_uri] if args.key?(:query_file_uri)
  @query_list = args[:query_list] if args.key?(:query_list)
end