Class: Google::Apis::DataprocV1::HiveJob

Inherits:
Object
  • Object
show all
Includes:
Core::Hashable, Core::JsonObjectSupport
Defined in:
lib/google/apis/dataproc_v1/classes.rb,
lib/google/apis/dataproc_v1/representations.rb,
lib/google/apis/dataproc_v1/representations.rb

Overview

A Dataproc job for running Apache Hive (https://hive.apache.org/) queries on YARN.

Instance Attribute Summary collapse

Instance Method Summary collapse

Constructor Details

#initialize(**args) ⇒ HiveJob

Returns a new instance of HiveJob.



1973
1974
1975
 
# File 'lib/google/apis/dataproc_v1/classes.rb', line 1973

def initialize(**args)
   update!(**args)
end

Instance Attribute Details

#continue_on_failure ⇒ Boolean Also known as: continue_on_failure?

Optional. Whether to continue executing queries if a query fails. The default value is false. Setting to true can be useful when executing independent parallel queries. Corresponds to the JSON property continueOnFailure

Returns:

  • (Boolean) 


1940
1941
1942
 
# File 'lib/google/apis/dataproc_v1/classes.rb', line 1940

def continue_on_failure
  @continue_on_failure
end

#jar_file_uris ⇒ Array<String>

Optional. HCFS URIs of jar files to add to the CLASSPATH of the Hive server and Hadoop MapReduce (MR) tasks. Can contain Hive SerDes and UDFs. Corresponds to the JSON property jarFileUris

Returns:

  • (Array<String>) 


1947
1948
1949
 
# File 'lib/google/apis/dataproc_v1/classes.rb', line 1947

def jar_file_uris
  @jar_file_uris
end

#properties ⇒ Hash<String,String>

Optional. A mapping of property names and values, used to configure Hive. Properties that conflict with values set by the Dataproc API may be overwritten. Can include properties set in /etc/hadoop/conf/*-site.xml, /etc/ hive/conf/hive-site.xml, and classes in user code. Corresponds to the JSON property properties

Returns:

  • (Hash<String,String>) 


1955
1956
1957
 
# File 'lib/google/apis/dataproc_v1/classes.rb', line 1955

def properties
  @properties
end

#query_file_uri ⇒ String

The HCFS URI of the script that contains Hive queries. Corresponds to the JSON property queryFileUri

Returns:

  • (String) 


1960
1961
1962
 
# File 'lib/google/apis/dataproc_v1/classes.rb', line 1960

def query_file_uri
  @query_file_uri
end

#query_list ⇒ Google::Apis::DataprocV1::QueryList

A list of queries to run on a cluster. Corresponds to the JSON property queryList

Returns:



1965
1966
1967
 
# File 'lib/google/apis/dataproc_v1/classes.rb', line 1965

def query_list
  @query_list
end

#script_variables ⇒ Hash<String,String>

Optional. Mapping of query variable names to values (equivalent to the Hive command: SET name="value";). Corresponds to the JSON property scriptVariables

Returns:

  • (Hash<String,String>) 


1971
1972
1973
 
# File 'lib/google/apis/dataproc_v1/classes.rb', line 1971

def script_variables
  @script_variables
end

Instance Method Details

#update!(**args) ⇒ Object

Update properties of this object



1978
1979
1980
1981
1982
1983
1984
1985
 
# File 'lib/google/apis/dataproc_v1/classes.rb', line 1978

def update!(**args)
  @continue_on_failure = args[:continue_on_failure] if args.key?(:continue_on_failure)
  @jar_file_uris = args[:jar_file_uris] if args.key?(:jar_file_uris)
  @properties = args[:properties] if args.key?(:properties)
  @query_file_uri = args[:query_file_uri] if args.key?(:query_file_uri)
  @query_list = args[:query_list] if args.key?(:query_list)
  @script_variables = args[:script_variables] if args.key?(:script_variables)
end