Class: Google::Apis::DataprocV1::SparkSqlJob

Inherits:
Object
  • Object
show all
Includes:
Core::Hashable, Core::JsonObjectSupport
Defined in:
lib/google/apis/dataproc_v1/classes.rb,
lib/google/apis/dataproc_v1/representations.rb,
lib/google/apis/dataproc_v1/representations.rb

Overview

A Dataproc job for running Apache Spark SQL (http://spark.apache.org/sql/) queries.

Instance Attribute Summary collapse

Instance Method Summary collapse

Constructor Details

#initialize(**args) ⇒ SparkSqlJob

Returns a new instance of SparkSqlJob.



3324
3325
3326
 
# File 'lib/google/apis/dataproc_v1/classes.rb', line 3324

def initialize(**args)
   update!(**args)
end

Instance Attribute Details

#jar_file_uris ⇒ Array<String>

Optional. HCFS URIs of jar files to be added to the Spark CLASSPATH. Corresponds to the JSON property jarFileUris

Returns:

  • (Array<String>) 


3294
3295
3296
 
# File 'lib/google/apis/dataproc_v1/classes.rb', line 3294

def jar_file_uris
  @jar_file_uris
end

#logging_config ⇒ Google::Apis::DataprocV1::LoggingConfig

The runtime logging config of the job. Corresponds to the JSON property loggingConfig

Returns:



3299
3300
3301
 
# File 'lib/google/apis/dataproc_v1/classes.rb', line 3299

def logging_config
  @logging_config
end

#properties ⇒ Hash<String,String>

Optional. A mapping of property names to values, used to configure Spark SQL's SparkConf. Properties that conflict with values set by the Dataproc API may be overwritten. Corresponds to the JSON property properties

Returns:

  • (Hash<String,String>) 


3306
3307
3308
 
# File 'lib/google/apis/dataproc_v1/classes.rb', line 3306

def properties
  @properties
end

#query_file_uri ⇒ String

The HCFS URI of the script that contains SQL queries. Corresponds to the JSON property queryFileUri

Returns:

  • (String) 


3311
3312
3313
 
# File 'lib/google/apis/dataproc_v1/classes.rb', line 3311

def query_file_uri
  @query_file_uri
end

#query_list ⇒ Google::Apis::DataprocV1::QueryList

A list of queries to run on a cluster. Corresponds to the JSON property queryList

Returns:



3316
3317
3318
 
# File 'lib/google/apis/dataproc_v1/classes.rb', line 3316

def query_list
  @query_list
end

#script_variables ⇒ Hash<String,String>

Optional. Mapping of query variable names to values (equivalent to the Spark SQL command: SET name="value";). Corresponds to the JSON property scriptVariables

Returns:

  • (Hash<String,String>) 


3322
3323
3324
 
# File 'lib/google/apis/dataproc_v1/classes.rb', line 3322

def script_variables
  @script_variables
end

Instance Method Details

#update!(**args) ⇒ Object

Update properties of this object



3329
3330
3331
3332
3333
3334
3335
3336
 
# File 'lib/google/apis/dataproc_v1/classes.rb', line 3329

def update!(**args)
  @jar_file_uris = args[:jar_file_uris] if args.key?(:jar_file_uris)
  @logging_config = args[:logging_config] if args.key?(:logging_config)
  @properties = args[:properties] if args.key?(:properties)
  @query_file_uri = args[:query_file_uri] if args.key?(:query_file_uri)
  @query_list = args[:query_list] if args.key?(:query_list)
  @script_variables = args[:script_variables] if args.key?(:script_variables)
end