Class: Google::Apis::DataprocV1beta2::SparkSqlJob

Inherits:
Object
  • Object
show all
Includes:
Core::Hashable, Core::JsonObjectSupport
Defined in:
lib/google/apis/dataproc_v1beta2/classes.rb,
lib/google/apis/dataproc_v1beta2/representations.rb,
lib/google/apis/dataproc_v1beta2/representations.rb

Overview

A Dataproc job for running Apache Spark SQL (http://spark.apache.org/sql/) queries.

Instance Attribute Summary collapse

Instance Method Summary collapse

Constructor Details

#initialize(**args) ⇒ SparkSqlJob

Returns a new instance of SparkSqlJob.



3188
3189
3190
 
# File 'lib/google/apis/dataproc_v1beta2/classes.rb', line 3188

def initialize(**args)
   update!(**args)
end

Instance Attribute Details

#jar_file_uris ⇒ Array<String>

Optional. HCFS URIs of jar files to be added to the Spark CLASSPATH. Corresponds to the JSON property jarFileUris

Returns:

  • (Array<String>) 


3158
3159
3160
 
# File 'lib/google/apis/dataproc_v1beta2/classes.rb', line 3158

def jar_file_uris
  @jar_file_uris
end

#logging_config ⇒ Google::Apis::DataprocV1beta2::LoggingConfig

The runtime logging config of the job. Corresponds to the JSON property loggingConfig

Returns:



3163
3164
3165
 
# File 'lib/google/apis/dataproc_v1beta2/classes.rb', line 3163

def logging_config
  @logging_config
end

#properties ⇒ Hash<String,String>

Optional. A mapping of property names to values, used to configure Spark SQL's SparkConf. Properties that conflict with values set by the Dataproc API may be overwritten. Corresponds to the JSON property properties

Returns:

  • (Hash<String,String>) 


3170
3171
3172
 
# File 'lib/google/apis/dataproc_v1beta2/classes.rb', line 3170

def properties
  @properties
end

#query_file_uri ⇒ String

The HCFS URI of the script that contains SQL queries. Corresponds to the JSON property queryFileUri

Returns:

  • (String) 


3175
3176
3177
 
# File 'lib/google/apis/dataproc_v1beta2/classes.rb', line 3175

def query_file_uri
  @query_file_uri
end

#query_list ⇒ Google::Apis::DataprocV1beta2::QueryList

A list of queries to run on a cluster. Corresponds to the JSON property queryList

Returns:



3180
3181
3182
 
# File 'lib/google/apis/dataproc_v1beta2/classes.rb', line 3180

def query_list
  @query_list
end

#script_variables ⇒ Hash<String,String>

Optional. Mapping of query variable names to values (equivalent to the Spark SQL command: SET name="value";). Corresponds to the JSON property scriptVariables

Returns:

  • (Hash<String,String>) 


3186
3187
3188
 
# File 'lib/google/apis/dataproc_v1beta2/classes.rb', line 3186

def script_variables
  @script_variables
end

Instance Method Details

#update!(**args) ⇒ Object

Update properties of this object



3193
3194
3195
3196
3197
3198
3199
3200
 
# File 'lib/google/apis/dataproc_v1beta2/classes.rb', line 3193

def update!(**args)
  @jar_file_uris = args[:jar_file_uris] if args.key?(:jar_file_uris)
  @logging_config = args[:logging_config] if args.key?(:logging_config)
  @properties = args[:properties] if args.key?(:properties)
  @query_file_uri = args[:query_file_uri] if args.key?(:query_file_uri)
  @query_list = args[:query_list] if args.key?(:query_list)
  @script_variables = args[:script_variables] if args.key?(:script_variables)
end