Class: Google::Apis::DataprocV1::SparkSqlJob

Inherits:
Object
  • Object
show all
Includes:
Core::Hashable, Core::JsonObjectSupport
Defined in:
generated/google/apis/dataproc_v1/classes.rb,
generated/google/apis/dataproc_v1/representations.rb,
generated/google/apis/dataproc_v1/representations.rb

Overview

A Cloud Dataproc job for running Apache Spark SQL (http://spark.apache.org/sql/ ) queries.

Instance Attribute Summary collapse

Instance Method Summary collapse

Methods included from Core::JsonObjectSupport

#to_json

Methods included from Core::Hashable

process_value, #to_h

Constructor Details

#initialize(**args) ⇒ SparkSqlJob

Returns a new instance of SparkSqlJob



1119
1120
1121
 
# File 'generated/google/apis/dataproc_v1/classes.rb', line 1119

def initialize(**args)
   update!(**args)
end

Instance Attribute Details

#jar_file_uris ⇒ Array<String>

Optional HCFS URIs of jar files to be added to the Spark CLASSPATH. Corresponds to the JSON property jarFileUris

Returns:

  • (Array<String>) 


1105
1106
1107
 
# File 'generated/google/apis/dataproc_v1/classes.rb', line 1105

def jar_file_uris
  @jar_file_uris
end

#logging_config ⇒ Google::Apis::DataprocV1::LoggingConfig

The runtime logging config of the job. Corresponds to the JSON property loggingConfig

Returns:



1110
1111
1112
 
# File 'generated/google/apis/dataproc_v1/classes.rb', line 1110

def logging_config
  @logging_config
end

#properties ⇒ Hash<String,String>

Optional A mapping of property names to values, used to configure Spark SQL's SparkConf. Properties that conflict with values set by the Cloud Dataproc API may be overwritten. Corresponds to the JSON property properties

Returns:

  • (Hash<String,String>) 


1117
1118
1119
 
# File 'generated/google/apis/dataproc_v1/classes.rb', line 1117

def properties
  @properties
end

#query_file_uri ⇒ String

The HCFS URI of the script that contains SQL queries. Corresponds to the JSON property queryFileUri

Returns:

  • (String) 


1089
1090
1091
 
# File 'generated/google/apis/dataproc_v1/classes.rb', line 1089

def query_file_uri
  @query_file_uri
end

#query_list ⇒ Google::Apis::DataprocV1::QueryList

A list of queries to run on a cluster. Corresponds to the JSON property queryList

Returns:



1094
1095
1096
 
# File 'generated/google/apis/dataproc_v1/classes.rb', line 1094

def query_list
  @query_list
end

#script_variables ⇒ Hash<String,String>

Optional Mapping of query variable names to values (equivalent to the Spark SQL command: SET name="value";). Corresponds to the JSON property scriptVariables

Returns:

  • (Hash<String,String>) 


1100
1101
1102
 
# File 'generated/google/apis/dataproc_v1/classes.rb', line 1100

def script_variables
  @script_variables
end

Instance Method Details

#update!(**args) ⇒ Object

Update properties of this object



1124
1125
1126
1127
1128
1129
1130
1131
 
# File 'generated/google/apis/dataproc_v1/classes.rb', line 1124

def update!(**args)
  @query_file_uri = args[:query_file_uri] if args.key?(:query_file_uri)
  @query_list = args[:query_list] if args.key?(:query_list)
  @script_variables = args[:script_variables] if args.key?(:script_variables)
  @jar_file_uris = args[:jar_file_uris] if args.key?(:jar_file_uris)
  @logging_config = args[:logging_config] if args.key?(:logging_config)
  @properties = args[:properties] if args.key?(:properties)
end