Class: Google::Apis::DataprocV1beta2::SparkSqlJob
- Inherits:
-
Object
- Object
- Google::Apis::DataprocV1beta2::SparkSqlJob
- Includes:
- Core::Hashable, Core::JsonObjectSupport
- Defined in:
- generated/google/apis/dataproc_v1beta2/classes.rb,
generated/google/apis/dataproc_v1beta2/representations.rb,
generated/google/apis/dataproc_v1beta2/representations.rb
Overview
A Cloud Dataproc job for running Apache Spark SQL (http://spark.apache.org/sql/ ) queries.
Instance Attribute Summary collapse
-
#jar_file_uris ⇒ Array<String>
Optional.
-
#logging_config ⇒ Google::Apis::DataprocV1beta2::LoggingConfig
The runtime logging config of the job.
-
#properties ⇒ Hash<String,String>
Optional.
-
#query_file_uri ⇒ String
The HCFS URI of the script that contains SQL queries.
-
#query_list ⇒ Google::Apis::DataprocV1beta2::QueryList
A list of queries to run on a cluster.
-
#script_variables ⇒ Hash<String,String>
Optional.
Instance Method Summary collapse
-
#initialize(**args) ⇒ SparkSqlJob
constructor
A new instance of SparkSqlJob.
-
#update!(**args) ⇒ Object
Update properties of this object.
Methods included from Core::JsonObjectSupport
Methods included from Core::Hashable
Constructor Details
#initialize(**args) ⇒ SparkSqlJob
Returns a new instance of SparkSqlJob
2015 2016 2017 |
# File 'generated/google/apis/dataproc_v1beta2/classes.rb', line 2015 def initialize(**args) update!(**args) end |
Instance Attribute Details
#jar_file_uris ⇒ Array<String>
Optional. HCFS URIs of jar files to be added to the Spark CLASSPATH.
Corresponds to the JSON property jarFileUris
1985 1986 1987 |
# File 'generated/google/apis/dataproc_v1beta2/classes.rb', line 1985 def jar_file_uris @jar_file_uris end |
#logging_config ⇒ Google::Apis::DataprocV1beta2::LoggingConfig
The runtime logging config of the job.
Corresponds to the JSON property loggingConfig
1990 1991 1992 |
# File 'generated/google/apis/dataproc_v1beta2/classes.rb', line 1990 def logging_config @logging_config end |
#properties ⇒ Hash<String,String>
Optional. A mapping of property names to values, used to configure Spark SQL's
SparkConf. Properties that conflict with values set by the Cloud Dataproc API
may be overwritten.
Corresponds to the JSON property properties
1997 1998 1999 |
# File 'generated/google/apis/dataproc_v1beta2/classes.rb', line 1997 def properties @properties end |
#query_file_uri ⇒ String
The HCFS URI of the script that contains SQL queries.
Corresponds to the JSON property queryFileUri
2002 2003 2004 |
# File 'generated/google/apis/dataproc_v1beta2/classes.rb', line 2002 def query_file_uri @query_file_uri end |
#query_list ⇒ Google::Apis::DataprocV1beta2::QueryList
A list of queries to run on a cluster.
Corresponds to the JSON property queryList
2007 2008 2009 |
# File 'generated/google/apis/dataproc_v1beta2/classes.rb', line 2007 def query_list @query_list end |
#script_variables ⇒ Hash<String,String>
Optional. Mapping of query variable names to values (equivalent to the Spark
SQL command: SET name="value";).
Corresponds to the JSON property scriptVariables
2013 2014 2015 |
# File 'generated/google/apis/dataproc_v1beta2/classes.rb', line 2013 def script_variables @script_variables end |
Instance Method Details
#update!(**args) ⇒ Object
Update properties of this object
2020 2021 2022 2023 2024 2025 2026 2027 |
# File 'generated/google/apis/dataproc_v1beta2/classes.rb', line 2020 def update!(**args) @jar_file_uris = args[:jar_file_uris] if args.key?(:jar_file_uris) @logging_config = args[:logging_config] if args.key?(:logging_config) @properties = args[:properties] if args.key?(:properties) @query_file_uri = args[:query_file_uri] if args.key?(:query_file_uri) @query_list = args[:query_list] if args.key?(:query_list) @script_variables = args[:script_variables] if args.key?(:script_variables) end |