Python Client for Dataproc Metastore¶
Dataproc Metastore is a fully managed, highly available, autoscaled, autohealing, OSS-native metastore service that greatly simplifies technical metadata management. Dataproc Metastore service is based on Apache Hive metastore and serves as a critical component towards enterprise data lakes.
In order to use this library, you first need to go through the following steps:
Install this library in a virtualenv using pip. virtualenv is a tool to create isolated Python environments. The basic problem it addresses is one of dependencies and versions, and indirectly permissions.
With virtualenv, it’s possible to install this library without needing system install permissions, and without clashing with the installed system dependencies.
pip install virtualenv virtualenv <your-env> source <your-env>/bin/activate <your-env>/bin/pip install google-cloud-dataproc-metastore
pip install virtualenv virtualenv <your-env> <your-env>\Scripts\activate <your-env>\Scripts\pip.exe install google-cloud-dataproc-metastore
Read the Client Library Documentation for Dataproc Metastore to see other available methods on the client.
Read the Dataproc Metastore Product documentation to learn more about the product and see How-to Guides.
View this README to see the full list of Cloud APIs that we cover.
Because this client uses
grpc library, it is safe to
share instances across threads. In multiprocessing scenarios, the best
practice is to create client instances after the invocation of
This package includes clients for multiple versions of the Dataproc Metastore
API. By default, you will get
v1, the latest version.
v1 API Reference¶
v1beta API Reference¶
v1alpha API Reference¶
For a list of all