Hive Metastore
With the Big Data Tools plugin, you can monitor your Hive Metastore.
Typical workflow:
Connect to a Hive Metastore server
In the Big Data Tools window, click
and select Hive Metastore.In the Big Data Tools dialog that opens, specify the connection parameters:
Name: the name of the connection to distinguish it between the other connections.
Properties: select how to specify your Hive configuration properties: enter them explicitly or load them from a configuration folder. If you select Explicit, you can enter a value for the
metastore.thrift.urisproperty in the URL field and enter any other properties in the Other properties field.
Optionally, you can set up:
Per project: select to enable these connection settings only for the current project. Deselect it if you want this connection to be visible in other projects.
Enable connection: deselect if you want to restrict using this connection. By default, the newly created connections are enabled.
Enable tunneling: creates an SSH tunnel to the remote host. It can be useful if the target server is in a private network but an SSH connection to the host in the network is available.
Select the checkbox and specify a configuration of an SSH connection (click ... to create a new SSH configuration).
Enable HTTP basic authentication: connection with the HTTP authentication using the specified username and password.
Database pattern: if you want to view only some of your Hive databases in the editor tab, use this field to enter a regular expression for the database names.
Table pattern: if you want to view only some of your database tables in the editor tab, use this field to enter a regular expression for the table names.
Once you fill in the settings, click Test connection to ensure that all configuration parameters are correct. Then click OK.
View databases in the editor
You can open the Hive Metastore or its particular catalogs, databases, and tables in a separate tab of the editor (similarly to other storages).
In the Big Data Tools tool window, select a connection to your Hive Metastore or expand it to open a catalog, a database, or a table.
Right-click the selected element and select Open in Editor. Alternatively, click
.This will open the selected storage, catalog, database, or table in a separate tab of your editor.
On the right side of the opened tab, use
to show and hide the details about the selected element.
Monitor databases
Once you have established a connection to the Hive server, the Hive Metastore tool window becomes available. You can use it to monitor your databases, view schemas and partitions, and configure the way the data is displayed:
Start typing a name in the Filter field to filter databases by name.
Click
to filter data by storage type.Click
to show or hide columns from the database view.
In the Location column, you can click the database URL to quickly open a directory in an HDFS or S3 viewer. If the needed connection does not exist, this will open the connection creation form.