Hive Metastore
With the Big Data Tools plugin, you can monitor your Hive Metastore.
Typical workflow:
Create a connection to a Hive server
In the Big Data Tools tool window, click
and select Hive Metastore under the Monitoring section.In the Big Data Tools Connections window that opens, configure the connection parameters:
Mandatory parameters:
Name: the name of the connection to distinguish it between the other connections.
Properties: select how to specify your Hive configuration properties: enter them explicitly or load them from a configuration folder. If you select Explicit, you can enter a value for the
metastore.thrift.urisproperty in the URL field and enter any other properties in the Other properties field.
Optionally, you can set up:
Enable connection: deselect if you want to restrict using this connection. By default, the newly created connections are enabled.
Enable tunneling. Creates an SSH tunnel to the remote host. It can be useful if the target server is in a private network but an SSH connection to the host in the network is available.
Select the checkbox and specify a configuration of an SSH connection (click ... to create a new SSH configuration).
Database pattern: if you want to view only some of your Hive databases in the editor tab, use this field to enter a regular expression for the database names.
Table pattern: if you want to view only some of your database tables in the editor tab, use this field to enter a regular expression for the table names.
Once you fill in the settings, click Test connection to ensure that all configuration parameters are correct. Then click OK.
View databases in File Viewer
You can open the Hive Metastore or its particular catalogs, databases, and tables in a separate File Viewer (similarly to other storages).
In the Big Data Tools tool window, select a Hive Metastore connection or expand it to open a catalog, a database, or a table.
Right-click the selected element and select Open in Separate Viewer. Alternatively, click
.This will open the selected storage, catalog, database, or table in a separate tab of your editor.
Right-click a database or a table and select Show Info. The information about the selected element will be displayed to the right of it. Use
to show and hide the details panel.
Monitor databases
Once you have established a connection to the Hive server, the Hive Metastore tool window becomes available. You can use it to monitor your databases, view schemas and partitions, and configure the way the data is displayed:
Start typing a name in the Filter field to filter databases by name.
Click
to filter data by storage type.Click
to show or hide columns from the database view.
In the Location column, you can click the database URL to quickly open a directory in an HDFS or S3 viewer. If the needed connection does not exist, this will open the connection creation form.