You can create new or edit existing local or remote Zeppelin notebooks, execute code paragraphs, preview the resulting tables and graphs, and export the results to various formats.
The plugin supports many IDE features to work with notebooks:
When you install the Big Data Tools plugin for IntelliJ IDEA, the following user interface elements appear:
Big Data Tools window
The Big Data Tools window appears in the rightmost group of the tool windows. The window displays the list of the configured servers, notebooks, and files structured by folders.
Notebooks
Data files
Basic operations on notebooks are available from the context menu.
For the basic operations with the servers, use the window toolbar:
If you have any questions regarding the Big Data Tools plugin, click the Support link and select one of the available options. You can join the support Slack channel, submit a ticket in the YouTrack system, or copy the support email to send your question.
Notebook editor
In the notebook editor, you can add and execute Python, Scala and SQL code paragraphs. When editing your code paragraph, you can use all the coding assistance features available for a particular language. Code warnings and errors will be highlighted in the corresponding code constructs in the scrollbar. The results of paragraph execution are shown in the preview area below each paragraph.
Use the notebook editor toolbar for the basic operations with notebooks:
Opens the Interpreter Bindings dialog to configure interpreters for the selected notebook.
Click this button to open the notebook in the browser or copy a link to it.
Allows you to jump to a particular paragraph of a notebook.
Shows the minimap for quick navigation through the notebook.
The notebook editor toolbar also shows the status of the last paragraph execution.
Successful
Failed
Aborted
Monitoring tool windows
These windows appear when you have connected to a Spark or Hadoop server.
Spark monitoring
Hadoop monitoring
Building your BigData project
With the dedicated project type and the corresponding wizard, you can create project in IntelliJ IDEA that has all the required Spark dependencies. You can start developing Spark applications without any additional configurations.
Create a dedicated project
Select File | New | Project from the main menu
Select Big Data from the options on the left, then ensure that the Spark type of project is specified. Click Next.
On the next page of the wizard, specify your project's name, location, build system (SBT, Gradle or Maven), JDK, and artifact coordinates.
Fields in the More settings section are populated automatically based on the project's name value. You can alter them, if needed.
Our website uses some cookies and records your IP address for the purposes of accessibility, security, and managing your access to the telecommunication network. You can disable data collection and cookies by changing your browser settings, but it may affect how this website functions. Learn more.
With your consent, JetBrains may also use cookies and your IP address to collect individual statistics and provide you with personalized offers and ads subject to the Privacy Notice and the Terms of Use. JetBrains may use third-party services for this purpose. You can adjust or withdraw your consent at any time by visiting the Opt-Out page.