Big Data Tools
note
If you used Big Data Tools in 2023.1 or before, then after updating PyCharm to 2023.3, you will have all these new plugins automatically installed.
Thanks for your feedback!
Available only in PyCharm Professional: download to try or compare editions
The Big Data Tools is a set of plugins intended for data engineers.
It includes the following plugins:
Submit and monitor Spark jobs
Connect to Kafka brokers and Kafka Schema Registry, produce and consume data
Preview Parquet, ORC, Avro, and CSV files (the plugin is installed automatically with the Remote File Systems plugin)
Connect to Zeppelin, run code in notebooks, and preview output (development of the Zeppelin plugin is currently suspended)
Before PyCharm 2023.2, Big Data Tools was a single plugin, and none of its parts could be installed separately. Starting from 2023.2, you can install any of these tools as a separate plugin. You can also install the Big Data Tools plugin, which will automatically install all these six plugins.
note
If you used Big Data Tools in 2023.1 or before, then after updating PyCharm to 2023.3, you will have all these new plugins automatically installed.
Thanks for your feedback!
Our website uses some cookies and records your IP address for the purposes of accessibility, security, and managing your access to the telecommunication network. You can disable data collection and cookies by changing your browser settings, but it may affect how this website functions. Learn more.
With your consent, JetBrains may also use cookies and your IP address to collect individual statistics and provide you with personalized offers and ads subject to the Privacy Notice and the Terms of Use. JetBrains may use third-party services for this purpose. You can adjust or withdraw your consent at any time by visiting the Opt-Out page.