Python for data science
To perform scientific computing and data visualization, select the Python project type in the New Project wizard.
When choosing the Python project type, you need to ensure that you have conda installed. Once this is done, all you need is to specify the project name.
Note that to work with Matplotlib, Numpy, Plotly, or pandas, you need to install these packages on your Python interpreter.
Analyze data
View data structures
When viewing variables in the Python Console, you can click View as Array, View as DataFrame, or View as Series links to display the data in the Data View tool window.
By default, the new table representation is used. Click
Switch Between Table Representations to change the table interface.
Click
Table Coloring Options to toggle and configure cell coloring.
Dataframes and series can be displayed in tabular or graphical form. By default, tables are shown. To toggle the view mode, use the corresponding icons in the upper left corner.
![View dataframe as a table View dataframe as a table](https://resources.jetbrains.com/help/img/idea/2024.2/py_table_view.png)
Work with tables
Sort data
To sort the table data based on the column values, you can either click the column name or select Ascending or Descending from the ORDER BY section in the context menu.
To add another column to sorting, you can either click the column name while pressing Alt or select Ascending or Descending from the Add to ORDER BY section in the context menu.
The data will be sorted by selected columns.
State
Description
Indicates that the data is not sorted in this column. The initial state of the sorting marker.
The data is sorted in the ascending order.
The data is sorted in the descending order.
The number to the right of the marker (1 on the picture) is the sorting level. You can sort by more than one column. In such cases, different columns will have different sorting levels.
View column statistics
By default, column statistics are turned off.
To change the default mode to Compact or Detailed, navigate to .
The Compact mode includes only Missing
and Count
statistics:
![Column statistics in a compact mode Column statistics in a compact mode](https://resources.jetbrains.com/help/img/idea/2024.2/py_ds_compact_statistics.png)
For numeric data, histograms are plotted and shown together with statistics. Hover over the histogram to view detailed information about each bar.
To view detailed column statistics, do one of the following:
Hover over a column name. A popup with column statistics appears.
Click
Show Column Statistics and select Detailed.
The detailed statistics are shown above the columns.
![Column statistics for non-numeric data Column statistics for non-numeric data](https://resources.jetbrains.com/help/img/idea/2024.2/py_ds_column_stats_non_numeric.png)
- Data type
Shows the data type the column belongs to
- Missing
Shows the number of
None
values in the column- Count
Shows the total number of items in a column
- Distinct
Shows the number of unique values
- Top
Shows the most popular value
- Frequency
Shows the number of times an element occurs
![Column statistics for numeric data Column statistics for numeric data](https://resources.jetbrains.com/help/img/idea/2024.2/py_ds_column_stats_numeric.png)
- Data type
Shows the data type the column belongs to
- Missing
Shows the number of
None
values in the column- Count
Shows the total number of items in a column
- Mean
Shows the average number of all values in the column
- Std. Deviation
Shows the standard deviation value
- Min
Shows the minimum value in the column
- Pctl
Shows values for 5th, 25th, 50th( Median) and 95th percentiles
- Max
Shows the maximum value in the column
Work with charts
To view dataframes or series in a graphical form, click Show Chart.
![View data as a chart View data as a chart](https://resources.jetbrains.com/help/img/idea/2024.2/py_chart_view.png)
The data will be displayed in the form of a chart. You can change the type of chart and configure additional settings.
![Data displayed as a chart Data displayed as a chart](https://resources.jetbrains.com/help/img/idea/2024.2/py_ds_chart_displayed.png)
Configure charts
Click
Show series settings to change the initial settings of the chart.
Select the chart type and configure the settings. You can choose one of the following chart types:
Bar
Pie
Area
Line
Scatter
Bubble
Stock
AreaRange
Histogram
Click the Add new series link to add more series to the chart.
Save a chart as an image
Click
Export to PNG to save the generated chart in the .png format.
Enter the filename and click Save.
View data visualizations
Data visualizations are displayed in the Plots tool window, allowing you to resize it and to zoom it in and out.
To save a plot, right-click the preview thumbnail and select Save as Image or Save All Plots from the context menu.
![Matplotlib debugging Matplotlib debugging](https://resources.jetbrains.com/help/img/idea/2024.2/py_matplotlib_debug.png)
When stopping on a breakpoint, the plot being debugged appears in the Plots tool window. See the Debug section of the Data Science project tutorial.
Matplotlib and Plotly are also available in the console. See the Running in console section of the Data Science project tutorial. When starting a Python console ( ), one can import required packages and build graphs as required:
![Building graphs with matplotlib in Python console Building graphs with matplotlib in Python console](https://resources.jetbrains.com/help/img/idea/2024.2/py_matplotlib.png)
The Java console is accessible for further inputs.