Testing
Share:
These questions were only shown to the respondents who said they work as a Tester / QA Engineer or are involved in testing as part of their jobs.
79%
of all respondents say testing plays an integral role in their development, which is four percentage points more than last year.
63%
of surveyed respondents say they are personally involved in test automation.
Unit
Integration
End-to-End
Performance
Other
None
85%
of those who have unit tests in their projects write them on their own.
In-house testing
Outsource testing
Assessors
Other
46%
of respondents use test case design as part of their testing process.
59%
of respondents report that – in their companies – the same people take part in both test design and test execution.
The usage of performance, regression, and stress testing rose compared to last year, while functional and usability testing was used less often despite still being in the top-5 testing types.
72%
77%
Functional testing
48%
43%
Performance testing
48%
44%
Regression testing
42%
45%
Acceptance testing
32%
39%
Usability testing
63%
of those who use unit tests also use test coverage metrics.
Test / QA Engineers have become more in-demand and highly skilled. The share of projects where there is more than 1 QA per 10 developers increased by four percentage points compared to last year. The same growth is seen among projects where 76-100% of QAs have programming skills. Respectively, the share of those who do only manual testing has declined.
40%
44%
Less than 1 QA per 10 developers
31%
29%
1–3 QAs per 10 developers
7%
5%
4–6 QAs per 10 developers
1%
1%
7–8 QAs per 10 developers
2%
3%
9–10 QAs per 10 developers
1%
1%
More QAs than developers
18%
18%
I'm not sure
33%
35%
0–25%
12%
12%
26–50%
7%
7%
51–75%
24%
20%
76–100%
23%
26%
I don't know
Office documents
I don’t use any specific tools
Special test case management tools
Other
The share of those who use specific tools for test case storage increased by nine percentage points compared to last year. Test automation coverage did not change much compared to last year. The share of projects with at least half of the tests automated is still slightly higher than 50%.
All
Most
Half
Only some
None
I'm not sure
34%
29%
Postman
31%
34%
JUnit
25%
23%
Jest
20%
15%
Pytest
19%
20%
Selenium WebDriver
The top five languages used for test automation didn’t change from last year and still are JavaScript/TypeScript, Python, Java, C#, and PHP.
14%
of respondents say they use AI/ML in testing their projects, which is six percentage points more than last year.
Behavior Driven Development is becoming more and more widespread, adding five percentage points since last year. Now, 17% of respondents say they use some BDD technologies.
JetBrains AquaNew
Looking for a powerful tool for test automation? Get JetBrains Aqua and boost your productivity by developing more reliable automated tests which require less maintenance.
Based on your valuable feedback, Aqua supports the most popular programming languages and automation testing frameworks. Subscribe to our blog to receive news about the latest improvements, and be sure to follow us on Twitter!
Find the right tool
Thank you for your time!
We hope you found our report useful. Share this report with your friends and colleagues.
If you have any questions or suggestions, please contact us at surveys@jetbrains.com.