TestNG

Create a new TestNG class

1. In the Project tool window (Alt+1), right-click the package inside the Test Sources Root in which you want to create a new test class.

2. Select New | Java Class from the context menu.

3. In the Create New Class dialog, name the new class and click OK.

4. In the editor, write the code for your test class. Use the TestNG annotations where necessary. For example, you may want to annotate the whole class or individual methods:

   import org.testng.Assert; import org.testng.annotations.DataProvider; import org.testng.annotations.Test; @Test() public class SampleTest { @DataProvider public Object[][] data() { return new String[][] {new String[] {"data1"}, new String[] {"data2"}}; } @Test(dataProvider = "data") public void test(String d) { Assert.assertEquals("First Line\nSecond Line", "First Line\nSecond Line"); } }

Run TestNG tests

• To run an individual test, click in the gutter and select Run.

• To run all tests in a test class, click against the test class declaration and select Run.

You can view test results in the Run tool window.

Run tests and generate reports

In Aqua, you can add VM options, use another JDK, or enable code coverage using run configurations. You can create multiple configurations for the same test class or test suite with different settings and compare the results.

For TestNG, you can configure the listener that will generate reports for you. Creating a separate run configuration might be helpful in case you don't want to generate reports every time you run your tests.

1. In the main menu, go to Run | Edit Configurations.

2. If there are no previously created TestNG configurations, click and from the list that opens, select TestNG.

   Otherwise, select the required exising configuration from the list.

3. If it is a new configuration, give it a name.

4. From the Test kind list, select the scope of tests that you want to run. The next field will change accordingly allowing you to select specific tests to run.

5. In the Output directory field, you can specify a folder in which the IDE will place the report.

   By default, the IDE creates a new test-output folder in the project root directory, but you can use another folder or use different folders for different reports.

6. Switch to the Listeners tab, click , and add the EmailableReporter option. This will generate an HTML report.

7. Apply the changes and close the dialog.

   

8. On the toolbar, make sure that the newly created run configuration is selected and click next to it. Alternatively, press Shift+F10.

   

Create test suites in XML

You can specify test suites in .xml or .yaml files. If you are going to use YAML, make sure to add the corresponding dependency to the build file.

1. Right-click the project root folder in the Project tool window, select New | File and enter the name of the file, for example testng.xml.

2. Fill in the file with information about your tests. For more information, refer to testng.xml.

Use YAML for test suites

TestNG supports defining a test suite using YAML, however, it doesn't contain the YAML parser by default. If you want to use a YAML file, add the snakeyaml dependency. The version should correspond with the TestNG version that you use.

1. Open the build file (pom.xml or build.gradle), press Alt+Insert, and select Add dependency.

2. In the tool window that opens, type snakeyaml in the search field.

   Locate the necessary dependency, select its version in the search results, and click Add next to it.

3. Press Ctrl+Shift+O or click the notification that appears in the top-right corner of the editor to load the changes.

4. Right-click the project root folder in the Project tool window, select New | File and enter the name of the file, for example testing.yaml.

Run a test suite

To be able to run a TestNG test suite, create a run configuration for this suite:

1. In the main menu, go to Run | Edit Configurations.

2. In the left-hand pane, click and from the list that opens, select TestNG. Name the new configuration.

3. From the Test kind list, select Suite.

   The Suite field becomes available.

4. In the Suite field, click and specify the path to the XML or YAML file in which the test suite is configured.

5. In the Output directory field, you can specify a folder in which the IDE will place output files, such as test reports.

   By default, the IDE creates a new test-output folder in the project root directory, but you can use another folder or use different folders for different outputs.

6. Apply the changes and close the dialog.

   

7. On the toolbar, make sure that the newly created run configuration is selected and click next to it. Alternatively, press Shift+F10.