Software Testing

Parallel Test Execution using TestNG

Parallel Test Execution using TestNG

Parallel test execution in TestNG allows multiple test cases to run simultaneously, reducing execution time and improving efficiency. This is particularly useful for large test suites.

Enabling Parallel Execution

TestNG provides multiple ways to execute tests in parallel using the testng.xml configuration file.

Parallel Execution Options

TestNG supports parallel execution at different levels:

  • Methods: Executes test methods in parallel.
  • Classes: Executes test classes in parallel.
  • Tests: Executes test groups defined in the <suite>.
  • Instances: Executes multiple instances of the same class in parallel.

Configuring Parallel Execution

Parallel Methods Execution

Run test methods in parallel by adding the parallel="methods" attribute to <suite> and specifying the thread-count.


<suite name="Suite1" parallel="methods" thread-count="3">
    <test name="Test1">
        <classes>
            <class name="com.testingdocs.Tests"/>
        </classes>
    </test>
</suite>

Parallel Classes Execution

Run test classes in parallel:


<suite name="Suite1" parallel="classes" thread-count="3">
    <test name="Test1">
        <classes>
            <class name="com.testingdocs.Test1"/>
            <class name="com.testingdocs.Test2"/>
        </classes>
    </test>
</suite>

Parallel Tests Execution

Run multiple <test> elements in parallel:


<suite name="Suite1" parallel="tests" thread-count="2">
    <test name="Test1">
        <classes>
            <class name="com.testingdocs.Test1"/>
        </classes>
    </test>
    <test name="Test2">
        <classes>
            <class name="com.testingdocs.Test2"/>
        </classes>
    </test>
</suite>

Parallel Instances Execution

Execute multiple instances of a test class in parallel:


<suite name="Suite1">
    <test name="Test1">
        <classes>
            <class name="com.testingdocs.Test1" parallel="instances"/>
        </classes>
    </test>
</suite>

Parallel Execution Using DataProvider

TestNG allows parallel execution at the DataProvider level using parallel = true:


import org.testng.annotations.DataProvider;
import org.testng.annotations.Test;

public class ParallelDataProviderTest {

    @DataProvider(name = "testData", parallel = true)
    public Object[][] getData() {
        return new Object[][]{
            {"Data1"},
            {"Data2"},
            {"Data3"}
        };
    }

    @Test(dataProvider = "testData")
    public void testMethod(String data) {
        System.out.println(Thread.currentThread().getId() + " - Data: " + data);
    }
}

Running Parallel Tests in Maven

If using Maven, you can configure Surefire Plugin to run tests in parallel:


<build>
    <plugins>
        <plugin>
            <groupId>org.apache.maven.plugins</groupId>
            <artifactId>maven-surefire-plugin</artifactId>
            <version>3.0.0</version>
            <configuration>
                <parallel>methods</parallel>
                <threadCount>3</threadCount>
            </configuration>
        </plugin>
    </plugins>
</build>

Best Practices

Some of the best practices to follow are as follows:

  • Ensure thread safety of test methods to prevent issues in shared data.
  • Use thread-local storage where necessary.
  • Monitor CPU & memory usage when running tests in parallel.
  • Optimize thread count based on system capabilities.

Parallel execution in TestNG significantly improves test efficiency and speed. Proper configuration using testng.xml, DataProvider, or Maven Surefire Plugin enables seamless parallel execution.