1. A method comprising: providing, by a processing device, a test entity as an extension of a script execution environment, wherein the script execution environment is built on a software framework of a computer system of the processing device, and wherein the test entity comprising test entity invocation modules to implement configuration settings for a test managed by the test entity; executing, by the test entity, a test execution script to perform the test on software in view of a first configuration setting defined in the test execution script via a setup parameter of the test entity, wherein the setup parameter comprises an execution parameter that represents different hardware profiles on which the test execution script is executed, and wherein the test execution script acts as a black-box to prevent script changes from influencing the test entity; receiving, by test entity invocation logic of the test entity, a second configuration setting for the test via the setup parameter of the test entity, wherein the setup parameter provides an abstraction layer for the test entity from the first and second configuration settings, and wherein the test entity invocation logic comprises a single configuration variant; providing, by test entity invocation logic, the second configuration setting for the test to test execution logic of the test entity, wherein the second configuration setting is passed to the test execution logic from the test entity invocation logic via at least one of command-line arguments or configuration objects; modifying, by the test execution logic in runtime of the test execution script, the first configuration setting into the second configuration setting within the test execution script, wherein the abstraction layer enables the test execution logic to modify the test execution script without restarting the test execution script; and causing, by the processing device in the runtime of the test execution script without restarting the test execution script, the test execution script to perform the test on the software in view of the second configuration setting, wherein the test execution script utilizes multiple threads to perform the test concurrently with other tests, wherein the test is select by choosing a form of at least one of test identification or test name, and wherein the test comprises execution information in runtime.