1. A method comprising: storing, in a memory, a plurality of files, the plurality of files including a first file and a second file that are used by an application, wherein each file in the plurality of files has a respective file name; storing, in the memory, a plurality of tests, the plurality of tests including a first test and a second test that are used to test the application, wherein each test in the plurality of tests has a respective test name; storing, in the memory, a plurality of test results, the plurality of test results including a first test result, which includes a first file name of the first file, which was updated by the application after a first update was applied to the application, a first test name of the first test, and a first test metric based on the first test; storing, in the memory, a correlation matrix, which associates the first file name and the first test name with a first correlation between the first file and the first test based on the first test metric; receiving a second update to the application, wherein the second update includes a first test profile including a first plurality of test names designated as test failure candidates; detecting the first test profile; detecting a second file name of the second file, which is updated by the application after the second update is applied to the application; detecting, by querying the correlation matrix with the second file name, a second correlation between the second file and the second test; building a first test plan based on at least the second correlation and the first test profile, wherein the first test plan includes an ordered list of a second plurality of test names including the second test name and the first plurality of test names, and wherein the second test name and the first plurality of test names are respectively ordered based on at least a plurality of correlations from the correlation matrix including the second correlation; running the first test plan based on the ordered list; detecting a first failure of the second test; generating a second test result, which includes the second file name, the second test name, and a second test metric based on the second test; and updating, in the correlation matrix, the second correlation between the second file and the second test, based on the second test metric.