1. A method comprising: determining, by a computing device, a plurality of test cases to test an application; determining, by the computing device, a set of attributes assigned to each test case in the plurality of test cases, wherein the set of attributes are determined without execution of each test case; calculating, by the computing device, a test case risk score for each test case in the plurality of test cases based on the set of attributes associated with each respective test case, wherein the test case risk score quantifies a risk in not executing each respective test case; selecting, by the computing device, a first subset of the plurality of test cases based on at least a portion of the calculated risk scores; and outputting, by the computing device, a test plan including the first subset of the plurality of test cases along with a test plan risk score that quantifies the risk in not executing a second subset of the plurality of test cases not included in the first subset of the plurality of test cases, wherein the test plan does not include the second subset of the plurality of test cases.