1. A method, implemented at least in part by a computing device, for software upgrade analysis, the method comprising: by the computing device: receiving a selection of at least one object class of a plurality of available object classes; retrieving one or more application programming interface (API) calls from a plurality of API calls based on the received selection; generating a test definition based at least in part on the one or more API calls; executing a first test by using the one or more API calls in the test definition within a software environment wherein the first test is run on the software environment prior to upgrading the software environment; subsequent to upgrading the software environment, executing a second test by using the one or more API calls within the upgraded software environment; and generating a software upgrade report based on a comparison of test results from the first test and test results from the second test.