1. A non-transitory computer readable storage medium storing instructions for causing one or more processors to perform a method for assessing performance of a computer resource service, the method comprising: receiving one or more filters to be included in a request for performance metrics associated with the computer resource service, wherein the one or more filters comprise one or more parameters that used to determine which of the performance metrics to provide in response to the request; sending, via a network, the request to a system that is monitoring the performance metrics of test virtual machines executing on computer systems of the computer resource service; receiving, via the network, a response that includes a set of the performance metrics determined by the one or more filters, wherein the set of performance metrics comprise performance metrics associated with configurations of the test virtual machines; determining, based at least in part on the set of performance metrics, a configuration from the configurations of the test virtual machines; and initiating a virtual machine in the computer resource service according to the configuration.