1. A distributed computing system, comprising: a plurality of worker nodes, each configured to crawl a portion of an interactive client-server application; and a master node comprising a processor coupled to a memory, the memory comprising a master state graph, the master state graph comprising the results of at least of the worker nodes crawling a portion of the interactive client-server application; wherein the master node is configured to: examine the master state graph to determine a number of reconverging traces, wherein: a trace comprises an alternating sequence of states and transitions representing valid behavior of the interactive client-server application; a reconvergent trace comprises a trace comprising a reconvergent state; and a reconvergent state is a state that can be reached through two or more distinct traces of the web application's behavior; and if the number of reconverging traces is below a threshold, receive a first result from the execution of a first job from a first worker node, the result containing states and transitions associated with crawling a first portion of the interactive client-server application; and add the first result to the master state graph without attempting to remove duplicate states or transitions.