12. A cluster computing system, comprising: a job scheduling node coupled to a network, the job scheduling node including a processor configured to execute computer-executable instructions of a job scheduling process, wherein the job scheduling node executes the job scheduling process for generating a job state object for a job to be executed by a distributed application executed by a plurality of compute nodes of the cluster computing system, wherein the job state object comprises a file that includes a database for storing job metadata that includes at least job status information; a first compute node coupled to the network, the first compute node including a first compute node processor configured to execute computer-executable instructions for causing the first compute node to: execute at least one process of the distributed application for execution of the job; receive the job state object from the scheduling node via the network; access the database of the job state object to update the job metadata in connection with execution of a portion of the job while the job state object is at the first compute node; and provide to at least a second compute node of the cluster computing system access to the job metadata in the database of the job state object; and transmit, via the network, an address of the job state object at the second compute node to a state tracker node of the cluster computing system, the state tracker node executing a state tracking process for storing the address of the job state object in a state location database; the second compute node coupled to the network, the second compute node including a second compute node processor configured to execute computer-executable instructions for causing the second compute node to: receive the job state object including the metadata in the database of the job state object from the first compute node; execute at least one additional process of the distributed application for additional execution of the job; and access the database of the job state object to update the job metadata in connection with the additional execution of the job while the job state object is at the second compute node; and the state tracker node coupled to the network, the state tracker node including another compute node processor configured to execute computer-executable instructions for causing the state tracker node to: receive, from the first compute node, the address of the job state object indicating a location of the job state object at the second compute node; and store the address of the job state object in the state location database.
12. A cluster computing system, comprising: a job scheduling node coupled to a network, the job scheduling node including a processor configured to execute computer-executable instructions of a job scheduling process, wherein the job scheduling node executes the job scheduling process for generating a job state object for a job to be executed by a distributed application executed by a plurality of compute nodes of the cluster computing system, wherein the job state object comprises a file that includes a database for storing job metadata that includes at least job status information; a first compute node coupled to the network, the first compute node including a first compute node processor configured to execute computer-executable instructions for causing the first compute node to: execute at least one process of the distributed application for execution of the job; receive the job state object from the scheduling node via the network; access the database of the job state object to update the job metadata in connection with execution of a portion of the job while the job state object is at the first compute node; and provide to at least a second compute node of the cluster computing system access to the job metadata in the database of the job state object; and transmit, via the network, an address of the job state object at the second compute node to a state tracker node of the cluster computing system, the state tracker node executing a state tracking process for storing the address of the job state object in a state location database; the second compute node coupled to the network, the second compute node including a second compute node processor configured to execute computer-executable instructions for causing the second compute node to: receive the job state object including the metadata in the database of the job state object from the first compute node; execute at least one additional process of the distributed application for additional execution of the job; and access the database of the job state object to update the job metadata in connection with the additional execution of the job while the job state object is at the second compute node; and the state tracker node coupled to the network, the state tracker node including another compute node processor configured to execute computer-executable instructions for causing the state tracker node to: receive, from the first compute node, the address of the job state object indicating a location of the job state object at the second compute node; and store the address of the job state object in the state location database. 15. The cluster computing system as recited in claim 12 , wherein the metadata for the job further includes job history information.