1. A computer-implemented method for updating a firmware image on a coherent hardware accelerator concurrently with executing operations on the coherent hardware accelerator, the computer-implemented method comprising: while executing a set of operations on the coherent hardware accelerator, storing a firmware update package in a local memory on the coherent hardware accelerator; restarting the coherent hardware accelerator by: pausing the execution of at least a first operation initiated on the coherent hardware accelerator, and applying the firmware update package to the firmware image on the coherent hardware accelerator; and while resuming the paused operation on the coherent hardware accelerator, querying a configuration of the updated coherent hardware accelerator and making the configuration available to an operating system for discovery and use in one or more subsequent operations.