1. A method for updating a firmware image on a coherent hardware accelerator concurrently with executing operations on the coherent hardware accelerator, comprising: while executing accelerator-enabled operations on the coherent hardware accelerator, storing a firmware update package in a local memory on the coherent hardware accelerator; restarting the coherent hardware accelerator by: pausing the execution of at least a first operation initiated on the coherent hardware accelerator, and applying the firmware update package to the firmware image on the coherent hardware accelerator; and resuming the operation on the coherent hardware accelerator.