1. A method performed by a server for performing a memory operation in a partitioned key-value store, comprising: receiving a request from an application for at least one atomic memory operation, wherein said application executes on a compute node having a client of said partitioned key-value store and said atomic memory operation comprises a memory address identifier of a memory location of said client; and in response to said atomic memory operation, said server employing one or more remote memory operations to perform one or more of (i) reading a client-side memory location identified by said memory address identifier and storing one or more key-value pairs from said client-side memory location in a local key-value store of said server; and (ii) obtaining one or more key-value pairs from said local key-value store of said server and writing said obtained one or more key-value pairs into said client-side memory location identified by said memory address identifier, wherein program control returns to said application when said server receives said request from said application for said atomic memory operation such that said application performs one or more additional tasks while said server performs said one or more remote memory operations.