1. A method for persisting log data by a plurality of router-writer pairs in a computer network, the method comprising: creating, by a log persistence manager in the computer network, a writer assignment map that assigns each of a plurality of shards to a writer of the router-writer pairs, wherein each of the shards is a subset of the log data, the assignment identifying the writer assigned to persist a particular shard into a storage unit, and the assignment performed based on assignment criteria; receiving, at a router of the router-writer pairs, the shards from member computers in the computer network; and routing, by the router, the shards to corresponding writers of the router-writer pairs based on the writer assignment map.