Setting individual cap size on Time Machine storage on OS X Server
You could use Profile Manager in order to do so and setup individual limits per machine.

Login to Profile Manager and register your device (i.e. by downloading the profile to it) if not already done. Then you should be able to setup every single fine grained setting you want for that device without the need of any terminal-hacks or external tools.