Does adding Yosemite Tags to a File change its MD5 Signature?
I ran md5 file in Terminal.app, applied a tag to file, and re-ran md5. The hash returned was the same. Without knowing your exact setup it's impossible to know for sure, but it looks like you're OK.