How can I disable and/or uninstall "Messages" from OS X Yosemite?
While Apple stock OS X apps cannot be deleted, you can remove the your Apple ID's association with the Messages app by opening Messages and clicking Messages > Preferences > Accounts.

From there you can remove your Apple ID (and therefore the phone numbers associated with it) and your problem should stop.