This is really interesting. The plugin can't change your phone number even if you wanted. You must have done something else.
BTW, was Google Analytics code appearing in the head section?
Try reactivating the plugin. And let me know.