Can I remove User Dictionary Application itself ? not just words in it?
On my Galaxy S3, running 4.1.2, the User dictionary is a background service that can be disabled. If you are running a similar device look into the following:

Settings\App Manager\All\User Dictionary
Click the disable button.

If you are using a different device or system this could get you started in the right direction.