Bash automatically creating () and ()! files
Bash, by itself, will not create files like this. These files are probably created by you accidentally through incorrect typing/pasting of commands.

You can remove the files using rm:

rm '()' '()!'