Plugin not showing up in CP
Well, I deleted the whole contactform folder, downloaded it again, and added it back to the plugins folder. Just to be safe, I ran service httpd restart. After that, it showed up immediately. 

I can't be sure, but I'm assuming that there was just something wrong with the originally downloaded files. 

I hope this helps someone else in the future.