Clean URLs work*, but not when I submit forms?
I think you need to enable Apache's rewrite module using a2enmod rewrite or with sudo if you get permission errors and added the Apache directive AllowOverride All for VirtualHost.