How do I allow users to remove their pictures from their user profile?
If you use Field Permisions module, you should check the permission settings for that field. There are 5 permissions for each field: "Create own, edit own, edit anyone's, view own, view anyone's". It seems that you didn't give the 'edit own value' permission to users.