DOC: start 1.0.4
NOTE: opened against 1.0.x branch as to not commit to release at this stage.

I think could backport a few PRs moving the whatsnews and only after a release remove from 1.1 whatsnew on master. This gives us the chance to easily abandon the release at any time.