PKG: remove pyproject.toml for now
Since this gives problems, it might be better to remove this until support in pip is better? 
Eg I also have errors on the geopandas CI when installing pandas master with pip due to this.

Scipy did something similar: https://github.com/scipy/scipy/pull/8735