How to Hide WhatsApp contact invites
There's a workaround. 
I changed the details from 'Mobile' to 'Home/Work' in my Android Contacts for all those non-Whatsapp numbers.
Now they don't show up in Whatsapp invite contact.