Apple Mail Client without “All Mail” folder
In the GMAIL settings, it says show or not the All Mail folder in IMAP:



So, it is your choice to show the All Mail folder on your computer or not.

There is nothing to break by choosing which folders will show on your computer from mama google's web email.

The All Mail folder is a feature of the Gmail, not your email program. So if you do not want to see it locally then disable it. Also All mail is just a bucket where a duplicate from all other folders reside for easy search. It is not real folder, just a collection of emails from other folders.