Choice of preferred IUPAC names
Quoting the Introduction (P-10) of the IUPAC Blue Book (Nomenclature of Organic Chemistry: IUPAC Recommendations and Preferred Names 2013):

[...] We have developed rules for assigning 'preferred IUPAC names', while continuing to allow alternative names in order to preserve the diversity and adaptability of the nomenclature to daily activities in chemistry [...]
Thus the existence of preferred IUPAC names does not prevent the use of other names to take into account a specific context or to emphasize structural features common to a series of compounds. Preferred IUPAC names (PINs) belong to a 'preferred IUPAC nomenclature'. Any name other than a preferred IUPAC name, as long as it is unambiguous and follows the principles of the IUPAC recommendations herein, is acceptable as a 'general IUPAC name', in the context of a 'general IUPAC nomenclature'.

Therefore, there may be multiple names for a compound which are allowable in IUPAC nomenclature, one or more of which may be a trivial name (or derived from one). Note that there is no stipulation that the PIN must be the systematically obtained name. So, for a compound with a trivial name, either the systematic name or the trivial name may be chosen as the PIN. How does IUPAC choose which one is the PIN?
It might not be the answer we are looking for, but the end of the day, I strongly suspect it is simply arbitrary. The examples you have cited are very illustrative. Here is one more inconsistency which, to the best of my knowledge, is arbitrary.
&quot;Acetic acid&quot; is a PIN that may be modified by substitution (P-65-1.1.1), but only to a limited degree (P-15.1.8.2.1). Therefore &quot;bromoacetic acid&quot; is also a PIN. On the other hand, acetylene is also a PIN; however, substitution of any kind of not allowed (P-31.1.2.1). So, instead of bromoacetylene, the PIN is bromoethyne. (Bromoacetylene, however, remains acceptable within general use. All the names listed below that aren't followed by &quot;(PIN)&quot; are acceptable within general use.)

What makes IUPAC decide that - for PIN purposes - one trivial name is substitutable, whereas another is not? Or in the examples you have cited, why is one trivial name the PIN whereas another isn't? Of course, the rules state that it must be so, but to the best of my knowledge, there isn't any explanation of the philosophy behind the choice of PIN. Maybe I'll be proven wrong, though, and I'd be glad to see it.
To be honest, if you could come up with one, I'd be surprised. It's very tough to draw a line. Maybe we can agree that &quot;acetone&quot; should be a PIN, but should &quot;neopentane&quot; be a PIN as well? How about &quot;estrogen&quot;? Someone has to just arbitrarily choose where to draw a line, and it just so happens that IUPAC has gone with something stricter that doesn't use &quot;acetone&quot; as a PIN.
Anyway, just to reiterate - many of these names are perfectly valid IUPAC names. It is just that, for one reason or another, IUPAC has not selected them as preferred IUPAC names.