Are there any downsides to key stretching an already high quality entropic key? For example, if we grab 50 bytes from a high quality source and run them through a key stretching function like Argon2 and have it generate a 32 byte secret for AES.

Is there any downside to this? Do we lose any entropy during this process since it comes from a high quality source already?
Even with perfectly random input, if your final key size is 32 bytes, you cannot have more than 32 bytes of entropy in it.

But it seems pretty useless to use key stretching if you already have more random bytes than your key length, you could just use 32 bytes of your 'perfect' source as an AES key. You just expose yourself to possible weakness in the key stretching algorithm without any benefit.