I'm ready to delegate to a pool. I know the easiest options are to do so using either Daedalus or Yoroi. But, how do I choose which pool to stake to and does it really matter?

I found [this post on reddit](https://www.reddit.com/r/Cardano_ELI5/comments/l004rh/how_do_i_pick_a_staking_pool_to_stake_my_ada_with/) which does a good job of describing saturation and pledge. It also discusses what the fees mean. What I'm really asking here is that I don't understand why it might matter which pool to delegate to when it seems that any one will give me about 4-6% apy over the whole year. If I'm going to get that APY no matter which pool I delegate to, why does it matter which one I delegate to?