Dust went into my MacBook left speaker
Because dust doesn't conduct well, you should not worry about anything getting damaged, especially not if it's small enough to fit through the speaker.

Fact is that a lot of dust slows down electronics, but such small quantities, as said, shouldn't be a problem.

If you still want to get it out, you should probably do as Solar Mike said and just vacuum it a little.