Well, in fact your votes do count towards who wins electoral votes, so yes your vote does count. I'll admit I'd prefer a straight direct election to the electoral college, but if you're voting to see (say) who gets Californias 55 Electoral Votes, that's still a vote.Adam J · 8 years ago.ust because the system needs a little work does not mean your vote does not count. Barely 40% of the people came out to vote in the last election. It is a right and to not exercise your right is not smart and that goes for all rights.