Countability union of all finite and countably infinite sequences over finite alphabet
Your solution for proving that $\Sigma^*$ is countable is correct.
However the set $\Sigma^\omega$ of infinite sequences is not countable,
since it is in bijection with the set of subsets of $\mathbb{N}$, which is not countable. See this question.