A fancier way to do it that has a better trade off, is to have the serial number be on a detachable stump that can be pulled off of the ballot when it's put into the box, keeping the ballots looking the same. 