In general a semi-colon (;) connects two independent clauses, while a comma connects an independent clause with a dependent one (like the sentence I've just written). The real issue is the difference between a semi-colon, a colon, and a period. That's more subtle.