Mac kernel panic - memory problem
Did you disable your swap file? As ghoppe, bmike, and I mention in the top answers to this question, this is a bad idea for exactly the problems you're having.

The other option is that you have bad RAM. Run a memory checker (like Memtest86) to see it you have a bad stick or two and remove and replace the offending modules.