As I understand it, the song is in the public domain, not the performance of it.  Any copyright you might obtain would extend to your performance only.  The song itself would remain in public domain.
Once a song is in the public domain, does that mean any remake of it is public domain too?