Images in the Render Layer nodes of the Compositor disappear
OK solved. I was manually rendering each layer and the compositor was only reading the last render, which was whatever layer I had just done. I let the compositor do the work and it handled it.