When does DNA replicate actually?
According to This paper and most biology textbooks, S-phase or synthesis phase is literally defined by the beginning and ending of DNA replication.  The first picture does not accurately represent the nature of DNA replication and is instead a model to help people track DNA copies during stages of cell division.  DNA is replicated as chromatin and condenses to "double" chromosome form.  You can see some micrographs of DNA condensation in this paper.  You'll see that they don't condense as single chromatids, but they are already replicated.