Has the bitcoin network ever been "down"?
A bitcoin node could be down or (extremely rarely as you say) all its peers could be down... but the bitcoin network could not be considered down; you could still synchronize by connecting to different peers manually using fallback nodes or even have your own list of nodes.

The only way for the bitcoin network to be down is if all the nodes+miners are down which would be nearly impossible even with a few dozens of nodes (current estimate is 6000+ nodes). However, in the very beginning, when there where 1 or 2-3 machines it was possible (see example in @Murch's answer, where that early on, there was only one node on the network: Satoshi's).