Can you connect an output pin from one Arduino to the input pin of another?
Yes, you can. That is indeed the most easy way of communication.

And like you said, you have to connect the grounds of both arduino's. 

Optionally you could add a pull-up of pull-down resistor, so the countdown doesn't accidentally start if the first arduino is still starting up, or is disconnected.