Can the other player put Draw 2 if your Draw 2 was the last card?
The game is over.

After the first player plays their Draw 2, their turn is over. If their turn ends and they have no cards, they win the game. There is no opportunity for a counter-play in this situation.