On the last day of the meeting , it was decided that the first Olympic Games , to be controlled by the IOC , would take place two years later in Athens . On the last day of the Congress , it was decided that the first Olympic Games , to come under the auspices of the IOC , would take place two years later in Athens .