I left yogurt on my desk
I'm sure you'll be fine.  The yogurt would actually have to come into the temperature zone for harmful bacteria to become active, and then would have to have enough time for that bacteria to actually multiply enough to make you sick.  I have eaten room temp. yogurt many times.  You have nothing to worry about.