I flew the wrong pattern at an uncontrolled airport... Should I be worried?
Don't worry about it too much.  Are you specifically asking what are the odds of getting a phone call about this?  I'm not sure this is a really good question for Stack Exchange.  If you are really worried about it, fill out one of those mistake-reporting forms just in case -- https://asrs.arc.nasa.gov/ 

Newish/ overloaded pilots at unfamiliar airports have been known to overfly the field, look at the wind sock, and then proceed to set up a landing in exactly the wrong direction.  It happens.  Try to be aware of when you are getting over-loaded and double-check yourself.  

Live and learn-- you lived, so learn.