Requesting a professor I barely know a recommendation letter for postdoc
Recommendation letters for students one knows well are relatively easy to write.

Recommendation letters for students one doesn't know well are very difficult to write and potentially take twice as long as the ones for students one knows well. Asking someone who doesn't know you to write one was a stretch, and though it would have been more polite of that person to kindly tell you "no", this was very likely a silent "no".

Think of it this way: recommendations are sort of a covenant we have with the students we teach, postdocs we supervise, or colleagues we work closely with. It is part of the reward that comes with doing well in your studies or research, you don't just get your marks or your degree, you get the recommendation too. If you haven't earned that with someone, it's just a time suck for them to try to come up with something to say about you based on the CV you give them.

I doubt you have messed anything up permanently; they may not even remember this happened. I don't think ill of anyone that I've opted not to write a recommendation for. I'd just be hesitant to ask anything more of that person until you've earned it via collaboration.