Conflicts with colleagues as a postdoc - reason enough to start looking for the next job?
I have often heard that the most valuable thing you get out of postdoc positions is the contacts you make. 


I always thought the most valuable thing you get out of postdoc positions is the research experience and the research papers. The contacts/connections would be the by-products after you conduct quality research.

You said "I'm also quite sure I haven't been able to prove myself to him yet.". If you leave now, you wasted all the efforts you spent to apply for your current postdoc job and the time you spent on the job so far only because you don't like your colleagues?

I understand you are at a well-regarded foreign university. My guess is that many of your colleagues came from different cultures/locations than yours. That's probably why you feel that they are intolerable.

My advice: concentrate on your research (which is your job). Work with your professor and those colleagues if needed. Do your best.

Edit after the OP put in some more details:

Your example sounds like you are in the wrong group in the sense of research direction. I don't quite understand why you went there in the first place. But, you are there now. I would try to stay there for a while if I were you. I would collaborate with my colleagues. I would learn beetles of Borneo from them. I would show them why beetles of New Guinea are also worth studying. I'll do my best. If it still doesn't work out after a while, then I'll quit and find another postdoc job, the right one this time.