Browsing in Finder is extremely slow while fine in Terminal
I found it. It was automounted NFS shares that makes Finder unstable (even for local folders). I used hard,intr mount options so the disconnect dialog was not showing up. Now I use crankd in PyMacAdmin so that they are only mounted when I'm in my home network.