Why can't Safari open RSS feeds?
Based on the error message, I tried the following command and solved the problem:

chown -R username: ~/Library/Safari


So I guess there are some files or directories which does not belong to me. It's weird how could this happen because I never touched that directory manually before.