Site really slow for registered users
Views supports caching the query and the rendering. 

If you have page caching enabled then it's obviously much faster and views isn't involved at all. 

There is no silver bullet to improve performance, try to install xhprof to find out where your bottlenecks are. 

Using a different cache backend like memcached can help a lot, for a start.