How to create a view with contextual filters and then make menus to filter it?
I managed to figure this out. With help from this tutorial http://www.metaltoad.com/blog/using-drupal-contextual-filters-views and the reason why the links in the menus dind't work for me were because I was using the same url as the taxonomy term had so I only got a term list. So I just changed the view url to something else than the taxonomy and it worked.

It now works if I write the view adress/any termreference without having to create a separate view for all of them.