Are there blue foods out there?
A few that came immediately to mind:


Blueberries
Purple potatoes (sort of blue-violet)
Blue corn (readily found in the form of corn chips)
Lobsters are blueish (until cooked when they turn bright red, so nobody thinks of them as blue)
Some edible flowers


An excellent answer can be found at Skeptics.SE, complete with lots of pictures.