SQL Azure not using available memory
Turns out that even if you pay for reserved resurces and are guaranteed 8GB of RAM, you aren't really guaranteed it. And it's not really reserved for you. In our case it turned out that another Windows Azure customer was using too much resources and our database got 1GB instead of 8.