Can I delete things safely from ~/Library?
To see which folders inside ~/Library use most of the space, run something like

cd ~/Library; du -sm * | sort -rn | head -16


in Terminal which gives you the 16 folders using the most space.

Specific cleanup actions afterwards depend on the folders found.