Your server doesn’t meet the following requirements to run Craft
I would install PHP via a third-party repository. I use Ondřej Surý's and I'm pretty happy with it. It installs PHP 5.5.

https://launchpad.net/~ondrej/+archive/ubuntu/php5