Importing Craft CMS Locally
So having tried bringing it locally and getting a multitude of errors, I realized the live site was version 2 and I was installing version 3. 

Following the upgrade guide solved it for me (among some minor plugin tweaks).