 His father was Sir Alexander Fraser (1570–1636), and his mother was Lady Margaret Abernethy, daughter of Sir George Abernethy, 7th Lord Saltoun of Abernethy.He entered King's College, Aberdeen, in 1619.Upon the death of his father in 1636, he inherited the lands of Philorth as its 10th Laird.