Authoritative Books on Subprime Mortgage Crisis
Trying to think of what's on my bookshelf... this is an incomplete list, but it should get you started.

The Financial Crisis Inquiry Commission Report is the authoritative overview of the housing crisis and its role in the financial crisis. It's unique in that the staff of the FCIC was able to interview essentially all the major players and had access to documents that were (and many of which still are) unavailable to the public. It's also free.

The American Mortgage System: Crisis and Reform by Susan Wachter (editor) is a collection of essays that provide a good overview of many of the main issues. 

For a lighter read, All the Devils Are Here: The Hidden History of the Financial Crisis by Bethany McLean and Joe Nocera is good, but flawed.

On Fannie Mae and Freddie Mac, I'd recommend Guaranteed to Fail: Fannie Mae, Freddie Mac, and the Debacle of Mortgage Finance by Acharya, et. al.

House of Debt (Mian and Sufi) isn't bad on some of the causality, but I find that it goes a bit off the rails when it comes to policy prescriptions.