Open PDF using Google Chrome
Make sure you click the "Change All" checkbox in the Get Info window.

(Credit for this answer goes to Lyken. There was just no sense in letting this question masquerade as unanswered any longer.)