The episode's title, "Live Free or Die", refers to the New Hampshire state motto, which Vito notices on a license plate while he is browsing an arts and crafts shop.
It also possibly refers to Vito's options: Live free (stay in New Hampshire) or die (return to New Jersey).