 The paper duty was removed in 1861.William Gladstone, as Chancellor of the Exchequer, repealed the paper duties, but only after a false start in 1860, when the House of Lords rejected his bill, against conventions on financial issues.The following year Gladstone returned to the measure, consolidated into a Budget Finance Bill, the first such