Silver was born in Bradford, Yorkshire, England in 1949, of German Jewish descent.
As a young man Silver exhibited entrepreneurial skills and spent his school lunch breaks at the local auction rooms buying and selling furniture.