 His father Caspard was a goldsmith, and he had three brothers.Two of his brothers Georg and Paul became goldsmiths themselves, while his third brother was the painter Martin Schongauer.Both Martin and Ludwig are thought to have been pupils of the painter Caspar Isenmann.