Brugman's father was Pierre Brugman from Curaçao of Dutch-Jewish Sephardic ancestry and his mother, Isabel Duliebre from Puerto Rico.
The Brugman family moved to Puerto Rico and settled in the City of Mayagüez where Mathias met and married Ana Maria Laborde.