The museum's original collection was bought by Eindhoven city council in 1934 in an agreement with Henri van Abbe, a private collector and local cigar manufacturer.
As the building had become far too small for modern demands, a new extension to the building, including a 27 metre high tower, was designed by Abel Cahen; it was inaugurated in 2003 by Queen Beatrix.