She legally changed her name to Lillian Rousseau , but her clothing company kept the `` Lilly Pulitzer '' label . Although she legally changed her name to `` Lillian McKim Rousseau , '' her clothing company continued to operate under the `` Lilly Pulitzer '' label .