When applying to a masters program, is your undergraduate school important?
The admission committee I serve has 11 members and there will probably be 11 unique answers to this question. Generally, it matters, but the degree it matters and how much it'd factor into the decision varies member to member, committee to committee.

There is thought such as "A grade B+ in prestigious university is better than a grade A in a so-so university." And there is thought such as "This so-called prestigious university tends to inflate grades, so a mediocre grade is going to be a bad news." The amount of subjectivity and variation can be astounding.

To complicate the problem further, what is "prestige?" Generally, people can name up to 10 prestigious universities, and then the rest are somewhat hazy. Some committees attempt to use acceptance rates as a representation and yet it's far from perfect: program by program the acceptance rates can differ, and such fine information is seldom available.

So, they do care, but it's difficult to predict how much. I'd say don't worry too much about the existing GPAs. If you can improve it, take some relevant courses and get some good grades, if not, then present the best aspects of yours through showcasing your course combination (e.g. did you take more challenging courses over the easier?) and trend (e.g. did your grades improve along time?), clear sense of a long-term plan, a convincing personal statement, and impressive open exam scores (such as TOEFL and GRE in the US) to order to leave a good impression.