Over a long enough time can ants cause structural damage to a house, or other structure, built with concrete blocks?

We bought our current home new but the house was sitting complete and empty for about 2 years before we moved in. We have a small amount of ants each summer. I have had a little bit of success with any poison but obviously not complete success as they return each year.

We have some cracks in our house that are borderline structural cracks and we are having these assessed by engineers. They could be caused by a completely different reason.

However, is it at all possible that I am overlooking the potential damage that ants could cause to a block house?