Why does CaCO3 react with HCl, but not with H2SO4?
Your marble chips react on the surface.

In the case of hydrochloric acid, the resulting salt, calcium chloride, is highly soluble in the acid, dissolves and provides further attack to the (new) surface.

With sulfuric acid, the highly insoluble calcium sulfate is formed on the surface of the marble chip. With other words:

Calcium sulfate acts like a protective layer.