What determines the maximum size of a cpu cache?
It's a trade-off between the higher hit rate of a large cache and the faster speed of the smaller cache RAM. Hit rate follows a law of diminishing returns as the cache gets larger.

Doubling the size of a large cache may only less than a couple of percent increase in hit rate but it'll certainly increase its access time, which slows CPU throughput.