What is this cement structure under ground?
It looks like a standard 4×4 post with concrete poured around it. The square in the middle should have some wood left to be sure. The hole may go 36-48" down depending on local code even deeper. I usually use a tractor and a chain to pop old fence post out when on a job but on my place I just shifted the fence post several feet and left them in the ground.