When I do an inward extrusion the walls of the cube remain, whats going on?
I would not use extrude there, instead I would make a loop cut like I shown with blue line, delete the plane I marked with red lines, including the edges, and then fill up the hole using F hotkey.
Let me know if that helped, otherways I'll make a more detailed answer later, when back from work.