What am I doing wrong while finishing drywall inside corners?
I would say you have too much compound. You should be able to press very firmly and pretty much squeeze out the excess compound. The thin layer that remains will provide good adherence of the tape. You want the compound to fully coat the back of the tape, but no more.