It means that he wasn't supposed to trouble me, and he wasn't supposed to call me at work and wasn't supposed to disturb me, and he wasn't supposed to ruin my routine and the indulgence in the pregnancy. 