Measure BJT base voltage cause IC to increase, why?
You say you're measuring the base voltage ... with no further qualification, that means the base voltage with respect to ground. 

As the emitter is at -5V, that means base is around -4.3V, so an additional resistance to ground (your meter) will increase the base current.

Which increases the collector current as you observe.