r2.12 cherry-pick: 47b849cb89f "[Linaro:ARM_CI] Fix permissions problems on installing Python pkgs"
Refer to the original commit: https://github.com/tensorflow/tensorflow/commit/47b849cb89f86cc0552840da552f907e9fe53f8a