Can't place context-controlled block below user picture on user profile page
The weight for the user picture element is set to -10 by default, but
  even if I make it lower, nothing changes is.


The default weight for system content is 0, so display below that you would want a weight of 1 or more for your block in Context > Reaction > Block (if I'm understanding your issue correctly).