Can Q-learning working in a multi agent environment where every agent learns a behaviour independently?
Not particularly sure what you are asking, so the question that I will be answering is this: 


  Can Q learning be used to estimate a value that depends on another value in the Q Learning Matrix even though there is a certain amount of unpredictability involved?


The answer is yes!

I will use the example of a robotic arm trying to reach a point in space since that is what I am most familiar with. 

Imagine a robotic arm with a shoulder, elbow, and wrist joint. The desired elbow value depends very much on the shoulder value which is also being learned. Given enough iterations, the Q learning algorithm will come up with a solution (out of possibly many) for the elbow joint based on where the shoulder joint is at that time. 

The intrinsic unpredictability (air drag, motor power, etc in this case) is countered intuitively by the Q-learning algorithm iteratively learning what works best.