Do relativized relations between complexity classes tell us anything about the nonrelativized relation? The existence of relativized relations between complexity classes seems to often be treated as "circumstantial" evidence about the "true" or "real-world" (i.e. nonrelativized) relation between the classes. (For example, this lecture describes one particular oracle separation as "formal evidence" that the complexity classes are unconditionally distinct.) However, as far as I understand (please correct me if I am wrong), for complexity classes $A$ and $B$ and an oracle for a language $L$, all four of these cases are logically possible:


$A = B$ and $A^L = B^L$
$A = B$ and $A^L \neq B^L$
$A \neq B$ and $A^L = B^L$
$A \neq B$ and $A^L \neq B^L$


So presuming that at the end of the day the unrelativized result is what we really care about, what are relativized results "good for"?

I can see one application: if we happen to be able to find oracles for two languages $L$ and $L'$ such that $A^L = B^L$ and $A^{L'} \neq B^{L'}$, then that tells us that any proof that either $A = B$ or $A \neq B$ cannot relativize, and this fact saves us a lot of time by allowing us to immediately skip many potential proofs.

But do oracle results give us any evidence about the actual relation? In particular, why are oracle separations treated as "evidence" (though not a proof) that the complexity classes are unequal? How strong does the complexity-theory community consider such evidence to be? (I know that last question is subjective and hard to answer precisely.)
I am by no means an expert, but 2 things come to mind:

Because if we know things like $A^L \neq B^L$, for some $L$, then a proof of $A = B$ need to be non-relativizing. This puts constrains on the techniques used for such a proof, and thus it is helpful in the way towards getting a proof.

Because if you prove $A^L = B^L$, and the oracle is not very strong, then it seems that you are narrowing down the possibility of $A \neq B$, as with some extra help they become equal. This can arguably be evidence towards believing that $A = B$. To me it feels like saying that John and Peter were equally strong in a fight with boxing gloves. That doesn't necesarily mean that they will be equally strong without the gloves, as one of them could be weaker but use the gloves better. Nevertheless, the information about their fight with gloves is arguable evidence of their relative strength.