(SOLVED) Power BI, Page level filter not working with many to one relation
Posting this as an answer.

Turns out the relations were set to Cross filter direction: Single on all relations (and the one from Month table.Month to A.Month was not set to active).

Setting Cross filter direction: Both fixed the problem.