Why does my ethernet on my custom board only work sometimes?
The 8P8C connector J5 in your design uses pins 6 and 7 for the receive pair.
The receive pair is on pins 3 and 6 on standard Ethernet interface.