AND with XOR gates not working together
Working with your latest (unconventional) circuit (with the extra resistors) you do not quite get the XOR function. Look at V(xor) between 3 and 4 seconds.

See LT Simulation below:



If however you were to eliminate D4 and add a resistor before your AND LED you get closer to what you are after.

See LT Simulation below: