Spin spin coupling in a proton NMR of an ester?
In the most common case you can only observe 3J-couplings, any spins further away than three bonds do not cause a visible splitting in your spectra. The exception are couplings via double-bonds or aromatic systems, there you can often see small couplings over four bonds.

In this case the spins are too far away from each other to cause a visible splitting, you are correct that it would result in a singlet a quartet and a triplet.

In the case of OH and NH protons, chemical exchange can play a role. This is a bit more complicated, but the simple version is that protons that can exchange quickly with the solvent are often not observable in NMR (or just as a very broad signal) and due to that also don't couple. Though in the most common cases the OH proton is usually too far away from the other protons in the molecule to show a coupling anyway.