The effect of structure on the boiling points of organic molecules
Yes, structure is important in this respect. Most importantly, the alcohols are able to form hydrogen bonds among each other, which is not possible for the ethers. Since evaporation always means breaking intermolecular interactions in the liquid phase, any additional stabilizing interaction raises the boiling point.