Vapor Pressure Paradox
Although "paradox" is not quite the right term, what you have discussed is actually a simple, yet interesting and important phenomenon.  

Given the ideal situation as you have presented, your thoughts on what would happen are correct. If the system were to achieve $\pu{100\%}$ humidity with respect to the pure water, that would always be slightly over $\pu{100\%}$ humidity with respect to solution B, so water would condense onto B. This of course would cause the humidity with respect to pure water to drop, so more would evaporate. All things being ideal, eventually all of the water in A would transfer to the solution in B (plus the gas phase). The rate that would happen would depend strongly on the concentration of the solute in B.  

An example of this situation playing out in the environment can be seen in the growth of water and ice particles in clouds. The vapor pressure of one particle can differ from that of another due to solute concentration, particle size (small droplets have a greater vapor pressure than larger droplets) and phase (supercooled water droplets have a greater vapor pressure than ice particles at the same temperature). Regardless of the cause of the vapor pressure difference, whether it's solute concentration or one of the other factors, the situation is the same as depicted in your question. And the result is the same; the particles having greater vapor pressure will end up evaporating and then condensing onto the particles having lower vapor pressure (of course we're talking about vapor pressure of water/ice only, not any solute). This is generally referred to as the Wegener–Bergeron–Findeisen process, although this technically only refers to water-to-ice vapor transfer.