How is it possible to achieve this functionality?
Select an open drain inverter, and if you can't get an open drain input source, run it through an open drain buffer.  Buffer your potentiometer through an op amp or emitter follower, and run your pullups to that voltage.  If you have a dual gang potentiometer, you can use each wiper as a pullup.