Base-k representations of the co-domain of a polynomial - is it context-free?
Of course $k \geq 2$ here.

There once was a manuscript by Horváth that claimed to solve the problem, but it was unclear in several places and to my knowledge was never published.

As far as I know, the problem is still open.  One direction of the implication is easy, of course.