Can an author refer to work they did jointly using the first person?
In maths you never use the first person singular anyway, so they question as stated does not apply. Also, all work in a paper (in pure maths at least) is understood to be the work of all authors. In fact, it is common to refer to the other paper in the third person, even when the authors are the same.

In short: no, this is not acceptable.