Is this level of citation acceptable in a dissertation?
It sounds like the way you did the reference was fine and perfectly standard practice in mathematics. And I doubt Turnitin is remotely useful for mathematics anyway.
The more important question is whether what you did meets the expectations of your committee, and you'll have to ask them that.