Can I ask a Master's paper reader to be a referee for Ph.D.?
For sure it may depend on the rules your university has, but if the referee can explain the occasions in which he could assess you (in your case seminars and thesis), and why he thinks you would be a good candidate, I do not see any problems in asking him.
The fact that he is now a professor (even if somewhere else) is only a plus.