Is grout in the toilet a plumbing clog concern?
It's not likely to be a problem. The cement in the mortar is diluted enough that it won't create a plug downstream. You're mostly looking at clean silica sand. However, I'd play it safe and vacuum it out before flushing. 

I'd then disallow that contractor from entering my home ever again.