setting statistics time on/off giving different results
If there are user defined functions in your code, there can be significant overhead to setting STATISTICS TIME ON. See here.

More importantly, be REALLY careful when using scalar UDFs. They will inhibit parallelism for your query, and have a nasty habit of running once per row returned by your query. 

The impact they have on STATISTICS TIME should be the least of your concerns.