Do I need voltage regulator?
I am using USB cable. So do i need any stabilizator there?

USB is reasonably well regulated, and your load isn't very sensitive to minor changes in voltage, so you don't need a regulator.

Is there a chance if i connect this to power source it will burn the source?

That depends on the specific device, but most USB source or host devices have internal overcurrent protection.  If you are concerned that you might inadvertently short something, double check that your supply has protection or add a fuse.