Power an LED from 120v
You could use a small 4.5v transformer with a bridge rectifier and filter, but that would be overkill. And a transformerless design most probably too dangerous, so yes, go with the batteries.