How to handle addresses of the restaurants to feed the data-set in the ML model?
You can convert each address to a pair of geographical coordinates (latitude, longitude). In this way, you'll have a rough measure of the distance between different location. This can be done with Google Maps, for example.

I suggest you to use compute Manhattan distance between locations, in order to properly estimate travel times within a city.