How to change the scroll distance
As we know, the scrolling zoom speed increases with the distance from the center point of the viewport camera. I think the problem occurs because the center point is far away from view.

I suggest:

1)Select the object and press NUM . to move center point to the selection.

2)Use Ctrl + Middle Click to perform precise zooming.

3)Use fly mode (Shift + F) to navigate.