Speeding up and improving directory listing from windows Servers?
If you are using the Finder then try with another file manager or try run a ls in the terminal. Let us know if you are experiencing the same kind of delays using the command line.

Some good alternative file manager are muCommander and Midnight Commander. Try both.