Would unstable sample rate affect spectrum after FFT?
My question is whether the unstable sample rate may lead to the frequency shift?

Since the frequency bins in the FFT are proportional to the sampling rate, if you change the sampling rate, you change the frequency of those bins. If you know what the sampling rate is on every particular data set, you can resample it to be consistent between all of them.