Is it possible to apply PCA on different subsets independently?
You can use mini batch PCA. One formulation is available in sklearn.

Alternatively, you can run PCA on a carefully selected subset of your data. It's very time consuming and I'm not sure it's possible, and its feasibility is task specific.