Learn and sample from a generative model with 2000 boolean features
You may try an Apriori algorithm or more advanced FPGrowth algorithm. It will give you a set of association rules, which, I think, you required:


  e.g. if feature 10 is on, feature 14, 15, and 16 are usually on