How should I construct a binary classifier for thousands of positive data and millions of unlabeled data?
I think the problem you mentioned is sometimes countered as a deep one-class classification problem. You may want to Google for latest researches in this field.

One paper I've been reading is: Learning Deep Features for One-Class Classification.

Available on ArXiv.