Columns with no (or nearly no) differences between rows worth keeping?
The features you described are known as low variance features and in general you should remove those features. The rationale behind this, is that low variance feature contain less information. See this for a succinct explanation and some code in python. Be sure to normalize your features. One of the advantages is to speed the training phase.