pandas read_csv. How to ignore delimiter before line break
Specifying which columns to read using usecols will be a cleaner approach or you can drop the column once you have read the data but this comes with an overhead of reading data that you don't need. The generic approach will require you the create a regex parser which will be more time consuming and more messy.
I'm reading a file with numerical values. 
data = pd.read_csv('data.dat', sep=' ', header=None)
In the text file, each row end with a space, So pandas wait for a value that is not there and add a "nan" at the end of each row.
For example:
2.343 4.234 
is read as: 
[2.343, 4.234, nan]
I can avoid it using , usecols = [0 1] but I would prefer a more general solution