Merging common Columns values in two DataFrame Pandas
Dropping your duplicate rows and merging on 'Patient ID' should solve your issue. 

data = pd.merge(res_total_Df, key_df,
                        left_on=['patient_id'], right_on = ['patient_id'], how = 'left')