You can make both decision trees and knn fairly robust to outliers. ... You can remove or truncate outliers ahead of time using IQR or other method. Note when evaluating regression problems most people default to RMSE. This is sensitive to outliers in the test set.