Cost Function for evaluating a Regression Model
A loss function and cost function are the same thing.  As you intuit, classical regression treats loss/cost as symmetric, which is not always what you want. In classification tasks, you can make an asymmetric loss matrix.  You can do a similar thing with regression if you solve it with gradient descent, but the ordinary least squares has symmetric loss baked in.  

So I would consider either (1) using a numeric optimization library like sklearn or tensorflow to explicitly define the regression parameters you want to estimate, write your own custom loss function, and then do parameter estimation via gradient descent, or (2) finding a software package that allows for asymmetric loss, for example see this discussion.