What does it mean when people say a cost function is something you want to minimize?
No, it means you are trying to find the inputs that make the output of the cost function the smallest. It doesn't mean that you should "minimize" use of it.