Linear SVM with slack variables: Will it find a perfect decision boundary if it exists?
Having linear separable data means that an optimal solution exists. The support vector machine is an approach to identify the optimal solution with multiple steps through Lagrange multiplication. This method is guaranteed to give you the optimal solution if there is one.