Linear programming over a finite field
Your problem, solving a system of linear equations, can be solved using an ancient algorithm, Gaussian elimination, which works over all fields.

Note that linear programming is more general, allowing also inequalities. It is not entirely clear, however, how the order should be defined over a finite field.