Kalman Filter from 2D LookUp Table
Is there a way to use a Kalman Filter to improve these measurements if I have no physical rule...

No.
Kalman filters add value by using a model of a process to refine an estimate of the states of that process.
If you don't have a model, and you don't have enough data to develop a model, then you can't get there from here.