do you burn more calories if you are less fit?
People who are the most physically active seem to become more efficient at using energy, and so burn fewer calories when not exercising than the rest of us.