Do I have to use butter in a "butter yellow cake?"
For a boxed cake either type of cooking fat should render a similar result. The final flavor will be a little different, but it shouldn't make a huge difference and probably won't be much different than a mix that calls for oil in the first place.

If you wanted to keep the flavor similar while avoiding dairy you could try using butter flavored shortening instead of oil.