Which is better, 其他所有 or 所有其他？
Both will be fine. They have a different emphasis and usage for the context.

When you say 其他所有, you are emphasizing "others" and 所有 isn't got special attention. The felling will be similar to "The guests today include faculty members from the math department, physics department, and all other departments from south campus".

When you say 所有其他, you have a special emphasizing of "all". It's like "Every person leave, please. EVERY one."