Capitalization conventions for departments, schools, etc
Yes, the capital letters apply to the words in the department name, even in running text.

The reason is because the whole department/faculty name contains all of those words. The department names are examples of proper names.