How to have all the fields available in a display mode for content type D8
You need to drag the items that you don't want to the disabled section. This works for both form display and front end display. 



For your custom display mode, you should be able to select from each display mode: