How to prevent VLC from setting as default player?
Right-click (Control click) on the type of file you want to always open with Elmedia. Click 'Get Info'. 

In the 'Open With' section, select Elmedia from the drop-down menu. To apply this change to all files of this type, click the 'Change All' button. Repeat with any other file types as desired/when they come up