When I right click while in edit mode, the context menu doesn't appear
go to Edit>Preferences>Keymap
In the searchbox type: Call menu
Then have a look in the search results for "Mesh Call Menu". And check what key you have assigned for it. Should be "Right Mouse" if you want it like this.