SQL Server Agent Alerts using severity 16
Finally found the answer to my question.

You need to enable the is_event_logged in the sys.messages table.

Example code:

EXEC sp_altermessage @message_id = 2812, @parameter = 'WITH_LOG', @parameter_value = 'true'


Here is the blog post I found to answer my question
Reference