SQL Server: calculating memory requirements for Full db backups
At this point, I think this could explain my observations:

https://support.microsoft.com/en-us/help/4347088/fix-out-of-memory-error-when-there-are-free-pages-in-sql-server