Adobe Premiere Background Processes
That's not really a large allocation of memory for Premiere. It's only holding as private memory just under 4GB. 

My recommendation would be to add additional memory to you system. 

I personally would recommend a minimum of 32 GB, but if your overhead is low in general, you can get away with less and not have any issues.