Delete pickle file with python within Blender
The standard filesystem functions available in python can be used within blender.

import os
os.remove(path) # a single file
os.rmdir(path) # an empty folder


The python docs include more info.