Identify strange wall fixing
I believe that is called a spring pin anchor or express nail 



To remove it, I'd try these:  



or any nail puller.  

Spraying some Liquid Wrench or other light lubricant might make it easier to pull out, but also slippery to hold onto, and might make an oily rusty stain.