Is keeping batteries rolling loose inside a drawer a fire hazard?
like the other answered it, the battery didn't enough current source but definitely can SPARK if your battery somewhat miraculously (in bad term) contact with metal body of another battery.

but Spark thing is not likely will be happens, the most occurence is leak by battery. the smell is awful, it's greasy like oil spill, and didn't remove easily with single wipes not even with hair dryer.

if you must to drop all of your battery in drawer, i suggest you put them out all in one direction or place it straight vertical in boxes. that way you will be fine except the leak