What kind of sensor can sense Infrared radiation from any direction?
You need multiple sensors anyways because with one sensor its going to be staring right at the sun. With multiple sensors you can at least ignore the ones staring at the sun.
Photodiodes and phototransistors in flat SMD packages have the widest field of view: 60 degrees half-angle half-max sensitivity but its a sinusoid covering +/-90 degrees at 0 sensitivity at the edges.
I also really doubt you actually need EVER direction. I imagine horizontally outward in every direction would be sufficient. The very wide field of view in the types of devices mentioned above might actually cause you problems by having the sun in their field of view even if pointed horizontally.
I would go with narrower in which case you would need to look at through-hole photodiode and phototransistors. The ones that look shaped like LEDs have conical fields of view so for horizontally outward but not upward looking you need multiple narrower field ones in a ring. There are radial side mount packaging which have a wider horizontal field of view than vertical which would help them ignore the sun if it is to your back.
You also want the black opaque, visible blind packaging.