Does my cell phone alarm run off the battery or does it need cell service Will the alarm in my phone go off when programmed if I am in a poor cell reception area?
Yes, it will.

The default alarm is built into Android and uses the alarmManager to schedule when to sound the alarm.

It will always go off, unless the device is powered off or in silent mode (however some ROM's have separate volume controls for alarms and other volumes).