How to get an alarm / warning when it starts to rain
This isn't an Android solution, but I think it will work for you.

This IFTTT Recipe will send an SMS if the weather condition changes to "Rain".

Trigger (Weather channel)


Current condition changes to rain


Action (SMS channel)


Send me an SMS message