Diagnosing rust on geraniums can be a challenge for growers. Rust begins with yellow spots on the underside of the leaves and can rapidly progress with brown fungal spores called pustules in the center of each spot. The pustules are raised up off the leaf surface and feel rough to the touch.