Molds associated with Aflatoxin?
Strictly speaking the common bread mould Rhizopus sp. does not produce aflatoxin.
The fungus Aspergillus flavus which belongs to the class Ascomycetes secretes aflatoxin. It attacks cereal grains , legumes, tree nuts. The fungi are green in colour and 'mould' like in appearance.
The fungus attacks the food stuffs and storage grains. So under favourable conditions it may grow in your store room if it finds food for its growth. Also Aspergillus can grow at temperatures as high as 48°C and even at low temperatures like 5-8°C.

Edit: On being asked for sources I include some which strongly support my claim 
1. For suitable conditions of growth of the fungi visit https://en.m.wikipedia.org/wiki/Aspergillus_flavus and read under the Environment heading.
2. Visit https://bioweb.uwlax.edu/bio203/s2013/ernst_ale2/habitat.htm and read from " Aspergillus flavus is omnipresent " upto " Aspergillus may also grow on or inside walls in homes, especially if the house is damp or has been damaged by flooding. "
3.https://www.moldbacteria.com/mold-types.html this site provides a list of different fungi found in our homes. Here you can find Aspergillus flavus to grow in flower pot soil. Moreover other species of Aspergillus are found in kitchens and bathrooms.