Why are more electronegative atoms better leaving groups?
You can interpret the term "stabilizing" to mean that some effect leads to a  more energetically favorable state (i.e. lower in energy) relative to your original state. So to answer your first question, if atom A is better at stabilizing negative charge than atom B, then it means that it is more energetically favorable to place a negative charge on atom A and have B remain neutral than the other way around. This could be because placing additional electron density around A is more energetically favorable than placing it on B, or because it is less energetically unfavorable to place more electron density on A than it would be to place it on B. 

To answer your second question, more electronegative atoms are generally better at stabilizing negative charge because, by definition, electronegative atoms have a greater tendency to attract electron density. However, it is not only the electronegativity of an atom which determines its leaving group ability, but also its size. If an atom is larger, then it means the electrons will be spread out over a larger volume, which is more energetically favorable. This is one reason why iodide is a better leaving group than bromide, even though bromine is more electronegative than iodine. In addition, iodine is larger and it forms weaker bonds than bromine with other atoms due to poorer overlap of atomic orbitals, meaning it is easier to break iodine bonds (e.g. the bond dissociation energy is 284 kJ/mol for Br$-$CH$_3$ versus 232 kJ/mol for I$-$CH$_3$ at 298 K). Because iodine bonds are easier to break, it is easier for iodine to "leave" the molecule and is thus a better leaving group.

Along this same line of reasoning, fluorine, being very electronegative, can form a very stable anion, but it forms very strong bonds which are difficult to break, and fluoride cannot leave if the fluorine bond doesn't break. That is why fluoride is a poorer leaving group than the other halogens.