Effects of Different AC Adapters On Various Electronics
Voltage

Different adaptors have different voltages.  You must use the correct voltage (within the margin of error which is hopefully written on both parts). If you don't the consequences could vary from it working, but unreliably, to not working, to immediately and permanently failing, to catching fire.

Polarity

Some connectors, such as the barrel jack connector on the arduino, come in different polarities. e.g. "Center pin positive" and "Center pin negative". Getting that wrong can have similar consequences to the above.  Other connectors, such as the various versions of USB, only have one polarity, so it doesn't matter.

Current

The power supply will have a maximum current it can supply, and in some cases also a minimum.  The load defines the actual power drawn, and as long as it is in-between the maximum and minimum for the supply, all is well.  Otherwise, it will probably just not work. It is in theory possible to damage the supply this way, but that only usually happens with rough and ready supplies, or those designed for building into products, not the ones which come separately.

Isolation and Grounding

For safety reasons, you must not swap isolated and non-isolated power supplies, though from your description all yours will be isolated.  You should not swap grounded and non-grounded supplies either, though the consequences there are less severe.

Power supply connectors

It sounds like many of your supplies have USB connectors. That's good, as they will all be 5V, same polarity, isolated, and almost always floating. This is because USB chargers are standardised. The only variation will be in the current they can supply, which hopefully will be written on (watch out for cheap ones with lies written on). And if you try to draw more current than they can supply, they will shut down safely. The ones with the barrel jacks will be more variable, as there isn't a standard.