How feasible is creating a plug in -out hardware system ? is it possible ??
Yes, you can build hardware modules which can be fitted and detected at runtime. By connecting modules to a shared bus and probing for them at startup, you could create a dynamic system.

You could use USB for each module, or address scanning with I2C, or even SPI with jumpered chip selects.