Arduino as ISP: IC swapping
Can I just program it in the classical way and pull out the chip from the arduino ?


Sure you can, you place the chip (that already has a bootloader) to the arduino board, program it and then you can pull it out and place it on a breadboard (connecting the supplies and crystal) and it will work fine.

To put it another way, you can get any empty chip like mega88/168, place it on a breadboard, program it once with the arduino bootloader (using an ISP serial programmer) and after that you can use the bootloaded functionality to program the chip on the breadboard.