Vršajević's first professional club was NK TOŠK Tešanj.
From Čelik, Avdija moved to Czech side AC Sparta Prague but never made an appearance for them, spending loan spells initially at SK Kladno and then at 1. FC Tatran Prešov.