Xposed as a system app
Xposed Installer is not necessarily a system app; however, Xposed framework itself , mainly /system/bin/app_process, is. If by "restore" you mean factory reset (wiping /data) then it will not go away.