Is it possible to unload built-in kernel module?
No. Built-in drivers aren't modules, they are built-in (hence the name). If it's not showing in lsmod, you can't get rid of it short of building a new kernel.