Attempted installing Google Play Store, but ended up installing Android Market!
I browsed a bit on Android Market and then I pushed another file from the zip downloaded. It's named MarketUpdater.apk. That's what updates the Market to Play Store!

Tried starting from scratch and pushed market updater too! So it was Play Store right when it sat in.