Is it possible to convert 6V 4A (24W) DC to 12V 3A (36W) DC using step up booster?
No. To put it quite simply, you cannot have more power out than you have going in. You can increase the voltage available, you can increase the current available, but you cannot increase the available power.

25W going in means a maximum of 25W out.