Creating an edgeless material for flame
Just an idea..

You could just draw with really soft brush in Photoshop/Gimp, something similar to a flame. Then use that as the mask factor. 

 


I just did this on a flat plane. If you use a solid object just make sure all the sides are close to each other or it might look a little weird.