How to size transformer for a circuit?
I did some search and found that I need power factor for getting VA
  rating.


No, power factor has no influence on the VA rating. If your DC load is less than 5 watts then you can use a transformer that is capable of providing more than 5 VA usually. I would be tempted to go for something that is more like 10 VA but this may be too big for your needs.