What is the best way to track IR led?
If you're just building a few units and not a big scaler product, I would change the plan. Check out Nintendo Wii IR camera - they contain IR camera and output the position of one or more IR emitters.

By using a ready module you can save your time to build the interactive functionality instead of building a camera system and OpenCV processing and integration.