How to know if my research problem is interesting or not?
These questions are best answered by a more experienced person than yourself, in particular your advisor. It is why you have an advisor in the first place. But let me be a bit more specific to your (many) questions. 

First, you don't know what you will learn when starting research. That is why it is research and not just writing stuff down. A problem may turn out to be difficult or easy. It may turn out to have an interesting solution or just a run-of-the-mill grind-out-the-result solution. But you don't know until you do it. I think that is true in any field, but is so in mathematics, certainly. 

For the second bullet, all problems are valuable to solve. Even if the solution is just to conclude the answer is trivial. You learn from solving them, and that is one of the main benefits of doing math in the first place. 

Usually, if a problem is listed as unsolved in a recent paper it is probably worth pursuing. But such questions generate interest, so look, also, for more recent results. That doesn't mean that it isn't also valuable to solve the problems yourself, as suggested in the previous paragraph. 

If a paper has been published in a reputable journal, it has been reviewed by other mathematicians. Presumably they agree that the problems stated at the end have at least some interest. But, solving them also increases your skill. 

In general all mathematical questions, unless trivial, are interesting to at least some mathematicians. It can be a very small number, of course as some of the silos in math research are very narrow and deep. But if they are interesting to you, especially as a student, they are interesting by definition. 

But get a doctoral advisor and explore some of these things with him or her.