Is it okay to use somebody else’s methodology in my own paper (with proper citations) or is this plagiarism?
Yes, it's okay to reuse other people's methodology to address an original research question.  It is not okay to copy the methods section of their publication.  You must write your own, in addition to citing them.