Not citing a secondary source for a reason
You are mixing up to different things. It sounds like you are copying the sentence structure of the secondary source. If this is the case, that is plagiarism. It doesn't matter if you cite the secondary source or not, as no one will know that the citation is referring to the sentence structure. The second issue is the facts. For these, you should be citing the primary source. You do not need to cite every source that has cited the primary source. It is generally much better to cite primary sources than secondary sources, because as you have discovered, things can get messy the further away from the primary source you go.