Transparent material is "see through" when rendered in Cycles
I still don't know why it appeared transparent but I found a workaround, I just used a second UV map. I didn't know you could use multiple UV maps...