Should I be using the little copper bit inside this 3/8 water connection?
That looks like an olive for use with a copper pipe.
The pex fittings I use have a split collar as they are designed with the water seal internally onto the brass spigot and the nut/collar is to secure the pipe into place.