It was long thought that the first true vertebrates ( fish â '' Ostracoderms ) appeared in the Ordovician , but recent discoveries in China show they probably originated in the Lower Cambrian . It was long thought that the first true vertebrates ( fish â '' Ostracoderms ) appeared in the Ordovician , but recent discoveries in China reveal that they probably originated in the Early Cambrian .