Caycedo studied Law in the Colegio Mayor de Nuestra Señora del Rosario (nowadays known as Universidad del Rosario) in Bogotá, where he later became its vice-rector (deputy Headmaster).
He traveled to Spain, where he joined the army to fight against Napoleon.