although the gangs erred on the side of caution and started to withdraw their man from the water at the slightest hint of danger , many youngsters had lost their lives in the effort to harvest these small crustaceans .