ritcherd was amused , when he went with george to retrieve the colors , to see that the ship was also carrying british and french flags , as well as the jolly roger theyd been flying the majority of the time until now .