Caldecott's health was generally poor and he suffered much from gastritis and a heart condition going back to an illness in his childhood.
Soon after his early death, his many friends contributed to a memorial, which was designed by Sir Alfred Gilbert.