In the next match, against Southgate, he narrowly missed out on a century, having scored 99 runs in the first innings, but achieved the landmark score in the following game, against Cambridgeshire. Batting at number four, he scored 114 runs, almost half of his team's total for the first innings. The university won by eight wickets. The score remained the best of his career, resulting in both his highest total batting, and his best bowling figures, being against the same side: Cambridgeshire. He represented his university against Oxford for the second and final time in 1867, and though he claimed just one wicket and made scores of 17 and 20 not out, he was praised for his sensible batting in the second innings which helped his team win the match by five wickets. In 1868, Lyttelton played five matches for Cambridge, but did not feature in the contest with Oxford. His batting average dropped significantly from the previous year's 37.88 to 13.57, and over half of his wickets for the season came in a match against Southgate. In that match he took five wickets for 17 runs in the second innings, the second five-wicket haul of his career. After leaving university, Lyttelton only played two further first-class matches, appearing for the amateur side "Gentlemen of England" against a university on each occasion. Along with the majority of his family, he appeared a number of times for the "Gentlemen of Worcestershire", a fore-runner to Worcestershire County Cricket Club, for whom he made his debut in a match against the "Gentlemen of Warwickshire" shortly before entering Cambridge. Playing for the county in 1866, Lyttelton and his brother Charles took nine of Shropshire's first innings wickets, the other being a run out. In 1878, six years after his final first-class appearance, he scored 127 runs against the Free Foresters, his highest recorded batting total for the county. E.F. Benson described him as "grim and blunt and bearded and rich: he lived alone in a house in Hill Street into which no friend had ever penetrated. He was a bachelor, he sang in the Bach choir, and on being asked if had ever in his life kissed a woman he replied: "Once. On the brow." Later life He was Assistant Private Secretary to the Prime Minister, William Ewart Gladstone, from 1871 to 1874, Assistant Private Secretary to the Secretary of State Earl Granville from