A surviving fragment of footage of Ferguson from The Lie or The Avalanche can be seen in Paramount's The House That Shadows Built (1931). Other brief surviving footage of Ferguson is preserved in Paramount's A Trip to Paramountown (1922) Continuing to play roles of elegant society women, Ferguson was quickly dubbed "The Aristocrat of the Silent Screen", but the aristocratic label also was because she was known as a difficult and sometimes arrogant personality with whom to work. Many of the films she agreed to do were because they were adaptations of stage plays with which she was familiar. Elsie Ferguson eventually followed the move west and bought a home in the hills of Hollywood, California. In 1920, she traveled to the Middle East and Europe. She fell in love with Paris and the French Riviera, and within a few years, she bought a permanent home there. In 1921, she accepted another contract offer from Paramount Pictures to star in four films to be spread over a two-year period. One of these was the 1921 film entitled Forever in which she starred with Wallace Reid. "Talkies" and retirement Ferguson's last silent film before returning to Broadway was the 1925 drama The Unknown Lover. In 1930, she made her first sound film that also would be her final film, titled Scarlet Pages, which is now preserved in the Library of Congress. The film was based on a 1929 Broadway production of the same name that she also starred in. She was described as having a "pleasantly low-pitched voice with perfect diction." Well known as difficult to work with, temperamental, and argumentative, she married four times. Following her final marriage at age 51, she and her husband acquired a farm in Connecticut and divided their time between it and her home in Cap d'Antibes. Ferguson made her final appearance on Broadway in 1943, at the age of 60, that met with critical acclaim. She played in Outrageous Fortune, a play written by her neighbor Rose Franken. The play closed eight weeks after it opened. Critics hailed Ferguson's performance as "glowing" and having "the charm and winning manner of old." Ferguson died in Lawrence Memorial Hospital in New London, Connecticut, in 1961. She lived on an estate called White Gate Farms. She was interred in the Duck River Cemetery in Old Lyme, Connecticut. A very wealthy woman with no heirs and a lover