Tamién escribió dos obres creatives: Epistles on Women, Exemplifying their Character and Condition in Various Ages and Nations, with Miscellaneous Poems (1810), y la so única obra de ficción Lorimer, a Balte (1814).