How to remove object of type FONT in Blender Python
Upon inspecting what sort of options there are using the Autocomplete function, I found unlink:

# Clear all objects in the master collection to reset to a blank scene
for object in bpy.data.scenes[0].collection.objects:
    bpy.data.scenes[0].collection.objects.unlink(object)


This clears all the objects from the collection, Text or not.