Speaker can be removed by the Lok Sabha by a resolution passed by an effective majority of the House as per Articles 94 and 96.
Speaker is also removed on getting disqualified for being Lok Sabha member under sections 7 & 8 of Representation of the People Act, 1951 [REF].