可怕 and 恐怖 are what kind of "terrible"?
It just means frighteningly/terrifying in your situation. Your passenger is just scared by your little stunts (but he/she may be amazed by your moves at the same time).

恐怖 and 可怕 do not have the meaning of poorly.