1. A method of managing a dialog turn between a user and a spoken dialog system, the method comprising: generating first dialog turn information using dialog information analyzed from a speech uttered by the user; generating second dialog turn information using facial expression information analyzed from a face image of the user; selecting one of the first and second dialog turn information using predetermined weight information; and determining a final dialog turn using the selected one dialog turn information, information on a status of the spoken dialog system, information on whether the user speech is input, and information on a no-answer time of the user, for controlling a dialog between the user and the spoken dialog system.