A voice dialog device, comprises a voice processing unit configured to obtain a voice pronounced by a user and a result of recognizing the voice; a plurality of estimation units configured to estimate emotion of the user by different methods; and a response unit configured to create a response sentence, based on results of estimating the emotion of the user, and provide the response sentence to the user, wherein when a discrepancy exists between the results of estimating the emotion of the user by the plurality of estimation units, the response unit makes an inquiry to the user, and determines which estimation result is to be adopted, based on content of an obtained response.