Provided are a video telephone device and a video telephone processing method in which a video call environment with excellent usability is provided even when used by a plurality of persons. A video telephone device that performs a call with another video telephone device via a network photographs an image of a speaker, recognizes the speaker based on the photographed image, and changes a background image in an image to be transmitted according to a recognition result. Thus, for example, when the users who are not close to each other perform a call, a situation in which an image showing a state of a room is supplied as a background image is solved.