A hearing device adapted to be worn by a user and for picking up sound containing the user's own voice is provided. The hearing device comprises a) an input unit comprising first and second input transducers for converting sound to first and second electric input signals, respectively, representing said sound; b) a processor configured to receive said first and second electric input signals and to provide a combined signal as a linear combination of the first and second electric input signals, wherein the combined signal comprises an estimate of the user's own voice, and c) wherein said hearing device is configured to provide that said first and second input transducers are located on said user at first and second locations, when worn by said user; and d) wherein said first and second locations are selected to provide that said first and second electric signals exhibit substantially different directional responses for sound from the user's mouth as well as from sound from sound sources located in an environment around the user. A method of operating a hearing device is further disclosed. Thereby an improved quality of an own voice estimate may be provided.