Disclosed herein, among other things, are systems and methods for hearing assistance in multiple-talker settings. One aspect of the present subject matter includes a method of operating a hearing assistance device for a user in an environment. A parameter is sensed relating to facing orientation of a talker in communication within the environment. Parameters related to location and talking activity of a talker can also be used. In various embodiments, facing orientation, location, and talking activity of the talker are estimated based on the sensed parameter. A hearing assistance device parameter is adjusted based on the estimated facing orientation, location, and talking activity of the talker, according to various embodiments.