Techniques are provided for detecting violations of user physical location constraints. One method comprises obtaining a constraint on a physical location of a user within a building; evaluating a network signal from a processing device of the user to identify a physical port that connects the processing device of the user to a network; obtaining a mapping of the physical port to a physical location within the building to determine the physical location of the user within the building; determining if the physical location of the user within the building violates the constraint; and initiating an automated remedial action in response to a result of the determining. The user can be identified using a device signature of the processing device of the user (e.g., based on one or more identifiers of hardware, software and/or network elements associated with the processing device).