The present invention pertains to a method for fitting a hearing device to needs and preferences of a user and/or for operating the hearing device. The method comprises determining whether a personal token of the user is located in proximity of the hearing device (10). The method further comprises enabling fitting of the hearing device to the needs and preferences of the user and/or enabling operating of the hearing device only if the personal token has been determined to be located in proximity of the hearing device, otherwise disabling fitting and/or operating of the hearing device (20). Furthermore, a corresponding fitting system and a set of associated hearing devices as well as a use of the latter are provided.