A method and apparatus for controlling use of an autonomous vehicle includes an interior occupant sensing system to obtain data of occupants from a video camera. An occupant sensing controller is configured to receive the video and detect a number of faces of occupants disposed in the vehicle. Further, the occupant sensing controller determines demographic information from the video data of each of the detected faces and then stores the vehicle location, the number of faces, and the demographic information for occupants as data in the vehicle. The occupant sensing controller determines from the demographic information an age of occupants in the autonomous vehicle, and when the demographic information indicates that all occupants in the autonomous vehicle are less than a certain age, limits travel to a destination or operation of the autonomous vehicle in response to age. Further, the occupant sensing controller can recognize a specific authorized individual within the vehicle and limit usage of the vehicle for the identified authorized individual.