A method and device for detecting acoustic feedback events with an artificial neural network in an in-ear earbud audio system that allows, by user interaction, playback of a recorded and processed signal from an environment-recording microphone by an in-ear speaker that faces or is at least acoustically coupled with the ear canal such that sound played by the speaker enters the ear canal. The audio system employs an acoustic seal that acoustically separates the speaker from the microphone, but due to external factors, the acoustical separation may not be adequate, thereby forming acoustic feedback paths. The neural network facilitates a binary classification of the time-wise segmented microphone signal, which is used to stop playback by the in-ear speaker if a feedback event is detected to protect the hearing of the user. Detection of a feedback event triggers an audible or wireless notification to be delivered to the user.