An electronic device may be provided with a housing having housing sidewalls. A plate may be connected between a pair of the sidewalls. An audio jack may be mounted to the plate. A microphone may be mounted within the device between the audio jack and a given one of the sidewalls. A vibrator may be mounted between one of the sidewalls and the audio jack using a bracket. The vibrator may have a weight that is tapered along its length. A button may be formed in an opening in one of the housing sidewalls. The button may have a button member with a protrusion that extends through a button opening in the sidewall. A support structure may be interposed between a switch and the button member. The switch may have a portion that extends through an opening in the support structure and that is actuated by the button member.