A coaxial connector set including a first connector to which a coaxial cable having a center conductor and an outer conductor is connected, and a second connector mounted on a circuit board having a ground coupling portion. The first connector has a first outer terminal, and the second connector has a second outer terminal. The first outer terminal has an outer conductor clamp portion, a first outer contact portion, and a tip surrounding portion positioned between the outer conductor clamp portion and the first outer contact portion and surrounding a tip portion of the center conductor. Shortcut coupling paths are formed between the tip surrounding portion and the second outer terminal or the ground coupling portion.