A method of assembling a camera assembly for a vehicle vision system includes providing a housing having a front housing portion and a rear housing portion that includes a connector portion configured for connecting to a vehicle wiring connector. An imager circuit board includes an imager is disposed at the front housing portion such that the imager is aligned with the lens of the front housing portion. A connector circuit board is disposed at the rear housing portion and electrically connected to a coaxial connector structure at the connector portion. The rear housing portion is mated with the front housing portion and circuitry of the connector circuit board is electrically connected to circuitry of the imager circuit board via at least one spring-loaded connector that electrically connects at the imager circuit board and at the connector circuit board.