An autonomous construction robotic system is disclosed which includes a processing unit, a robotic arm, the robotic arm is adapted to be coupled to a central attachment arm and thereby position the central attachment arm according to a plurality of degrees of freedom, a panel handling and fastening system, including a panel handling assembly coupled to the central attachment arm and adapted to pick and place a construction panel onto a framed structure within a construction zone, and a vision system adapted to provide visual information to the processing unit associated with the framed structure, wherein the processing unit processes the visual information to automatically determine placement position of the construction panel on the framed structure.