A tool box structure includes a plurality of row sockets. Each row socket has a plurality of insert holes defined therein for adapting to receive a screwdriver bit and a positioning gutter formed at the bottom thereof. A box body is pivotally connecting to the row sockets. The box body has a plurality of positioning slots defined therein and corresponding to the quantity of the row sockets in the box body. An elastic element is installed between each positioning slot and each positioning gutter. The positioning slot and the positioning gutter is abutted by two ends of each elastic element. A cover body is installed to the box body. A plurality of openings is defined in the cover body and respectively corresponding to the insert holes in the row sockets.