The present invention provides an automated optical inspection and classification apparatus based on a deep learning system, comprising a camera and a processor. The processor executes a deep learning system after loading data from a storage unit and the processor, and comprises an input layer, a neural network layer group, and a fully connected-layer group. The neural network layer group is for extracting to an input image and thereby obtaining a plurality of image features. The fully connected-layer group is for performing weight-based classification and outputting an inspection result.