The invention provides a sorting system and method based on machine vision. The system comprises a material conveying unit, a high-speed removing unit, a photoelectric sensing assembly and a calculation processing unit, wherein the material conveying unit is used for conveying materials and processing the arrangement of the materials, the photoelectric sensing assembly comprises a lighting deviceand a CCD camera, the high-speed removing unit comprises a high-speed pneumatic electromagnetic removing valve and a control circuit thereof, the calculation processing unit comprises an MCU, a data acquisition module, a data processing module and a result output module, the CCD camera is connected with the data acquisition module and is used for collecting image information of the materials and sending the image information to the data acquisition module, the data acquisition module is connected with the data processing module, the data processing module carries out real-time analysis and processing on the image information, the MCU is connected with the control circuit of the high-speed removing unit, and the control circuit controls opening and closing of the high-speed pneumatic electromagnetic removing valve. According to the system and method, the automation degree of a production line can be improved, the labor intensity is greatly reduced, and the removal effect is ensured.