Described are methods, systems, and apparatuses for 3D vision processing using an IP block. A vision processing module comprises an integrated circuit that performs one or more 3D vision processing algorithms and a plurality of controllers that couple the integrated circuit to each of: a sensor device, a processor, a memory module, and a network interface. The vision processing module receives image data from the sensor device, the image data corresponding to one or more images captured by the sensor device. The vision processing module executes one or more of the 3D vision processing algorithms using at least a portion of the image data as input. The vision processing module transmits an output from execution of one or more of the 3D vision processing algorithms to at least one of: the processor, the memory module, or the network interface.