Embodiments of this disclosure provide a deep learning model used for driving behavior recognition and training apparatus and method thereof. In recognition, the model performs feature extraction by using a plurality of consecutive input images captured from a driving angle of view of a vehicle, and performs temporal and spatial fusion on extracted features by using a recursive neural network. In training, as images captured from a driving angle of view of a vehicle are acquired, the model may be trained. Hence, the model may accurately recognize various classes of driving behaviors.