A vehicle for interpreting a traffic scene is provided. The vehicle includes one or more sensors configured to capture an image of an external view of the vehicle, and a controller. The controller is configured to obtain the captured image of the external view of the vehicle from the one or more sensors, segment a plurality of instances from the captured image, determine relational information among the plurality of instances, and generate a hyper graph including a plurality of nodes representing the plurality of instances and a plurality of edges representing the relational information among the plurality of instances.