A vehicle computing system may implement techniques to control a vehicle to avoid collisions between the vehicle and agents (e.g., dynamic objects) in an environment. The techniques may include generating a representation of a path of the vehicle through an environment as a polygon. The vehicle computing system may compare the two-dimensional path with a trajectory of an agent determined using sensor data to determine a collision zone between the vehicle and the agent. The vehicle computing system may determine a risk of collision based on predicted velocities and probable accelerations of the vehicle and the agent approaching and traveling through the collision zone. Based at least in part on the risk of collision, the vehicle computing system may cause the vehicle to perform an action.