The disclosure relates to system and method for providing assistance to a user using augmented reality. The method includes acquiring a video stream and a set of data associated with a task being performed by a user, in real-time, using a camera and/or a sensor device. The video stream includes sequential frames. The method further includes determining a present state associated with the task based on the sequential frames using an Artificial Neural Network (ANN) based action prediction model; determining scenarios and events corresponding to the scenarios based on the video stream and the set of data using an ANN based augmented intelligence model; and determining sequential instructions required for assisting the user to accomplish the task, dynamically, based on the present state and the events associated with the task, using at least one of a rule-based engine and an ANN based instruction prediction model.