A system and a method for detecting presence of a living hold in a video stream are disclosed. The method comprises pre-processing N consecutive frames for eliminating noise. An edge score may be calculated for the N consecutive frames, and a clip threshold primary and a clip threshold secondary may be defined. The method further comprises identifying primary edges and secondary edges in the N consecutive frames. Successively, a percentage of fixed primary edges and percentage of fixed secondary edges may be determined. Presence of the living hold may be confirmed based on the value of the percentage of fixed primary edges and the percentage of fixed secondary edges.