A system enables dynamic linking between a variety of video formats including television broadcasts, web pages, and video displays which are stored on magnetic or optical media. Each frame of the video information is identified together with a plurality of locations within that frame. The locations selected by the user for example using a pointing device is then used to access associated information either within the system itself or on an external system. Thus, in some embodiments of the present invention, any item on a given frame may be linked initially or thereafter to other information within or without the particular system containing that information.