A visual web page analysis system includes an image analyzing unit, a block analyzing unit, a vision identifying unit, and an output unit. The image analyzing unit loads information of a web page and segments content of the web page into a plurality of blocks based on a visual feature. The block analyzing unit classifies the blocks based on an attribute of each block. The vision identifying unit compares at least a relative feature of each block to determine a function of each block on the web page. The output unit collects the blocks and their functions into an information interface and outputs the information interface.