An image processing apparatus includes a plurality of video processors, a video memory for recording video data, and a plurality of ports. Each of the ports is connected between the video processor and the video memory, for accessing the video memory in response to supplied information. A plurality of memory map table units, each includes at least one table for being set with management information for managing a memory area of the video memory in which video data is recorded, for selectively supplying the management information set to the table to corresponding ports. A processing unit has a function of setting the management information to the table of the memory map table unit.