A method and system for padding an array of data on-the-fly in a direct memory access (DMA) controller. The method includes receiving the array of data in the DMA controller. The method also includes identifying edge groups of pixels at edges of the array of data and creating a padded region of data words along a periphery of the array of data. Each data word includes pixels of a corresponding edge group. The data words are then stored in a memory along with received array of data. Further, the method includes sending a request for padded data at a location in the memory, the padded data defining the array of data and the padded region of data words. Further, the method also includes translating the location of the padded data to addresses of one of, the data words and the array of data in the memory and retrieving the padded data at the addresses in the memory.