A system and method for script and orientation detection of images using artificial neural networks (ANNs) are disclosed. In one example, textual content in the image is extracted. Further, a vertical component run (VCR) and horizontal component run (HCR) are obtained by vectorizing each connected component in the extracted textual content. Furthermore, a zonal density run (ZDR) is obtained for each connected component in the extracted textual content. In addition, a concatenated vertical document vector (VDV), horizontal document vector (HDV), and zonal density vector (ZDV) is computed by normalizing the obtained VCR, HCR, and ZDR, respectively, for each connected component. Moreover, the script in the image is determined using a script detection ANN module and the concatenated VDV, HDV, and ZDV of the image. Also, the orientation of the image is determined using an orientation detection ANN module and the concatenated VDV, HDV, and ZDV of the image.