An electronic calculating apparatus for generating an interaction index map of an image, a method thereof and a non-transitory machine-readable medium thereof are provided. The electronic calculating apparatus includes a database and a processor electrically coupled to the database. The database stores a plurality of reference images. The processor sets at least one feature of the image, selects at least one candidate reference image from the plurality of reference images according to the at least one feature by a matching calculating procedure, transforms the at least one candidate reference image into at least one transformed candidate reference image, and generates a specific interaction index map of the image according to at least one interaction index map of the at least one transformed candidate reference image so that a displaying device executes the corresponding operation according to a user instruction by the specific interaction index map and side-information.