A new technology of prediction of manipulability in response even to an instruction with missing information in an object manipulation task to have a robot manipulate some kind of object is provided. An instruction understanding system includes an obtaining engine configured to obtain a linguistic expression of a name of an object to be manipulated and a linguistic expression of a situation where the object corresponding to the name is placed in a real environment and a classifier configured to receive input of the linguistic expression of the name and the linguistic expression of the situation and output manipulability of the object corresponding to the name in the real environment.