Provided is a real-time robot controlling system which includes a first layer comprising one or more control target devices; a second layer comprising a device control module controlling directly the devices at upper level of the first layer; a third layer comprising a shared memory connected to the device control module at upper level of the second layer; a fourth layer comprising one or more agents performing independent processes using the shared memory at upper level of the third layer; and a fifth layer controlling the one or more agents according to user commands at upper level of the fourth layer.