A system having a layered architecture for constructing dynamic social network from image data of actors and events. It may have a low layer for capturing raw data and identifying actors and events. The system may have a middle layer that receives actor and event information from the low layer and puts it in to a two dimensional matrix. A high layer of the system may add weighted relationship information to the matrix to form the basis for constructing a social network. The system may have a sliding window thus making the social network dynamic.