System and methods are described to determining a recommendation for a user based on changes in objects detected on a network-connected surface. The system receives, from the network-connected surface, a plurality of object identifiers for a plurality of physically inanimate objects of different types detected on the network-connected surface, wherein the object identifiers indicate a positioning of each object; determines, based on the object identifiers, a first arrangement of the plurality of physically inanimate objects; detects one or more changes in the plurality of object identifiers, wherein the one or more changes correspond to one or more changes in positioning from the first arrangement; in response to detecting the one or more changes, determines a second arrangement of the plurality of physically inanimate objects; and generates a content recommendation based on the second arrangement.