A swing set assembly having a swing set connector connected to a top rail is preferably provided which has a first cantilevered arm which connects to a top rail of at least two outer perimeters. Top rails are envisioned either fitting over the arm or in a bore the arm depending upon the outer perimeter of the top rail utilized. These and other embodiments are envisioned being of modular construction of a first half and a second half whether at an end of or between top rails. On the event that modification of the swing set is desired, an end half can be removed from a first half, and a top rail half connected thereto along with another top rail to extend the length of the total swing set. Alternatively, if a total top rail length is to be shortened, a top rail can be removed and a first half of the connector can be replaced with an end half.