A fence (10) comprising at least two spaced-apart substantially upright fence posts (12a, 12b) anchored into the ground or other fixed structure and a stack of at least two boards (14) extending between each pair of adjacent fence posts. Each board (14) extends in a substantially horizontal orientation relative to the upright fence posts and is supported at each end by a respective fence post (12a,12b). At least one pair of retaining components (16a,16b) are provided on each fence post (12a,12b) and each pair of retaining components forms a series of cavities that are each shaped to receive and retain a respective end of a board (14) of the stack to thereby support the respective end of the board (14) at the fence post (12a, 12b).