A modular accessory system is structured to be mounted in a panel board including a housing assembly and a number of conductors with each conductor having a number of stabs extending therefrom. The modular accessory system includes an interface assembly structured to be selectively coupled to the panel board and a number of modules disposed on the interface assembly. Each module is structured to at least monitor or regulate one or more attributes of the panel board.