The present invention relates to an apparatus and a method for producing polycrystalline silicon having a reduced amount of boron compound impurities. Especially, the boron compounds are removed from the process for producing polycrystalline silicon, while the trichlorosilane is purified by distillation. The invention feeds condensed liquid trichlorosilane into a primary distillation tower below the liquid level inside the primary distillation tower thereby scrubbing the boron impurities upon contact inside the primary distillation tower. There result is trichlorosilane leaving the primary distillation tower with total amount of boron at least 10 times less.