A transmitting apparatus and a receiving apparatus for visible light communication, and a visible light communication system are provided. The visible light communication system includes a transmitting apparatus and a receiving apparatus. The transmitting apparatus includes two transmitting modules. The transmitting modules include a plurality of visible light sources and a transmitting polarization plate. Polarizations of the two transmitting polarization plates are orthogonal to each other. The receiving apparatus includes two receiving modules. The receiving modules include a plurality of light detecting diodes and a receiving polarization plate. Polarizations of the paired receiving polarization plate and transmitting polarization plate are the same.