The present invention is directed to optimized anti-CD3 variable sequences for use in a variety of bispecific formats, including those that utilize scFv components. The invention further relates to nucleic acids encoding for the polypeptide, to vectors comprising the same and to host cells comprising the vector. In another aspect, the invention provides for a pharmaceutical composition comprising the mentioned polypeptide and medical uses of the polypeptide.