A technique for identifying RTP based traffic in routers and switches is disclosed. In one embodiment, a method of identifying RTP based traffic in routers and switches, includes receiving IP packets including a UDP header and a second header located substantially after the UDP header, generating statistical parameters by inspecting predetermined sequence of bits at predetermined offsets in the second header of each received IP packet for a predetermined number of IP packets, and determining whether the IP packet is an RTP based IP packet by comparing the generated statistical parameters to predetermined characteristics. The method also includes pre-filtering the received IP packets to allow only the IP packets comprising the UDP header and the second header to reach an RTP detection engine.