The present invention discloses a solution for an intelligent video surveillance (IVS) system able to perform real-time analytics on internet protocol (IP) video streams which are directly ingested by the IVS system. An internet protocol camera can be identified and connected to the intelligent video surveillance system which lacks an intermediate video management component. The raw video stream can be received directly from the camera in the form of a real-time video stream such as real-time streaming protocol (RTSP). One or more real-time analytics can be performed on said video stream based on one or more system criteria and user established criteria. When an incident event is detected one or more programmatic actions can be performed in response to analytics enacted.