Available release Frigate 0.14, providing a means for creating network video recorders (NVR, Network Video Recorder) in real-time mode of analyzing videos transmitted from the IP chamber of video surveillance, as well as detecting and fixing changes and objects. The system can maintain images of people who passed the camera. To identify objects, a machine learning model is used on a local system without contacting external services. The platform code is written in Python and is distributed under the MIT license.
To process the images transmitted from the camera and define objects, OpenCV and Tensorflow are used. The system is optimized for minimal resource consumption and uses a multiprocess model of launching models. To reduce the load, the determination of objects is carried out only in relation to the determination of changes and movement. It is possible to integrate with various home automation systems supporting the MQTT protocol, such as Home Assistant and OpenHAB. Management is carried out through the Web interface, which can be integrated directly into the Home Assistant interface.
The features include a low level of false positives, the ability to separately determine objects (people, cars), support for the optional use of devices Google Coral TPU for acceleration of video processing in real-time (Frigate can process more than 100 object detection operations per second), the ability to define operation zones and the exact time of intrusion, a flexible alert system. The system also supports video relay and live viewing using WebRTC and RTSP, reducing the number of connections to the camera.
The new release features a fully rewritten user interface optimized for desktop and mobile systems. The interface allows users to quickly assess the current condition or recent events, access live camera feeds, evaluate the overall state of cameras, and view event history in the form of animated thumbnails. Support for authentication, roles (administrator, user), and proxy connections using Authelia, Authentik, and Oauth2_Proxy has been added.