Advanced AI Features in UniFi Protect
UniFi Protect’s AI-powered security features provide motion detection, object classification, facial and license plate recognition, speech-to-text capabilities, and audio classifications to enhance surveillance. These advanced tools allow users to monitor security events efficiently, receive real-time alerts, and search footage with precision.
To learn more about setting AI-powered alerts in UniFi Protect, see our Alarm Manager guide here.
AI Features Overview
Most UniFi cameras support AI features natively, though the exact capabilities of each will vary from camera to camera. This article will let you know which features are supported by which models. For models that do not support certain features, as well as third-party cameras, AI Key and/or AI Port can enable these capabilities.
- The AI Port brings Protect’s advanced AI capabilities to a legacy or third-party camera. Once connected to your network, it can process video from any selected camera, regardless of its physical location. Learn more here.
- The AI Key processes smart detections from UniFi cameras (or third-party cameras connected via an AI Port) across your network. Learn more here.
Motion Detection
Detect any movement in designated areas and trigger alerts for potential security events.
- G3/G4/G5/AI Series: Supported natively.
- Third-Party Cameras: Requires AI Port.
Person, Vehicle, and Animal Detection
Identify different objects moving through the camera’s field and label them as people, vehicles or animals, to enhance search accuracy and enable automation. Additionally, use the Loitering feature to receive alerts or trigger audio alarms when a person or vehicle remains in a designated zone for a set duration.
- G3 Series: Requires AI Port.
- G4/G5/AI Series: Supported natively.
- Third-Party Cameras: Requires AI Port.
Package Detection
Recognize and alert users when a package is left in a designated area.
- G4 Doorbell Pro: Supported natively.
Vehicle Classification
Distinguish between different types of vehicles (cars, trucks, motorcycles) and detect vehicle colors. Search through your recordings for specific vehicle types and colors to find footage you are looking for.
- AI Port: Provides real-time processing for G3/G4/G5 Series & third-party cameras.
- AI Key: Provides post-processing on G4/G5 Series; there will be a delay in processing and notifications will not be instantaneous.
- AI Series: Supported natively.
License Plate Recognition (LPR)
Captures and logs license plates for automated tracking, security monitoring, and access control. Search through your recordings for specific license plate numbers to find what you are looking for, or set automated alarms when a specific license plate arrives on premises.
- AI Port: Provides real-time processing for G3/G4/G5 Series & third-party cameras.
- AI Key: Provides post-processing on G4/G5 Series; there will be a delay in processing and notifications will not be instantaneous. This delay varies based on the current processing queue and AI-Key load.
- AI Series Cameras: Supported (excluding 360-lens models).
- AI LPR: Specially designed camera optimized for dedicated license plate recognition at high speeds and in low-light situations, preventing glare from external light sources like headlights.
Facial Recognition
Identifies specific individuals, enabling access automation and enhanced monitoring to enhance search accuracy and alarm management.
- AI Port: Provides real-time processing for G3/G4/G5 Series & third-party cameras.
- AI Key: Provides post-processing on G4/G5 Series; there will be a delay in processing and notifications will not be instantaneous.
- AI Series: Supported (excluding 360-lens models).
Line Crossing Detection
Triggers alerts when motion crosses a defined virtual boundary, useful for perimeter security.
- G3 Series and Third-Party Cameras: Requires AI Port.
- G4/G5/AI Series: Supported natively (excluding PTZ).
Additionally, AI Series cameras natively support Line Crossing Counting, allowing you to track the number of times the boundary is crossed. G3/G4/G5 and Third-Party cameras can achieve this functionality when paired with an AI Port.
Audio-Based Detections
Recognizes alarms (CO/smoke detectors), speech, sirens, and other specific sounds to enhance situational awareness and optimize Alarm Manager.
CO & Smoke Detector Alarm Sound (based on standardized UL217 and UL2034 alarm patterns)
- G3 Series: Requires AI Port.
- G4/G5/AI Series: Supported natively.
- Third-Party Cameras: Requires AI Port and a microphone-equipped camera.
Siren, Car Horn, Car Alarm, Glass Break, Dog Barking
- G3/G4/G5 Series: Requires AI-Port
- AI Series: Supported natively.
- Third-Party Cameras: Requires AI-Port
Speech, Baby Crying
- G3 Series and Third-Party Cameras: Requires AI Port.
- G4/G5/AI Series: Supported natively.
Note: Audio-Based classifications will not work for cameras lacking a built-in microphone.
Speech-to-Text
Automatically converts spoken words from recorded footage into searchable text for faster reviews and security auditing.
- G3 Series and Third-Party Cameras: Requires AI Port and AI Key.
- G4/G5/AI Series Cameras: Requires AI Key.
Note: Speech-to-Text will not work for cameras lacking built-in microphones.
Find Anything Search
Uses AI-enhanced search to quickly locate relevant footage based on motion, objects, or spoken words.
- G3 Series: Requires AI Port and AI Key.
- G4/G5/AI Series: Requires AI Key.
- Third-Party Cameras: Requires AI Port and AI Key.
Optimize Your UniFi Protect AI Features
- Real-Time Alerts: Configure notifications for detected events. Learn more.
- Optimizing Recognition Accuracy: Improve face and plate detection over time. Read the guide.
- Exporting and A`rchiving Footage: Learn how to save and archive critical recordings. Read the guide.
- Dedicated License Plate Recognition: Set up AI-LPR for optimized license plate capture. Learn more.