Face Recognition Pipeline
WORKING
Edge Proxy FR Loop (5 FPS) to FR Server to Bounding Box Detections to Dual Broadcast
Dashboard Features
- Real-time bbox overlay on WHEP video stream
- Toggleable FR overlay (FaceIcon on/off)
- Auto-scaling from native to display resolution
- Color-coded: blue (known) vs orange (unknown)
- Identity plus confidence labels
Orchestrator Integration
IDENTIFY_PERSON action triggers capture_frame to FR WebSocket to JSON detections to Broadcast to dashboard
Technical Details
FR Server: ws://kluster.klass.dev:42067
Model: SCRFD plus ViT plus ByteTrack
Protocol: Binary JPEG to JSON
Edge Proxy: 5 FPS continuous loop
Dual WS: /fr (dashboard) plus /edge (orchestrator)
FR Temporal Analyzer
Pattern detection across frames for consistent tracking
Video Source
MediaMTX: Ghost PC :8889
WHEP: /cam/whep endpoint
Network: VPN/Tailscale to Milipol venue