System Architecture

MILIPOL VENUE (Remote)

Operator Dashboard

React/KlassUI, WHEP video, FR overlay, STT/TTS

VPN / Tailscale

KLUSTER PLATFORM (Onyx Lab)

DYNO Orchestrator :8000

Planner + Executor + State Machine

FR Server :42067

SCRFD + ViT + ByteTrack

TTS Server :8200

CosyVoice3 Singlish

STT (Kognigate) :43008

Whisper ASR

ROBOT (192.168.168.x)

Ghost PC (.105)

Motor control, Camera, IMU, MediaMTX :8889

Xavier PC (.205)

Edge Proxy :8080, Nav2, LiDAR, HDL Loc

WiFi to Lab Network

EXTERNAL SERVICES

modelapi.klass.dev

vLLM - Qwen3-Next-80B (planner + VLM)

KEY DATA FLOWS

Voice: Mic -> STT -> Orchestrator -> LLM -> Plan

Video: Camera -> MediaMTX -> WHEP -> Dashboard

FR: Camera -> Edge Proxy -> FR Server -> Dashboard

Nav: Orchestrator -> Edge Proxy -> Nav2 -> Robot