Graces Quarters – 2025
Dismounted Soldier-Robot Teaming and Threat Response with Multimodal AI
📌 Graces Quarters
This year our demonstration advanced beyond zero-visibility reconnaissance into dynamic soldier-robot teaming and AI-driven threat response. The system showcased a Spot robot autonomously following and mimicking a soldier using an Extended Kalman Filter–smoothed UWB localization fused with directional scanning. Upon detecting a threat, such as a bunker via a custom-trained object detection module and LLaVA-powered visual reasoning, the robot autonomously dispatched the soldier to investigate using voice-task able commands. Integration with Microsoft HoloLens enabled real-time visualization and imitation of soldier movement, completing a fully functional AI-driven tactical coordination loop. The demo marked a milestone in context-aware, multimodal situational awareness for dismounted operations.
