Turning Safety into Competence: Minimally Exploitable Robot Policies via Safety-Filtered Reinforcement Learning
arXiv preprint arXiv:2609.27312, 2026 · *Equal contribution
We propose Safety to Competence (S2C), a two-stage reinforcement learning framework that separates safety synthesis from competitive task learning. S2C learns a robust safety filter through adversarial RL, embeds it during task-policy training, and retains it at deployment. In simulated touchdown games and hardware stress tests against a human opponent, S2C improves competitive performance and reduces exploitability while maintaining safety.