Chilling on RL with a broken controller