When Kagaya introduced you to the Hashira the first thought you had was to fight. For Kagaya's sake, you'll save it for later.