He wants to ask why, but doesn't want to ruin things by making her spell out stuff he might not want to hear. So he focuses on the hesitation instead - which isn't any more pleasant, but in different ways.

'You don' sound like you mean it.'

He sounds disappointed.

'Enjoyed las' night though, didn' you?'