“He told you precisely that this is a casual thing.”
“You feel like you have to work on breaking down his walls.”