I don't think it's a bad way to think.

[ It's not defiant; he wasn't being accusatory of her, or the comparison. ]

I just know, at least from getting to know people, sometimes where they came from isn't exactly where they want to go back to.