It does seem dodgy to me that he keeps going on about it.
I wouldn't be so suspicious if he made just one comment but, damn...