I agree with you - I think his superficial charm comes off as a bit creepy, honestly. And I think (though it's been a while since I really paid attention to canon) that it's more what other people think of him, because they're not really paying attention very well. Which is interesting, and why I go for John/Teyla friendship every time, because she sees him, and he's used to people not bothering to look.